Why Tools for Buildings and Cities Performance Simulation Need to Evolve

Why Tools for Buildings and Cities Performance Simulation Need to Evolve

Simulation tools offer increased opportunities for understanding building performance, but also present significant challenges. To overcome the '7 deadly sins' associated with performance simulation tools, Joe Clarke argues that structural changes are needed involving the roles of construction industry, professional bodies, researchers and software developers.

Buildings are complex systems because their energy use and indoor environmental conditions vary dynamically under the stochastic influence of weather, occupants and component erraticisms. Addressing this complexity has been the principal driver of the evolution of performance simulation tools since the beginning of the personal computer era in the 1970s. Despite the significant progress that has been made since then – as evidenced, for example, by the array of tools posted at the Building Energy Software Tools directory – it is evident that a gap is growing between tool capability and the widening and deepening aspects of the clean energy transition as it affects buildings and cities. This unwelcome situation stems from the growing pressure to radically reduce city energy demand, integrate cleaner sources of energy supply, ensure that indoor/ outdoor spaces promote human wellbeing, and mitigate local / global environmental impacts; all while addressing interacting technical domains, diverse performance expectations and pervasive uncertainties. It is here contended that the ultimate goal of built environment performance simulation, when applied at whatever scale, is to provide practitioners with the means to emulate reality in a manner that renders operational resilience more likely. Such a capability portends a future in which the conjugate heat, air, moisture, light, sound, electricity, pollutant and control signal flows are simulated in an integrated manner on the basis of high resolution descriptions of proposed schemes subjected to industry standard performance assessment procedures. The merits of an approach that enables whole system, multi-variate performance appraisal under realistic operational scenarios cannot be understated. The challenge is to ensure that future performance simulation tools evolve in a reasonable time frame to provide the required functionality.

Creating such highly functional software tools, and embedding these within the design process, is a non-trivial task that is hindered by the present situation where the development community encompasses diverse technical and business interests and has yet to evolve mechanisms by which long term development goals can be agreed and collectively pursued. This situation gives rise to, and is exacerbated by, the ‘Seven Deadly Sins’ of software tool development as previously identified by Maver (1995) in the context of Computer-Aided Architectural Design, and here recast for building and city performance simulation.

1.   Macro-myopia

This relates to the often heard claim that a tool is all-singing, all-dancing and easy to use. However, there is no acknowledgement of a tool’s deficiencies, how these relate to the long term aspirations of the community, and how software is actually used. This situation derives from commercial and academic pressures on tool creators that make it difficult for them to admit that their product is other than uniquely state-of-the-art, to acknowledge that other tools may in some respects be more advanced at any point in time, and to engage more with the contributions from the wider community. Addressing this issue would, at the very least, act as a catalyst for developer collaboration and better tool interoperability.

2.   Déjà vu / amnesia

This is the re-emergence of ideas that have striking similarity to earlier work but with no attempt to openly acknowledge or build upon what went before. Inappropriately mentored newcomers to the field often proffer solutions that have been previously tried and rejected or, more problematic, expend considerable effort implementing methods that do not contribute any new assessment functionality. This situation is often compounded by ‘hiding’ such solutions behind user-friendly but misleading user interfaces.

3.   Xenophilia

This is the importing of concepts from other disciplines (most typically computer science) that divert intellectual effort from researching what lies at the heart of the buildings and cities performance simulation challenge. A common example is a tool with an elegant optimisation algorithm that acts on results from a simplified core that gives misleading outputs by design. The absence of city performance simulation as a core discipline makes it difficult to justify R&D funding resulting in slow progress and low impact.

4.   Non-sustainability

This is where the R&D effort is devoted to over-indulgent tool development, such as the reimplementation of existing methods corresponding to a new software engineering paradigm (such as object-oriented programming), with little attention given to researching design solutions that yield improved quality of performance to building clients and users. This results in ‘new’ tools of diminished capability when compared to what went before. Indeed, tool vendors, commercial or academic, are more likely to announce a ‘stunning new feature’ – BIM model import, legislation compliance support, user plug-in capability etc. – than invest effort in understanding how their tool can improve design solutions.

5.   Failure to validate

This is where a plethora of exotic claims relating to predictive preciseness are not subjected to any independent verification. In most other disciplines this situation is considered unacceptable. The existence of an independent tool accreditation agency or, at the very least, the requirement that tools encapsulate standard validation tests that can be activated by users, would do much to eliminate spurious claims and improve tool fidelity vis-à-vis the real world.

6.   Failure to evaluate

This is where there is no independent investigation of tool ease of use and applicability to real problems. The absence of credible user feedback means that future R&D is undirected and vulnerable to academic drift. The professional bodies could usefully take the lead in activities focused on applications requirements capture in order to identify necessary new functionality, bring forward application standards, and inform the content of training provisions for practitioners.

7.   Failure to criticise

This is where a community conspires to condone or even encourage self-indulgent speculation and solipsism: a bad example to set for the next generation of researchers and developers. A useful role for construction sector bodies would be to initiate activities that bring constructive criticism to bear on the capabilities and application deficiencies of all tools as a means to influence the funding bodies and thereby ensure a better future.

In summary, tool developers are forced to address disparate requirements relating to user interfaces, data model manipulation, mathematical models, numerical methods, database management, software engineering, outcome validation, user documentation and the like. Because there is limited development sharing, and since no single organisation will possess the necessary expertise in all areas, contemporary tools have substantial deficiencies relative to the reality. To compound the problem, tools are promoted by vendors in a manner that hides deficiencies and implicitly or otherwise undermines the development effort expended by others. This is an unacceptable situation that serves only to fragment the development effort. The consequence of such behaviours is a slow pace of change, lack of standards, unnecessary duplication of effort, tension between developers, and a plethora of software tools all with substantial shortcomings.

One professional body – the International Building Performance Simulation Association (IBPSA) – has taken action to address the above issues through the publication of a futures vision for the discipline (Clarke, 2015) and through the fostering of activities to direct the called-for developments. What is now needed is for the construction industry itself to take a proactive role in directing tool evolution and application. Such a role could usefully address questions such as:

  • What are the costs and benefits of the high resolution simulation approach?
  • How can a business identify the correct software tools for its needs?
  • Who should provide independent tool validation and accreditation?
  • How can modelling tools best be embedded within a business?
  • What are the different roles required from members of a simulation team?
  • What training will staff require and who can provide this?
  • In what ways will business work practices need to be adapted?
  • How are high resolution models constructed and quality-assured?
  • Where will I find approved databases for use in model definition?
  • How are models calibrated before use and documented and archived thereafter?
  • What are the requirements for standard performance assessments?
  • What performance criteria should be used to appraise overall performance?
  • What are the business risks and rewards associated with investing in the technology?

Some progress in these regards has already been made with professional bodies such as CIBSE and ASHRAE establishing mechanisms to support tool use in practice – such as the work of the Building Simulation & Energy Modelling group and Building Energy Modelling Professional Certification programme respectively. In a recent project, a CIBSE-led initiative involving industry and academic partners set out to establish an approach to the automated assessment of the operational resilience of submitted proposals (Clarke and Cowie, 2020) based on long term simulation.

Only by guarding against the 7 Deadly Sins and finding answers to pertinent questions such as those listed above, will performance simulation tools become demonstrably quicker, cheaper and better than the traditional approaches to design options appraisal that they seek to replace. That is an exciting prospect for the construction industry: improved performance through an easy to access, low cost computational approach to buildings and cities performance quality assurance at the design/ retrofit stage.



References

Clarke J A (2015) ‘A vision for building performance simulation: a position paper prepared on behalf of the IBPSA Board’, Building Performance Simulation, 8(2), pp. 39-43.

Clarke J A and Cowie A (2020, forthcoming) ‘A simulation-based procedure for building operational resilience testing’, Proceedings CIBSE / ASHRAE Technical Symposium, Glasgow, UK, 16-17 April.

Maver T W (1995) ‘CAAD’s Seven Deadly Sins’, Proceedings 6th International Conference on Computer-Aided Architectural Design Futures - Global Design Studio (Eds M Tan and R Tey), National University of Singapore, Singapore, 24-26 Sept., pp. 21-22.

Latest Peer-Reviewed Journal Content

Journal Content

Health inequalities and indoor environments: research challenges and priorities [editorial]
M Ucci & A Mavrogianni

Operationalising energy sufficiency for low-carbon built environments in urbanising India
A B Lall & G Sethi

Promoting practices of sufficiency: reprogramming resource-intensive material arrangements
T H Christensen, L K Aagaard, A K Juvik, C Samson & K Gram-Hanssen

Culture change in the UK construction industry: an anthropological perspective
I Tellam

Are people willing to share living space? Household preferences in Finland
E Ruokamo, E Kylkilahti, M Lettenmeier & A Toppinen

Towards urban LCA: examining densification alternatives for a residential neighbourhood
M Moisio, E Salmio, T Kaasalainen, S Huuhka, A Räsänen, J Lahdensivu, M Leppänen & P Kuula

A population-level framework to estimate unequal exposure to indoor heat and air pollution
R Cole, C H Simpson, L Ferguson, P Symonds, J Taylor, C Heaviside, P Murage, H L Macintyre, S Hajat, A Mavrogianni & M Davies

Finnish glazed balconies: residents’ experience, wellbeing and use
L Jegard, R Castaño-Rosa, S Kilpeläinen & S Pelsmakers

Modelling Nigerian residential dwellings: bottom-up approach and scenario analysis
C C Nwagwu, S Akin & E G Hertwich

Mapping municipal land policies: applications of flexible zoning for densification
V Götze, J-D Gerber & M Jehling

Energy sufficiency and recognition justice: a study of household consumption
A Guilbert

Linking housing, socio-demographic, environmental and mental health data at scale
P Symonds, C H Simpson, G Petrou, L Ferguson, A Mavrogianni & M Davies

Measuring health inequities due to housing characteristics
K Govertsen & M Kane

Provide or prevent? Exploring sufficiency imaginaries within Danish systems of provision
L K Aagaard & T H Christensen

Imagining sufficiency through collective changes as satisfiers
O Moynat & M Sahakian

US urban land-use reform: a strategy for energy sufficiency
Z M Subin, J Lombardi, R Muralidharan, J Korn, J Malik, T Pullen, M Wei & T Hong

Mapping supply chains for energy retrofit
F Wade & Y Han

Operationalising building-related energy sufficiency measures in SMEs
I Fouiteh, J D Cabrera Santelices, A Susini & M K Patel

Promoting neighbourhood sharing: infrastructures of convenience and community
A Huber, H Heinrichs & M Jaeger-Erben

New insights into thermal comfort sufficiency in dwellings
G van Moeseke, D de Grave, A Anciaux, J Sobczak & G Wallenborn

‘Rightsize’: a housing design game for spatial and energy sufficiency
P Graham, P Nourian, E Warwick & M Gath-Morad

Implementing housing policies for a sufficient lifestyle
M Bagheri, L Roth, L Siebke, C Rohde & H-J Linke

The jobs of climate adaptation
T Denham, L Rickards & O Ajulo

Structural barriers to sufficiency: the contribution of research on elites
M Koch, K Emilsson, J Lee & H Johansson

Life-cycle GHG emissions of standard houses in Thailand
B Viriyaroj, M Kuittinen & S H Gheewala

IAQ and environmental health literacy: lived experiences of vulnerable people
C Smith, A Drinkwater, M Modlich, D van der Horst & R Doherty

Living smaller: acceptance, effects and structural factors in the EU
M Lehner, J L Richter, H Kreinin, P Mamut, E Vadovics, J Henman, O Mont & D Fuchs

Disrupting the imaginaries of urban action to deliver just adaptation [editorial]
V Castán-Broto, M Olazabal & G Ziervogel

Building energy use in COVID-19 lockdowns: did much change?
F Hollick, D Humphrey, T Oreszczyn, C Elwell & G Huebner

Evaluating past and future building operational emissions: improved method
S Huuhka, M Moisio & M Arnould

Normative future visioning: a critical pedagogy for transformative adaptation
T Comelli, M Pelling, M Hope, J Ensor, M E Filippi, E Y Menteşe & J McCloskey

Nature for resilience reconfigured: global- to-local translation of frames in Africa
K Rochell, H Bulkeley & H Runhaar

How hegemonic discourses of sustainability influence urban climate action
V Castán Broto, L Westman & P Huang

Fabric first: is it still the right approach?
N Eyre, T Fawcett, M Topouzi, G Killip, T Oreszczyn, K Jenkinson & J Rosenow

Social value of the built environment [editorial]
F Samuel & K Watson

Understanding demolition [editorial]
S Huuhka

Data politics in the built environment [editorial]
A Karvonen & T Hargreaves

See all

Latest Commentaries

5th Anniversary Essays

5th Anniversary Essays

These commissioned essays from Buildings & Cities' authors and readers explore how the research landscape is changing. New essays are continuously being added to the collection during 2024 as part of B&C's anniversary.

Collectively, these essays offer fresh insights into the processes and issues that are currently inadequate or missing in the built environment research landscape. A wide perspective from different disciplines and geographies creates a positive, collective vision for shaping the research agenda. Recommendations are made for what needs to change.

We hope this will provoke and inspire research funders, researchers and other stakeholders to discuss, reflect and act. Ideas range from systemic change to key research questions to improving engagement to change of focus.

The Challenges of Evidence-Based Design

While some progress has been made, particularly in areas like healing architecture where the impact of design on human well-being is more directly observable, much work remains to be done to extend evidence-based design to broader fields of architecture, urban planning and design. Meta Berghauser Pont (Chalmers University of Technology) explains the challenges and pathways needed for a shift toward evidence-based design in urban planning and urban design.

Join Our Community