Simulation tools offer increased opportunities for understanding building performance, but also present significant challenges. To overcome the '7 deadly sins' associated with performance simulation tools, Joe Clarke argues that structural changes are needed involving the roles of construction industry, professional bodies, researchers and software developers.
Buildings are complex systems because their energy use and indoor environmental conditions vary dynamically under the stochastic influence of weather, occupants and component erraticisms. Addressing this complexity has been the principal driver of the evolution of performance simulation tools since the beginning of the personal computer era in the 1970s. Despite the significant progress that has been made since then – as evidenced, for example, by the array of tools posted at the Building Energy Software Tools directory – it is evident that a gap is growing between tool capability and the widening and deepening aspects of the clean energy transition as it affects buildings and cities. This unwelcome situation stems from the growing pressure to radically reduce city energy demand, integrate cleaner sources of energy supply, ensure that indoor/ outdoor spaces promote human wellbeing, and mitigate local / global environmental impacts; all while addressing interacting technical domains, diverse performance expectations and pervasive uncertainties. It is here contended that the ultimate goal of built environment performance simulation, when applied at whatever scale, is to provide practitioners with the means to emulate reality in a manner that renders operational resilience more likely. Such a capability portends a future in which the conjugate heat, air, moisture, light, sound, electricity, pollutant and control signal flows are simulated in an integrated manner on the basis of high resolution descriptions of proposed schemes subjected to industry standard performance assessment procedures. The merits of an approach that enables whole system, multi-variate performance appraisal under realistic operational scenarios cannot be understated. The challenge is to ensure that future performance simulation tools evolve in a reasonable time frame to provide the required functionality.
Creating such highly functional software tools, and embedding these within the design process, is a non-trivial task that is hindered by the present situation where the development community encompasses diverse technical and business interests and has yet to evolve mechanisms by which long term development goals can be agreed and collectively pursued. This situation gives rise to, and is exacerbated by, the ‘Seven Deadly Sins’ of software tool development as previously identified by Maver (1995) in the context of Computer-Aided Architectural Design, and here recast for building and city performance simulation.
This relates to the often heard claim that a tool is all-singing, all-dancing and easy to use. However, there is no acknowledgement of a tool’s deficiencies, how these relate to the long term aspirations of the community, and how software is actually used. This situation derives from commercial and academic pressures on tool creators that make it difficult for them to admit that their product is other than uniquely state-of-the-art, to acknowledge that other tools may in some respects be more advanced at any point in time, and to engage more with the contributions from the wider community. Addressing this issue would, at the very least, act as a catalyst for developer collaboration and better tool interoperability.
This is the re-emergence of ideas that have striking similarity to earlier work but with no attempt to openly acknowledge or build upon what went before. Inappropriately mentored newcomers to the field often proffer solutions that have been previously tried and rejected or, more problematic, expend considerable effort implementing methods that do not contribute any new assessment functionality. This situation is often compounded by ‘hiding’ such solutions behind user-friendly but misleading user interfaces.
This is the importing of concepts from other disciplines (most typically computer science) that divert intellectual effort from researching what lies at the heart of the buildings and cities performance simulation challenge. A common example is a tool with an elegant optimisation algorithm that acts on results from a simplified core that gives misleading outputs by design. The absence of city performance simulation as a core discipline makes it difficult to justify R&D funding resulting in slow progress and low impact.
This is where the R&D effort is devoted to over-indulgent tool development, such as the reimplementation of existing methods corresponding to a new software engineering paradigm (such as object-oriented programming), with little attention given to researching design solutions that yield improved quality of performance to building clients and users. This results in ‘new’ tools of diminished capability when compared to what went before. Indeed, tool vendors, commercial or academic, are more likely to announce a ‘stunning new feature’ – BIM model import, legislation compliance support, user plug-in capability etc. – than invest effort in understanding how their tool can improve design solutions.
This is where a plethora of exotic claims relating to predictive preciseness
are not subjected to any independent verification. In most other disciplines
this situation is considered unacceptable. The existence of an independent tool
accreditation agency or, at the very least, the requirement that tools
encapsulate standard validation tests that can be activated by users, would do
much to eliminate spurious claims and improve tool fidelity vis-à-vis the real
world.
This is where there is no independent investigation of tool ease of use
and applicability to real problems. The absence of credible user feedback means
that future R&D is undirected and vulnerable to academic drift. The
professional bodies could usefully take the lead in activities focused on applications
requirements capture in order to identify necessary new functionality, bring
forward application standards, and inform the content of training provisions
for practitioners.
This is where a community conspires to condone or even encourage self-indulgent speculation and solipsism: a bad example to set for the next generation of researchers and developers. A useful role for construction sector bodies would be to initiate activities that bring constructive criticism to bear on the capabilities and application deficiencies of all tools as a means to influence the funding bodies and thereby ensure a better future.
In summary, tool
developers are forced to address disparate requirements relating to user
interfaces, data model manipulation, mathematical models, numerical methods,
database management, software engineering, outcome validation, user documentation
and the like. Because there is limited development sharing, and since no single
organisation will possess the necessary expertise in all areas, contemporary
tools have substantial deficiencies relative to the reality. To compound the
problem, tools are promoted by vendors in a manner that hides deficiencies and
implicitly or otherwise undermines the development effort expended by others.
This is an unacceptable situation that serves only to fragment the development
effort. The consequence of such
behaviours is a slow pace of change, lack of standards, unnecessary duplication
of effort, tension between developers, and a plethora of software tools all
with substantial shortcomings.
One professional body – the International Building Performance Simulation Association (IBPSA) – has taken action to address the above issues through the publication of a futures vision for the discipline (Clarke, 2015) and through the fostering of activities to direct the called-for developments. What is now needed is for the construction industry itself to take a proactive role in directing tool evolution and application. Such a role could usefully address questions such as:
Some progress in these regards has already been made with professional bodies such as CIBSE and ASHRAE establishing mechanisms to support tool use in practice – such as the work of the Building Simulation & Energy Modelling group and Building Energy Modelling Professional Certification programme respectively. In a recent project, a CIBSE-led initiative involving industry and academic partners set out to establish an approach to the automated assessment of the operational resilience of submitted proposals (Clarke and Cowie, 2020) based on long term simulation.
Only by guarding
against the 7 Deadly Sins and finding answers to pertinent questions such as
those listed above, will performance simulation
tools become demonstrably quicker, cheaper and better than the traditional
approaches to design options appraisal that they seek to replace. That is an
exciting prospect for the construction industry: improved performance through
an easy to access, low cost computational approach to buildings and cities
performance quality assurance at the design/ retrofit stage.
Clarke J A (2015) ‘A vision for building performance simulation: a position paper prepared on behalf of
the IBPSA Board’, Building Performance Simulation, 8(2), pp. 39-43.
Clarke J A and Cowie A (2020, forthcoming) ‘A simulation-based procedure
for building operational resilience testing’, Proceedings CIBSE / ASHRAE Technical Symposium, Glasgow, UK, 16-17 April.
Maver T W (1995) ‘CAAD’s Seven Deadly Sins’, Proceedings 6th International Conference on Computer-Aided Architectural Design Futures - Global Design Studio (Eds M Tan and R Tey), National University of Singapore, Singapore, 24-26 Sept., pp. 21-22.
Health inequalities and indoor environments: research challenges and priorities [editorial]
M Ucci & A Mavrogianni
Operationalising energy sufficiency for low-carbon built environments in urbanising India
A B Lall & G Sethi
Promoting practices of sufficiency: reprogramming resource-intensive material arrangements
T H Christensen, L K Aagaard, A K Juvik, C Samson & K Gram-Hanssen
Culture change in the UK construction industry: an anthropological perspective
I Tellam
Are people willing to share living space? Household preferences in Finland
E Ruokamo, E Kylkilahti, M Lettenmeier & A Toppinen
Towards urban LCA: examining densification alternatives for a residential neighbourhood
M Moisio, E Salmio, T Kaasalainen, S Huuhka, A Räsänen, J Lahdensivu, M Leppänen & P Kuula
A population-level framework to estimate unequal exposure to indoor heat and air pollution
R Cole, C H Simpson, L Ferguson, P Symonds, J Taylor, C Heaviside, P Murage, H L Macintyre, S Hajat, A Mavrogianni & M Davies
Finnish glazed balconies: residents’ experience, wellbeing and use
L Jegard, R Castaño-Rosa, S Kilpeläinen & S Pelsmakers
Modelling Nigerian residential dwellings: bottom-up approach and scenario analysis
C C Nwagwu, S Akin & E G Hertwich
Mapping municipal land policies: applications of flexible zoning for densification
V Götze, J-D Gerber & M Jehling
Energy sufficiency and recognition justice: a study of household consumption
A Guilbert
Linking housing, socio-demographic, environmental and mental health data at scale
P Symonds, C H Simpson, G Petrou, L Ferguson, A Mavrogianni & M Davies
Measuring health inequities due to housing characteristics
K Govertsen & M Kane
Provide or prevent? Exploring sufficiency imaginaries within Danish systems of provision
L K Aagaard & T H Christensen
Imagining sufficiency through collective changes as satisfiers
O Moynat & M Sahakian
US urban land-use reform: a strategy for energy sufficiency
Z M Subin, J Lombardi, R Muralidharan, J Korn, J Malik, T Pullen, M Wei & T Hong
Mapping supply chains for energy retrofit
F Wade & Y Han
Operationalising building-related energy sufficiency measures in SMEs
I Fouiteh, J D Cabrera Santelices, A Susini & M K Patel
Promoting neighbourhood sharing: infrastructures of convenience and community
A Huber, H Heinrichs & M Jaeger-Erben
New insights into thermal comfort sufficiency in dwellings
G van Moeseke, D de Grave, A Anciaux, J Sobczak & G Wallenborn
‘Rightsize’: a housing design game for spatial and energy sufficiency
P Graham, P Nourian, E Warwick & M Gath-Morad
Implementing housing policies for a sufficient lifestyle
M Bagheri, L Roth, L Siebke, C Rohde & H-J Linke
The jobs of climate adaptation
T Denham, L Rickards & O Ajulo
Structural barriers to sufficiency: the contribution of research on elites
M Koch, K Emilsson, J Lee & H Johansson
Life-cycle GHG emissions of standard houses in Thailand
B Viriyaroj, M Kuittinen & S H Gheewala
IAQ and environmental health literacy: lived experiences of vulnerable people
C Smith, A Drinkwater, M Modlich, D van der Horst & R Doherty
Living smaller: acceptance, effects and structural factors in the EU
M Lehner, J L Richter, H Kreinin, P Mamut, E Vadovics, J Henman, O Mont & D Fuchs
Disrupting the imaginaries of urban action to deliver just adaptation [editorial]
V Castán-Broto, M Olazabal & G Ziervogel
Building energy use in COVID-19 lockdowns: did much change?
F Hollick, D Humphrey, T Oreszczyn, C Elwell & G Huebner
Evaluating past and future building operational emissions: improved method
S Huuhka, M Moisio & M Arnould
Normative future visioning: a critical pedagogy for transformative adaptation
T Comelli, M Pelling, M Hope, J Ensor, M E Filippi, E Y Menteşe & J McCloskey
Nature for resilience reconfigured: global- to-local translation of frames in Africa
K Rochell, H Bulkeley & H Runhaar
How hegemonic discourses of sustainability influence urban climate action
V Castán Broto, L Westman & P Huang
Fabric first: is it still the right approach?
N Eyre, T Fawcett, M Topouzi, G Killip, T Oreszczyn, K Jenkinson & J Rosenow
Social value of the built environment [editorial]
F Samuel & K Watson
Understanding demolition [editorial]
S Huuhka
Data politics in the built environment [editorial]
A Karvonen & T Hargreaves
Latest Commentaries
5th Anniversary Essays
These commissioned essays from Buildings & Cities' authors and readers explore how the research landscape is changing. New essays are continuously being added to the collection during 2024 as part of B&C's anniversary.
Collectively, these essays offer fresh insights into the processes and issues that are currently inadequate or missing in the built environment research landscape. A wide perspective from different disciplines and geographies creates a positive, collective vision for shaping the research agenda. Recommendations are made for what needs to change.
We hope this will provoke and inspire research funders, researchers and other stakeholders to discuss, reflect and act. Ideas range from systemic change to key research questions to improving engagement to change of focus.
The Challenges of Evidence-Based Design
While some progress has been made, particularly in areas like healing architecture where the impact of design on human well-being is more directly observable, much work remains to be done to extend evidence-based design to broader fields of architecture, urban planning and design. Meta Berghauser Pont (Chalmers University of Technology) explains the challenges and pathways needed for a shift toward evidence-based design in urban planning and urban design.