Challenges ahead: collecting, managing, integrating and sharing comprehensible findings on actual performance from cradle to grave
Adrian Leaman (Usable Buildings) reflects on the Probe research project, drawing lessons for the architectural and building research challenges ahead. He advocates practice-based, real-world, case-study research with a positive commitment of all concerned to qualitative improvement for the public and private good using a more engaged professional support system.
The multi-disciplinary project that gave flesh to this approach was Probe - ’Post-Occupancy Review of Buildings and their Engineering" (nowadays we would substitute ’Environment‘ for "Engineering‘). The project outputs are archived in the Probe section of usablebuildings.co.uk . There were twenty-three building studies in all, and five final report papers. One of these, Final Report 4, was subtitled "Strategic Conclusions: Get Real About Building Performance". From this comes a summary diagram of "pointers" for the future, which we called ’the Probe Nine’ (Figure 1). We said in 1999:
’It is vital to integrate space, time and performance issues, to design for usability and manageability, and to know who owns which problems. Often one finds too much concentration on the means (the building) than on the benefits it will bring to the occupiers; and what it will demand of them. Consequently, there can be a loss of grip on overall mission. Expectations of buildings by clients, designers and occupants can easily be unrealistic, with unresolved problems “parked” in the areas of greatest ignorance. Examples are enthusiasm about the promises of new technology, but not assessing possible downside risks; relying too much on management without considering the effort and costs involved; and not addressing possible needs for fine-tune once a building is occupied.’
Looking at Figure 1, on the left are the ends, where the commissioning client and user client usually stand. On the right are the means: the buildings and the designers, contractors, suppliers and others who provide and service them. In design situations, often the spotlight falls on the building as an end in itself, rather than the means to the occupier’s ends. In the middle are linking tools based on feedback, helping to build bridges between the ends and the means, the demand-side and the supply-side.
Where is this leading? The key is how feedback works, and how it is professionally managed. This is the territory of virtuous and vicious circles, chronic and acute performance problems, reputational damage, hiding the bad news, shooting the messenger. Probe was a case in point. We included an opportunity for design teams to respond to the study findings, and published these alongside our own building assessments. That way we could talk about faults openly, not just successes. The design team still had some control over the narrative, but we did not shirk discussion of perceived failures. A viable and useful knowledge system has processes which link means to ends via performance feedback protocols. This is second-nature to many risk- averse professions and industries, like medicine or transportation. The reason why there is so much dissonance in architecture and construction - between academia and design practice, professional skill sets, historic and modern building practice and research funding, amongst several more - is the embedded reticence towards formal routine feedback.
This means academia needs to work with industry to produce more relevant research outputs devoid of unnecessary jargon, such as the briefing notes introduced by Buildings & Cities, rather than expecting research articles are all that is needed. The same applies to statistical tables, diagrams and architectural plans. Communicating in different mediums can be challenging for authors and researchers, but essential if a better grip on ends, needs, purpose, strategy and the other features that clients need to consider in a building brief. Academia needs to be much more tolerant of real-world research outside the laboratory and more skeptical of over-optimism with computer modelling and big data.
Downwind of Probe we were well aware that 'Making feedback routine' was vital for progress. Many of the initiatives we considered, encouraged or attempted are described in Bordass et al. (2004):
‘After many false dawns, it now seems possible that feedback and post-occupancy evaluation will begin to become more routine – promising better, nicer, more productive, more cost-effective and more sustainable buildings which are better suited to the needs of their users. It will be a long haul, but clients, designers and government are becoming more interested in building performance and some are already requiring or offering aftercare services.’
We created the Usable Buildings Trust, hoping that its impetus would lead to new social institutions devoted to promoting research, training and education. The rump of that initiative is the usablebuildings.co.uk website. This hosts building case studies which can safely be placed in the public domain, together with other Probe-inspired projects like Soft Landings and New Professionalism, plus presentations and support material. The timeline (Usable Buildings n.d.) records where we went with this.
Realistically, progress has been tangible, but far slower than we would have expected or liked. In the middle of it all on 14 June 2017 came the tragic circumstances of the Grenfell Tower fire. We now have a better understanding of the venality and greed of the main perpetrators (Grenfell Tower Inquiry 2024). But even with the Inquiry's forensic investigations, extensive recommendations and the benefit of hindsight, we can still see that there is far too much focus on a self-serving construction industry.
Taking a needs-focused social and environmental view might still have meant that tower blocks would be built in the first place, but only as long as there were management resources secured and in place to run them effectively. What you certainly don't do is to add unmanageable complexity to an already fragile system in the name of "improvement" thereby multiplying the chances that things will go wrong.
On this basis it is obvious where we need to go in the future. Far more effort needs to go into areas that have normally been the province of applied social science. These include:
As for Probe, we look back more at lost opportunities than successes. At the time, further funding was denied us because the work could not be framed as 'innovative'. We were suggesting perhaps two new Probe studies annually, carried out by the ad hoc multi-professional team working without the inflated administrative and cost overheads of the university sector. At a conservative estimate that might have contributed a further 50 case studies, together with the designers' responses to the findings.
Making feedback routine would have been the simplest, fastest and most cost-effective way of repairing the systemic breakdown that has manifest its worst features in a mendacious building industry. However, momentum may still be there for that to happen. The lessons from Grenfell yet again show why feedback research is vital to ensure that buildings are designed, built and operated robustly and with low risk. Such knowledge is needed by regulators, practitioners and society. It’s time for research funders to reframe their notions of “innovation” to include a feedback research programme.
Bordass W., Derbyshire A., Eley J. & Leaman A. (2004). Beyond Probe: Making Feedback Routine. Conference: Closing the Loop: Post-Occupancy Evaluation: the Next Steps, 29 April - 2 May 2004, Windsor, UK. https://www.usablebuildings.co.uk/UsableBuildings/Unprotected/BeyondProbe.pdf
Grenfell Tower Inquiry. (2024). Phase 2 report, September 2004, London: House of Commons. https://www.grenfelltowerinquiry.org.uk/phase-2-report
Leaman A., Bordass W. & Ruyssevelt P. (1999). Probe Final Report 4: Strategic Conclusions: Get Real About Building Performance. https://www.usablebuildings.co.uk/UsableBuildings/Unprotected/Probe/ProbePDFs/SR4.pdf
Usable Buildings. (n.d.). Probe archive. https://www.usablebuildings.co.uk/UsableBuildings/ProbeListAll.html
Usable Buildings. (n.d.). Usable Buildings Timeline. https://www.usablebuildings.co.uk/UsableBuildings/Timeline.html
Young Foundation. (2024). Shaping a fairer future. https://www.youngfoundation.org
Health inequalities and indoor environments: research challenges and priorities [editorial]
M Ucci & A Mavrogianni
Operationalising energy sufficiency for low-carbon built environments in urbanising India
A B Lall & G Sethi
Promoting practices of sufficiency: reprogramming resource-intensive material arrangements
T H Christensen, L K Aagaard, A K Juvik, C Samson & K Gram-Hanssen
Culture change in the UK construction industry: an anthropological perspective
I Tellam
Are people willing to share living space? Household preferences in Finland
E Ruokamo, E Kylkilahti, M Lettenmeier & A Toppinen
Towards urban LCA: examining densification alternatives for a residential neighbourhood
M Moisio, E Salmio, T Kaasalainen, S Huuhka, A Räsänen, J Lahdensivu, M Leppänen & P Kuula
A population-level framework to estimate unequal exposure to indoor heat and air pollution
R Cole, C H Simpson, L Ferguson, P Symonds, J Taylor, C Heaviside, P Murage, H L Macintyre, S Hajat, A Mavrogianni & M Davies
Finnish glazed balconies: residents’ experience, wellbeing and use
L Jegard, R Castaño-Rosa, S Kilpeläinen & S Pelsmakers
Modelling Nigerian residential dwellings: bottom-up approach and scenario analysis
C C Nwagwu, S Akin & E G Hertwich
Mapping municipal land policies: applications of flexible zoning for densification
V Götze, J-D Gerber & M Jehling
Energy sufficiency and recognition justice: a study of household consumption
A Guilbert
Linking housing, socio-demographic, environmental and mental health data at scale
P Symonds, C H Simpson, G Petrou, L Ferguson, A Mavrogianni & M Davies
Measuring health inequities due to housing characteristics
K Govertsen & M Kane
Provide or prevent? Exploring sufficiency imaginaries within Danish systems of provision
L K Aagaard & T H Christensen
Imagining sufficiency through collective changes as satisfiers
O Moynat & M Sahakian
US urban land-use reform: a strategy for energy sufficiency
Z M Subin, J Lombardi, R Muralidharan, J Korn, J Malik, T Pullen, M Wei & T Hong
Mapping supply chains for energy retrofit
F Wade & Y Han
Operationalising building-related energy sufficiency measures in SMEs
I Fouiteh, J D Cabrera Santelices, A Susini & M K Patel
Promoting neighbourhood sharing: infrastructures of convenience and community
A Huber, H Heinrichs & M Jaeger-Erben
New insights into thermal comfort sufficiency in dwellings
G van Moeseke, D de Grave, A Anciaux, J Sobczak & G Wallenborn
‘Rightsize’: a housing design game for spatial and energy sufficiency
P Graham, P Nourian, E Warwick & M Gath-Morad
Implementing housing policies for a sufficient lifestyle
M Bagheri, L Roth, L Siebke, C Rohde & H-J Linke
The jobs of climate adaptation
T Denham, L Rickards & O Ajulo
Structural barriers to sufficiency: the contribution of research on elites
M Koch, K Emilsson, J Lee & H Johansson
Life-cycle GHG emissions of standard houses in Thailand
B Viriyaroj, M Kuittinen & S H Gheewala
IAQ and environmental health literacy: lived experiences of vulnerable people
C Smith, A Drinkwater, M Modlich, D van der Horst & R Doherty
Living smaller: acceptance, effects and structural factors in the EU
M Lehner, J L Richter, H Kreinin, P Mamut, E Vadovics, J Henman, O Mont & D Fuchs
Disrupting the imaginaries of urban action to deliver just adaptation [editorial]
V Castán-Broto, M Olazabal & G Ziervogel
Building energy use in COVID-19 lockdowns: did much change?
F Hollick, D Humphrey, T Oreszczyn, C Elwell & G Huebner
Evaluating past and future building operational emissions: improved method
S Huuhka, M Moisio & M Arnould
Normative future visioning: a critical pedagogy for transformative adaptation
T Comelli, M Pelling, M Hope, J Ensor, M E Filippi, E Y Menteşe & J McCloskey
Nature for resilience reconfigured: global- to-local translation of frames in Africa
K Rochell, H Bulkeley & H Runhaar
How hegemonic discourses of sustainability influence urban climate action
V Castán Broto, L Westman & P Huang
Fabric first: is it still the right approach?
N Eyre, T Fawcett, M Topouzi, G Killip, T Oreszczyn, K Jenkinson & J Rosenow
Social value of the built environment [editorial]
F Samuel & K Watson
Understanding demolition [editorial]
S Huuhka
Data politics in the built environment [editorial]
A Karvonen & T Hargreaves
Latest Commentaries
5th Anniversary Essays
These commissioned essays from Buildings & Cities' authors and readers explore how the research landscape is changing. New essays are continuously being added to the collection during 2024 as part of B&C's anniversary.
Collectively, these essays offer fresh insights into the processes and issues that are currently inadequate or missing in the built environment research landscape. A wide perspective from different disciplines and geographies creates a positive, collective vision for shaping the research agenda. Recommendations are made for what needs to change.
We hope this will provoke and inspire research funders, researchers and other stakeholders to discuss, reflect and act. Ideas range from systemic change to key research questions to improving engagement to change of focus.
The Challenges of Evidence-Based Design
While some progress has been made, particularly in areas like healing architecture where the impact of design on human well-being is more directly observable, much work remains to be done to extend evidence-based design to broader fields of architecture, urban planning and design. Meta Berghauser Pont (Chalmers University of Technology) explains the challenges and pathways needed for a shift toward evidence-based design in urban planning and urban design.