Integrating Feedback into Research and Practice

Integrating Feedback into Research and Practice

Challenges ahead: collecting, managing, integrating and sharing comprehensible findings on actual performance from cradle to grave

Adrian Leaman (Usable Buildings) reflects on the Probe research project, drawing lessons for the architectural and building research challenges ahead. He advocates practice-based, real-world, case-study research with a positive commitment of all concerned to qualitative improvement for the public and private good using a more engaged professional support system. 

The multi-disciplinary project that gave flesh to this approach was Probe - ’Post-Occupancy Review of Buildings and their Engineering" (nowadays we would substitute ’Environment‘ for "Engineering‘).  The project outputs are archived in the Probe section of usablebuildings.co.uk .  There were twenty-three building studies in all, and five final report papers.  One of these, Final Report 4, was subtitled "Strategic Conclusions: Get Real About Building Performance".  From this comes a summary diagram of "pointers" for the future, which we called ’the Probe Nine’ (Figure 1).  We said in 1999:

’It is vital to integrate space, time and performance issues, to design for usability and manageability, and to know who owns which problems. Often one finds too much concentration on the means (the building) than on the benefits it will bring to the occupiers; and what it will demand of them. Consequently, there can be a loss of grip on overall mission. Expectations of buildings by clients, designers and occupants can easily be unrealistic, with unresolved problems parked” in the areas of greatest ignorance. Examples are enthusiasm about the promises of new technology, but not assessing possible downside risks; relying too much on management without considering the effort and costs involved; and not addressing possible needs for fine-tune once a building is occupied.’ 
Figure 1: The Probe Nine.
Figure 1: The Probe Nine.

Looking at Figure 1, on the left are the ends, where the commissioning client and user client usually stand. On the right are the means: the buildings and the designers, contractors, suppliers and others who provide and service them.  In design situations, often the spotlight falls on the building as an end in itself, rather than the means to the occupiers ends.  In the middle are linking tools based on feedback, helping to build bridges between the ends and the means, the demand-side and the supply-side.

Where is this leading?  The key is how feedback works, and how it is professionally managed.  This is the territory of virtuous and vicious circles, chronic and acute performance problems, reputational damage, hiding the bad news, shooting the messenger.  Probe was a case in point. We included an opportunity for design teams to respond to the study findings, and published these alongside our own building assessments.  That way we could talk about faults openly, not just successes.  The design team still had some control over the narrative, but we did not shirk discussion of perceived failures. A viable and useful knowledge system has processes which link means to ends via performance feedback protocols.  This is second-nature to many risk- averse professions and industries, like medicine or transportation.  The reason why there is so much dissonance in architecture and construction - between academia and design practice, professional skill sets, historic and modern building practice and research funding, amongst several more - is the embedded reticence towards formal routine feedback.   

This means academia needs to work with industry to produce more relevant research outputs devoid of unnecessary jargon, such as the briefing notes introduced by Buildings & Cities, rather than expecting research articles are all that is needed. The same applies to statistical tables, diagrams and architectural plans.  Communicating in different mediums can be challenging for authors and researchers, but essential if a better grip on ends, needs, purpose, strategy and the other features that clients need to consider in a building brief.  Academia needs to be much more tolerant of real-world research outside the laboratory and more skeptical of over-optimism with computer modelling and big data. 

Downwind of Probe we were well aware that 'Making feedback routine' was vital for progress.  Many of the initiatives we considered, encouraged or attempted are described in Bordass et al. (2004):

‘After many false dawns, it now seems possible that feedback and post-occupancy evaluation will begin to become more routine – promising better, nicer, more productive, more cost-effective and more sustainable buildings which are better suited to the needs of their users. It will be a long haul, but clients, designers and government are becoming more interested in building performance and some are already requiring or offering aftercare services.’

We created the Usable Buildings Trust, hoping that its impetus would lead to new social institutions devoted to promoting research, training and education.  The rump of that initiative is the usablebuildings.co.uk website. This hosts building case studies which can safely be placed in the public domain, together with other Probe-inspired projects like Soft Landings and New Professionalism, plus presentations and support material.  The timeline (Usable Buildings n.d.) records where we went with this.

Realistically, progress has been tangible, but far slower than we would have expected or liked.  In the middle of it all on 14 June 2017 came the tragic circumstances of the Grenfell Tower fire.  We now have a better understanding of the venality and greed of the main perpetrators (Grenfell Tower Inquiry 2024). But even with the Inquiry's forensic investigations, extensive recommendations and the benefit of hindsight, we can still see that there is far too much focus on a self-serving construction industry. 

Taking a needs-focused social and environmental view might still have meant that tower blocks would be built in the first place, but only as long as there were management resources secured and in place to run them effectively.  What you certainly don't do is to add unmanageable complexity to an already fragile system in the name of "improvement" thereby multiplying the chances that things will go wrong.

On this basis it is obvious where we need to go in the future.  Far more effort needs to go into areas that have normally been the province of applied social science.  These include:

  • practice-based knowledge management systems, tailored to the needs and resources of practices of all types and sizes
  • simpler and consistently reliable methods for performance data gathering in the field
  • new protocols for non-compromising information sharing between professionals and practices who would normally compete with each other
  • public interest not-for-profit institution building along the lines pioneered by Michael Young and carried forward by the Young Foundation (2024).
  • more emphasis on risk management together with understanding the processes of improvement and deterioration in both the historic building stock and modern construction
  • a targeted approach to building briefing, with frameworks that encourage cradle-to-grave monitoring as incorporated in, for example, Soft Landings.

As for Probe, we look back more at lost opportunities than successes.  At the time, further funding was denied us because the work could not be framed as 'innovative'.  We were suggesting perhaps two new Probe studies annually, carried out by the ad hoc multi-professional team working without the inflated administrative and cost overheads of the university sector.  At a conservative estimate that might have contributed a further 50 case studies, together with the designers' responses to the findings. 

Making feedback routine would have been the simplest, fastest and most cost-effective way of repairing the systemic breakdown that has manifest its worst features in a mendacious building industry.  However, momentum may still be there for that to happen.  The lessons from Grenfell yet again show why feedback research is vital to ensure that buildings are designed, built and operated robustly and with low risk. Such knowledge is needed by regulators, practitioners and society. It’s time for research funders to reframe their notions of “innovation” to include a feedback research programme.

References

Bordass W., Derbyshire A., Eley J. & Leaman A. (2004). Beyond Probe: Making Feedback Routine. Conference: Closing the Loop: Post-Occupancy Evaluation: the Next Steps, 29 April - 2 May 2004, Windsor, UK. https://www.usablebuildings.co.uk/UsableBuildings/Unprotected/BeyondProbe.pdf

Grenfell Tower Inquiry. (2024). Phase 2 report, September 2004, London: House of Commons. https://www.grenfelltowerinquiry.org.uk/phase-2-report

Leaman A., Bordass W. & Ruyssevelt P. (1999). Probe Final Report 4: Strategic Conclusions: Get Real About Building Performance. https://www.usablebuildings.co.uk/UsableBuildings/Unprotected/Probe/ProbePDFs/SR4.pdf

Usable Buildings. (n.d.). Probe archive. https://www.usablebuildings.co.uk/UsableBuildings/ProbeListAll.html

Usable Buildings. (n.d.). Usable Buildings Timeline. https://www.usablebuildings.co.uk/UsableBuildings/Timeline.html

Young Foundation. (2024). Shaping a fairer future. https://www.youngfoundation.org

Latest Peer-Reviewed Journal Content

Journal Content

Spatiotemporal evaluation of embodied carbon in urban residential development
I Talvitie, A Amiri & S Junnila

Energy sufficiency in buildings and cities: current research, future directions [editorial]
M Sahakian, T Fawcett & S Darby

Sufficiency, consumption patterns and limits: a survey of French households
J Bouillet & C Grandclément

Health inequalities and indoor environments: research challenges and priorities [editorial]
M Ucci & A Mavrogianni

Operationalising energy sufficiency for low-carbon built environments in urbanising India
A B Lall & G Sethi

Promoting practices of sufficiency: reprogramming resource-intensive material arrangements
T H Christensen, L K Aagaard, A K Juvik, C Samson & K Gram-Hanssen

Culture change in the UK construction industry: an anthropological perspective
I Tellam

Are people willing to share living space? Household preferences in Finland
E Ruokamo, E Kylkilahti, M Lettenmeier & A Toppinen

Towards urban LCA: examining densification alternatives for a residential neighbourhood
M Moisio, E Salmio, T Kaasalainen, S Huuhka, A Räsänen, J Lahdensivu, M Leppänen & P Kuula

A population-level framework to estimate unequal exposure to indoor heat and air pollution
R Cole, C H Simpson, L Ferguson, P Symonds, J Taylor, C Heaviside, P Murage, H L Macintyre, S Hajat, A Mavrogianni & M Davies

Finnish glazed balconies: residents’ experience, wellbeing and use
L Jegard, R Castaño-Rosa, S Kilpeläinen & S Pelsmakers

Modelling Nigerian residential dwellings: bottom-up approach and scenario analysis
C C Nwagwu, S Akin & E G Hertwich

Mapping municipal land policies: applications of flexible zoning for densification
V Götze, J-D Gerber & M Jehling

Energy sufficiency and recognition justice: a study of household consumption
A Guilbert

Linking housing, socio-demographic, environmental and mental health data at scale
P Symonds, C H Simpson, G Petrou, L Ferguson, A Mavrogianni & M Davies

Measuring health inequities due to housing characteristics
K Govertsen & M Kane

Provide or prevent? Exploring sufficiency imaginaries within Danish systems of provision
L K Aagaard & T H Christensen

Imagining sufficiency through collective changes as satisfiers
O Moynat & M Sahakian

US urban land-use reform: a strategy for energy sufficiency
Z M Subin, J Lombardi, R Muralidharan, J Korn, J Malik, T Pullen, M Wei & T Hong

Mapping supply chains for energy retrofit
F Wade & Y Han

Operationalising building-related energy sufficiency measures in SMEs
I Fouiteh, J D Cabrera Santelices, A Susini & M K Patel

Promoting neighbourhood sharing: infrastructures of convenience and community
A Huber, H Heinrichs & M Jaeger-Erben

New insights into thermal comfort sufficiency in dwellings
G van Moeseke, D de Grave, A Anciaux, J Sobczak & G Wallenborn

‘Rightsize’: a housing design game for spatial and energy sufficiency
P Graham, P Nourian, E Warwick & M Gath-Morad

Implementing housing policies for a sufficient lifestyle
M Bagheri, L Roth, L Siebke, C Rohde & H-J Linke

The jobs of climate adaptation
T Denham, L Rickards & O Ajulo

Structural barriers to sufficiency: the contribution of research on elites
M Koch, K Emilsson, J Lee & H Johansson

Life-cycle GHG emissions of standard houses in Thailand
B Viriyaroj, M Kuittinen & S H Gheewala

IAQ and environmental health literacy: lived experiences of vulnerable people
C Smith, A Drinkwater, M Modlich, D van der Horst & R Doherty

Living smaller: acceptance, effects and structural factors in the EU
M Lehner, J L Richter, H Kreinin, P Mamut, E Vadovics, J Henman, O Mont & D Fuchs

Disrupting the imaginaries of urban action to deliver just adaptation [editorial]
V Castán-Broto, M Olazabal & G Ziervogel

Building energy use in COVID-19 lockdowns: did much change?
F Hollick, D Humphrey, T Oreszczyn, C Elwell & G Huebner

Evaluating past and future building operational emissions: improved method
S Huuhka, M Moisio & M Arnould

Normative future visioning: a critical pedagogy for transformative adaptation
T Comelli, M Pelling, M Hope, J Ensor, M E Filippi, E Y Menteşe & J McCloskey

Nature for resilience reconfigured: global- to-local translation of frames in Africa
K Rochell, H Bulkeley & H Runhaar

How hegemonic discourses of sustainability influence urban climate action
V Castán Broto, L Westman & P Huang

Fabric first: is it still the right approach?
N Eyre, T Fawcett, M Topouzi, G Killip, T Oreszczyn, K Jenkinson & J Rosenow

Social value of the built environment [editorial]
F Samuel & K Watson

Understanding demolition [editorial]
S Huuhka

Data politics in the built environment [editorial]
A Karvonen & T Hargreaves

See all

Latest Commentaries

Systems Thinking is Needed to Achieve Sustainable Cities

As city populations grow, a critical current and future challenge for urban researchers is to provide compelling evidence of the medium and long-term co-benefits of quality, low-carbon affordable housing and compact urban design. Philippa Howden-Chapman (University of Otago) and Ralph Chapman (Victoria University of Wellington) explain why systems-based, transition-oriented research on housing and associated systemic benefits is needed now more than ever.

Artwork © Pat Sonnino 2024

Andrew Karvonen (Lund University) explains why innovation has limitations for achieving systemic change. What is also needed is a process of unmaking (i.e. phasing out existing harmful technologies, processes and practices) whilst ensuring inequalities, vulnerabilities and economic hazards are avoided. Researchers have an important role to identify what needs dismantling, identify advantageous and negative impacts and work with stakeholders and local governments.

Join Our Community