Open Peer Review
Social and health outcomes following upgrades to a national housing standard: a multilevel analysis of a five-wave repeated cross-sectional survey
BMC Public Healthvolume 17, Article number: 927 (2017)
While existing research indicates that housing improvements are associated with health improvements, less is known about the wider social and health benefits of meeting national housing standards, as well as those of their specific constituent measures. This study evaluates the impacts of a managed housing upgrade programme through a repeated cross-sectional survey design.
A five-wave repeated cross-sectional survey was conducted over a seven-year period from 2009 to 2016 (n = 2075; n = 2219; n = 2015; n = 1991; and n = 1709, respectively). The study followed a managed upgrade programme designed to meet a national social housing standard over an extended period. The data were analysed from a multilevel perspective to take account of the time-dependent nature of the observations and differences in socio-demographic composition.
The installation of the majority of individual housing measures (new windows and doors; boilers; kitchens; bathrooms; electrics; loft insulation; and cavity/external wall insulation) were associated with improvements in several social (housing suitability, satisfaction, and quality; thermal comfort and household finances) and health (mental, respiratory and general health) outcomes; and analyses showed relationships between the number of measures installed and the total amount invested on the one hand and the social and health outcomes on the other. There were however a few exceptions. Most notably, the installation of cavity wall insulation was associated with poorer health outcomes, and did not lead to better social outcomes. Also, no association was found between the number of measures installed and respiratory health.
The study suggests that substantial housing investments through a managed upgrade programme may result in better social and health outcomes, and that the size of the improvements are proportionate to the number of measures installed and amount invested. However, there may be risks associated with specific measures; and more attention is needed for mechanical ventilation when upgrading energy efficiency of houses through fabric work. In addition to providing new evidence regarding the wider social and health outcomes, the study provides an analytical approach to evaluate upgrade programmes that are delivered over multiple years.
Poor quality housing may contribute to social and health inequality that could be addressed through housing improvements [1,2,3]. The current evidence suggests that housing improvements can lead to a number of positive health outcomes, in particular when they are targeted at those with existing poor health and inadequate warmth [3,4,5]. However, the benefits of area-led housing interventions are still uncertain [3, 6], and much remains to be learnt about the impacts of meeting housing quality standards and their constituent measures [4, 7]. Studying the impacts of wider upgrade programmes to meet standards is more challenging than those of targeted affordable warmth interventions, as upgrade programmes often take place over a longer period (i.e. years rather than weeks or months). Changes in health may then reflect changes in the composition of the population rather than result from the housing upgrades themselves. Housing upgrade programmes also often involve multiple measures beyond the regular affordable warmth ones. A recent systematic review concluded that most studies examine the overall impacts of housing improvement programmes, and that less is known about the health effects of specific measures and/or extent of the intervention . Thus far, only a limited number of studies have tried to disentangle the impacts of programmes consisting of multiple measures [4, 8]. Furthermore, research has largely ignored the social benefits that may be part of the pathways to health [9, 10]. Evidence from both qualitative and quantitative research suggests that housing upgrade programmes can result in a wide range of positive outcomes related to housing conditions , fuel poverty , thermal comfort [11, 12], financial stress [13,14,15], and subjective wellbeing .
This paper addresses some of the identified gaps in the literature. It reports on a seven-year evaluation study that aimed to examine the wider social and health benefits of a managed housing upgrade programme to meet a national housing standard over an extended period of time. The study’s objectives were to examine (1) the changes in a range of social and health outcomes following upgrades to a national social housing standard, and (2) whether these outcomes can be linked to the specific measures that were part of the upgrade programme. The social and health outcomes are in the areas of (a) housing suitability, satisfaction, and quality, (b) thermal comfort and household finances, and (c) mental, respiratory and general health. In addition to providing new evidence regarding the wider social and health benefits of housing upgrades, the paper presents an analytical approach to examine such outcomes through a repeated cross-sectional survey design. The approach allows the different outcomes to be linked to the individual measures and the extent of the intervention. The context and details of the upgrade programme are described in the Methods section; and below we discuss the expected social and health outcomes of the programme.
Pathways from housing upgrades to social and health outcomes
The literature has identified several pathways that may link housing upgrades to social and health outcomes [8,9,10,11, 16]. The two main pathways associated with energy efficiency improvement involve better thermal living conditions and improved heating affordability [9,10,11]. Past research has found associations between living in cold and damp housing and mental wellbeing, whereby such homes potentially contribute to a variety of mental health stressors [2, 16,17,18]. Stress may arise from thermal discomfort, concerns about household finances and debt, and even from worries about the health effect of living in a cold and damp home itself . There is now extensive empirical evidence that energy performance investments can produce better mental wellbeing, in particular when they are targeted at vulnerable populations [3, 16], via the pathways of thermal satisfaction and improved household finances . Evidence of improvements in general health following warmth interventions has also been found, although this is not always statistically significant . It is however anticipated that broad improvements in living conditions and mental wellbeing are likely to be associated with better general health [10, 16, 19].
In addition to posing a risk to mental health, cold and damp housing may also contribute to poor respiratory health [2, 20,21,22]. Poor internal conditions can affect respiratory health in several ways. Low temperatures may suppress the function of the immune system , raising the risk of respiratory problems . Low indoor temperatures may also encourage the development of damp and mould in the home . Inadequate heating, insulation and ventilation can therefore lead to exposure to allergenic spores, a known risk factor for asthma sufferers . A combination of measures can improve internal conditions , and as a result lower the allergy burden . It is therefore likely that the warmth improvements that are part of the upgrade programme will lead to fewer housing-related problems, such as mould and damp, as well as improved respiratory health. More recently, there have been indications that energy efficiency improvements may produce adverse health outcomes, in particular where houses are built or upgraded to high standards of insulation and air tightness . In Wales, which has a wet climate, this may lead to higher indoor humidity levels and as a result mould contamination. Highly energy efficient homes have been linked to increased asthma in adults . This may however not be due to internal hydrological conditions, as the same study found that higher energy efficient homes had lower levels of mould growth . Other research suggests that energy-efficiency retrofits can improve occupants’ health through reduced exposure to cold and pollutants, but that their benefits will be reduced if not accompanied by appropriate ventilation . A recent study illustrated the importance of mechanical ventilation when making buildings more airtight . Increases in indoor relative humidity levels were only found for buildings that received cavity-wall insulation (which generally was installed without mechanical ventilation), not in British steel-framed buildings or in buildings with solid walls receiving external wall insulation (which was accompanied by extractor fans).
There is now a substantial literature on the health outcomes following affordable warmth interventions. However, research on other housing improvements is less well developed. Only a handful of (mostly qualitative) studies examined outcomes associated with internal improvements, such as providing up-to-date kitchens and bathrooms [14, 15, 29, 30]. Caldwell and colleagues reported increased use of the kitchen following upgrades, as well as increased thermal comfort . Gilbertson and colleagues similarly reported increased use of the kitchen and improved nutrition , which may result in better general health outcomes in the longer term. Research conducted as part of the GoWell programme found that the provision of new kitchens and bathrooms may produce better mental health outcomes , although another study using data linkage found no change in emergency admissions following kitchens or bathroom upgrades . Evidence relating to other improvements, such as rewiring, is even more scarce, not least because they are often installed alongside other internal improvements. As noted by Thomson and colleagues, housing-led renewal programmes are often analysed as a whole, and not by specific measures and/or the extent of intervention . While rewiring may reduce the number of accidents within the home, it is less likely to have strong associations with mental, respiratory and general health outcomes . Given the paucity of good quality evidence, the suggested pathways to health from these and other housing improvements can only be speculative at this stage. Conceptual frameworks used in other research posits that updating kitchens and bathrooms may produce better mental and general health outcomes through better designed facilities, and better internal appearances leading to improved housing satisfaction [7, 8, 10].
Expected associations of housing improvements
Table 1 presents the hypothesised associations of the housing improvements that will be tested in this research. The warmth measures that are part of the upgrade programme include wall and loft insulation, boilers, and (double-glazed) windows and doors. In line with previous research, installation of these measures is expected to be associated with better mental, respiratory and general health via the two main pathways of thermal satisfaction and improved household finances. In addition, all measures that improve the energy performance of the buildings are expected to be associated with fewer housing-related problems, such as mould and damp. While not all types of insulation were accompanied by mechanical ventilation (external wall insulation was installed with and cavity wall insulation without mechanical ventilation), it is expected that they all lead to fewer building-related problems due to improved internal hydrothermal conditions; the standard of a SAP 65Footnote 1 energy rating is not expected to bring about problematic levels of air tightness. While new kitchens, bathrooms and electrics, are expected to be associated with better mental and general health, due to tenants being more content and at ease in their homes, there is no empirical evidence or theoretical reasons to believe that these measures eliminate damp and mould, and as a result will help to improve respiratory health. The measures are equally not expected to produce large-sized improvements in thermal comfort and household finances.
All measures of the upgrade programme are expected to be linked to housing satisfaction. That is, any investment that improves the quality or appearance of the house will be appreciated by the tenants, and are therefore likely to lead to higher suitability and satisfaction ratings. This not only applies to the energy efficiency measures, such as wall insulation and new boilers, but also to windows and doors with improved safety features, up-to-date kitchens and bathrooms with appropriate design, layout and state of repair, and electrics that involve the installation of power sockets, Carbon Monoxide and Smoke detectors, and security lighting. All of these features are likely to make tenants feel more content, safe, and at ease in their homes.
The overall intervention (as indicated by the number of measures and total amount invested; see below) is expected to be positively associated with all outcome measures.
The study was conducted in Carmarthenshire, Wales, one of the largest Welsh unitary authorities located in the south-west of Wales. Carmarthenshire is a largely rural Authority, with three significant urban centres (Llanelli, Carmarthen, and Ammanford). There is significant deprivation within Carmarthenshire, with 25 LSOAs (lower layer super output areas)Footnote 2 within the 30% most deprived areas in Wales. The majority of these areas are located within urban areas .
The housing upgrade programme
The Carmarthenshire Homes Standard (“the upgrade programme”) was developed following the publication of the national housing strategy for Wales, which requires all social housing landlords, including local authorities, to bring all social housing up to the Welsh Housing Quality Standard [32, 33]. The standard sets out a basic set of requirements to ensure that all social housing in Wales is in a good state of repair; safe and secure; adequately heated; fuel efficient and well insulated; well managed; and located in attractive and safe environments. While similar standards have been introduced in the other UK countries, the detailed requirements of the Welsh Housing Quality Housing Standard means that it is more challenging to meet than those set elsewhere .
Following a consultation with their tenants in 2005, Carmarthenshire County Council (“the council”) took the decision to retain ownership of their social housing stock and to set its own, slightly higher housing standard. The standard was to be achieved through a managed upgrade programme running from 2007 to 2015.
Properties received a number of improvements depending upon the state of repair relative to the housing standard. These improvements were delivered in a work programme with extensive tenant consultation and engagement. It was agreed that the programme was to be spread evenly across the authority on an area-by-area basis, and conducted in such a way that work could be carried out with the tenants in situ, in order to minimise the disruption to them. Tenants were informed at the start of the programme when the work would take place.
The programme involved the elements of (1) windows and doorsFootnote 3; (2) boilers; (3) kitchens3; (4) bathroomsFootnote 4; (5) electricsFootnote 5; (6) loft insulationFootnote 6; (7) cavity-wall insulation6; (8) external wall insulation6; and (9) safety improvements to external paths. The council also developed an environmental work package to identify and improve elements in the in their wider estate environment. This part of the programme was however scaled down at an early stage due to budget constraints.
The elements were delivered through four broad work packages, namely (1) external work (windows and doors); (2) internal work (kitchens, bathrooms, boilers, electrics); (3) thermal insulation/external finishes; and (4) gardens and estates. This means that multiple measures were installed as part of the same work package, although not all houses received all of the elements mentioned. More than 9000 properties were upgraded at an overall cost of £200+ million. Virtually all properties were compliant by the beginning of 2016, at the time of the fifth and final survey of this study.
The health surveys
A study was designed to assess the social and health benefits to tenants resulting from the housing improvements. In the absence of appropriate comparator groups within the area, it was decided to follow the tenants throughout the upgrade programme with a series of health surveys. The design consisted of five repeated cross-sectional health surveys conducted over a seven-year period from 2009 to 2016. The sampling frame of the survey were social housing tenants of the council. The social housing stock of the council consisted of approximately 9200 properties at the time of the study, of which about 400 houses were of non-traditional build (e.g. steel-framed or concrete constructions). All addresses were approached for either a postal survey or face-to-face interviews. Any adult tenant currently living in the council-owned properties was eligible for inclusion. Responses from non-traditional properties were excluded from the analyses, to ensure that the results of the study are generalisable to other programmes upgrading standard social housing in the UK.
The first wave of data collection took place in early 2009 as part of a pilot study. Following the successful delivery of the pilot study, four additional health surveys were conducted in 2011, 2012, 2014 and 2016.Footnote 7 All five surveys that are part of the study were conducted in the same period within the heating season. The fifth and final survey was conducted at the end of the programme, when most of the improvements were completed. Data were collected using postal questionnaire and face-to-face interviews by two Wales-based market research companies with established networks of trained interviewers. The project received ethical approval from the School Research Ethics Committee of the Welsh School of Architecture.
In the first survey, conducted in 2009, tenants of properties where work had not started yet were contacted for face-to-face interviews. All other tenants were approached by postal questionnaire. All tenants who took part in the first survey were contacted to be interviewed face-to-face for the second survey in 2011. The remaining tenants were contacted by postal questionnaire. Respondents who had not consented to be re-contacted were excluded from the study. This sampling strategy was repeated in the remaining surveys to ensure that the samples were comparable across the different years. The response rates were generally higher for the face-to-face interviews than for the postal questionnaires.Footnote 8 In all five surveys, a prize draw was offered as an incentive for residents to complete and return their postal questionnaires. The number of households contacted decreased over the seven-year period of the study. This was mostly due to the exclusion of tenants who did not want to be contacted again.
The survey was designed to cover the topics of (1) housing suitability, satisfaction, and quality, (2) thermal comfort and household finances, and (3) mental, respiratory and general health. The three topics are used as a structure for this paper.
Data from the five health surveys were combined to form a single dataset, and subsequently linked to intervention data held by the council (see The intervention dataset section). The data were linked using a unique property reference number, which was included in the surveys and in the intervention dataset. The reference number enabled the properties to be matched with deprivation data from the Welsh Index of Multiple Deprivation. After removal of multiple responses from the same household and of responses from tenants living in non-traditional housing, the overall dataset consisted of 10,009 individual responses. Respondent characteristics of the five surveys are provided in Table 2.
The intervention dataset
Records on progress of the upgrade programme were used to determine changes in the status of eight housing intervention measures, i.e. (1) new windows and doors, (2) boilers, (3) kitchens, (4) bathrooms, (5) electrics, (6) loft insulation, (7) cavity-wall insulation, and (8) external wall insulation. Measures that were part of the gardens and estates work package were not included because this part of the programme was scaled down at an early stage. For each survey, properties were categorised according to whether an intervention had taken place or not, for each of the listed measures. Table 3 shows the number and percentage of completed measures in the five surveys.
The number of improvements installed in each property varied according to the condition of the property at the start of the study. Some properties were already compliant for some or all of the measures at the time of the first survey in 2009. Where properties had received measures prior to the first survey, they were categorised as having received the intervention. The timing of the work programme was not related to residents’ needs in terms of health, housing condition, or other personal characteristics, and can therefore be assumed effectively random. Where properties had received measures prior to the first survey round, they were still categorised as receiving an intervention and the date was recorded for the installation of each measure.
The intervention data were further used to calculate a number of measures variable. This variable indicates how many different intervention measures (out of the eight housing measures of interest) had been installed within each property at the time the five surveys were conducted. The maximum number of possible measures in any one property was seven (a property could only receive external wall or cavity-wall insulation).
A total spend variable was created reflecting the average total investment of the programme. The variable was calculated for each individual property at the time of the five surveys and expressed in thousand pounds per property (£k/property), using cost data provided by the council. The total spend variable is closely related to the number of measures variables, but weighted according to the cost of the individual measures.Footnote 9 This is based on the assumptions that the cost of the measure is indicative of its size and therefore potential impact on the outcome measures.
The study focused on nine outcome measures relating to the topics of housing suitability, satisfaction, and quality; thermal comfort and household finances; and mental, respiratory and general health.
Three measures were used to indicate housing suitability, satisfaction, and quality, respectively.
Suitability of housing was measured by asking the tenants “Do you feel that your home is suitable for the needs of you and your family?” Response options were “yes” (1) or “no” (0).
Satisfaction with the state of repair of the home was measured by asking “In general, how satisfied or dissatisfied are you with the current state of repair of your home?” The 5-point answering scale ranged from “very dissatisfied” (1) to “very satisfied” (5), with “neither satisfied nor dissatisfied” as the scale midpoint (3).
A building problems variable was constructed as an indicator of housing quality. Respondents were asked whether they currently experience any of the following problems in their home: draught, condensation, damp on walls and/or floors, mould, lack of adequate heating, rot in windows or doorframes, and leaking roof. This variable was dichotomised to indicate whether someone had experienced any building problems (1) or not (0).
Three measures were used to indicate thermal comfort and household finances.
Thermal comfort was measured by asking tenants the extent to which they were satisfied or dissatisfied with the temperature in (1) the main living room during the day, (2) the main living room in the evening, and (3) the bedroom at night on a typical winter’s day. Scale analyses showed that the reliability of the scale is consistently high across the five surveys (Cronbach’s α > 0.90). The three items were therefore combined into a single thermal comfort scale ranging from 1 (strongly dissatisfied) to 5 (strongly satisfied).
Household finances was measured using two items. The Costs of living in home was determined by asking tenants “How easy or difficult is it for you to meet the costs of living in this home?” A 5-point answering scale ranged from “very easy” (1) to “very difficult” (5), with “neither easy nor difficult” as the scale midpoint (3). The Difficulties paying utility bills variable reflects responses to the question: “In the past 12 months, have you had difficulties paying scheduled utility bills, such as electricity, water, gas?” The response options were “yes” (1) and “no” (0).
Three mental, respiratory and general health outcomes were used in the study.
A mental health scale was created by averaging the answers to five questions relating to how much of the time in the previous 4 weeks respondents have been a very nervous person (reversed), have felt so down in the dumps that nothing could cheer them up (reversed), have felt calm and peaceful, have felt downhearted and blue (reversed), and have been a happy person. Scale analyses showed that the five items could be combined to create an internally consistent scale (Cronbach’s alpha ≥0.85 across the five surveys). The frequency response options ranged from “none of the time” to “all of the time”, which were subsequently weighted to form a scale ranging from 0 to 100.
Respiratory health was assessed by asking respondents to report whether they had experienced any of eleven listed respiratory symptoms in the past month. The symptoms included coughing, bringing up phlegm, shortness of breath, wheezing, chest tightness, runny nose, blocked nose, sinus swelling, sneezing, sore throat or fever. The responses were dichotomised, reflecting whether respondents had experienced any respiratory symptoms (1) or not (0).
The general health variable reflects responses to the question “In general, how would you say your health is?” Respondents could use the following categories: excellent, very good, good, fair, poor. This variable was dichotomised to contrast excellent, very good and good (1) with fair and poor (0) health. The self-rated health variable has been validated as a measure of general health and mortality [34,35,36].
The five-wave repeated cross-sectional survey was analysed using multilevel modelling, with individual responses to the five surveys (level 1) nested within the properties that are part of the council’s housing stock (level 2). The nested multilevel design allowed for the time-dependent observations over the seven-year period of the study to be taken into account . Analyses were conducted with the MLwiN 2.36 software package . The multilevel approach allowed the simultaneous analysis of multiple properties at different stages of improvement during the upgrade programme, while dealing with repeated observations for individuals living in the intervention homes and unbalanced data with different numbers of observations for individuals in the properties. The final dataset used for the analyses consisted of 1980 properties with a single observation, 1476 properties with two observations, 968 properties with three observations, 442 properties with four observations, and 81 properties with five observations.
The analyses consisted of a series of multilevel models with the nine outcome measures as the dependent variables. The basic statistical model included the intervention measures as the independent variables, together with the year of the survey and the socio-demographic variables of gender, age, working and retirement status, possession of educational qualifications, reception of housing benefits, area deprivation (Welsh Index of Multiple Deprivation), and smoking status. The individual socio-demographics variables were included as dummy variables. The year of the survey was included as a number ranging from (year) 1 to (year) 8.
Separate series of models were constructed for each of the eight intervention measures, as well as for the number of measures and total spend variables. Parameters were estimated using restricted iterative generalised least squares (RIGLS) procedures. Different types of models were constructed dependent on the type of outcome variable. Linear regression models were used for the satisfaction with state of repair, thermal comfort, costs of living in home, and mental health outcome variables. Logistic regression models were used for the suitability of housing, any building problems, difficulties paying bills, any respiratory symptoms, and good health outcome variables.
In this paper we report the regression coefficients for the different intervention measures (including the number of measures and total spend variables). These coefficients show the extent to which each measure is individually associated with a change in the different outcome variables, taking account of the year of the survey and individual socio-demographic characteristics. The number of measures coefficient provides an estimate of the change in the outcome variable for each additional intervention measure installed, while the total spend coefficient provides an estimate of the change in the outcome variable for each £1000 invested under the upgrade programme. The latter two variables can therefore be used to link the extent of the intervention to the different social and health outcomes.
The associations of the covariates with the nine outcome variables are provided in Appendix. The ‘year’ coefficient in the table provides the underlying trend of the outcome variable over the 7 years of the study (in change/year);
Table 4 shows the nine outcome measures for the five surveys. Overall, there were no clearly discernible trends for the different measures over the seven-year period. While there were some differences between the 2009 survey on the one hand and all the other surveys on the other, these are likely to reflect differences in composition between the pilot study and the rest.
Housing suitability, satisfaction, and quality
Table 5 shows that the installation of most individual intervention measures were, as hypothesised, positively associated with perceptions of housing suitability, satisfaction, and quality. The installation of new kitchens, bathrooms, and electrics was also associated with a lower likelihood of reporting any housing problems, in contrast to what was hypothesised.
A number of associations were not significant: the installation of new windows and doors was not associated with higher suitability and satisfaction ratings; external wall insulation was also not associated with higher suitability ratings; the installation of either boilers or loft insulation was not significantly associated with the reporting of any building problems; and external wall insulation was not significantly associated with any of the housing suitability, satisfaction, and quality outcome measures.
Table 5 further shows that the number of measures and total spend variables were both positively associated with the housing suitability, satisfaction, and quality outcome measures. A positive association was found between the number of measures variable and perceptions of housing suitability (OR = 1.14, 95% CI = 1.09–1.19) and satisfaction with the property’s state of repair (B = 0.104 (0.008), p < 0.001). The likelihood of respondents reporting any building problems reduced by 10% (OR = 0.90, 95% CI = 0.87–0.93) with each additional intervention measure installed.
Positive associations were found between the total spend variable and perceptions of housing suitability (OR = 1.03, 95% CI = 1.02–1.05) and satisfaction with the property’s state of repair (B = 0.028 (0.002), p < 0.001). For each £1000 invested, the likelihood of tenants reporting building problems reduced by 3% (OR = 0.97, 95% CI = 0.96–0.98).
Thermal comfort and household finances
Table 6 shows that the installation of almost all individual intervention measures were associated with improvements in thermal comfort and household finances. In contrast to the expectations, this included the installation of new kitchens, bathrooms, and electrics.
A number of associations were non-significant: cavity wall insulation was not associated with any of the thermal comfort and household finances outcome measures; external wall insulation was not associated with thermal comfort; and the installation of new boilers was not associated with the difficulties paying bills outcome measure.
Table 6 further demonstrates that each additional intervention measure and £1000 invested were associated with improvements in thermal comfort (B = 0.090 (0.008), p < 0.001; and B = 0.024 (0.002), p < 0.001, respectively). The number of measures and total spend variables were also associated with better household finances. For each additional measure installed under the upgrade programme, tenants experienced fewer difficulties meeting the costs of living in their homes (B = −0.072; (0.008), p < 0.001) and were less likely to report difficulties paying scheduled utility bills (OR = 0.96, 95% CI = 0.93–0.99); and for each additional £1000 invested under the upgrade programme tenants experienced fewer difficulties meeting the costs of living in their homes (B = −0.017; (0.002), p < 0.001) and were less likely to report difficulties paying scheduled utility bills (OR = 0.99, 95% CI = 0.98–1.00).
Mental, respiratory and general health
Table 7 shows that a majority of the intervention measures were associated with the health outcome measures. In most cases, these associations were positive, meaning that the interventions led to better mental health, fewer respiratory symptoms, and better general health. In contrast to the expectations, the installation of cavity wall insulation was associated with poorer mental (B = −2.052 (0.687), p < 0.05) and general (B OR = 0.78, 95% CI = 0.68–0.89) health, and an increase in reported respiratory symptoms (OR = 1.47, 95% CI = 1.30–1.66).
A number of associations were not significant: windows and doors were not associated with the likelihood of reporting good health, and boilers were not associated with the likelihood of reporting any respiratory symptoms.
In contrast to the expectations, new kitchens, bathrooms, and electrics were non-significantly associated with the likelihood of reporting good health.
Table 6 further shows that the number of measures and total spend variables were both associated with better mental, respiratory and general health. For each additional measure installed (B = 0.826 (0.161), p < 0.001) and £1000 invested (B = 0.223 (0.044), p < 0.001), tenants reported better mental health; for each £1000 invested OR = 0.99, 95% CI = 0.98–1.00) tenants were less likely to report any respiratory symptoms; and for each additional measure installed (OR = 1.03, 95% CI = 1.00–1.07) and £1000 invested (OR = 1.01, 95% CI = 1.00–1.02) tenants were more likely to report good health.
This paper examined changes in a range of social and health outcomes following upgrades to a national social housing standard, and whether these outcomes can be linked to specific intervention measures that were part of the upgrade programme. A majority of the individual intervention measures (i.e. new windows and doors; boilers; kitchens; bathrooms; electrics; loft insulation; and cavity/external wall insulation) were, as expected, positively associated with a number of social (i.e. housing suitability, satisfaction, and quality; thermal comfort and household finances) and health (mental, respiratory and general health) outcomes; and analyses revealed associations between the number of measures installed and the total amount invested on the one hand and the different social and health outcomes on the other. There were however a number of exceptions. Most notably, the installation of cavity wall insulation was associated with poorer health outcomes, and did not lead to higher suitability and satisfaction ratings, nor to improved thermal satisfaction and household finances. In contrast to what was expected, new kitchens, bathrooms and electrics were all associated with improved housing satisfaction, thermal comfort and household finances. Kitchens and bathrooms had positive associations with mental health, they were not linked to better general health. Also, no association was found between the number of measures installed and respiratory health.
The results suggest that managed programmes to meet national housing standards may result in a range of positive social and health outcomes, and that these improvements are generally proportionate to the number of measures installed and amount invested. There may however be risks associated with specific measures. The results relating to cavity wall insulation appear in line with other recent research, suggesting that energy efficiency measures may pose risks to respiratory health in certain circumstances . It is significant that, while cavity wall insulation–which was installed without any additional ventilation– was linked to poorer health outcomes in this study, external wall insulation–which was accompanied by extractor fans– was associated with better health outcomes. This, together with a recent monitoring study that found that cavity wall insulation (without extractor fans) increased indoor humidity levels but external wall (with extractor fans) did not , indicates that ventilation as part of energy efficiency upgrades requires more attention to avoid any negative outcomes resulting from reduced ventilation and air exchange rates. It is important to note that the research involved repeated cross-sectional surveys, and that more research is needed to firmly establish causality.
Other results that require further attention relate to the unexpected positive links between new kitchens, bathroom and electrics with the reduced reporting of housing-related problems, such as damp and mould, and improved reports of thermal comfort and household finances. While, theoretically, there are no clear reasons to believe that these measures can eliminate damp and mould and/or substantially improve thermal comfort and household finances, the effects found in this study were sizeable. This may be linked to mechanical ventilation that was installed as part of the electrical upgrade element.
The research resonates well with other recent research. Grey and colleagues found that energy-efficiency investments increased subjective wellbeing and were linked to a number of psychosocial intermediaries that are conducive to better health; although they did not find changes in respiratory or physical health.  It is also in line those that observed improvements in thermal comfort and reductions in financial stress through quantitative [12,13,14] and qualitative [10, 13, 15, 17] work. There is however only limited work on outcomes following improvements other than affordable warmth interventions. There are clear parallels with work conducted as part of the GoWell programme in Glasgow, not only in terms of the content of the upgrade programme but also in terms of the results [4, 8]. The current paper, just as Curl and Kearns  followed a long-term housing improvement programme, and tried to disentangle the effect of different housing improvement works. However, rather than re-arranging multiple waves of data into two time periods representing a before and an after measurement, this current study took a multilevel modelling approach to make use of the complete dataset. This approach to analyse the repeated cross-sectional survey allows the different outcomes of the individual measures and the extent of the intervention to be compared with outcomes for tenants of houses that did not receive an intervention, while taking account of the time-dependent nature of the observations. It may therefore be useful for organisations that want to evaluate long-term upgrade programmes that do not lend themselves for randomisation or a stepped wedge design . In this case, the council agreed through tenant consultation that the programme was to be spread evenly across the authority and with as little disruption to the occupants as possible. This shows that evaluations of complex non-health interventions cannot be separated from the practicalities of delivering the actual programme and from other social and economic considerations, and that different methodological and analytical approaches are needed that take account of a range of dimensions of complexity .
While the approach presented in this paper provides a statistical way in which a complex, long-term intervention can be evaluated, it is not without limitations. Even if the intervention was distributed across the council’s housing stock as evenly as possible, and delivered independent of need and initial housing condition, the intervention was not randomised. As discussed above, the study design and analytical approach was chosen to effectively capture the rolling programme of multiple housing intervention elements that were delivered over the seven-year period of the research. Furthermore, the improvements were delivered through four broad work packages. While the properties did not always receive all elements of a work package, multiple elements were often installed at the same time. This makes it difficult to disentangle the effects of the different individual measures. The survey frequency (surveys were conducted every one or 2 years) makes it difficult to attribute the changes to specific measures. Multiple work packages could have been delivered between the different waves of data collection. This means that some of the effects reported in this paper may reflect the effects of multiple elements that were delivered together.
The research was conducted over an extended seven-year period with a changing population. A high churn rate typical for social housing tenants complicates capture of the effects of the intervention at the individual level. The multilevel approach does however allow adjustments for changes in differences in socio-demographic composition across the subsequent waves of data collection. Just as with any study using survey methodology, sample bias could be an issue; although response rates were generally higher than in other studies that were conducted in low-income areas [11, 41]. Response bias could be resolved through data linkage, which was done in a related study.  While we did not assess the condition of the houses at the start of the study, we did consider the extent of the intervention. That is, we examined the extent to which the number of measures installed and amount invested were linked to the different social and health outcomes. It is possible to use these results as an indicator of the effects that can be expected from the size of the investments to upgrade housing stock. The population studied is typical for those living in social housing in the UK; and similar housing standards have been rolled out across the different UK countries. The study focused specifically on standard UK social housing stock, as responses from non-traditional housing were excluded from the analyses. We therefore expect that the results of the study is generalisable to social housing residents in temperate regions living in homes that do not meet accepted housing quality standards.
The multilevel analysis of repeated cross-sectional surveys, which followed a managed upgrade programme designed to meet a national housing standard, found evidence that area-based investment in housing can provide a number of measurable benefits to tenants. Not only were several measures associated with better mental, respiratory and general health outcomes, they also resulted in fewer building-related problems, improved thermal comfort and household finances, and higher residential satisfaction. While the gains associated with each additional measure were generally modest, gains could add up with sizeable investments. There may however be some health risks associated with specific measures. In particular, the study suggests that mechanical ventilation requires more attention when upgrading the energy efficiency through fabric work. Overall, though, the study shows that the social and health outcomes of managed housing upgrade programme are predominantly positive, and that that they are proportionate to the number of measures installed and amount invested.
The Standard Assessment Procedure (SAP), developed by the Building Research Establishment, is the UK Government’s recommended method system for measuring the energy rating of residential dwellings . The Welsh Housing Quality Standard requires a minimum rating of 65 out of 100.
LSOAs is part of a geographical hierarchy used to report official small-area statistics in Wales and England.
The windows and doors were double glazed and had safety features complying with Secured By Design (http://www.securedbydesign.com).
Both kitchens and bathrooms need to be up-to-date with appropriate design, layout and state of repair for their safe use.
The electrics element involved rewiring (where necessary), the installation of power sockets, Carbon Monoxide and Smoke detectors, security lighting, and extractor fans in kitchens and bathrooms.
The insulation measures were selected to achieve a minimum SAP (Standard Assessment Procedure for Energy Rating of Dwellings 2005) rating of 65 out of 100. External wall or cavity wall insulation were installed depending on the building type. External wall insulation was companied by mechanical ventilation, while cavity wall insulation was not.
Data were collected in the following periods: Survey 1: 23 February to 20 March 2009; Survey 2: 14 February to 2 April 2011; Survey 3: 13 February to 31 March 2012; Survey 4: 1 February to 23 March 2014 and Survey 5: 15 February to 5 April 2016.
Response rates for the five surveys were as follows (excluding non-traditional properties):
Survey Year Type Contacted Achieved sample Response rate 1 2009 Face-to-face 553 319 55% Postal 8237 1769 21% 2 2011 Face-to-face 2088 976 47% Postal 6180 1246 20% 3 2012 Face-to-face 2117 1034 49% Postal 6017 1008 17% 4 2014 Face-to-face 1989 1021 58% Postal 6039 972 16% 5 2016 Face-to-face 1769 906 51% Postal 5920 807 14%
New windows and doors: £3500; boilers: £5752; kitchens: £3298; bathrooms: £2349; electrics (re-wiring): £3159; loft insulation: £225; cavity-wall insulation: £1000; and external wall insulation: £9000.
Evans GW, Wells NM, Moch A. Housing and mental health: a review of the evidence and a methodological and conceptual critique. J Soc Issues. 2003;59:475–500. https://doi.org/10.1111/1540-4560.00074.
Marmot M, Geddes I, Bloomer E, Allen J, Goldblatt P. Marmot review team. The health impacts of cold homes and fuel poverty. London: Friends of the Earth & the Marmot Review Team; 2011.
Thomson H, Thomas S, Sellstrom E, Petticrew M. Housing improvements for health and associated socio-economic outcomes. Cochrane Database Syst Rev. 2013;2:CD008657. https://doi.org/10.1002/14651858.CD008657.pub2.
Curl A, Kearns A, Mason P, Egan M, Tannahill C, Ellaway A. Physical and mental health outcomes following housing improvements: evidence from the GoWell study. J Epidemiol Community Health. 2015;69:12–9. https://doi.org/10.1136/jech-2014-204064.
Osman LM, Ayres JG, Garden C, Reglitz K, Lyon J, Douglas JG. Home warmth and health status of COPD patients. Eur J Pub Health. 2008;18:399–405.
Gibson M, Petticrew M, Bambra C, Sowden AJ, Wright KE, Whitehead M. Housing and health inequalities: a synthesis of systematic reviews of interventions aimed at different pathways linking housing and health. Heal Place. 2011;17:175–84. https://doi.org/10.1016/j.healthplace.2010.09.011.
Rodgers SE, Bailey R, Johnson R, Poortinga W, Smith R, Berridge D, et al. Health impact, and economic value, of meeting housing quality standards: a retrospective, longitudinal data linkage study. Public Heal Res. 2018. (in press).
Curl A, Kearns A. Can housing improvements cure or prevent the onset of health conditions over time in deprived areas? BMC Public Health. 2015;15:1–14. https://doi.org/10.1186/s12889-015-2524-5.
Gilbertson J, Grimsley M, Green G. Psychosocial routes from housing investment to health: evidence from England’s home energy efficiency scheme. Energy Policy. 2012;49:122–33.
Thomson H, Thomas S. Developing empirically supported theories of change for housing investment and health. Soc Sci Med. 2015;124:205–14.
Grey C, Jiang S, Nascimento C, Rodgers SE, Johnson R, Lyons RA, et al. The short-term health and psychosocial impacts of domestic energy efficiency investments in low-income areas: a controlled before and after study. BMC Public Health. 2017;17:1–10. https://doi.org/10.1186/s12889-017-4075-4.
Poortinga W, Jiang S, Grey C, Tweed C. Impacts of energy-efficiency investments on internal conditions in low-income households. Build Res Inf 2017;0:1–15. doi: https://doi.org/10.1080/09613218.2017.1314641.
Grey C, Schmieder-Gaite T, Jiang S, Nascimento C, Poortinga W. Cold homes, fuel poverty and energy-efficiency improvements: a longitudinal focus group approach. Indoor Built Environ. 2017;26:902–13. https://doi.org/10.1177/1420326X17703450.
Caldwell J, McGowan S, McPhail J, McRae C, Morris G, Murray K, et al. Glasgow warm homes study: final report. Glasgow: Glasgow City Council Housing Services; 2001.
Gilbertson J, Stevens M, Stiell B, Thorogood N. Home is where the hearth is: grant recipients’ views of England’s home energy efficiency scheme (warm front). Soc Sci Med. 2006;63:946–56.
Liddell C, Guiney C. Living in a cold and damp home: frameworks for understanding impacts on mental well-being. Public Health. 2015;129:191–9.
Liddell C, Morris C. Fuel poverty and human health: a review of recent evidence. Energy Policy. 2010;38:2987–97.
Hopton J, Hunt S. The health effects of improvements to housing: a longitudinal study. Hous Stud. 1996;11:271–86.
Howden-Chapman P, Matheson A, Crane J, Viggers H, Cunningham M, Blakely T, et al. Effect of insulating existing houses on health inequality: cluster randomised study in the community. BMJ. 2007;334:460.
Williamson IJ, Martin CJ, McGill G, Monie RD, Fennerty AG. Damp housing and asthma: a case-control study. Thorax. 1997;52:229–34.
Sharpe RA, Thornton CR, Nikolaou V, Osborne NJ. Fuel poverty increases risk of mould contamination, regardless of adult risk perception & ventilation in social housing properties. Environ Int. 2015;79:115–29.
Sharpe RA, Thornton CR, Nikolaou V, Osborne NJ. Higher energy efficient homes are associated with increased risk of doctor diagnosed asthma in a UK subpopulation. Environ Int. 2015;75:234–44.
Howieson SG. Multiple deprivation and excess winter deaths in Scotland. J R Soc Promot Heal. 2005;125:18–22.
Platt SD, Martin CJ, Hunt SM, Lewis CW. Damp housing, mould growth, and symptomatic health state. BMJ. 1989;298:1673–8.
Denning DW. O\textquoterightDriscoll BR, Hogaboam CM, bowyer P, Niven RM. the link between fungi and severe asthma: a summary of the evidence. Eur Respir J. 2006;27:615–26. https://doi.org/10.1183/09031936.06.00074705.
Sharpe RA, Thornton CR, Osborne NJ. Modifiable factors governing indoor fungal diversity and risk of asthma. Clin Exp Allergy. 2014;44:631–41. https://doi.org/10.1111/cea.12281.
Bone A, Murray V, Myers I, Dengel A, Crump D. Will drivers for home energy efficiency harm occupant health? Perspect Public Health. 2010;130:233–8.
Hamilton IG, Milner J, Chalabi Z, Das P, Jones B, Shrubsole C, et al. Health effects of home energy efficiency interventions in England: a modelling study. BMJ Open. 2015;5:e007298. https://doi.org/10.1136/bmjopen-2014-007298.
Gibson M, Thomson H, Kearns A, Petticrew M. Understanding the psychosocial impacts of housing type: qualitative evidence from a housing and regeneration intervention. Hous Stud. 2011;26:555–73. https://doi.org/10.1080/02673037.2011.559724.
Bullen C, Kearns RA, Clinton J, Laing P, Mahoney F, McDuff I. Bringing health home: householder and provider perspectives on the healthy housing programme in Auckland, New Zealand. Soc Sci Med. 2008;66:1185–96.
Rees L, Reynolds R. WIMD 2014: Carmarthenshire summary. Carmarthen: Carmarthen County Council; 2014.
National Assembly for Wales. Better homes for people in Wales. Cardiff: National Assembly for Wales; 2002.
Welsh Assembly Government, The Welsh Housing Quality Standard. Revised guidance for social landlords on interpretation and achievement of the welsh housing quality standard. Cardiff: Welsh Assembly Government; 2008. http://gov.wales/docs/desh/publications/141030-whqs-guide-for-social-landlords-en.pdf
Idler EL, Benyamini Y. Self-rated health and mortality: a review of twenty-seven community studies. J Health Soc Behav. 1997;38:21–37. https://doi.org/10.2307/2955359.
McGee DL, Liao Y, Cao G, Cooper RS. Self-reported health status and mortality in a multiethnic US cohort. Am J Epidemiol. 1999;149:41–6. https://doi.org/10.1093/oxfordjournals.aje.a009725.
Kawada T. Self-rated health and life prognosis. Arch Med Res. 2003;34:343–7. https://doi.org/10.1016/S0188-4409(03)00052-3.
Goldstein H. Multilevel statistical models. London: Wiley; 2011.
Rasbash J, Charlton C, Browne WJ, Healy M, Cameron B. MLwiN Version 2.36. Bristol: Centre for Multilevel Modelling, University of Bristol; 2016.
Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54. https://doi.org/10.1186/1471-2288-6-54.
Petticrew M, Rehfuess E, Noyes J, Higgins JPT, Mayhew A, Pantoja T, et al. Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. J Clin Epidemiol. 2013;66:1230–43. https://doi.org/10.1016/j.jclinepi.2013.06.005.
Parry O, Bancroft A, Gnich W, Amos A. Nobody home? Issues of respondent recruitment in areas of deprivation. Crit Public Health. 2001;11:305–17.
Building Research Establishment. Building research establishment domestic energy model (BREDEM). Watford: Building Research Energy Conservation Support Unit; 1997.
We would like to thank Carmarthenshire County Council for funding the research, and in particular Jonathan Morgan and Sandra Evans who helped greatly with the delivery of the research. We would also like to thank the tenants who took part in the research.
This project is funded by Carmarthenshire County Council.
Availability of data and materials
Data collected as part of the study can be obtained from the corresponding author.
Ethics approval and consent to participate
The study received ethical approval from the School Research Ethics Committee of the Welsh School of Architecture, Cardiff University (EC1011.048). The participants were informed about the aims of the study at the start of the interviews.
Consent for publication
Not applicable. The submission does not contain any personally identifiable information.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.