Validation of self-reported anthropometrics in the Adventist Health Study 2

Abstract

Background

Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2).

Methods

We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity.

Results

On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m². The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern.

Conclusions

Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity.

Background

Obesity is one of the main public health problems of this century. The prevalence of overweight and obesity has reached epidemic proportions around the world, not only in developed countries but also in developing countries. Thus, it has been recognised as a pandemic by the World Health Organization [1].

Obesity is an important risk factor for several chronic diseases such as cardiovascular disease, hypertension, type 2 diabetes, arthritis, and some cancers [2]. In addition, the causes of obesity are multiple and complex. For all these reasons it is important to assess obesity as a risk factor and to study the potential causes of weight gain in large populations.

Body mass index (BMI) has been used as a measure of obesity, with obesity defined as a BMI ≥30 kg/m² (calculated as weight in kg divided by height in meters squared) [1]. Self-reported height and weight provide a cost-effective assessment of these variables and thus have been used in numerous epidemiological studies as the only feasible way to obtain information. However, relying on self-reported data of participants has inherent problems. Therefore, it is of the utmost importance to assess the validity of that information.

The validity of "self-reported" BMI, calculated from self-reported height and weight has been assessed in several populations [3–6]. Results vary depending on the characteristics of the population. In this context, there are no studies assessing the validity of these self-reported measures in a population mostly vegetarian. Therefore, our objective was to evaluate the validity of self-reported anthropometrics in a representative subsample of the Adventist Health Study 2 (AHS-2) cohort.

Methods

The Adventist Health Study 2 (AHS-2)

The AHS-2 is a prospective cohort study of over 96,000 adult Adventists in the USA and Canada. The main objective of the study is to assess the association between lifestyle choices, particularly diet, and the risk of cancer and other health outcomes. Its methods have been described elsewhere [7]. Briefly, the sample includes Seventh-day Adventist church members living in the USA and Canada who were 30 years and older, and who were sufficiently fluent in English to complete the lengthy lifestyle questionnaire. Enrolment started in February 2002 and finished December 2007. All participants completed a self-reported lifestyle questionnaire including their weight and height. Most participants were either Caucasian or Black/African-American. The AHS-2 cohort is relatively unique for its wide range of dietary patterns compared with the general Western population. Also interesting is that about half of participants practice some kind of vegetarian dietary pattern [8].

Validation study

Subjects included in this report are part of a calibration study for the AHS-2 conducted at Loma Linda University. Participants were randomly selected from the AHS-2 using a two-stage random selection method: first, churches were randomly selected from around North America, being weighted for church size; then subjects were randomly chosen from each of these churches. Participants attended a scheduled clinic appointment at their local church. Weight was measured with a calibrated scale without shoes and heavy outer garments, to the nearest 0.1 kg and height was measured with a stadiometer without shoes to the nearest 1/4 inch. Both measurements were taken by a trained research assistant. Vegetarian status, and intake of soy and nuts were obtained from a previously validated food frequency questionnaire [9]. Participants with a diagnosis of active cancer, Alzheimer's disease, or pregnant women were excluded from the calibration study. Unqualified subjects and those who refused to take part in the calibration study (about one third) were replaced with individuals randomly chosen from the same church and matched by race, age (within 5 y of the original subject age), and sex. Because of the special focus on black Adventist as a minority in the AHS-2, the calibration was designed to include approximately equal numbers of blacks and whites. The study was approved by the institutional review board of Loma Linda University, and all subjects signed a written informed consent.

Statistical analyses

We calculated the crude differences between self-reported and measured anthropometrics (weight, height, and BMI) and adjusted them for time-lag between self-reported and measured anthropometric data, and for race, age, and sex by analyses of covariance. We report the differences between self-reported and measured variables according to population characteristics and compared them through Student T tests, or analyses of variance, depending on the form of the variables.

We studied the agreement between self-reported and measured anthropometric variables using a random-effect model intraclass correlation coefficient and the survival agreement plot for BMI proposed by Luiz et al. [10] differentiating between negative and positive differences [11].

Non-parametric Spearman correlation coefficients were calculated between self-reported and measured anthropometric variables. Sensitivity, specificity, predictive positive and negative values and Kappa index were calculated for the validation of obesity (BMI≥30 kg/m²).

Participants were categorised into quintiles of weight according to their self-reported and measured weight information. The percentages of misclassification in different adjacent quintiles or, when the misclassification was more than two quintiles, were estimated. Similarly, we classified participants according to each category of BMI (normal weight, overweight and obese) and calculated the absolute agreement and the overall kappa index.

We also present the BMI relative error (self-reported-measured/measured*100) graphed against the average BMI according to Bland and Altman [12].

Finally, to evaluate predictors of differences between self-reported and measured weight and BMI, multivariate linear regression analyses were performed taking weight and BMI differences [self-reported-measured] as the dependent variable.

Results

From 1011 participants in the calibration study, we excluded one hundred participants with missing values, thus finally including 911 participants.

Those 911 participants were a good representation of the overall AHS-2cohort, except that the validation sample had a slightly higher percentage of soy consumers (Table 1). The difference in race is by design as the calibration study over-sampled black subjects.

Table 1 Characteristics of participants in the validation sample and in the Adventist Health Study-2 (AHS-2).

On average, participants self-reported lower weight (-0.31 kg, 95% CI: -1.20 to +0.58), greater height (+1.66 cm, 95% CI: +0.99 to +2.33) and thus lower BMI (-0.64 kg/m², 95% CI: -1.02 to -0.25) as compared to measured values, after adjusting for time-lag, measured anthropometrics, age and sex (Table 2).

Table 2 Comparison between self-reported and measured values for weight, height and body mass index (BMI) in the validation sample (n = 911) of the Adventist Health Study-2.

When we compared self-reported and measured anthropometrics according to population characteristics we found differences according to age: younger participants reported less weight than measured, however older participants reported more weight than objectively measured. Older participants reported more height than was measured. Those participants who reported less BMI were particularly between 45-55 years old. Obese participants also reported a more inaccurate BMI than non-obese participants reporting -0.9 kg/m² [95% CI: -1.3 to -0.6] less than measured. Similarly, those participants who were non-soy consumers (<1 g of soy protein per day) had more measurement error than soy-consumers (Table 3). There were no differences between sex, race, nut consumption and dietary pattern.

Table 3 Anthropometric differences according to population characteristics in the AHS-2 validation sample (n = 911).

Spearman correlation coefficients (95% CI) for weight, height, and BMI were 0.96 (0.95-0.96), 0.96 (0.95-0.96), and 0.94 (0.93-0.94), and intraclass correlation coefficients were 0.98 (0.97-0.98), 0.95 (0.93-0.97), and 0.97 (0.96-0.97). The sensitivity of self-reported BMI to detect obesity was 0.81 (0.76-0.85), the specificity 0.97 (0.95-0.98), the predictive positive value 0.93 (0.89-0.97), the predictive negative value 0.92 (0.89-0.94), and the Kappa index 0.81 (0.77-0.85).

After cross-classifying participants into quintiles of self-reported and measured weight, the absolute agreement between quintiles was 74% (95% CI: 71-77%). In addition, if we calculated the absolute agreement between self-report and measured values using a category including participants with values in the same quintiles or +/- 1 adjacent quintile, there was almost total agreement (99.1%, 95% CI: 98.3%-99.6%).

The absolute agreement in the cross-classification of participants according to their self-reported and measured BMI categories (normal weight, overweight and obese) was 83.4% (95% CI: 80.9%-85.8%).

After multivariate analyses, predictors of differences between self-reported and measured weight were age, obesity, education, soy consumption, and type of dietary pattern followed-up. Similarly, predictors of BMI differences were obesity, soy consumption, and type of dietary pattern followed-up (Table 4). The Bland-Altman plot shows a relatively random variability given the inexistence of a funnel plot (Figure 1).

Table 4 Multivariate Prediction of differences between self-reported and measured weight and body mass index (BMI).

Figure 1

Bland-Altman plot for Body Mass Index (BMI) relative error*. *[(Self-reported - Measured)/Measured]*100.

Finally, we used the survival-agreement plot to depict graphically the agreement between self-reported and measured BMI (Figure 2). We noted that negative BMI relative errors (under-reported) tended to be greater than positive BMI relative errors (over-reported) (log-rank test, p < 0.001).

Figure 2

Survival agreement Plot for Body Mass Index (BMI). *[(Self-reported - Measured)/Measured ]*100 Log-Rank Test < 0.001 Survival agreement Plot as proposed by Luiz et al. (J Clin Epidemiol 2003; 56:963-7). The x-axis shows the absolute difference between self-reported and measured weight (kg), and the y-axis shows the proportions of observations with differences that are at least those in the x-axis. Separate lines for negative difference (self-reported-measured; infra-reported) and continuous line for positive difference (self-reported-measured; over-reported).

Discussion

Overall our results showed a high validity of self-reported anthropometrics in a representative subsample of the AHS-2 cohort. These results are in agreement with a meta-analysis of self-reported weight that included 24 studies which concluded that self-reporting is sufficiently accurate in epidemiological studies [13]. However, in the present study we also found some independent predictors of inaccurate values after multivariate analysis.

In contrast to some previous studies [6], [14], [15] we did not find differences between sexes in evaluating anthropometric data. Nevertheless, in agreement with the majority of the studies age was a predictor of reporting less height [3], [5], [15], [16]. This is understandable, since height declines with age in later life [17] and older people may be unaware of this decrease in their stature. Additionally in our study, age was also a predictor of reporting greater weight.

Similarly to other studies [3], [5], [16], [18] obese subjects provided less accurate weight and BMI data. They tended to underestimate their weight and hence BMI, but the bias in self-reported weight was only 0.6 kg on average among the obese. In this context, and in agreement with Villanueva et al [3], normal weight participants were least likely to be incorrectly classified to another BMI category, while obese participants were most likely to be incorrectly classified since obesity is seen as socially undesirable.

Regarding education, participants with at least 2-years of college reported less weight and BMI compared to those with a high school education or lower. This may be explained by the higher pressure and desirability bias in this group of people.

Race was not an independent predictor of validity as was observed in a recent study [6]. There were no differences between the white and black population of AHS-2 in the validity of self-reported anthropometrics. Gillum, et al [4] with data from NHANES III, similar to Kuczmarski, et al. [16], also did not find differences between blacks and whites. Gillum, et al [4] found a greater bias in BMI using self-reported data from Hispanic men and women compared with white non-Hispanic men and women. This is similar to our findings even though the trends were not statistically significant probably due to the small number of Hispanics' participants.

Interestingly, we found that soy consumers over-reported their weight compared to non-soy consumers; however, the latter group was more inaccurate regarding their anthropometric data, as the variances of differences between self-report and measured data were higher. Soy consumers might be more health conscious and as a consequence they might have more accurate knowledge of their weight and height. By contrast, semi-vegetarian participants, those with low meat and fish consumption, significantly underreported their weight and BMI in comparison to non-vegetarians. Future research is necessary to determine the generalizability of these findings to other settings. It is worth noting that the magnitude of differences between self-reported and measured weight was smaller than in other populations [5], [18]. The sensitivity in assessing obesity was higher [81%] than the 74% observed in the USA [19], 57% in Spain [20] and 55-61% in Sweden [21]. Our results were similar to those in a Scottish population [22] and in a Japanese workplace population [23].

One potential limitation of the study was the existence of a relatively wide time-lag between ascertainment of self-reported data and measured data. The median time-lag between the answered questionnaire and the time when subjects were been objectively weighted and measured for height was 1.58 years. Therefore, the observed differences between self-reported and measured weight and BMI may truly be due to real changes of weight and BMI across time. In fact, when we repeated the analyses including only those participants who went to clinics within a year after answering the questionnaire the results improved (i.e. Kappa index for obesity: 0.87; 95% CI: 0.77-0.97). However, our results were adjusted for time-lag period and in any case this potential limitation should bias the results towards a worse validity. Confounding by variables not controlled for cannot be excluded. However, given the uncertainty about the existence or nature of such associations it is unclear which other variables should be controlled for as confounders.

On the other hand, subjects completed the questionnaire on self-reported weight and height before the clinics and without knowing that their weight and height would be measured in the future. In addition, the number of participants in the validation study is relatively high and it was a representative sample of the AHS-2 cohort.

Conclusion

In conclusion, this study indicates that self-reported weight and height data from a cohort of Adventists in the USA and Canada is valid enough to be used in epidemiological association studies, although it can lead to some underestimation of obesity.