Reliability and validity of a short form household food security scale in a Caribbean community
© Gulliford et al; licensee BioMed Central Ltd. 2004
Received: 23 October 2003
Accepted: 16 June 2004
Published: 16 June 2004
We evaluated the reliability and validity of the short form household food security scale in a different setting from the one in which it was developed.
The scale was interview administered to 531 subjects from 286 households in north central Trinidad in Trinidad and Tobago, West Indies. We evaluated the six items by fitting item response theory models to estimate item thresholds, estimating agreement among respondents in the same households and estimating the slope index of income-related inequality (SII) after adjusting for age, sex and ethnicity.
Item-score correlations ranged from 0.52 to 0.79 and Cronbach's alpha was 0.87. Item responses gave within-household correlation coefficients ranging from 0.70 to 0.78. Estimated item thresholds (standard errors) from the Rasch model ranged from -2.027 (0.063) for the 'balanced meal' item to 2.251 (0.116) for the 'hungry' item. The 'balanced meal' item had the lowest threshold in each ethnic group even though there was evidence of differential functioning for this item by ethnicity. Relative thresholds of other items were generally consistent with US data. Estimation of the SII, comparing those at the bottom with those at the top of the income scale, gave relative odds for an affirmative response of 3.77 (95% confidence interval 1.40 to 10.2) for the lowest severity item, and 20.8 (2.67 to 162.5) for highest severity item. Food insecurity was associated with reduced consumption of green vegetables after additionally adjusting for income and education (0.52, 0.28 to 0.96).
The household food security scale gives reliable and valid responses in this setting. Differing relative item thresholds compared with US data do not require alteration to the cut-points for classification of 'food insecurity without hunger' or 'food insecurity with hunger'. The data provide further evidence that re-evaluation of the 'balanced meal' item is required.
Keywordsfood security food insecurity reliability validity questionnaires West Indies Trinidad and Tobago
Food insecurity has been defined as the 'limited or uncertain availability of nutritionally adequate and safe foods, or limited or uncertain ability to acquire food in socially acceptable ways' . Food insecurity may compromise both dietary intakes and health outcomes. The measurement of food insecurity in epidemiological studies through the use of self-reported responses to questionnaire measures has therefore attracted growing interest. In the United States, an 18 item food security questionnaire was developed  and applied in the 1995 Current Population survey and in subsequent surveys carried out for the US Department of Agriculture . This US food security questionnaire includes items relevant to households with children as well as adults. It has properties analogous to Guttman scaling  such that the items can be ranked according to decreasing frequency of affirmative responses and increasing severity of food insecurity. This property permits distinctions to be made between food security, food insecurity without hunger, food insecurity with moderate hunger, and food insecurity with severe hunger . In 1999 Blumberg et al  proposed an abbreviated short form of the household food security scale which included six items from the 18 item questionnaire. These were selected so as to be applicable to households with or without children, and to distinguish between food security, food insecurity without hunger and food insecurity with hunger only. This six item module has also been described, with a slightly different question order, by Bickel et al .
Application of the food insecurity scale in the US has revealed that food insecurity may be unexpectedly frequent even in a high-income country . The concept and measurement of food insecurity may be even more relevant in the setting of middle-income countries where a significant proportion of households have incomes which are low enough to potentially compromise access to food. In Trinidad and Tobago, the UN Food and Agriculture Organisation estimated that 13% of the population were under-nourished in 1997–1999 . We recently explored experiences of food insecurity in a population survey in Trinidad and Tobago using the short form of the household food security scale . We found that 25% of subjects were classified as food insecure according to this instrument. Food insecurity was associated with low incomes, physical limitations and lower consumption of fruit and vegetables. These findings were consistent with reports from the US [8, 9]. However, in contrast to some other studies [10–12], underweight was associated with food insecurity but overweight or obesity were not .
While the consistency of these associations with those of other reports pointed to the validity of the scale, our results showed an unexpectedly higher proportion of affirmative responses to the item concerning 'balanced meals' , and an unexpected difference in the prevalence of food insecurity across ethnic groups. The latter finding might have been explained by sampling imbalances, as a cluster sampling technique was used . Based on these two observations, Frongillo  questioned the validity of the short form food security for application in Trinidad and Tobago. The present report therefore aimed to evaluate item responses obtained using the short form household food security scale in a context which is different from the one in which the measure was developed.
Trinidad and Tobago is an English-speaking country but a distinct vernacular is widely used, especially by lower income groups. Food habits have been influenced by the cultures of European, African, Indian and Chinese immigrants to the country. More recently, restrictions on trade have been dismantled, American economic influences have become increasingly important and there have been associated changes in dietary habits. Based on a comparison of statistics, the gross national income per capita in Trinidad and Tobago was about 14% that of the US being US$4,930 in 2000 .
In order to evaluate the reliability and validity of responses to the short form food security scale, we first explored the consistency of the scale items  and estimated agreement between responses obtained from individual respondents from the same households. We then used item response theory models to estimate item thresholds, and to explore whether there was evidence of differential item functioning by ethnicity. In order to evaluate criterion-related validity , we estimated the association of each item with household income and frequent consumption of green vegetables and salads.
Subjects and questionnaire
Items in the short form Household Food Security Scale . Figures are frequencies (column percent) except where stated.
Affirmative responses (531)
Estimated Thresholda (SE)
Item fit P value
I/we couldn't afford to eat balanced meals
Affirmative: Often or sometimes true
The food that I/we bought just didn't last, and I/we didn't have money to get more
Affirmative: Often or sometimes true
In the last 12 months, since (date 12 months ago) did you (or other adults in your household) ever cut the size of your meals or skip meals because there wasn't enough money for food?
If YES, How often did this happen? Affirmative: Almost every month or Some months but not every month
In the last 12 months, did you ever eat less than you felt you should because there wasn't enough money to buy food?
In the last 12 months, since (date 12 months ago) were you ever hungry but didn't eat because you couldn't afford enough food?
Each item in the household food security scale was reduced to the categories of affirmative or not as described by Blumberg et al  (Table 1). We estimated Cronbach's alpha for the six items. We estimated the intraclass correlation coefficient for each item using analysis of variance in order to assess the correlation of item responses within households. Item response models were fitted to the data using BILOG-MG version 3.0 software from Scientific Software International . Item-score correlations were estimated as the Pearson correlation between each item and the total and were taken from the BILOG output . Initially a one parameter logistic (Rasch) model was fitted. Item thresholds, their standard errors and item fit P-values are reported. Item thresholds are estimated parameters which indicate the location of the item in relation to the latent construct. In this context, the threshold provides a measure of the relative severity of food insecurity associated with affirmative responses to an item. Under the conventions of the Rasch model, the item thresholds are scaled so that their arithmetic mean is zero. The thresholds may also be rescaled to a different mean location as discussed by Bickel et al .
After fitting the single group model, we explored whether there was evidence of differential item functioning in different ethnic groups. Subjects with 'not known' ethnic group were omitted from these analyses. The combined data from the three ethnic groups were fitted to a one-parameter logistic model, but with separate item thresholds estimated for each ethnic group. Only the means of the item thresholds were constrained to be equal across groups. The extent to which items functioned differentially in the three ethnic groups was then assessed by the likelihood ratio (difference in twice log likelihood) between the single-group model with item thresholds constrained to be equal for all respondents and this unconstrained model.
We used logistic regression to estimate associations between item responses, as dependent variables, and income. The slope index of inequality for income was estimated as recommended by Mackenbach and Kunst  and Wagstaff et al . This permitted the use of a single estimate to summarise the association between income and an item, rather than requiring the presentation of odds ratios for each category of income. Logistic regression was also used to estimate the association between consumption of green vegetables and salads, as dependent variable, and item responses. This variable was selected because food insecurity was associated with reduced consumption of green vegetables and salads. Regression analyses were adjusted for continuous variable age, sex and ethnic group. We also tested whether associations differed according to ethnic group. Robust standard errors were estimated to allow for clustering by household .
There were 631 eligible adults and food security data were obtained for 531 (84%) subjects from 286 households. There were 134 (25%) of subjects who were classified as food insecure, based on a definition of two affirmative items out of six. Table 1 lists the six items of the household food security scale in rank order of frequency of affirmative responses, with the exception that item number eight is listed after item number five with which it is associated. Items are numbered following Blumberg et al . Item-score correlations ranged between 0.52 to 0.79. The value of Cronbach's alpha, an index of internal consistency, was 0.87. In the Afro-Trinidadian ethnic group, Cronbach's alpha was 0.84, in Indo-Trinidadians 0.90 and in the mixed group 0.83. Table 1 also gives estimated threshold values from the Rasch model for each of the items. It was clear that the 'balanced meal' item gave the lowest severity threshold in this dataset. The severity rankings of the other items were consistent with US data.
Responses obtained from households with more than one respondent, and intraclass correlation coefficient. Figures are frequencies (column percent) except where indicated.
Discordant responses by household size
ICC (95% CI)
Two respondents (120)
Three respondents (30)
Four respondents (15)
0.78 (0.73 to 0.83)
0.73 (0.67 to 0.79)
0.70 (0.63 to 0.76)
0.71 (0.65 to 0.77)
0.78 (0.73 to 0.83)
0.77 (0.72 to 0.82)
0.68 (0.61 to 0.75)
Item responses and correlations by ethnic group. Figures are frequencies (column percent) except where indicated.
Test for differential item functioning by ethnicity.
Adjusted threshold estimates from differential item function model
3 'Balanced meal'
2 'Food last'
5 'Skip meal'
8 'How often'
7 'Eat less'
Associations of food security items with monthly household income. Figures are frequencies (row percent) except where indicated.
Affirmatives (%) with monthly income
Slope index of income-related inequality
Odds ratio (95% CI)a
Food secure (327)
Food insecure (127)
8.08 (2.91 to 22.5)
3 Balanced meal (153)
3.77 (1.40 to 10.2)
2 Food last (103)
5.35 (1.80 to 15.9)
5 Skip meals (91)
17.1 (5.15 to 56.7)
7 Eat less (71)
19.9 (4.99 to 79.4)
8 How often (68)
14.3 (3.49 to 58.5)
10 Hungry (29)
20.8 (2.67 to 162.5)
Associations of food security items with consumption of vegetables and salads. Figures are frequencies (row percent) except where indicated.
Eats vegetables ≥5–6 days per week (row %)
Odds ratio (95% CI)a
Food secure (397)
Food insecure (134)
0.43 (0.24 to 0.77)
3 Balanced meal (162)
0.42 (025 to 0.70)
2 Food last (109)
0.44 (0.23 to 0.84)
5 Skip meals (93)
0.42 (0.22 to 0.82)
7 Eat less (75)
0.32 (0.14 to 0.73)
8 How often (70)
0.36 (0.16 to 0.82)
10 Hungry (31)
0.51 (0.17 to 1.49)
Frequency of consumption of ten food items for each food security item. Figures are frequencies (percent of row total).
Whether eaten ≥5–6 times per week
Whether eaten at least weekly
Green vegetables and salads
Bread and bread rolls
Legumes (peas, beans and lentils)
Fish (including shellfish)
Sweets, chocolate etc
Sweet biscuits or cake
Burgers, fried chicken or pizzas
Food secure (397)
Food insecure (134)
3 Balanced meal (162)
2 Food last (109)
5 Skip meals (93)
7 Eat less (75)
8 How often (70)
10 Hungry (31)
The present study evaluated the food insecurity item responses and provides evidence for their reliability and validity in this setting . The six items of the short form household food security scale gave consistent responses. Cronbach's alpha was similar to the values of 0.84 and 0.86 reported by Kendall et al , for a slightly different group of items, and 0.86 reported by Hamilton et al  for the US food security measure. Streiner and Norman  suggest that values for alpha should exceed 0.70, while values in excess of 0.90 might suggest that some items are redundant. The reliability of the measure was also supported by the high level of agreement for item responses of individuals in the same households. The item response theory models provided evidence for the validity of the instrument in this context. Estimated item thresholds were generally consistent with the relative severity of food insecurity represented by each item in US data. The main departure from this pattern related to the 'balanced meal' item which was consistently the item with lowest severity in these data. The associations between item responses and household income and consumption of green vegetables and salads were consistent, and, at least for income, graded according to the severity of food insecurity represented by the item. These results provide evidence of criterion-related validity  similar to the results reported for the food security measure in the US [21, 22]. Furthermore the classification of food insecurity provided information additional to that from socio-economic status in terms of income and education.
In the US data, the item concerning 'food not lasting' gave the highest proportion of affirmatives . In our data, the 'balanced meal' item represented the item with lowest severity but the ranking obtained for the 'balanced meal' item was also reflected in the estimated associations with income and consumption of vegetables and salads. The findings from the Trinidad and Tobago data are therefore consistent even though they differ in this respect from the US data. However, there was evidence that the 'balanced meal' item performed differently in different ethnic groups, with a higher threshold being observed in the Afro-Trinidadian group which nevertheless exhibited the highest proportion with food insecurity in this sample. This differential functioning was not sufficiently large to influence the ranking of the item in the different groups. The 'eat less' and 'how often' items generally had similar thresholds while the 'hungry' item gave a much higher threshold. Therefore it is justifiable to conclude that the different relative item thresholds compared with US data, does not require alteration to the cut-points of two affirmatives for the classification of 'food insecurity without hunger' or five affirmatives for 'food insecurity with hunger'.
Qualitative data from Hawaii showed that the 'balanced meal' item may be subject to variable interpretation  and this was reflected in the performance of the food security measure . Harrison et al  also questioned the conceptual validity of this item in the translation of the food security questionnaire into Spanish. We share the reservations expressed by Derrickson et al  concerning this item. Derrickson et al  suggested that additional explanation of this item should be provided. In a more recent survey we have introduced the following text: 'a balanced meal may contain starchy food, like rice, potatoes, bread, ground provisions or macaroni ; and a protein-rich food like meat, fish, milk, or peas or beans; and a fruit or a vegetable'. This was adapted from Derrickson et al based on the advice of experienced local nutritionists. However, the requirement for additional explanation might support the idea that the original question is unsatisfactory. Qualitative research might be carried out to identify a more culturally appropriate wording for this item but changes to an established measure should generally be made cautiously because changes made locally may compromise the generalisability of findings.
Our study had the strengths of a population-based study based on a multi-stage sampling design. The questionnaire was interview administered and there were few missing values. The sample size was relatively modest but adequate for this purpose. A concern relates to the relative representativeness of the samples obtained for each ethnic group. The sample was drawn from 15 clusters of households and income, ethnicity and food insecurity were each correlated within clusters. Imbalance in the distribution of income, or food security, in relation to ethnicity could have occurred by chance through the sampling of a small number of clusters. Post hoc sub-group analyses by ethnicity therefore require replication and we caution against attaching undue weight to these findings, especially since there were few affirmative responses for some items when analysed by ethnicity. In the analyses, we were not always able to allow for the effects of clustering by household or household cluster because clustered versions of relevant tests were not available. In general the consequence would be to make standard errors and P-values too small, the results should therefore be viewed with some caution.
A considerable research effort, spanning almost a decade, was devoted to the development of the US food security measure [1, 21, 22]. The items were derived from the results of qualitative interviews with food insecure subjects, and the instrument is considered to be well grounded. Wolfe and Frongillo observed that the comparability of the instrument is likely to hold in 'many other countries' . The present results suggest that the instrument may certainly prove of value in assessing food insecurity within countries like Trinidad and Tobago which may have a higher frequency of food insecurity than the US. Our results generally support the reliability and validity of the food security scale within this population but, in agreement with other reports, we find that the 'balanced meal' item gave less consistent responses. Like any brief instrument, the short form household food security scale is unlikely to encompass all facets of the experience of food insecurity. There is a role for future research to evaluate whether relevant aspects of food insecurity are neglected by the instrument, and whether the sensitivity and specificity of the resulting classification can be enhanced. Nevertheless, the present results support the use of this measure in epidemiological studies to evaluate the distribution, determinants and associations of food insecurity within this population.
As with other self-reported measures, there are likely to be difficulties in making comparisons across different populations because individuals' expectations and their interpretations of item response categories may vary systematically between populations . This is evident in the results obtained for the 'balanced meal' item. The difference in prevalence of food insecurity between Trinidad and Tobago and the US is large and consistent. Nevertheless, comparisons between populations of the prevalence of food insecurity obtained using self-reported measures must be interpreted with caution. Associations obtained within populations are likely to be less sensitive to such problems, but even here they cannot always be ignored . Our data suggested that the pattern of responses was generally similar in each ethnic group but there was evidence that two of the items might have slightly different relative severities in different groups. Murray et al  observe that 'a critical requirement is an improved understanding of the determinants of differences between self-reported and observed measures of performance or capacity in selected domains in health' (page 991). This observation also applies in the assessment of food insecurity.
DM had the original idea for the survey and contributed to the design and implementation of the study, BR contributed to the design of the study and oversaw the collection of data, MG designed the questionnaire and measurement forms, analysed the data and drafted the paper. All authors read and approved the first version of the paper, MG and BR approved the final version of the paper. MG is guarantor.
intraclass correlation coefficient
slope index of inequality
The authors thank the Chief Medical Officer of Trinidad and Tobago for permission to report this work. We also thank the staff of the Central Statistical Office for help in drawing the sample and for advice on conducting the survey and the staff of the Nutrition Division for their skill and dedication in working on the survey.
- Carlson SJ, Andrews MS, Bickel GW: Measuring food insecurity and hunger in the United States: Development of a national benchmark measure and prevalence estimates. J Nutr. 1999, 129: 510S-516S.PubMed
- Nord M, Andrews M, Carlson S: Household food security in the United States, 2001. 2003, Washington DC: United States Department of Agriculture. Economic Research Service. Food Assistance and Nutrition Research report, 29:
- Streiner DL, Norman GR: In Health measurement scales. A practical guide to their development and use. 1989, Oxford: Oxford University Press
- Blumberg SJ, Bialostosky K, Hamilton WL, Briefel RR: The Effectiveness of a Short Form of the Household Food Security Scale. Am J Public Health. 1999, 89: 1231-1234.PubMed CentralView ArticlePubMed
- Bickel G, Nord M, Price C, Hamilton W, Cook J: Measuring food security in the United States. Guide to measuring food security. Revised 2000. 2000, Washington DC: USDA, Food and Nutrition Service
- United Nations Food and Agriculture Organisation: The state of food security in the world. accessed 15th April 2002, [http://www.fao.org/docrep/003/y1500e/y1500e06.htm#P0_3]
- Gulliford MC, Mahabir D, Rocke B: Food insecurity, food choices, and body mass index in adults: nutrition transition in Trinidad and Tobago. Int J Epidemiol. 2003, 32: 508-516. 10.1093/ije/dyg100.View ArticlePubMed
- Kendall A, Olson CM, Frongillo EA: Relationship of hunger and food insecurity to food availability and consumption. J Am Diet Assoc. 1996, 96: 1019-1024. 10.1016/S0002-8223(96)00271-4.View ArticlePubMed
- Tarasuk VS: Household food insecurity with hunger is associated with women's food intakes, health and household circumstances. J Nutr. 2001, 131: 2670-2676.PubMed
- Alaimo K, Olson CM, Frongillo EA: Low family income and food insufficiency in relation to overweight in US children: is there a paradox?. Arch Pediatr Adolesc Med. 2001, 155: 1161-1167.View ArticlePubMed
- Olson CM: Nutrition and health outcomes associated with food insecurity and hunger. J Nutr. 1999, 129: 521S-524S.PubMed
- Sarlio-Lahteenkorva S, Lahelma E: Food insecurity is associated with past and present economic disadvantage and body mass index. J Nutr. 2001, 131: 2880-2884.PubMed
- Frongillo EA: Commentary: Assessing food insecurity in Trinidad and Tobago. Int J Epidemiol. 2003, 32: 516-517. 10.1093/ije/dyg218.View ArticlePubMed
- Gulliford M, Mahabir D, Rocke B: Food insecurity definitions and body mass index. Response. Int J Epidemiol. 2003, 32: 1118-1119. 10.1093/ije/dyg330.View ArticlePubMed
- World Bank: World Development Indicators 2002. 2002, Washington DC: World Bank, accessed 3rd March 2003, [http://www.worldbank.org/data/wdi2002/tables/table1-1.pdf]View Article
- Kendall A, Olson CM, Frongillo EA.: Validation of the Radimer/Cornell measures of hunger and food insecurity. J Nutr. 1995, 125: 2793-2801.PubMed
- du Toit M, Ed: IRT from SSI: BILO-MG, MULTILOG, PARSCALE and TESTFACT. 2003, Lincolnwood, Il: Scientific Software International
- Mackenbach JP, Kunst AE: Measuring the magnitude of socio-economic inequalities in health: An overview of available measures illustrated with two examples from Europe. Soc Sci Med. 1997, 44: 757-771. 10.1016/S0277-9536(96)00073-1.View ArticlePubMed
- Wagstaff A, Paci P, van Doorslaer E: On the measurement of inequalities in health. Soc Sci Med. 1991, 33: 545-557. 10.1016/0277-9536(91)90212-U.View ArticlePubMed
- Stata Corporation: Stata Reference Manual. Release 7. 2001, College Station, Texas: Stata Corporation
- Hamilton WL, Cook JT, Thompson WL, Buron LF, Frongillo EA, Olson CM, Wehler CA: Household Food Security in the United States in 1995. Technical report of the food security measurement project. 1997, Washington DC, United States Department of Agriculture
- Hamilton WL, Cook JT, Thompson WW, Buron LF, Frongillo EA, Olson CM, Wehler CA: Household food security in the United States in 1995. Summary report of the Food Security Measurement Project. 1997, Washington DC, United States Department of Agriculture
- Derrickson JP, Sakai M, Anderson J: Interpretations of the "balanced meal" household food security indicator. J Nutr Educ. 2001, 33: 155-160.View ArticlePubMed
- Derrickson JP, Fisher AG, Anderson JEL: The Core Food Security Module Scale Measure Is Valid and Reliable When Used with Asians and Pacific Islanders. J Nutr. 2000, 130: 2666-2674.PubMed
- Harrison GG, Stormer A, Herman DR, Winham DM: Development of a Spanish-Language Version of the U.S. Household Food Security Survey Module. J Nutr. 2003, 133: 1192-1197.PubMed
- Wolfe WS, Frongillo EA: Building Household Food Security Measurement Tools from the Ground Up. 2000, Washington, DC: Food and Nutrition Technical Assistance Project. Academy for Educational Development
- Iburg KM, Salamon JA, Tandon A, Murray CJL: Cross-population comparability of physician-assessed and self-reported measures of health. The Global Burden of Disease 2000 in Aging Populations. Research Paper No. 01.20. 2003, Cambridge, MA, Harvard Burden of Disease Unit
- Sutton M, Carr-Hill R, Gravelle H, Rice N: Do measures of self-reported morbidity bias the estimation of the determinants of health care utilisation?. Soc Sci Med. 1999, 49: 867-878. 10.1016/S0277-9536(99)00169-0.View ArticlePubMed
- Murray CJ, Salomon JA, Mathers C: A critical examination of summary measures of population health. Bull World Health Organ. 2000, 78: 981-994.PubMed CentralPubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/4/22/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.