Development and validation of a measure of health literacy in the UK: the newest vital sign
© Rowlands et al; licensee BioMed Central Ltd. 2013
Received: 20 July 2012
Accepted: 3 January 2013
Published: 7 February 2013
Skip to main content
© Rowlands et al; licensee BioMed Central Ltd. 2013
Received: 20 July 2012
Accepted: 3 January 2013
Published: 7 February 2013
Health literacy (HL) is an important public health issue. Current measures have drawbacks in length and/or acceptability. The US-developed Newest Vital Sign (NVS) health literacy instrument measures both reading comprehension and numeracy skills using a nutrition label, takes 3 minutes to administer, and has proven to be acceptable to research subjects. This study aimed to amend and validate it for the UK population.
We used a three-stage process; (1) a Delphi study with academic and clinical experts to amend the NVS label to reflect UK nutrition labeling (2) community-based cognitive testing to assess and improve ease of understanding and acceptability of the test (3) validation of the NVS-UK against an accepted standard test of health literacy, the Test of Functional Health Literacy in Adults (TOFHLA) (Pearson’s r and the area under the Receiver Operating Characteristic (ROC) curve) and participant educational level. A sample size calculation indicated that 250 participants would be required. Inclusion criteria were age 18–75 years and ability to converse in English. We excluded people working in the health field and those with impaired vision or inability to undertake the interview due to cognitive impairment or inability to converse in English.
In the Delphi study, 28 experts reached consensus (3 cycles). Cognitive testing (80 participants) yielded an instrument that needed no further refinement. Validation testing (337 participants) showed high internal consistency (Cronbach’s Alpha = 0.74). Validation against the TOFHLA demonstrated a Pearson’s r of 0.49 and an area under the ROC curve of 0.81.
The NVS-UK is a valid measure of HL. Its acceptability and ease of application makes it an ideal tool for use in the UK. It has potential uses in public health research including epidemiological surveys and randomized controlled trials, and in enabling practitioners to tailor care to patient need.
Health literacy (HL) is defined as ‘the cognitive and social skills that determine the motivation and ability of individuals to gain access to, understand and use information in ways that promote and maintain good health’ [1, 2]. It is recognised as an important cause of health inequalities in industrialised nations such as the UK, US, Canada, and Australia [2–6]. HL is a complex concept, with multiple components . The ability to understand both language and numbers in health contexts are core competencies. Health literacy is associated with educational status and other social determinants of health such as ethnicity and socio-economic status, but has an association with health and long-term conditions that persists even when these are controlled for in analyses .
Where there is a mismatch between individuals’ health-related literacy and numeracy skills and the demands of the health system, those with lower skills are at risk of poorer health. Low HL is associated with limited participation in screening for diseases, limited understanding of one’s illness or treatment plan, difficulties managing a chronic conditions such as diabetes mellitus, coronary health disease, heart failure, and asthma, poorer overall health status [5, 9–14] and increased mortality .
Development of the evidence that links low HL and health has been facilitated by the use of measures of individual HL skills. The two most commonly used measures are the Test of Functional Health Literacy in Adults (TOFHLA)  and the Rapid Estimate of Adult Literacy in Medicine (REALM) . Both TOFHLA and REALM have been validated for use in the UK [18, 19]. However, both have disadvantages in use in research and practice. The length of time required for administration of the TOFHLA (22 minutes or more for the full version and up to 10 minutes for the shortened version) precludes its use in busy clinic settings and significantly increases the length of participant questioning if used in research. The REALM can be administered quickly (in less than 3 minutes) but, unlike the TOFHLA, does not test word comprehension or numeracy.
The Newest Vital Sign is a relatively new instrument, developed in the US and a validated predictor of health literacy, measuring both literacy and numeracy skills. Now described in more than 50 peer-reviewed journal articles, the NVS consists of a food nutrition label with six associated questions giving scores from 0 to 6 . It is quick to administer (3 minutes), acceptable to patients, and accurately predicts health literacy levels when compared to the lengthier TOFHLA.
This study’s objectives were to undertake a process of cognitive testing with health practitioners, nutritionists, academics, and the public in the UK to (a) modify the NVS nutrition label to match the style and content of nutrition labels used in the UK and (b) modify the questions associated with the nutrition label so that terminology and language matched common language usage in the UK. This was followed by validation of the amended test (the “NVS-UK”) against the UK-validated version of the TOFHLA. The TOFHLA was chosen as the standard against which the NVS-UK would be validated as it tests comprehension, is an accepted standard test for health literacy  and was the standard against which the original US version of the NVS was validated .
The NVS nutrition label was adapted to conform to current UK food labeling practice and the questions were converted from US- to UK-style English. We did this with a web-based Delphi technique [21, 22] that involved a panel of experts from clinical practice (medicine, nursing, pharmacy), public health, dietetics, research, adult education, and the food and drink industry. Recruitment of these experts was undertaken through the Health Literacy Group UK, a not-for profit organization that aims to raise the profile of health literacy as a remediable cause of health inequalities . All Health Literacy Group UK members were invited by email to participate and all who expressed an interest were recruited. We asked these experts to assess nutrition labels used in the UK, to compare their content and layout to the nutrition label used on the original (US) version of the NVS, and to suggest modifications of the original NVS nutrition label to make it concordant with UK nutrition labels. We also asked them to make suggestions for modifying the wording of the questions that accompany the nutrition label. The intent of these modifications was to make the style of English in the questions correspond to common usage in the UK.
Participants then used a web-based Delphi technique to score the layout of the modified nutrition label and questions, ranking them on a 5-point scale in which 1 indicated complete disagreement that the nutrition label and questions were suitable for use in the UK, and 5 indicating complete agreement. Further modifications of the nutrition label and questions were made in response to these scores and suggestions from participants, and rounds of web-based scoring were continued until consensus was reached (i.e. all participants scoring 4 or 5) that the label and questions were suitable for use in the UK and no more suggestions for improvement were being made.
National readership survey social grades
% of population (NRS 2010)
Higher managerial, administrative and professional
Intermediate managerial, administrative and professional
Supervisory, clerical and junior managerial, administrative and professional
Skilled manual workers
Semi-skilled and unskilled manual workers
State pensioners, casual and lowest grade workers, unemployed with state benefits only
Each participant was asked to complete the NVS UK questions, comment on question wording and label content and layout, and explain the processes they used to answer each question. They were asked to give feedback on the length of the survey and the clarity and difficulty of the questions.
This was an iterative process in which successive rounds of 15–20 interviews were carried out. Each round was followed by a review of the responses by project investigators and further modification of the NVS label and questions as indicated by interview results. Interview rounds continued until no more modifications were suggested. Participants in the cognitive interviews all gave informed consent and were offered a £25 voucher as compensation for their time.
The socio-demographic characteristics of the participants in the cognitive interviews were compared with local and national population characteristics using Office of National Statistics (ONS) 2007 mid-year estimates , ONS 2009 mid-year estimates  and 2001 UK census data .
Validation of the NVS-UK was assessed by comparing its performance to that of an accepted standard measure of health literacy, the TOFHLA [16, 18], including the area under the Receiver Operating Characteristic (ROC) curve, and it’s correlation with education qualification attainment.
Data were collected on socio-demographic, lifestyle, and educational attainment in an interview that lasted 45–60 minutes. Age data were collected in 10-year age bands. The interview procedures were pilot tested with 20 Lambeth residents, following which the main validation survey was undertaken.
The reference standard measure for HL used in this study, the TOFHLA, was developed from hospital materials and consists of a 50-item reading comprehension and 17-item numerical ability test, taking 22 minutes or more to administer. The reading items use a modified Cloze procedure, in which every 5th to 7th word in a passage is omitted and replaced with a blank space; the word to fit into each blank space is chosen from multiple-choice options. The numeracy items use prescription forms, clinic instructions, and medical insurance examples about which questions are asked requiring calculations. TOFHLA scores range from 0 to 100. A score of <60 represents inadequate health literacy; people with skills at this level are likely to experience the greatest barriers due to limited literacy and numeracy. A score of 60 to 74 represents marginal literacy; people scoring at this level may experience some difficulties understanding and using health information. Those scoring >75 have adequate literacy and are unlikely to experience problems arising from limited health literacy and numeracy skills.
Participants completed the NVS UK first followed by the UK-validated version of the TOFHLA.
For validation against the TOFHLA, the sample size calculation was based on published reports on the validation of the original NVS, where correlation against the TOFHLA was 0.59 . An unacceptable correlation was considered to be 0.3 (i.e. accounting for 9% of variance), and (based on previous data) a plausible correlation for purposes of power calculation was defined as 0.5 (or more). All correlations that could be shown to be significantly higher than 0.3 were regarded as acceptable. At least 250 subjects were required to give 90% power to detect such a difference.
The recruitment area for the validation stage was widened to include the London Borough of Southwark. Southwark is a borough neighbouring Lambeth with similar socio-demographic characteristics i.e. high levels of socio-economic deprivation and a high proportion of people from BEM groups . Eligibility criteria were age 18 – 75 years, living at home, and ability to converse in English. We excluded potential participants if they were health care professionals (defined as people working in the National Health Service or private health care), did not live at home, had self-reported impaired vision (unable to read the test card), or were unable to hold a conversation with the interviewer due to cognitive impairment or inability to converse in English. Sampling aimed to recruit a sample reflecting the age, gender, NRS social grades and ethnic mix of Lambeth and Southwark. Recruitment was by postcode with interviewers assigned to clusters of postcodes with a high prevalence of residents fitting the desired recruitment profile. A total of 51 sample points were issued, with 7 interviews to achieve within each sample point. Interviewers knocked at the doors of potential recruits; if no-one eligible for the study was available or participation was declined, the interviewer went to the next address on their list. The interviews took place in participants’ homes with consent. Participants were given a £15 gift voucher in compensation for their time.
The principal analysis to determine the validity of the NVS-UK was to assess the correlation (Pearson r) between scores on the NVS and an accepted standard measure of health literacy, the TOFHLA [16, 18] and by calculating the area under the receiver operating characteristic (ROC) curve. Validity was further assessed by the correlation (Pearson’s r) between the NVS and participants’ educational qualification attainment.
Optimal cut-off point(s) on the NVS UK for differentiating different levels of health literacy as identified by the TOFHLA were undertaken through calculation of the sensitivity and specificity for selected cut scores in the ROC analysis.
Statistical analyses were performed using STATA. V 11.2.
The cognitive testing and validation interviews were conducted by Ipsos MORI under the Market Research Society (MRS) Code of Conduct and Interviewer Quality Control Scheme (IQCS). Ethics approval for the study was granted by the London South Bank University Ethics Committee (ref UREC 1034). This project was exempt from NHS Research Ethics Approval as participants were not recruited from the NHS.
Area of interest/expertise of Delphi expert panel 1
health (other please state)2
literacy language and numeracy
education practitioner / teacher
food and drink industry
Other non-health (please specify)2
Cognitive testing to amend Newest Vital Sign (NVS) UK: Socio-demographic characteristics of participants
Product Description: Ice Cream
Servings per container:
250 kcal (calories)
of which sugars
of which saturates
of which monounsaturates
of which polyunsaturates
of which trans fats
NVS UK questions and correct responses
1. How many calories (kcal) will you eat if you eat the whole container?
1,000 KCAL or 1,000 CALORIES
2. If you are advised to eat no more than 60 grams of carbohydrate for dessert, what is the maximum amount of ice cream you could have?
Two servings (or anything up to 2 servings) OR Half the container (or any amount up to half the container) OR 200 ml (or any amount up to 200 ml).
3. Imagine that your doctor advises you to reduce the amount of saturated fat in your diet. You usually have 42 g of saturated fat each day, some of which comes from one serving of ice cream. If you stop eating ice cream, how many grams of saturated fat would you be eating each day?
4. If you usually eat 2500 calories each day, what percentage of your daily calorie (kcal) intake will you get if you eat one serving of ice cream?
1/10 (one tenth) OR 10%
Imagine that you are allergic to the following substances: penicillin, peanuts, latex gloves, and bee stings.
5. Is it safe for you to eat this ice cream?
If ‘No’ to Q5:
6. Why not?
Because it contains peanut oil/peanuts/nuts OR Because you might have an allergic reaction
ASK IF answer to Q6 is ‘Because you might have an allergic reaction’:
7. Why would you have an allergic reaction?
Because it contains peanut oil/peanuts/nuts
The internal consistency of the NVS UK was high (Cronbach’s Alpha = 0.74).
The correlation against the reference standard TOFHLA was 0.49 on 332 observations (95% CI: 0.40 to 0.57), meaning that 24% (95% CI 16 to 32) of variance is accounted for; which can be deemed acceptable as it is significantly higher (P<0.001) than the unacceptable value of 0.30 set in the power calculation.
The area under the receiver operating characteristic (ROC) curve for predicting TOFHLA scores was 0.81 (Standard Error (SE) 0.0302, 95% confidence interval 0.76 to 0.88). This is shown in Figure 3.
Validation of NVS UK: Socio-demographic characteristics of participants
Lambeth and Southwark %
Black and Ethnic Minority
Level 0 and 1
Level 2 and above
Optimal cut-off points for prediction of adequate health literacy levels on the TOFHLA
Sensitivity (true positive)
Specificity (true negative)
We have modified the original NVS to develop a new version that is suitable for use in the UK. The NVS-UK has face validity, as it tests skills used in everyday life (i.e. understanding and interpreting information on a food nutrition label) – a factor that is likely to contribute to its acceptability to patients . The instrument measures both text comprehension (literacy) and numeracy skills.
In addition, our analysis shows that the NVS-UK has good psychometric characteristics. Scores correlate well with a UK-validated version of the more complex and lengthy TOFLHA. Importantly, the area under the ROC curve of 0.81 was high, indicating high accuracy and, in fact, higher accuracy than many screening tests that are widely used in clinical practice [33–35]. The broader distribution and lesser skewness of the NVS scores across the population when compared with the TOFHLA (Figures 1 and 2) indicate a better ability to discriminate across a wider range of health literacy levels.
The ROC analysis identified optimal cut-off points for interpreting NVS-UK results in research or clinical practice. A score of 4 or more would correctly identify all those with adequate health literacy skills, a score of 2 – 3 would indicate intermediate health literacy skills, and a score of 0 – 1 would indicate low health literacy skills. These cut-off levels are the same as those found in validation of the original NVS. These values can be used in both research and clinical practice to identify individuals likely to have health literacy skills at those three levels.
It important to note, however, both the NVS and the TOFHLA are assessment tools that identify only certain aspects of the ‘cognitive and social skills needed by individuals as they access, understand, and use information in ways that promote and maintain good health’ [1, 2]. Neither will measure the full range of skills needed to be ‘health literate’, or can assign a specific reading or numeracy level. Our study does show, however, that the NVS-UK is valid as a screening test that gives an accurate prediction of health literacy skills in comparison to the more complex and longer TOFHLA, and is likely to discriminate across a wider range of skills levels.
It should be noted that our study only included people able to converse in English. Further studies are required to determine potential use of the NVS-UK in people who have limited English skills. This may be facilitated by its translation into and validation in other languages. A validated Spanish version of the NVS is available  and the instrument has recently been translated into Dutch and Turkish, [36, 37].
Finally, although the UK-NVS had a higher correlation with educational attainment than the TOFHLA or REALM, the correlation is nonetheless low. This low correlation was not unexpected as it is known that educational attainment is not a good predictor of literacy skills; many individuals have literacy skills well below what might be expected from the number of years of schooling they completed . When health literacy skills need to be ascertained in research or practice, education level should not be used to make this determination. Rather, a direct measure such as the NVS-UK should be used.
The NVS-UK is a simple and accurate predictor of health literacy skills. Previous studies [20, 32, 39] show that it takes an average of 3 minutes to complete and can be administered by both clinical and non-clinical personnel. This, combined with its acceptability to patients  makes it an ideal measure to be used in surveys, cohort studies, and clinical trials in which health literacy may be a factor.
The NVS has been widely used in clinical practice to aid practitioners and practice managers in understanding the HL skills of their patient populations, and such assessments have been found acceptable to nearly all patients [40, 41].
An interesting possibility is the potential use of HL assessment as a diagnostic tool when patients appear to be experiencing difficulties in understanding and managing complex conditions or adhering to medication or other treatment regimens, as HL is known to be a predictor of poor adherence [42–44]. Further research is required to investigate this.
The speed, simplicity, validity and acceptability of the NVS-UK make it an ideal research tool to investigate the role of health literacy in health and illness. It also has a potentially valuable role in improving clinical practice and patient communication.
GR (corresponding author) is Professor of Health Disparities at London South Bank University, UK and Chair of the Health Literacy Group UK http://www.healthliteracy.org.uk.
NK is a Consultant Community Midwife at Guy’s and St Thmoas’ NHS Foundation Trust, London, UK.
EO-M is Head of Obstetrics at Guy’s and St Thomas’ NHS Foundation Trust, London UK.
PS is a non-clinical Senior Lecturer in Medical Statistics at King’s College London, UK.
SB is a Research Dietician at King’s College London, UK.
BDW is a Professor of Family Medicine at the University of Arizona, US.
Black and ethnic minority
Newest vital sign
Office of national statistics
Rapid estimate of adult literacy in medicine
Receiver operating characteristic
Test of functional health literacy in adults
The authors thank Ipsos MORI team who conducted the interviews for this project, Dr Bridget Holmes who contributed to writing the grant application, additional thanks to expert panel from the Health Literacy Group UK who supported us with the Delphi technique, and Lucy McDonald who provided administrative support.
This study was funded by The Guys & St Thomas’ Charity http://www.gsttcharity.org.uk.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.