Does anonymity increase the reporting of mental health symptoms?
© Fear et al.; licensee BioMed Central Ltd. 2012
Received: 1 February 2012
Accepted: 6 September 2012
Published: 17 September 2012
There is no doubt that the perceived stigma of having a mental disorder acts as a barrier to help seeking. It is possible that personnel may be reluctant to admit to symptoms suggestive of poor mental health when such data can be linked to them, even if their personal details are only used to help them access further care. This may be particularly relevant because individuals who have a mental health problem are more likely to experience barriers to care and hold stigmatizing beliefs. If that is the case, then mental health screening programmers may not be effective in detecting those most in need of care. We aimed to compare mental health symptom reporting when using an anonymous versus identifiable questionnaire among UK military personnel on deployment in Iraq.
Survey among UK military personnel using two questionnaires, one was anonymous (n = 315) and one collected contact details (i.e. identifiable, n = 296). Distribution was by alternate allocation. Data were collected in Iraq during January-February 2009.
No significant difference in the reporting of symptoms of common mental disorders was found (18.1% of identifiable vs. 22.9% of anonymous participants). UK military personnel were more likely to report sub-threshold and probable PTSD when completing questionnaires anonymously (sub-threshold PTSD: 2.4% of identifiable vs. 5.8% of anonymous participants; probable PTSD: 1.7% of identifiable vs. 4.8% of anonymous participants). Of the 11 barriers to care and perceived social stigma statements considered, those completing the anonymous questionnaire compared to those completing the identifiable questionnaire were more likely to endorse three statements: “leaders discourage the use of mental health services” (9.3% vs. 4.6%), “it would be too embarrassing” (41.6% vs. 32.5%) and “I would be seen as weak” (46.6% vs. 34.2%).
We found a significant effect on the reporting of sub-threshold and probable PTSD and certain stigmatizing beliefs (but not common mental disorders) when using an anonymous compared to identifiable questionnaire, with the anonymous questionnaire resulting in a higher prevalence of PTSD and increased reporting of three stigmatizing beliefs. This has implications for the conduct of mental health screening and research in the US and UK military.
KeywordsMilitary Mental health Anonymity Stigma Barriers to care
The US Department of Defense is currently carrying out a large mental health screening programme with the aim of detecting mental health disorders in military personnel on their return from Iraq or Afghanistan, the Post-Deployment Health Assessment (PDHA) and Post-Deployment Health Re-Assessment (PDHRA) . The PDHA and the PDHRA use brief screening instruments which are administrated post-deployment to identify those individuals who require referral to mental health professionals and thus data collection is not anonymous. However, the effectiveness of these programmes remains in doubt. Milliken et al  found that not everyone identified via these programmes went on to attend a mental health clinic and that many of those who did attend mental health clinics did so in spite of not being identified as being in need of care by the screening process. Also Warner et al  reported that the PDHA misses most soldiers with mental health problems.
There is no doubt that the perceived social stigma of having a mental disorder acts as a substantial barrier to help seeking in both the UK and US Armed Forces [2–5]. It is possible that personnel may be reluctant to admit to symptoms suggestive of poor mental health when such data can be linked to them personally, even if their personal details are only used to help them access further care. This may be particularly relevant because individuals who have a mental health problem are more likely to report barriers to care and hold stigmatizing beliefs [2, 4, 5]. It is well documented that an individual’s beliefs about how they will be perceived by others if they have a mental health problem are powerful determinants of help-seeking . If that is the case, then mental health screening programmers may not be effective in detecting those most in need of care.
The aim of this paper was to examine the reporting of mental health problems using an identifiable and an anonymous questionnaire completed by UK military personnel. Data were collected during deployment to Iraq (in early 2009) as part of an in-theatre mental health survey (Operational Mental Health Needs Evaluation, OMHNE) .
The OMHNE visit was conducted at various locations in Iraq between 26 January and 27 February 2009, with the research team consisting of military and civilian personnel . True random sampling was not possible because of the need to ensure an adequate coverage of personnel from small widely dispersed operating bases, and for operational reasons. Instead, after discussion with the medical and personnel staff officers based in the UK operational headquarters, purposive sampling was conducted to ensure an adequate spread of personnel and locations. Information on the service and rank profile of the deployed force was obtained from the divisional personnel report, allowing examination of the representativeness of the study sample. All the main UK bases in Iraq were visited, excluding some remote locations. Location commanders were asked to assemble all available personnel so that the survey team could provide information about the study and distribute questionnaires. The survey team were explicit in briefing the potential respondents that, unlike other deployment activities, completion of the questionnaires was voluntary. Personnel were also assured that all information was confidential, that their individual responses would not be reported to commanders and that no individual would be named in any report about the study. Respondents were informed that any personal identification information would be separated from the questionnaire by the study team and stored separately. The questionnaire took approximately 25 minutes to complete. Participants were not given any payment or any other inducement for taking part in the study. Once completed, participants placed their questionnaire in an envelope and sealed it before giving it to a member of the study team.
The study used two versions of the OMHNE questionnaire. One was completely anonymous in that it asked for no information which could be used to identify the respondent. The other version asked for a variety of identifiable information, including: first name, surname, date of birth, Service number, and both unit and home address. Approximately 50% of the participants filled in anonymous questionnaires, with the other 50% being asked to provide contact details. The operational environment mandated a simple system of allocation, so we used alternate allocation to distribute the questionnaires. The questionnaires were distributed by the study team directly to the individuals and thus every other questionnaire allocated was anonymous. Personnel were reassured that no matter which version of the questionnaire they received no identifiable information would be released by the research team to anyone (including the Chain of Command) and that no participant would be referred on for care. All participants were UK military personnel on operational deployment to Iraq and were a non-help seeking group. Special Forces personnel were not included in the sample. Full details of the study methodology can be found in Mulligan et al .
Mental health measures
The OMHNE questionnaire included two mental health measures. The 12-item General Health Questionnaire (GHQ), which was used to measure symptoms of common mental disorders . The GHQ asks participants to rate their health according to each of 12 items in relation to the last few weeks (compared to usual). Response categories are scored from 0-3 and were re-coded into binary scores (0-1) such that the responses ‘better than usual’ and ‘same as/no more than usual’ were coded 0, and the responses ‘rather more than usual’ and ‘much more than usual’ were coded as 1. The responses are summed and a caseness cut off score of ≥4 was used to define having symptoms of common mental disorder .
The Post-Traumatic Stress Disorder (PTSD) Checklist Civilian Version (PCL-C) was used to measure probable PTSD , with a score of ≥50 being used to define those with probable PTSD . We have examined the PCL score in four categories to aid interpretation (17-19, 30-39, 40-49 (defined as sub-threshold PTSD) and 50+ (defined as probable PTSD). We also examined the three domains of PTSD, using the definition of one positive endorsement for intrusiveness (criterion B), three endorsements for numbing/avoidance (criterion C) and two endorsements for hyper-arousal (criterion D).
The OMHNE questionnaire included a list of 11 stigma statements (adapted from Hoge et al ). These were five statements referring to barriers to care, for example, “it’s difficult to schedule an appointment”, and six statements referring to perceived social stigma, for example, “I would be seen as weak”. Response options were on a 4-point Likert scale from strongly agree to strongly disagree. For the purposes of these analyses, responses were combined to form two response options (agree vs. disagree).
Socio-demographic, military and deployment factors
The questionnaire included questions about socio-demographic and military characteristics and deployment experiences. Combat exposure was assessed with a 17-item measure that asked about the frequency of exposure to potentially traumatic combat events. For each combat exposure, respondents were asked how many times in their current deployment they had experienced this exposure (never, once, 2-4 times, 5-9 times or 10+ times). This measure was adapted from Hoge et al . For the purposes of the current analyses, exposure to each combat experience was summed and then the overall distribution was divided into tertiles (no exposures, 1-2 or 3+).
Approval to conduct the study was granted by the Ministry of Defence Research Ethics Committee (MODREC) (Protocol No. 839/194). All participants gave written informed consent. The study complies fully with the Helsinki Declaration.
Chi2 and t-test statistics were used to compare the categorical and continuous socio-demographic, military and deployment characteristics of the two groups. Chi2 test statistics and odds ratios (with 95% confidence intervals) were used to determine whether completing an identifiable or anonymous questionnaire influenced the likelihood of reporting mental health symptoms and stigmatizing beliefs. The data were analyzed using STATA 11, with statistical significance defined as P < 0.05.
Of 612 personnel approached to take part, 611 (99.8%) completed the survey. This represented approximately 15% of the UK Armed Forces personnel deployed to Iraq at the time the data were collected. The sample consisted of Naval Service (including Royal Marines), British Army and Royal Air Force personnel, men, women, regular and reserve personnel. The overall prevalence of probable PTSD was 3.3% (20/605) and 20.5% (121/590) for symptoms of common mental disorders. Of the 20 cases with probable PTSD, 16 also reported symptoms of common mental disorders.
Socio-demographic, military and deployment characteristics by questionnaire type (Anonymous vs. Identifiable)
Identifiable (n = 296)
Anonymous (n = 315)
Chi2 or t-test statistic (degrees of freedom), P value
0.75 (1), P = 0.388
Mean age in years
0.48 (597), P = 0.631
(95% confidence interval)
0.27 (1), P = 0.603
8.69 (2), P = 0.013
Royal Air Force
0.14 (2), P = 0.932
Thought might be killed
0.77 (1), P = 0.379
Number of traumatic events experienced*
1.94 (2), P = 0.380
Questionnaire Type (Anonymous vs. Identifiable) and Symptom Reporting
Identifiable (n = 296)
Anonymous (n = 315)
Chi2 test statistic (degrees of freedom), P value
Odds ratio (95% confidence interval)
Adjusted* odds ratio (95% confidence interval)
PTSD (score on the PCL)
9.66 (3), P = 0.022
- 40-49 (sub-threshold PTSD)
- 50+ (probable PTSD)
Common mental disorders
- case (cut off 4+)
2.08 (1), P = 0.150
Questionnaire Type (Anonymous vs. Identifiable) and Reporting of Barriers to Care and Perceived Social Stigma
Identifiable (n = 296)† n (%)
Anonymous (n = 315) †† n (%)
Chi2 statistic (degrees of freedom), P value
Odds ratio (95% confidence interval)
Adjusted* odds ratio (95% confidence interval)
Barriers to Care
It is difficult to schedule an appointment
0.31 (1), P = 0.580
It is difficult to get time off
2.14 (1), P = 0.143
I don’t trust mental health professionals
0.34 (1), P = 0.560
My visit would not remain confidential
0.13 (1), P = 0.722
Leaders discourage the use of mental health services
4.76 (1), P = 0.029
Perceived social stigma
It would be too embarrassing
5.16 (1), P = 0.023
It would affect my career
0.03 (1), P = 0.864
Others would have less confidence in me
1.46 (1), P = 0.227
My leaders would treat me differently
0.75 (1), P = 0.387
My leaders would blame me
0.26 (1), P = 0.608
I would be seen as weak
9.09 (1), P = 0.003
We showed that there was a statistically significant effect on the reporting of sub-threshold and probable PTSD (but not common mental disorders) and three (out of eleven) stigmatizing beliefs when using an anonymous compared to identifiable questionnaire. These findings could be interpreted in two ways. The first explanation is that there is an underreporting of symptoms and stigmatizing beliefs among those who completed the identifiable questionnaire because they are concerned about the consequences of disclosure and further stigma. The second explanation is that those completing the anonymous survey over report their own symptoms and stigmatizing beliefs. Since there is no obvious benefit of over reporting symptoms or beliefs in an anonymous questionnaire, we consider that the first explanation is the most plausible. However, this can only be confirmed in a linked qualitative study or clinical follow-up assessment. We note that other studies have found similar differences in the reporting of PTSD symptoms among military personnel [2, 10–12].
Why we find an association with probable PTSD and not common mental disorders is puzzling. Perhaps military personnel perceive a traumatic stress disorder as being more indicative of weakness than succumbing to the varied and numerous non-traumatic stressors which occur during deployment.
There has been minimal research on the “honesty” of reporting among military personnel. However, general population surveys have shown that anonymous surveys resulted in increased reporting of eating disorder symptoms , while there were no differences in reporting of postpartum mood symptoms .
Of particular interest is the implications of our results, and how these will differ according to context. The prevalence of probable PTSD in the UK Armed Forces have remained low, at around 4%, since the start of operations in Iraq and Afghanistan [15, 16]. This means that the absolute differences between the anonymous and identifiable versions of the questionnaire are not substantial, even though the odds ratio is large. However, one should be cautious of generalizing this finding (based on a military population with a low prevalence of probable PTSD) to a population with a higher prevalence of probable PTSD (for example, the US military among whom PTSD prevalence (post-deployment) is approximately 13%-19% [3, 17]). Exactly the same odds ratio would then have a substantial impact on the success of any screening programmed.
We are aware that alternate allocation is a less than ideal form of allocation concealment. Alternate allocation is not a random process and could be open to bias by the assigning clinician . However, the survey took place in an active war zone, which imposes its own practical constraints. The survey team, who were present throughout the time in which personnel were completing the questionnaire, did not observe any exchange of forms or anything to indicate that the alternate allocation was being violated. Given that the only difference between the two questionnaires was whether or not there was a space for name, address and Service number, it seems unlikely that any deviation from this process would have happened. Further, the two groups were similar, in general, on all socio-demographics, military characteristics and combat experiences. A truly randomized study in an operational environment would not have been possible, thus we believe the current design, although not ideal, was the best available in the conditions and was unlikely to have led to bias.
Given the potential difference in the prevalence of probable PTSD, it is fair to ask why use identifiable (but confidential) surveys at all? One reason is because identifiable (but confidential) surveys have the considerable advantage of permitting truly longitudinal data collection. Also, in the chaotic environment of a war zone where potential participants and the survey team moved frequently, identifiable surveys help prevent duplication. There is, therefore, a tradeoff between full anonymisation, used by Hoge et al , but not in our otherwise similar study . Hotopf et al  were able to prospectively follow up the same people , whilst the anonymised study was only able to look at time trends . However, in a UK-based study the differences between anonymised and identifiable data collection are acceptable, but the same results in a setting with a higher prevalence of PTSD would suggest considerable underreporting of symptoms and thus limit the utility of this approach.
We have done several analyses, hence increasing the possibility of associations arising by chance. We have not made adjustments for multiple comparisons in line with the recommendations of Rothman .
We found a significant effect on the reporting of sub-threshold and probable PTSD and certain stigmatizing beliefs (but not common mental disorders) when using an anonymous compared to identifiable questionnaire, with the anonymous questionnaire resulting in a higher prevalence of probable PTSD and certain stigmatizing beliefs. This result was most likely due to an underreporting of symptoms and stigma among those who completed the identifiable questionnaire. These results suggest that researchers need to weigh up the balance between full anonymisation against the use of non-anonymised but confidential survey methods, which permit future follow up. Clinicians need to consider the background prevalence of the disorder being screened – in this study the differences between anonymised and identifiable data collection were probably acceptable, but the same results in a setting with a higher prevalence of PTSD would suggest considerable underreporting of symptoms.
General Health Questionnaire
Ministry of Defence
Operational Mental Health Needs Assessment
Post traumatic stress disorder Checklist Civilian Version
Post-Deployment Health Assessment
Post-Deployment Health Re-Assessment
Post traumatic stress disorder
United States. Neil Greenberg and Simon Wessely are joint last authors
This work was funded by the UK Ministry of Defence (MoD). However, they had no role in the design, analysis, interpretation or decision to submit this paper. We disclosed the paper to the MoD at the point it was submitted for publication and any errors of fact identified by the MoD were corrected at the same time as addressing the reviewers’ comments. The corresponding author had full access to the study data and had final responsibility for the decision to submit the paper for publication.
- Milliken CS, Auchterlonie JL, Hoge CW: Longitudinal assessment of mental health problems among active and reserve component soldiers returning from the Iraq war. JAMA. 2007, 298: 2141-2148. 10.1001/jama.298.18.2141.View ArticlePubMed
- Warner CH, Appenzeller GN, Grieger T, Belenkiy S, Breitbach J, Parker J, Warner CM, Hoge C: Importance of Anonymity to Encourage Honest Reporting in Mental Health Screening After Combat Deployment. Arch Gen Psychiatry. 2011, 68: 1065-1071. 10.1001/archgenpsychiatry.2011.112.View ArticlePubMed
- Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL: Combat duty in Iraq and Afghanistan, mental health problems and barriers to care. NEJM. 2004, 351: 13-22. 10.1056/NEJMoa040603.View ArticlePubMed
- Langston V, Greenberg N, Fear N, Iversen A, French C, Wessely S: Stigma and mental health in the Royal Navy: A mixed methods paper. J Mental Health. 2010, 19: 8-16. 10.3109/09638230802522999.View Article
- Iversen AC, van Staden L, Hacker Hughes J, Greenberg N, Hotopf M, Rona RJ, Thornicroft G, Wessely S, Fear NT: The stigma of mental health problems and other barriers to care in the UK Armed Forces. BMC Heal Serv Res. 2011, 11: 31-10.1186/1472-6963-11-31.View Article
- Cepeda-Benito A, Short P: Self-concealment, avoidance of psychological services, and perceived likelihood of seeking professional help. J Couns Psychol. 1998, 45: 1-7.View Article
- Mulligan K, Jones N, Woodhead C, Davies M, Wessely S, Greenberg N: Mental health of UK Military Personnel while on deployment in Iraq: The Operational Mental Health Needs Evaluation (OMHNE). Br J Psych. 2010, 197: 405-410. 10.1192/bjp.bp.110.077263.View Article
- Goldberg DP, Gater R, Sartorius N, Ustun TB, Piccinelli M, Gureje O, Rutter C: The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychol Med. 1997, 27: 191-197. 10.1017/S0033291796004242.View ArticlePubMed
- Weathers F, Litz B, Herman D, Huska J, Keane T: The PTSD checklist civilian version (PCL-C). 1994, National Centre for PTSD, Boston, MA
- McLay R, Deal W, Murphy J, Center K, Kolkow T, Grieger T: On-the-Record Screenings Versus Anonymous Surveys in Reporting PTSD. Am J Psych. 2008, 165: 775-10.1176/appi.ajp.2008.07121960.View Article
- Thomas J, Bliese P, Adler A, Wright K: Reporting Psychological Symptoms: Anonymity Matters (a little). 2004, US Army Medical Research Unit, Europe
- Kline A, Falca-Dodson M, Sussner B, Ciccone DS, Chandler H, Callahan L, Losonczy M: Effects of repeated deployment to Iraq and Afghanistan on the health of New Jersey Army National Guard Troops: Implications for military readiness. Am J Public Health. 2010, 100: 276-283. 10.2105/AJPH.2009.162925.PubMed CentralView ArticlePubMed
- Lavender JM, Anderson DA: Effect of perceived anonymity in assessments of eating disordered behaviors and attitudes. Int J Eat Disord. 2009, 42: 546-551. 10.1002/eat.20645.View ArticlePubMed
- Matthey S, White T, Rice S: Women’s responses to postnatal self-report mood and experience measures: does anonymity make a difference?. Arch Womens Ment Health. 2010, 13: 477-484. 10.1007/s00737-010-0159-1.View ArticlePubMed
- Fear NT, Jones M, Murphy D, Hull L, Iversen AC, Coker B, Machell L, Sundin J, Woodhead C, Jones N, Greenberg N, Landau S, Dandeker C, Rona RJ, Hotopf M, Wessely S: What are the consequences of deployment to Iraq and Afghanistan on the mental health of UK armed forces? A cohort study. Lancet. 2010, 375: 1783-1797. 10.1016/S0140-6736(10)60672-1.View ArticlePubMed
- Hotopf M, Hull L, Fear NT, Browne T, Horn O, Iversen A, Jones M, Murphy D, Bland D, Earnshaw M, Greenberg N, Hughes JH, Tate AR, Dandeker C, Rona R, Wessely S: The health of UK military personnel who deployed to the 2003 Iraq war: a cohort study. Lancet. 2006, 367: 1731-1741. 10.1016/S0140-6736(06)68662-5.View ArticlePubMed
- Hoge CW, Terhakopian A, Castro CA, Messer SC, Engel CC: Association of posttraumatic stress disorder with somatic symptoms, health care visits, and absenteeism among Iraq war veterans. Am J Psychiatry. 2007, 164: 150-153. 10.1176/appi.ajp.164.1.150.View ArticlePubMed
- Everitt BS, Wessely S: Clinical Trials in Psychiatry. 2008, Wiley-Blackwell, West Sussex, England, 2 Revised Edition
- Rothman KJ: No adjustments are needed for multiple comparisons. Epidemiology. 1990, 1: 43-46. 10.1097/00001648-199001000-00010.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/12/797/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.