- Research article
- Open Access
Psychometric evaluation of the Problem Areas in Diabetes (PAID) survey in Southern, rural African American women with Type 2 diabetes
BMC Public Health volume 8, Article number: 70 (2008)
The Problem Areas in Diabetes (PAID) survey is a measure of diabetes-related stress for which reported use has been in largely Caucasian populations. Our purpose was to assess the psychometric properties of the PAID in Southern rural African American women with Type 2 diabetes.
A convenience sample of African American women (N = 131) ranging from 21–50 years of age and diagnosed with Type 2 diabetes were recruited for a survey study from two rural Southern community health centers. Participants completed the PAID, Center for Epidemiological Studies-Depression Scale (CES-D), and the Summary of Diabetes Self-Care Activities Scale (SDSCA). Factor analysis, Cronbach's coefficient alpha, and construct validation facilitated psychometric evaluation.
A principle component factor analysis of the PAID yielded two factors, 1) a lack of confidence subscale, and 2) a negative emotional consequences subscale. The Lack of Confidence and Negative Emotional Consequences subscales, but not the overall PAID scale, were associated with glycemic control and body mass index, respectively. Relationships with measures of depression and diabetes self-care supported construct validity of both subscales. Both subscales had acceptable (alpha = 0.85 and 0.94) internal consistency measures.
A psychometrically sound two-factor solution to the PAID survey is identified in Southern, rural African American women with Type 2 diabetes. Lack of confidence in and negative emotional consequences of diabetes self-care implementation provide a better understanding of determinants of glycemic control and weight than an aggregate of the two scales.
Type 2 diabetes is a leading cause of death for African American women . Epidemiological evidence indicates that glycemic control in this patient group is suboptimal and that they suffer disproportionately from diabetes-related complications .
Though tight glycemic control is viewed as a primary indicator of favorable diabetes outcomes , a myriad of factors, including attention to diet, monitoring of blood glucose, medication, and physical activity , contribute to a patient's success in achieving desirable glycemic control. Additionally, psychological distress can negatively impact a patient's adherence to these necessary self-care regimens [5, 6].
The Problem Areas in Diabetes (PAID) survey was developed as a measure of diabetes-related stress that could be useful in measuring the association between psychological adjustment to diabetes and adherence to self-care behaviors . This 20-item survey uses a Likert-scale format to assess the degree to which diabetes management and/or feelings about diabetes are problematic to patients. To date, research application of the PAID has been mostly in Caucasian, urban populations [8, 9] and, to a lesser extent, urban African Americans [1, 10]. Our goal was to assess the reliability and validity of the PAID in Southern, rural African American women with Type 2 diabetes.
This study was part of a larger survey investigation to characterize diabetes self-care activities in Southern, rural African American women with Type 2 diabetes. Participants were recruited from two rural community health centers in a southern state. Both centers serve predominately African American patients. Eligible participants were 1) African American females, 2) with a clinical diagnosis of Type 2 diabetes for a minimum of 6 months, and 3) between 21 and 50 years of age. Participants were identified from a diabetes database and sent invitation letters or referred by nurses during appointments. Follow-up phone calls were used when patients had not responded to letters after 2 weeks. Newspaper ads and flyers were also used for recruitment. The Meharry Medical College Institutional Review Board approved the survey and the administration procedures.
Demographic characteristics were obtained using a self-report survey. Body mass index (BMI) was calculated from self-reported height and weight entries. The most recent hemoglobin A1c (HbA1c) readings within the last year were collected via chart extractions after all surveys were complete.
Problem Areas in Diabetes (PAID) scores were calculated using a five-point Likert-scale with options ranging from "0-not a problem" to "4-serious problem". Summing all item scores and multiplying by 1.25 resulted in an overall PAID score. A minimum score of 0 indicated no diabetes-related distress. A maximum score of 100 indicated significant diabetes-related distress. Previously, high internal consistency of PAID was reported (Cronbach's alpha = 0.95) and factor analyses revealed a single global emotional distress factor . Evidence of construct validity has been reported based on correlations to related measures, including diabetes coping scales . Additionally, discriminant validity has been reported, including comparisons of PAID scores between Type 1 and 2 diabetes patients .
The Center for Epidemiological Studies Depression Scale (CES-D)  was used as a measure of depression. Scores were based on patients' responses to 20 statements assessing behavior and feelings within the last week. Response options ranged from "0-rarely/none of the time" to "3-most/all of the time". Summing all item scores resulted in a final score, with a score of 60 indicating significant depression.
The Summary of Diabetes Self-Care Activities Scale (SDSCA)  was used to measure various diabetes self-care activities. Using a continuous scale ranging from "0 to 7 days", each participant indicated the number of days in a week that she engaged in 1) eating a generally healthy diet (general diet-2 items), 2) eating a diet high in fruits/vegetables and low in high fat foods (specific diet-2 items), 3) physical activity for at least 30 minutes (1 item), 4) a specific exercise (1 item), 5) glucose self-monitoring (2 items), 6) foot inspections (2 items), and 7) taking recommended medications (1 item). For self-care categories with at least 2 items (all except the "physical activity", "specific exercise", and "medication", questions), item scores were averaged resulting in an overall score for each self-care activity (i.e. general diet, specific diet, glucose self-monitoring, and foot inspections). Scores ranged from 0 (no weekly participation in a diabetes self-care activity) to 7 (participation in a diabetes self-care activity every day of the week).
All surveys were self-administered (paper and pencil) to individual patients or patient groups (ranging from 2 to 25 people). Administration took place in a designated room at the collaborating community health centers under the direct supervision of either the principal investigator or research coordinator. Patients received a $20 gift certificate for participation. Survey completion times ranged from 20 minutes to 40 minutes.
To examine the internal structure of the PAID, we performed principal component factor analysis to examine the pattern of loadings for evidence of a 1-factor solution that supports the current use of the PAID as a single scale  or the possibility of an alternate factor solution. We utilized both a scree plot and a minimum eigenvalue of 1.5 to guide extracting factors in subsequent analysis. Orthogonal and oblique rotations were explored to best approximate simple structure when extracting more than one factor. Item-loadings of 0.40 or greater were the criterion used to guide interpretation of rotated factor loadings. Reliability was assessed using Cronbach's coefficient alpha. For internal consistency testing, we accepted an alpha of ≥0.75. To evaluate the construct validity of the PAID, we performed several correlation analyses using the Pearson product-moment correlation coefficient (r). For correlation with the CES-D, we hypothesized that higher scores on the PAID (either as a one or two factor solution) would be positively associated (r = ~0.5) with higher scores on the CES-D. We hypothesized low to moderate (r = 0.10–0.30) negative correlations with SDSCA subscales. We further tested validity of the PAID using correlations between the PAID and patient age, BMI, and HbA1c and expected low to moderate (r = 0.10–0.30) correlations.
All data were analyzed using STATA Version 7 (STATA Corporation, College Station, TX).
Of the 160 patients that completed the survey, only 131 were included in the analysis. A total of 7 surveys were excluded because participants did not meet the age criterion. Twenty-two patients did not complete all 20 PAID survey items. Demographically, these patients were not different from those that completed all items. Table 1 provides a demographic and clinical profile of the 131 Southern, rural African American women that completed all PAID items. The profile depicts a middle age, obese, and low-income patient group with suboptimal glycemic control, the majority of which were non-smokers.
Internal consistency of the PAID was high (Cronbach's alpha = 0.94). Our factor analysis resulted in 2 factors with eigenvalues above 1.5 and with sound internal consistency (Factor 1 alpha = 0.85; Factor 2 alpha = 0.94). Orthogonal rotations best approximated simple structure for these 2 new factors. Factor loadings are presented in Table 2. Seven loaded on the first factor and 13 on the second factor. Items loading on the first factor were interpreted as a "Lack of Confidence in Self-Care Implementation" (Lack of Confidence Subscale) and those on the second factor as "Negative Emotional Consequences of Self-Care Implementation" (Emotional Consequences Subscale). We consequently elected to simultaneously investigate the construct validity of this 2-factor solution along with the single factor PAID solution.
Correlations of the Lack of Confidence Subscale, Emotional Consequences Subscale, and the overall PAID to the CES-D (Cronbach's alpha = 0.85) and SDSCA subscales (Cronbach's alpha range = 0.75 to 0.87-for 2-item scales only) were used to assess construct validity based on a priori hypotheses (Table 3). The Cronbach's alpha estimate of the "specific diet" subscale was too low to establish internal consistency so we did not use this subscale in construct validity studies. This lack of internal consistency of this subscale has also been reported in studies of largely Caucasian populations . Correlations were high (r = 0.69–0.97) between the Lack of Confidence subscale, Emotional Consequences subscale, and the PAID. In keeping with our hypothesis that depression would be positively correlated with the PAID, positive correlations were observed between the Lack of Confidence Subscale, Emotional Consequences Subscale, and the PAID and the CESD (r = 0.55–0.58). All correlations between the Lack of Confidence and Emotional Consequences subscales and SDSCA subscales were negative. This confirmed our theoretical assumption that diabetes-related stress would be higher for patients that participated in self-care activities less frequently. For the Lack of Confidence Subscale, significant negative correlations were found with diet and foot inspection-related subscales only. For the Emotional Consequences Subscale, significant negative correlations were observed with diet and physical activity-related subscales. With the exception of the glucose monitoring subscale and the medication adherence question, significant negative correlations were found between the PAID single factor solution and other SDSCA subscales.
Correlations of the Lack of Confidence and Emotional Consequences subscales and the PAID with select demographic and clinical characteristics were used to examine predictive validity. Age was significantly negatively correlated with the each subscale and the PAID. Glycemic control, as measured by HbA1c, was significantly correlated (in a positive direction) with only the Lack of Confidence subscale. Body mass index was positively correlated with each of the subscales and the PAID. However, the association was only statistically significant with the Emotional Consequences subscale.
This is the first study to quantitatively evaluate the psychometric attributes of the highly utilized PAID survey in Southern, rural African American women with Type 2 diabetes. While the original 1-factor solution previously described performed well, a 2-factor solution revealed clearer correlations between psychological distress and glycemic control and BMI, two critical indicators for diabetes-related health outcomes.
Importantly, we were able to observe a significant positive correlation between the 1st subscale in our 2-factor solution, "Lack of Confidence in Self-Care Implementation" and Hba1c. The fact that Hba1c was not significantly correlated with the PAID, as a single scale, is inconsistent with other findings ([7, 9]) in largely Caucasian populations but consistent with findings in urban African Americans . While the impact of race on PAID responses is not clear, it is possible that the PAID as a single scale, masks some of the more specific factors that impact emotions and behaviors that ultimately influence HbA1c in African American women. However, additional work is required to explore this notion. Figure 1 provides a conceptual model and shows that Lack of Confidence in implementing the diabetes self-care plan could potentially influence self-care, which might ultimately impact glycemic control. The clinical relevance of this finding is apparent, especially for this high-risk population, and is of critical importance in delineating relevant emotional factors that may influence self-care behaviors and, ultimately, impact glycemic control. This relationship between Lack of Confidence and glycemic control is consistent with the findings of others that confidence is a key determinant of self-care behaviors among African American women with Type 2 diabetes  and persons with Type 2 diabetes, in general . Since there was not a significant correlation between the PAID and HbA1c, this finding also provides support for the additional utility of the PAID as 2-factor model.
Moreover, our 2-factor solution revealed a significant positive association between our 2nd subscale, "Negative Emotional Consequences of Self-care Implementation" and BMI. This association is clinically relevant given the emerging obesity epidemic among African American women  and the disproportionate diabetes burden among African American women . For example, items in the Emotional Consequences subscale represent the emotional consequences of implementing a diabetes self-care plan. Figure 2 illustrates this relationship. It shows that implementing a diabetes self-care plan could possibly result in negative emotions that might, in turn, impact self-care. Further, the degree to which specific components of the self-care plan are implemented can negatively influence BMI.
Therefore, our 2-factor solution allowed us to identify important correlates of HbA1c and BMI in Southern, rural African American women with Type 2 diabetes, ones that would not have emerged using the 1-factor PAID solution alone. Our work represents first steps in identifying relevant emotional factors for diabetes self-management and, ultimately, glycemic control among rural African American women with Type 2 diabetes. To the extent that our 2 subscales reliably and accurately correlate with Hba1C and BMI among this patient population, future work should focus on defining best methods for improving patient confidence in self-care activities that pose the most significant challenges and helping patients manage the emotional consequences of implementing self-care plans.
Our study has some limitations. Cognitive response interviews were not conducted. The addition of this method would have enhanced our ability to understand how patients perceived the meaning of individual PAID items. Our demographic questionnaire did not discriminate between patients receiving insulin via shots or pump. Therefore, our study results do not take into account differences attributable to distinct methods of insulin delivery and, possibly, adjustment issues. Another possible limitation was the potential for patients to respond to PAID questions in a manner that they felt was socially desirable (i.e. reporting that "feeling scared when you think about living with diabetes" was not a problem when indeed it was a significant one). Though impractical relative to minimizing patient fatigue during questionnaire administration, the additional administration of a social desirability questionnaire along with the PAID and other questionnaires would have been helpful in determining whether this was indeed true for this study . Also, our most significant study results were found in a sample of obese patients with poorly controlled diabetes. Since our study only included rural, female patients, it is not clear the extent to which gender and locale alone correlated with these specific clinical characteristics. A more heterogeneous study sample would have been helpful in this regard. From a psychometric perspective, it was apparent from our factor analysis results that 3 of the PAID items loaded well (≥ 0.40) on both the Lack of Confidence and Emotional Consequences subscales. Since it was not our goal to modify the PAID items and, hence, possibly enhance factor loading clarity, we assigned these 3 items to the Emotional Consequences subscale based on three critical factors: 1) slightly superior loadings (with the exception of item 9 where loadings were equal); 2) face validity, and 3) better theoretical cohesiveness relative to our construct validity conceptualization. Finally, while it is appropriate and common practice to report correlations between 1- and 2-item SDSCA subscales and other scales, subscales with more items might lend to more robust and discriminating results.
The greatest strengths of our study were findings that lack of confidence in diabetes self-care implementation and the negative emotional consequences of self-care implementation were associated with Hba1c and BMI, respectively. Though the correlations that support these findings were modest, the clinical importance of identifying emotions that might impact glycemic control and body weight among Southern, rural African American women with Type 2 diabetes adds tremendous value to these novel findings. Other major strengths of this study were related to our recruitment efforts. We were able to recruit African American patients, a group that is typically perceived to be "hard to reach" relative to study recruitment (). Additionally, we were able to recruit patients from rural locales, a success that is invaluable for involving geographically underserved populations in research ().
A psychometrically sound two-factor solution to the PAID survey is identified in Southern, rural African American women with Type 2 diabetes. Lack of confidence in and negative emotional consequences of diabetes self-care implementation provide a better understanding of determinants of glycemic control and weight than an aggregate of the two scales. Further work is needed to replicate these findings and, subsequently, design interventions that to improve the lives of Southern, rural African American women with Type 2 diabetes.
D'Eramo-Melkus G, Spollett G, Jefferson V, Chyun D, Tuohy B, Robinson T, Kaisen A: A culturally competent intervention of education and care for black women with type 2 diabetes. Appl Nurs Res. 2004, 17: 10-20. 10.1016/j.apnr.2003.10.009.
Harris MI, Eastman RC, Cowie CC, Flegal KM, Eberhardt MS: Racial and ethnic differences in glycemic control of adults with type 2 diabetes. Diabetes Care. 1999, 22: 403-408. 10.2337/diacare.22.3.403.
The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. The Diabetes Control and Complications Trial Research Group. N Engl J Med. 1993, 329: 977-986. 10.1056/NEJM199309303291401.
Resnicow K, DiIorio C, Soet JE, Borrelli B, Ernst D, Hecht J, Thevos A: Motivational Interviewing in Medical and Public Health Settings. Motivational Interviewing: Preparing People For Change. Edited by: Miller WR and Rollnick S. 2002, New York, Guilford Press, 265-2nd
Lloyd CE, Brown FJ: Depression and diabetes. Curr Womens Health Rep. 2002, 2: 188-193.
Ciechanowski PS, Katon WJ, Russo JE, Hirsch IB: The relationship of depressive symptoms to symptom reporting, self-care and glucose control in diabetes. Gen Hosp Psychiatry. 2003, 25: 246-252. 10.1016/S0163-8343(03)00055-0.
Polonsky WH, Anderson BJ, Lohrer PA, Welch G, Jacobson AM, Aponte JE, Schwartz CE: Assessment of diabetes-related distress. Diabetes Care. 1995, 18: 754-760. 10.2337/diacare.18.6.754.
Radloff LS: The CES-D scale: A self report depression scale for research in the general population. Applied Psychological Measurement. 1977, 1: 385-401. 10.1177/014662167700100306.
Snoek FJ, Pouwer F, Welch GW, Polonsky WH: Diabetes-related emotional distress in Dutch and U.S. diabetic patients: cross-cultural validity of the problem areas in diabetes scale. Diabetes Care. 2000, 23: 1305-1309. 10.2337/diacare.23.9.1305.
Spencer MS, Kieffer EC, Sinco BR, Palmisano G, Guzman JR, James SA, Graddy-Dansby G, Two Feathers J, Heisler M: Diabetes-specific emotional distress among African Americans and Hispanics with type 2 diabetes. J Health Care Poor Underserved. 2006, 17: 88-105.
Welch GW, Jacobson AM, Polonsky WH: The Problem Areas in Diabetes Scale. An evaluation of its clinical utility. Diabetes Care. 1997, 20: 760-766. 10.2337/diacare.20.5.760.
Toobert DJ, Hampson SE, Glasgow RE: The summary of diabetes self-care activities measure: results from 7 studies and a revised scale. Diabetes Care. 2000, 23: 943-950. 10.2337/diacare.23.7.943.
Skelly AH, Marshall JR, Haughey BP, Davis PJ, Dunford RG: Self-efficacy and confidence in outcomes as determinants of self-care practices in inner-city, African-American women with non-insulin-dependent diabetes. Diabetes Educ. 1995, 21: 38-46. 10.1177/014572179502100107.
Aljasem LI, Peyrot M, Wissow L, Rubin RR: The impact of barriers and self-efficacy on self-care behaviors in type 2 diabetes. Diabetes Educ. 2001, 27: 393-404.
Expert Panel on the Identification, Evaluation, and Treatment of Overweight in Adults. Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults: executive summary. Am J Clin Nutr. 1998, 68: 899-917.
DeVellis RF: Scale Development; Theory and Applications. 2003, Thousand Oaks, California, Sage Publications, 26: 170-
Gooden KM, Carter-Edwards L, Hoyo C, Akbar J, Cleveland RJ, Oates V, Jackson E, Furberg H, Gammon MD: Perceptions of participation in an observational epidemiologic study of cancer among African Americans. Ethn Dis. 2005, 15: 68-75.
Chadiha LA, Morrow-Howell N, Proctor EK, Picot SJ, Gillespie DC, Pandey P, Dey A: Involving rural, older African Americans and their female informal caregivers in research. J Aging Health. 2004, 16: 18S-38S. 10.1177/0898264304268147.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/8/70/prepub
This study was supported by grants from the National Institutes of Health, National Center for Research Resources (1 R25 RR017577-01), National Institutes of Health, National Center on Minority Health and Health Disparities (5 P20 MD000516-03), and National Institutes of Health, National Institute of Diabetes and Digestive, and Kidney Diseases (3 P60 DK020593-26S1). The sponsors had no role in study design; in the collection, analysis, or interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.
The authors wish thank the administrative and clinical staff at Delta Health Center (Mound Bayou, MS) and Greater Meridian Health Clinic (Meridian, MS) for their support during all phases of this project.
The author(s) declare that they have no competing interest.
STM was primarily responsible for the study design, implementation, data collection, data analysis, data interpretation, and drafting the manuscript. TAE provided detailed guidance on study design and implementation, aided substantially in data interpretation, and contributed to drafting and editing the manuscript.
About this article
Cite this article
Miller, S.T., Elasy, T.A. Psychometric evaluation of the Problem Areas in Diabetes (PAID) survey in Southern, rural African American women with Type 2 diabetes. BMC Public Health 8, 70 (2008). https://doi.org/10.1186/1471-2458-8-70
- Glycemic Control
- African American Woman
- Emotional Consequence
- Negative Emotional Consequence
- Confidence Subscale