Skip to main content
  • Research article
  • Open access
  • Published:

Challenges and opportunities in establishing a collaborative multisite observational study of chronic diseases and lifestyle factors among adults in Puerto Rico

Abstract

Background

Prevalence of chronic diseases and unhealthy lifestyle behaviors among the adult population of Puerto Rico (PR) is high; however, few epidemiological studies have been conducted to address these. We aimed to document the methods and operation of establishing a multisite cross-sectional study of chronic diseases and risk factors in PR, in partnership with academic, community, clinical, and research institutions.

Methods

The Puerto Rico Assessment of Diet, Lifestyle and Diseases (PRADLAD) documented lifestyle and health characteristics of adults living in PR, with the goal of informing future epidemiological and intervention projects, as well as public health, policy, and clinical efforts to help improve the population’s health. The study was conducted in three primary care clinics in the San Juan, PR metropolitan area. Eligible volunteers were 30–75y, living in PR for at least 10 months of the previous year, and able to answer interviewer-administered questionnaires without assistance. Questions were recorded electronically by trained interviewers, and included socio-demographic characteristics, lifestyle behaviors, self-reported medically-diagnosed diseases, and psychosocial factors. Waist and hip circumferences were measured following standardized protocols. A subset of participants answered a validated food frequency questionnaire, a legumes questionnaire, and had medical record data abstracted. Process and outcome evaluation indicators were assessed.

Results

The study screened 403 participants in 5 months. Of these, 396 (98%) were eligible and 380 (94%) had reliable and complete information. A subset of 242 participants had valid dietary data, and 236 had medical record data. The mean time to complete an interview was 1.5 h. Participants were generally cooperative and research collaborators were fully engaged. Having multiple sites helped enhance recruitment and sociodemographic representation. Diagnosed conditions were prevalent across sites. Challenges in data monitoring, interviewer training, and scheduling were identified and corrected, and should be addressed in future studies.

Conclusions

Epidemiological studies in PR can be successfully implemented in partnership with multiple institutions. Effective recruitment and implementation requires concerted planning and continued involvement from partners, frequent quality control, brief interviews, reasonable incentives, and thorough training/re-training of culturally-sensitive interviewers. Further studies are feasible and needed to help address highly prevalent chronic conditions in PR.

Peer Review reports

Background

Recent reports from Puerto Rico (PR), a United States (US) territory, highlight an adverse health profile among the island’s general population. The top leading causes of death in PR are all chronic diseases: heart diseases, cancer, diabetes, and Alzheimer’s disease, and overall death rates are surpassing birth rates [1]. Among the most prevalent conditions were arthritis (20%), depression (17%), and diabetes (14%) [2]. Even though it has been estimated that more than 90% of type 2 diabetes, 80% of heart disease, 70% of stroke, and 70% of colon cancer may be prevented by not smoking, maintaining a healthy weight, engaging in moderate physical activity, and consuming a healthy diet with moderate alcohol intake [3], risky lifestyle behaviors are widespread in PR. In 2011, 2 out of 3 individuals were classified with overweight or obesity, and 15% of the population smoked [2], with increasing trends in the past few years [1]. Sociodemographic disparities were reported for the same time period, with low median household income ($18,660) and high unemployment (16%), despite high percentages of college (or above) education (45%) [1]. With over 3.5 million inhabitants in the densely-populated island of PR, tending to the health of the population must be a priority.

Public health and clinical initiatives have the potential to reduce morbidity and mortality in chronic diseases and risk factors. The most successful prevention initiatives are based on scientific evidence [4, 5]. For chronic diseases and their risk factors, much of this evidence has come from epidemiological studies of observational and intervention design [5, 6]. Observational studies are particularly appropriate to provide useful information when trials and interventions are unethical or unfeasible, and to generate hypotheses and preliminary evidence to better design future studies [7]. For example, the Framingham Osteoporosis Study has helped identify multiple nutrients and foods that alter bone health [8], some of which are now being applied in dietary trials. Similarly, even though major risk factors for cardiovascular disease have been well-known for decades, the Hispanic Community Health Study/Study on Latinos (HCHS/SOL) recently documented large variations in dietary intake patterns [9, 10] and cardiometabolic risk among diverse US Hispanic/Latino background groups, highlighting a need to focus in preventive health behaviors by specific ethnic group [11, 12]. This last example underscores the importance of epidemiological studies in revealing new information that can better inform multi-level public health efforts tailored to the target population.

Despite the need to understand chronic disease contributors in PR, there is a dearth of concerted efforts in the island to study the determinants and dynamics that drive chronic diseases as a way to identify potential ways to prevent them. The most comprehensive epidemiological study conducted in the island was the Puerto Rico Heart Health Program in the 1970s, which was designed to investigate morbidity and mortality from coronary heart disease in Puerto Rican men [13]. Important results on dietary risk factors [1416], sociodemographic and lifestyle risk factors [1721], and biological markers [22, 23] were documented for cardiovascular disease, diabetes, and other chronic diseases. However, no large-scale comprehensive studies have been conducted on the island in the 45 years since then, despite the documented rapid increases in chronic diseases and unhealthy lifestyles. Subsequent studies have collected data on chronic conditions or risk factors, but have been limited by scope or target sub-population. For example, the Puerto Rican Elderly: Health Conditions longitudinal, island-wide study investigated social issues affecting the elderly (≥60y) from 2002 to 2007 [24]. The San Juan Obesity Longitudinal Study prospectively followed San Juan residents aged 40–65y with overweight or obesity in 2005 [25]. A cross-sectional study of Puerto Ricans aged 21–79y residing in the San Juan metropolitan area successfully collected information in 2005 on prevalence of chronic diseases and risk factors using questionnaires and physical and laboratory measures [26, 27]. Few of these studies documented the process and lessons learned while establishing the cohorts, making it difficult for other investigators to estimate the resources, time, and efforts needed to conduct similar studies.

Further rigorous efforts to collect valid data on multi-level contributors to chronic disease are needed to address the considerable health disparities in PR. Moreover, documenting the operational process and methodology can help prevent or correct problems and improve the success of future studies. Initiatives carried out through partnerships are of particular value to help share interdisciplinary research ideas, advocacy, education and training, expertise, capacity-building, resources, and funding [4, 28]. Thus, the aim of this report is to document the methodology, process and outcome evaluation, and lessons learned by conducting the Puerto Rico Assessment of Diet, Lifestyle, and Diseases (PRADLAD), a collaborative multisite cross-sectional study aiming to assess lifestyle factors and prevalence of chronic diseases among adults in PR. PRADLAD has the goal of informing future epidemiological and intervention projects, as well as public health, policy, and clinical efforts, to help improve the population’s health.

Methods

Study design and population

PRADLAD was designed as a cross-sectional survey of a convenience sample of adults living in PR. The study was advertised at the main entrances and waiting rooms of three partner clinics in the San Juan metropolitan area: Fundación de Investigación de PR (FDI; a research center and medical care facility), Centro Multidisciplinario de Medicina de la Asociación de Maestro de PR – CDT Asociación de Maestro de Hato Rey (a clinic within a city hospital, Hospital del Maestro), and Health Pro Med (a nonprofit federally-funded primary community health care center). Recruitment was conducted in the primary care sites of the clinics, and not in specialized care units. Study personnel distributed recruitment flyers to individuals in the waiting room of the primary care clinics. FDI was the study’s main partner on the island, and they had previous successful research and clinical collaborations with the two other clinics. These two partner clinics were selected because they were committed to the project and had the necessary resources (i.e.: private interview rooms, internet access, sharable medical records), and to increase representation of sociodemographic characteristics of participants. The study aimed to recruit 450 participants and expected a conservative 20% loss due to lack of eligibility and incomplete or poor data, based on a previous study of Puerto Ricans from Boston [29], for a final sample size of 360 participants.

Participants were patients waiting for a medical appointment, or persons accompanying a patient, or visitors at one of the clinics. Interested individuals talked with an identified study research assistant, who provided details about the study and a screening questionnaire to confirm eligibility. To be eligible, an individual had to be living on PR at the time of the study and for at least 10 months of the previous year, be aged 30–75y, and be able to answer questions without assistance (i.e.: no major speech or neurological impairment). The study was conducted between July and November, 2015. All participants provided written informed consent. The Institutional Review Board (IRB) at Harvard T.H. Chan School of Public Health, Ponce Health Sciences University in PR, University of Massachusetts, and Northeastern University, approved the study.

Data collection

Questionnaires were administered by trained, Spanish-speaking research assistants in a private room at the clinics while the participant waited for their medical appointment (if a patient at the clinic). If the interview was not completed at that time, the participant had the option to complete the interview after the appointment or by telephone (for which contact information was obtained), or to terminate the interview (which they were notified they could do at any time). Any participant who did not complete the interview during the initial contact was re-contacted up to 3 times by phone within the subsequent 14 days to finish the interview.

Study data were collected and managed using the electronic data capture tool ‘Research Electronic Data Capture’ (REDCap) hosted at Harvard T.H. Chan School of Public Health. REDCap is a secure, web-based application designed to support data capture for research studies, providing 1) an intuitive interface for validated data entry; 2) audit trails for tracking data manipulation and export procedures; 3) automated export procedures for seamless download of data to statistical packages; and 4) procedures for importing data from external sources [30]. In addition, interviewers had hardcopies of the questionnaires as backup.

The interview consisted of 3 questionnaires: 1) a main questionnaire that asked questions on demographic and socioeconomic characteristics, medical history, lifestyle behaviors, and psychosocial measures, 2) a food frequency questionnaire (FFQ) that included questions on the frequency and quantity of intake of a list of foods and beverages, and 3) an optional, supplemental legumes questionnaire that asked about perceptions towards bean intake. Eligible participants were asked for their consent to obtain a copy of their medical records, from which we extracted information on anthropometry, blood pressure, medical diagnoses, medication use, and recent laboratory results. They were also asked to consent to being contacted for future research opportunities or additional questions, and to having their waist and hip circumference measured. Participants received a one-time $20 gift card incentive for completing the main questionnaire and FFQ. Participants who opted to answer the legumes questionnaire received an additional $5. Additionally, we provide each participant with a bag of healthy snacks and water. The questionnaire was written in Spanish using Puerto Rican vernacular, and was pre-piloted for clarity among Puerto Rican adults before implementation. Participants were informed that completing all sections would take approximately 1.5 h.

All interviewers were thoroughly trained by experienced staff to administer the consent form and questionnaires, and to perform anthropometric measurements. Each interviewer was required to practice interviews before collecting data. Open-ended questions at the end of each section allowed the interviewer to provide more information about the participant and feedback on the interview process.

General background characteristics

Participants provided information on demographic and socioeconomic characteristics including household composition, educational attainment, marital status, work history, household income, food security and food assistance, and use of communications technology. Questionnaires used to collect these data were based on the Boston Puerto Rican Health Study (BPRHS) [29] and the National Health and Nutrition Examination Survey (NHANES) [31], with some modifications by the research team for clarity within this population.

Health and health behaviors

Participants were asked whether they had ever received a diagnosis by a doctor or health professional of a specific list of chronic conditions [29]. If a participant responded affirmatively to having a disease, we obtained detailed information on medications, time of diagnosis, and current status of the disease. Additionally, we asked participants with a diagnosis of major cardiometabolic conditions to report if they had received and/or followed medical advice on diet, physical activity, or medication treatments for each condition [32]. We asked female participants for information on pregnancy and menopausal status, and all participants for family history of major chronic diseases, use of health services, health insurance, and self-rated health status, as adapted from questions from BPRHS and NHANES [29, 31].

We assessed history, frequency, quantity, and type of smoking and alcohol use [29]. Physical activity was captured using a modified Paffenbarger questionnaire of the Harvard Alumni Activity Survey [33], which was effectively tested in a middle-aged Puerto Rican population [29]. A physical activity score was calculated as the sum of hours spent on typical 24-h activities (heavy, moderate, light, or sedentary activity, and sleeping) multiplied by weighing factors that parallel the rate of oxygen consumption associated with each activity [29]. Physical activity levels were defined as sedentary (score < 30), light (30 to <40), or moderate or vigorous (≥40). Questions on hours of sleep over a 24-h period and difficulty falling asleep [34] were included; these were previously asked among Puerto Ricans [35].

Nutrient intake and dietary behaviors

A semi-quantitative FFQ was used to assess dietary intake. The FFQ has been adapted and validated for this population [36, 37]. Those with energy intakes < 600 or > 4800 kcal and/or 2 or more sections of the questionnaire left blank were excluded from dietary analyses. The FFQ were administered in REDCap [30] and the file was linked with the Minnesota Nutrient Data System (version 5.0_35) for food and nutrient analyses.

A comprehensive questionnaire was developed to assess dietary behaviors and attitudes. Questions were adapted from the Food Attitudes and Behaviors Survey of the National Cancer Institute [38, 39], questions asked in HCHS/SOL [40], and a validated dietary behaviors questionnaire for Latinos [41], with additional questions developed by the research team for further validation in this study. The Dietary Behaviors domain included questions on food shopping and cooking roles; time, frequency, and place of meals; frequency and choices when eating away from home; cooking and eating practices; self-rated dietary quality; dietary identity; drinking water choice and safety; and nutrition awareness and knowledge. The Dietary Attitudes domain included questions on reasons for general food choices; attitudes and beliefs towards healthy eating; and motivations, self-efficacy, and intentions for healthy eating.

Anthropometry

Self-reported weight, height, and systolic and diastolic blood pressure were queried. Participants who consented, were not pregnant at the time of the interview, and were able to have anthropometric measures, were measured for waist and hip circumferences by the trained interviewer using a Gulick measuring tape following standard protocols [31, 42]. Measures were taken with the participant relaxed, standing with feet close together, arms at the side and body weight evenly distributed, and at the end of a normal expiration. The participant was asked to remove any additional layers of clothing and lift the shirt slightly. Waist circumference was measured at the midpoint between the lower margin of the least palpable rib and the top of the iliac crest. Hip circumference was measured around the widest portion of the buttocks, with the tape parallel to the floor. If a waist line could not be detected, the participant was asked to indicate the location of his/her umbilicus at which point the measure was taken. Measurements were taken in centimeters to the nearest millimeter, as well as in inches to the nearest decimal, in duplicate. A third measurement was taken if there was more than 1 cm (0.4 in.) of difference between the first and second measurement. We used the average of the two or three measurements as the final value.

Waist circumference thresholds used to define abdominal obesity were >102 cm in men or >88 cm in women, according to US guidelines, with a second cutoff (>94 cm in men, >80 cm in women) recommended for populations of European and Sub-Sahara African heritages [42]. We calculated the waist-to-hip ratio by dividing the waist by the hip measurement; a waist-to-hip ratio of ≥0.90 in men or ≥0.85 in women was deemed as elevated [42]. Body mass index (BMI) was calculated by dividing self-reported weight in kilograms by height in meters squared. BMI was used to classify participants according to their weight status: underweight (15.0 to 18.4 kg/m2) [43, 44], normal weight (18.5 to 24.9 kg/m2), overweight (25.0 to 29.9 kg/m2), or obesity (≥30 kg/m2) [42].

Psychosocial scales

We used the Center for Epidemiology Studies Depression (CESD) Scale to assess depressive symptomatology, [45] based on how often a participant agreed with 20 statements about feelings within nine domains. The scale ranges from 0 to 60; a higher score corresponds to stronger depressive symptomology. The CESD has shown good reliability and validity in Hispanics, including Puerto Ricans [4648], although less so for Puerto Rican low-income men [49]. Depressive symptomatology was defined as CESD score ≥16 [4547]. The Perceived Stress Scale measures the degree to which people perceive their lives as stressful based on 14 statements [50]; the score ranges from 0 to 56 with higher scores indicative of higher stress. This scale has been satisfactorily evaluated in Spanish-speakers, including Puerto Ricans [5153]. We assessed overall perceived social support with the 12-item Interpersonal Support Evaluation List (ISEL-12), which has an overall range of 0–36; greater scores relate to higher social support. The scale includes three subscales: appraisal (advice or guidance), belonging (empathy, acceptance, concern), and tangible support (help or assistance, such as material or financial aid) [54]. The ISEL-12 has shown reliability and validity among Hispanics including Puerto Ricans [55]. Participants who reported a diagnosis of diabetes were asked 5 questions derived from the Diabetes Social Support Questionnaire-Family Version [56] to assess perceived family support for diabetes management. A higher score within a 0–25 range indicates higher diabetes support.

Legumes questionnaire

The supplemental legumes questionnaire was part of a second study on attitudes and preferences of beans, with the long-term goal of informing a bean-promotion intervention in the island. The questionnaire was developed from one previously implemented in PR, [57] with additional questions adapted from the Food Attitudes and Behaviors Survey.

Statistical analysis

Descriptive characteristics by clinic were assessed using SAS software version 9.4 (SAS Institute Inc; Cary, NC). Differences among clinics were tested using chi-square for categorical variables or analysis of variance for continuous variables. Statistically significant differences were considered at a two-tailed alpha <0.05.

Process and outcome evaluation

An initial pilot was conducted the first week of the study to gauge flow of enrollment and duration of interviews, and to identify and correct issues presented in the field. The main research team held weekly or biweekly meetings to debrief the progress of the study. A form to report adverse events was developed. Recruitment logs were maintained on-site at FDI and checked by two research assistants and a research coordinator. Data quality checks were done by two investigators every 1–3 weeks: for every 25 recruited participants until the first 100, and then every 50 participants. Training or retraining sessions were conducted whenever issues were identified or when a new staff member joined the study.

Indicators for process evaluation included recruitment logs, reports of adverse events, and number of trainings/re-trainings. In addition, written open-ended comments from interviewers and participants collected in the interviews were used to gauge feedback from participants, and team meeting notes were used to identify challenges and corrective actions. Indicators for outcome evaluation included number of participants recruited, number of eligible participants, duration of the interviews, duration of the study, completion and quality of the data collected and results of main sociodemographic and health characteristics of participants by clinic.

Results

Process evaluation indicators

Eleven interviews were completed in the pilot week. Immediate debriefing identified that the interviews were longer than anticipated, averaging 1 h and 45 min (median: 1:33) when conducted in person, and that some anthropometric measurements were done incorrectly, despite interviewers having had two trainings and practice sessions. Team meetings also identified issues with unreliable Internet connection that interrupted the interviews. Some interviewers reported that the psychosocial questions elicited emotional reaction from a few participants. In response, we removed selected sections of the questionnaire, and retrained interviewers to measure waist and hip circumference, to properly ask the psychosocial questions, and to sympathetically handle any emotional reaction or to skip the questions or stop the interview if a participant became visibly upset.

Recruitment through subsequent weeks was steadily high, as we had 11 interviewers working full time. There was a decline in participants’ recruitment from weeks 4 to 9, corresponding to the beginning of the academic year for many of our interviewers who cut back to part-time. To boost our recruitment goals, we identified and trained 11 new interviewers who started working on week 10 and sustained an average of 23 participants per week for the remainder of the study.

Four trainings/re-trainings were needed during the course of the study. Team meetings and data quality checks identified mistakes in data entry: failing to take the anthropometric measures twice or to enter the decimal point, failing to mark any non-applicable or blank answers, not verifying that the hours for the physical activity questions added to a 24 h period, and entering the phone numbers or the time of interview in the wrong format. The data quality check team corrected most of these mistakes.

Feedback from the open-ended entries suggested that emotional reactions still occurred during the psychosocial questions (i.e.: teary-eyed, or sharing their situation and feelings with the interviewer), especially among those with diagnosed depression. However, no interviews had to be stopped because of a participant becoming upset, and we did not have any reports of adverse events. Participants commented that they found some of the questions repetitive and the interviews long, despite them averaging 1:33 h (median: 1:24) after deleting sections in the first week. Still, comments reflected a positive attitude from participants, who were generally cooperative and answered enthusiastically. Interviewers mentioned that the incentives were appealing and the snacks provided were well received, especially as they waited for their appointment.

Through the course of the study, the partner clinics remained engaged and cooperative to the study needs by providing access to private rooms, internet connection, and making the medical records from patients who consented accessible to the research team. Still, internet disruptions continued throughout the course of the study, and some interviews had to be completed using hardcopies of the questionnaire, which were later entered and verified manually. This manual process took longer than the direct electronic data capturing. Data quality checks did not detect any differences in data entered manually versus collected electronically. At the end of the study, we provided certificates of appreciation to the partner clinics and interviewers.

Outcome indicators: recruitment and participation

From July to November 2015, 403 participants approached our research assistants for participation in the study (Fig. 1). Of these, 396 met the inclusion criteria (7 were excluded due to ages younger than 30 or older than 75), and were invited to participate. Of these, 16 participants were excluded because the interviewer determined that the participant did not understand the questions or gave unreliable responses (n = 7) or for leaving more than half of the main questionnaire incomplete (n = 9). Thus, 380 participants (94% of those who approached the study) were included in the analysis for the main questionnaire.

Fig. 1
figure 1

Recruitment and participation flowchart of the Puerto Rico Assessment for Diet, Lifestyle, and Diseases study

The FFQ was started by 330 participants, or nearly 90% of the sample. However, the sample size with complete FFQ data was reduced to 252 after conducting standard exclusions for incomplete sections and outlying energy intake suggestive of misreporting. There were 316 participants with available anthropometric measures. Missing measures were due to not giving consent (n = 20), not being able to take the measure (n = 20; for example because the person had a physical limitation), or unreliable data (n = 24). Unreliable data for waist and hip measurements were more common among the first few interviews conducted by an interviewer.

While only 12 participants did not consent to having their medical record data abstracted, an additional 35 had signed documents at their respective clinic restricting any data sharing to third parties. Participants without medical records (n = 97) were visitors to the clinics or new patients. Thus, 236 had available medical record data. Finally, 292 completed at least half of the legumes questionnaire.

Most of the interviews were completed during the initial contact; 21 interviews were completed by phone, 16 in-person but at a later time (i.e., after the medical appointment or another day), and 16 could not be located after 3 attempts. Reasons included wrong phone numbers or disconnected lines. We restricted our final sample size to those with at least half of the main questionnaire complete. Incomplete questionnaires were mostly missing the psychosocial scales (n = 39), which was the last section. While 94% of participants initially consented to being re-contacted for future studies or additional question, 34 individuals requested later that they not be re-contacted; thus approximately 86% were willing to be re-contacted.

Participants’ characteristics by site

More than half of participants were recruited from the community clinic (Health Pro Med), followed by the research clinic (FDI), and the city hospital clinic (Centro Multidisciplinario de Medicina del Hospital del Maestro) (Table 1). While the percent of participants with anthropometric and medical record data did not differ by clinic, there were significantly fewer participants with valid FFQ or with complete legumes questionnaire in the research clinic than the other two sites.

Table 1 Characteristics of participants of the Puerto Rico Assessment for Diet, Lifestyle, and Diseases, by site

Participants recruited at the community clinic were younger, had lower educational attainment and household income, and were more likely to reside in urban areas, have public or no health insurance, and receive government food assistance. Participants of Dominican ethnicity were recruited only at the community clinic. Individuals recruited at the city hospital clinic were older, more likely to be female, and had higher educational attainment, household income, current employment, and private health insurance. Finally, those from the research center were more likely to be male, reside in rural areas, be unemployed, and live alone.

Lifestyle and psychosocial characteristics varied by clinic, with participants with abdominal obesity more likely to be recruited from the city hospital, while participants with high waist-to-hip ratio were more often recruited at the city hospital and the research center. There were no significant differences in percent of participants with overweight/obesity status (based on self-reported measures), sedentary physical activity level, or self-reported poor/fair diet, by clinic; however these were relatively high for all sites. Participants from the research center were more likely to currently smoke but less likely to currently drink alcohol, and reported more hours of sleep. Participants from the community clinic had higher perceived stress and depressive symptomatology scores, and lower social support score. There were no statistically significant differences by clinic in prevalence of self-reported medical diagnoses except for obesity and hypercholesterolemia, which were higher among participants from the city hospital. Medical conditions were highly prevalent, with eight conditions reported by at least 20% of participants.

Discussion

We document the challenges and opportunities that exist for conducting an observational study of chronic disease and lifestyle factors in PR, and we provide recommendations for similar efforts in the future (Table 2). First, the collaborative team must reasonably account for the time and effort needed to successfully implement a study of this nature. Preparing for PRADLAD took around one year; obtaining multiple IRB approvals took 4 months. The new policy from the National Institutes of Health on the use of a Single Institutional Review Board for multisite research may help ease this burden in subsequent projects [58]. The use of existing standardized protocols and questionnaires already validated and translated into Spanish saved time and effort. Only a few instruments had to be developed or adapted, and the goal is to validate them within PRADLAD for future use. It is important to ensure that the instruments utilized in a study are adapted and valid to the research setting, language, time, and context [59].

Table 2 Summary of challenges, opportunities, and recommendations for conducting collaborative epidemiological studies in Puerto Rico

While we screened fewer than the targeted 450 participants, the thorough training of interviewers and repeated data quality checks allowed us to minimize loss of observations and thus to keep nearly 94% of participants as our final sample size, more than the anticipated 360 participants after a 20% loss. The fairly fast fulfillment of recruitment goals suggests that our locations, scope of the study, and incentives were sufficiently convenient and attractive to volunteers. Strategies that have been shown to help increase participation and retention among minority groups include promptly providing incentives, having a familiar, accessible, and comfortable location, and developing tools to clearly explain the study’s purpose, importance, and procedures [60, 61].

Except for a few participants who answered the questionnaires hastily and requested not to be contacted again, participants had a positive attitude and they trusted in and cooperated with the study, which likely helped increase completion rates. Trust and cooperation were evidenced by the high percent of participants who consented to having their medical record accessed, as well as to being contacted for future studies or additional questions. The BPRHS reported a retention rate of 84% at 2-years follow-up [62], and a study of older adults (≥60y) in PR had 90% retention for the second wave [24], suggesting participants’ commitment to the studies. Other studies have suggested that Latinos have a strong willingness and trust to participate in biomedical studies, and are motivated by the perceived importance of the study topic and a desire to acquire and contribute to new knowledge [61, 6365]. While material incentives are not always a strong motivation for participation in health programs among Puerto Ricans [66], they should be fair and commensurate to the time and effort of the study [60]. Additional incentives such as health literature or services, transportation, raffles, food, or pastime activities, may also be valuable [61, 66].

Fluctuation in recruitment during the course of a study is normal, but keeping weekly records of enrollment helped us identify an atypical drop and promptly rectify it by hiring more interviewers to keep an even recruitment flow. This, however, required new training sessions that, in addition to the re-trainings needed to reinforce protocols, became time- and labor-intensive and entailed extra cost and delay in recruitment. Nonetheless, interviewers were highly engaged with the study and with participants. PRADLAD trained 22 students in health-related fields about various epidemiological protocols, increasing their professional advancement and the prospect of being hired for similar projects. Recruiting experienced interviewers, and providing higher remuneration, may help increase productivity and retention of interviewers [67]. Moreover, our experience expands on that of community-based participatory research studies that suggest that minority students serving as research assistants are seen as trustworthy role models [68]. Interviewers of the same heritage or cultural values (i.e.: respect, personal approach, affability, same language) can further increase trust and participants’ satisfaction [61]. In fact, the emotional reactions from some participants when asked sensitive questions, may have been due to connecting with and trusting the interviewer. Showing respect for a patient is associated with the patient divulging feelings and personal information [69]. Training interviewers to sensitively handle personal questions is important for this population.

Process evaluation strategies helped us correct issues through the course of the study. This included having a pilot period to identify issues in the field, frequent debriefing team meetings, repeated data quality checks, and qualitative feedback from participants and interviewers. Requesting participants’ feedback was also done and recommended in the HCHS/SOL [61]. The questionnaire was shortened to decrease the length of the interview, but further efforts to keep interviews short and running swiftly, as well as including short breaks during the procedures, could be beneficial [61]. While participants were informed beforehand that the interviews would last 1.5 h, and we averaged 1:33 h after shortening it, participants still found the interviews long. Interviews were sometimes interrupted by loss of internet connection, which likely increased the perception of a long interview, as well as contributing to incomplete interviews. Fortunately, interviewers had hardcopies of the questionnaire and were able to continue, even if completing these took longer than the fast electronic data capture. Future studies should take advantage of real-time electronic data capture when feasible, as web-based technologies can facilitate, streamline, and lower the cost of data collection [70]. Having hardcopies may avoid losing or rescheduling participants. Finally, re-contacting participants was not always possible due to wrong phone numbers or disconnected lines. The BPRHS successfully located individuals because, in addition to the participant’s contact information, they recorded the information of two close contacts who could locate them, and they sent letters requesting them to call the study [29].

Thorough data quality checks helped us correct measurement and data entry errors, which also boosted quantity and quality of the observations. Although we had to delete some observations for low data quality, the number did not exceed those reported in other studies. For minority populations, who provide the same quality of information as other groups, population- appropriate data collection methods are particularly important to help maximize high-quality results [71]. Moreover, it has been posited that the quality of data reflects the field efforts expended [71], which were exhaustive in our study.

Cooperation, resources, and engagement from the partner clinics were substantial. Their staff helped advertise the study among patients and visitors, and provided access to the necessary resources. Still, retrieving medical record data took effort and time, and not all records had complete or accurate data, which was observed in another study in PR [72]. Use of electronic medical records facilitated the process. Working with multiple partners also helped us become better informed about the inherent characteristics of their source population and to contextualize results within the respective setting. This is important because survey research on minority populations benefits from a deep understanding of the sociocultural characteristics of the community or target group [71]. Two actions that reinforced the strong ties between the team were providing certificates of appreciation to the clinics and interviewers, and preparing a report to share with each clinic’s staff and patients. Further strategies to foster collaboration include having a written agreement of roles and responsibilities beforehand, and having designated liaisons at each site as well as a senior coordinator for the project.

Despite having standardized protocols, we observed differences in recruitment and main outcomes by clinic. Most participants were recruited at the community clinic; high participation is common in community settings [60]. Participants from the research center were less likely to complete the additional questionnaires, deserving further probing into possible reasons. We observed differential sociodemographic characteristics by site, likely due to the inherent source population of each clinic. For example, most of the women were recruited from the city hospital, which was originally designed to serve teachers (who are predominantly women), while the community clinic is located within a largely Dominican neighborhood. Having multiple sites with diverse backgrounds likely increased the representation of our participants and diminished biased results. A study of Puerto Ricans in Connecticut had a similar multisite recruitment approach in order to increases sociodemographic representation [73].

Importantly, chronic conditions and unhealthy risk factors were prevalent across all sites. This concurs with recent island-wide reports that show high prevalence of arthritis, depression, diabetes, overweight or obesity, and unhealthy lifestyle behaviors [1, 2]. Most of our sample had low income, high unemployment, and high educational attainment, as reported for the general PR population [1]. Our results also agree with reports from a recent cross-sectional study of similar design [27, 74]. This suggests that PRADLAD achieved wide representation, although the non-random sample design may limit generalizability of results.

Conclusions

PRADLAD, a collaborative multisite cross-sectional study, helped establish trust, feasibility, training, capacity-building, resources, and expertise for conducting observational studies in Puerto Rico. While the cross-sectional convenience-sample design limits temporality and generalizability, the study accumulated data across multiple themes that will help answer gaps in knowledge of the relationship between diet, lifestyle, and diseases in PR, as well as generate hypotheses and preliminary evidence to design future studies and programs [7]. Working in partnership proved valuable to the study’s success. This type of collaborative work is essential to progress in public health initiatives, even in the face of challenges [4].

The documented high prevalence of unhealthy lifestyle behaviors and multiple chronic conditions warrants further research and intervention in PR. There have been calls to conduct large-scale epidemiological studies on risk factors, clinical care, and public health initiatives to prevent heart disease and related chronic conditions in PR [72]. This report has documented some of the operational challenges and opportunities that could help answer this call. Past epidemiological studies on similar topics have yielded important results. PRADLAD rigorously collected valid data on multi-level contributors to chronic diseases that will extend upon these findings to help improve the population’s health.

Abbreviations

BPRHS:

Boston Puerto Rican Health Study

CESD:

Center for Epidemiological Studies – Depression

FDI:

Fundación de Investigación de Puerto Rico

FFQ:

Food frequency questionnaire

HCHS/SOL:

Hispanic Community Health Study/Study on Latinos

IRB:

Institutional Review Board

ISEL-12:

Interpersonal Support Evaluation List-12

NHANES:

National Health and Nutrition Examination Survey

PR:

Puerto Rico

PRADLAD:

Puerto Rico Assessment of Diet, Lifestyle, and Diseases

REDCap:

Research Electronic Data Capturing

US:

United States.

References

  1. Rodríguez Ayuso IR, Geerman K, Pesante F. Puerto Rico Community Health Assessment: Secondary Data Profile. Department of Health, Commonwealth of Puerto Rico. 2012. http://www.salud.gov.pr/Estadisticas-Registros-y-Publicaciones/Publicaciones/Evaluacion%20de%20la%20Salud%20de%20la%20Comunidad%20Puertorrique%C3%B1a%20Perfil%20de%20Datos%20Secundarios%20(Ingl%C3%A9s).pdf. Accessed 29 June 2016.

  2. Serrano-Rodriguez R, Amill-Rosario A. Puerto Rico Behavioral Risk Factor Surveillance Survey Annual Report 2011. Puerto Rico Behavioral Risk Factor Surveillance System Puerto Rico Department of Health, Centers for Disease Control and Prevention. 2014. http://www.estadisticas.pr/iepr/LinkClick.aspx?fileticket=wo1dnQRAaQA%3d&tabid=186. Accessed 29 June 2016.

  3. Willett WC, Koplan JP, Nugent R, Dusenbury C, Puska P, Gaziano TA. Prevention of Chronic Disease by Means of Diet and Lifestyle Changes. In: Jamison DT, Breman JG, Measham AR, editors. Disease Control Priorities in Developing Countries. 2nd ed. Washington DC: Oxford University Press; 2006. p. 833–50.

    Google Scholar 

  4. Frieden TR. Six components necessary for effective public health program implementation. Am J Public Health. 2014;104(1):17–22.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30:175–201.

    Article  PubMed  Google Scholar 

  6. Lacey Jr JV. The WHI ten year’s later: an epidemiologist’s view. J Steroid Biochem and Mol Biol. 2014;142:12–5.

    Article  CAS  Google Scholar 

  7. Castillo RC, Scharfstein DO, MacKenzie EJ. Observational studies in the era of randomized trials: finding the balance. J Bone Joint Surg Am. 2012;94(1):112–7.

    Article  PubMed  Google Scholar 

  8. Sahni S, Mangano KM, McLean RR, Hannan MT, Kiel DP. Dietary Approaches for Bone Health: Lessons from the Framingham Osteoporosis Study. Curr Osteoporos Rep. 2015;13(4):245–55.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Siega-Riz AM, Sotres-Alvarez D, Ayala GX, Ginsberg M, Himes JH, Liu K, Loria CM, Mossavar-Rahmani Y, Rock CL, Rodriguez B, et al. Food-group and nutrient-density intakes by Hispanic and Latino backgrounds in the Hispanic Community Health Study/Study of Latinos. Am J Clin Nutr. 2014;99(6):1487–98.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Mattei J, Sotres-Alvarez D, Daviglus ML, Gallo LC, Gellman M, Hu FB, Tucker KL, Willett WC, Siega-Riz AM, Van Horn L et al. Diet quality and its association with cardiometabolic risk factors vary by Hispanic/Latino ethnic background in the Hispanic Community Health Study/Study of Latinos. J Nutr. 2016. In press.

  11. Schneiderman N, Chirinos DA, Aviles-Santa ML, Heiss G. Challenges in preventing heart disease in hispanics: early lessons learned from the Hispanic Community Health Study/Study of Latinos (HCHS/SOL). Prog Cardiovasc Dis. 2014;57(3):253–61.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Daviglus ML, Pirzada A, Talavera GA. Cardiovascular disease risk factors in the Hispanic/Latino population: lessons from the Hispanic Community Health Study/Study of Latinos (HCHS/SOL). Prog Cardiovasc Dis. 2014;57(3):230–6.

    Article  PubMed  Google Scholar 

  13. Garcia-Palmieri MR, Feliberti M, Costas Jr R, Colon AA, Cruz-Vidal M, Cortes-Alicea M, Ayala AM, Sobrino R, Torres R. An epidemiological study on coronary heart disease in Puerto Rico: The Puerto Rico Heart Health Program. Bol Asoc Med P R. 1969;61(6):174–9.

    CAS  PubMed  Google Scholar 

  14. Fuhrman BJ, Smit E, Crespo CJ, Garcia-Palmieri MR. Coffee intake and risk of incident diabetes in Puerto Rican men: results from the Puerto Rico Heart Health Program. Public Health Nutr. 2009;12(6):842–8.

    Article  CAS  PubMed  Google Scholar 

  15. Smit E, Garcia-Palmieri MR, Figueroa NR, McGee DL, Messina M, Freudenheim JL, Crespo CJ. Protein and legume intake and prostate cancer mortality in Puerto Rican men. Nutr Cancer. 2007;58(2):146–52.

    Article  CAS  PubMed  Google Scholar 

  16. Garcia-Palmieri MR, Sorlie P, Tillotson J, Costas Jr R, Cordero E, Rodriguez M. Relationship of dietary intake to subsequent coronary heart disease incidence: The Puerto Rico Heart Health Program. Am J Clin Nutr. 1980;33(8):1818–27.

    CAS  PubMed  Google Scholar 

  17. Crespo CJ, Palmieri MR, Perdomo RP, McGee DL, Smit E, Sempos CT, Lee IM, Sorlie PD. The relationship of physical activity and body weight with all-cause mortality: results from the Puerto Rico Heart Health Program. Ann Epidemiol. 2002;12(8):543–52.

    Article  PubMed  Google Scholar 

  18. Sorlie PD, Garcia-Palmieri MR. Educational status and coronary heart disease in Puerto Rico: the Puerto Rico Heart Health Program. Int J Epidemiol. 1990;19(1):59–65.

    Article  CAS  PubMed  Google Scholar 

  19. Garcia-Palmieri MR, Costas Jr R, Cruz-Vidal M, Sorlie PD, Tillotson J, Havlik RJ. Milk consumption, calcium intake, and decreased hypertension in Puerto Rico. Puerto Rico Heart Health Program study. Hypertension. 1984;6(3):322–8.

    Article  CAS  PubMed  Google Scholar 

  20. Garcia-Palmieri MR, Sorlie PD, Havlik RJ, Costas Jr R, Cruz-Vidal M. Urban-rural differences in 12 year coronary heart disease mortality: the Puerto Rico Heart Health Program. J Clin Epidemiol. 1988;41(3):285–92.

    Article  CAS  PubMed  Google Scholar 

  21. Garcia-Palmieri MR, Costas Jr R, Cruz-Vidal M, Sorlie PD, Havlik RJ. Increased physical activity: a protective factor against heart attacks in Puerto Rico. Am J Cardiol. 1982;50(4):749–55.

    Article  CAS  PubMed  Google Scholar 

  22. Garcia-Palmieri MR, Crespo CJ, Mc Gee D, Sempos C, Smit E, Sorlie PD. Wide pulse pressure is an independent predictor of cardiovascular mortality in Puerto Rican men. Nutr Metab Cardiovasc Dis. 2005;15(1):71–8.

    Article  PubMed  Google Scholar 

  23. Cruz-Vidal M, Garcia-Palmieri MR, Costas Jr R, Sorlie PD, Havlik RJ. Abnormal blood glucose and coronary heart disease: the Puerto Rico Heart Health Program. Diabetes Care. 1983;6(6):556–61.

    Article  CAS  PubMed  Google Scholar 

  24. Palloni A, Davila AL, Sanchez-Ayendez M. Puerto Rican Elderly: Health Conditions (PREHCO) Project, 2002-2003, 2006-2007. In: Inter-University Consortium for Political and Social Research, distributor. Ann Arbor; 2013; ICPSR34596-v1. http://doi.org/10.3886/ICPSR34596.v1. Accessed 29 June 2016.

  25. Joshipura KJ, Andriankaja MO, Hu FB, Ritchie CS. Relative utility of 1-h Oral Glucose Tolerance Test as a measure of abnormal glucose homeostasis. Diabetes Res Clin Pract. 2011;93(2):268–75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Perez CM, Guzman M, Ortiz AP, Estrella M, Valle Y, Perez N, Haddock L, Suarez E. Prevalence of the metabolic syndrome in San Juan, Puerto Rico. Ethn Dis. 2008;18(4):434–41.

    PubMed  PubMed Central  Google Scholar 

  27. Perez CM, Sanchez H, Ortiz AP. Prevalence of overweight and obesity and their cardiometabolic comorbidities in Hispanic adults living in Puerto Rico. J Community Health. 2013;38(6):1140–6.

    Article  PubMed  Google Scholar 

  28. Mattei J, Malik V, Wedick NM, Hu FB, Spiegelman D, Willett WC, Campos H. Reducing the global burden of type 2 diabetes by improving the quality of staple foods: The Global Nutrition and Epidemiologic Transition Initiative. Global Health. 2015;11:23.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Tucker KL, Mattei J, Noel SE, Collado BM, Mendez J, Nelson J, Griffith J, Ordovas JM, Falcon LM. The Boston Puerto Rican Health Study, a longitudinal cohort study on health disparities in Puerto Rican adults: challenges and opportunities. BMC Public Health. 2010;10:107.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.

    Article  PubMed  Google Scholar 

  31. National Health and Nutrition Examination Survey (NHANES) 2015-2016. In: National Center for Health Statistics: Centers for Disease Control and Prevention; 2015-2016. http://wwwn.cdc.gov/Nchs/Nhanes/Search/nhanes15_16.aspx. Accessed 29 June 2016.

  32. National Health Interview Survey, 1985: Health Promotion and Disease Prevention (HPDP) Smoking History During Pregnancy Supplement. In: National Center for Health Statistics: United States Department of Health and Human Services; 1985; ICPSR 9764-v1. http://doi.org/10.3886/ICPSR09764.v1. Accessed June 29, 2016.

  33. Paffenbarger Jr RS, Wing AL, Hyde RT. Physical activity as an index of heart attack risk in college alumni. Am J Epidemiol. 1978;108(3):161–75.

    PubMed  Google Scholar 

  34. Li Y, Zhang X, Winkelman JW, Redline S, Hu FB, Stampfer M, Ma J, Gao X. Association between insomnia symptoms and mortality: a prospective study of U.S. men. Circulation. 2014;129(7):737–46.

    Article  PubMed  Google Scholar 

  35. Sotos-Prieto M, Bhupathiraju SN, Falcon LM, Gao X, Tucker KL, Mattei J. A Healthy Lifestyle Score Is Associated with Cardiometabolic and Neuroendocrine Risk Factors among Puerto Rican Adults. J Nutr. 2015;145(7):1531–40.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Tucker KL, Bianchi LA, Maras J, Bermudez OI. Adaptation of a food frequency questionnaire to assess diets of Puerto Rican and non-Hispanic adults. Am J Epidemiol. 1998;148(5):507–18.

    Article  CAS  PubMed  Google Scholar 

  37. Palacios C, Trak MA, Betancourt J, Joshipura K, Tucker KL. Validation and reproducibility of a semi-quantitative FFQ as a measure of dietary intake in adults from Puerto Rico. Public Health Nutr. 2015;18(14):2550–8.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Emanuel AS, McCully SN, Gallagher KM, Updegraff JA. Theory of Planned Behavior explains gender difference in fruit and vegetable consumption. Appetite. 2012;59(3):693–7.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Goodman AB, Blanck HM, Sherry B, Park S, Nebeling L, Yaroch AL. Behaviors and attitudes associated with low drinking water intake among US adults, Food Attitudes and Behaviors Survey, 2007. Prev Chronic Dis. 2013;10:E51.

    PubMed  PubMed Central  Google Scholar 

  40. Dietary Behavior. In: Hispanic Community Health Study/ Study of Latinos: National Heart, Lung, and Blood Institute (NHLBI), National Institutes of Health (NIH); 2016. https://www2.cscc.unc.edu/hchs/node/3990. Accessed 29 June 2016.

  41. Fernandez S, Olendzki B, Rosal MC. A dietary behaviors measure for use with low-income, Spanish-speaking Caribbean Latinos with type 2 diabetes: the Latino Dietary Behaviors Questionnaire. J Am Diet Assoc. 2011;111(4):589–99.

    Article  PubMed  PubMed Central  Google Scholar 

  42. World Health Organization. Waist Circumference and Waist-Hip Ratio: Report of a WHO Expert Consultation. Geneva; 2011. http://apps.who.int/iris/bitstream/10665/44583/1/9789241501491_eng.pdf. Accessed 29 June 2016.

  43. Whitlock G, Lewington S, Sherliker P, Clarke R, Emberson J, Halsey J, Qizilbash N, Collins R, Peto R. Body-mass index and cause-specific mortality in 900 000 adults: collaborative analyses of 57 prospective studies. Lancet. 2009;373(9669):1083–96.

    Article  PubMed  Google Scholar 

  44. Armour BS, Courtney-Long E, Campbell VA, Wethington HR. Estimating disability prevalence among adults by body mass index: 2003-2009 National Health Interview Survey. Prev Chronic Dis. 2012;9:E178. quiz E178.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1:385–401.

    Article  Google Scholar 

  46. Cho MJ, Mościcki EK, Narrow WE, Rae DS, Locke BZ, Regier DA. Concordance between two measures of depression in the Hispanic Health and Nutrition Examination Survey. Soc Psychiatry Psychiatr Epidemiol. 1993;28(4):156–63.

    Article  CAS  PubMed  Google Scholar 

  47. Falcon LM, Tucker KL. Prevalence and correlates of depressive symptoms among Hispanic elders in Massachusetts. J Gerontol B Psychol Sci Soc Sci. 2000;55(2):S108–16.

    Article  CAS  PubMed  Google Scholar 

  48. Gonzalez P, Nunez A, Merz E, Brintz C, Weitzman O, Navas EL, Camacho A, Buelna C, Penedo FJ, Wassertheil-Smoller S et al. Measurement Properties of the Center for Epidemiologic Studies Depression Scale (CES-D 10): Findings From HCHS/SOL. Psychological Assess. 2016. In press.

  49. Rivera-Medina CL, Caraballo JN, Rodriguez-Cordero ER, Bernal G, Davila-Marrero E. Factor structure of the CES-D and measurement invariance across gender for low-income Puerto Ricans in a probability sample. J Consult Clin Psychol. 2010;78(3):398–408.

    Article  PubMed  Google Scholar 

  50. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–96.

    Article  CAS  PubMed  Google Scholar 

  51. Ramirez MT, Hernandez RL. Factor structure of the Perceived Stress Scale (PSS) in a sample from Mexico. Span J Psychol. 2007;10(1):199–206.

    Article  PubMed  Google Scholar 

  52. Falcon LM, Todorova I, Tucker K. Social support, life events, and psychological distress among the Puerto Rican population in the Boston area of the United States. Aging Ment Health. 2009;13(6):863–73.

    Article  PubMed  Google Scholar 

  53. Perera MJ, Brintz CE, Birnbaum-Weitzman O, Penedo FJ, Gallo LC, Gonzalez P, Gouskova N, Isasi CR, Navas-Nacher EL, Perreira KM et al. Factor Structure of the Perceived Stress Scale-10 (PSS) Across English and Spanish Language Responders in the HCHS/SOL Sociocultural Ancillary Study. Psychol Assess. 2016. In press.

  54. Cohen S, Mermelstein R, Kamarck T, Hoberman HM. Measuring the functional components of social support. In: Social Support: Theory, Research and Applications. The Hague: Springer Netherlands: Martinus Nijhoff Publishers, Dordrecht; 1985. p. 73–94.

    Chapter  Google Scholar 

  55. Merz EL, Roesch SC, Malcarne VL, Penedo FJ, Llabre MM, Weitzman OB, Navas-Nacher EL, Perreira KM, Gonzalez F, Ponguta LA, et al. Validation of interpersonal support evaluation list-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study. Psychol Assess. 2014;26(2):384–94.

    Article  PubMed  Google Scholar 

  56. La Greca AM, Bearman KJ. The diabetes social support questionnaire-family version: evaluating adolescents’ diabetes-specific support from family members. J Pediatr Psychol. 2002;27(8):665–76.

    Article  PubMed  Google Scholar 

  57. Mattei J, Campos H. Perceptions and behaviors of legume consumption among Puerto Rican adults. Health Behav Policy Rev. 2014;1(1):38–49.

    Article  Google Scholar 

  58. Tabak L. NIH Policy on the Use of a Single Institutional Review Board for Multi-Site Research. In: Federal Register; National Institutes of Health. 2016;81:40325-31. https://www.gpo.gov/fdsys/pkg/FR-2016-06-21/pdf/2016-14513.pdf. Accessed 29 June 2016.

  59. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Yancey AK, Ortega AN, Kumanyika SK. Effective recruitment and retention of minority research participants. Annu Rev Public Health. 2006;27:1–28.

    Article  PubMed  Google Scholar 

  61. Talavera AC, Buelna C, Giacinto RE, Castaneda SF, Giachello A, Crespo-Figueroa M, Hernandez JB, Rodriguez R, Abreu Mde L, Sanchez CM, et al. Levels of Participants Satisfaction with Initial Contact and Examination Visit: The Hispanic Community Health Study/Study of Latinos (HCHS/SOL). Ethn Dis. 2016;26(3):435–42.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Jimenez MP, Osypuk TL, Arevalo S, Tucker KL, Falcon LM. Neighborhood socioeconomic context and change in allostatic load among older Puerto Ricans: The Boston Puerto Rican health study. Health Place. 2015;33:1–8.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Ceballos RM, Knerr S, Scott MA, Hohl SD, Malen RC, Vilchis H, Thompson B. Latino beliefs about biomedical research participation: a qualitative study on the U.S.-Mexico border. J Empir Res Hum Res Ethics. 2014;9(4):10–21.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Hohl SD, Gonzalez C, Carosso E, Ibarra G, Thompson B. “I did it for us and I would do it again”: perspectives of rural latinos on providing biospecimens for research. Am J Public Health. 2014;104(5):911–6.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Wendler D, Kington R, Madans J, Van Wye G, Christ-Schmidt H, Pratt LA, Brawley OW, Gross CP, Emanuel E. Are racial and ethnic minorities less willing to participate in health research? PLoS Med. 2006;3(2):e19.

    Article  PubMed  Google Scholar 

  66. Mattei J, Mendez J, Falcon LM, Tucker KL. Perceptions and Motivations to Prevent Heart Disease among Puerto Ricans. Am J Health Behav. 2016;40(3):322–31.

    Article  PubMed  Google Scholar 

  67. Mitchell S, Fahrney K, Strobl M, Stephenson W, Bibb B. Interviewer Characteristics Associated With Productivity, Cost Efficiency, and Retention. American Association for Public Opinion Research; RTI International. 2010. http://ww2.amstat.org/sections/srms/Proceedings/. Accessed 29 June 2016.

  68. Wallerstein NB, Duran B. Using community-based participatory research to address health disparities. Health Promot Pract. 2006;7(3):312–23.

    Article  PubMed  Google Scholar 

  69. Goto M, Takemura YC. Which medical interview skills are associated with patients’ verbal indications of undisclosed feelings of anxiety and depressive feelings? Asia Pac Fam Med. 2016;15:2.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Toledano MB, Smith RB, Brook JP, Douglass M, Elliott P. How to Establish and Follow up a Large Prospective Cohort Study in the 21st Century--Lessons from UK COSMOS. PLoS One. 2015;10(7):e0131521.

    Article  PubMed  PubMed Central  Google Scholar 

  71. McGraw SA, McKinlay JB, Crawford SA, Costa LA, Cohen DL. Health survey methods with minority populations: some lessons from recent experience. Ethn Dis. 1992;2(3):273–87.

    CAS  PubMed  Google Scholar 

  72. Monsanto HA, Renta-Munoz A, Dones W, Comulada A, Cidre C, Orengo JC. The Puerto Rico Cardiovascular Risk-Estimation Study (PRCaRES): an exploratory assessment of new patients in physicians’ offices. P R Health Sci J. 2014;33(2):58–64.

    PubMed  Google Scholar 

  73. Fitzgerald N, Himmelgreen D, Damio G, Segura-Perez S, Peng YK, Perez-Escamilla R. Acculturation, socioeconomic status, obesity and lifestyle factors among low-income Puerto Rican women in Connecticut, U.S., 1998–1999. Rev Panam Salud Publica = Pan Am J Public Health. 2006;19(5):306–13.

    Google Scholar 

  74. Perez CM, Soto-Salgado M, Suarez E, Guzman M, Ortiz AP. High Prevalence of Diabetes and Prediabetes and Their Coexistence with Cardiovascular Risk Factors in a Hispanic Community. J Immigr Minor Health. 2015;17(4):1002–9.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge the effort and dedication of Dr. Maribel Rodriguez-Torres, former medical director of Fundación de Investigación, who passed away suddenly during the course of the study. We extend our sincere appreciation to Lorena Macías Navarro for assisting with the preparation of the study documents and IRB approval, as well as with training the interviewers. The team acknowledges Irving Ortiz for coordinating the interviews and securing resources for the study. We also recognize the work of Sherman J. Bigornia, Sabrina E. Noel, and Peter J. Bakun for analyzing the food frequency questionnaires. Our special appreciation to Lics. Antonia Andino and Jorge A. Torres-Otero from our partner clinic Centro Multidisciplinario de Medicina de la Asociación de Maestro de PR – CDT Asociación de Maestro; Hospital del Maestro (Hato Rey) for their support. PRADLAD was successful thanks to the contribution from all our interviewers, the staff at the partner clinics, and the participants.

Funding

The study was funded by private anonymous donations to Harvard TH Chan School of Public Health, a Dry Bean Health Research Program Incentive Award from the Northarvest Bean Growers Association, and institutional funds from Fundación de Investigación. Dr. Mattei received funding from a Mentored Career Development Award to Promote Faculty Diversity in Biomedical Research (K01-HL120951) from the NIH-National Heart Lung and Blood Institute.

Availability of data and materials

PRADLAD data and materials are available upon request to the corresponding author.

Authors’ contributions

JM was principal investigator on the study and responsible for conceptualizing the study, obtaining ethical approval, supervising the conduct and management of the study, data quality control, data analysis and interpretation, and writing the manuscript. JFRO, KLT, and CFRB contributed to study conceptualization, management and implementation, data quality control, and interpretation of results. MT, FR, and AC were responsible for data entry, management and validation, data analysis, and interpretation of results. MT additionally helped write portions of the manuscript. HV, HC, and WCW contributed to the study design, implementation, and interpretation of results for this report. All authors have read, edited, and approved the final version of the manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The Institutional Review Board at Harvard T.H. Chan School of Public Health, Ponce Health Sciences University in PR, University of Massachusetts, and Northeastern University approved the study. All participants provided written informed consent.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Josiemer Mattei.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mattei, J., Rodríguez-Orengo, J.F., Tamez, M. et al. Challenges and opportunities in establishing a collaborative multisite observational study of chronic diseases and lifestyle factors among adults in Puerto Rico. BMC Public Health 17, 136 (2017). https://doi.org/10.1186/s12889-017-4035-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-017-4035-z

Keywords