Skip to main content
Download PDF

Telehealth utilization in U.S. Medicare beneficiaries aged 65 years and older during the COVID-19 pandemic

BMC Public Health volume 23, Article number: 368 (2023) Cite this article

Abstract

Background

The COVID-19 pandemic has become a serious public health concern for older adults and amplified the value of deploying telehealth solutions. The purpose of this study was to investigate telehealth offered by providers among U.S. Medicare beneficiaries aged 65 years and older during the COVID-19 pandemic.

Methods

This cross-sectional study analyzed Medicare beneficiaries aged 65 years and older using data from the Medicare Current Beneficiary Survey, Winter 2021 COVID-19 Supplement (\(n=9,185\)). We identified variables that were associated with telehealth offered by primary care physicians and beneficiaries’ access to the Internet through a multivariate classification analysis utilizing Random Forest machine learning techniques.

Findings

For study participants interviewed by telephone, 81.06% of primary care providers provided telehealth services, and 84.62% of the Medicare beneficiaries had access to the Internet. The survey response rates for each outcome were 74.86% and 99.55% respectively. The two outcomes were positively correlated (\(\chi ^2=268.58,\,p<.001\)). The Our machine learning model predicted the outcomes accurately utilizing 44 variables. Residing area and race/ethnicity were most informative for predicting telehealth coverage, and Medicare-Medicaid dual eligibility and income were most informative for predicting Internet access. Other strong correlates included age, ability to access basic needs and certain mental and physical health conditions. Interactions were found among statuses of residing area, age, Medicare Advantage and heart conditions that intensified the disparity of outcomes.

Conclusions

We found that telehealth offered by providers likely increased during the COVID-19 pandemic for older beneficiaries, providing important access to care for certain subgroups. Policymakers must continue to identify effective means of delivering telehealth services, modernize the framework of regulatory, accreditation and reimbursement, and address disparities in access to telehealth with a particular focus on underserved communities.

Peer Review reports

Background

The COVID-19 pandemic has been a catalyst in increasing the utilization of telehealth services. It has triggered the rapid shift from traditional in-person visits to a hybrid model of in-person and telebehavioral health visits [1, 2], especially if the physician’s office presents logistical barriers caused by the pandemic such as inconvenient clinic hours [3, 4]. The use of telehealth pre-COVID-19 was very limited in Medicare fee-for-service (FFS) and only available to beneficiaries enrolled in Medicare Advantage via national telehealth platforms. However, during the COVID-19 pandemic, Medicare FFS reimbursement for telehealth visits was the same as in-person visits. Providers also quickly set up telehealth in response to the public health emergency (PHE). These changes removed the rural-only geographic restrictions, expanded services eligible for telehealth and enabled widespread use of telehealth among Medicare FFS beneficiaries during the COVID-19 PHE [5]. Older adults, particularly those with weak immune systems, are most at risk for underlying conditions that may lead to more severe COVID-19 illness or complications [6, 7]. When older adults tend to delay or forego traditional in-person health care, telehealth services should be utilized because of their safety in providing healthcare services and mitigating the risks of infection [8, 9]. However, there are policy and payment restrictions identifying where beneficiaries could receive these services and which providers could be paid to deliver them [10, 11]. As means to support vulnerable older patients, exploring the use of telehealth is important to foster health system resilience and provide policy implications related to extending telehealth coverage under traditional Medicare.

In previous studies, pre-COVID disparities in the use of telehealth were reported to be associated with age, race/ethnicity, income, and geography [12,13,14]. With the emergence of COVID-19, efforts have been made to expand telehealth options to eliminate racial, residential and age disparities [15, 16]. There are studies reporting that the use of telehealth has been maximized during the initial stage of the COVID-19 pandemic [17,18,19]. For instance, the mean number of patients with virtual visits per month at Mayo Clinic increased from 3.5 (July 2019 to February 2020) to 172 (March to December 2020) [11, 20]. The budding literature on telehealth utilization during the pandemic emphasized that patients had an overall positive view of and were satisfied with telehealth [21,22,23]. However, no telehealth program can be created overnight by all primary care physicians (PCP) and specialists (SP). In previous studies on telehealth utilization, little attention has been paid to Medicare beneficiaries aged 65 years and older. Along with telemedical innovations and vaccine administration [24, 25], understanding the experiences of these Medicare beneficiaries is essential for policymakers to assess the capacity to treat patients and make diverse contributions to telehealth.

In the present study, the objective was to focus on self-reported telehealth utilization and access to the Internet among Medicare beneficiaries aged 65 years and older during the COVID-19 pandemic. Because these two outcomes could be potentially correlated, we conducted a multivariate classification analysis. Independant variables included socio-demographic factors, personal experiences with COVID-19, economic and mental effects of the pandemic, Non-COVID-19 health status and interview time. There is a high dimension of variables with complex relationships, so we decide to use machine learning approaches. Nowadays, scientists and researchers used the machine learning and deep learning models in several applications including agriculture [26, 27], environment [28,29,30,31,32,33,34], text sentiment analyses [35], cyber security [36,37,38],and medicine [39]. Since there are many correlated variables with missing values in our dataset, we utilized Random Forest machine learning techniques for the multivariate classification analysis [40, 41].

Methods

Data source and variables

We used the survey data from the Medicare Current Beneficiary Survey (MCBS) Winter 2021 COVID-19 Supplement, administered by telephone interview conducted by trained and certified NORC at the University of Chicago field interviewers from February through April 2021. As a continuous, multipurpose survey, the MCBS is sponsored by the Centers for Medicare & Medicaid Services (CMS) in the U.S. The original MCBS primarily focuses on outcomes such as changes in health status, spending down to Medicaid eligibility, impacts of the Medicare program, changes in satisfaction with care, and the usual source of care. With the emergence of COVID-19, CMS was uniquely positioned to use the MCBS as a vehicle to collect vital information on how the pandemic is impacting the Medicare population, and made the data publicly available at the MCBS COVID-19 Supplement Public Use File. This is a nationally representative survey of all Medicare beneficiaries, and we chose Medicare beneficiaries aged 65 years and older as our target population.

We conducted descriptive analyses as an overview of patterns of telehealth offerings and access to the Internet (see Table S1 for the items in the questionnaire) using variables including socio-demographic factors, personal experiences with COVID-19, economic and mental effects of the pandemic, and non-COVID-19 health status. We also conducted a multivariate classification analysis to detect significant predictors.

Statistical analysis

All analyses adopted sampling weights provided by the MCBS to give nationally representative estimates. All percentages and proportions were calculated using survey weights. A weighted chi-squared test was used for the descriptive overview of each predictor. Random Forest [40] model was applied for the multivariate classification analysis, which is a modern machine learning technique that has been utilized to select replicable sets of exploratory factors from a large number of predictors [42,43,44,45,46,47]. Because this method is completely nonparametric without any restrictive underlying model assumptions, nonlinear and complex interrelationships can be robustly accounted for. After fitting the Random Forest model, variable importance (VIMP) [40, 41] and partial plots [48, 49] were adopted to identify and depict variables that are associated with the outcomes after adjusting for all the other variables. We select informative variables as those with positive VIMP estimates whose P values are less than 0.05. The VIMP can be interpreted as the increase in the misclassification error when the predictor of interest is randomly permutated into a noise variable. Negative VIMP values categorize “noisy” variables that degrade model accuracy. The VIMP and misclassification errors are calculated in a cross-validated fashion using the data proportion that is not used for fitting the model (a forest of classification trees is “grown” from bootstrap samples of the original dataset, leaving an average of 37% of the data not sampled, which is referred to as out-of-bag data).

We implemented weighted chi-squared tests and the Random Forest model in the open-source R software using the weights [50] and randomForestSRC [51, 52] packages respectively. The function wtd.chi.sq from the weights package was used for conducting weighted chi-squared tests. From the randomForestSRC package, the function rfsrc was used with 1000 trees and the function tune and parameters na.action = “na.impute” and case.wt were used for tuning the model, for imputing missing values of independent variables [53, 54] and for survey weighting, respectively; then the function subsample was used for estimating inferences of VIMP with default settings using 1000 subsamples [55]. There are two major tuning parameters, the number of variables to possibly split at each node (mtry) and the minimum size of terminal node (nodesize); model performance is evaluated from different combinations of mtry and nodesize to determine the final optimized forest (see Fig. S1 for details). Maximal subtree analysis was used for detecting interactions between predictors [56, 57] (see Fig. S2 for the heatmap). Partial plots were generated by setting the partial parameter in the plot.variable function [58]. The statistical significance level was set at .05.

Results

The MCBS Public Use File contains 11,107 Medicare beneficiaries in total, among which 9,185 beneficiaries aged 65 years and older (82.70%, survey-weighted 85.38%) were included in this study (survey-weighted \(n=\) 49.00 million). For answering whether PCP offered telehealth appointments, 1,964 and 1 beneficiaries reported “don’t know” and “refused”, respectively, with 344 inapplicable/missing data see Table S2 for more information on the missing values. For answering whether they had access to the Internet, 40 and one beneficiaries reported “don’t know” and “refused,” respectively. These categories were inappropriate for implementing the weighted chi-squared tests, therefore discarded in the descriptive analysis for both outcomes and independent variables. The survey response rates for each outcome were 74.86% and 99.55% respectively. From the yes and no categories, 81.06% and 84.62% respondents reported telehealth coverage and Internet access respectively. The two outcomes were positively correlated (\(\chi ^2=268.58,\,p<.001\)). The type of telehealth offered was summarized as “telephone”, “video” and “both”, whose survey-weighted percentages were 21.31, 7.56 and 71.14, respectively. The association between the type of telehealth offered and electronic device usage is shown in Fig. 1. Access to the Internet and owning electronic devices positively relate to the categories “video” and “both”.

Fig. 1
figure 1

Distribution of type of telehealth offered and electronic device usage. The survey-weighted percentage of the “yes” category is listed on the top. A The association between type of telehealth and owning a computer. B The association between type of telehealth and owning a smartphone. C The association between type of telehealth and owning a tablet. D The association between type of telehealth and Internet access

Full size image

Descriptive analysis

The main characteristics of the sample are displayed in Table 1 with frequency, survey-weighted percentage and significant level of test statistics. There are 43 variables, including ten socio-demographic variables, two variables describing personal experiences with COVID-19, seven variables describing the economic and mental effects of the pandemic, and 24 variables recording non-COVID-19 health status.

Among socio-demographic factors, 7 of 10 were significantly associated with both outcomes, including age, race/ethnicity, residing area (metro vs non-metro), census region, income, use of a language other than English at home (shown as non-English in Table 1) and Medicare-Medicaid dual eligibility. The male group and the group without prescription drug coverage (Part D plan) significantly tended to have access to the Internet. The status of Medicare Advantage (MA) also played a significant role. The two variables describing personal experiences with COVID-19, which recorded COVID-19 test and COVID-19 antibody test results, were not significantly associated with the outcomes. Among factors describing the economic and mental effects of the pandemic, 3 of 7 were significantly associated with both outcomes. Beneficiaries who felt more financially secure, more stressed and less socially connected were more likely to have access to telehealth and the Internet; beneficiaries with access to the Internet were those who were able to pay rent/mortgage as well as get food and home supplies. Most of the 24 variables recording non-COVID-19 health status were significantly associated with either of the outcomes.

Table 1 Descriptive analysis of telehealth coverage and Internet access
Full size table

Multivariate classification analysis

Important variables for predicting both outcomes were identified by machine learning using the Random Forest multivariate classification model, and the results are shown in Table 2 and Fig. S2. Only yes and no responses of the outcomes were included in the Random Forest model (\(n=6848,p=44\)). All variables in Table 1 were added to the classification model with a variable recording interview date added. The Random Forest classification model predicted the outcomes accurately: the out-of-bag misclassification error is 21.22% for predicting telehealth coverage and 17.60% for Internet acess. The complete list of VIMP for Table 2 can be found in Appendix Table S3. We also used Internet access as an additional predictor for the outcome telehealth provided by PCP and Table S4 showed significant predictors, among which Internet access is the strongest predictor. Table 1 consists of stacked contingency tables of variables, and the first two rows of each contingency table for each variable were used for calculating an odds ratio (OR) with survey weights to demonstrate the direction of effects. Table 2 presents the estimate, standard error (SE), and the P value of VIMP, followed by the survey-weighted OR. A large estimate of VIMP indicates a variable that is strongly associated with the corresponding outcome, while a negative estimate indicates a noise variable. An OR greater than 1 indicates a positive association between the first category of the variable and the corresponding outcome, compared with its second category, while an OR less than 1 indicates a negative association. For variables with yes and no responses, an OR greater than 1 indicates a positive association since the first category is always for the yes response. The effects of three informative multifactorial categorical variables are shown in Fig. 2 for race/ethnicity and region and Fig. S3 for Medicare Advantage.

Fig. 2
figure 2

Random Forest estimated probabilities of outcomes plotted against candidate variables. A The association between race/ethnicity and telehealth coverage. B The association between race/ethnicity and Internet access. C The association between region and telehealth coverage. D The association between region and Internet access

Full size image

Coverage of telehealth

We detected 14 variables significantly associated with telehealth coverage after adjusting for other variables. Residing area (metro residence, VIMP = 2.00, SE = 0.24, \(p<\) .001, OR = 2.00) and race/ethnicity (VIMP = 1.14, SE = 0.27, \(p<\) .001, OR = 1.92) were the most informative factors (see Table 2), indicating that non-hispanic white and metro residence were more likely to have coverage of telehealth. In addition, the relatively young group (VIMP = 0.10, SE = 0.02, \(p<\) .001, OR = 1.65) and high income group (VIMP = 0.10, SE = 0.05, \(p=\) .026, OR = 0.49) tended to have higher coverage. Beneficiaries who had positive COVID-19 test (VIMP = 0.25, SE = 0.10, \(p=\) .005, OR = 1.31) and were able to get food (VIMP = 0.99, SE = 0.30, \(p=\) .001, OR = 1.58) and pay rent/mortgage (VIMP = 0.47, SE = 0.21, \(p=\) .011, OR = 1.39) were more likely to have telehealth coverage.

In terms of mental effects of the pandemic and non-COVID-19 health status or habit, beneficiaries with telehealth coverage tended to feel lonely or sad (VIMP = 0.38, SE = 0.13, \(p=\) .002, OR = 1.05) and have depression (VIMP = 0.05, SE = 0.01, \(p<\) .001, OR = 1.08). Beneficiaries who had coverage of telehealth were more likely with high cholesterol (VIMP = 0.12, SE = 0.01, \(p<\) .001, OR = 1.04), but no heart conditions such as myocardial infarction, angina pectoris/coronary heart disease (CHD), congestive heart failure (see Table S3) or abnormal valve/rhythm (VIMP = 0.01, SE = 0.01, \(p=\) .026, OR = 0.96); they were with low probability of having any arthritis (VIMP = 0.06, SE = 0.01, \(p<\) .001, OR = 0.83) or reporting e-cigarette usage (ever used, VIMP = 0.15, SE = 0.07, \(p=\) .016, OR = 0.92; smoke now, VIMP = 0.61, SE = 0.09, \(p<\) .001, OR = 0.72)

Access to the internet

Among the 18 variables listed in Table 1, 11 variables were significantly associated with access to the Internet. The two most informative factors are Medicare-Medicaid dual eligibility (VIMP = 9.78, SE = 1.16, \(p<\) .001, OR = 0.13) and income (VIMP = 3.83, SE = 0.49 \(p<\) .001, OR = 0.14), indicating that nondual-eligible beneficiaries (not eligible for Medicaid benefits) and beneficiaries with higher income were more likely to have access to the Internet. In addition, the non-hispanic white group (VIMP = 2.05, SE = 0.44, \(p<\) .001, OR = 3.85) and relatively young group (VIMP = 0.96, SE = 0.10, \(p<\) .001, OR = 2.74) tended to have access to the Internet. Beneficiaries with Internet access were those who were able to get food (VIMP = 0.83, SE = 0.24, \(p<\) .001, OR = 1.18) but more likely to feel lonely or sad (VIMP = 0.14, SE = 0.07, \(p=\) .018, OR = 1.06) .

In terms of non-COVID-19 health status or habit, beneficiaries with Internet access tended to report e-cigarette usage (ever used, VIMP = 0.15, SE = 0.06, \(p=\) .008, OR = 1.32) but do not have weak immune system due to health conditions (VIMP = 0.01, SE = 0.01, \(p=\) .039, OR = 0.98). Although beneficiaries reporting any heart condition had lower probability of Internet access, those with angina pectoris/CHD (VIMP = 0.13, SE = 0.02, \(p<\) .001, OR = 1.16) and with other heart conidtion such as abnormal valve/rhythm (VIMP = 0.04, SE = 0.01, \(p<\).001, OR = 1.02) were more likely to have access to the Internet.

Table 2 Informative variables for predicting telehealth coverage and Internet access from Random Forest analyses
Full size table

Variable interactions

We found three pairs of variables that intensified the disparity in both outcomes among combined categories. The interaction between residing area and age is demonstrated in Fig. 3A and B for the two outcomes. The 65 to 74 age group with the status of metro residence had higher probabilities of telehealth coverage and Internet access (86.16% and 91.28%) than the over-74 age group with the status of non-metro residence (64.52% and 68.11%). The interaction between race/ethnicity and Medicare Advantage is demonstrated in Fig. 3C for Internet access and Fig. S3A for telehealth coverage. The non-Hispanic white group with no Medicare Advantage enrollment had higher probabilities of Internet access (89.61%) and telehealth coverage (83.43%) than the non-Hispanic black group (72.44% and 67.28%). The non-Hispanic white group without congestive heart failure (ever) also had higher probabilities of Internet access (88.99% shown in Fig. 3D) and telehealth coverage (83.58% shown in Fig. S4B) than the non-Hispanic black group with congestive heart failure (65.11% and 67.45%).

Fig. 3
figure 3

Interactions of variables for predicting the probabilities of telehealth coverage and Internet access. The survey-weighted proportions of positive outcomes are listed in the parentheses. A The interaction between residing area and age for predicting telehealth coverage. B The interaction between residing area and age for predicting Internet access. C The interaction between race/ethnicity and Medicare Advantage (MA) for predicting Internet access. D The interaction between race/ethnicity and congestive heart failure (ever) for predicting Internet access

Full size image

Discussion

This study set out to investigate the use of telehealth among older adults during the pandemic in the U.S. Specifically, we aimed to model telehealth coverage offered by PCP and Internet access reported by Medicare beneficiaries aged 65 Years and older during the Winter of 2021. Utilizing nationally representative survey data, we examined patterns in coverage of telehealth and access to the Internet during the COVID-19 pandemic. First, we identified about four-fifth of older beneficiaries who reported telehealth coverage and Internet access during the pandemic. Our estimate for telehealth coverage was about the same as the estimate from prior work on overall beneficiaries (80.2%) [11]. Compared with Internet access, the low survey response rate for telehealth coverage indicates that older people may be accustomed to seeing a doctor in person and less comfortable with technology [59], possibly due to physical limitations, such as impaired vision or manual dexterity [60]. Our work adds to the existing literature by identifying factors contributing to telehealth usage in a nationally representative population with stable health insurance during the COVID-19 pandemic. Strong correlates, such as Medicare beneficiaries’ age, race/ethnicity, income, Medicare-Medicaid dual eligibility, ability to access basic needs, and certain mental and physical health conditions, are consistent with some prior studies [61,62,63,64,65,66].

We found that self-reported telehealth coverage is strongly associated with the result of beneficiaries’ active COVID-19 test, indicating increased awareness of telehealth among COVID-19 patients and the importance of enhancing telehealth coverage for containing the pandemic. We found that Internet access was positively related to telehealth coverage and associated with the type of telehealth, indicating that investment in technology infrastructure could have a significant impact on improving access to healthcare. Although our primary outcome, telehealth provided by PCP, would be affected more by provider factors than patient factors, the survey does not offer much information on provider factors. Therefore, we could only use patient factors in this paper. Some patient characteristics could be directly associated with whether a provider offers a visit to be delivered via telehealth, such as whether the patient is suspected of having COVID-19, or is considered a high-risk patient due to underlying health conditions. Some patient characteristics, such as MA enrollment or race/ethnicity, could be indirectly related to the outcome since they are confounded with some unobserved provider factors, especially under the condition that no telehealth program can be created overnight. For example, before the COVID-19 pandemic, if telehealth was only available to beneficiaries enrolled in MA, then during the pandemic, even MA itself is no longer associated with telehealth access anymore, both beneficiaries enrolled in MA and their providers tend to have more awareness of telehealth with a telehealth program that was already created.

We attempted to identify potential barriers to the implementation of telehealth services during the COVID-19 pandemic. Our findings confirmed and expanded previous results that identified barriers to access and utilization of telemedicine, such as the age of the patient, racial/ethnic disparities, and type of community and geographic location [67, 68]. Our results suggested that beneficiary who is less likely to have access to telehealth from PCP tends to be someone who is a non-metro residence, with a lower income, or without Internet access. Telehealth utilization in rural areas, particularly the Southern regions of the country, has previously been limited [69, 70]. However, the regional differences in older beneficiaries’ access to the Internet were not as large. Although our descriptive statistics show that males were more likely to have Internet access, this difference is not significant in our classification model after adjusting for other variables. Previous studies found that females utilized telehealth services more than males [71], while we observed similar awareness of primary care virtual appointments between females and males in U.S. Medicare beneficiaries aged 65 years and older.

Before the COVID-19 pandemic, telehealth reimbursement was limited to the management of chronic conditions [11]. Limited reimbursement may constrain the widespread use of telehealth. We found that several mental and physical health conditions were significantly associated with telehealth coverage, indicating that such limitations may still exist for certain chronic conditions in the wake of the pandemic. Although several health conditions were negatively associated with telehealth coverage, we found that depression was positively associated with telehealth coverage, which may reflect the parity between mental health coverage and coverage for other medical conditions.

Compared with the existing literature, we analyzed related factors in a more inclusive fashion to identify main effects and complex interactions. We believe that after adjustment for different factors, the discoveries of the most informative ones could be more consistent and reproducible. On the other hand, adding more factors brings risks of multicollinearity and missing data, which causes the problem of convergence for parametric statistical models. We tried classical logistic regression and lasso penalized logistic regression for this dataset, which did not converge due to a large amount of missing values on the predictors. When the goal is to rank the factors which are highly correlated and interacted, nonparametric variable important indices [41, 72, 73], instead of odds ratios or regression coefficients, may be more suitable for providing insights. The success of this predictive model was also largely attributed to the high quality of the data. Although there are many missing values, the misclassification errors are about only 20%, indicating high accuracy of missing data imputation by Random Forest [53] and low common biases related to surveys, such as recall bias. Random Forest methods have a high potential for analyzing survey data whose variables are multifactorial and interacted.

Limitations

This study has several limitations. First, it relies upon self-reported data from a national survey limited to a relatively short period. As such, our findings may be subject to self-reporting errors and are not generalizable to older adults who are non-Medicare beneficiaries or live in long-term care facilities. We do not have data to infer if similar issues occurred in the broader population and patients on commercial insurance or uninsured. Second, our study has two types of missing data problems: the missing values for the outcome and the predictors. Although low misclassification errors indicate high accuracy of missing data imputation for the predictors by Random Forest, we have to omit the missing values for the outcome, which could bring bias to the model’s findings. Additionally, the cross-sectional nature of the data and analyses prevents assumptions of causality. As a cross-sectional study, changes in telehealth utilization were not directly assessed, but inferred based on studies of telehealth use prior to the pandemic. Furthermore, several important factors were not included in the survey, such as education attainment, information on state residency, primary diagnosis from the telehealth visit, etc. We could not evaluate effects of specific pandemic responses such as masking policies and restrictions on elective surgeries, or effects of specific regulatory issues on telemedicine such as payment, licensure, credentialing, online prescribing, medical malpractice, privacy and security, etc. Further, the mental effects of the pandemic were not evaluated via clinical mood or disorders to capture different dimensions of mental health problems.

Conclusions

In summary, this cross-sectional survey study suggests that several barriers to telehealth utilization exist among older Medicare beneficiaries. The COVID-19 pandemic may exacerbate existing barriers for this high at-risk population. As in-person visits were being discouraged or were unavailable due to the risks of the COVID-19 virus, the need for strategies for improving telehealth utilization grows. Policymakers must continue to identify effective means of ensuring equal access and utilization of telehealth.

Availability of data and materials

The dataset analyzed for this study can be found at https://github.com/luminwin/MCBS-PUF2021. More details about this dataset can be found in the Medicare Current Beneficiary Survey COVID-19 Supplement, available at https://www.cms.gov/research-statistics-data-systems/cms-covid-19-data-products. The questionnaire can be found at https://www.cms.gov/research-statistics-data-and-systemsresearchmcbsquestionnaires/2021-winter-supplemental-covid-19-questionnaires.

References

  1. Satin AM, Lieberman IH. The Virtual Spine Examination: Telemedicine in the Era of COVID-19 and Beyond. Global Spine J. 2021;11(6):966–74. https://doi.org/10.1177/2192568220947744.

    Article  PubMed  Google Scholar 

  2. Garfan S, Alamoodi AH, Zaidan BB, Al-Zobbi M, Hamid RA, Alwan JK, et al. Telehealth utilization during the Covid-19 pandemic: A systematic review. Comput Biol Med. 2021;138:104878. https://doi.org/10.1016/j.compbiomed.2021.104878.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Reece JC, Neal EF, Nguyen P, McIntosh JG, Emery JD. Delayed or failure to follow-up abnormal breast cancer screening mammograms in primary care: a systematic review. BMC Cancer. 2021;21(1):1–14. https://doi.org/10.1186/s12885-021-08100-3.

    Article  Google Scholar 

  4. Park S, Stimpson JP. Trends in Self-reported Forgone Medical Care Among Medicare Beneficiaries During the COVID-19 Pandemic. JAMA Health Forum. 2021;2(12):e214299–e214299. https://doi.org/10.1001/jamahealthforum.2021.4299.

    Article  PubMed  PubMed Central  Google Scholar 

  5. The U S Department of Health and Human Services (HHS). Medicare payment policies during COVID-19. 2022. https://telehealth.hhs.gov/providers/billing-and-reimbursement/medicare-payment-policies-during-covid-19/. Accessed 1 Oct 2020.

  6. Gold JA, Rossen LM, Ahmad FB, Sutton P, Li Z, Salvatore PP, et al. Race, ethnicity, and age trends in persons who died from COVID-19–United States, May–August 2020. Morb Mortal Wkly Rep. 2020;69(42):1517. https://doi.org/10.15585/mmwr.mm6942e1.

    Article  CAS  Google Scholar 

  7. Morrow-Howell N, Galucia N, Swinford E. Recovering from the COVID-19 Pandemic: A Focus on Older Adults. J Aging Soc Policy. 2020;32(4–5):526–35. https://doi.org/10.1080/08959420.2020.1759758.

    Article  PubMed  Google Scholar 

  8. Lin B, Yue S. The Use of Telehealth in Depression Treatment during the Crisis Caused by COVID-19. Soc Work Pub Health. 2022;0(0):1–12. https://doi.org/10.1080/19371918.2022.2053631.

  9. Cantor JH, McBain RK, Pera MF, Bravata DM, Whaley CM. Who Is (and Is Not) Receiving Telemedicine Care During the COVID-19 Pandemic. Am J Prev Med. 2021;61(3):434–8. https://doi.org/10.1016/j.amepre.2021.01.030.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Kichloo A, Albosta M, Dettloff K, Wani F, El-Amir Z, Singh J, et al. Telemedicine, the current covid-19 pandemic and the future: a narrative review and perspectives moving forward in the USA. Fam Med Community Health. 2020;8(3):e000530.

  11. Hamadi HY, Zhao M, Haley DR, Dunn A, Paryani S, Spaulding A. Medicare and telehealth: The impact of COVID-19 pandemic. J Eval Clin Pract. 2022;28(1):43–8. https://doi.org/10.1111/jep.13634.

    Article  PubMed  Google Scholar 

  12. Uscher-Pines L, McCullough C, Dworsky MS, Sousa J, Predmore Z, Ray K, et al. Use of Telehealth Across Pediatric Subspecialties Before and During the COVID-19 Pandemic. JAMA Netw Open. 2022;5(3):e224759–e224759. https://doi.org/10.1001/jamanetworkopen.2022.4759.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Pinto JM, Coppola JF, Stanford M, Gaur C, Gaur D. Educational effects of telehealth implementation on older adults with socio-economic disparities. In: IEEE Long Island Systems, Applications and Technology (LISAT) Conference 2014. 2014. p. 1–6. https://doi.org/10.1109/LISAT.2014.6845208.

  14. Jetty A, Moore MA, Coffman M, Petterson S, Bazemore A. Rural Family Physicians Are Twice as Likely to Use Telehealth as Urban Family Physicians. Telemed e-Health. 2018;24(4):268–76. https://doi.org/10.1089/tmj.2017.0161.

    Article  Google Scholar 

  15. Jewett PI, Vogel RI, Ghebre R, Hui JY, Parsons HM, Rao A, et al. Telehealth in cancer care during COVID-19: disparities by age, race/ethnicity, and residential status. J Cancer Survivorship. 2022;16(1):44–51. https://doi.org/10.1007/s11764-021-01133-4.

    Article  Google Scholar 

  16. Hayrapetian L, Zepp M, Rao S, Hennessey M, Houle M, Atienza M, et al. Expanding telehealth options during the COVID pandemic eliminated racial and age disparities in electronic communication by inflammatory bowel disease patients. J Natl Med Assoc. 2021;113(4):474–7. https://doi.org/10.1016/j.jnma.2021.03.005.

    Article  PubMed  Google Scholar 

  17. Hoffman DA. Increasing access to care: telehealth during COVID-19. J Law Biosci. 2020;7(1). https://doi.org/10.1093/jlb/lsaa043.

  18. Martinez-Martin N, Dasgupta I, Carter A, Chandler JA, Kellmeyer P, Kreitmair K, et al. Ethics of Digital Mental Health During COVID-19: Crisis and Opportunities. JMIR Ment Health. 2020;7(12):e23776. https://doi.org/10.2196/23776.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Koonin LM, Hoots B, Tsang CA, Leroy Z, Farris K, Jolly B, et al. Trends in the use of telehealth during the emergence of the COVID-19 pandemic–United States, January–March 2020. Morb Mortal Wkly Rep. 2020;69(43):1595. https://doi.org/10.15585/mmwr.mm6943a3.

    Article  CAS  Google Scholar 

  20. Bharucha AE, Rhodes CT, Boos CM, Keller DA, Dispenzieri A, Oldenburg RP. Increased Utilization of Virtual Visits and Electronic Approaches in Clinical Research During the COVID-19 Pandemic and Thereafter. Mayo Clin Proc. 2021;96(9):2332–41. https://doi.org/10.1016/j.mayocp.2021.06.022.

    Article  CAS  PubMed  Google Scholar 

  21. Slightam C, Gregory AJ, Hu J, Jacobs J, Gurmessa T, Kimerling R, et al. Patient perceptions of video visits using veterans affairs telehealth tablets: survey study. J Med Internet Res. 2020;23(5):542–52. https://doi.org/10.4048/jbc.2020.23.e56.

    Article  Google Scholar 

  22. Zimmerman BS, Seidman D, Berger N, Cascetta KP, Nezolosky M, Trlica K, et al. Patient perception of telehealth services for breast and gynecologic oncology care during the COVID-19 pandemic: A single center survey-based study. J Breast Cancer. 2020;23(5):542. https://doi.org/10.4048/jbc.2020.23.e56.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Andrews E, Berghofer K, Long J, Prescott A, Caboral-Stevens M. Satisfaction with the use of telehealth during COVID-19: An integrative review. Int J Nurs Stud Adv. 2020;2:100008. https://doi.org/10.1016/j.ijnsa.2020.100008.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Giacalone A, Marin L, Febbi M, Franchi T, Tovani-Palone MR. eHealth, telehealth, and telemedicine in the management of the COVID-19 pandemic and beyond: Lessons learned and future perspectives. World J Clin Cases. 2022;10(8):2363. https://doi.org/10.12998/wjcc.v10.i8.2363.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Haroz EE, Kemp CG, O’Keefe VM, Pocock K, Wilson DR, Christensen L, et al. Nurturing Innovation at the Roots: The Success of COVID-19 Vaccination in American Indian and Alaska Native Communities. Am J Public Health. 2022;112(3):383–7. https://doi.org/10.2105/AJPH.2021.306635.

    Article  PubMed  Google Scholar 

  26. Haq MA. Planetscope Nanosatellites Image Classification Using Machine Learning. Comput Syst Sci Eng. 2022;42(3):1031–46.

    Article  Google Scholar 

  27. Haq MA. CNN Based Automated Weed Detection System Using UAV Imagery. Comput Syst Sci Eng. 2022;42(2):837–49.

    Article  Google Scholar 

  28. Haq MA. Smotednn: A novel model for air pollution forecasting and aqi classification. Comput Mater Continua. 2022;71:1.

    Google Scholar 

  29. Haq MA. CDLSTM: A novel model for climate change forecasting. Comput Mater Contin. 2022;71:2363–81.

    Google Scholar 

  30. Haq MA, Jilani AK, Prabu P. Deep Learning Based Modeling of Groundwater Storage Change. CMC-Comput Mater Continua. 2021;70:4599–617.

    Google Scholar 

  31. Haq MA, Rahaman G, Baral P, Ghosh A. Deep learning based supervised image classification using UAV images for forest areas classification. J Indian Soc Remote Sens. 2021;49(3):601–6.

    Article  Google Scholar 

  32. Haq MA, Baral P, Yaragal S, Pradhan B. Bulk Processing of Multi-Temporal Modis Data, Statistical Analyses and Machine Learning Algorithms to Understand Climate Variables in the Indian Himalayan Region. Sensors. 2021;21(21):7416.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Haq MA, Baral P. Study of permafrost distribution in Sikkim Himalayas using Sentinel-2 satellite images and logistic regression modelling. Geomorphology. 2019;333:123–36.

    Article  Google Scholar 

  34. Haq MA, Azam MF, Vincent C. Efficiency of artificial neural networks for glacier ice-thickness estimation: A case study in western Himalaya. India J Glaciol. 2021;67(264):671–84.

    Article  Google Scholar 

  35. Revathy G, Alghamdi SA, Alahmari SM, Yonbawi SR, Kumar A, Haq MA. Sentiment analysis using machine learning: Progress in the machine intelligence for data science. Sustainable Energy Technologies and Assessments. 2022;53:102557.

    Article  Google Scholar 

  36. Haq MA, Khan MAR, Alshehri M. Insider Threat Detection Based on NLP Word Embedding and Machine Learning. Intell Autom Soft Comput. 2022;33(1):619–35.

    Article  Google Scholar 

  37. Haq MA, Khan MAR. DNNBoT: Deep Neural Network-Based Botnet Detection and Classification. CMC-Comput Mater Continua. 2022;71(1):1729–50.

    Article  Google Scholar 

  38. Haq MA, Khan MAR, Talal AH. Development of PCCNN-Based Network Intrusion Detection System for EDGE Computing. CMC-Comput Mater Continua. 2022;71(1):1769–88.

    Article  Google Scholar 

  39. Santosh Kumar B, Haq MA, Sreenivasulu P, Siva D, Alazzam MB, Alassery F, et al. Fine-tuned convolutional neural network for different cardiac view classification. J Supercomput. 2022;78:1–18.

  40. Breiman L. Random forests. Mach Learn. 2001;45(1):5–32.

    Article  Google Scholar 

  41. Ishwaran H, Lu M. Standard errors and confidence intervals for variable importance in random forest regression, classification, and survival. Stat Med. 2019;38(4):558–82.

    Article  PubMed  Google Scholar 

  42. Lu M, Parel JM, Miller D. Interactions between staphylococcal enterotoxins A and D and superantigen-like proteins 1 and 5 for predicting methicillin and multidrug resistance profiles among Staphylococcus aureus ocular isolates. PLoS ONE. 2021;16(7):1–18. https://doi.org/10.1371/journal.pone.0254519.

    Article  CAS  Google Scholar 

  43. Lu M, Liao X. Access to care through telehealth among U.S. Medicare beneficiaries in the wake of the COVID-19 pandemic. Front Public Health. 2022;10. https://doi.org/10.3389/fpubh.2022.946944.

  44. Ong J, Liu X, Rajarethinam J, Kok SY, Liang S, Tang CS, et al. Mapping dengue risk in Singapore using Random Forest. PLoS Negl Trop Dis. 2018;12(6):e0006587.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Yurekli H, Yigit OE, Bulut O, Lu M, Oz E. Exploring Factors That Affected Student Well-Being during the COVID-19 Pandemic: A Comparison of Data-Mining Approaches. Int J Environ Res Public Health. 2022;19(18). https://doi.org/10.3390/ijerph191811267.

  46. Bachert C, Zhang N, Holtappels G, De Lobel L, Van Cauwenberge P, Liu S, et al. Presence of IL-5 protein and IgE antibodies to staphylococcal enterotoxins in nasal polyps is associated with comorbid asthma. J Allergy Clin Immunol. 2010;126(5):962–8.

    Article  CAS  PubMed  Google Scholar 

  47. Fang X, Liu W, Ai J, He M, Wu Y, Shi Y, et al. Forecasting incidence of infectious diarrhea using random forest in Jiangsu Province, China. BMC Infect Dis. 2020;20(1):1–8.

    Article  Google Scholar 

  48. Goldstein A, Kapelner A, Bleich J, Pitkin E. Peeking inside the black box: Visualizing statistical learning with plots of individual conditional expectation. J Comput Graph Stat. 2015;24(1):44–65.

    Article  Google Scholar 

  49. Molnar C. Interpretable machine learning. 2020. https://christophm.github.io/interpretable-ml-book/. Accessed 23 Oct 2022.

  50. Pasek J, with some assistance from Alex Tahk, some code modified from R-core; Additional contributions by Gene Culter, Schwemmle M. weights: Weighting and Weighted Statistics; 2021. R package version 1.0.4. https://CRAN.R-project.org/package=weights. Accessed 23 Oct 2022.

  51. Ishwaran H, Kogalur UB. Fast Unified Random Forests for Survival, Regression, and Classification (RF-SRC). manual; 2022. R package version 3.1.0. https://cran.r-project.org/package=randomForestSRC. Accessed 23 Oct 2022.

  52. Ishwaran H, Lu M, Kogalur UB. randomForestSRC: getting started with randomForestSRC vignette. 2021. http://randomforestsrc.org/articles/getstarted.html. Accessed 23 Oct 2022.

  53. Tang F, Ishwaran H. Random forest missing data algorithms. Stat Anal Data Min ASA Data Sci J. 2017;10(6):363–77.

    Article  Google Scholar 

  54. Ishwaran H, Tang F, Lu M, Kogalur UB. randomForestSRC: multivariate splitting rule vignette. 2021. http://randomforestsrc.org/articles/mvsplit.html. Accessed 23 Oct 2022.

  55. Ishwaran H, Lu M, Kogalur UB. randomForestSRC: variable importance (VIMP) with subsampling inference vignette. 2021. http://randomforestsrc.org/articles/vimp.html. Accessed 23 Oct 2022.

  56. Ishwaran H, Chen X, Minn AJ, Lu M, Lauer MS, Kogalur UB. randomForestSRC: minimal depth vignette. 2021. http://randomforestsrc.org/articles/minidep.html. Accessed 23 Oct 2022.

  57. Lu M, Sha Y, Silva T, Colaprico A, Sun X, Ban Y, et al. LR hunting: A Random Forest Based Cell-cell Interaction Discovery Method for Single-cell Gene Expression Data. Front Genet. 2021;12:1431. https://doi.org/10.3389/fgene.2021.708835.

    Article  CAS  Google Scholar 

  58. Ishwaran H, Lu M, Kogalur UB. randomForestSRC: partial plots vignette. 2021. http://randomforestsrc.org/articles/partial.html. Accessed 23 Oct 2022.

  59. Carolan K, Grabowski DC, Mehrotra A, Hatfield LA, et al. Use of telemedicine for emergency triage in an independent senior living community: Mixed methods study. J Med Internet Res. 2020;22(12):e23014.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Call VR, Erickson LD, Dailey NK, Hicken BL, Rupper R, Yorgason JB, et al. Attitudes toward telemedicine in urban, rural, and highly rural communities. Telemed e-Health. 2015;21(8):644–51.

    Article  Google Scholar 

  61. Myers A, Presswala L, Bissoonauth A, Gulati N, Zhang M, Izard S, et al. Telemedicine for Disparity Patients With Diabetes: The Feasibility of Utilizing Telehealth in the Management of Uncontrolled Type 2 Diabetes in Black and Hispanic Disparity Patients; A Pilot Study. J Diabetes Sci Technol. 2021;15(5):1034–41.

    Article  PubMed  Google Scholar 

  62. Foster MV, Sethares KA. Facilitators and barriers to the adoption of telehealth in older adults: an integrative review. CIN Comput Inform Nurs. 2014;32(11):523–33.

    Article  PubMed  Google Scholar 

  63. Greenwood H, Krzyzaniak N, Peiris R, Clark J, Scott AM, Cardona M, et al. Telehealth Versus Face-to-face Psychotherapy for Less Common Mental Health Conditions: Systematic Review and Meta-analysis of Randomized Controlled Trials. JMIR Ment Health. 2022;9(3):e31780.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Zhou X, Snoswell CL, Harding LE, Bambling M, Edirippulige S, Bai X, et al. The role of telehealth in reducing the mental health burden from COVID-19. Telemed e-Health. 2020;26(4):377–9.

    Article  CAS  Google Scholar 

  65. Bagayoko CO, Traoré D, Thevoz L, Diabaté S, Pecoul D, Niang M, et al. Medical and economic benefits of telehealth in low-and middle-income countries: results of a study in four district hospitals in Mali. BMC Health Serv Res. 2014;14(1):1–6.

    Google Scholar 

  66. Choi NG, Hegel MT, Marti CN, Marinucci ML, Sirrianni L, Bruce ML. Telehealth problem-solving therapy for depressed low-income homebound older adults. Am J Geriatr Psychiatr. 2014;22(3):263–71.

    Article  Google Scholar 

  67. Dorsey ER, Topol EJ. State of telehealth. N Engl J Med. 2016;375(2):154–61.

    Article  PubMed  Google Scholar 

  68. Scott Kruse C, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: a systematic review. J Telemed Telecare. 2018;24(1):4–12.

    Article  PubMed  Google Scholar 

  69. Chen JA, DeFaccio RJ, Gelman H, Thomas ER, Indresano JA, Dawson TC, et al. Telehealth and rural-urban differences in receipt of pain care in the veterans health administration. Pain Med. 2022;23(3):466–74.

    Article  CAS  PubMed  Google Scholar 

  70. Hadlandsmyth K, Driscoll MA, Mares JG, Au V, Miell KR, Lund  BC. Rurality impacts pain care for female veterans similarly to male veterans. J Rural Health. 2022;00:1–7. https://doi.org/10.1111/jrh.12646.

  71. Arora P, Ha J, Mehta D. PMU5 IMPACT of telehealth utilization during the COVID-19 pandemic on health care resource utilization. Value Health. 2021;24:S145.

    Article  PubMed Central  Google Scholar 

  72. Lu M, Ishwaran H. A prediction-based alternative to P values in regression models. J Thorac Cardiovasc Surg. 2018;155(3):1130.

    Article  PubMed  Google Scholar 

  73. Lu M, Ishwaran H. Discussion on “Nonparametric variable importance assessment using machine learning techniques’’ by Brian D. Williamson, Peter B. Gilbert, Marco Carone, and Noah Simon. Biometrics. 2021;77(1):27. https://doi.org/10.1111/biom.13391.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was funded by the Department of Public Health Sciences 2022 Copeland Foundation Award and the Relief Funding Award from the Office of the Vice Provost for Research and Scholarship and the Office of Faculty Affairs, University of Miami.

Author information

Authors and Affiliations

  1. Department of Public Health Sciences, Miller School of Medicine, University of Miami, Miami, Florida, USA

    Min Lu & Xinyi Liao

Authors
  1. Min Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xinyi Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ML: Conceptualization, Methodology, Software, Formal analysis, Investigation, Writing-Original draft preparation, Writing-Review & Editing, Supervision, Funding acquisition. X.L.: Data management, Project administration, Writing-Review & Editing. All authors reviewed the manuscript. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Min Lu.

Ethics declarations

Ethics approval and consent to participate

Ethics approval and consent to participate for the entire project were obtained by US Centers for Medicare & Medicaid Services (CMS) and NORC at the University of Chicago; both organizations uphold provisions established under the Privacy Act of 1974, the NORC Institutional Review Board (IRB), the Office of Management and Budget (OMB), and the Federal Information Security Management Act of 2002. All methods were carried out in accordance with CMS data users’ guide: COVID-19 winter supplemental public use file (PUF), available at https://www.cms.gov/files/document/2021mcbscovidpufdugwinter.pdf. All protocols for PUF are consistent with the Medicare Current Beneficiary Survey protocols. Informed consent has been obtained from all participants.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, M., Liao, X. Telehealth utilization in U.S. Medicare beneficiaries aged 65 years and older during the COVID-19 pandemic. BMC Public Health 23, 368 (2023). https://doi.org/10.1186/s12889-023-15263-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-023-15263-0

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us