Skip to main content
Download PDF

Validating the Time and Change test to screen for dementia in elderly Koreans

BMC Public Health volume 4, Article number: 52 (2004) Cite this article

Abstract

Background

We assessed the applicability of the T&C test as an accurate and convenient means to screen for dementia in primary care and community settings.

Methods

The study group comprised 59 patients and 405 community participants, all of who were aged 65 years and over. The time component of the T&C test evaluated the ability of a subject to comprehend clock hands that indicated a time of 11:10, while the change component of the T&C test evaluated the ability of a subject to make 1,000 Won from a group of coins with smaller denominations (one 500, seven 100, and seven 50 Won coins).

Results

The T&C test had a sensitivity and specificity of 73.0 and 90.9%, respectively, and positive and negative predictive values of 93.1, and 66.7%, respectively. The test-retest and interobserver agreement rates were both 95% (κ = 0.91) (time interval, 24 hours). The association between the T&C test and K-MMSE test was modest, while significant (r = 0.422, p < 0.001). The T&C test scores were not influenced by educational status.

Conclusions

We conclude that the T&C test is useful as supplemental testing of important domains (e.g., calculation, conceptualization, visuospatial) to traditional measures such as the MMSE. However, because T&C test is simple, rapid, and easy to use, it can be applied conveniently to elderly subjects by non-specialist personnel who receive training.

Peer Review reports

Background

Dementia, an acquired persistent impairment of cognitive functioning is an increasingly common problem in Korea, and is associated with increased morbidity and mortality, functional loss, caregiver burden, and institutionalization [1]. Nevertheless, most patients with dementia are not detected by family members or clinicians at an early stage, even though such patients have memory problems [2, 3].

Screening for dementia has been recommended to increase detection of dementia. The Mini-Mental State Examination (MMSE) is a brief screening test that quantitatively assesses the cognitive status of elderly people [4, 5]. Although it has shown good validity, the MMSE has been found to be influenced largely by racial differences and educational status [6–10]. Korean elderly show very low levels of educational background, and it is necessary to develop appropriate cognitive assessment method that is not influenced by education. The Time and Change (T&C) test was developed by Inouye et al. [11] to assess (i) how well a patient understands time and (ii) the ability of the patient to calculate using money. Several studies have found that the T&C test allows direct assessment of two important activities of daily living and supplements the testing of calculation, conceptualization, and visuospatial cognitive domains irrespective of race and education [11–13].

We have therefore introduced a T&C test, and assessed the applicability of the T&C test as a convenient and accurate means to detect early stage dementia in primary care and community settings.

Methods

Subjects

One study group initially comprised 60 participants who either visited or were admitted to a hospital that was located in an urban area, namely Gwangju city (referred to forthwith as area A) between November and December 2001. Of these 60 participants, 37 were diagnosed with Alzheimer's disease or vascular dementia, 11 had mental illness such as schizophrenia or depression, 7 had organic brain disease such as cerebral apoplexy or Parkinson's disease, and 5 were alcoholics.

Another study group initially comprised 412 participants who were recruited from all residents of Jangseong-county, Jeonnam province, South Korea, aged 65 and over in 2002(referred to forthwith as area B). The area consists of 11 towns and had an estimated population 54,528 of whom about 16.5% were aged 65 and over. The subjects were selected from each stratum (town) using cluster sampling. All subjects in whom vision or hearing was impaired were excluded from the study. We selected 59 (of 60) and 405 (of 412) participants from area A and B, respectively. All participants gave informed consent, and when participants with dementia cannot provide informed consent, caregivers were asked to provide it.

The Time and Change test

The 'time' component of the T&C test evaluated the ability of a subject to comprehend that the hands of a clock indicated 11:10. The diameter of the clock was 15 cm, and the distance between the clock and the participant was 25–35 cm (in consideration of the visual deficits of the older subjects). When the subject responded incorrectly on the first attempt, the interviewer posed the same question, i.e., a second attempt was permitted. The time (in seconds) that it took for the participant to respond correctly was recorded. A time limit of 60 s for a response was imposed.

In the 'change' component of the T&C test, the participants were required to make 1,000 Won from a group of coins of several smaller denominations, namely one 500, seven 100, and seven 50 Won coins, that were placed on a table in front of the participant. The participants were given 120 s to complete the task, and an additional 120 s was granted if the subject failed to complete the task at the first attempt. The time (in seconds) that it took for the participant to complete the task was recorded by the interviewer.

The participants who completed both of the aforementioned tasks of the T&C test successfully were determined to be negative for suspected dementia, whereas participants who failed to complete either or both of the tasks were determined to be positive for suspected dementia. The T&C test was performed prior to the other cognitive tests by an interviewer who was unaware of the results of the other tests.

Measurement

In the participants from area A, the T&C test was conducted by a nurse, while a physician who were blinded to the result of the T&C test performed a clinical examination and neuropsychiatric inventory. The diagnostic criteria for dementia were based on those of the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) [14]. To detect the causative diseases of dementia, the following were carried out: general blood and chemical tests (including VDRL, Vitamin B12, T3, T4, TSH); a chest radiograph; an electrocardiogram; a brain computerized tomography scan; and psychometric tests including the K-MMSE [15]. Alzheimer's dementia was diagnosed based on the guidelines of the National Institute of Neurological and Communicative Disorders and Stroke and Alzheimer's disease and Related Disorders Association (NINCDS-ADRDA) [16]. Vascular dementia was diagnosed based on the guidelines of the National Institute of Neurological Disorders and Stroke and the Association Internationale pour la Recherche et l'Enseignement en Neurosciences (NINDS-AIREN) [17]. The CDR developed by Hughes et al. [18] was used to determine the progression of dementia.

The participants from area B were interviewed by interviewers who had undergone sufficient training to be able to conduct the K-MMSE and T&C test.

All participants were interviewed for data on social and demographic factors such as address, age, sex, educational status, and the number of family members living together.

Assessment of the validity of the T&C test

To assess the validity of the T&C test as a method to screen for dementia in the participants from area A, we compared the results of the test to a reference standard (diagnosed by a physician), and evaluated sensitivity, specificity, and positive and negative predictive values. To assess the test-retest reliability, the one type of interviewer (specifically, physicians) conducted the same test twice at an interval of 24 h (n = 22 participants). To assess the interobserver reliability, two different types of interviewer (specifically, physicians and psychometrists) conducted the same test, at an interval of 24 h (n = 22 participants).

To assess the applicability of the T&C test as a method to screen for dementia in the participants from area B, the association between the T&C and K-MMSE test scores was evaluated.

Statistical analysis

The sensitivity, specificity, and positive and negative predictive values and 95% Confidence interval of the T&C test were analyzed. After classifying the participants from area B into a group in which dementia was suspected, and another group in which dementia was not suspected based on the results from the T&C test, a Student's t-test was used to compare the total K-MMSE score with the scores for each of the components of the K-MMSE test, and Spearman's rank correlation was used to analyze the correlation between the T&C and K-MMSE test scores. SPSS for Windows (version 10.0; SPSS Inc., Chicago, IL, USA) and Stata Software 6.0 (Stata Corporation, College Station, Texas) were used to analyze data and statistics.

Results

Characteristics of subjects

For the participants from area A, the average age was 73.2 ± 7.9 years, 55.9% of the group was female, the average number of years of education was 4.2 ± 5.4, and 62.7% lived alone. For the participants from area B, the average age was 73.1 ± 6.1 years, 58.5% of the group was female, the average number of years of education was 3.1 ± 4.0, and 29.0% lived alone (Table 1).

Table 1 Characteristics of the study groups.
Full size table

Validity of the T&C Test

Table 2 shows the results of an analysis of the validity of the T&C test. In a comparison of the T&C test and a diagnosis of dementia by physicians (which served as a reference), 27 of 37 patients that had been diagnosed as demented were classified as positive for dementia according to the T&C test, and the sensitivity was 73.0%. Of the subjects who were diagnosed as not demented, 20 of 22 were classified as negative according to the T&C test, and the specificity was 90.9%. The positive predictive value that indicated the probability of dementia, as determined by a positive classification according to the T&C test, was 93.1%, while the negative predictive value that indicated the probability of not being demented, as determined by a negative classification according to the T&C test, was 66.7%.

Table 2 Concurrent validity of the Time and Change (T&C) test in a sample of elderly hospital patients.
Full size table

Reliability of the T&C test

The rate of agreement of the test-rest & interobserver variability was analyzed to assess the reliability of the T&C test. The rate of agreement of both the test-retest and interobserver was 95% (κ = 0.91) (time interval, 24 hours).

Comparison of the T&C and K-MMSE test

There was a significant difference between the total K-MMSE score and the scores for each of the components of the K-MMSE test between participants that were classified as positive and those that were classified as negative for dementia according to the T&C test (Table 3). The association between the T&C test and K-MMSE test revealed modest, while significant (r = 0.422, p < 0.001) (Table 4).

Table 3 Korean Mini-Mental State Examination (K-MMSE) scores according to T&C test performance in a sample of elderly community population.
Full size table
Table 4 Convergent validity of the T&C test in a sample of elderly community population.
Full size table

Association between the T&C test and educational status

The results of a logistic regression in which the T&C test as a dichotomous and dependent variable was performed with education status adjusting for age and sex revealed no association between them. The odds ratio for T&C test associated with educational status is 0.877 (95% CI = 0.766–1.004).

Response times in the T&C test

For the time task in the T&C test, 75.8% of the participants produced a correct response on the first attempt after 6.3 ± 6.7 s, and 45 participants (11.1%) produced a correct response on the second attempt. For the change task in the T&C test, 81.2% of the participants produced a correct response on the first attempt after 12.7 ± 14.2 s, and 43 participants (10.6%) produced a correct response on the second attempt. 34 participants(8.4%) were tested twice for both the time and change task. None of the subjects refused to respond during the tests.

Discussion

Interracial variability in both the etiology of dementia and the accuracy of cognitive testing suggests that there is an urgent need to develop racially appropriate methods of cognitive assessment. The rate of vascular dementia due to cerebrovascular disease is much higher in Koreans than in other races; this is due to insufficient prevention, diagnosis, and treatment of hypertension, diabetes, and hyperlipidemia in Korea. Vascular dementia, unlike Alzheimer's disease, can be prevented by appropriate treatment and prevention for the risk factors of cerebrovascular diseases, can be treated to improve symptoms and inhibit progression of the disease.

In the present study, the original T&C test of Inouye et al. [11] was modified to apply specifically to Korean elderly sample, and was used to screen for dementia. We found that the sensitivity of the T&C test was 73.0%, specificity was 90.9%, and the positive and negative predictive values were 93.1% and 66.7%, respectively. The disparity between the sensitivity and the specificity might mean the insensitivity to mild stage or pre-dementia. We advocate using the T&C test sequentially with other dementia measures (with increased sensitivity).

When compared to the results of Kawamato [19], in which sensitivity and specificity was 49.1 and 95.2%, respectively; the sensitivity of the T&C test in the present study was remarkably high, while specificity was relatively low. In a study by Inouye et al. [8] in which the MMSE and modified Blessed Dementia Rating Scale (mBDRS) served as standards, sensitivity was 86%, specificity was 71%, and the negative predictive value was 97% when the subjects were hospital patients [8], while sensitivity was 63%, specificity was 96%, and the negative predictive value was 93%, for outpatients [12]. This discrepancy might be due to the characteristics of different samples or the diagnostic standards for dementia. The rate of dementia among the participants of the present study (62.7%) was higher than in the studies by Inouye and colleagues (14 and 16% for admitted and outpatients, respectively). Therefore, there are limitations when it comes to comparing the predictive values of screening tests, which would appear to be influenced by the prevalence.

In elderly patients, the assessment of cognitive function is affected by psychological factors and by the circumstances under which the tests are conducted. In our measurement of the reliability of the T&C test, the test-retest and interobserver agreement rates were both remarkably high (95% for each, κ = 0.91). In a study by Inouye et al. [8] the test-retest agreement rate was 88%, and the interobserver agreement rate was 78% when the subjects were hospital patients [8]. However in the present study test-rest was conducted in the short interval, therefore it might to be influenced by carry-over effects and learning effects.

In the present study, no association was observed between T&C test scores and educational status. This result may be explained by the fact that interpreting the hands of a clock and calculation using change are behaviors that are common to all people during daily life, irrespective of race and education. In addition, unlike the language-focused MMSE, the questions in the T&C test cannot be misinterpreted or misunderstood, and are effective for assessing calculation ability and attention. Clock test (similar to T&C test) is less likely to be confounded by educational attainment [20], and measures various facets of cognitive functioning at varying levels of difficulty [21].

This study has several important limitations. First, while the hospital patients underwent an evaluation of their medical history as well as neurological and physical examinations before a diagnosis of dementia was made, the elderly community sample were evaluated using only the K-MMSE as a reference. Second, the hospital patients would appear to be a rather unusual sample in that there was a high prevalence of psychiatric morbidity in the non-demented subjects. Third, dementia in the present study was not classified as vascular or Alzheimer's-type, nor did we consider the severity of symptoms. Finally, the T&C test has limitations in assessment of a wide range of deficits associated with dementia. However, because T&C test is simple, rapid, and easy to use, the T&C test may pose particular advantages in primary care and community settings where frequent assessment of cognitive functioning is required. The T&C test adds supplemental testing of important domains (e.g., calculation, conceptualization, visuospatial) to traditional measures such as MMSE. In addition, because the T&C test is less influenced by educational status, it may be particularly useful in populations with diverse educational and cultural backgrounds.

Conclusions

We conclude that the T&C test is useful as a supplemental testing of important domains (e.g., calculation, conceptualization, visuospatial) to traditional measures such as the MMSE, because sensitivity of T&C test is not great and the association between the T&C test and MMSE is modest. However, because T&C test is simple, rapid, and easy to use, it can be applied conveniently to elderly subjects by non-specialist personnel who receive training. In addition, the T&C test is less influenced by educational status

Funding

This work was supported by grants from Chonnam National University Hospital (CUHRI-U-200241).

References

  1. 1.

    Folstein MF, Bassett SS, Anthony JC, Romaniski AJ, Nestadt GR: Dementia: Case ascertainment in a community survey. Journal of Gerontology. 1991, 46: M132-138.

    CAS  Article  PubMed  Google Scholar 

  2. 2.

    Ross GW, Abbott RD, Petrovitch H, Masaki KH, Murdaugh C, Trockman C, Curb JD, White LR: Frequency and characteristics of silent dementia among elderly Japanese-American men. JAMA. 1997, 77: 800-805. 10.1001/jama.277.10.800.

    Article  Google Scholar 

  3. 3.

    McLean S: Assessing dementia. Difficulties, definitions and differential diagnosis. Austrian and New Zealand Journal of Psychiatry. 1987, 21: 142-174.

    CAS  Article  Google Scholar 

  4. 4.

    Folstein MF, Folstein SE, McHugh PR: Mini-Mental State Examination: a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975, 12: 189-198. 10.1016/0022-3956(75)90026-6.

    CAS  Article  PubMed  Google Scholar 

  5. 5.

    Tombaugh TN, Mclntyre NJ: The mini-mental state examination: a comprehensive review. J Am Geriatr Soc. 1992, 40: 922-935.

    CAS  Article  PubMed  Google Scholar 

  6. 6.

    Anthony JC, Le Resche L, Niaz U, Von Korff MR, Folstein MF: Limits of the 'Mini-Mental State' as a screening test for dementia and delirium among hospital patients. Psychological Medicine. 1982, 12: 397-408.

    CAS  Article  PubMed  Google Scholar 

  7. 7.

    Fillenbaum GG, Hughes DC, Heyman A, Geroge LK, Blazer DG: Relationship of health and demographic characteristics to Mini-Mental State Examination score among community residents. Psychological Medicine. 1988, 18: 719-726.

    CAS  Article  PubMed  Google Scholar 

  8. 8.

    Jorm AF, Scott R, Henderson AS: Educational level differences on the Mini-Mental State: the role of test bias. Psychological Medicine. 1988, 18: 727-731.

    CAS  Article  PubMed  Google Scholar 

  9. 9.

    Escobar JI, Burnam A, Karno M, Forsythe A, Landsverk J, Golding M: Use of the Mini-Mental State Examination (MMSE) in a community population of mixed ethnicity. Cultural and linguistic artifacts. Journal of Nervous and Mental Disease. 1986, 174: 607-614.

    CAS  Article  PubMed  Google Scholar 

  10. 10.

    Galasko D, Klauber MR, Hofstetter CR: The Mini-Mental State Examination in the early diagnosis of Alzheimer's disease. Archives of Neurology. 1990, 47: 49-52.

    CAS  Article  PubMed  Google Scholar 

  11. 11.

    Inouye SK, Robinson JT, Froehlich TE, Richardson ED: The time and change test: a simple screening test for dementia. Journal of Gerontology. 1998, 53A (4): M281-286.

    Google Scholar 

  12. 12.

    Froehlich TE, Robinson JT, Inouye SK: Screening for dementia in the outpatient setting: the time and change test. Journal of the American Geriatrics Society. 1998, 46 (12): 1506-1511.

    CAS  Article  PubMed  Google Scholar 

  13. 13.

    Mussi C, Foroni M, Valli A, Ascari S, Tolve I, Salvioli G: The "Time and Change" test: An appropriate method to detect cognitive decline in the elderly. Journal of Geriatric Psychiatry and Neurology. 2002, 15: 12-15.

    Article  PubMed  Google Scholar 

  14. 14.

    American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorder. Washington DC. 1994, 4

    Google Scholar 

  15. 15.

    Kang YK, Na DL, Hahn SH: A validity study on the Korean Mini-Mental State Examination (K-MMSE) in dementia patients. Journal of Korean Neurology Association. 1997, 15 (2): 300-307.

    Google Scholar 

  16. 16.

    McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM: Clinical diagnosis of Alzheimer's disease: Report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology. 1984, 34: 939-944.

    CAS  Article  PubMed  Google Scholar 

  17. 17.

    Roman GC, Tatemichi TK, Erkinjuntti T, Cummings JL, Masdeu JC, Garcia JH: Vascular dementia: diagnosis criteria for research studies: Report of the NINDS-AIREN International Workshop. Neurology. 1993, 43: 250-260.

    CAS  Article  PubMed  Google Scholar 

  18. 18.

    Hughes CP, Berg L, Danziger WL, Coben LA, Martin RL: A new clinical scale for the staging of dementia. British Journal of Psychiatry. 1982, 140: 566-572.

    CAS  Article  PubMed  Google Scholar 

  19. 19.

    Kawamoto R: Simple screening test for dementia in elderly persons-the time and change test. Japanese Journal of Public Health. 2000, 47 (6): 486-491.

    CAS  PubMed  Google Scholar 

  20. 20.

    Shulman KI, Pushkar GD, Cohen CA, Zucchero CA: Clock-drawing and dementia in the community: A longitudinal study. International Journal of Geriatric Psychiatry. 1993, 1: 135-140.

    Article  Google Scholar 

  21. 21.

    O'Rourke N, Tuokko H, Hayden S, Beattie BL: Early identification of Dementia: Predictive Validity of the Clock Test. Archi Clin Neuropsychology. 1997, 12 (3): 257-267. 10.1016/S0887-6177(97)80001-7.

    Article  Google Scholar 

Pre-publication history

  1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/4/52/prepub

Download references

Author information

Affiliations

  1. Department of Preventive Medicine, Chonnam National University Medical School, Hak-1-dong, Dong-gu, Gwangju, 501–190, South Korea

    Jung-Ae Rhee & Eun-Kyung Chung

  2. Department of Preventive Medicine, Seonam University College of Medicine, 120–1, Mareuk-dong, Seo-gu, Gwangju, South Korea

    Min-Ho Shin

Authors
  1. Jung-Ae Rhee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eun-Kyung Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Min-Ho Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eun-Kyung Chung.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

JAR conceived of the study, collected data and drafted the manuscript. EKC participated in its design, performed data collection, and reviewed the manuscript. MHS participated in data analysis and reviewed the manuscript. All authors read and approved the final manuscript.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Rhee, J., Chung, E. & Shin, M. Validating the Time and Change test to screen for dementia in elderly Koreans. BMC Public Health 4, 52 (2004). https://doi.org/10.1186/1471-2458-4-52

Download citation

Keywords

  • Dementia
  • Vascular Dementia
  • Educational Status
  • Supplemental Testing
  • Change Task

BMC Public Health

ISSN: 1471-2458

Contact us