Background
Dementia is an illness in which memory and other thinking skills deteriorate to the point that someone can no longer manage their daily activities without assistance. If the memory and thinking problems are milder, so that independent living is not affected, the condition is described as mild cognitive impairment (MCI). Both conditions usually affect older people. It is considered important that people with dementia or MCI can get an accurate diagnosis at a time and place suitable for them so that they and their families can understand the problem and can access treatment and support. However millions of people with dementia around the world never get a diagnosis. There are many reasons for this, but one may be a lack of accessible diagnostic services, particularly for people in rural areas or those who find it difficult to travel. During the COVID-19 pandemic, many face-to-face services were closed. Telehealth - the use of information and communication technology (ICT) to provide health services at a distance may be a way to increase access to specialist assessment for people with suspected dementia who cannot easily get to clinics. However, it is important to be sure that increased accessibility does not come at the expense of accuracy of diagnosis.
Review question
We asked how accurate telehealth diagnoses of dementia and MCI were compared to diagnoses made when patients attend traditional clinics for a face-to-face assessment.
What we did
We searched databases of medical studies up to 4 November 2020 for studies in which people had two assessments for suspected dementia or MCI: one telehealth assessment and one conventional face-to-face assessment. Both assessments were done by specialists and took place within a month of each other. For the telehealth assessment, all contact between the patient and the diagnosing specialist had to have been done remotely, using ICT, but some of the information needed to make the diagnosis could be collected by other members of the healthcare team who saw the patient in person. We then assessed how closely the results of the telehealth assessments agreed with the face-to-face assessments.
What we found
We included three studies (136 participants) who had suspected dementia. One small study (16 participants) was conducted in veterans' homes in the USA; the other two studies were in community services in Australia. They all used videoconference systems for their telehealth assessments. All three studies aimed to make dementia diagnoses but only one also aimed to diagnose MCI. The quality of the studies was generally good. In two studies, nurses who saw the patients in person played a big role in gathering information used in both assessments, which could bias those studies towards close agreement between the assessments.
The studies found that telehealth assessment correctly identified 80% to 100% of the people who were diagnosed with dementia at face-to-face assessment and also correctly identified 80% to 100% of people who did not have dementia.
Only one study (100 participants) attempted to diagnose MCI. In this study, 71% of participants who had MCI and 73% of participants who did not have MCI were correctly identified using telehealth assessment.
Telehealth assessment in this study correctly identified 97% of the participants who had either MCI or dementia, but correctly identified only 22% of those who did not have either, although again this result was very uncertain because of the very small number of people in this category.
It is important to note that diagnoses of dementia and MCI made by two specialists seeing patients face-to-face will not show 100% agreement. Therefore perfect agreement between telehealth and face-to-face assessments cannot be expected.
What we concluded
From the evidence we found, telehealth assessment for diagnosing dementia seems to have a good level of accuracy when compared to face-to-face assessment, although the small number of studies and participants and differences between the included studies means that there is a lot of uncertainty about this result. Telehealth appeared to be a little less accurate for diagnosing MCI than for diagnosing dementia. Agreement between two face-to-face assessments is also not perfect and we cannot say that disagreements between telehealth and face-to-face diagnoses were any more common.
We found only very few eligible studies with a small number of participants. An important difference between the studies providing data for the analyses was whether the target condition was dementia only (two studies) or dementia and MCI (one study). The data suggest that telehealth assessment may be highly sensitive and specific for the diagnosis of all-cause dementia when assessed against a reference standard of conventional face-to-face assessment, but the estimates are imprecise due to small sample sizes and between-study heterogeneity, and may apply mainly to telehealth models which incorporate a considerable amount of face-to-face contact with healthcare professionals other than the doctor responsible for making the diagnosis. For the diagnosis of MCI by telehealth assessment, best estimates of both sensitivity and specificity were somewhat lower, but were based on a single study. Errors occurred at the cognitively healthy/MCI and the MCI/dementia boundaries. However, there is no evidence that diagnostic disagreements were more frequent than would be expected due to the known variation between clinicians’ opinions when assigning a dementia diagnosis.
Many millions of people living with dementia around the world are not diagnosed, which has a negative impact both on their access to care and treatment and on rational service planning. Telehealth - the use of information and communication technology (ICT) to provide health services at a distance - may be a way to increase access to specialist assessment for people with suspected dementia, especially those living in remote or rural areas. It has also been much used during the COVID-19 pandemic. It is important to know whether diagnoses made using telehealth assessment are as accurate as those made in conventional, face-to-face clinical settings.
Primary objective: to assess the diagnostic accuracy of telehealth assessment for dementia and mild cognitive impairment.
Secondary objectives: to identify the quality and quantity of the relevant research evidence; to identify sources of heterogeneity in the test accuracy data; to identify and synthesise any data on patient or clinician satisfaction, resource use, costs or feasibility of the telehealth assessment models in the included studies.
We searched multiple databases and clinical trial registers on 4 November 2020 for published and 'grey' literature and registered trials. We applied no search filters and no language restrictions. We screened the retrieved citations in duplicate and assessed in duplicate the full texts of papers considered potentially relevant.
We included in the review cross-sectional studies with 10 or more participants who had been referred to a specialist service for assessment of a suspected cognitive disorder. Within a period of one month or less, each participant had to undergo two clinical assessments designed to diagnose dementia or mild cognitive impairment (MCI): a telehealth assessment (the index test) and a conventional face-to-face assessment (the reference standard). The telehealth assessment could be informed by some data collected face-to-face, e.g. by nurses working in primary care, but all contact between the patient and the specialist clinician responsible for synthesising the information and making the diagnosis had to take place remotely using ICT.
Two review authors independently extracted data from included studies. Data extracted covered study design, setting, participants, details of index test and reference standard, and results in the form of numbers of participants given diagnoses of dementia or MCI. Data were also sought on dementia subtype diagnoses and on quantitative measures of patient or clinician satisfaction, resource use, costs and feasibility. We assessed risk of bias and applicability of each included study using QUADAS-2. We entered the results into 2x2 tables in order to calculate the sensitivity and specificity of telehealth assessment for the diagnosis of all-cause dementia, MCI, and any cognitive syndrome (combining dementia and MCI). We presented the results of included studies narratively because there were too few studies to derive summary estimates of sensitivity and specificity.
Three studies with 136 participants were eligible for inclusion. Two studies (20 and 100 participants) took place in community settings in Australia and one study (16 participants) was conducted in veterans' homes in the USA. Participants were referred from primary care with undiagnosed cognitive symptoms or were identified as being at high risk of having dementia on a screening test in the care homes. Dementia and MCI were target conditions in the larger study; the other studies targeted dementia diagnosis only. Only one small study used a 'pure' telehealth model, i.e. not involving any elements of face-to-face assessment.
The studies were generally well-conducted. We considered two studies to be at high risk of incorporation bias because a substantial amount of information collected face-to-face by nurses was used to inform both index test and reference standard assessments. One study was at unclear risk of selection bias.
For the diagnosis of all-cause dementia, sensitivity of telehealth assessment ranged from 0.80 to 1.00 and specificity from 0.80 to 1.00. We considered this to be very low-certainty evidence due to imprecision, inconsistency between studies and risk of bias. For the diagnosis of MCI, data were available from only one study (100 participants) giving a sensitivity of 0.71 (95% CI 0.54 to 0.84) and a specificity of 0.73 (95% CI 0.60 to 0.84). We considered this to be low-certainty evidence due to imprecision and risk of bias. For diagnosis of any cognitive syndrome (dementia or MCI), data from the same study gave a sensitivity of 0.97 (95% CI 0.91 to 0.99) and a specificity of 0.22 (95% CI 0.03 to 0.60). The majority of diagnostic disagreements concerned the distinction between MCI and dementia, occurring approximately equally in either direction. There was also a tendency for patients identified as cognitively healthy at face-to-face assessment to be diagnosed with MCI at telehealth assessment (but numbers were small).
There were insufficient data to make any assessment of the accuracy of dementia subtype diagnosis.
One study provided a small amount of data indicating a good level of clinician and especially patient satisfaction with the telehealth model. There were no data on resource use, costs or feasibility.