CADTH Health Technology Review

At-Home Polysomnography Versus In-Clinic Polysomnography for Sleep Disorders

Rapid Review

Authors: Chantelle C. Lachance, Sharon Bailey

Abbreviations

AHI

apnea-hypopnea index

CPAP

continuous positive airway pressure

EEG

electroencephalogram

ICSD

International Classification of Sleep Disorders

OSA

obstructive sleep apnea

PSG

polysomnography

QUADAS-2

Quality Assessment of Diagnostic Accuracy Studies 2

SF-36

Short Form (36) Health Survey

Research Questions

  1. What is the diagnostic test accuracy of Level 2 Polysomnography for screening or diagnosis of any sleep disorders in adults?

  2. What is the clinical utility of Level 2 Polysomnography for screening or diagnosis of any sleep disorders in adults?

  3. What is the cost-effectiveness of Level 2 Polysomnography for the screening or diagnosis of sleep disorders in adults?

Key Messages

Context and Policy Issues

What Are Sleep Disorders?

A common complaint in the general population is excessive daytime sleepiness.1,2 The International Classification of Sleep Disorders (ICSD) defines excessive daytime sleepiness as the inability to maintain wakefulness and alertness during the major waking episodes of the day, with sleep occurring unintentionally or at inappropriate times almost daily for at least 3 months.3,4 A longitudinal study used the validated Epworth Sleepiness Scale to find that 33% of respondents living in Quebec reported excessive daytime sleepiness.5 Other common complaints related to sleep include snoring and associated events (e.g., gasping, choking), reported by patient and/or bed partner, and morning headaches.6 These clinical presentations can indicate certain sleep disorders or other medical conditions (e.g., heart disease, lung disease, depression).1

Sleep disorders are a group of conditions that disturb normal sleep patterns.1 Sleep disorders among adults are 1 of the most common clinical problems encountered,4 and can affect the quality, timing, and amount of sleep resulting in daytime distress and impairment in functioning.7 For example, survey data from the Canadian Longitudinal Study on Aging (n = 27, 210) suggests that nearly 20% of adults older than 45 years old are at risk of obstructive sleep apnea (OSA) in Canada.8 Certain sleep conditions can also perpetuate adverse outcomes such as mortality, cardiovascular disease, mental and cognitive disorders, accidents, and injuries.9 The ICSD includes 6 categories of sleep disorders with a spectrum of disorders classified within each category:

What Is the Current Practice?

To determine if patients have a sleep disorder, they may be recommended by their health care provider to partake in a sleep study known as polysomnography (PSG).10,11 A Level 1 or type I (attended) PSG is the current gold standard for diagnosing sleep-disordered breathing, such as OSA, and other sleep disorders (i.e., certain central disorders of hypersomnolence, sleep-related movement disorders, and parasomnias) when used in conjunction with patients’ clinical history and other tests.2,4,11 Also, to obtain reimbursement for continuous positive airway pressure (CPAP) devices, the typical treatment for OSA, a Level I PSG is currently required for patients living in certain locations within Canada, including Ontario.12,13 A Level 1 PSG occurs in a registered sleep laboratory, within a hospital or specialized sleep clinic, under the supervision of trained health care staff to continuously monitor several physiologic signals during sleep:

When a patient arrives at the clinic, a sleep technician places the equipment on the patient and monitors them throughout the sleep test in the technologist's control room.10 The test results are later interpreted by a sleep specialist, and a treatment plan is discussed with the patient in a follow-up visit (e.g., no intervention required, CPAP therapy recommended).10 A Level 1 PSG is largely standard practice in Canada, and capacity is limited to the number of dedicated beds within each registered sleep clinic.10,13 However, during the COVID-19 pandemic, in-clinic PSG testing was temporarily paused in Canada to prioritize essential services and surgeries.14 As a result, wait times for in-clinic PSG testing was further exacerbated by the pausing of in-clinic PSG.14,15 The COVID-19 pandemic also illuminated access challenges for patients living in Canada: access to registered sleep clinics varies greatly depending on location (rural and/or remote versus urban settings) as well as other factors (e.g., ability to travel, care responsibilities at nighttime).14-16

What Is a Level 2 PSG, and How May It Benefit?

Level 2 or type II PSGs use the same monitoring sensors as full PSG (Level 1) but are unattended, affording the ability to be performed outside of the sleep clinic and in the patient’s home.15,17 Using a Level 2 PSG may be a way to help mitigate the long wait times for those awaiting a Level 1 PSG but also improve patient access to care.14,16 Studies of Level 3 and 4 PSG devices, home devices that mainly screen for OSA and do not include EEG monitoring, suggest that they are associated with faster diagnoses and treatment times and could be cost-effective; it is unclear if Level 2 PSG devices may result in similar outcomes if patients can be tested from the comfort of their home without a sleep technician present during the test.2 Before Level 2 PSG devices are used throughout Canada, it is important to understand their accuracy, clinical utility, and cost-effectiveness.

Objective

To support the decision-making about Level 2 PSG for screening and diagnosis of any sleep disorders, we prepared this Rapid Review to summarize and critically appraise the studies available on the diagnostic accuracy, clinical utility, and cost-effectiveness of Level 2 PSG in adults.

Methods

Literature Search Methods

An information specialist conducted a literature search on key resources, including MEDLINE, Embase, the Cochrane Database of Systematic Reviews, the International HTA Database, the websites of Canadian and major international health technology agencies, as well as a focused internet search. The search approach was customized to retrieve a limited set of results, balancing comprehensiveness with relevancy. The search strategy comprised controlled vocabulary, such as the National Library of Medicine’s MeSH (Medical Subject Headings), and keywords. Search concepts were developed based on the elements of the research questions and selection criteria. The main search concept was polysomnography. Conference abstracts were excluded. The search was completed on June 13, 2023, and was limited to English-language documents published since January 1, 2018.

Selection Criteria and Methods

One reviewer screened citations and selected studies. In the first level of screening, 1 reviewer screened titles and abstracts and then retrieved potentially relevant articles to assess for inclusion. Table 1 presents the final selection of full-text articles based on the inclusion criteria.

Table 1: Selection Criteria

Criteria

Description

Population

Adult individuals suspected of having any sleep disorders

Intervention/Index test

Level 2 PSG (at-home or unattended)

Reference standard

Q1. Level 1 PSG (in-clinic or attended)

Q2 and Q3. Not applicable

Comparators

Q1. Not applicable

Q2 and Q3. Level 1 PSG (in-clinic or attended) or Level 3 PSG (at-home or unattended)

Outcomes

Q1. Diagnostic test accuracy (e.g., sensitivity, specificity, positive predictive value, negative predictive value)

Q2. Clinical utility (e.g., time to diagnosis, cardiovascular outcomes, new cardiovascular events, cerebrovascular outcomes, mortality, quality of life, motor vehicle accidents)

Q3. Cost-effectiveness (e.g., cost per QALY gained, ICER)

Study designs

Health technology assessments, systematic reviews, randomized controlled trials, nonrandomized studies, economic evaluations

ICER = incremental cost-effectiveness ratio; PSG = polysomnography; QALY = quality-adjusted life-year.

Exclusion Criteria

We excluded articles if they did not meet the selection criteria outlined in Table 1, were duplicate publications, or were published before 2018.

Critical Appraisal of Individual Studies

One reviewer critically appraised the included publications using the following tools as a guide: Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) checklist18 for the diagnostic test accuracy study and the Downs and Black checklist19 for clinical utility study. Summary scores were not calculated for the included studies; rather, the strengths and limitations of each included publication were described narratively.

Summary of Evidence

Quantity of Research Available

Appendix 1 presents the study selection details. We identified 1 crossover study20 that addressed the diagnostic test accuracy of Level 2 PSG (research question 1) and 1 observational study21 that examined the clinical utility of Level 2 PSG (research question 2). We did not identify any relevant health technology assessments or randomized controlled trials. Further, we did not identify any relevant economic evaluations regarding Level 2 PSG for screening or diagnosing adult sleep disorders. Appendix 5 provides additional references of potential interest that did not meet the inclusion criteria.

Summary of Study Characteristics

Appendix 2 provides detailed characteristics of included publications.

Included Study for Question 1: Diagnostic Test Accuracy

We included 1 crossover study20 that examined the diagnostic test accuracy of Level 2 PSG for the diagnosis of OSA. This 2018 study was conducted in Brazil. The study authors used a single-gate approach with 1 set of eligibility criteria (i.e., 1 group of participants with suspected OSA according to the study protocol) for admission. The study authors considered a clinical diagnosis of OSA was possible when the patient had at least 1 of the following symptoms: witnessed apneas; snoring; snoring associated with excessive daytime sleepiness; or snoring and daytime tiredness. The index test was a home monitoring sleep test using Level 2 PSG: Embletta X100 system (Embla, Natus Inc., Middleton, US) whereby the PSG technician went to the participant’s home to hook up and later disassemble the equipment (i.e., the test itself was unattended). The reference standard was an in-clinic sleep test, reported by the author as the “gold standard,” (p. 119) using the same equipment (i.e., Embletta X100 system) conducted in the standard way tests are performed in the clinic.20 The adult participants from 1 study site were consecutively included and randomly assigned to 1 of 2 groups according to the test sequence. Group 1 (n = 20) had the at-home PSG first, followed by a second, in-clinic PSG. Group 2 (n = 20) had the in-clinic PSG first, followed by a second, at-home PSG. The second PSG always happened on the night after the first PSG. The relevant outcomes for this review were sensitivity, specificity, positive predictive value, and negative predictive value in relation to the apnea-hypopnea index (AHI, used for determining the presence and severity of OSA).20

Included Study for Question 2: Clinical Utility

We included 1 observational study21 that examined the clinical utility of Level 2 PSG for diagnosing OSA. This 2022 study included 225 participants living in Portugal with OSA, whereby a diagnosis was made using PSG. The study compared patients that received a Level 2 ambulatory, at-home PSG (intervention, n = 114) with patients that received a Level 1 attended, in-clinic PSG (comparator, n = 111) for their diagnosis of OSA. The study included a retrospective cohort component (for collecting general demographic data, for example) and a prospective, cross-sectional component to evaluate key outcomes using a patient questionnaire. The relevant outcomes for this review were quality of life, daytime sleepiness, hypertension, and treatment adherence (hours per night, percentage of days using CPAP). The follow-up period was not clearly defined or reported.21

Summary of Critical Appraisal

Appendix 3 presents additional details regarding the strengths and limitations of included publications.

Diagnostic Test Accuracy Study

Zancanella and colleagues (2021)20 recruited participants using a convenience sample and randomly assigned them into 2 groups, according to the test sequence. The study authors avoided a case-control study design (i.e., all participants had a clinical diagnosis of OSA according to the study protocol). The authors did not include all participants in the analysis; it is unclear if it was appropriate to exclude 6 participants that had lost EEG sensors during home monitoring (e.g., should a participant’s loss of EEG sensors be a data point for interpretation instead of criteria for exclusion?), which may also be a concern for its applicability. By excluding these participants, the estimates of diagnostic accuracy may also be overoptimistic and could have introduced bias. The study population, index test, and reference standard seem to match those targeted by the review questions. The study authors described their methods to conduct and interpret the index test and reference standard. All participants received the same index test and reference standard and the timing between tests was within 1 day of each other, ensuring the patients’ clinical condition would not have changed between tests. It is unclear whether the authors interpreted the index test and reference standard results without knowing the opposing test results. The study authors did not report measures of uncertainty. Zancanella and colleagues declared that they have no conflicts of interest, including “no significant financial support for this work that could have influenced its outcome” (p. 121).20 The authors did not report any additional context leaving it unclear what significant means (e.g., no funding versus a specific monetary value) and if it had the potential to introduce any reporting bias.20

Clinical Utility Study

The study by Andrade and Paiva (2018)21 clearly reported the objectives, main outcomes, participant inclusion criteria, participant characteristics, interventions, findings, estimates of random variability, and actual P values. The authors recruited study participants from the same population over the same time, but they did not report any potential confounders (nor describe any adjustment of potential confounding factors such as OSA severity and pre-existing health conditions [e.g., cardiovascular and pulmonary disease]). The authors did not report any details about characteristics of participants lost to follow-up or adverse events. For example, they did not describe why the quality-of-life outcome had data from 148 participants when they included 225 participants overall. When considering external validity, the setting appeared representative of that in the population; though, it was unclear if the population invited and/or agreed to participate is representative of the entire population. When considering bias, there was no apparent data dredging, the statistical tests appeared appropriate, and authors clearly described the outcome measures. Because the study design was retrospective, the investigators were not able to blind participants or clinicians to exposures. It is unclear if study authors blinded exposures to the investigator(s) that analyzed the data. The authors did not clearly define or report the allowable length of time between when a patient had the PSG and when their outcome data were collected (e.g., 2 months versus 3 years). Moreover, the authors did not describe how they adjusted for losses of participants to follow-up for key outcomes. The authors did not state whether they conducted any power calculations, so it is unknown if the study had the appropriate number of patients required to avoid a type II error (e.g., accept the null hypothesis incorrectly and report that there is no difference between the 2 groups).22 Andrade and Paiva (2018)21 reported no conflicts of interest.

Summary of Findings

Appendix 4 presents the main study findings.

Diagnostic Accuracy of Level 2 PSG

We identified 1 study20 that examined the diagnostic test accuracy of Level 2 PSG for apneas and hypopneas using the AHI. When using “AHI <15>” (p. 120, interpreted as 15 events per hour, representing moderate OSA), the Level 2 (at-home) PSG, compared to the Level 1 (in-clinic) PSG, had:

This suggests that Level 2 PSG tests have moderate sensitivity to detect OSA. This means that, out of every 100 people with OSA, Level 2 PSG will:

This also suggests that Level 2 PSG tests have moderate specificity in detecting those who do not have OSA. This means that, out of every 100 individuals who do not have OSA:

Clinical Utility of Level 2 PSG

We identified 1 study21 that examined the clinical utility of Level 2 PSG and provided results for the following outcomes: (i) quality of life; (ii) daytime sleepiness; (iii) hypertension; and (iv) treatment adherence.

Quality of Life

After OSA diagnosis and noninvasive ventilation treatment, the study authors compared mean scores for each specific scale of the Short Form (36) Health Survey (SF-36) between groups (i.e., Level 2 PSG versus Level 1 PSG). There were no statistically significant differences in mean scores between groups for 7 of the 8 scales of the SF-36, but there was a statistically significant increase in the Role-Physical scale for the Level 2 PSG group (P = 0.042).21 However, whether these differences are clinically important is unknown, as the Minimal Clinically Important Difference was not reported for this scale.

Daytime Sleepiness

This study compared Epworth Sleepiness Scale scores, a validated scale to measure excessive daytime sleepiness in adults between groups, and found no statistically significant differences between the Level 2 PSG group and the Level 1 PSG group (P = 0.111).21

Hypertension

This study compared hypertension between groups and found no statistically significant differences between the Level 2 PSG group and the Level 1 PSG group (P = 0.721).21

Treatment Adherence

The study compared treatment adherence between Level 2 and Level 1 PSG groups. Overall, 88.8% of patients used CPAP for more than 4 hours on more than 70% of nights, with no statistically significant differences in adherence between groups (P = 0.915).21 There were also no statistically significant differences between the Level 2 group and Level 1 PSG group in mean hours of CPAP use per night (P = 0.884) and in percentage of days of CPAP use (P = 0.193). The study authors concluded that overall CPAP use in both groups was “considered within clinically efficient limits” (p. 1327); however, this was not described further.21

Cost-Effectiveness of Level 2 PSG

We did not identify any relevant evidence regarding the cost-effectiveness of Level 2 PSG for the screening or diagnosis of sleep disorders in adults; therefore, no summary can be provided.

Limitations

Overall Completeness of the Evidence

The findings in this review are limited by the quantity of relevant evidence we identified. For all research questions, no HTA, systematic reviews, or randomized controlled trials met the inclusion criteria for this review.

We did not find any evidence on the following; therefore, no conclusions can be formed on these aspects of the research questions:

Notwithstanding, we found little evidence about the diagnostic test accuracy (1 study) and clinical utility (1 study) of Level 2 PSG for screening and diagnosis of OSA. It is unclear whether the lack of evidence is from the true paucity of available evidence regarding Level 2 PSGs versus a limitation of the rapid methodology used for this review (i.e., a limited literature search from the past 5 years). However, this methodological approach balances comprehensiveness with timeliness. Furthermore, when screening the literature for this review, we did see more literature regarding Level 3 and 4 PSG devices, suggesting that the literature search strategy was likely sufficient to capture recent, relevant evidence about at-home PSG devices.

Generalizability of the Findings

The included studies were conducted in Brazil and Portugal and some of the devices used (e.g., Domino by SOMNOmedics) do not have active license listings in Canada;23 therefore, it is unclear whether the results summarized in this review are generalizable to the health care context in Canada.

These limitations warrants taking caution when interpreting the findings of this review.

Conclusions and Implications for Decision- or Policy-Making

This review identified and summarized the evidence available on the diagnostic test accuracy (1 crossover study)20 and clinical utility (1 observational study)21 of Level 2 PSG for screening or diagnosing sleep disorders in adults.

The limited evidence on diagnostic test accuracy from 1 study20 focused on the accuracy of Level 2 PSG for diagnosing OSA. Comparing Level 2 PSG with Level 1 PSG, the authors reported 80% sensitivity, 83% specificity, 91% positive predictive value, and 67% negative predictive value. These findings suggest moderate sensitivity to detect OSA and moderate specificity to detect those who do not have OSA. Though, the study authors did not provide context about whether moderate accuracy is acceptable in the field of sleep medicine.20

The limited evidence on the clinical utility of Level 2 PSG from 1 study21 focused on a few relevant outcomes that are downstream of testing and diagnosis of OSA, after resulting treatment, including quality of life, daytime sleepiness, hypertension, and treatment adherence. The authors did not report significant differences in daytime sleepiness, hypertension, treatment adherence, and most quality of life measures for patients with OSA who were diagnosed with a Level 2 PSG compared with a Level 1 PSG.21 These findings suggest that patients may have similar clinical outcomes with an in-home PSG versus an in-clinic PSG, which may be an important implication for policy or decision-making if future studies support these clinical findings and observe Level 2 PSGs to be cost-effective or preferred by patients. However, this study had certain limitations to consider when interpreting the overall findings: study authors did not describe or adjust for any confounding factors (e.g., OSA severity), which may have introduced bias (i.e., internal validity); and the study authors excluded 6 participants after having a Level 2 PSG because EEG sensors fell off during the study. If a PSG fails in the real-world setting, it is presumed that the patient would have to retake the test either at home again or in a sleep clinic. Further research could be explored to determine if these situations would result in a slower time to diagnosis or a reduction of quality-of-life outcomes.

Overall, we found few studies20,21 addressing our research questions that met our inclusion criteria. Both included studies focused on patients with OSA,20,21 and we did not find any studies that examined other sleep disorders. We also did not identify any relevant studies addressing the cost-effectiveness of screening or diagnosis of sleep disorders in adults. Though not eligible for this report, 1 study used a theoretical economic decision model to explore Level 2 PSGs within the British Columbia context.15 This study found that Level 2 studies may provide substantial cost advantages versus in-clinic PSGs, but the study authors stated that further empirical studies need to be conducted to test their algorithms.15 Further, decision-makers may wish to consider whether Level 2 PSG impacts other important clinical utility outcomes, including time to diagnosis, direct cardiovascular and cerebrovascular outcomes, mortality, and motor vehicle accidents. We require research focused on sleep disorders other than OSA and the cost-effectiveness of Level 2 PSG.

In conclusion, while limited evidence suggests that Level 2 PSG may be moderately accurate for diagnosing OSA and may not lead to different clinical outcomes for patients compared with Level 1 PSG, we require more comprehensive research with rigorous methodological approaches to understand this topic better.

References

1.National Cancer Institute. Sleep disorder. 2023; https://www.cancer.gov/publications/dictionaries/cancer-terms/def/sleep-disorder. Accessed 2023 Jul 11.

2.Rosenberg R, Hirshkowitz M, Rapoport DM, Kryger M. The role of home sleep testing for evaluation of patients with excessive daytime sleepiness: Focus on obstructive sleep apnea and narcolepsy. Sleep Med. 2019;56:80-89. PubMed

3.American Academy of Sleep Medicine. International Classification of Sleep Disorders, 3rd ed. Darien (IL): American Academy of Sleep Medicine; 2014.

4.Karna B, Sankari A, Tatikonda G. Sleep Disorder. Treasure Island (FL): StatPearls Publishing; 2023: https://www.ncbi.nlm.nih.gov/books/NBK560720/.

5.Jaussent I, Morin CM, Ivers H, Dauvilliers Y. Incidence, worsening and risk factors of daytime sleepiness in a population-based 5-year longitudinal study. Sci Rep. 2017;7(1):1372. PubMed

6.Gottlieb DJ, Punjabi NM. Diagnosis and management of obstructive sleep apnea: A review. JAMA. 2020;323(14):1389-1400. PubMed

7.American Psychiatric Association. What are sleep disorders? 2020; https://www.psychiatry.org/patients-families/sleep-disorders/what-are-sleep-disorders. Accessed 2023 Jul 11.

8.Thompson C, Legault J, Moullec G, et al. A portrait of obstructive sleep apnea risk factors in 27,210 middle-aged and older adults in the Canadian Longitudinal Study on Aging. Sci Rep. 2022;12(1):5127. PubMed

9.Extent and health consequences of chronic sleep loss and sleep disorders. In: Colten HR, Altevogt BM, eds. Sleep Disorders and Sleep Deprivation: An Unmet Public Health Problem. Washington (DC): Institute of Medicine of the National Academies; 2006: https://www.ncbi.nlm.nih.gov/books/NBK19961/.

10.BC Ministry of Health. Diagnostic sleep medicine review. Vancouver (BC): Province of British Columbia; 2020: https://www2.gov.bc.ca/assets/gov/health/practitioner-pro/medical-services-plan/diagnostic-facilities/diagnostic-sleep-medicine-report.pdf. Accessed 2023 Jul 12.

11.Fleetham J, Ayas N, Bradley D, et al. Canadian Thoracic Society guidelines: Diagnosis and treatment of sleep disordered breathing in adults. Can Respir J. 2006;13(7):387-392. PubMed

12.Ontario Ministry of Health. Respiratory equipment and supplies. 2023; https://www.ontario.ca/page/respiratory-equipment-and-supplies. Accessed 2023 Jul 12.

13.Ontario Ministry of Health. Application for funding - respiratory equipment & supplies. 2023; https://forms.mgcs.gov.on.ca/en/dataset/014-4793-67. Accessed 2023 Jul 12.

14.Tran NT, Tran HN, Mai AT. A wearable device for at-home obstructive sleep apnea assessment: State-of-the-art and research challenges. Front Neurol. 2023;14:1123227. PubMed

15.Ayas NT, Jen R, Baumann B. Revisiting level II sleep studies in the era of COVID-19: a theoretical economic decision model in patients with suspected obstructive sleep apnea. Sleep Sci Pract. 2021;5(1):11. PubMed

16.Flemons WW, Douglas NJ, Kuna ST, Rodenstein DO, Wheatley J. Access to diagnosis and treatment of patients with suspected sleep apnea. Am J Respir Crit Care Med. 2004;169(6):668-672. PubMed

17.Kapur VK, Auckley DH, Chowdhuri S, et al. Clinical practice guideline for diagnostic testing for adult obstructive sleep apnea: An American Academy of Sleep Medicine clinical practice guideline. J Clin Sleep Med. 2017;13(3):479-504. PubMed

18.Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-536. PubMed

19.Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377-384. PubMed

20.Zancanella E, do Prado LF, de Carvalho LB, Machado Junior AJ, Crespo AN, do Prado GF. Home sleep apnea testing: an accuracy study. Sleep Breath. 2022;26(1):117-123. PubMed

21.Andrade L, Paiva T. Ambulatory versus laboratory polysomnography in obstructive sleep apnea: Comparative assessment of quality, clinical efficacy, treatment compliance, and quality of life. J Clin Sleep Med. 2018;14(8):1323-1331. PubMed

22.Jones SR, Carley S, Harrison M. An introduction to power and sample size estimation. Emerg Med J. 2003;20(5):453-458. PubMed

23.Health Canada. Medical Devices Active Licence Listing (MDALL). 2023; https://health-products.canada.ca/mdall-limh/. Accessed 2023 Jul 26.

Appendix 1: Selection of Included Studies

Figure 1: Selection of Included Studies

We identified 557 citations from the electronic literature search. We excluded 531 citations and retrieved 26 electronic literature potentially relevant full-text reports for scrutiny. In total we included 2 reports in the review.

Appendix 2: Characteristics of Included Publications

Note that this appendix has not been copy-edited.

Table 2: Characteristics of Included Diagnostic Test Accuracy Study

Study citation, country, funding source

Study design, target condition(s)

Population characteristics

Index test and reference standard

Outcomes

Zancanella et al. (2022)20

Brazil

Funding source: NR

Study design:

Crossover study

Target condition: OSA

Adult participants with a clinical diagnosis of OSA (according to the study protocol) from 1 site consecutively included and randomly assigned to 1 of 2 groups according to test sequence.

Group 1: At-home PSG then in-clinic PSGa

Group 2: In-clinic PSG then at-home PSGa

34 adult participants who never had a PSG, were not pregnant or taking medication with proven interference with sleep phases and/or other PSG parameters:

Group 1: 14 participants (64% male, 36% female, mean age = 39.9 ± 8.9 years).

Group 2: 20 participants (75% male, 25% female, 40.2 ± 9.0 years).

Index Test: Level 2 PSG (i.e., at-home sleep study) using Embletta X100 system (Embla, Natus Inc., Middleton, Wisconsin, US).

Reference Standard: Level 1 PSG (i.e., in-clinic sleep study) reported by author as the “gold standard” (p. 119) using Embletta X100 system (Embla, Natus Inc., Middleton, Wisconsin, US).

Sensitivity, specificity, positive predictive value, negative predictive value

NR = not reported; OSA = obstructive sleep apnea; PSG = polysomnography.

aThe second PSG always happened on the night after the first PSG.

Table 3: Characteristics of Included Primary Clinical Utility Study

Study citation, country, funding source

Study design

Population characteristics

Intervention and comparator(s)

Clinical outcomes, length of follow-up

Andrade and Paiva (2018)21

Portugal

Funding source: NR

Observational study with a retrospective cohort component and a prospective, cross-sectional component.

225 adult participants with an OSA diagnosis via PSG.

Intervention: Level 2 ambulatory PSG (i.e., at-home sleep study) using Domino (SOMNOmedics GmbH, Randersacker, Germany) or Embla 7000 (Embla Systems, Inc., Broomfield, Colorado, US).

Comparator: Level 1 attended PSG (i.e., in-clinic sleep study) using Alice 5 (Philips Respironics, Murrysville, Pennsylvania, US), Domino (SOMNOmedics GmbH, Randersacker, Germany), Embla 7000 (Embla Systems, Inc., Broomfield, Colorado, US) or Nicolet (Vyassis Health care, San Diego, California, US).

Outcomes: quality of life, daytime sleepiness (ESS score), hypertension, treatment adherence (hours per night, percentage of days)

Follow-up: undefined

ESS = Epworth Sleepiness Scale; NR = not reported; OSA = obstructive sleep apnea; PSG = polysomnography.

Appendix 3: Critical Appraisal of Included Publications

Table 4: Strengths and Limitations of Diagnostic Test Accuracy Study Using the QUADAS-2 Checklist18

Strengths

Limitations

Zancanella et al. (2022)20

Participant selection

  • Participants recruited using a convenience sample and randomly assigned into 2 groups according to test sequence.

  • Case-control study design avoided (i.e., all participants had a clinical diagnosis of OSA according to the study protocol).

Index test and reference standard

  • The study population, index test, and reference standard seem to match those targeted by the review questions.

  • Methods to conduct and interpret the index test and reference standard well described.

  • All participants received the same index test and reference standard.

Flow and timing

  • The second PSG always happened on the night after the first PSG.

Participant selection

  • It is unclear if it was appropriate to exclude the 6 participants that had a loss of EEG sensors during home monitoring. By excluding these participants, the estimates of diagnostic accuracy may be overoptimistic and may have introduced bias.

Index test and reference standard

  • It is unclear whether study authors interpreted the index test and reference standard results without knowledge of the opposing test results.

  • It is not clear if study authors should have considered the participant’s loss of EEG sensors a data point for interpretation vs. criteria for exclusion.

Flow and timing

  • Not all participants included in the analysis.

EEG = electroencephalogram; NA = not applicable; OSA = obstructive sleep apnea; PSG = polysomnography; QUADAS-2 = Quality Assessment of Diagnostic Accuracy Studies 2.

Note that this appendix has not been copy-edited.

Table 5: Strengths and Limitations of Clinical Utility Study Using the Downs and Black Checklist19

Strengths

Limitations

Andrade and Paiva (2018)21

Reporting

  • Objectives, main outcomes, participant inclusion criteria, participant characteristics, interventions, findings, estimates of random variability, and actual P values all clearly reported.

External validity

  • Setting appeared to be representative of that in the population.

Internal validity (bias)

  • No data dredging (i.e., unreported/post hoc analyses) apparent.

  • Statistical tests appear appropriate.

  • Outcome measures clearly described.

Internal validity (confounding)

  • Study participants recruited from the same population over the same time.

Power

  • NA

Reporting

  • Potential confounders not reported.

  • Adverse events and characteristics of participants lost to follow-up not reported.

External validity

  • Population invited/agreed to participate may not be representative of the entire population.

Internal validity (bias)

  • Study participants and clinicians not blinded to exposures.

  • Unclear if investigators blinded to exposures.

Internal validity (confounding)

  • Adjustment for potential confounders not reported.

  • Unclear how authors adjusted for losses of participants to follow-up for key outcomes.

Power

  • No acknowledgement of power calculations reported.

NA = not applicable.

Note that this appendix has not been copy-edited.

Appendix 4: Main Study Findings

Note that this appendix has not been copy-edited.

Table 6: Summary of Findings by Outcome — Diagnostic Test Accuracy for Apneas and Hypopneas (AHI) Detection

Study citation

Index test

Reference standard

Number of participants

Sensitivity (95% CI)

Specificity (95% CI)

PPV (95% CI)

NPV

(95% CI)

Zancanella et al. (2022)20

At-home PSG (Level 2)

In-clinic PSG (Level 1)

34

0.8 (NR)

0.83 (NR)

0.91 (NR)

0.67 (NR)

AHI = Apnea-Hypopnea Index; CI = confidence interval; NPV = negative predictive value; OSA = obstructive sleep apnea; PPV = positive predictive value; PSG = polysomnography.

Table 7: Summary of Findings by Outcome — Clinical Utility of Level 2 PSG

Study citation

Outcome

Intervention: Level 2 PSG

Control: Level 1 PSG

P value

Andrade and Paiva (2018)21

QoL (SF-36 survey): Physical Functioning, mean (SD)

85.7 (18.9)a n = 90

83.6 (17.7)a n = 93

0.204

QoL (SF-36 survey): Role-Physical, mean (SD)

84.3 (29.8)a n = 90

83.6 (25.8)a n = 93

0.042

QoL (SF-36 survey): Bodily Pain, mean (SD)

74.9 (27.8)a n = 90

71.3 (29.4)a n = 93

0.414

QoL (SF-36 survey): General Health, mean (SD)

65.8 (19.3)a n = 90

65.3 (21.6)a n = 93

0.780

QoL (SF-36 survey): Vitality, mean (SD)

66.3 (24.1)a n = 90

65.9 (24.3)a n = 93

0.943

QoL (SF-36 survey): Social Functioning, mean (SD)

87.6 (22.3)a n = 90

85.9 (22.2)a n = 93

0.694

QoL (SF-36 survey): Role - Emotional, mean (SD)

86.6 (26.5)a n = 90

83.1 (28.4)a n = 93

0.235

QoL (SF-36 survey): Mental Health, mean (SD)

75.4 (20.2)a n = 90

75.3 (22.7)a n = 93

0.687

Daytime sleepiness: ESS score

NR n = 110

NR n = 100

0.111

Hypertension

NR

NR

0.721

Treatment adherence

NR

NR

0.915

Hours per night of CPAP use, mean (SD)

5.8 (1.4) n = 93

5.6 (1.3) n = 89

0.884

Percentage of days of CPAP use, mean (SD)

79% (25.4%) n = 93

77.6% (25.3%) n = 89

0.193

CPAP = continuous positive airway pressure; ESS = Epworth Sleepiness Scale; OSA = obstructive sleep apnea; PSG = polysomnography; QoL = quality of life; SF-36 = Short Form (36) Health Survey.

aMean score reported by participants after OSA diagnosis and noninvasive ventilation treatment.

Appendix 5: References of Potential Interest

Previous CADTH Reports

Interventions for the treatment of obstructive sleep apnea in adults: A health technology assessment. (CADTH optimal use report vol.6, no.1b). Ottawa (ON): CADTH; 2017: https://www.cadth.ca/interventions-treatment-obstructive-sleep-apnea-adults-health-technology-assessment

Methods to diagnose obstructive sleep apnea. (CADTH Rapid response report: summary of abstracts). Ottawa (ON): CADTH; 2016: https://www.cadth.ca/sites/default/files/pdf/htis/july-2016/RB0998%20Methods%20to%20Diagnose%20OSA%20Final.pdf

Channels for the diagnosis of obstructive sleep apnea: Validity, diagnostic accuracy, and guidelines. (CADTH Rapid response report: summary of abstracts). Ottawa (ON): CADTH; 2015: https://www.cadth.ca/sites/default/files/pdf/htis/aug-2015/RB0901%20Portable%20Testing%20for%20Obstructive%20Sleep%20Apnea%20Final.pdf

Diagnosis of snoring and obstructive sleep apnea: A review of the accuracy. Ottawa (ON): CADTH; 2009: https://www.cadth.ca/sites/default/files/pdf/L0092_Diagnosis_Snoring_Obstructive_Sleep_Apnea.pdf

Portable monitoring devices for diagnosis of obstructive sleep apnea at home: Review of accuracy, cost-effectiveness, guidelines, and coverage in Canada. Ottawa (ON): CADTH; 2009: https://www.cadth.ca/portable-monitoring-devices-diagnosis-obstructive-sleep-apnea-home-review-accuracy-cost

Level 2 PSG for Sleep Bruxism

Abe Y, Nakazato Y, Takaba M, Kawana F, Baba K, Kato T. Diagnostic accuracy of ambulatory polysomnography with electroencephalogram for detection of sleep bruxism-related masticatory muscle activity. J Clin Sleep Med. 2023;19(2):379-392. PubMed