CADTH Health Technology Review

eConsult for Provider-to-Provider Consultation

Technology Review

Authors: Kwakye Peprah, Melissa Walter

Abbreviations

eConsult

electronic consultation

PCP

primary care provide

PHI

protected health information

EMR

electronic medical records

Key Messages

Research Questions

  1. What ethical and professional considerations should be accounted for in the collection, use, and disclosure of protected health information (PHI) in an electric consultation (eConsult) framework?

  2. What are the necessary cost considerations to ensure the sustainability of an eConsult program?

  3. What are the strengths and limitations of eConsult as a standalone platform relative to one that is integrated within an electronic medical records (EMR) system?

  4. What considerations are required for the successful integration of eConsult models into clinical workflows?

Background

The mismatch between supply and demand for specialty services presents a barrier to access to specialty care, especially for rural or urban populations considered to be at a disadvantage.1 Challenges include making and attending appointments, prolonged wait times, transportation difficulties, and burden to patients from additional visits.1 According to a 2018 publication, Canada placed last among 11 participating countries in a Commonwealth Fund survey that assessed patient access to care.2 Since 2010, 56% of patients in Canada wait at least 4 weeks to see a specialist, compared with an average 36% for the Commonwealth Fund.3 Poor access to care — which includes prolonged waiting — can cause anxiety for patients and their families, can increase pain, and can affect a patient’s ability to carry out daily activities, leading to a deterioration in overall quality of health.2,4 Delayed access to care by specialists can result in delayed diagnosis and duplication of services, causing frustration for patients and dissatisfaction among primary care clinicians.2 The use of specialist consultation by primary care providers (PCPs) to seek expert opinions in real time on specific care questions may help improve access; however, it is often hindered by patient and physician scheduling conflicts.1 Therefore, eConsult has emerged as an innovation designed to improve access to specialist care.

eConsult (also called store-and-forward electronic consultation), is an asynchronous approach to telehealth where a PCP can request that a specialist review and offer a recommendation for a clinical inquiry. eConsult, real-time or synchronous telemedicine, and remote patient monitoring form the 3 main types of telemedicine.5 The primary goals of an eConsult system are threefold: to provide short-term diagnostic and therapeutic advice to PCPs and patients when circumstances do not require a face-to-face consultation with the specialist, to prepare patients for in-person visits by arranging for completion of tests in advance, and to provide PCPs and specialists interaction to support chronic disease management.6

Reported benefits of eConsult include increased access to specialty clinics and reduced turnaround time for a consult, enhanced overall quality of care, increased satisfaction to patients and providers, reduced patient travel costs, improved provider productivity, opportunity for PCP education through eConsult exchange, and improved physician-to-physician communication.1-6 However, some barriers to the uptake and scaling up of eConsults have been described; these included absence of a defined appropriate use of eConsults, increased health care expenditures if eConsult does not result in a significant decrease or avoidance of in-person visits, care fragmentation, inadequate communication between clinicians, privacy and security concerns, lack of established business models, and difficulty in billing.1,7,8

The aim of this report is to summarize the evidence about eConsults regarding considerations for (1) the collection, use, and disclosure of PHI, (2) necessary cost to ensure sustainability, (3) strengths and limitations of standalone versus integrated platforms, and (4) factors for successfully integrating eConsult models into clinical workflows.

Methods

Literature Search Methods

An iterative set of targeted literature searches was conducted in April 2020and May 2020 by an information specialist in Medline, as well as a focused internet search. The search strategies were comprised of both controlled vocabulary, such as the National Library of Medicine’s MeSH (Medical Subject Headings), and keywords. The main search concepts were virtual consults, primary care providers, and specialists. These concepts were then combined with either: costs, ethics/privacy, workflows, or electronic health records. The initial searches were limited to English-language documents published between January 1, 2010, and the original search dates. For the current report, database and internet searches were rerun on September 8, 2021, to capture any articles published since the initial search dates.

Selection Criteria and Methods

The study selection was done in 2 phases. In the first level of screening, titles and abstracts were reviewed and potentially relevant full-text articles were retrieved and assessed for inclusion. Two reviewers screened citations and selected studies. The final selection of full-text articles was based on the availability of relevant pieces of information to answer any of the research questions. One reviewer extracted data and summarized relevant information into tables. No critical appraisal was performed. Papers that did not provide a specific answer to any of the research questions were excluded.

Summary of Evidence

Quantity of Research Available

A total of 235 citations were identified in the literature search. Following screening of titles and abstracts, 145 citations were excluded and 90 potentially relevant reports from the electronic search were retrieved for full-text review. Two potentially relevant publications were retrieved from the grey literature search for full-text review. Of these 92 potentially relevant articles, 81 publications were excluded for various reasons, and 11 publications with relevant information to answer any of the research questions were included in this report. These comprised 6 cost evaluation studies and 5 nonrandomized studies with information on considerations for the successful integration of eConsult models into clinical workflows.

Summary of Findings

Q1. What ethical and professional considerations should be accounted for in the collection, use, and disclosure of PHI in an eConsult framework?

No study was identified that provided relevant information regarding the ethical and professional considerations for the collection, use, and disclosure of PHI in an eConsult framework; therefore, no summary can be provided.

Q2. What are the necessary cost considerations to ensure the sustainability of an eConsult program?

A summary of the characteristics and conclusions of the 6 studies contributing relevant information about cost considerations to ensure the sustainability of an eConsult program is presented in Table 1.

Table 1: Characteristics of Included Studies With Information on Cost Considerations to Ensure the Sustainability of an eConsult Program

Author (publication year), country

Study design

Referring PCP

Specialty consulted

Outcomes measured

Cost factors considered

Results, authors’ conclusion, summary

Vidal-Alaball et al. (2018)5

Spain

A cost saving analysis comparing teledermatology with face-to-face dermatology visits in the county of Bages in 2016

PCPs (n = NR) form 14 primary care facilities

Dermatologists (n = NR)

The economic

impact of asynchronous telemedicine services compared with the cost of traditional outpatient consultations

  • Equipment

  • Staff cost (e.g., PCP and dermatologists’ rates)

  • Number of dermatology visits

  • Societal (e.g., productivity loss, time spent travelling, cost of fuel to travel)

“The results of this study show that using teledermatology instead of face-to-face dermatology consultations can save 51,164 € per year (11.4 € per patient visited) in the county of Bages. Most savings were societal (40,814 € per year). When removing societal costs, the savings amounted to 10,350 € per year.”5 p.6

Liddy et al. (2017)9

Canada

A cross-sectional study and cost analysis of all eConsult cases submitted from Nunavut through the Champlain BASE eConsult Service between August 2014 and April 2016

15 PCPs (all family physicians) from Nunavut

55 specialists available through the Champlain BASE eConsult Service

Total societal costs and savings associated with the Champlain BASE eConsult Service

Direct costs included:

  • delivery costs (e.g., for supporting and operating the eConsult service)

  • consultation-specific costs (e.g., specialist remuneration for answering eConsults as well as staff time for assigning cases to specific specialists),

  • added referral costs (e.g., costs for eConsults where the PCP was not originally contemplating a referral, but initiated one because of eConsult)

  • patient travel costs (estimated based on the cost of a flight from the PCP’s town in Nunavut to Ottawa and back)

eConsultation services were provided for at least 11 conditions. The most referred to specialties were dermatology (16%), cardiology (8%), endocrinology (7%), otolaryngology (7%), and obstetrics/gynecology (7%).

“We provide evidence that widescale implementation of e-consult in Canada’s north would greatly improve access to specialists, improve the provider experience of care, reduce health system costs and potentially have a tremendous positive impact on quality of patient care beyond access. There is an urgency to move forward with enabling policies, provider engagement, partnerships with government and commitment to implementation.”9 p. 6

Liddy et al. (2016)4

Canada

A costing evaluation of all eConsults in the Champlain health region of Eastern Ontario, Canada, submitted between April a, 2014, and March 31, 2015, from the societal perspective

Referrals originated from PCPs (n = NR) practicing in rural areas

Specialists from 44 different specialty groups

Net potential societal cost savings associated with the Champlain BASE eConsult Service

• Delivery costs

• Specialist remuneration

• Costs associated with face-to-face (traditional) referrals initiated due to of eConsult

Potential savings included:

• costs of traditional referrals avoided

• indirect patient savings through avoided travel and lost wages and productivity

A total of 3,487 eConsults were completed, 40% of which led to avoiding originally contemplated face-to-face specialist visit. eConsult led to a net societal saving of $38,729, or $11 per eConsult.

“Our findings suggest that eConsult services have the potential to lower the costs for the healthcare system and make care more affordable for patients by reducing indirect costs of care. Patient-centred health services should consider incorporating eConsult services into their practices in order to reduce the economic burden of care.”4 p.6

Liddy et al. (2016)10

Canada

Simulated cost implication studies of different remuneration models for specialists’ pay for eConsults in Canada, based on Champlain BASE eConsult data

Not specified

68 specialists from 43 different specialty groups

Specialists’ remuneration in eConsults in Canada, using different models

  • Prorated hourly rate model (e.g., the Champlain BASE eConsult Service uses $200.00 per hour prorated to length of time)

  • Incentive model (i.e., prorated plus bonus for time to complete eConsult: $10.00 and $5.00 for within 24 and 48 hours, respectively)

  • Fee-for-service (Billing code) model (uses flat fee per eConsult, regardless of duration to complete eConsult; e.g., $44.50 for specialist and $16.00 for PCP in Ontario)

  • Flat weekly fee (based on a set total time, or a minimum duration with the option to increase based on volume, blocked for eConsult)

3,670 eConsults (i.e., 97.2% of the total submitted between April 1, 2014, and March 31, 2015) were included in the analyses. The specialist response time – median (IQR) = 0.78 (IQR: 0.153.2) days

Mean (SD) = 2.2 (3.1) days. Most (67.5%) eConsults in the incentive remuneration model were completed within 1 day (56.2%) or 2 days (11.4%).

The average specialist cost per eConsult under the different models were:

  • prorated hourly rate = $45.72

  • incentive model = $51.90

  • fee-for-service = $40.50 ($60.50 overall, adding the accompanying PCP remuneration)

  • flat weekly fee = $337.00 for a set block of 3 hours per week or $133.41using the 1-hour increments method, assuming at least $200 per week.

The findings suggest that the prorated hourly rate model is associated with the lowest average cost per eConsult, whereas the flat weekly fees model has the highest cost per eConsult. Based on specialist remuneration alone, the fee-for-service model led to a lower cost than the prorated hourly rate model; however, the accompanying PCP remuneration makes the overall cost higher. The incentive model had the fastest time to complete eConsults. Thus, where promptness of response is a priority, that model may be a reasonable choice though it raises the expenditure.

“While these results are based on a Canadian healthcare system and the current workflow of the Champlain BASE eConsult, our findings can inform policymakers considering the implementation of an eConsult service, or those wishing to further develop an existing platform. In a different healthcare context where universal healthcare coverage is not offered, other remuneration models beyond the scope of the Champlain BASE eConsult data may be of interest. Future research should explore payment models for eConsult in other healthcare contexts and their impact on quality and outcome.”10 p.8

Liddy et al. (2015)11

Canada

Costing evaluation, with a break-even analysis, of all eConsults in the Champlain health region of Eastern Ontario, Canada, submitted between April 1, 2011, and March 31, 2014, from the payer’s perspective

235 PCPs

27 different specialty groups

Direct and variable costs associated with the Champlain BASE eConsult Service, and the number of eConsults needed for it to break even

Direct costs:

  • Start-up costs (e.g., cost to develop the electronic forms, workflows, and web page design)

Variable costs:

  • Delivery costs (e.g., setup and registration, support, and administration costs)

  • Consultation-specific costs (e.g., payments made to specialists and costs for staff to direct each eConsult to the appropriate specialist)

eConsults were completed for a total of 2,606 cases over the study period. Most frequent eConsults were in dermatology (17.7%), endocrinology (9.9%), neurology (9.1%), hematology (8.6%), obstetrics/gynecology (7.4%), and cardiology (7.3%). eConsults resulted in avoiding originally planned face-to-face specialist visits in 40.3% (n = 1,051) of cases processed.

“We showed a marked decrease in the cost per eConsult over each annual period with a projected break-even point at 7,818 cases. Future research is needed to identify and examine similar outcomes that may lead to cost savings, as well as patient and provider perspectives on eConsult and evaluate the program’s effect on quality-of-care outcomes.”11 p.73

Butler and Yellowlees (2012)12

US

A retrospective cost analysis comparing ATP with STP and traditional in-person psychiatric consultations in the primary care setting

PCPs at a rural community clinic in California

Psychiatrist at a university hospital in California

Fixed and variable costs of providing the psychiatric services using ATP, STP, or traditional psychiatric consultations

Fixed costs:

  • Infrastructure costs (e.g., laptops, video equipment, software, and hardware)

  • Development costs for the web-based consultation software

  • Provider training costs

Variable costs:

  • Labour costs (e.g., for consultation by psychiatrist, PCP, and auxiliary staff)

“The marginal costs of the ATP, STP, and in-person models were $68.18, $107.50, and $96.36, respectively… STP was the most expensive model in terms of both fixed costs and marginal cost. ATP had intermediate fixed costs and the lowest marginal cost. In-person consultations had the lowest fixed costs and intermediate marginal cost. The break-even point between the ATP and in-person models was 249 patient encounters.” p.75

“The results of this study provide early evidence that the ATP consultation model delivers care at lower marginal cost than either STP or traditional in-person consultations from the perspective of the healthcare system. If these data are reproducible, it follows that wider adoption of ATP-like models could lead to less costly delivery of healthcare.”12 p.76

ATP = asynchronous telepsychiatry; BASE eConsult = Building Access to Specialists through eConsultation; IQR = interquartile range; NR = not reported; PCP = primary care provider; SD = standard deviation; STP = synchronous telepsychiatry.

Q3. What are the strengths and limitations of eConsult as a standalone platform relative to one that is integrated within an EMR system?

No study was identified that provided relevant information regarding the strengths and limitations of eConsult as a standalone platform relative to one that is integrated within an EMR system; therefore, no summary can be provided.

Q4. What considerations are required for the successful integration of eConsult models into clinical workflows?

A summary of the characteristics and conclusions of the 6 studies that contribute relevant information about considerations for the successful integration of eConsult models into clinical workflows is presented in Table 2.

Table 2: Characteristics of Included Studies With Information on Considerations for the Successful Integration of eConsult Models into Clinical Workflows

Author (publication year), country

Study design

Referring PCP

Specialty consulted

Outcomes measured

Factors considered or identified

Results, authors’ conclusion, summary

Anderson et al. (2021)13

US

A qualitative study in the VA New England Healthcare System using qualitative content analysis of semi-structured interviews to identify and describe salient categories. The study was conducted from October 2018 to September 2019.

35 PCP from 6 medical centres in a VISN in the US. They included 3 large urban sites and 3 rural sites

38 specialty care providers from all 6 participating VISN sites to represent 3 high-volume medical subspecialties (cardiology, neurology, and pulmonology)

The feasibility and acceptability of implementing the upscaling of decentralized eConsult delivery into a centralized (hub-and-spoke) model on a VISN level

Potential benefits:

  • Expanded access to specialist expertise

  • Increased timeliness of eConsult responses

Potential barriers or concerns:

  • Differences in resource availability and management styles between sites

  • Anticipated disruption to working relationships

  • Lack of incentives for central eConsultants

  • Dedicated staff’s burnout and fatigue

  • Technological challenges

  • Lack of motivation for change

Interviewees acknowledged the following prospect, using the centralized eConsult model:

  • Site with unavailable or understaffed specialists could access need specialties care

  • Benefit specialists in need of advice of other specialists with expertise in niche areas (e.g., neurosurgery, pulmonary hypertension)

  • Potential to capitalize on specialty services across different sites by leveraging access to highly specialized clinical expertise of certain specialists to other facilities beyond their local base

  • Provision of more detailed and efficient responses by reserving time to answer eConsults

Perceived barriers included:

  • Actively drawing on specialists at well-resourced sites to staff the “hub,” whereas the low-resource sites would be the primary beneficiaries

  • Uncertainty about consultants’ knowledge of care processes and resources to implement recommendations at less complex facilities

  • Potential for the model to have an effect on established local relationships between clinicians, and between clinicians and patients, which could impact tone and content of advice or care

  • Potential to undermine the motivation to provide high-quality, detailed eConsult responses to prevent a face-to-face referral to specialist’s service

  • Specialists feared that a centralized eConsult might have a lower threshold to recommend a face-to-face visit, potentially leading to an increase in local clinic volume

  • Concern about risk for burnout or fatigue if the central eConsultants were not provided with sufficient work credit or protected time. Also, a duty to answer eConsults as one’s main or sole clinical responsibility would be monotonous and taxing

“Based on a case study from one of the largest integrated healthcare systems in the United States, our work identifies novel concerns and offers insights for healthcare organizations contemplating a scale-up of their e-consult systems.” “Scaling up e-consults in line with the hub-and-spoke model may help pave the way for a centralized and efficient approach to care delivery, but the success of this transformation will depend on healthcare systems’ ability to evaluate and address barriers to leveraging economies of scale for e-consults.”13 p.2165

Rankine et al. (2021)14

US

An iterative user-centred design and evaluation process for the development of an eConsultation system, with target users from a research network of primary care practices and the Division of Adolescent and Young Adult Medicine of a university medical centre in Pittsburgh

12 general pediatricians

12 adolescent medicine specialists

User feedback on the usefulness and usability of eConsultations for adolescents and young adult patients

The following 4 considerations were proposed for efficiency in usability:

  • Reducing documentation time by avoiding redundancy, minimizing free-text entry, and using drop-down menus

  • Organizational changes to emphasize critical information, including prompting for the specific consult question at the beginning of the templated note

  • Maximizing the use of auto-populated data fields

  • Balancing the recommendations for efficient documentation with the need for adequately detailed information.

The following measures were proposed to reduce potential errors in implementing the proposals:

  • Minimize potential errors in auto-populated data in EHR, by acknowledging the potential for inaccuracies or outdated information in the fields

  • Ensure accurate information for interprofessional communication

  • Maximize clarity of prompts for specific patient and clinical information

  • Maximize clarity of prompts about confidentiality and communication to ensure appropriate confidential documentation within the EHR

“Through an iterative user-centered design process, we identified user perspectives to guide the refinement of an e-consultation system based on general pediatrician and adolescent medicine specialist feedback on usefulness and usability related to the care of AYAs. Qualitative analysis of this feedback revealed both opportunities and risks related to confidentiality, communication, and the use of tailored documentation prompts that should be considered in the development and use of e-consultations with AYAs.”14 p. 1

Ahmed et al. (2020)1

US

A retrospective cohort study using data from primary and specialty care practices at 2 large academic and 2 community hospitals of an integrated health system in Massachusetts

1,096 referring providers in internal medicine, family medicine, medicine pediatrics, primary care, or women's health

121 specialist consulting in 5 specialties — hematology, infectious disease, dermatology, rheumatology, and psychiatry — between October 2017 and November 2018

Appropriateness of eConsult inquiries, characterized as diagnostic, therapeutic, for provider education, or at the request of the patient

The appropriateness of eConsult as assessed by the following 4 criteria (a detailed definition of each is provided in the article):

  • Not answerable by reviewing evidence-based summary sources (i.e., an eConsult asking a question that could be easily answered by referencing a point-of-care resource or clinical guidelines is not considered appropriate)

  • Not merely requesting logistic information (i.e., an eConsult asking only about institutional knowledge or information that does not necessitate input from a physician is not considered appropriate)

  • Having appropriate clinical urgency (i.e., an eConsult asking for evaluation of a condition that needs to be urgently assessed is not considered appropriate)

  • Having appropriate patient complexity (i.e., an eConsult asking for evaluation of a condition that would necessitate in-person assessment by a specialist is not considered appropriate)

A total of 6,512 eligible eConsults were made. Overall, 70.2% of eConsults met all 4 criteria for appropriateness, with the frequency of unmet criteria varying among specialties. Most consultations (73.1% to 87.8%) were answered within 1 day.

“Novel metrics to assess the appropriateness and utility of e-consults provide meaningful insight into practice, provide a rubric for comparison in future studies in additional settings, and suggest areas to improve resource use and patient care.”1 p.640

Costello et al. (2020)15

US

A prospective study performed between November 2016 and September 2017

PCPs (n = NR) from a local clinic providing serves to the underinsured patient population in Phoenix, Arizona, US

Consultant specialist (n = NR) from a tertiary institution providing teledermatology eConsults in Scottsdale, Arizona, US

Satisfaction, confidence, accuracy, and efficiency and efficacy of referrals

Pre-implementation considerations included:

  • Identification of PCPs, establishing technological obstacles

  • Expected volumes, workflows for providers

  • Contingency plans for technological failures

  • Training PCP on their workflow and practice with mock consultations

  • Training allied supportive staff on their workflow, their PCPs’ workflow, and performing mock consultations

Implementation considerations included:

  • Ensuring availability of appropriate data collection and processing devices and software (e.g., Mobile devices with dermoscopic attachments, VPN and PhotoExam application, and HIPAA-compliant and -encrypted Qualtrics standardized templates to transmit all information)

  • Standardized data capture forms for PCP to summarize lesional or rash history

  • Teledermatology consultation,

  • Post-teledermatology consultation primary care plan

  • Face-to-face dermatology consultation, and post-face-to-face provider discussions

“In conclusion, we established a teledermatology network and were able to provide high-quality care to patients with limited access to specialty care by integrating a mobile phone-based application into an existing EHR. We provided care within our community to clinics outside our care network. Teledermatology significantly increased PCP absolute diagnostic and management concordance, as well as significantly increased PCP confidence in diagnosis and management. There was high-provider satisfaction with the service and low in-person referral rates. A similar process can be utilized by other large health care organizations throughout the United States to provide high-quality consultation to clinics with un- and underinsured populations.”15 p.940

Lee et al. (2018)16

US

Qualitative interviews with thematic content analysis to identify main themes and subthemes

40 PCPs from the Los Angeles County Department of Health Services, including 12 internists, 17 family practitioners, and 11 advanced practice clinicians

Not applicable (the study was designed to assess PCP perceptions on eConsults)

  • PCP perceptions of the results of eConsult implementation on clinical workflow and workload

  • Care coordination and access to specialists

  • Clinician and staff relationships with specialists

  • Referral decision-making and comfort with managing a broader array of diagnoses

  • Satisfaction with specialty access

Refer to box in Primary Care Practitioners’ Perceptions of Electronic Consult Systems (nih.gov)16 for proposed questions to guide the implementation of eConsult, including PCP interface design, process design, pre-eConsult processes, post-eConsult processes, implementation planning and messaging, and maintenance feedback

The results showed opposing views on 3 qualitative themes about how PCPs perceived eConsult, as indicated by the following:

  • Quicker access to specialist care for those who need it, and more timely care for patients who did not require a specialist visit (as they no longer need to wait for an appointment to see the specialist). However, some PCPs thought that eConsult was an obstruction that slowed access to care.

  • A shift of specialty care-related duties to the PCP, which some considered as an opportunity for education while others perceived as a burdensome shift of work.

  • Some believed that eConsult dialogue strengthened communication and relationships with the specialist. However, others viewed interactions with specialist as more antagonistic

  • In addition, most PCPs had some frustration with the administrative burden of eConsult and interface issues, including lack of integration between eConsult and electronic health records.

“The implementation of eConsult as a transformative delivery innovation had a range of positive and negative consequences for PCPs’ day-to-day practice. Informed by our analysis, our list of guiding questions (Box) highlights decisions that health systems implementing eConsult must make, either intentionally or by default.”16 p. 10 and 18

AYA = adolescents and young adults; EHR = electronic health records; HIPAA = Health Insurance Portability and Accountability Act; PCP = primary care provider; VISN = Veterans Integrated Service Networks; VPN = virtual private network.

References

1.Ahmed S, Kelly YP, Behera TR, et al. Utility, appropriateness, and content of electronic consultations across medical subspecialties. Ann Intern Med. 2020;172(10):641-647. PubMed

2.Liddy C, Moroz I, Afkham A, Keely E. Sustainability of a primary care-driven eConsult service. Ann Fam Med. 2018;16(2):120-126. PubMed

3.Liddy C, Moroz I, Mihan A, Nawar N, Keely E. A systematic review of asynchronous, provider-to-provider, electronic consultation services to improve access to specialty care available worldwide. Telemed J E Health. 2019;25(3):184-198. PubMed

4.Liddy C, Drosinis P, Deri Armstrong C, McKellips F, Afkham A, Keely E. What are the cost savings associated with providing access to specialist care through the Champlain BASE eConsult service? A costing evaluation. BMJ Open. 2016;6(6):e010920. PubMed

5.Vidal-Alaball J, Garcia Domingo JL, Garcia Cuyas F, et al. A cost savings analysis of asynchronous teledermatology compared to face-to-face dermatology in Catalonia. BMC Health Serv Res. 2018;18(1):650. PubMed

6.Parikh PJ, Mowrey C, Gallimore J, Harrell S, Burke B. Evaluating e-consultation implementations based on use and time-line across various specialties. Int J Med Inf. 2017;108:42-48. PubMed

7.Jariwala NN, Snider CK, Mehta SJ, et al. Prospective implementation of a consultative store-and-forward teledermatology model at a single urban academic health system with real cost data subanalysis. Telemed J E Health. 2021;27(9):989-996. PubMed

8.Carter ZA, Goldman S, Anderson K, et al. Creation of an internal teledermatology store-and-forward system in an existing electronic health record: a pilot study in a safety-net public health and hospital system. JAMA Dermatol. 2017;153(7):644-650. PubMed

9.Liddy C, McKellips F, Armstrong CD, Afkham A, Fraser-Roberts L, Keely E. Improving access to specialists in remote communities: a cross-sectional study and cost analysis of the use of eConsult in Nunavut. Int J Circumpolar Health. 2017;76(1):1323493. PubMed

10.Liddy C, Deri Armstrong C, McKellips F, Drosinis P, Afkham A, Keely E. Choosing a model for eConsult specialist remuneration: factors to consider. Informatics. 2016;3(2):8.

11.Liddy C, Deri Armstrong C, Drosinis P, Mito-Yobo F, Afkham A, Keely E. What are the costs of improving access to specialists through eConsultation? The Champlain BASE experience. Stud Health Technol Inform. 2015;209:67-74. PubMed

12.Butler TN, Yellowlees P. Cost analysis of store-and-forward telepsychiatry as a consultation model for primary care. Telemed J E Health. 2012;18(1):74-77. PubMed

13.Anderson E, Rinne ST, Orlander JD, Cutrona SL, Strymish JL, Vimalananda VG. Electronic consultations and economies of scale: a qualitative study of clinician perspectives on scaling up e-consult delivery. J Am Med Inform Assoc. 2021;28(10):2165-2175. PubMed

14.Rankine J, Yeramosu D, Matheo L, Sequeira GM, Miller E, Ray KN. Optimizing e-Consultations to adolescent medicine specialists: qualitative synthesis of feedback from user-centered design. JMIR Hum Factors. 2021;8(3):e25568. PubMed

15.Costello CM, Cumsky HJL, Maly CJ, et al. Improving access to care through the establishment of a local, teledermatology network. Telemed J E Health. 2020;26(7):935-940. PubMed

16.Lee MS, Ray KN, Mehrotra A, Giboney P, Yee HF, Jr., Barnett ML. Primary care practitioners' perceptions of electronic consult systems: a qualitative analysis. JAMA Intern Med. 2018;178(6):782-789. PubMed