Leveraging Information Technology to Hardwire Diagnostic Stewardship
Received Date: Oct 08, 2018 / Accepted Date: Oct 31, 2018 / Published Date: Nov 07, 2018
Objective: This article reports the impact of an electronic educational tool embedded in the electronic medical record on diagnostic stewardship of procalcitonin (PCT)-A biomarker used to differentiate bacterial from viral infection. This tool specifically targets the preanalytic (ordering and collection) phase of the PCT test.
Methods: This retrospective study was conducted at a 401-bed academic medical center from February 2017- February 2018. The preintervention phase extended from February 2017-July 2017; intervention phase from August 2017- September 2017 and postintervention phase from October 2017-February 2018.
Results: A total of 567 PCT orders were evaluated. There was an overall reduction in total PCT orders and an improvement in appropriate PCT orders. Total PCT orders reduced by 54.4% (P<0.001). Appropriate ordering for PCT improved by 33.4% (P<0.001).
Conclusion: Our results further support the use of information technology to hardwire diagnostic stewardship, an important strategy to improve resource utilization and patient care.
Keywords: Diagnostic stewardship; Procalcitonin; Information technology; Electronic educational tool
Diagnostic stewardship is defined as a systematic process that encourages optimal utilization of diagnostics. The primary goal of diagnostic stewardship is to facilitate clinical decisions to improve patient care. Principles of diagnostic stewardship are applicable to all three phases of laboratory procedures-preanalytic (ordering and collection), analytic (processing) and postanalytic (reporting) . Under the Hospital Outpatient Quality Reporting Program, one-third of the measures monitor appropriate utilization of diagnostic tests. Performance on these measures directly influence financial reimbursement and the hospital star rating by Centre of Medicare and Medicaid services .
Diagnostic stewardship has immense potential to improve patient care. Overuse of tests will increase false positives that have a downstream domino effect on treatment decisions and can be associated with patient morbidity. Conversely, underuse of tests can adversely impact patient care by misdiagnosis or a delay in diagnosis.
The Institute of Medicine has emphasized a key role of computer systems to improve patient care. Computerized systems also play an important role in diagnostic pathology [3,4]. Accordingly, strategies deployed for diagnostic stewardship often rely on information technology (IT) for a broad impact. Computerized ordering is effective in reducing medication errors. Electronic order sets are useful in management of clinical conditions like bacteremia and in fostering antimicrobial stewardship [5-7]. Automated alerts have been used to encourage diagnostic stewardship for an accurate diagnosis of Clostridium difficile infection (CDI) .
We sought to study the impact of an electronic educational tool (EET) on the preanalytic phase of a biological marker-Procalcitonin (PCT). PCT is a biomarker that can help to differentiate bacterial from viral infections when used in conjunction with clinical judgement. PCT also correlates with resolution of bacterial infection [9-12]. PCT level rises within six hours of onset of a bacterial infection and declines with the control of infection .
Evidence from studies conducted in controlled settings has shown PCT to be useful in early discontinuation of antimicrobials without an increase in mortality . In a controlled setting, a study protocol is followed that ensures optimal selection of subjects and appropriate serial monitoring of PCT. Of note, these studies have excluded subjects who received antimicrobials for prolonged periods and immunosuppressed hosts [15,16]. Certain inflammatory conditions like post-operative state, cardiogenic shock and trauma further limit the use of PCT. In these situations, specificity of PCT to identify bacterial infections is compromised.
In the ‘real world’ setting, where patients are not a part of a study protocol and patient selection and serial monitoring is done based on the ordering provider’s judgement, the utility of PCT is equivocal. In a large study, conducted in intensive care units, PCT use was associated with an increase in antimicrobial use and an increase in CDI .
The Infectious Diseases Society of America and the Society of Healthcare Epidemiology of America offer a weak recommendation for PCT use. In addition, they recommend that each hospital assess if PCT use is appropriate for their patient population .
To encourage appropriate ordering of PCT, we implemented an EET in our electronic health record (EHR). This tool reinforces three cardinal rules of diagnostic stewardship, i.e., ‘right test’ on the ‘right patient’ and at the ‘right time’ .
Study setting and design
This is a retrospective, observational, quasi-experimental study evaluating the impact of IT (EET) on diagnostic stewardship of PCT.
The study was conducted at a 401-bed, tertiary, acute care academic facility. This is a referral hospital in Los Angeles County with a quarter of admissions directly from other facilities. Subjects included in the study were inpatients, 18 years of age and older with at least one serum PCT level. Both total and appropriate PCT orders were measured before and after implementation of EET. The preintervention phase (Pre-IP) extended from February 2017-July 2017. Intervention phase was August 2017-September 2017. Postintervention phase (Post-IP) extended from October 2017-February 2018. An approval from Institutional Review Board at University of Southern California was obtained for the study.
An EET was implemented to optimize PCT ordering practices. The EET is a part of our EHR (Cerner). There was a 6-week trial period in August and September before the final launch of EET in late September 2017.
When an ordering provider attempts to order PCT, the EET is launched. This tool consists of two steps. In the first step, an educational alert outlines limitations of PCT. This alert gives the end user an option to proceed or cancel the order. If end user decides to proceed with the order, a second educational alert prompts the user to complete an electronic form. This form inquires about clinical conditions where utility of PCT is limited. The second step also gives the option to proceed or cancel the order. A PCT test can be ordered only if the electronic form is completed. If the order assessment form is completed, it is a part of the EHR. The steps involved in ordering PCT are displayed in Figure 1.
Education on PCT was ongoing through the calendar year of 2017, i.e., through both Pre-IP and Post-IP. Information about PCT was disseminated among physicians, trainees and pharmacists in the form of educational memorandums. Appropriateness of PCT ordering was also discussed in multidisciplinary rounds when pharmacists or infection preventionists were rounding with clinical teams.
Primary outcome is the proportion of appropriate PCT orders in Pre-IP and Post-IP. A PCT order was considered inappropriate if obtained in the setting of acute kidney injury (AKI), cardiogenic shock, if the patient was receiving antimicrobials for more than 72 hours, had undergone surgery in the last 72 hours or was receiving some form of dialysis. These clinical scenarios limit applicability of PCT [20-24].
A PCT order can either be a single order or a sequential order. A single order is placed only once during a clinical episode. Sequential order is defined as serial PCTs obtained for a clinical episode to assess improvement.
To examine the trend in PCT orders over time, time-series graphs were generated for the total number of orders and number of appropriate orders. The Chi-square test of association was used to determine whether the intervention (EET) was related to the number of orders, single orders, and sequential orders. The Chi-square test of homogeneity was used to determine whether there was a difference between the appropriate orders for Pre-IP and Post-IP. A P-value of 0.05 or less was considered statistically significant. The graphs and analyses were conducted using Stata 15.0 (College Station, TX).
In Pre-IP, PCT was ordered in 186 subjects and in Post-IP in 139 subjects. The average age of subjects was 60 years in both groups. Most common comorbid conditions in both groups were subarachnoid hemorrhage and sepsis. In Pre-IP, 127 subjects fell into the category of inappropriate patient selection. In this group, 75% of the subjects were considered inappropriate candidates for PCT, by virtue of duration of antibiotics. The remaining 15% had one of the following diagnosis i.e., AKI, cardiogenic shock and on dialysis. In Post-IP, 38 subjects fell into the inappropriate category with 68% of these subjects, on prolonged duration of antibiotics. In the remaining 32%, there was inappropriate patient selection because of AKI and/or dialysis.
Total PCT orders
A total of 567 PCT orders were evaluated for this study. Time-series graphs were generated for total and appropriate PCT orders. After EET was launched, there was an overall reduction in PCT orders and an increase in proportion of appropriate PCT orders (Figure 2). Monthly average for total PCT orders was 68 and 31 in Pre-IP and Post-IP, respectively (P <0.001). The difference was statistically significant between Pre-IP and Post-IP, for both single and sequential total orders Table 1.
Appropriate PCT orders
In Pre-IP, there were a total of 409 orders and 42.54% (174 out of 409) were appropriate. In Post-IP, there were a total of 158 orders and 75.95% (120 out of 158) were appropriate (Figure 3). Monthly average for appropriate PCT orders was 29 and 24 in Pre-IP and Post-IP, respectively. EET resulted in a statistically significant improvement in ordering of appropriate PCT orders (P<0.001). Appropriate ordering improved for both single and sequential orders, when Pre-IP and Post- IP were compared (P<0.001) (Table 1).
|Parameters||Pre-IP Appropriate||Post-IP Appropriate||p-value|
Table 1: Chi-square tests show a statistically significant difference between preintervention and postintervention phases for the total number of orders, single orders, and sequential orders.
Direct cost savings were estimated by measuring the reduction in total PCT orders and a reduction in inappropriate PCT orders. In Pre- IP, there were 409 total orders and 235 orders were inappropriate. The cumulative cost of total orders was $10,225 and cost of inappropriate orders was $5,875. The cumulative cost in Post-IP for total orders (158 orders) was $3,950 and cost of inappropriate orders (38 orders) was $950. These calculations are done based on $25 (approximate) for each PCT order. EET resulted in reducing the direct costs by 61.36% ($6,275).
In this study, we demonstrate benefits of harnessing IT for diagnostic stewardship of PCT in the preanalytic phase. Appropriate ordering of PCT increased by 33.41% (42.54% in Pre-IP and 75.95% in Post-IP) after introduction of EET. Total orders reduced by 54.4% in Post-IP compared to Pre-IP. Impact of EET was noted on both single and sequential orders. Improvement in total orders and appropriate orders was statistically significant. This reflects improved patient selection and better understanding of this diagnostic marker by ordering providers.
Two attributes of EET were able to modify ordering provider’s behaviour- a) availability at the point of ordering and b) reliance on active learning, i.e., ordering provider was required to complete an electronic form before proceeding to the next step. Availability of EET at the point of ordering gave the ordering provider easy access to educational information about PCT. In contrast, in-person educational efforts led by pharmacists and infection preventionists occurred after PCT results were available.
Similar interventions have been used to improve appropriate usage of select antimicrobials . A systematic review showed an overall improvement in antimicrobial usage with the use of various clinical decision support systems like computerized provider order entry and computerized approval systems . Such system-based stewardship interventions can be useful in saving personnel time and hardwiring evidence-based medicine in practice.
With increasing emphasis on ‘Choosing Wisely’ campaign, it is incumbent on healthcare professionals to practice evidence-based medicine . Diagnostic stewardship is a critical component of this campaign. Typically, implementation strategies for diagnostic stewardship are either user-based or system-based. User-based approaches take the form of audit and feedback as commonly used in antimicrobial stewardship efforts. System-based efforts often rely on IT and include clinical decision support tools for optimization . In our study, a system-based tool, i.e., EET, allowed us to socialize evidence-based use of PCT.
While this work demonstrated convincing results, there are some caveats that should be kept in mind while interpreting these results. It was a single-center experience and will need to be replicated at other centers to confirm its generalizability. We relied on capturing patient information from chart documentation which may have introduced human error. EET was not deployed in isolation. Educational efforts were simultaneously ongoing and may have reinforced optimal use of PCT. It is therefore not possible to conclusively determine what portion of the behaviour change can be attributed to EET versus other interventions. However, it is important to note that other educational efforts were ongoing through both Pre-IP and Post-IP, so EET was the main variable between the two time periods. Finally, it is challenging to calculate the true economic impact of optimizing PCT orders. We have only estimated direct costs. Indirect cost benefits of PCT would include several data points, including antimicrobial use, additional testing and length of stay which were beyond the scope of this study.
In conclusion, a well-designed and a well-implemented EET has the potential to influence the preanalytic phase of laboratory procedures. To design and implement an effective diagnostic stewardship intervention, an ongoing dialogue between IT, diagnosticians and clinicians is imperative. An effective intervention should be accessible at the point of ordering to facilitate the three cardinal rules of diagnostic stewardship, i.e., the ‘right’ test, on the ‘right’ patient, and at the ‘right’ time. By harnessing IT, we can hardwire evidence-based medicine and optimize resource utilization in the current healthcare environment.
The authors would like to thank the Pharmacists and Infection Preventionists at Keck Medicine of University of Southern California for their educational efforts. The authors would also like to thank Deborah G. Passey (Aitia Research Consulting) for offering statistical expertise.
- Morgan DJ, Malani P, Diekema DJ (2017) Diagnostic stewardship-leveraging the laboratory to improve antimicrobial use. JAMA 318: 607-608.
- (2017) Centers for Medicaid Services (CMS), HHS. Medicare program: Hospital outpatient prospective payment and ambulatory surgical center payment systems and quality reporting programs. Final rule with comment period. Fed Regist 82: 59216-59494.
- Goceri E, Goksel B, Elder JB, Puduvalli VK, Otero JJ et al. (2017) Quantitative validation of anti-PTBP1 antibody for diagnostic neuropathology use: Image analysis approach. Int J Numer Method Biomed Eng 33.
- Kaya B, Goceri E, Becker A, Elder B, Puduvalli V et al. (2017) Automated fluorescent microscopic image analysis of PTBP1 expression in glioma. PLoS ONE 12: e0170991.
- Shamliyan TA, Duval S, Du J, Kane RL (2008) Just what the doctor ordered. Review of the evidence of the impact of computerized physician order entry system on medication errors. Health Serv Res 43: 32-53.
- Rosa R, Zavala B, Cain N, Anjan S, Aragon L, et al. (2018) Antimicrobial stewardship program implementation of a quality improvement intervention using real-time feedback and an electronic order set for the management of staphylococcus aureus bacteremia. Infect Control Hosp Epidemiol 39: 346-349.
- Nomura Y, Garcia M, Child J, Hurst AL, Hyman D, et al. (2018) Effect of provider-selected order indications on appropriateness of antimicrobial orders in a pediatric hospital. Am J Health Syst Pharm 75: 213-221.
- Lambl BB, Kaufman N, Kurowski J, O’Neill W, Buckley F, et al. (2017) Does electronic stewardship work?. J Am Med Inform Assoc 24: 981-985.
- Muller B, White JC, Nylen ES, Snider RH, Becker KL, et al. (2001) Ubiquitous expression of the calcitonin-i gene in multiple tissues in response to sepsis. J Clin Endocrinol Metab 86: 396-404.
- Assicot M, Gendrel D, Carsin H, Raymond J, Guilbaud J, et al. (1993) High serum procalcitonin concentrations in patients with sepsis and infection. Lancet 341: 515-518.
- Huang DT, Weissfeld LA, Kellum JA, Yealy DM, Kong L, et al. (2008) Risk prediction with procalcitonin and clinical rules in community-acquired pneumonia. Ann Emerg Med 52: 48-58.
- Muller B, Harbarth S, Stolz D, Bingisser R, Mueller C, et al. (2007) Diagnostic and prognostic accuracy of clinical and laboratory parameters in community-acquired pneumonia. BMC Infect Dis 7: 10.
- Gilbert DN (2017) Role of procalcitonin in the management of infected patients in the intensive care unit. Infect Dis Clin North Am 31: 435-453.
- de Jong E, van Oers JA, Beishuizen A, Vos P, Vermeijden WJ, et al. (2016) Efficacy and safety of procalcitonin guidance in reducing the duration of antibiotic treatment in critically ill patients: A randomised, controlled, open-label trial. Lancet Infect Dis 16: 819-827.
- Huang HB, Peng JM, Weng L, Wang CY, Jiang W, et al. (2017) Procalcitonin-guided antibiotic therapy in intensive care unit patients: A systematic review and meta-analysis. Ann Intensive Care 7: 114.
- Schuetz P, Wirz Y, Sager R, Christ-Crain M, Stolz D, et al. (2017) Procalcitonin to initiate or discontinue antibiotics in acute respiratory tract infections. Cochrane Database Syst Rev 10: CD007498.
- Chu DC, Mehta AB, Walkey AJ (2017) Practice patterns and outcomes associated with procalcitonin use in critically ill patients with sepsis. Clin Infect Dis 64: 1509-1515.
- Barlam TF, Cosgrove SE, Abbo LM, McDougall C, Schuetz AN, et al. (2016) Executive summary: Implementing an antibiotic stewardship program: Guidelines by the infectious diseases society of America and the society for healthcare epidemiology of America. Clin Infect Dis 62: 1197-1202.
- Messacar K, Parker SK, Todd JK, Dominguez SR (2017) Implementation of rapid molecular infectious disease diagnostics: The role of diagnostic and antimicrobial stewardship. J Clin Microbiol 55: 715-723.
- Molter GP, Soltész S, Kottke R, Wilhelm W, Biedler A, et al. (2003) Procalcitonin plasma concentrations and systemic inflammatory response following different types of surgery. Anaesthesist 52: 210-217.
- Geppert A, Steiner A, Delle-Karth G, Heinz G, Huber K (2003) Usefulness of procalcitonin for diagnosing complicating sepsis in patients with cardiogenic shock. Intensive Care Med 29: 1384-1389.
- Geppert A, Steiner A, Zorn G, Delle-Karth G, Koreny M, et al. (2002) Multiple organ failure in patients with cardiogenic shock is associated with high plasma levels of interleukin-6. Crit Care Med 30: 1987-1994.
- Grace E, Turner RM (2014) Use of procalcitonin in patients with various degrees of chronic kidney disease including renal replacement therapy. Clin Infect Dis 59: 1761-1767.
- Trimarchi H, Dicugno M, Muryan A, Lombi F, Iturbe L, et al. (2013) Pro-calcitonin and inflammation in chronic hemodialysis. Medicina (B Aires) 73: 411-416.
- Ranji SR, Steinman MA, Shojania KG, Gonzales R (2008) Interventions to reduce unnecessary antibiotic prescribing: A systematic review and quantitative analysis. Med Care 46: 847-862.
- Curtis CE, Al-Bahar F, Marriott JF (2017) The effectiveness of computerised decision support on antibiotic use in hospitals: A systematic review. PloS one 12: e0183062.
- Brody H (2010) Medicine's ethical responsibility for health care reform-the top five list. N Engl J Med 362: 283-285.
- Madden GR, Weinstein RA, Sifri CD (2018) Diagnostic stewardship for healthcare-associated infections: Opportunities and challenges to safely reduce test use. Infect Control Hosp Epidemiol 39: 214-218.
Citation: Neha N, Neeti V (2018) Leveraging Information Technology to Hardwire Diagnostic Stewardship. J Med Diagn Meth 7: 279. DOI: 10.4172/2168-9784.1000279
Copyright: © 2018 Nanda N, et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Select your language of interest to view the total content in your interested language
Share This Article
- Total views: 142
- [From(publication date): 0-0 - Feb 18, 2019]
- Breakdown by view type
- HTML page views: 123
- PDF downloads: 19