Full metadata record
DC Field | Value | Language |
---|---|---|
dc.citation.number | 1 | - |
dc.citation.startPage | 13518 | - |
dc.citation.title | SCIENTIFIC REPORTS | - |
dc.citation.volume | 13 | - |
dc.contributor.author | Choi, Dong Hyun | - |
dc.contributor.author | Lim, Min Hyuk | - |
dc.contributor.author | Kim, Ki Hong | - |
dc.contributor.author | Shin, Sang Do | - |
dc.contributor.author | Hong, Ki Jeong | - |
dc.contributor.author | Kim, Sungwan | - |
dc.date.accessioned | 2023-12-21T11:46:28Z | - |
dc.date.available | 2023-12-21T11:46:28Z | - |
dc.date.created | 2023-09-22 | - |
dc.date.issued | 2023-08 | - |
dc.description.abstract | Prediction of bacteremia is a clinically important but challenging task. An artificial intelligence (AI) model has the potential to facilitate early bacteremia prediction, aiding emergency department (ED) physicians in making timely decisions and reducing unnecessary medical costs. In this study, we developed and externally validated a Bayesian neural network-based AI bacteremia prediction model (AI-BPM). We also evaluated its impact on physician predictive performance considering both AI and physician uncertainties using historical patient data. A retrospective cohort of 15,362 adult patients with blood cultures performed in the ED was used to develop the AI-BPM. The AI-BPM used structured and unstructured text data acquired during the early stage of ED visit, and provided both the point estimate and 95% confidence interval (CI) of its predictions. High AI-BPM uncertainty was defined as when the predetermined bacteremia risk threshold (5%) was included in the 95% CI of the AI-BPM prediction, and low AI-BPM uncertainty was when it was not included. In the temporal validation dataset (N = 8,188), the AI-BPM achieved area under the receiver operating characteristic curve (AUC) of 0.754 (95% CI 0.737-0.771), sensitivity of 0.917 (95% CI 0.897-0.934), and specificity of 0.340 (95% CI 0.330-0.351). In the external validation dataset (N = 7,029), the AI-BPM's AUC was 0.738 (95% CI 0.722-0.755), sensitivity was 0.927 (95% CI 0.909-0.942), and specificity was 0.319 (95% CI 0.307-0.330). The AUC of the post-AI physicians predictions (0.703, 95% CI 0.654-0.753) was significantly improved compared with that of the pre-AI predictions (0.639, 95% CI 0.585-0.693; p-value < 0.001) in the sampled dataset (N = 1,000). The AI-BPM especially improved the predictive performance of physicians in cases with high physician uncertainty (low subjective confidence) and low AI-BPM uncertainty. Our results suggest that the uncertainty of both the AI model and physicians should be considered for successful AI model implementation. | - |
dc.identifier.bibliographicCitation | SCIENTIFIC REPORTS, v.13, no.1, pp.13518 | - |
dc.identifier.doi | 10.1038/s41598-023-40708-2 | - |
dc.identifier.issn | 2045-2322 | - |
dc.identifier.scopusid | 2-s2.0-85168331127 | - |
dc.identifier.uri | https://scholarworks.unist.ac.kr/handle/201301/66021 | - |
dc.identifier.wosid | 001052369000017 | - |
dc.language | 영어 | - |
dc.publisher | NATURE PORTFOLIO | - |
dc.title | Development of an artificial intelligence bacteremia prediction model and evaluation of its impact on physician predictions focusing on uncertainty | - |
dc.type | Article | - |
dc.description.isOpenAccess | TRUE | - |
dc.relation.journalWebOfScienceCategory | Multidisciplinary Sciences | - |
dc.relation.journalResearchArea | Science & Technology - Other Topics | - |
dc.type.docType | Article | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordPlus | MEDICINE | - |
Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Tel : 052-217-1404 / Email : scholarworks@unist.ac.kr
Copyright (c) 2023 by UNIST LIBRARY. All rights reserved.
ScholarWorks@UNIST was established as an OAK Project for the National Library of Korea.