Evaluation of the value of ChatGPT as a self-medicationpatients’ advisor for minor ailments in comparison withcommunity pharmacist: A Cross-sectional study
Main Article Content
Keywords
ChatGPT, Community Pharmacist, Self-medication, Minor ailments, Artificial intelligence in healthcare.
Abstract
Abstract The Objectives: This study aims to evaluate the value of ChatGPT in helping patients select appropriate self-care and over-the-counter medications for minor ailments compared to community pharmacists (CP).Method: The study used a cross-sectional assessment and a covert simulated patient study, in which three clinical pharmacists prepared 91 clinical scenarios representing the most common OTC indications. These case scenarios were presented to ChatGPT and community pharmacists to compare generated responses in several aspects. Accuracy, patient-centeredness, comprehensiveness, and word count of responses from both ChatGPT and community pharmacists were assessed by three clinical pharmacists.Results: It was found that ChatGPT responses were more accurate (4.51±0.64 vs 3.78±0.89), patient-centered (4.46±0.70 vs 3.68±0.88), and comprehensive (4.38±0.71 vs 2.68±1.26) compared to pharmacists’ responses (p<0.001). Cosine similarity showed that the majority (40.7%, n=37) of cases answered by community pharmacists were moderately like that of ChatGPT, with an average score of 0.51±0.23.Conclusion: The study suggests ChatGPT is an accurate tool for a self-medication advisor for minor ailments. It is important to emphasize that this tool should be used to support patients and pharmacists rather than being the sole source of drug information, as therapy individualization and up-to-date information can’t be achieved without pharmacists’ intervention. It also underscores the need for enhancing pharmacists’ and pharmacy students’ training in minor ailments recommendations and management.
References
2. Rahimisadegh R, Sharifi N, Jahromi VK, Zahedi R, Rostayee Z, Asadi R. Self-medication practices and their characteristics among Iranian university students. BMC pharmacology & toxicology. 2022;23(1):60.
3. Sharif S, Bugaighis L, Sharif R. Self-Medication Practice among Pharmacists in UAE. Pharmacology & Pharmacy. 2015;06:428–435.
4. Noone J, Blanchette CM. The value of self-medication: summary of existing evidence. Journal of Medical Economics. 2018;21(2):201–211. 5. emhj. Prevalence of self-medication in university students: systematic review and meta-analysis. World Health Organization - Regional Office for the Eastern Mediterranean.
6. Bennadi D. Self-medication: A current challenge. Journal of Basic and Clinical Pharmacy. 2013;5(1):19–23.
7. Ray PP. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems. 2023;3:121–154.
8. Ker J, Wang L, Rao J, Lim T. Deep Learning Applications in Medical Image Analysis. IEEE Access. 2017;PP:1–1.
9. Beaulieu-Jones BK, Yuan W, Brat GA, Beam AL, Weber G, Ruffin M, Kohane IS. Machine learning for patient risk stratification: standing on, or looking over, the shoulders of clinicians? npj Digital Medicine. 2021;4(1):1–6.
10. Han K, Cao P, Wang Y, Xie F, Ma J, Yu M, Wang J, Xu Y, Zhang Y, Wan J. A review of approaches for predicting drug–drug interactions based on machine learning. Frontiers in pharmacology. 2022;12:814858.
11. Sinha RK, Roy AD, Kumar N, Mondal H, Sinha R. Applicability of ChatGPT in assisting to solve higher order problems in pathology. Cureus. 2023;15(2).
12. Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Critical care. 2023;27(1):1–5.
13. Das D, Kumar N, Longjam LA, Sinha R, Roy AD, Mondal H, Gupta P. Assessing the capability of ChatGPT in answering first-and second-order knowledge questions on microbiology as per competency-based medical education curriculum. Cureus. 2023;15(3).
14. Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, Chartash D. How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education. 2023;9(1):e45312.
15. Juhi A, Pipil N, Santra S, Mondal S, Behera JK, Mondal H, Pipil Sr N, Santra Sr S, Behera IV JK. The capability of ChatGPT in predicting and explaining common drug-drug interactions. Cureus. 2023;15(3).
16. McMahon HV, McMahon BD. Automating untruths: ChatGPT, self-managed medication abortion, and the threat of misinformation in a post-Roe world. Frontiers in Digital Health. 2024;6.
17. Yusuff KB, Makhlouf AM, Ibrahim MI. Community pharmacists’ management of minor ailments in developing countries: A systematic review of types, recommendations, information gathering and counselling practices. International Journal of Clinical Practice. 2021;75(10):e14424.
18. Rathod P, Sharma S, Ukey U, Sonpimpale B, Ughade S, Narlawar U, Gaikwad S, Nair P, Masram P, Pandey S. Prevalence, Pattern, and Reasons for Self-Medication: A Community-Based Cross-Sectional Study From Central India. Cureus. 15(1):e33917.
19. Anon. Self-care and minor ailments: The view from Canada - ScienceDirect.
20. Makhlouf AM, Ibrahim MIM, Awaisu A, Vyas SK, Yusuff KB. Management of common minor ailments in Qatar: Community pharmacists’ self-perceived competency and its predictors. PLoS ONE. 2021;16(8):e0256156.
21. Willemsen KR, Harrington G. From patient to resource: the role of self-care in patient-centered care of minor ailments. SelfCare Journal. 2015.
22. Pillay N, Tisman A, Kent T, Gregson‡ J. THE economic burden of minor ailments on the national health service in the UK. SelfCare Journal. 2015.
23. Mansell K, Bootsman N, Kuntz A, Taylor J. Evaluating pharmacist prescribing for minor ailments. The International Journal of Pharmacy Practice. 2015;23(2):95–101.
24. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, Wang Y, Dong Q, Shen H, Wang Y. Artificial intelligence in healthcare: past, present and future. Stroke and Vascular Neurology. 2017;2(4).
25. Krishnan G, Singh S, Pathania M, Gosavi S, Abhishek S, Parchani A, Dhar M. Artificial intelligence in clinical medicine: catalyzing a sustainable global healthcare paradigm. Frontiers in Artificial Intelligence. 2023;6:1227091.
26. Rajkomar A, Dean J, Kohane I. Machine Learning in Medicine. New England Journal of Medicine. 2019;380(14):1347–1358.
27. Al-Antari MA. Artificial Intelligence for Medical Diagnostics—Existing and Future AI Technology! Diagnostics. 2023;13(4):688.
28. Rammal DS, Alomar M, Palaian S. AI-Driven pharmacy practice: Unleashing the revolutionary potential in medication management, pharmacy workflow, and patient care. Pharmacy Practice. 2024;22(2):1–11.
29. Singh S, Kumar R, Payra S, Singh SK. Artificial Intelligence and Machine Learning in Pharmacological Research: Bridging the Gap Between Data and Drug Discovery. Cureus. 15(8):e44359.
30. Alowais SA, Alghamdi SS, Alsuhebany N, Alqahtani T, Alshaya AI, Almohareb SN, Aldairem A, Alrashed M, Bin Saleh K, Badreldin HA, Al Yami MS, Al Harbi S, Albekairy AM. Revolutionizing healthcare: the role of artificial intelligence in clinical practice. BMC Medical Education. 2023;23(1):689.
31. Jarab AS, Abu Heshmeh SR, Al Meslamani AZ. Artificial intelligence (AI) in pharmacy: an overview of innovations. Journal of Medical Economics. 2023;26(1):1261–1265.
32. Raza MA, Aziz S, Noreen M, Saeed A, Anjum I, Ahmed M, Raza SM. Artificial Intelligence (AI) in Pharmacy: An Overview of Innovations. Innovations in Pharmacy. 2022;13(2):10.24926/iip.v13i2.4839.
33. Tai-Seale M, Baxter SL, Vaida F, Walker A, Sitapati AM, Osborne C, Diaz J, Desai N, Webb S, Polston G, Helsten T, Gross E, Thackaberry J, Mandvi A, Lillie D, et al. AI-Generated Draft Replies Integrated Into Health Records and Physicians’ Electronic Communication. JAMA Network Open. 2024;7(4):e246565.
34. Small WR, Wiesenfeld B, Brandfield-Harvey B, Jonassen Z, Mandal S, Stevens ER, Major VJ, Lostraglio E, Szerencsy A, Jones S, Aphinyanaphongs Y, Johnson SB, Nov O, Mann D. Large Language Model–Based Responses to Patients’ In-Basket Messages. JAMA Network Open. 2024;7(7):e2422399.
35. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science (New York, N.Y.). 2019;366(6464):447–453.
36. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nature Medicine. 2019;25(1):44–56.
Article Sidebar
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.