The Impact of Using E-Portfolios for Pharmacy Students in Advanced Pharmacotherapy: Complicated Comorbidity Cases Compared to Traditional Assessment Methods in the AI Era
Main Article Content
Keywords
e-portfolios, artificial intelligence, OSCEs
Abstract
Objective: To evaluate the effectiveness of electronic portfolios (e-portfolios) as an assessment method for fifth-year pharmacy students in advanced pharmacotherapy courses focusing on complex comorbidity cases compared to traditional assessment methods, and to analyze their impact on Objective Structured Clinical Examination (OSCE) performance in the artificial intelligence era. Methods: A quasi-experimental study was conducted with 32 fifth- year pharmacy students at Fatima College of Health Sciences. Students were randomly assigned to either an e-portfolio assessment group (n=16) or a traditional assessment group (n=16). The e-portfolio group documented complex comorbidity cases with reflective components, while the control group completed traditional assessments. Both groups participated in identical OSCEs. Data were analyzed using independent samples t-tests, Mann- Whitney U tests, and thematic analysis. Results: The e-portfolio group demonstrated significantly higher scores in clinical reasoning assessment (mean 83.5±4.2 vs 76.3±5.1, p=0.008) and OSCE stations involving complex cases (mean 86.8±5.3 vs 79.2±6.1, p=0.001). Qualitative analysis revealed enhanced metacognitive awareness and therapeutic decision-making in the e-portfolio group. Cohen’s d effect sizes ranged from 0.76 to 1.33, indicating medium to large effects. Conclusion: E-portfolios focusing on complex comorbidity cases provide significant advantages over traditional assessment methods in advanced pharmacotherapy courses, particularly for developing integrated clinical reasoning skills necessary for managing patients with multiple disease states. Implementation of e-portfolios may better prepare students for the complexities of modern pharmacy practice in the AI era.
References
2. Briceland LL, Hamilton RA. Electronic reflective student portfolios to demonstrate achievement of ability-based outcomes during advanced pharmacy practice experiences. Am J Pharm Educ. 2010;74(5):79.
3. Mak V, Krishnan S, Chuang S. Students’ and examiners’ experiences of their first virtual pharmacy objective structured clinical examination (OSCE) in Australia during the COVID-19 pandemic. Healthcare (Basel). 2022;10(2):328.
4. Al-Ghananeem AM, Malcom DR, Shammas S, Aburjai T. A call to action to transform pharmacy education and practice in the Arab world. Am J Pharm Educ. 2018;82(9):7014.
5. Dameh M. Pharmacy education in the United Arab Emirates. Am J Pharm Educ. 2019;83(8):7229.
6. Pate KA, Pate AN, Sampognaro LA, Patel DI, Caldas LM, Akins BR, Bryant PJ, Bradley CL. Design, implementation, and assessment approaches for meaningful use of student portfolios in doctor of pharmacy curricula. Am J Pharm Educ. 2021;85(7):8370.
7. Demirbag B, Topkaya SG. Digital portfolio applications in health sciences education: A systematic review. Med Ed Publish. 2021;10(1):158.
8. Tsingos C, Bosnic-Anticevich S, Smith L. Learning styles and approaches: Can reflective strategies encourage deep learning? Curr Pharm Teach Learn. 2015;7(4):492-504.
9. Karimi R, Worthy SL, Perez M, Baxter JL, Yao K, Shao C. Validity evidence for using a general self-efficacy scale in pharmacy education. Am J Pharm Educ. 2020;84(3):7497.
10. Gumpper BS, Li J, Christle M. Artificial intelligence in pharmacy education: Opportunities, challenges, and considerations. Am J Pharm Educ. 2023;87(9):16217.
11. Breton CA, Hernandez F, Aghdam E, Shoa S, Patel V, Miranda AC. Impacts of artificial intelligence on pharmacy practice and education. J Am Coll Clin Pharm. 2024;7(1):24-35.
12. Al-Dahir S, Bryant K, Kennedy KB, Robinson DS. Online virtual-patient cases versus traditional problem-based learning in advanced pharmacy practice experiences. Am J Pharm Educ. 2014;78(4):76.
13. Shirwaikar A. Objective structured clinical examination (OSCE) in pharmacy education - a trend. Pharm Pract (Granada). 2015;13(4):627.
14. Nazar H, Omer U, Nazar Z, Husband A. A study to investigate the impact of a blended learning teaching approach to teach pharmacy law. Int J Pharm Pract. 2019;27(3):303-310.
15. Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, Morley D, Pollard D, Ashcroft T, Popovic C, Sayers J. The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach. 2009;31(4):282-298.
16. Al Alawi S, Ahmed AA, Alrumaihi F. Development and evaluation of an electronic portfolio for pharmacy students in Qatar University: a mixed-method approach. East Mediterr Health J. 2021;27(4):398-407.
17. Peeters MJ, Boddu SHS. Assessing development in critical thinking: one institution’s experience. Curr Pharm Teach Learn. 2016;8(3):271-278.
18. Vyas D, Bray BS, Wilson MN. Use of simulation-based teaching methodologies in US colleges and schools of pharmacy. Am J Pharm Educ. 2013;77(3):53.
19. Hajat C, Stein E, Yach D. The United Arab Emirates Cardiovascular Disease Burden: The PURE-UAE study. J Epidemiol Glob Health. 2022;12(1):14-19.
20. Alhyas L, McKay A, Balasanthiran A, Majeed A. Prevalences of overweight, obesity, hyperglycaemia, hypertension and dyslipidaemia in the Gulf: systematic review. JRSM Short Rep. 2011;2(7):55.
21. Ibrahim AA, Scott J, Taherali F, Slim M, Kheir N, Bates I. Competency-based pharmacy education: Current practice and future potential in the Arab world. Pharm Educ. 2021;21:324-332.
22. Patel N, Begum S, Kayyali R. Interprofessional education and practice guide: developing interprofessional education in health and social care courses. J Interprof Care. 2016;30(5):654-661.
23. Medina MS, Castleberry AN, Persky AM. Strategies for improving learner metacognition in health professional education. Am J Pharm Educ. 2017;81(4):78.
24. Al-Haddad M, Hamdy H. Self-directed learning in problem-based learning medical curricula: the case for student assessment. Med Teach. 2019;41(5):501-508.
25. Malcom DR, Strum-Rewin S, Al-Harbi NN, Gortney JS. Artificial intelligence’s potential impact on the academy, professional identity formation, and the future of pharmacy practice. Am J Pharm Educ. 2023;87(5):ajpe8886.
26. Song YK, Chung EK, Lee YS, Yoon JH, Kim H. Objective structured clinical examination as a competency assessment tool of students’ readiness for advanced pharmacy practice experiences in South Korea: a pilot study. BMC Med Educ. 2023;23(1):231.
27. Ali M. What now and what next? The new era of OSCE: Innovation in learning assessment. Pharm Educ. 2020;20(2):56-58.
28. Bin Naeem N, Khan A. Stuck in the blend: Challenges faced by students enrolled in blended programs of Masters in Health Professions Education. Pak J Med Sci. 2019;35(4):929-933.
29. Fathelrahman AI, Ibrahim MIM, Wertheimer AI. Pharmacy Practice in Developing Countries: Achievements and Challenges. London: Academic Press; 2016.
30. Tsingos-Lucas C, Bosnic-Anticevich S, Schneider CR, Smith L. Using reflective writing as a predictor of academic success in different assessment formats. Am J Pharm Educ. 2017;81(1):8.
31. Peeters MJ, Vaidya VA. A mixed-methods analysis in assessing students’ professional development by applying an assessment for learning approach. Am J Pharm Educ. 2016;80(5):77.
32. Kheir N, Awaisu A, Radoui A, El Badawi A, Jean L, Dowse R. Development and evaluation of a pharmacy student self-assessment instrument for patient care competencies. Pharm Pract (Granada). 2019;17(3):1565.
33. Al-Azzam SI, Alzoubi KH, AbuRuz S, Alefan Q. Drug-related problems in a sample of outpatients with chronic diseases: a cross- sectional study from Jordan. Ther Clin Risk Manag. 2016;12:233-239.
34. Phanudulkitti C, Puengrung S, Meepong R, Tuntapakul S, Krass I, Sumpradit N. A systematic review on the use of virtual patient and computer-based simulation for experiential pharmacy education. Explor Res Clin Soc Pharm. 2023;12:100368.
35. Wollen JT, Gee JS, Nguyen KA, Surati DD. Development of a communication-based virtual patient counseling objective structured clinical examination (OSCE) for first year student pharmacists. PEC Innov. 2023;3:100215.
