Abstract

Conclusion. The use of digital media distribution in clinical education, based on the CIPP evaluation model, is effective in supporting students' successful completion of the program during the learning process. The only obstacles in the learning process are not all the diseases or cases listed in the logbook that students encountered during clinical education.

Keywords: Program evaluation, digital media, utilization, CIPP, clinical education

Abbas, U., Parveen, M., Sahito, F. S., Hussain, N., & Munir, S. (2024). E-learning in medical education: A perspective of pre-clinical medical students from a lower-middle-income country. BMC Medical Education, 24(1), 162. https://doi.org/10.1186/s12909-024-05158-y  

Airasian,  P. W. (2001). A Taxonomy for Learning, Teaching, and Assessing. New York: Library of Congress Catalog.

Ali, W. (2020). Online and remote learning in higher education institutes: A necessity in light of the COVID-19 pandemic. Higher Education Studies, 10(3), 16–25. https://doi.org/10.5539/hes.v10n3p16  

Aljahany, M., Malaekah, H., Alzahrani, H., Alhamadah, F., & Dator, W. L. (2021). Simulation-based peer-assisted learning: perceptions of health science students. Advances in Medical Education and Practice, 30(12), 731–737. doi:10.2147/AMEP.S308521.

Arikunto, S. (2010). Evaluasi Program Pendidikan. Jakarta: Bumi Aksara.

Arikunto, S., Safrudin, C., &  Jabar, A. (2013). Evaluasi Program Pendidikan Pedoman Teoritis Praktis Bagi Praktisi Pendidikan. Jakarta: Bumi Aksara.

Aydin, M. O., Kafa, I. M., Ozkaya, G., Alper, Z., & Haque, S. (2022). Peer-assisted skills learning in structured undergraduate medical curriculum: an experiential perspective of tutors and tutees. Nigerian Journal of Clinical Practice, 25(5), 589–596. doi:10.4103/njcp.njcp_1410_21.

Badawy, A., Fisteus, J. A., Mahmoud, T. M., & Abd El-Hafeez, T. (2021). Topic extraction and interactive knowledge graphs for learning resources. Sustainability, 14(1), 226. https://doi.org/10.3390/su14010226  

Baucham, R. S., Mintz-Binder, R., & Baker, K. A. (2024). An innovative use of the logic model for a qualitative analysis framework. The Journal of Continuing Education in Nursing, 55(6), 297–301. https://doi.org/10.3928/00220124-20240301-05

Bhosale, M. S. S., Salunkhe, A., & Surve, F. (2020). Influence of modern technology in education. Aayushi International Interdisciplinary Research Journal, 77, 219–222. https://doi.org/10.48175/ijarsct-8166

Candoli, C. (1995). Based Management in Education, Lancaster: Technomic Publishing Company.

Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, 11(4), 589–597.

Carlson, B. M. (2004). Human Embryology and Developmental Biology. Philadelphia: Library of Congress Cataloging.

Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). Sage.

Davidson, E. J. (2005). Evaluation Methodology Basics New Delhi: Sage Publication.

Davis, J. (2011). Intraocular Inflammation and Uveitis. San Francisco: American Academy of Ophthalmology.

Dumas, B. P., Hollerbach, A. D., Stuart, G. W., & Duffy, N. D. (2015). Expanding simulation capacity: Senior-level students as teachers. The Journal of Nursing Education, 54(9), 516–519. doi:10.3928/01484834-20150814-06

El Koshiry, A., Eliwa, E., Abd El-Hafeez, T., & Shams, M. Y. (2023). Unlocking the power of blockchain in education: An overview of innovations and outcomes. Blockchain: Research and Applications, 4(4), 100165. https://doi.org/10.1016/j.bcra.2023.100165

European Society of Endodontology, Gulabivala, K., Ahlquist, M., Al-Nazhan, S., Dummer, P. M. H., Frencken, J., Harty, F., Peters, O. A., & Rafter, M. (2010). Accreditation of postgraduate speciality training programmes in Endodontology: Minimum criteria for training specialists in Endodontology within Europe. International Endodontic Journal, 43(9), 725–737. https://doi.org/10.1111/j.1365-2591.2010.01775.x

Farias, M., Jenkins, K., & Lock, J. (2013).  Standardized clinical assessment and management plans (SCAMPs) provide a better alternative to clinical practice guidelines. Health Aff 32(5) 911–920. https://doi.org/10.1377/hlthaff.2012.0667.

Feliciano, D. V. (2008). Trauma. New Jersey: Library of Congress.

Field, M. J., & Lohr, K. N. (1990). Clinical practice guidelines: Directions for a new program. Washington, DC: National Academy Press. https://www.nap.edu/read/1626/chapter/8

Fitzpatrick, J. L. (2004). Program Evaluation Boston: Congress Cataloging-in-Publication Data.

Freitas de Mello, N., Nascimento Silva, S., Gomes, D. F., & others. (2024). Models and frameworks for assessing the implementation of clinical practice guidelines: A systematic review. Implementation Science, 19(59). https://doi.org/10.1186/s13012-024-01389-1

Glasman, N. S., & David, N. (1995). Evaluation in Decision Making USA: The Falmer.

Govender, L., & Archer, E. (2021). Feedback as a spectrum: The evolving conceptualisation of feedback for learning. African Journal of Health Professions Education, 13(1), 12–13. https://doi.org/10.7196/AJHPE.2021.v13i1.1414

Guba, E. G., Yvonna, S., & Lincoln. (1983). Effective Evaluation, Improving the usefulness of Evaluation Results Through Responsive and Naturalistic Approaches. Boston: Jossey-Bass Publisher.

Guskey, T. R. (2000). Evaluating Professional Development. Boston: Corwin Press.

Hardywinoto, S. T. (1999). Panduan Gerontologi Tinjauan dari berbagai Aspek. Jakarta: PT Gramedia.

Harrison. (2013). Manual of Medicine. Philadelphia: Library of Congress Catalogic.

Hison, J. (2007). The Endocrine System. Oxford: British Library Cataloging.

Hussain, F. (2012). E-Learning 3.0= E-Learning 2.0+ Web 3.0?. International Association for the Development of the Information Society. https://doi.org/10.4018/9781599043258.ch017

Kahan, B. (2008). Review of Evaluation Frameworks. Boston:Kael Consulting.

Khamim. (2007). Evaluasi Program Pelaksanaan Kurikulum Berbasis Kompetensi (KBK) Satu Penelitian Evaluatif Program Pelaksanaan Kurikulum Berbasis Kompetensi Berdasarkan Model CIPP Pada SMP Negeri 19 Kebayoran Baru Jakarta.Jakarta : PPs UNJ, Disertasi.

Kurikulum dan Silabi Fakultas Kedokteran Universitas Kristen Indonesia. (2008). Fakultas Kedokteran Universitas Kristen Indonesia, Jakarta.

Linda, E., & Paul, R. (2005). The miniature guide to critical thinking "Concepts & Tools".  The Foundation of Critical Thinking.California.

Lucenti, L., Maffulli, N., & Bardazzi, T. (2024). Return to sport following arthroscopic management of femoroacetabular impingement: a systematic review. J Clin Med, 13(17). https://doi.org/10.3390/jcm13175219.

MacKie, R. M. (1989). Skin Cancer. Oxford: British Library Cataloguing-in-Publication-Data. Madaus, G. F., Michael, S. S., & Daniel, L. (1985). Stufflebeam,Evaluation Model, Viewpoints on Educational and Human Services Evaluation,. Boston: Kluwer Nijhoff Publishing.

Mark, M. M., & Deborah, J. (2010). The 2010 User-Friendly Handbook for Project Evaluation. Program officer and COTR Division of Research and Learning in Formal and Informal settings National Science Foundation.

Marynowski, S. (2006). Best Practices Guide to Program Evaluation For Aquatic Educators.Florida: Pandion Systems, Inc.

Maslim, R. (2001). Panduan Praktis Penggunaan Klinis Obat Psikotropik. Jakarta: Bagian Ilmu Kedokteran Jiwa FK Unika Atma Jaya.

MeschanIsadore. (1984). Roentgen Signs in Diagnostic Imaging Philadelphia: Library of Congress Cataloging.

Michael. (1991). Otolaryngology Philadelphia: W.B. Saunders. Naga, S. D. (2013). Teori Sekor pada Pengukuran Mental. Jakarta: PT Nagarani Citrayasa.

Migliorini F, Baroncini A, Eschweiler J, Knobe M, Tingart M, & Maffulli N. (2023). Return to sport after arthroscopic surgery for femoroacetabular impingement. Surgeon, 21(1) 21–30. https://doi.org/10.1016/j.surge.2021.11.006   

Migliorini, F., Pilone, M., Schafer, L., Bertini, F.A., Giorgino, R., & Maffulli, N. (2025). Allograft versus autograft ACL reconstruction in skeletally immature patients: a systematic review. Br Med Bull. 153(1). https://doi.org/10.1093/bmb/ldae020.

Nagendrababu, V., Gopinath, V. K., Nassar, M., Narasimhan, S., Abbott, P. V., & Duncan, H. F. (2024). A multi-national survey-based evaluation of undergraduate/predoctoral endodontic education. International Endodontic Journal. Advance online publication. https://doi.org/10.1111/iej.14160

Nagendrababu, V., Gopinath, V. K., Nassar, M., Shetty, N., Kishen, A., Abbott, P. V., & Duncan, H. F. (2025). Clinical and preclinical postgraduate training in endodontic education: A transnational exploratory survey. International Dental Journal, 75(4), 100861. https://doi.org/10.1016/j.identj.2025.100861

Naikoo, A. A., Thakur, S. S., Guroo, T. A., & Lone, A. A. (2018). Development of society under modern technology: A review. Scholedge International Journal of Business Policy & Governance, 5(1), 1–8. http://dx.doi.org/10.19085/journal.sijbpg050101

Nathan. (1981). Hematology of Infancy and Childhood. Philadelphia: W.B. Saunders Company.

Newberry, D. J., & Strong, A. D. (2009). Beyond mental health maintenance: An evaluation framework driven by recovery-focused outcomes. Canadian Journal of Community Mental Health, 28(2), 73–94.

Patel. (2007). Respiratory System. Oxford: Mosby.

Paul, W. R. (2002). Critical Thinking.Boston: Library of Congress.

Peter, J. D. (2011). Immunology. Philadelphia: Wiley Blackwell.

Purwanto. (2009). Evaluasi hasil belajar. Yogyakarta: Pustaka Pelajar.

Raja, R., & Nagasubramani, P. C. (2018). Impact of modern technology in education. Journal of applied and advanced research, 3(1), 33-35. https://doi.org/10.21839/jaar.2018.v3is1.165

Ramani, S., & Krackov, S. K. (2012). Twelve tips for giving feedback effectively in the clinical environment. Medical Teacher, 34(10), 787–791. https://doi.org/10.3109/0142159X.2012.684916

Ramani, S., Könings, K. D., Ginsburg, S., & van der Vleuten, C. P. M. (2019). Feedback redefined: Principles and practice. Journal of General Internal Medicine, 34(5), 744–749. https://doi.org/10.1007/s11606-019-04874-2

Rao, V. K. (2007). Quality Education.New Delhi: Balaji Offset.

Rasyid, H., & Mansur. (2008). Penilaian Hasil Belajar. Bandung: Wacana Prima.

Rossi-Fedele, G., Damiani, F., Love, R. M., & others. (2020). Revised guidelines for educational requirements for specialisation in endodontics in Australia and New Zealand (July 2020). Australian Endodontic Journal, 46(3), 302–306. https://doi.org/10.1111/aej.12434

Rusyadi. (2012). Evaluasi Program Kelas Astra Cooperation (AC) pada SMK Negeri 5 Makasar Studi Evaluasi Model CIPP terhadap Program Kerja Sama antara SMK Negeri 5 Makasar dan PT. Astra Internasional. Disertasi, Jakarta: PPs UNJ.

Salim, D. H. B. (2011).Bioetika,Humaniora dan Profesionalisme dalam Profesi Dokter. Jakarta.

Saunders, W. B. (1971). The Psychiatric Interview in Clinical Practice Philadelphia: Library of Congress.

Schwartz. (1999). Principles of Surgery. San Fransisco: Congres Cataloging.

Sean, M. B. (1980). Many Voices, One World. New York: McCorquodale.

Setiabudi, H. T. (1999). Panduan Gerontologi Tinjauan dari berbagai Aspek. Jakarta: PT Gramedia.

Situmorang, R., Atwi, S., & Rudi, S. (2004). Desain Pembelajaran. Jakarta: Universitas Terbuka.

Sneil, R. S. (2007). Clinical Anatomy By Systems.Philadelphia: Library of Congress Cataloging.

Soekidjo, N. (2005). Metodoogi Penelitian Kesehatan. Edisi Revisi. Jakarta: PT. Rineka Cipta.

Srivastava, D. S., & Sarita, K. (2000). Curriculum and Instruction, Delhi: Mehra Offset Press.

Stables, I. (2012). Development of clinical skills: the contribution of peer learning. Learn. Disabil. Pract., 15(8), 1–12. doi:10.7748/ldp2012.10.15.8.12.c9326.

Stufflebeam,  D. L., & Anthony, J. S. (1986).  System Evaluation : A Self-Instructional Guide to Theory and Practice. Boston : Kluwer-Nijhoff Publishing.

Stufflebeam, D., Land, A. J., & Shinkfield. (2007). Evaluation Theory, Models, & Applications. Boston: Jossey-Bass.

Sugiyono. (2009). Metodologi Penelitian Pendidikan, Bandung: Alfabeta.

Sujana, N. (2009). Penillaian Hasil Proses Belajar Mengajar, Bandung: Remaja Rosdakarya.

Sumadi & Aditya, M. (2007). Biologi Sel. Yogyakarta : Graha Ilmu.

Supardi. (2005). Metode Penelitian Ekonomi dan Bisnis.Yogyakarta:UII Press.

Taba, H. (2012). Curriculum Development. New York: Library of Congress Catalog.

Tayibnapis, F. Y. (2008). Evaluasi Program dan Instrumen Evaluasi. Jakarta: PT Rineka Cipta.

Tilaar, H. A. R. (1997). Pengembangan Sumber Daya Manusia dalam Era Globalisasi. Jakarta: Gramedia.

Tîrziu, A. M., & Vrabie, C. (2015). Education 2.0: E-learning methods. Procedia-Social and Behavioral Sciences, 186, 376-380. https://doi.org/10.1016/j.sbspro.2015.04.213

Trankle, S. A., & Reath, J. (2019). Partners in recovery: An early phase evaluation of an Australian mental health initiative using program logic and thematic analysis. BMC Health Services Research, 19(524), 1–18. https://doi.org/10.1186/s12913-019-4360- 2

Unrau, Y. (1993). A program logic model approach to conceptualizing social service programs. The Canadian Journal of Program Evaluation, 8(1), 117–134. 〈https://www .utpjournals.press/doi/pdf/10.3138/cjpe.08.008〉

Vaughan, D. (1983). General Ophthalmology. New Jersey: Lange Medical Publications.

Vojvodic, M., & Ann, Y. (2014). Comprehensive Medical Reference and Review for the Medical Council of Canada Qualifying Exam Part 1 and the United States Medical Licensing Exam Part 2 Canada: Toronto Notes for Medical Students Inc.

Waxman, S. G. (2013). Clinical Neuroanatomy. New York: McGraw-Hill.

Wilde, J., & Suzanne, S. (1995).  Evaluation Hanbook. Evaluation  Assistance Center-Western Region.

Williams. (1997). Obstetrics. New Jersey: Congress Cataloging.

Willis, V. C., Craig, K. J. T., & Jabbarpour, Y. (2022). Digital health interventions to enhance prevention in primary care: scoping review. JMIR Med. Inform. 10 (5)

Wirawan. (2011). Evaluasi: Teori, Model, Standar, Aplikasi dan Profesi. Jakarta: Rajawali Press. 

Worthen, B. R., & James, R. S. (1987). Educational Evaluation, New York & London: Longman.

Wyllie, R. K. M. (2006). Gastrointestinal Haemorrage dalam Buku Pediatric Gastrointestinal and Liver Disease.3rd Edition.Saunders  Elgevier.

Yamada, T. (2005). Gastroenterology. New Jersey: Library of Congress Cataloging.

Zhang K. A. (2024). New Scientific Medical Model: Improvement of theCurrent Biopsychosocial Medical Models. Research 7, 0541. https://doi.org/10.34133/research.0541