The surgical clinical training measurement: developing and evaluating the quality of surgical clinical training among Syrian surgical residents
Submitted by: Ahmad Ghazal & Mayssoon Dashash
Published by: BMC Medical Education
Date: 30 March 2025
Abstract
Background
Evaluation tools for training programs vary, necessitating a standardized tool for assessing surgical clinical training quality to enhance program effectiveness, pinpoint improvement areas, and ensure resident readiness for independent practice. We present a new tool designed to provide a reliable and consistent framework for evaluating the effectiveness of surgical clinical training.
Methods
The Surgical Clinical Training Measurement (SCTM) was developed using the modified Delphi method to evaluate ten variables, including core competencies specific to surgical training. It employs a 5-point Likert scale, with scores ranging from 40 to 200. General surgery residents completed the SCTM twice to evaluate training levels. Results were categorized based on score ranges. Statistical analysis via SPSS included descriptive statistics, group comparisons, internal consistency assessments, correlations, and reliability tests to evaluate the SCTM scores, demographic characteristics, and language versions. ANOVA, Chi-Square, Cohen Kappa, and Spearman’s rho tests were employed for data analysis.
Results
74 general surgery residents at Aleppo University Hospital have participated in this study. The SCTM scores indicated a mean total score of 131.42, with most residents falling into the good satisfactory category. Analysis showed no significant differences in total scores across specialty years, but post-hoc tests revealed differences between specific years. The SCTM demonstrated strong reliability, with a Kappa value of 0.884 indicating high agreement between English and Arabic versions (p < 0.05). Test-retest reliability was also high (r = 0.964, p < 0.01). Internal consistency was excellent across various domains, reinforcing its validity in surgical education. The analysis of variables showed different levels of reliability and mean scores among the various factors. The Pre-Operative Clinical variable had the highest performance, while the Evidence-Based Quality Clinical Training variable indicated the most potential for improvement. The strong positive correlations between various domains of SCTM emphasize the interconnected nature of skill development, with proficiency in patient care closely linked to competency in other areas such as Medical Knowledge, Practice-based Learning and Improvement, and Evidence-Based Quality Clinical Training.
Conclusion
SCTM offers a standardized and cohesive method for evaluating the quality of surgical clinical training. It’s a valuable resource for program directors, educators, and residents to assess and enhance training programs, and identify specific areas for improvement. Additional research is required to validate the SCTM in different settings and explore its applicability in other fields.