Universal Journal of Educational Research Vol. 1(3), pp. 247 - 254
DOI: 10.13189/ujer.2013.010315
Reprint (PDF) (340Kb)


Surgical Theatre (Operating Room) Measure STEEM (OREEM) Scoring Overestimates Educational Environment: the 1-to-L Bias


Ioannis DK Dimoliatis1, Eleni Jelastopulu2,*
1 Department of Hygiene and Epidemiology, University of Ioannina Medical School, Ioannina, Greece
2 Department of Public Health, School of Medicine, University of Patras, Patras, Greece

ABSTRACT

he surgical theatre educational environment measures STEEM, OREEM and mini-STEEM for students (student-STEEM) comprise an up to now disregarded systematic overestimation (OE) due to inaccurate percentage calculation. The aim of the present study was to investigate the magnitude of and suggest a correction for this systematic bias. After an initial theoretical exploration of the problem, published scores were retrieved from the literature and corrected using statistical theorems. Overestimations and differences between pseudo-percentages and real percentages were plotted against real percentages. Reported STEEM overall mean score of 74.4% (pseudopercentage) was corrected to 67.9% (real percentage), eliminating thus the 6.4% OE. Corresponding figures for OREEM and student-STEEM are 73.6%, 67.0%, 6.6% and 69.1%, 61.4%, 7.7% respectively. A total of 45 overestimated scores were retrieved and corrected. OE (range 2.8 to 13.6%, mean 7.3%) showed a complete (r = -1, p < 0.001) negative linear regression of real percentages (RP), namely, OE = 20-0.2*RP. No uncorrected score can achieve less than 20%. The non-0-based 1-to-5 coding overestimates STEEM, OREEM and student-STEEM educational environment scores if expressed as percentages due to the ‘1-to-5 bias’, or rather 1-to-L bias, whereupon L correlates to the number of points in the Likert scale, the number of options. The worse the educational environment the greater the overestimation, reducing instruments’ usefulness exactly then when alarm bells should be ringing. Hence, question coding should always be zero (0) based, as proposed by Likert. The 1-to-L bias applies to any questionnaire at any field of research.

KEYWORDS
Educational Environment, Likert Scale, STEEM / OREEM Questionnaire, Overestimation, Bias, Scoring

Cite this paper
Ioannis DK Dimoliatis , Eleni Jelastopulu . "Surgical Theatre (Operating Room) Measure STEEM (OREEM) Scoring Overestimates Educational Environment: the 1-to-L Bias." Universal Journal of Educational Research 1.3 (2013) 247 - 254. doi: 10.13189/ujer.2013.010315.