Validity evidence and reliability of a Simulated Patient Feedback Instrument

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Metacognitive monitoring and control in elementary school children: Their interrelations and their role for test performance

Contemporary models of self-regulated learning emphasize the role of distal motivational factors for student's achievement, on the one side, and the proximal role of metacognitive monitoring and control for learning and test outcomes, on the other side. In the present study, two larger samples of elementary school children (9- and 11-year-olds) were included and their mastery-oriented motivation, metacognitive monitoring and control skills were integrated into structural equation models testing and comparing the relative impact of these different constituents for self-regulated learning. For one, results indicate that the factorial structure of monitoring, control and mastery motivation was invariant across the two age groups. Of specific interest was the finding that there were age-dependent structural links between monitoring, control, and test performance (closer links in the older compared to the younger children), with high confidence yielding a direct and positive effect on test performance and a direct and negative effect on adequate control behavior in the achievement test. Mastery-oriented motivation was not found to be substantially associated with monitoring (confidence), control (detection and correction of errors), or test performance underlining the importance of proximal, metacognitive factors for test performance in elementary school children.