Reliability assessment of a peer evaluation instrument in a team-based learning course

Objective: To evaluate the reliability of a peer evaluation instrument in a longitudinal team-based learning setting. Methods: Student pharmacists were instructed to evaluate the contributions of their peers. Evaluations were analyzed for the variance of the scores by identifying low, medium, and high scores. Agreement between performance ratings within each group of students was assessed via intra-class correlation coefficient (ICC). Results: We found little variation in the standard deviation (SD) based on the score means among the high, medium, and low scores within each group. The lack of variation in SD of results between groups suggests that the peer evaluation instrument produces precise results. The ICC showed strong concordance among raters. Conclusions: Findings suggest that our student peer evaluation instrument provides a reliable method for peer assessment in team-based learning settings.

Quality of implementation in an evidence-based family prevention program: the Family Competence Program

Family prevention programs need to be evidence-based in order to guarantee the success of their implementation. The Family Competence Program (FCP), a Spanish cultural adaptation of the Strengthening Families Program (SFP), has developed different measures and processes to gauge the quality of the implementation. This article is dedicated specifically to two of these measures: the evaluation of the facilitators and the assessment of the family engagement techniques. For evaluating the facilitators, a Delphi technique with experts and professionals is undertaken. For assessing the family techniques, both self-evaluation of trainers and evaluation by families are used. Finding underpin that, in the case of facilitators, is important that, after to skills and experience, they need to understand the theory of change of the program. In the case of family engagement techniques, more detailed, comprehensive talks, discussions and group activities lead to better family engagement outcomes.