A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

OBJECTIVE: To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education. METHODS: In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. RESULTS: Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. CONCLUSIONS: Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.

Documenting the Contextualization and Implementation of mhGAP-HIG in Post-earthquake Nepal

Background: The burden of mental health is increased in humanitarian settings, and needs to be addressed in emergency situations. The World Health Organization has recently released the mental health Global Action Programme Humanitarian Intervention Guide (mhGAP-HIG) in order to scale up mental health service delivery in humanitarian settings through task-shifting. This study aims to evaluate, contextualize and identify possible barriers and challenges to mhGAP-HIG manual content, training and implementation in post-earthquake Nepal.

Methods: This qualitative study was conducted in Kathmandu, Nepal. Key informant interviews were conducted with fourteen psychiatrists involved in a mhGAP-HIG Training of Trainers and Supervisors (ToTS) in order to assess the mhGAP-HIG, ToTS training, and the potential challenges and barriers to mhGAP-HIG implementation. Themes identified by informants were supplemented by process notes taken by the researcher during observed training sessions and meetings.

Results: Key themes emerging from key informant interviews include the need to take three factors into account in manual contextualization: culture, health systems and the humanitarian setting. This includes translation of the manual into the local language, adding or expanding upon conditions prevalent in Nepal, and more consideration to improving feasibility of manual use by non-specialists.

Conclusion: The mhGAP-HIG must be tailored to specific humanitarian settings for effective implementation. This study shows the importance of conducting a manual contextualization workshop prior to training in order to maximize the feasibility and success in training health care workers in mhGAP.