In-training assessment - Its potential in enhancing clinical teaching

Context In-training assessment (ITA) has established its place alongside formative and summative assessment at both the undergraduate and postgraduate level. In this paper the authors aimed to identify those characteristics of ITA that could enhance clinical teaching. Methods A literature review and discussions by an expert working group at the Ninth Cambridge Conference identified the aspects of ITA that could enhance clinical teaching. Results The features of ITA identified included defining the specific benefits to the learner, teacher and institution, and highlighting the patient as the context for ITA and clinical teaching. The ‘mapping’ of a learner’s progress towards the clinical teaching objectives by using multiple assessments over time, by multiple observers in both a systematic and opportunistic way correlates with the incremental nature of reaching clinical competence. Conclusions The importance of ITA based on both direct and indirect evidence of what the learner actually does in the real clinical setting is emphasized. Particular attention is given to addressing concerns in the more controversial areas of assessor training, ratings and documentation for ITA. Areas for future research are also identified.

Training in and assessment of the procedural skills required to perform peripheral nerve blockade

The training and ongoing education of medical practitioners has undergone major changes in an incremental fashion over the past 15 years. These changes have been driven by patient safety, educational, economic and legislative/regulatory factors. In the near future, training in procedural skills will undergo a paradigm shift to proficiency based progression with associated requirements for competence-based programmes, valid, reliable assessment tools and simulation technology. Before training begins, the learning outcomes require clear definition; any form of assessment applied should include measurement of these outcomes. Currently training in a procedural skill often takes place on an ad hoc basis. The number of attempts necessary to attain a defined degree of proficiency varies from procedure to procedure. Convincing evidence exists that simulation training helps trainees to acquire skills more efficiently rather than relying on opportunities in their clinical practice. Simulation provides a safe, stress free environment for trainees for skill acquisition, generalization and transfer via deliberate practice. The work described in this thesis contributes to a greater understanding of how medical procedures can be performed more safely and effectively through education. The effect of feedback, provided to novices in a standardized setting on a bench model, based on knowledge of performance was associated with an increase in the speed of skill acquisition and a decrease in error rate during initial learning. The timing of feedback was also associated with effective learning of skill. A marked attrition of skills (independent of the type of feedback provided) was demonstrable 24 hrs after they have first been learned. Using the principles of feedback as described above, when studying the effect of an intense training program on novices of varied years of experience in anaesthesia (i.e. the present training programmes / courses of an intense training day for one or more procedures). There was a marked attrition of skill at 24 hours with a significant correlation with increasing years of experience; there also appeared to be an inverse relationship between years of experience in anaesthesia and performance. The greater the number of years of practice experience, the longer it required a learner to acquire a new skill. The findings of the studies described in this thesis may have important implications for the trainers, trainees and training bodies in the design and implementation of training courses and the formats of delivery of changing curricula. Both curricula and training modalities will need to take account of characteristics of individual learners and the dynamic nature of procedural healthcare.

Assessment of adult and youth performance standards under the Job Training Partnership Act /

"November 1985."

Assessment of a WIN quality training demonstration project : phase II report : training and early placement experiences /

Prepared under: grant no. 51-11-78-03 from the Employment and Training Administration, U.S. Department of Labor.

Selecting, training and assessing new general practice community teachers in UK medical schools

Background: Standards for undergraduate medical education in the UK, published in Tomorrow’s Doctors, include the criterion ‘everyone involved in educating medical students will be appropriately selected, trained, supported and appraised’. Aims: To establish how new general practice (GP) community teachers of medical students are selected, initially trained and assessed by UK medical schools and establish the extent to which Tomorrow’s Doctors standards are being met. Method: A mixed-methods study with questionnaire data collected from 24 lead GPs at UK medical schools, 23 new GP teachers from two medical schools plus a semi-structured telephone interview with two GP leads. Quantitative data were analysed descriptively and qualitative data were analysed informed by framework analysis. Results: GP teachers’ selection is non-standardised. One hundred per cent of GP leads provide initial training courses for new GP teachers; 50% are mandatory. The content and length of courses varies. All GP leads use student feedback to assess teaching, but other required methods (peer review and patient feedback) are not universally used. Conclusions: To meet General Medical Council standards, medical schools need to include equality and diversity in initial training and use more than one method to assess new GP teachers. Wider debate about the selection, training and assessment of new GP teachers is needed to agree minimum standards.

Using secret shopping to assess student assistant training

This paper aims to describe the results of three rounds of secret shopping conducted at the Hubert Library of Florida International University, and how the results affected and were affected by changes made to circulation desk student training programs.

Facilitating unlearning during implementation of new technology

Purpose – One of the critical issues for change management, particularly in relation to the implementation of new technologies, is the existence of prior knowledge and established mental models which may hinder change efforts. Understanding unlearning and how it might assist during organizational change is a way to address this resistance. The purpose of this paper is to present research designed to identify specific factors that facilitate unlearning. Design/methodology/approach – Drawing together issues identified as potential influencers of unlearning, a survey questionnaire was developed and administered in an Australian corporation undergoing large-scale change due to the implementation of an enterprise information system. The results were analyzed to identify specific factors that impact on unlearning. Findings – Findings from this paper identify factors that hinder or help the unlearning process during times of change including understanding the need for change, the level of organizational support and training, assessment of the change, positive experience and informal support, the organization's history of change, individual's prior outlooks, and individuals' feelings and expectations. Research limitations/implications – The use of only one organization does not allow for comparisons between organizations of different sizes, cultures or industries and therefore extension of this research is recommended. Practical implications – For practitioners, this paper provides specific elements at both the level of individuals and the organization that need to be considered for optimal unlearning during times of change. Originality/value – Previous literature on unlearning has been predominantly conceptual and theoretical. These empirical findings serve to further an earlier model based on qualitative research into potential influencers of unlearning.

Intern underperformance is detected more frequently in emergency medicine rotations

Objective: To determine the frequency and nature of intern underperformance as documented on in-training assessment forms. Methods: A retrospective review of intern assessment forms from a 2 year period (2009–2010) was conducted at a tertiary referral hospital in Brisbane, Queensland. The frequency of interns assessed as ‘requiring substantial assistance’ and/or ‘requires further development’ on mid- or end-of-term assessment forms was determined. Forms were analysed by the clinical rotation, time of year and domain(s) of clinical practice in which underperformance was documented. Results: During 2009 and 2010 the overall documented incidence of intern underperformance was 2.4% (95% CI 1.5–3.9%). Clinical rotation in emergency medicine detected significantly more underperformance compared with other rotations (P < 0.01). Interns predominantly had difficulty with ‘clinical judgment and decision-making skills’, ‘time management skills’ and ‘teamwork and colleagues’ (62.5%, 55% and 32.5% of underperforming assessments, respectively). Time of the year did not affect frequency of underperformance. A proportion of 13.4% (95% CI 9.2–19.0%) of interns working at the institution over the study period received at least one assessment in which underperformance was documented. Seventy-six per cent of those interns who had underperformance identified by mid-term assessment successfully completed the term following remediation. Conclusion: The prevalence of underperformance among interns is low, although higher than previously suggested. Emergency medicine detects relatively more interns in difficulty than other rotations.

Instrumentos de evaluación utilizados en la formación inicial del profesorado y su coherencia para el desarrollo de competencias profesionales en los estudiantes: visión del alumnado, egresados y profesorado

El objetivo de este trabajo es analizar la frecuencia con que se utilizan diferentes instrumentos y procedimientos de evaluación desde el punto de vista del profesorado, del alumnado y de los egresados en la formación inicial de maestros y profesores especialistas en Educación Física, así como el grado de coherencia –relación- percibido por cada uno de esos grupos implicados entre dichos instrumentos y procedimientos de evaluación y el desarrollo de las competencias profesionales que se pretende adquieran los estudiantes. La muestra objeto de estudio está compuesta por 199 alumnos, 67 egresados y 53 profesores de las titulaciones de Magisterio (especialidad de Educación Física) y Ciencias de la Actividad Física y el Deporte de las universidades de Valladolid, Salamanca y León. Los resultados muestran una clara discrepancia entre los distintos grupos analizados, tanto en lo referido al tipo de instrumentos de evaluación utilizados, como en la valoración del grado de coherencia entre estos y el desarrollo de las competencias profesionales de los futuros maestros.

A formação em rastreio e intervenções breves do álcool muda as atitudes dos profissionais de saúde ocupacional? : estudo quasi experimental exploratório para uma estratégia para o meio laboral

RESUMO - Estudos anteriores nos Cuidados de Saúde Primários (CSP) apontam para um incremento da Deteção Precoce (DP) e Intervenções Breves (IB) em pacientes com Problemas Ligados ao Álcool (PLA) após formação apropriada dos profissionais de saúde (com melhoria das suas atitudes). Este estudo quasi experimental, exploratório, é pioneiro no âmbito da Saúde Ocupacional (SO) para a implementação de Rastreio/DP e IB nos PLA. O objetivo principal foi avaliar se uma formação sobre Rastreio/DP e IB pode melhorar as atitudes dos profissionais de SO ao lidar com os PLA em Meio Laboral (PLAML). Foi aplicado um questionário em duas partes: Q1/pré-formação (variáveis sociodemográficas, profissionais, competências em alcoologia, experiência pessoal com álcool/familiares com PLA, dificuldades em lidar com trabalhadores com PLA, AUDIT-C e SAAPPQ) e Q2/pós-formação (avaliação da formação e das atitudes SAAPPQ - Adequação, Legitimidade, Motivação, Autoestima e Satisfação). Os resultados na amostra (N=39) revelaram um aumento sobretudo na Adequação e Satisfação. No entanto, naqueles com níveis baixos das atitudes pré-formação constou-se melhoria das atitudes à excepção da Autoestima e foram encontradas algumas associações com as características do perfil inicial dos participantes. Sugerem-se estudos posteriores para identificação de pacotes formativos mais efetivos e propostas para um Plano integrador de RIB para PLAML

Making teamwork work

This paper explores team assignments as an increasingly common component of many university courses. It argues that a need exists for all instructors, particularly those involved in the teaching of business communication, to develop a multi-faceted teamwork perspective which encompasses every dimension of team assignments. Such a perspective should permeate assignment design, student training, assessment of team process as well as product, self and peer assessment and the individualisation of student scores. Each of these facets is discussed with reference to research literature with a number of practical suggestions provided as exemplars for how to make teamwork work.

The influence of organisational commitment, job involvement and utility perceptions on trainees’ motivation to improve work through learning

Workplace training is a key strategy often used by organisations to optimise performance. Further, trainee motivation is a key determinant of the degree to which the material learned in a training programme will be transferred to the workplace, enhancing the performance of the trainee. This study investigates the relationship between several components of the Revised Human Resource Development (HRD) Evaluation and Research Model. This model provides a framework for diagnosing and understanding the causal influences of HRD intervention outcomes on training effectiveness. Data were obtained from an online questionnaire completed by 105 employees of various organisations. Findings revealed that affective organisational commitment, job involvement and utility perceptions are predictors of motivation to learn and transfer learning. An interaction effect was found, with increased affective organisational commitment predicting greater motivation to learn when training was of lower perceived utility. These findings suggest that the design and delivery of training should emphasise the relevance and utility of the programme in order to encourage greater trainee motivation and maximise return on investment. Additionally, implementing strategies aimed at promoting organisational commitment would appear beneficial.

Modelo de integração de sistemas de gestão da qualidade e gestão ambiental

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Inclusão da pessoa com deficiência intelectual no mercado de trabalho: avaliação de um programa de capacitação profissional

Pós-graduação em Psicologia do Desenvolvimento e Aprendizagem - FC