In-training assessment - Its potential in enhancing clinical teaching

Context In-training assessment (ITA) has established its place alongside formative and summative assessment at both the undergraduate and postgraduate level. In this paper the authors aimed to identify those characteristics of ITA that could enhance clinical teaching. Methods A literature review and discussions by an expert working group at the Ninth Cambridge Conference identified the aspects of ITA that could enhance clinical teaching. Results The features of ITA identified included defining the specific benefits to the learner, teacher and institution, and highlighting the patient as the context for ITA and clinical teaching. The ‘mapping’ of a learner’s progress towards the clinical teaching objectives by using multiple assessments over time, by multiple observers in both a systematic and opportunistic way correlates with the incremental nature of reaching clinical competence. Conclusions The importance of ITA based on both direct and indirect evidence of what the learner actually does in the real clinical setting is emphasized. Particular attention is given to addressing concerns in the more controversial areas of assessor training, ratings and documentation for ITA. Areas for future research are also identified.

Quality Assurance and Assessment in Technical Education System: A Web Based Approach

Engineering education quality embraces the activities through which a technical institution satisfies itself that the quality of education it provides and standards it has set are appropriate and are being maintained. There is a need to develop a standardised approach to most aspects of quality assurance for engineering programmes which is sufficiently well defined to be accepted for all assessments.We have designed a Technical Educational Quality Assurance and Assessment (TEQ-AA) System, which makes use of the information on the web and analyzes the standards of the institution. With the standards as anchors for definition, the institution is clearer about its present in order to plan better for its future and enhancing the level of educational quality.The system has been tested and implemented on the technical educational Institutions in the Karnataka State which usually host their web pages for commercially advertising their technical education programs and their Institution objectives, policies, etc., for commercialization and for better reach-out to the students and faculty. This helps in assisting the students in selecting an institution for study and to assist in employment.

Global and local challenges for best practices in assessment. The 9th Conference on the International Test Commission. Book of abstracts

The 9th International Test Commission Conference (ITC) took place at the Miramar Palace in San Sebastian, Spain, between the 2nd and 5th of July, 2014. The Conference was titled, “Global and Local Challenges for Best Practices in Assessment.” The International Test Commission, ITC (www.intestcom.org), is an association of national psychological associations, test commissions, publishers, and other organizations, as well as individuals who are committed to the promotion of effective testing and assessment policies and to the proper development, evaluation, and uses of educational and psychological instruments. The ITC facilitates the exchange of information among members and stimulates their cooperation on problems related to the construction, distribution, and uses of psychological and educational tests and other psychodiagnostic tools. This volume contains the abstracts of the contributions presented at the 9th International Test Commission Conference. The four themes of the Conference were closely linked to the goals of the ITC: - Challenges and Opportunities in International Assessment. - Application of New Technoloogies and New Psychometric Models in Testing. - Standards and Guidelines for Best Testing Practices. - Testing in Multilingual and Multicultural Contexts.

Reflections on the development of a dynamic learning, teaching and assessment strategy.

Developing learning, teaching and assessment strategies that foster ongoing engagement and provide inspiration to academic staff is a particular challenge. This paper demonstrates how an institutional learning, teaching and assessment strategy was developed and a ‘dynamic’ strategy created in order to achieve the ongoing enhancement of the quality of the student learning experience. The authors use the discussion of the evolution, development and launch of the Strategy and underpinning Resource Bank to reflect on the hopes and intentions behind the approach; firstly the paper will discuss the collaborative and iterative approach taken to the development of an institutional learning, teaching and assessment strategy; and secondly, the development of open access educational resources to underpin the strategy. The paper then outlines staff engagement with the resource bank and positive outcomes which have been identified to date, identifies the next steps in achieving the ambition behind the strategy and outlines the action research and fuller evaluation which will be used to monitor progress and ensure responsive learning at institutional level.

Training in and assessment of the procedural skills required to perform peripheral nerve blockade

The training and ongoing education of medical practitioners has undergone major changes in an incremental fashion over the past 15 years. These changes have been driven by patient safety, educational, economic and legislative/regulatory factors. In the near future, training in procedural skills will undergo a paradigm shift to proficiency based progression with associated requirements for competence-based programmes, valid, reliable assessment tools and simulation technology. Before training begins, the learning outcomes require clear definition; any form of assessment applied should include measurement of these outcomes. Currently training in a procedural skill often takes place on an ad hoc basis. The number of attempts necessary to attain a defined degree of proficiency varies from procedure to procedure. Convincing evidence exists that simulation training helps trainees to acquire skills more efficiently rather than relying on opportunities in their clinical practice. Simulation provides a safe, stress free environment for trainees for skill acquisition, generalization and transfer via deliberate practice. The work described in this thesis contributes to a greater understanding of how medical procedures can be performed more safely and effectively through education. The effect of feedback, provided to novices in a standardized setting on a bench model, based on knowledge of performance was associated with an increase in the speed of skill acquisition and a decrease in error rate during initial learning. The timing of feedback was also associated with effective learning of skill. A marked attrition of skills (independent of the type of feedback provided) was demonstrable 24 hrs after they have first been learned. Using the principles of feedback as described above, when studying the effect of an intense training program on novices of varied years of experience in anaesthesia (i.e. the present training programmes / courses of an intense training day for one or more procedures). There was a marked attrition of skill at 24 hours with a significant correlation with increasing years of experience; there also appeared to be an inverse relationship between years of experience in anaesthesia and performance. The greater the number of years of practice experience, the longer it required a learner to acquire a new skill. The findings of the studies described in this thesis may have important implications for the trainers, trainees and training bodies in the design and implementation of training courses and the formats of delivery of changing curricula. Both curricula and training modalities will need to take account of characteristics of individual learners and the dynamic nature of procedural healthcare.

Consulting pupils in Assessment for Learning classrooms: the twists and turns of working with students as co-researchers

This is an invited paper to a special issue on pupil voice focusing on methodological issues arising from the ESRC/TLRP project on consulting pupils about assessment practices in their classrooms. The issue of consulting pupils about assessment has rarely been researched before but what this article illustrates are some of the difficulties, tensions and positive outcomes of engaging with students as researchers within a nationally funded (and therefore externally driven), university-based project. This study adds considerably to the body of knowledge in this area by engaging students in the process as researchers in different capacities within the project. Issues discussed include the use of student advisory groups, ethical negotiation, students undertaking videotaped classroom observations and their subsequent role in co-interpreting video excerpts and visual images. The paper has attracted considerable interest already through the ESRC pupil seminar series forum and also from a prior paper presentation to the European Educational Research Association in September 2006 in Switzerland to the Childrens' Rights SIG becasue of researchers' current interests in embedding democratic principles and practices within research with children and young people.

Practicum in Educational Psychology: comparative analysis between areas of knowledge

In this paper we present the process and results of an investigation in which, after reflecting on the concept of Practicum and, specifically, in the Practicum in Educational Psychology degree taught at the University of A Coruña, an assessment is made taking into account the opinion of the students who have studied this matter, as to the relevance that the planned objectives are given and subsequent achievement of these. The results differ considering the area that the teacher who has tutored belongs to. Methodologicaly, it is a descriptive research, survey type, which involved a significant sample of students in their final year of the degree in the year 2012/13 through a questionnaire which validity (Teaching and content) and reliability (internal consistency) have been properly set (judgment of experts and a pilot experience for the calculation of Cronbach's alpha). The results show that the Practicum program has a good development of most of the objectives, especially those related to skills, where the average of the highest rated goals exceed the rating of 4. This suggests clear lines for innovation and improvement in the areas of conceptual and attitudinal level.

Revisioning assessment through a children’s rights approach: implications for policy, process and practice

The linkage between the impact of assessment and compliance with children’s rights is a connection, which although seemingly obvious, is nonetheless rarely made, particularly by governments, which, as signatories to the relevant human rights treaties, have the primary responsibility for ensuring that educational practice is compatible with international children’s rights standards. While some jurisdictions are explicit about an adherence to children’s rights frameworks in general policy documentation, such a commitment rarely features when the focus is on assessment and testing. Thus, in spite of significant public and academic attention given to the consequences of assessment for children and governments committed to working within children’s rights standards, the two are rarely considered together. This paper examines the implications for the policy, process and practice of assessment in light of international human rights standards. Three key children’s rights principles and standards are used as a critical lens to examine assessment policy and practice: (1) best interests; (2) non-discrimination; and (3) participation. The paper seeks new insights into the complexities of assessment practice from the critical perspective of children’s rights and argues that such standards not only provide a convenient benchmark for developing, implementing and evaluating assessment practices, but also acknowledge the significance of assessment in the delivery of children’s rights to, in and through education more generally.