Do multiple true-false items beat the commonly used one-best-answers questions regarding to the Ottawa Criteria for Good Assessment? Results of a literature review

Background: Multiple True-False-Items (MTF-Items) might offer some advantages compared to one-best-answer-questions (TypeA) as they allow more than one correct answer and may better represent clinical decisions. However, in medical education assessment MTF-Items are seldom used. Summary of Work: With this literature review existing findings on MTF-items and on TypeA were compared along the Ottawa Criteria for Good Assessment, i.e. (1) reproducibility, (2) feasibility, (3) validity, (4) acceptance, (5) educational effect, (6) catalytic effects, and (7) equivalence. We conducted a literature research on ERIC and Google Scholar including papers from the years 1935 to 2014. We used the search terms “multiple true-false”, “true-false”, “true/false”, and “Kprim” combined with “exam”, “test”, and “assessment”. Summary of Results: We included 29 out of 33 studies. Four of them were carried out in the medical field Compared to TypeA, MTF-Items are associated with (1) higher reproducibility (2) lower feasibility (3) similar validity (4) higher acceptance (5) higher educational effect (6) no studies on catalytic effects or (7) equivalence. Discussion and Conclusions: While studies show overall good characteristics of MTF items according to the Ottawa criteria, this type of question seems to be rather seldom used. One reason might be the reported lower feasibility. Overall the literature base is still weak. Furthermore, only 14 % of literature is from the medical domain. Further studies to better understand the characteristics of MTF-Items in the medical domain are warranted. Take-home messages: Overall the literature base is weak and therefore further studies are needed. Existing studies show that: MTF-Items show higher reliability, acceptance and educational effect; MTF-Items are more difficult to produce

Teaching and assessment of implant dentistry in undergraduate and postgraduate education: a European consensus

This paper constitutes a summary of the consensus documents agreed at the First European Workshop on Implant Dentistry University Education held in Prague on 19-22 June 2008. Implant dentistry is becoming increasingly important treatment alternative for the restoration of missing teeth, as patients expectations and demands increase. Furthermore, implant related complications such as peri-implantitis are presenting more frequently in the dental surgery. This consensus paper recommends that implant dentistry should be an integral part of the undergraduate curriculum. Whilst few schools will achieve student competence in the surgical placement of implants this should not preclude the inclusion of the fundamental principles of implant dentistry in the undergraduate curriculum such as the evidence base for their use, indications and contraindications and treatment of the complications that may arise. The consensus paper sets out the rationale for the introduction of implant dentistry in the dental curriculum and the knowledge base for an undergraduate programme in the subject. It lists the competencies that might be sought without expectations of surgical placement of implants at this stage and the assessment methods that might be employed. The paper also addresses the competencies and educational pathways for postgraduate education in implant dentistry.

Education of tobacco use prevention and cessation for dental professionals--a paradigm shift

The use of tobacco continues to be a substantial risk factor in the development and progression of oral cancer, periodontitis, implant failure and poor wound healing. Dental and dental hygiene education providers have made great advances towards the incorporation of tobacco education into their curricula in recent years. Unfortunately, however, both medical and dental education research has consistently reported schools providing only basic knowledge-based curricula that rarely incorporate more effective, behaviourally-based components affecting long-term change. The limited training of oral healthcare students, at least in part, is reflected in practising dental professionals continuing to report offering incomplete tobacco interventions. In order to prepare the next generation of oral healthcare providers, this paper proposes a paradigm shift in how tobacco use prevention and cessation (TUPAC) may be incorporated into existing curricula. It is suggested that schools should carefully consider: to what level of competency should TUPAC be trained in dental and dental hygiene schools; the importance of establishing rapport through good communication skills; the core knowledge level for TUPAC; suggested instructional and assessment strategies; the importance of continuing professional education for the enhancement of TUPAC.

A PRISMA assessment of the reporting quality of systematic reviews in orthodontics

Abstract Objectives: To assess the reporting quality of Cochrane and non-Cochrane systematic reviews (SR) in orthodontics and to compare the reporting quality (PRISMA score) with methodological quality (AMSTAR criteria). Materials and Methods: Systematic reviews (n  =  109) published between January 2000 and July 2011 in five leading orthodontic journals were identified and included. The quality of reporting of the included reviews was assessed by two authors in accordance with the PRISMA guidelines. Each article was assigned a cumulative grade based on fulfillment of the applicable criteria, and an overall percentage score was assigned. Descriptive statistics and simple and multiple linear regression analyses were undertaken. Results: The mean overall PRISMA score was 64.1% (95% confidence interval [CI], 62%-65%). The quality of reporting was considerably better in reviews published in the Cochrane Database of Systematic Reviews (P < .001) than in non-Cochrane reviews. Both multivariable and univariable analysis indicated that journal of publication and number of authors was significantly associated with the PRISMA score. The association between AMSTAR score and modified PRISMA score was also found to be highly statistically significant. Conclusion: Compliance of orthodontic SRs published in orthodontic journals with PRISMA guidelines was deficient in several areas. The quality of reporting assessed using PRISMA guidelines was significantly better in orthodontic SRs published in the Cochrane Database of Systematic Reviews.

Comparative assessment of clinical performance of esthetic bracket materials

To compare the alterations in esthetic appearance and slot morphology/integrity of two main types of esthetic brackets caused after clinical use.

Can level of education, accreditation and use of databases in cardiac rehabilitation be improved? Results from the European Cardiac Rehabilitation Inventory Survey

Professional skills, education and accreditation, along with clinical outcome assessment, are considered important factors to achieve comprehensive delivery and quality of cardiac rehabilitation (CR). This study assessed professional educational programmes, accreditation and use of databases in CR across the European countries.

Potential of information technology in dental education

The use of information technology (IT) in dentistry is far ranging. In order to produce a working document for the dental educator, this paper focuses on those methods where IT can assist in the education and competence development of dental students and dentists (e.g. e-learning, distance learning, simulations and computer-based assessment). Web pages and other information-gathering devices have become an essential part of our daily life, as they provide extensive information on all aspects of our society. This is mirrored in dental education where there are many different tools available, as listed in this report. IT offers added value to traditional teaching methods and examples are provided. In spite of the continuing debate on the learning effectiveness of e-learning applications, students request such approaches as an adjunct to the traditional delivery of learning materials. Faculty require support to enable them to effectively use the technology to the benefit of their students. This support should be provided by the institution and it is suggested that, where possible, institutions should appoint an e-learning champion with good interpersonal skills to support and encourage faculty change. From a global prospective, all students and faculty should have access to e-learning tools. This report encourages open access to e-learning material, platforms and programs. The quality of such learning materials must have well defined learning objectives and involve peer review to ensure content validity, accuracy, currency, the use of evidence-based data and the use of best practices. To ensure that the developers' intellectual rights are protected, the original content needs to be secure from unauthorized changes. Strategies and recommendations on how to improve the quality of e-learning are outlined. In the area of assessment, traditional examination schemes can be enriched by IT, whilst the Internet can provide many innovative approaches. Future trends in IT will evolve around improved uptake and access facilitated by the technology (hardware and software). The use of Web 2.0 shows considerable promise and this may have implications on a global level. For example, the one-laptop-per-child project is the best example of what Web 2.0 can do: minimal use of hardware to maximize use of the Internet structure. In essence, simple technology can overcome many of the barriers to learning. IT will always remain exciting, as it is always changing and the users, whether dental students, educators or patients are like chameleons adapting to the ever-changing landscape.

Further concerns about self-assessment: are medical students aware of their progress in clinical skills during clerkship

Background: Medical students do not accurately self-assess their competence. However, little is known about the awareness of change of competence over time. The aim of this study was to evaluate if students are aware of their progress. Summary of work: Twenty-two fourth year medical students had self- and expert-assessments of their clinical skills in musculoskeletal medicine in an OSCE like station (4 point Likert scale) at the beginning (t0) and end (t1) of their eight weeks clerkship in internal medicine. Thirteen students were assigned to the intervention of a 6x1 hour practical examination course; nine took part in the regular clinical clerkship activities only and served as controls. Summary of results/Conclusions: The intervention students significantly improved their skills (from 2.78 ± 0.36 to 3.30 ± 0.36, p<0.05) in contrast to the control students (from 3.11 ± 0.58 to 2.83 ± 0.49, n.s.). At t0, 19 students, at t1 21 out of 22 students underestimated their competence. Correlations between the change of self- and expert-assessment were r=0.43, p<0.05 (all), r=0.47, n.s. (control) and r=-0.12, n.s. (intervention), respectively. Take-home message: Medical students improving their clinical skills by an interactive course in addition to their regular clerkship activities are not aware of their progress

Participation in Further Education over the Life Course: a longitudinal study of three birth cohorts in the Federal Republic of Germany

In this paper we address the issue of who is most likely to participate in further training, for what reasons and at what stage of the life course. Special emphasis is given to the impact of labour-market policies to encourage further education and a person's individual or cohort possibilities to participate in further education. We apply a Cox proportional hazard model to data from the West German Life History Study, separately for women and men, within and outside the firm. Younger cohorts show not only higher proportions of participation in further education and training at early stages of the life course, they also continue to participate in higher numbers during later stages of the life course. General labour-force participation reduces and tenure with the same firm increases the propensity to participate in further education and training. Contrary to expectations, in Germany labour-market segmentation has been enhanced rather than reduced by further education and training policies, since in the firm-specific labour-market segment, i.e. skilled jobs in large firms, and in the public sector both women and men had a higher probability of participation. Particularly favourable conditions for participation in further education outside the firm prevailed during the first years of the labour promotion act (Arbeitsförderungsgesetz) between 1969 and 1974, but women did not benefit to the same extent as men. Training policies are, therefore, in need of continuous assessment based on a goal-achievement evaluation to avoid any unintended effects of such policies.

Challenges for medical educators: results of a survey among members of the German Association for Medical Education

BACKGROUND Despite the increasing interest in medical education in the German-speaking countries, there is currently no information available on the challenges which medical educators face. To address this problem, we carried out a web-based survey among the members of the Association for Medical Education (Gesellschaft für medizinische Ausbildung, GMA). METHODS A comprehensive survey was carried out on the need for further qualifications, expertise and the general conditions of medical educators in Germany. As part of this study, the educators were asked to list the three main challenges which they faced and which required urgent improvement. The results were analysed by means of qualitative content analysis. RESULTS The questionnaire was completed by 147 of the 373 members on the GMA mailing list (response rate: 39%). The educators named a total of 346 challenges and emphasised the following areas: limited academic recognition for engagement in teaching (53.5% of educators), insufficient institutional (31.5%) and financial support (28.4%), a curriculum in need of reform (22.8%), insufficient time for teaching assignments (18,9%), inadequate teacher competence in teaching methods (18.1%), restricted faculty development programmes (18.1%), limited networking within the institution (11.0%), lack of teaching staff (10.2%), varying preconditions of students (8.7%), insufficient recognition and promotion of medical educational research (5.5%), extensive assessment requirements (4.7%), and the lack of role models within medical education (3.2%). CONCLUSION The medical educators found the biggest challenges which they faced to be limited academic recognition and insufficient institutional and financial support. Consequently, improvements should be implemented to address these issues.