Developing multiple - choice questions in mathematics

In this paper we wish to illustrate different perspectives used to create Multiple-Choice questions and we will show how we can improve these in the construction of math tests. As it is known, web technologies have a great influence on student’s behaviour. Based on an on-line project beginning at 2007 which has been contributing to help students on their individual work, we would like to share our experience and thoughts with colleagues who have a common concern when they have the task of constructing Multiple-Choice tests. We feel that Multiple-Choice tests play an important and a very useful supporting role in selfevaluation or self-examination of our students. Nonetheless, good Multiple–Choice Test Items are generally more complex and time-consuming to create than other types of tests. It requires a certain amount of skill. However, this skill maybe increases through study, practice and experience. This paper discusses a number of issues related to the use of Multiple-Choice questions, lists the advantages and disadvantages of this question format contrasting it with open questions. Some examples are given in this context.

E-assessment in mathematics courses with multiple-choice questions tests

With the implementation of the Bologna Process several challenges have been posed to higher education institution, particularly in Portugal. One of the main implications is related to the change of the paradigm of a teacher centered education, to a paradigm that is student centered. This change implies the change of the way to assess courses in higher education institutions. Continuous and formative assessments emerged as the focus, catalyzed by electronic assessment, or e-assessment. This paper presents a case of the implementation of an e-assessment strategy, implemented in order to allow continuous, formative assessment in numerous mathematics classes using multiple-choice questions tests implement in Moodle open-source learning management system. The implementation can be considered a success.

E-assessment in mathematics courses with multiple-choice questions tests

With the implementation of the Bologna Process several challenges have been posed to higher education institution, particularly in Portugal. One of the main implications is related to the change of the paradigm of a teacher centered education, to a paradigm that is student centered. This change implies the change of the way to assess courses in higher education institutions. Continuous and formative assessments emerged as the focus, catalyzed by electronic assessment, or e-assessment. This paper presents a case of the implementation of an e-assessment strategy, implemented in order to allow continuous, formative assessment in numerous mathematics classes using multiple-choice questions tests implement in Moodle open-source learning management system. The implementation can be considered a success.

Computer-based summative assessment of clinical reasoning in clerkships: A mixed-method comparison of key feature problems with case-based multiple choice questions

Background: It is yet unclear if there are differences between using electronic key feature problems (KFPs) or electronic case-based multiple choice questions (cbMCQ) for the assessment of clinical decision making. Summary of Work: Fifth year medical students were exposed to clerkships which ended with a summative exam. Assessment of knowledge per exam was done by 6-9 KFPs, 9-20 cbMCQ and 9-28 MC questions. Each KFP consisted of a case vignette and three key features (KF) using “long menu” as question format. We sought students’ perceptions of the KFPs and cbMCQs in focus groups (n of students=39). Furthermore statistical data of 11 exams (n of students=377) concerning the KFPs and (cb)MCQs were compared. Summary of Results: The analysis of the focus groups resulted in four themes reflecting students’ perceptions of KFPs and their comparison with (cb)MCQ: KFPs were perceived as (i) more realistic, (ii) more difficult, (iii) more motivating for the intense study of clinical reasoning than (cb)MCQ and (iv) showed an overall good acceptance when some preconditions are taken into account. The statistical analysis revealed that there was no difference in difficulty; however KFP showed a higher discrimination and reliability (G-coefficient) even when corrected for testing times. Correlation of the different exam parts was intermediate. Conclusions: Students perceived the KFPs as more motivating for the study of clinical reasoning. Statistically KFPs showed a higher discrimination and higher reliability than cbMCQs. Take-home messages: Including KFPs with long menu questions into summative clerkship exams seems to offer positive educational effects.

Methodology for automated generation of multiple choice questions in self assessment

Current trends in the European Higher Education Area (EHEA) are moving towards the continuous evaluation of the students in substitution of the traditional evaluation based on a single test or exam. This fact and the increase in the number of students during last years in Engineering Schools, requires to modify evaluation procedures making them compatible with the educational and research activities. This work presents a methodology for the automatic generation of questions. These questions can be used as self assessment questions by the student and/or as queries by the teacher. The proposed approach is based on the utilization of parametric questions, formulated as multiple choice questions and generated and supported by the utilization of common programs of data sheets and word processors. Through this approach, every teacher can apply the proposed methodology without the use of programs or tools different from those normally used in his/her daily activity

How an enzyme answers. multiple-choice questions

Acetohydroxyacid synthase (AHAS) is the first common enzyme in the pathway for the biosynthesis of branched-chain amino acids. Interest in the enzyme has escalated over the past 20 years since it was discovered that AHAS is the target of the sulfonylurea and imidazolinone herbicides. However, several questions regarding the reaction mechanism have remained unanswered, particularly the way in which AHAS I chooses' its second substrate. A new method for the detection of reaction intermediates enables calculation of the microscopic rate constants required to explain this phenomenon.

Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

Multiple-choice tests: a tool in assessing knowledge

The purpose of this paper is to analyse if Multiple-Choice Tests may be considered an interesting alternative for assessing knowledge, particularly in the Mathematics area, as opposed to the traditional methods, such as open questions exams. In this sense we illustrate some opinions of the researchers in this area. Often the perception of the people about the construction of this kind of exams is that they are easy to create. But it is not true! Construct well written tests it’s a hard work and needs writing ability from the teachers. Our proposal is analyse the construction difficulties of multiple - choice tests as well some advantages and limitations of this type of tests. We also show the frequent critics and worries, since the beginning of this objective format usage. Finally in this context some examples of Multiple-Choice Items in the Mathematics area are given, and we illustrate as how we can take advantage and improve this kind of tests.

L'enseignement du patient diabétique et son évaluation par un questionnaire à choix multiple. [Education of the diabetic patient and its evaluation by a multiple-choice questionnaire].

37 insulin-dependent and non-insulin-dependent diabetics answered a multiple-choice questionnaire during inpatient educational sessions. 12 dietetic and 12 pathophysiologic questions had to be answered. Statistical analysis of factors influencing the number of errors can be summed up as follows: there is a direct correlation between age of the patient and number of errors; the older the patient, the greater the number of errors. However, insulin-dependent diabetics committed fewer errors than non-insulin-dependent subjects of the same age, which suggests greater motivation in the first group due to their treatment. The test likewise affords the patients an opportunity of reviewing unclear topics and enables the educational team to adapt their teaching to the patients.

Moodle and multiple-choice tests

Multiple-Choice items are used in many different kinds of tests in several areas of knowledge. They can be considered an interesting tool to the self-assessing or as an alternative or complementary instrument to the traditional methods for assessing knowledge. The objectivity and accuracy of the multiple-choice tests is an important reason to think about. They are especially useful when the number of students to evaluate is too large. Moodle (Modular Object-Oriented Dynamic Learning Environment) is an Open Source course management system centered around learners' needs and designed to support collaborative approaches to teaching and learning. Moodle offers to the users a rich interface, context-specific help buttons, and a wide variety of tools such as discussion forums, wikis, chat, surveys, quizzes, glossaries, journals, grade books and more, that allow them to learn and collaborate in a truly interactive space. Come together the interactivity of the Moodle platform and the objectivity of this kind of tests one can easily build manifold random tests. The proposal of this paper is to relate our journey in the construction of these tests and share our experience in the use of the Moodle platform to create, take advantage and improve the multiple-choices tests in the Mathematic area.

Continuing Medical Education Self-Assessment Questions Vol. 50, No. 2 - April 2014. Focal vibration in neurorehabilitation.

During the last decade, many studies have been carried out to understand the effects of focal vibratory stimuli at various levels of the central nervous system and to study pathophysiological mechanisms of neurological disorders as well as the therapeutic effects of focal vibration in neurorehabilitation. This review aimed to describe the effects of focal vibratory stimuli in neurorehabilitation including the neurological diseases or disorders like stroke, spinal cord injury, multiple sclerosis, Parkinson's' disease and dystonia. In conclusion, focal vibration stimulation is well tolerated, effective and easy to use, and it could be used to reduce spasticity, to promote motor activity and motor learning within a functional activity, even in gait training, independent from etiology of neurological pathology. Further studies are needed in the future well- designed trials with bigger sample size to determine the most effective frequency, amplitude and duration of vibration application in the neurorehabilitation.

Continuing Medical Education Self-Assessment Questions Vol. 50, No. 1 - January 2014. Actual evidence in the medical approach to adolescents with idiopathic scoliosis

Idiopathic scoliosis (IS) is a three-dimensional deformity of the spine and trunk. The most common form involve ado- lescents (AIS). The prevalence for AIS is 2-3% of the population, with 1 out of 6 patients requiring treatment of which 25% progress to surgery. Physical and rehabilitation medicine (PRM) plays a primary role in the so-called conservative treatment of adolescents with AIS, since all the therapeutic tools used (exercises and braces) fall into the PRM domain. According to a Cochrane systematic review there is evidence in favor of bracing, even if it is of low quality. Another shows that there is evidence in favor of exercises as an adjunctive treatment, but of low quality. Three meta-analysis have been published on bracing: one shows that bracing does not reduce surgery rates, but studies with bracing plus exercises were not included and had the highest effectiveness; another shows that full time is better than part-time bracing; the last focuses on observational studies following the SRS criteria and shows that not all full time rigid bracing are the same: some have the highest effectiveness, others have less than elastic and nighttime bracing. Two very important RCTs failed in recruitment, showing that in the field of bracing for scoliosis RCTs are not accepted by the patients. Consensuses by the international Society on Scoliosis Orthopedic and Rehabilitation Treatment (SOSORT) show that there is no agree- ment among experts either on the best braces or on their biomechanical action, and that compliance is a matter of clinical more than patients' behavior (there is strong agreement on the management criteria to achieve best results with bracing). A systematic review of all the existing studies shows effectiveness of exercises, and that auto-correction is the main goal of exercises. A systematic review shows that there are no studies on manual treatment. Research on conservative treat- ment of AIS has continuously decreased since the 1980s, but this trend changed only recently. The SOSORT Guidelines offers the actual standard of conservative care.

Investigating Multiple-Choice Assessment: Secondary School Teachers' Perceptions and Practices

Multiple-choice assessment is used within nearly all levels of education and is often heavily relied upon within both secondary and postsecondary institutions in determining a student’s present and future success. Understanding why it is effective or ineffective, how it is developed, and when it is or is not used by teachers can further inform teachers’ assessment practices, and subsequently, improve opportunities for student success. Twenty-eight teachers from 3 secondary schools in southern Ontario were interviewed about their perceptions and use of multiple-choice assessment and participated in a single-session introductory workshop on this topic. Perceptions and practices were revealed, discussed, and challenged through the use of a qualitative research method and examined alongside existing multiple-choice research. Discussion centered upon participants’ perspectives prior to and following their participation in the workshop. Implications related to future assessment practices and research in this field of assessment were presented. Findings indicated that many teachers utilized the multiple-choice form of assessment having had very little teacher education coursework or inservice professional development in the use of this format. The findings also revealed that teachers were receptive to training in this area but simply had not been exposed to or been given the opportunity to further develop their understanding. Participants generally agreed on its strengths (e.g., objectivity) and weaknesses (e.g., development difficulty). Participants were particularly interested in the potential for this assessment format to assess different levels of cognitive difficulty (i.e., levels beyond remembering of Bloom’s revised taxonomy), in addition to its potential to perhaps provide equitable means for assessing students of varying cultures, disabilities, and academic streams.

Evaluation of five guidelines for option development in multiple-choice item-writing. 'Evaluaci??n de cinco directrices para la construcci??n de opciones en ??tems de elecci??n m??ltiple'

Resumen tomado de la publicaci??n