Handwritten undergraduate case reports

Background: This article describes a 'back to the future' approach to case 'write-ups', with medical students producing handwritten instead of word-processed case reports during their clinical placements. Word-processed reports had been found to have a number of drawbacks, including the inappropriate use of 'cutting and pasting', undue length and lack of focus. Method: We developed a template to be completed by hand, based on the hospital 'clerking-in process', and matched this to a new assessment proforma. An electronic survey was conducted of both students and assessors after the first year of operation to evaluate impact and utility. Results: The new template was well received by both students and assessors. Most students said they preferred handwriting the case reports (55.6%), although a significant proportion (44.4%) preferred the word processor. Many commented that the template enabled them to effectively learn the structure of a case history and to improve their history-taking skills. Most assessors who had previously marked case reports felt the new system represented an improvement. The average time spent marking each report fell from 23.56 to 16.38minutes using the new proforma. Discussion: Free text comments from the survey have led to the development of a more flexible case report template better suited to certain specialties (e.g. dermatology). This is an evolving process and there will be opportunities for further adaptation as electronic medical records become more common in hospital. © Blackwell Publishing Ltd 2012.

How standardised patients award global scores in OSCEs: a qualitative study

Standardized patients (SPs) are often asked to award global scores on the humanistic aspects of a candidate’s performance in an OSCE. However, little is known about the process by which SPs arrive at their mark.
Five focus groups of SPs, using a convenience sample, were used to collect data until saturation. Thematic analysis was carried out independently by three researchers using a grounded theory approach.

Four major themes contributed to their decision-making process: environment, relationships within the exam, preparedness for the task and expectations of the student’s performance. Environmental factors included the station itself, the rating scale and examiner fatigue. Relationship factors included first impressions, the sense of purpose derived from examining and a tendency to mirror the examiner’s reaction. Factors relating to preparedness for task involved experience as an SP and technical aspects, such as the need for calibration. Lastly, expectations of performance were related to preconceptions about what makes a ‘good’ student, including their level of studies, appearance and technical performance.

In assessing students, SPs drew on their wider attitudes and experiences. SPs did not limit their assessment to humanistic traits but often included technical performance. Thus, SPs to some extent assessed a similar construct to examiners and this may help to explain the increased reliability associated with using SP scores. SP global scores are a useful adjunct but the process by which SPs award marks is complex and provides a challenge for training and standardisation.

Development of an objective structured clinical examination (OSCE) to assess formulation and extemporaneous dispensing skills in MPharm undergraduates

Background: The use of Objective Structured Clinical Examination (OSCE) in Pharmacy has been explored; however this is the first attempt in Queen’s University School of Pharmacy, Belfast to assess students via this method in a module where chemistry is the main discipline.

Aims: To devise an OSCE to assess undergraduate ability to check extemporaneously dispensed products for clinical and formulation errors. This activity also aims to consider whether it is a viable method of assessment in such a science-based class, from a staff and student perspective.

Method: Students rotated around a number of stations, performing a check of the product, corresponding prescription and formulation record sheet detailing the theory behind the formulation. They were assessed on their ability to spot intentional mistakes at each one.

Results: Of the 79 students questioned, 95% indicated that OSCE made them aware of the importance of the clinical check carried out by the pharmacist. Nearly all of the undergraduates (72 out of 79) felt that OSCE made them aware of the type of mistakes that students make in class. Most (5 out of 7) of the academic team members strongly agreed that it made students aware of ‘point of dispensing’ checks carried out by pharmacists, in addition to helping them to prepare for their exam.

Conclusion: OSCE assesses both scientific and formulation skills, and has increased the diversity of assessment of this module, bringing with it many additional benefits for the undergraduates since it measures their ability to exercise professional judgement in a time- constrained environment and, in this way, mirrors the conditions many pharmacists work within.

Evaluation of Microcollimated Pars Plana External Beam Radiation in the Porcine Eye

Purpose: To evaluate the clinical and histological side effects of a prototype stereotactic radiotherapy system delivering microcollimated external beam radiation through pars plana in porcine eyes.

Methods: Five Yucatan mini-swine (10 eyes) were randomized to five treatment groups. Eight eyes were dosed with X-ray radiation on Day 1, and two eyes served as untreated controls. Treated eyes received doses up to 60 Gy to the retina and up to 130 Gy to the sclera using single or overlapping beams. The treatment beams were highly collimated such that the diameter was approximately 2.5 mm on the sclera and 3 mm on the retinal surface. Fundus photography, fluorescein angiography (FA), and spectral domain optical coherence tomography (SD-OCT) were obtained on days 7, 30, 60, and 110. Images were examined by a masked grader and evaluated for abnormalities. Animals were sacrificed on day 111 and gross and histopathological analysis was conducted.

Results: Histological and gross changes to eye structures including conjunctiva and lens were minimal at all doses. Fundus, FA, and SD-OCT of the targeted region failed to disclose any abnormality in the control or 21 Gy treated animals. In the 42 and 60 Gy animals, hypopigmented spots were noted after treatment on clinical exam, and corresponding hyperfluorescent staining was seen in late frames. No evidence of choroidal hypoperfusion was seen. The histological specimens from the 60 Gy animals showed photoreceptor loss and displacement of cone nuclei.

Conclusion: Transcleral stereotactic radiation dosing in porcine eyes can be accomplished with no significant adverse events as doses less than 42 Gy.

Patient safety and communication: A new assessment for doctors trained in countries where language differs from that of the host country: Results of a pilot using a domain-based assessment

Objective

Global migration of healthcare workers places responsibility on employers to comply with legal employment rights whilst ensuring patient safety remains the central goal. We describe the pilot of a communication assessment designed for doctors who trained and communicated with patients and colleagues in a different language from that of the host country. It is unique in assessing clinical communication without assessing knowledge.

A 14-station OSCE was developed using a domain-based marking scheme, covering professional communication and English language skills (speaking, listening, reading and writing) in routine, acute and emotionally challenging contexts, with patients, carers and healthcare teams. Candidates (n = 43), non-UK trained volunteers applying to the UK Foundation Programme, were provided with relevant station information prior to the exam.

The criteria for passing the test included achieving the pass score and passing 10 or more of the 14 stations. Of the 43 candidates, nine failed on the station criteria. Two failed the pass score and also the station criteria. The Cronbach's alpha coefficient was 0.866.

This pilot tested ‘proof of concept’ of a new domain-based communication assessment for non-UK trained doctors.

The test would enable employers and regulators to verify communication competence and safety in clinical contexts, independent of clinical knowledge, for doctors who trained in a language different from that of the host country.

A-level Mathematics Options – Views of Secondary-level Teachers

The A-level Mathematics qualification is based on a compulsory set of pure maths modules and a selection of applied maths modules with the pure maths representing two thirds of the assessment. The applied maths section includes mechanics, statistics and (sometimes) decision maths. A combination of mechanics and statistics tends to be the most popular choice by far. The current study aims to understand how maths teachers in secondary education make decisions regarding the curriculum options and offers useful insight to those currently designing the new A-level specifications.

Semi-structured interviews were conducted with A-level maths teachers representing 27 grammar schools across Northern Ireland. Teachers were generally in agreement regarding the importance of pure maths and the balance between pure and applied within the A-level maths curriculum. A wide variety of opinions existed concerning the applied options. While many believe that the basic mechanics-statistics (M1-S1) combination is most accessible, it was also noted that the M1-M2 combination fits neatly alongside A-level physics. Lack of resources, timetabling constraints and competition with other subjects in the curriculum hinder uptake of A-level Further Maths.

Teachers are very conscious of the need to obtain high grades to benefit both their pupils and the school’s reputation. The move to a linear assessment system in England while Northern Ireland retains the modular system is likely to cause some schools to review their choice of exam board although there is disagreement as to whether a modular or linear system is more advantageous for pupils. The upcoming change in the specification offers an opportunity to refresh the assessment also and reduce the number of leading questions. However, teachers note that there are serious issues with GCSE maths and these have implications for A-level.

The validity of critical thinking tests for predicting degree performance: A longitudinal study

This study explored the validity of using critical thinking tests to predict final psychology degree marks over and above that already predicted by traditional admission exams (A-levels). Participants were a longitudinal sample of 109 psychology students from a university in the United Kingdom. The outcome measures were: total degree marks; and end of year marks. The predictor measures were: university admission exam results (A-levels); critical thinking test scores (skills & dispositions); and non-verbal intelligence scores. Hierarchical regressions showed A-levels significantly predicted 10% of the final degree score and the 11-item measure of ‘Inference skills’ from the California Critical Thinking Skills Test significantly predicted an additional 6% of degree outcome variance. The findings from this study should inform decisions about the precise measurement constructs included in aptitude tests used in the higher education admission process.

Development of an app to support learning in A-level maths

This project involved producing an app for smart devices to enable modernised learning for A-level maths students. Research in a stakeholder school showed that 94% of pupils surveyed within the upper-secondary level owned a smartphone and most owned a tablet also, emphasising the opportunity for using apps to support learning. The app was developed using iBuildApp, an online app-creation programme which requires no programming. Past exam questions and solutions, notes and video tutorials were included and the topic was vectors, identified by teachers as problematic. Pupils generally found the app easy to use and wanted further development. The videos were popular despite this not ranking highly as a preferred method of revision previously. Teachers were happy for pupils to use the app to supplement their learning, both in the classroom and outside.

Research Methods in Psychology For Dummies

Your hands-on introduction to research methods in psychology.  
Looking for an easily accessible overview of research methods in psychology? This is the book for you! Whether you need to get ahead in class, you're pressed for time, or you just want a take on a topic that's not covered in your textbook, Research Methods in Psychology For Dummies has you covered. 
Written in plain English and packed with easy-to-follow instruction, this friendly guide takes the intimidation out of the subject and tackles the fundamentals of psychology research in a way that makes it approachable and comprehensible, no matter your background. Inside, you'll find expert coverage of qualitative and quantitative research methods, including surveys, case studies, laboratory observations, tests and experiments—and much more. 
- Serves as an excellent supplement to course textbooks - Provides a clear introduction to the scientific method - Presents the methodologies and techniques used in psychology research- Written by the authors of Psychology Statistics For Dummies 
If you're a first or second year psychology student and want to supplement your doorstop-sized psychology textbook—and boost your chances of scoring higher at exam time—this hands-on guide breaks down the subject into easily digestible bits and propels you towards success.

What is being taught in Religious Education classes in Northern Ireland and to what extent should states be concerned about regulation, quality and control of the subject?

This paper reports on a research project designed to discover what schools are teaching in Religious Education in Northern Ireland and what procedures are in place to maintain standards in the delivery of the subject. A search through literature shows that little research has been carried out to determine what is being taught in Religious Education in Northern Ireland. It also indicates that there are very weak systems of control to measure the effectiveness or quality of what is delivered. A survey of the websites of all Post-Primary schools in the region was used to provide some answers to the basic question of what is being taught in RE. Using content and discourse analysis of these alongside supporting documentary sources (textbooks and exam specifications), it is possible to get a clearer picture of how the Northern Ireland Core Syllabus for Religious Education and any additional curricular elements are delivered in schools. The findings show that a significant minority of schools do not publicly articulate what pupils do in religious education. In situations where the content of religious education is made clear, some definite trends are evident. Despite the existence of a statutory core syllabus, there is significant variation in what is taught in schools. The content is most divergent from the syllabus in relation to the teaching of World Religions at Key Stage 3 and at Key Stage 4 whole elements of the syllabus are neglected due to limited conformity between the syllabus and exam specifications. These results raise important questions about the systems of regulation and control of the subject in the region. In law the subject is exempt from formal inspection by the local inspection authority; instead, a form of inspection is allowed for by the Christian churches who design the syllabus, but it is a process that is either entirely neglected or entirely unreported in situations where it does occur. It is argued that these findings raise questions of more general concern for this and other regions in Europe where the teaching of religious education is largely unregulated. For example, to what extent should states take an interest in what is taught in religious education, how it is delivered, what values it promotes and how standards of teaching and learning in the subject are upheld?

Undergraduate Student perceptions of a Restorative Dentistry OSCE

Objectives: The Objective Structured Clinical Exam (OSCE) is a widely accepted assessment method in undergraduate dental education. It aims to test higher order skills, attitudes and aspects of professionalism which other summative assessments such as MCQs and other written examinations are less able to do. The aim of this study was to evaluate the perceptions of 4th year undergraduate dental students of an OSCE undertaken in the Conservation Department.
Methods: On completion of the OSCE examination 51 fourth year undergraduate students were asked to complete an anonymised questionnaire. The questionnaire was made 22 questions, and requiring the students to provide both open and closed responses.
Results: A lot of positive aspects to the OSCE were observed in responses, students felt that the OSCE was a meaningful way for assessing their clinical skills (85%), it reflected real life conditions (79%) and that it was a fair method of assessment (75%).
A number of negative aspects were also noted. Most students felt the OSCE was stressful (72%) and they felt nervous during the examination (77%). Of the undergraduates asked 42% did not feel confident doing the OSCE.
A number of students felt it would be helpful to have additional information given to them on the OSCE prior to the assessment process.
Conclusion: In general the students found the OSCE a fair, meaningful form of assessment which reflected real life clinical situations, providing them with an opportunity to show their clinical knowledge and practical skills. A number study cohort did not feel confident during the OSCE and felt nervous and stressed by the experience. The information gained from the reflective nature of the feedback questionnaire has proved invaluable in the design of subsequent diets of the OSCE examination. 

Neurology assessment by objective structured video examination (OSVE)

Summary
Background
The ability to carry out a neurological examination and make an appropriate differential diagnosis is one of the mainstays of our final Bachelor of Medicine (MB) exam; however, with the introduction of objective structured clinical examinations (OSCEs) it has become impossible to arrange for adequate numbers of suitable real patients to participate in the exam.

Context
It is vital that newly qualified doctors can perform a basic neurological examination, interpret the physical signs and formulate a differential diagnosis.

It is vital that newly qualified doctors can perform a basic neurological examination

Innovation
Since 2010 we have introduced an objective structured video examination (OSVE) of a neurological examination of a real patient as part of our final MB OSCE exam. The students view clips of parts of the examination process. They answer questions on the signs that are demonstrated and formulate a differential diagnosis.

Implications
This type of station is logistically a lot easier to organise than a large number of real patients at different examination sites. The featured patients have clearly demonstrated signs and, as every student sees the same patient, are perfectly standardised. It is highly acceptable to examiners and performed well as an assessment tool. There are, however, certain drawbacks in that we are not examining the student's examination technique or their interaction with the patient. Also, certain signs, in particular the assessment of muscle tone and power, are more difficult for a student to estimate in this situation

An investigation of vision problems and the vision care system in Rural China

This paper examines the prevalence of vision problems and the accessibility to and quality of vision care in rural China. We obtained data from 4 sources: 1) the National Rural Vision Care Survey; 2) the Private Optometrists Survey; 3) the County Hospital Eye Care Survey; and 4) the Rural School Vision Care Survey. The data from each of the surveys were collected by the authors during 2012. Thirty-three percent of the rural population surveyed self-reported vision problems. Twenty-two percent of subjects surveyed had ever had a vision exam. Among those who self-reported having vision problems, 34% did not wear eyeglasses. Fifty-four percent of those with vision problems who had eyeglasses did not have a vision exam prior to receiving glasses. However, having a vision exam did not always guarantee access to quality vision care. Four channels of vision care service were assessed. The school vision examination program did not increase the usage rate of eyeglasses. Each county-hospital was staffed with three eye-doctors having one year of education beyond high school, serving more than 400,000 residents. Private optometrists often had low levels of education and professional certification. In conclusion, our findings shows that the vision care system in rural China is inadequate and ineffective in meeting the needs of the rural population sampled.

Improving E-Assessment Systems With A focus On Adaptive Feedback And Marking

Institutions involved in the provision of tertiary education across Europe are feeling the pinch. European universities, and other higher education (HE) institutions, must operate in a climate where the pressure of government spending cuts (Garben, 2012) is in stark juxtaposition to the EU’s strategy to drive forward and maintain a growth of student numbers in the sector (eurostat, 2015).

In order to remain competitive, universities and HE institutions are making ever-greater use of electronic assessment (E-Assessment) systems (Chatzigavriil et all, 2015; Ferrell, 2012). These systems are attractive primarily because they offer a cost-effect and scalable approach for assessment. In addition to scalability, they also offer reliability, consistency and impartiality; furthermore, from the perspective of a student they are most popular because they can offer instant feedback (Walet, 2012).

There are disadvantages, though.

First, feedback is often returned to a student immediately on competition of their assessment. While it is possible to disable the instant feedback option (this is often the case during an end of semester exam period when assessment scores must be can be ratified before release), however, this option tends to be a global ‘all on’ or ‘all off’ configuration option which is controlled centrally rather than configurable on a per-assessment basis.

If a formative in-term assessment is to be taken by multiple groups of
students, each at different times, this restriction means that answers to each question will be disclosed to the first group of students undertaking the assessment. As soon as the answers are released “into the wild” the academic integrity of the assessment is lost for subsequent student groups.

Second, the style of feedback provided to a student for each question is often limited to a simple ‘correct’ or ‘incorrect’ indicator. While this type of feedback has its place, it often does not provide a student with enough insight to improve their understanding of a topic that they did not answer correctly.

Most E-Assessment systems boast a wide range of question types including Multiple Choice, Multiple Response, Free Text Entry/Text Matching and Numerical questions. The design of these types of questions is often quite restrictive and formulaic, which has a knock-on effect on the quality of feedback that can be provided in each case.

Multiple Choice Questions (MCQs) are most prevalent as they are the most prescriptive and therefore most the straightforward to mark consistently. They are also the most amenable question types, which allow easy provision of meaningful, relevant feedback to each possible outcome chosen.
Text matching questions tend to be more problematic due to their free text entry nature. Common misspellings or case-sensitivity errors can often be accounted for by the software but they are by no means fool proof, as it is very difficult to predict in advance the range of possible variations on an answer that would be considered worthy of marks by a manual marker of a paper based equivalent of the same question.

Numerical questions are similarly restricted. An answer can be checked for accuracy or whether it is within a certain range of the correct answer, but unless it is a special purpose-built mathematical E-Assessment system the system is unlikely to have computational capability and so cannot, for example, account for “method marks” which are commonly awarded in paper-based marking.

From a pedagogical perspective, the importance of providing useful formative feedback to students at a point in their learning when they can benefit from the feedback and put it to use must not be understated (Grieve et all, 2015; Ferrell, 2012).

In this work, we propose a number of software-based solutions, which will overcome the limitations and inflexibilities of existing E-Assessment systems.