Predictability in high-stakes examinations: students' perspectives on a perennial assessment dilemma

Key debates within educational assessment continuously encourage us to reflect on the design, delivery and implementation of examination systems as well as their relevance to students. In more recent times, such reflections have also required a rethinking of who is authoritative about assessment issues and whose views we seek in order to better understand these perennial assessment dilemmas. This paper considers one such dilemma, predictability in high-stakes assessment, and presents students’ perspectives on this issue. The context is the Irish Leaving Certificate (LC) taken by upper secondary students (aged between 16 and 18) in order (mainly) to enter tertiary-level education. The data come from 13 group interviews with 81 students across a range of schools in Ireland. Listening to students about complex, high-stakes examining problems has a limited history within the educational assessment literature. The findings from the study address this shortcoming and depict how students’ insightful reflections can improve our understanding of these dilemmas. Further, students are more than able to reflect on their own situations with regard to high stakes examining contexts and have important contributions to make to our fuller understanding of those elements that will promote high quality and fair assessment.

Alcohol attention bias in adolescent social drinkers: an eye tracking study

Rationale
Previous research on attention bias in nondependent social drinkers has focused on adult samples with limited focus on the presence of attention bias for alcohol cues in adolescent social drinkers.
Objectives
The aim of this study was to examine the presence of alcohol attention bias in adolescents and the relationship of this cognitive bias to alcohol use and alcohol-related expectancies.
Methods
Attention bias in adolescent social drinkers and abstainers was measured using an eye tracker during exposure to alcohol and neutral cues. Questionnaires measured alcohol use and explicit alcohol expectancies.
Results
Adolescent social drinkers spent significantly more time fixating to alcohol stimuli compared to controls. Total fixation time to alcohol stimuli varied in accordance with level of alcohol consumption and was significantly associated with more positive alcohol expectancies. No evidence for automatic orienting to alcohol stimuli was found in adolescent social drinkers.
Conclusion
Attention bias in adolescent social drinkers appears to be underpinned by controlled attention suggesting that whilst participants in this study displayed alcohol attention bias comparable to that reported in adult studies, the bias has not developed to the point of automaticity. Initial fixations appeared to be driven by alternative attentional processes which are discussed further.

The use of eye-tracking to explore social difficulties in cognitively able students with autism spectrum disorder: A pilot study

Individuals with autism spectrum disorder do not just 'grow out of' their early difficulties in understanding the social world. Even for those who are cognitively able, autism-related difficulties continue into adulthood. Atypicalities attending to and interpreting communicative signals from others can provide barriers to success in education, employment and relationships. In the current study, we use eye-tracking during real social interaction to explore attention to social cues (e.g. face, eyes, mouth) and links to social awareness in a group of cognitively able University students with autism spectrum disorder and typically developing students from the same University. During the interaction, students with autism spectrum disorder showed less eye fixation and more mouth fixation than typically developing students. Importantly, while 63% of typically developing participants reported thinking they were deceived about the true nature of the interaction, only 9% of autism spectrum disorder participants picked up this subtle social signal. We argue that understanding how these social attentional and social awareness difficulties manifest during adulthood is important given the growing number of adults with autism spectrum disorder who are attending higher level education. These adults may be particularly susceptible to drop-out due to demands of coping in situations where social awareness is so important.

Obsessive-compulsive symptoms and attentional bias: An eye-tracking methodology

Background and objectives: Cognitive models suggest that attentional biases are integral in the maintenance of obsessive-compulsive symptoms (OCS). Such biases have been established experimentally in anxiety disorders; however, the evidence is unclear in Obsessive Compulsive disorder (OCD). In the present study, an eye-tracking methodology was employed to explore attentional biases in relation to OCS.
Methods: A convenience sample of 85 community volunteers was assessed on OCS using the Yale-Brown Obsessive Compulsive Scale-self report. Participants completed an eye-tracking paradigm where they were exposed to OCD, Aversive and Neutral visual stimuli. Indices of attentional bias were derived from the eye-tracking data.
Results: Simple linear regressions were performed with OCS severity as the predictor and eye-tracking measures of the different attentional biases for each of the three stimuli types were the criterion variables. Findings revealed that OCS severity moderately predicted greater frequency and duration of fixations on OCD stimuli, which reflect the maintenance attentional bias. No significant results were found in support of other biases.
Limitations: Interpretations based on a non-clinical sample limit the generalisability of the conclusions, although use of such samples in OCD research has been found to be comparable to clinical populations. Future research would include both clinical and sub-clinical participants.
Conclusions: Results provide some support for the theory of maintained attention in OCD attentional biases, as opposed to vigilance theory. Individuals with greater OCS do not orient to OCD stimuli any faster than individuals with lower OCS, but once a threat is identified, these individuals allocate more attention to OCS-relevant stimuli.

Ophthalmic epidemiology in Europe: the “European Eye Epidemiology” (E3) consortium

The European Eye Epidemiology (E3) consortium is a recently formed consortium of 29 groups from 12 European countries. It already comprises 21 population-based studies and 20 other studies (case-control, cases only, randomized trials), providing ophthalmological data on approximately 170,000 European participants. The aim of the consortium is to promote and sustain collaboration and sharing of data and knowledge in the field of ophthalmic epidemiology in Europe, with particular focus on the harmonization of methods for future research, estimation and projection of frequency and impact of visual outcomes in European populations (including temporal trends and European subregions), identification of risk factors and pathways for eye diseases (lifestyle, vascular and metabolic factors, genetics, epigenetics and biomarkers) and development and validation of prediction models for eye diseases. Coordinating these existing data will allow a detailed study of the risk factors and consequences of eye diseases and visual impairment, including study of international geographical variation which is not possible in individual studies. It is expected that collaborative work on these existing data will provide additional knowledge, despite the fact that the risk factors and the methods for collecting them differ somewhat among the participating studies. Most studies also include biobanks of various biological samples, which will enable identification of biomarkers to detect and predict occurrence and progression of eye diseases. This article outlines the rationale of the consortium, its design and presents a summary of the methodology.

Is the Schwabe organ a retained larval eye? Anatomical and behavioural studies of a novel sense organ in adult leptochiton asellus (Mollusca, Polyplacophora) indicate links to larval photoreceptors

The discovery of a sensory organ, the Schwabe organ, was recently reported as a unifying feature of chitons in the order Lepidopleurida. It is a patch of pigmented tissue located on the roof of the pallial cavity, beneath the velum on either side of the mouth. The epithelium is densely innervated and contains two types of potential sensory cells. As the function of the Schwabe organ remains unknown, we have taken a cross-disciplinary approach, using anatomical, histological and behavioural techniques to understand it. In general, the pigmentation that characterises this sensory structure gradually fades after death; however, one particular concentrated pigment dot persists. This dot is positionally homologous to the larval eye in chiton trochophores, found in the same neuroanatomical location, and furthermore the metamorphic migration of the larval eye is ventral in species known to possess Schwabe organs. Here we report the presence of a discrete subsurface epithelial structure in the region of the Schwabe organ in Leptochiton asellus that histologically resembles the chiton larval eye. Behavioural experiments demonstrate that Leptochiton asellus with intact Schwabe organs actively avoid an upwelling light source, while Leptochiton asellus with surgically ablated Schwabe organs and a control species lacking the organ (members of the other extant order, Chitonida) do not (Kruskal-Wallis, H = 24.82, df = 3, p < 0.0001). We propose that the Schwabe organ represents the adult expression of the chiton larval eye, being retained and elaborated in adult lepidopleurans.

Preparing assessments and examinations. Common errors and good practice.

Assessment forms an important part of the student learning experience and students place a high value on the quality of feedback that they receive from academic staff on where they might improve on their examinations or assignments. However while feedback is important the quality of the actual assessment itself before students undertake an examination or commence writing an assignment is also important. It is imperative that students are clear in their understanding of what is expected of them in order to achieve a particular grade and that there is lack of ambiguity in examinations or assignments. Biggs (2003) highlighted the importance of clarity in what students are expected to be able to do at the end of a unit of study, and that intended learning outcomes should be clearly aligned to the assessment and communicated to students so that they can structure their learning activities to optimize their assessment performance. However as Rust (2002) highlighted there are often inconsistencies in assessment practices ranging from a mis-match of assessment and learning outcomes to the inclusion of additional learning criteria and lack of clarity in the instructions. Such inconsistencies and unacceptable errors in examination papers can undermine student confidence in the assessment process
In order to try and minimise such inconsistencies an internal assessment group was set up October 2013 within the School of Nursing and Midwifery at Queens University Belfast, consisting of representative academic staff from across the range of undergraduate and post graduate courses in nursing and midwifery. The assessment group was to be a point of reference for all school examinations with a particular remit to develop an assessment strategy for all nursing and midwifery programmes and to ensure that all assessments comply with current best practice and with Nursing and Midwifery Council (NMC) requirements.
Aim
This paper aims to highlight some examples of good practice and common errors that were found in assignments and examinations that were submitted to the assessment group for review.
References

Biggs. J. (2003) Teaching for Quality Learning at University – What the Student Does 2nd Edition SRHE / Open University Press, Buckingham.
Rust, C.( 2002) The impact of assessment on student learning, Active Learning in Higher education Vol3(2):145-158

Assessment of cataract surgical outcomes in settings where follow-up is poor:PRECOG, a multicentre observational study

Background: Poor follow-up after cataract surgery in developing countries makes assessment of operative quality uncertain. We aimed to assess two strategies to measure visual outcome: recording the visual acuity of all patients 3 or fewer days postoperatively (early postoperative assessment), and recording that of only those patients who returned for the final follow-up examination after 40 or more days without additional prompting. Methods: Each of 40 centres in ten countries in Asia, Africa, and Latin America recruited 40-120 consecutive surgical cataract patients. Operative-eye best-corrected visual acuity and uncorrected visual acuity were recorded before surgery, 3 or fewer days postoperatively, and 40 or more days postoperatively. Clinics logged whether each patient had returned for the final follow-up examination without additional prompting, had to be actively encouraged to return, or had to be examined at home. Visual outcome for each centre was defined as the proportion of patients with uncorrected visual acuity of 6/18 or better minus the proportion with uncorrected visual acuity of 6/60 or worse, and was calculated for each participating hospital with results from the early assessment of all patients and the late assessment of only those returning unprompted, with results from the final follow-up assessment for all patients used as the standard. Findings: Of 3708 participants, 3441 (93%) had final follow-up vision data recorded 40 or more days after surgery, 1831 of whom (51% of the 3581 total participants for whom mode of follow-up was recorded) had returned to the clinic without additional prompting. Visual outcome by hospital from early postoperative and final follow-up assessment for all patients were highly correlated (Spearman's r_s=0·74, p<0·0001). Visual outcome from final follow-up assessment for all patients and for only those who returned without additional prompting were also highly correlated (r_s=0·86, p<0·0001), even for the 17 hospitals with unprompted return rates of less than 50% (r_s=0·71, p=0·002). When we divided hospitals into top 25%, middle 50%, and bottom 25% by visual outcome, classification based on final follow-up assessment for all patients was the same as that based on early postoperative assessment for 27 (68%) of 40 centres, and the same as that based on data from patients who returned without additional prompting in 31 (84%) of 37 centres. Use of glasses to optimise vision at the time of the early and late examinations did not further improve the correlations. Interpretation: Early vision assessment for all patients and follow-up assessment only for patients who return to the clinic without prompting are valid measures of operative quality in settings where follow-up is poor. Funding: ORBIS International, Fred Hollows Foundation, Helen Keller International, International Association for the Prevention of Blindness Latin American Office, Aravind Eye Care System. © 2013 Congdon et al. Open Access article distributed under the terms of CC BY.

Visual outcomes of cataract surgery performed by supervised novice surgeons during training in rural China

To assess the outcomes of cataract surgery performed by novice surgeons during training in a rural programme. Design: Retrospective study. Participants: Three hundred thirty-four patients operated by two trainees under supervision at rural Chinese county hospitals. Methods: Two trainees performed surgeries under supervision. Visual acuity, refraction and examinations were carried out 3 months postoperatively. Main Outcome Measures: Postoperative uncorrected visual acuity, pinhole visual acuity, causes of visual impairment (postoperative uncorrected visual acuity<6/18) Results: Among 518 operated patients, 426 (82.2%) could be contacted and 334 (64.4% of operated patients) completed the examinations. The mean age was 74.1±8.8 years and 62.9% were women. Postoperative uncorrected visual acuity was available in 372 eyes. Among them, uncorrected visual acuity was ≥6/18 in 278 eyes (74.7%) and <6/60 in 60 eyes (16.1%), and 323 eyes (86.8%) had pinhole visual acuity≥6/18 and 38 eyes (10.2%) had pinhole visual acuity<6/60. Main causes of visual impairment were uncorrected refractive error (63.9%) and comorbid eye disease (24.5%). Comorbid eye diseases associated with pinhole visual acuity<6/60 (n=23, 6.2%) included glaucoma, other optic nerve atrophy, vitreous haemorrhage and retinal detachment. Conclusions: The findings suggest that hands-on training remains safe and effective even when not implemented in centralized training centres. Further refinement of the training protocol, providing postoperative refractive services and more accurate preoperative intraocular lens calculations, can help optimize outcomes. © 2012 The Authors Clinical and Experimental Ophthalmology © 2012 Royal Australian and New Zealand College of Ophthalmologists.

Causes and five-year incidence of blindness and visual impairment in urban southern China:The Liwan Eye Study

PURPOSE. We determined the causes and five-year incidence of blindness and visual impairment (VI) in an adult, urban Chinese population. METHODS. Participants underwent a comprehensive eye examination at baseline in 2003 and then five years later. The World Health Organization (WHO) and United States (US) definitions were used to define incident blindness (WHO visual acuity [VA] < 20/400 in the better-seeing eye, US VA ≤ 20/200) and incident VI (WHO VA < 20/60-20/400, US VA < 20/40->20/200). RESULTS. Among 1405 baseline participants, 924 (75%) of 1232 survivors (87.7%) participated in the 5-year follow-up. The incidences of VI and blindness were 5.38% (95% confidence interval [CI] 3.99% ~ 7.07%) and 0.33% (95% CI 0.07% ~ 0.95%), respectively, based on the WHO definition, and 9.85% (95% CI 7.96% ~ 12.0%) and 1.42% (95% CI 0.76% ~ 2.41%), respectively, based on the US definition. Incidence of blindness and VI (WHO definition) increased significantly with older age (P < 0.001) and poorer baseline presenting VA in the worse-seeing eye (P < 0.001). The leading cause of best-corrected VI (WHO definition) was cataract (64.6%), whereas the main causes of presenting VI were refractive error (40.4%) and cataract (38.4%). CONCLUSIONS. The incidence of VI in urban Southern China is high. The major causes are unoperated cataract and undercorrected refractive error, reflecting the need for better surgical and refractive care, even in this urban setting. © 2013 The Association for Research in Vision and Ophthalmology, Inc.