An analysis of assessment outcomes from eight years' operation of the Australian border weed risk assessment system

The majority of Australian weeds are exotic plant species that were intentionally introduced for a variety of horticultural and agricultural purposes. A border weed risk assessment system (WRA) was implemented in 1997 in order to reduce the high economic costs and massive environmental damage associated with introducing serious weeds. We review the behaviour of this system with regard to eight years of data collected from the assessment of species proposed for importation or held within genetic resource centres in Australia. From a taxonomic perspective, species from the Chenopodiaceae and Poaceae were most likely to be rejected and those from the Arecaceae and Flacourtiaceae were most likely to be accepted. Dendrogram analysis and classification and regression tree (TREE) models were also used to analyse the data. The latter revealed that a small subset of the 35 variables assessed was highly associated with the outcome of the original assessment. The TREE model examining all of the data contained just five variables: unintentional human dispersal, congeneric weed, weed elsewhere, tolerates or benefits from mutilation, cultivation or fire, and reproduction by vegetative propagation. It gave the same outcome as the full WRA model for 71% of species. Weed elsewhere was not the first splitting variable in this model, indicating that the WRA has a capacity for capturing species that have no history of weediness. A reduced TREE model (in which human-mediated variables had been removed) contained four variables: broad climate suitability, reproduction in less or than equal to 1 year, self-fertilisation, and tolerates and benefits from mutilation, cultivation or fire. It yielded the same outcome as the full WRA model for 65% of species. Data inconsistencies and the relative importance of questions are discussed, with some recommendations made for improving the use of the system.

The role of previous experience and attitudes toward statistics in statistics assessment outcomes among undergraduate psychology students

Previous research has demonstrated that students’ cognitions about statistics are related to their performance in statistics assessments. The purpose of this research is to examine the nature of the relationships between undergraduate psychology students’ previous experiences of maths, statistics and computing; their attitudes toward statistics; and assessment on a statistics course. Of the variables examined, the strongest predictor of assessment outcome was students’ attitude about their intellectual knowledge and skills in relation to statistics at the end of the statistics curriculum. This attitude was related to students’ perceptions of their maths ability at the beginning of the statistics curriculum. Interventions could be designed to change such attitudes with the aim of improving students’ learning of statistics.

Quality assurance of assessment and moderation discourses involving sessional staff

Quality assurance is a major agenda in tertiary education. The casualisation of academic work, especially in teaching, is also a quality assurance issue. Casual or sessional staff members teach and assess more than 50% of all university courses in Australia, and yet the research in relation to the role sessional staff play in quality assurance of student assessment outcomes is scarce. Moderation processes are a pivotal part of robust quality assurance measures. Drawing upon previous work surrounding four discourses of moderation, this pilot project reports the results of research into the role and impact of sessional staff in moderation processes at tertiary level. Qualitative data were gathered through focus interviews. Results, in the form of various moderation discourses, indicate that sessional staff impact the formal quality assurance processes in numerous ways.

When did you last predict a good idea? Exploring the case of assessing creativity through learning outcomes

It has been noted elsewhere that an idea is acknowledged to be creative if it is novel, or surprising and adaptive. So how does that fit with education's desire to measure student performance against fixed, consistent and predicted learning outcomes? This study explores practical measures and theoretical constructs that address the dearth of teaching, learning and assessment strategies to enhance creative capacity in enterprise and entrepreneurship education. It is argued that inappropriate assessment strategies can be significant inhibitors of the creativity of students and teachers. Referring to the broader discipline of 'design', as defined by Bruce and Besant (2002) – the application of human creativity to a purpose – both broad employer satisfaction with education and fast growing economic success are found (DCMS, 2014). As predictable assessment outcomes equal predictable students, these understandings can inform educators who wish to map and develop enhanced creative endeavours such as opportunity recognition, communication and innovation.

Responding to our customers' needs: modifications to assessment in Obstetrics and Gynaecology over 20 years

Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.

Undergraduate Students’ Perceptions of Study Abroad and Their Level of Achievement of Global Learning Outcomes

This study expanded on current research on study abroad and global learning, using the Global Perspective Inventory (GPI), and conducted at Florida International University (FIU) in Miami, FL. The GPI assesses the holistic development of a global perspective in higher education within three domains and their respective FIU-determined equivalents: cognitive (global awareness), intrapersonal (global perspective), and interpersonal (global engagement). The main purpose of this study was to assess FIU’s undergraduate students’ perceptions of study abroad on their level of achievement of global awareness, global perspective, and global engagement. The secondary purpose was to determine how the students described their study abroad experience and achievement of global learning. The research design for this study consisted of parallel mixed methods. The quantitative component was an ex post facto with hypothesis design, using a pretest/posttest nonequivalent group methodology. FIU undergraduates (N=147) who studied abroad for one semester or more completed the GPI pre- and post-tests. Descriptive statistics and paired t-tests were conducted to compare the means. The interviews included 10 students, and were analyzed through Structural coding, Saldaña’s In Vivo coding, and Value coding. Quantitative analyses indicated positive changes in the students’ global awareness and global perspective. These analyses also showed that the FIU students achieved higher post-test means on all the domains of the GPI compared to other studies. Qualitative analyses showed that the students’ experiences incorporated all three global learning outcomes, most notably global awareness and perspective.

The student as customer model and its impact on the academic leadership role in higher education

This paper posits that the 'student as customer' model has a negative impact upon the academic leadership which in turn is responsible for the erosion of objectivity in the assessment process in the higher education sector. The paper draws on the existing literature to explore the relationship between the student as customer model, academic leadership, and student assessment. The existing research emanating from the literature provides the basis from which the short comings of the student as customer model are exposed. From a practical perspective the arguments made in this paper provide the groundwork for possible future research into the adverse affects of the student as customer model on academic leadership and job satisfaction in the academic work force. The concern for quality may benefit from empirical investigation of the relationship between the student as customer model and quality learning and assessment outcomes in the higher education sector. The paper raises awareness of the faults with the present reliance on the student as customer model and the negative impact on both students and academic staff. The issues explored have the potential to influence the future directions of the higher education sector with regard to the social implications of their quest for quality educational outcomes. The paper addresses a gap in the literature in regard to use of the student as customer model and the subsequent adverse affect on academic leadership and assessment in higher education.

Learning and teaching reflection : developing capacities for lifelong learning

Reflection is an essential part of being an effective learner and working as a productive teacher. It enables the learner or teacher to deliberate about the factors that lead to successful learning and teaching for them and/or their students, in a particular place and for a specific purpose, so they can make reasoned and effective choices. This chapter introduces important frameworks that cover a century of thinking around reflection in education, and illustrates how preservice teachers can use these ideas across three phases. First, becoming a reflective learner as a university student to enhance learning and assessment outcomes; second, becoming a reflective teacher to improve classroom teaching and learning outcomes; and third, developing the reflective capacities of primary students so they can enhance their skills for lifelong learning.

Responding to literature : accessible texts for reluctant readers

The Australian Curriculum: English 5.2 states, across all year level descriptions, that “students engage with a variety of texts for enjoyment”, with the level types of texts and levels of understanding developing over time (ACARA, 2014a). Problems arise when students are unable or unwilling to enjoy texts, and are reluctant to read, view, interpret, and evaluate written texts. This in turn impedes their ability to perform these texts for assessment purposes. The literacy abilities of students can vary widely within a single classroom, and it is a challenge for teachers to source and present texts which are accessible across the spectrum of reading abilities, as well as reflecting themes that are relevant and engaging for students, in addition to being consistent with the General Capabilities and Cross-Curriculum Priorities of the AC:E. In senior English also, the mainstream Qld Senior Syllabus (QSA, 2010, p. 6) requires that students have learning experiences developed through 15-20 literary texts, including the in-depth study of a complete novel. In the leisure context of English Communications, students may also “write stories, poems, or song lyrics” (QSA, 2004, p. 14). Since students’ responses to literature often take the form of other imaginative text creation we address this in this paper. We start by offering synopses of some accessible texts and strategies for teachers with these students who are unwilling or low literacy readers in junior secondary and senior level English. This paper canvases some easily read novels and some films with companion text suggestions which may serve as models for students responses. For the junior secondary texts, we identify how these align with the architecture of the Australian Curriculum’s General Capabilities and Cross Curriculum Priorities. Then, we will outline some suitable imaginative responses as possible assessment outcomes, such as short stories and digital stories.

Thinking as if you are another : drama, persuasive language and pretexts

Using Shaun Tan’s picture book Rules of Summer (2013) as a pretext, this practical session will explore how primary teachers can engage middle and upper primary students in drama-based activities that support student learning and assessment outcomes in both English and The Arts (with a particular emphasis on drama and media arts). The session will explore notions of persuasive text (written and oral), points of view, devised storytelling and embodied learning.

A meta-analytic approach to quantifying scientific uncertainty in stock assessments

Quantifying scientific uncertainty when setting total allowable catch limits for fish stocks is a major challenge, but it is a requirement in the United States since changes to national fisheries legislation. Multiple sources of error are readily identifiable, including estimation error, model specification error, forecast error, and errors associated with the definition and estimation of reference points. Our focus here, however, is to quantify the influence of estimation error and model specification error on assessment outcomes. These are fundamental sources of uncertainty in developing scientific advice concerning appropriate catch levels and although a study of these two factors may not be inclusive, it is feasible with available information. For data-rich stock assessments conducted on the U.S. west coast we report approximate coefficients of variation in terminal biomass estimates from assessments based on inversion of the assessment of the model’s Hessian matrix (i.e., the asymptotic standard error). To summarize variation “among” stock assessments, as a proxy for model specification error, we characterize variation among multiple historical assessments of the same stock. Results indicate that for 17 groundfish and coastal pelagic species, the mean coefficient of variation of terminal biomass is 18%. In contrast, the coefficient of variation ascribable to model specification error (i.e., pooled among-assessment variation) is 37%. We show that if a precautionary probability of overfishing equal to 0.40 is adopted by managers, and only model specification error is considered, a 9% reduction in the overfishing catch level is indicated.

Educational interventions in neurology:A comprehensive systematic review

A fear of neurology and neural sciences (neurophobia) may have clinical consequences. There is therefore a need to formulate an evidence-based approach to neurology education. A comprehensive systematic review of educational interventions in neurology was performed. BEI, Cochrane Library, Dialog Datastar, EBSCO Biomedical, EBSCO Psychology & Behavioral Sciences, EMBASE, ERIC, First Search, MDConsult, Medline, Proquest Medical Library and Web of Knowledge databases were searched for all published studies assessing interventions in neurology education among undergraduate students, junior medical doctors and residents up to and including July 2012. Two independent literature searches were performed for relevant studies, which were then classified for level of evidence using the Centre of Evidence-based Medicine criteria and four levels of Kirkpatrick educational outcomes. One systematic review, 16 randomized controlled trials (RCTs), nine non-randomized cohort/follow-up studies, 33 case series or historically controlled studies and three mechanism-based reasoning studies were identified. Educational interventions showed favourable evaluation or assessment outcomes in 15 of 16 (94%) RCTs. Very few studies measured subsequent clinical behaviour (two studies) and patient outcomes (one study). There is very little high quality evidence of demonstrably effective neurology education. However, RCTs are emerging, albeit without meeting comprehensive educational criteria. An improving evidence base in the quality of neurology education will be important to reduce neurophobia. © 2013 EFNS.

Gender and the Curriculum

Curriculum resides in relationship with the concept of gender in complex and multifaceted ways. Such a relationship acknowledges also the interconnectedness of curriculum, with assessment and pedagogy as well as with gender and demands that we look beyond gender as ‘sex-group differences’ to a deeper understanding of this notion as a cultural artifact, with more nuanced and complex understandings of boys and of girls and how gender affects young people’s identities as learners, as consumers of knowledge and skills, as well as differentially mediating their learning and ultimately their attainment. The chapter explores how we have moved from considerations of gender as a dichotomous variable (male/female) against which curriculum and assessment outcomes can be measured or evaluated, into considerations of gender as a culturally, fluid understanding of how boys and girls identify as individuals and as learners and how they differentially interact with subjects, subject knowledge and skills, as well as how these are taught and assessed.