Going global with assessment: what to do when the dominant culture's literacy drives assessment

This article explores how the dominant cultural literacy in a western context relies on a western template of knowledge that can inhibit internationalisation of the curricula unless it is identified, transformed, and broadened to become interculturally responsive. As Brian Street has said "literacies may be sites of negotiation and transform ation" (1994, p. 99). Drawing on the findings of an innovative website, Worldmarks , developed at Queensland University of Technology, as well as qualitative interviews with international students and staff, this article addresses the serious implications of assessment driven by the dominant culture's literacy. We identify how and why assessment driven by responsive cultural literacy enables all students to develop comprehensive intercultural communication skills and understandings as part of their lifelong learning in Australian universities.

A longitudinal study of learning for a group of indigenous Australian university students: Dissonant conceptions and strategies

Conceptions of learning and strategies used by 15 indigenous students in three Australian universities were studied longitudinally over three years. Their academic achievements were good, but at a high cost in terms of time and effort. In spite of the fact that almost half of the students expressed higher-order (qualitative) conceptions of learning in the first year and more in the second and third years, all of the students reported using highly repetitive strategies to learn. That is, they did not vary their way of learning, reading or writing in the beginning of their studies and less than half of them did so at the end of the three years. It is argued that encountering variation in ways of learning is a prerequisite for the development of powerful ways of learning and studying.

Learning difficulties in numeracy in Australia

In this article, we provide an understanding of the term numeracy as it is used in Australia and a description of numeracy education in this country. In particular, we discuss the role of outcomes-based curriculum frameworks and outline the dominant teaching approaches. The focus is on students with learning difficulties and how they are identified and supported in schools. We create two vignettes based on real students with difficulties in numeracy, which highlight two of the most common problems. We report on the prevalence of learning difficulties in numeracy in Australia and describe some of the initiatives related to the assessment and enhancement of learning in numeracy that are being undertaken in various states in Australia. Finally, we identify some of the future challenges facing the Australian education system in this area. These challenges relate to teacher knowledge, mandated assessment, and the role of parents. We conclude the article by calling for the evaluation of current assessment and intervention initiatives as well as the development of a national program to support the goal of numeracy for all students.

Enhancing student performance through cooperative learning in physical sciences

Students in a physical sciences course were introduced to cooperative learning at the University of Queensland, Gatton Campus. Groups of four to five students worked together in tutorial and practical sessions. Mid-term and practical examinations were abolished and 40% of total marks were allocated to the cooperative learning activities. A peer- and self-assessment system was successfully adapted to account for individual performance in cooperative learning group assignments. The results suggest that cooperative learning was very well received by students, and they expressed willingness to join cooperative learning groups in other courses. In addition, cooperative learning offered many benefits to students in terms of graduate attributes such as teamwork, communication, lifelong learning and problem-solving.

Factors affecting student attitudes toward flexible online learning in management education

In response to recent technological advances and the trend toward flexible learning in education, the authors examined the factors affecting student satisfaction with flexible online learning. The authors identified 2 key student attributes of student satisfaction: (a) positive perceptions of technology in terms of ease of access and use of online flexible learning material and (b) autonomous and innovative learning styles. The authors derived measures of perceptions of technology from research on the Technology Acceptance Model and used locus of control and innovative attitude as indicators of an autonomous and innovative learning mode. First-year students undertaking an introductory management course completed surveys at the beginning (n = 248) and at the end (n = 256) of course work. The authors analyzed the data by using structural equation modeling. Results suggest that student satisfaction is influenced by positive perceptions toward technology and an autonomous learning mode.

Six-month outcome for dysphagia following traumatic brain injury: Radiological assessment

The coexistence of a swallowing impairment, or dysphagia, can severely impact upon the medical condition and recovery of a child with traumatic brain injury (TBI; Logemann, Pepe, & Mackay, 1994). Despite this fact, there is limited data that provide evidence of the progression or outcome of dysphagia in the pediatric population post-TBI (Rowe, 1999). The present study aimed to (1) provide a prospective radiologically based profile of swallowing outcome and (2) determine the clinical significance of any persistent physiological swallowing deficits by investigating the presence/absence of any coexistent respiratory complications. Seven children with moderate/severe TBI were evaluated via an initial videofluoroscopic swallowing assessment (VFSS) at an average of 24.1 days postinjury, during the acute phase of management. A follow-up VFSS was conducted at an average of 7 months, 3 weeks postinjury. The physiological impairment, swallowing safety, swallowing efficiency, and functional swallowing outcomes of the acute phase post-TBI were compared with reassessment results at 6 months post-TBI. The presence/absence of lower respiratory tract infection/respiratory complications in the past 6 months postinjury were recorded.VFSS revealed a number of residual physiological oropharyngeal swallowing impairments and reduced swallowing efficiency. However, all participants presented with clinically safe and functional swallowing outcomes at 6 months post-TBI, with no recent history of respiratory complication. This study indicates good functional swallowing and respiratory outcomes for patients at 6-months post-TBI despite the presence of persistent physiological swallowing impairment.

Responding to our customers' needs: modifications to assessment in Obstetrics and Gynaecology over 20 years

Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.

Using student feedback to construct an assessment rubric for a concept map in physiology

Constructing quality assessment rubrics can be challenging, especially when they are used for integrated, group-centered, applied learning. We describe a collaborative assessment task in which groups of second-year dentistry students developed a complex concept map. In groups of four, the students were given a written, simulated, medical history of a patient and required to construct a concept map illustrating relevant pathophysiological concepts and pharmacological interventions. This report describes a research project aimed at making educational goals of the task more explicit through investigating student and faculty member understandings of the criteria that might be used to assess the concept map. Information was gathered about the perceptions of students in relation to the learning goals associated with the task. These were compared with faculty member perceptions. The findings were used to develop an assessment rubric intended to be more accessible to learners. The new rubric used the language of both faculty members and students to more clearly represent expectations of each criterion and standard. This assessment rubric will be used in 2005 for the next phase of the project.

Objective and behavioural assessment of the emergence from post-traumatic amnesia (PTA)

Primary objective: To determine the profile of resolution of typical PTA behaviours and describe new learning and improvements in self-care during PTA. Research design: Prospective longitudinal study monitoring PTA status, functional learning and behaviours on a daily basis. Methods and procedures: Participants were 69 inpatients with traumatic brain injury who were in PTA. PTA was assessed using the Westmead or Oxford PTA assessments. Functional learning capability was assessed using a routine set of daily tasks and behaviour was assessed using an observational checklist. Data was analysed using descriptive statistics. Main outcomes and results: Challenging behaviours that are typically associated with PTA, such as agitation, aggression and wandering resolved in the early stages of PTA and incidence rates of these behaviours were less than 20%. Independence in self-care and bowel and bladder continence emerged later during resolution of PTA. New learning in functional situations was demonstrated by patients in PTA. Conclusions: It is feasible to begin active rehabilitation focused on functional skills-based learning with patients in the later stages of PTA. Formal assessment of typically observed behaviours during PTA may complement memory-based PTA assessments in determining emergence from PTA.

Dynamic assessment of articulation during lingual fatigue in myasthenia gravis

The present study aimed to investigate how induced lingual fatigue affected lingual strength, articulatory kinematics, and perceptual speech features in CS, a 51-year-old female with active myasthenia gravis (MG), and three age and gender matched control participants, Lingual fatigue was elicited via a series of endurance tasks using a tongue pressure bulb. Following each endurance task, the participants performed a speech task containing the phonemes /k/, /t/, and /j/ that was recorded with an electromagnetic articulograph, followed by a lingual strength assessment using a tongue pressure bulb. Participants repeated this schedule over five phases and kinematic and strength changes during each phase were compared to baseline measurements. All of CSs significant kinematic changes occurred during the final fatigue phase compared to 27.3% of the control group's kinematic changes occurring during this phase, suggesting the kinematic changes associated with fatigue were not accelerated in CS. The endurance tasks also elicited different kinematic effects for CSs anterior and posterior tongue segments. While CS exhibited mostly similar kinematic and perceptual changes to the control group, some of CS's perceptual transcriptions for /k/ and kinematic changes were not replicated, indicating that some different perceptual and physiological consequences to CS's speech were elicited by the endurance tasks.

Fitness assessment of document model

Document classification is a supervised machine learning process, where predefined category labels are assigned to documents based on the hypothesis derived from training set of labelled documents. Documents cannot be directly interpreted by a computer system unless they have been modelled as a collection of computable features. Rogati and Yang [M. Rogati and Y. Yang, Resource selection for domain-specific cross-lingual IR, in SIGIR 2004: Proceedings of the 27th annual international conference on Research and Development in Information Retrieval, ACM Press, Sheffied: United Kingdom, pp. 154-161.] pointed out that the effectiveness of document classification system may vary in different domains. This implies that the quality of document model contributes to the effectiveness of document classification. Conventionally, model evaluation is accomplished by comparing the effectiveness scores of classifiers on model candidates. However, this kind of evaluation methods may encounter either under-fitting or over-fitting problems, because the effectiveness scores are restricted by the learning capacities of classifiers. We propose a model fitness evaluation method to determine whether a model is sufficient to distinguish positive and negative instances while still competent to provide satisfactory effectiveness with a small feature subset. Our experiments demonstrated how the fitness of models are assessed. The results of our work contribute to the researches of feature selection, dimensionality reduction and document classification.

Modern methods for traditional tasks: Developing an electronic version of student fieldwork assessment at The University of Queensland.

Fieldwork placements are an integral part of many professional tertiary programmes. At The University of Queensland, Occupational Therapy students undertake block fieldwork affiliations off campus at a wide range of sites as part of their studies. Students’ fieldwork performance has traditionally been assessed using a hard copy format of the Student Placement Evaluation Form (SPEF), which is posted to the university on completion by the clinical supervisor. This project aimed to develop an electronic version of the UQ Occupational Therapy Student Placement Evaluation Form (SPEF), to allow the assessment to be completed and returned in an on line format. Practitioners had become very comfortable with using the existing print based form so in order to encourage and assist users to extend beyond their comfort zones, numerous steps were taken to ease the learning process including incorporating the existing page layout, consistent colour coding, considerable user instruction, testing and software enhancement cycles. Additionally, the e-version of the SPEF aimed to provide a range of benefits such as on screen assistance in the form of instructions, roll overs and feedback to supervisors, increased accuracy, faster completion, cost savings to the School, up to date design, improved security and confidential and anonymous storage of fieldwork results for potential future research.