Use of web-based formative assessment to support student learning in metabolism/nutrition unit

In 2002, an integrated basic science course was introduced into the Bachelor of Dental Sciences programme at the University of Queensland, Australia. Learning activities for the Metabolism and Nutrition unit within this integrated course included lectures, problem-based learning tutorials, computer-based self-directed learning exercises and practicals. To support student learning and assist students to develop the skills necessary to become lifelong learners, an extensive bank of formative assessment questions was set up using the commercially available package, WebCT®. Questions included short-answer, multiple-choice and extended matching questions. As significant staff time was involved in setting up the question database, the extent to which students used the formative assessment and their perceptions of its usefulness to their learning were evaluated to determine whether formative assessment should be extended to other units within the course. More than 90% of the class completed formative assessment tasks associated with learning activities scheduled in the first two weeks of the block, but this declined to less than 50% by the fourth and final week of the block. Patterns of usage of the formative assessment were also compared in students who scored in the top 10% for all assessment for the semester with those who scored in the lowest 10%. High-performing students accessed the Web-based formative assessment about twice as often as those who scored in the lowest band. However, marks for the formative assessment tests did not differ significantly between the two groups. In a questionnaire that was administered at the completion of the block, students rated the formative assessment highly, with 80% regarding it as being helpful for their learning. In conclusion, although substantial staff time was required to set up the question database, this appeared to be justified by the positive responses of the students.

Using student feedback to construct an assessment rubric for a concept map in physiology

Constructing quality assessment rubrics can be challenging, especially when they are used for integrated, group-centered, applied learning. We describe a collaborative assessment task in which groups of second-year dentistry students developed a complex concept map. In groups of four, the students were given a written, simulated, medical history of a patient and required to construct a concept map illustrating relevant pathophysiological concepts and pharmacological interventions. This report describes a research project aimed at making educational goals of the task more explicit through investigating student and faculty member understandings of the criteria that might be used to assess the concept map. Information was gathered about the perceptions of students in relation to the learning goals associated with the task. These were compared with faculty member perceptions. The findings were used to develop an assessment rubric intended to be more accessible to learners. The new rubric used the language of both faculty members and students to more clearly represent expectations of each criterion and standard. This assessment rubric will be used in 2005 for the next phase of the project.

Modern methods for traditional tasks: Developing an electronic version of student fieldwork assessment at The University of Queensland.

Fieldwork placements are an integral part of many professional tertiary programmes. At The University of Queensland, Occupational Therapy students undertake block fieldwork affiliations off campus at a wide range of sites as part of their studies. Students’ fieldwork performance has traditionally been assessed using a hard copy format of the Student Placement Evaluation Form (SPEF), which is posted to the university on completion by the clinical supervisor. This project aimed to develop an electronic version of the UQ Occupational Therapy Student Placement Evaluation Form (SPEF), to allow the assessment to be completed and returned in an on line format. Practitioners had become very comfortable with using the existing print based form so in order to encourage and assist users to extend beyond their comfort zones, numerous steps were taken to ease the learning process including incorporating the existing page layout, consistent colour coding, considerable user instruction, testing and software enhancement cycles. Additionally, the e-version of the SPEF aimed to provide a range of benefits such as on screen assistance in the form of instructions, roll overs and feedback to supervisors, increased accuracy, faster completion, cost savings to the School, up to date design, improved security and confidential and anonymous storage of fieldwork results for potential future research.

Development of the student placement evaluation form: A tool for assessing student fieldwork performance

Evaluation of students undertaking fieldwork education placements is a critical process in the health professions. As training programs and practice evolve, systems for assessing students need to be reviewed and updated constantly. In 1995, staff of the occupational therapy training program at the University of Queensland, Australia decided to develop a new tool for assessing student fieldwork performance. Using an action research methodology, a team developed the Student Placement Evaluation Form, a flexible and comprehensive criterion-referenced evaluation tool. The present paper examines action research as an appropriate methodology for considering real-life organisational problems in a systematic and participatory manner. The action research cycles undertaken, including preliminary information gathering, tool development, trial stages and current use of the tool, are detailed in the report. Current and future development of the tool is also described.

Undergraduate student experience in dental service delivery in rural South Australia: An analysis of costs and benefits

Background, Rural experience for dental students can provide valuable clinical education, change attitudes to rural practice, and make a valuable contribution to clinical service provision. The aim of this paper is to assess the costs and benefits of service delivery by students through rural training programmes Methods: Groups of two students worked in the public dental clinics in adjacent rural centres where there had been long-term difficulties in recruiting staff. The costs and benefits of the programme were assessed by the impact on waiting lists, the total cost per patient of, a course of care and by the marginal cost of adding service provision by students to existing arrangements. Results: The total costs of emergency and complete treatment provided by students were greater than the costs of treatment provided by public-sector dentists but less than the costs of private providers treating public patients. However, the value of services were greater when care was provided by students or private providers and the marginal cost of students providing services was 50-70 per cent of the cost of care provided by public dentists. Conclusion: This assessment suggests that the service benefits achieved compliment the primary objective of influencing the attitude of students to rural practice.

Assessing the Use of Flexible Assessment

A course which has a large student enrolment consequently puts a heavy load on instructors both in the presentation and the assessment areas. In the School of Economics at the University of Queensland, this is the case for the quantitative analysis subjects. Assessment for many years has been through mid-semester and end of semester exams, as well as Computer Managed Learning (CML) assignments. In 2000 it was decided to incorporate a system of flexible assessment where neither the CML nor the mid-semester exam was compulsory. The outcomes are assessed and the advantages and disadvantages discussed.

Implications of missed opportunities for learning and assessment in design and technology education

Supporting student learning can be difficult, especially within open-ended or loosely structured activities, often seen as valuable for promoting student autonomy in many curriculum areas and contexts. This paper reports an investigation into the experiences of three teachers who implemented design and technology education ideas in their primary school classrooms for the first time. The teachers did not capitalise upon many of the opportunities for scaffolding their students' learning within the open-ended activities they implemented. Limitations of the teachers' conceptual and procedural knowledge of design and technology were elements that influenced their early experiences. The study has implications for professional developers planning programs in newly introduced areas of the curriculum to support teachers in supporting learning within open-ended and loosely structured problem solving activities. (C) 2001 Elsevier Science Ltd. All rights reserved.

Does participation in a pain course based on the international association for the study of pain's curricula guidelines change student knowledge about pain?

The People in Pain course was set up as a joint initiative of the Departments of Occupational Therapy and Physiotherapy within the School of Health and Rehabilitation Sciences at The University of Queensland. It was instigated in response to the publication of Pain Curricula for Occupational Therapy and Physiotherapy by the International Association for the Study of Pain (IASP) in 1994 (1). The first year it was offered, the "People in Pain" course comprised 14 h of lecture content. It was then expanded to encompass 28 h of lectures and seminar involvement. OBJECTIVES: To evaluate the impact of participation in a university pain course that meets the IASP pain curricula guidelines to increase health professional students' knowledge about pain. METHODS: Students who participated in the People in Pain course over the first three years were invited to complete the Revised Pain Knowledge and Attitudes Questionnaire (R-PKAQ) pre- and postcourse. Data obtained from 22 students in the short course formed a pilot project, and data from 22 students in the longer version of the course were used in the present study. RESULTS: Examination of the correlation matrix indicated substantial correlations between all R-PKAQ subscales except physiological basis of pain and pharmacological management of pain. In both the pilot project during the first year of the course and the expanded course in the following two years, significant improvement was found in the students' knowledge on five of the six subscales of the R-PKAQ: physiological basis of pain, psychological factors of pain perception, assessment and measurement of pain, cognitive-behavioural methods of pain relief, and pharmacological management of pain. Improvements in the developmental aspects of pain perception subscale failed to reach significance. CONCLUSIONS: An integrated pain course developed according to the pain curriculum guidelines developed by the IASP resulted in increased student knowledge regardless of the length of the program attended.

Enhancing student performance through cooperative learning in physical sciences

Students in a physical sciences course were introduced to cooperative learning at the University of Queensland, Gatton Campus. Groups of four to five students worked together in tutorial and practical sessions. Mid-term and practical examinations were abolished and 40% of total marks were allocated to the cooperative learning activities. A peer- and self-assessment system was successfully adapted to account for individual performance in cooperative learning group assignments. The results suggest that cooperative learning was very well received by students, and they expressed willingness to join cooperative learning groups in other courses. In addition, cooperative learning offered many benefits to students in terms of graduate attributes such as teamwork, communication, lifelong learning and problem-solving.