Using student feedback to construct an assessment rubric for a concept map in physiology

Constructing quality assessment rubrics can be challenging, especially when they are used for integrated, group-centered, applied learning. We describe a collaborative assessment task in which groups of second-year dentistry students developed a complex concept map. In groups of four, the students were given a written, simulated, medical history of a patient and required to construct a concept map illustrating relevant pathophysiological concepts and pharmacological interventions. This report describes a research project aimed at making educational goals of the task more explicit through investigating student and faculty member understandings of the criteria that might be used to assess the concept map. Information was gathered about the perceptions of students in relation to the learning goals associated with the task. These were compared with faculty member perceptions. The findings were used to develop an assessment rubric intended to be more accessible to learners. The new rubric used the language of both faculty members and students to more clearly represent expectations of each criterion and standard. This assessment rubric will be used in 2005 for the next phase of the project.

Triple objective team mentoring: achieving learning objectives with chemical engineering students

A sophisticated style of mentoring has been found to be essential to support engineering student teams undertaking technically demanding, real-world problems as part of a Project-Centred Curriculum (PCC) at The University of Queensland. The term ‘triple-objective’ mentoring was coined to define mentoring that addresses not only the student’s technical goal achievement but also their time and team management. This is achieved through a number of formal mentor meetings that are informed by a confidential instrument which requires students to individually reflect on team processes prior to the meeting, and a checklist of technical requirements against which the interim student team progress and achievements are assessed. Triple-objective mentoring requires significant time input and coordination by the academic but has been shown to ensure effective student team work and learning undiminished by team dysfunction. Student feedback shows they value the process and agree that the tools developed to support the process are effective in developing and assessing team work and skills with average scores mostly above 3 on a four point scale.

Undergraduate teaching of ideal and real fluid flows: The value of real-world experimental projects

This study describes the pedagogical impact of real-world experimental projects undertaken as part of an advanced undergraduate Fluid Mechanics subject at an Australian university. The projects have been organised to complement traditional lectures and introduce students to the challenges of professional design, physical modelling, data collection and analysis. The physical model studies combine experimental, analytical and numerical work in order to develop students’ abilities to tackle real-world problems. A first study illustrates the differences between ideal and real fluid flow force predictions based upon model tests of buildings in a large size wind tunnel used for research and professional testing. A second study introduces the complexity arising from unsteady non-uniform wave loading on a sheltered pile. The teaching initiative is supported by feedback from undergraduate students. The pedagogy of the course and projects is discussed with reference to experiential, project-based and collaborative learning. The practical work complements traditional lectures and tutorials, and provides opportunities which cannot be learnt in the classroom, real or virtual. Student feedback demonstrates a strong interest for the project phases of the course. This was associated with greater motivation for the course, leading in turn to lower failure rates. In terms of learning outcomes, the primary aim is to enable students to deliver a professional report as the final product, where physical model data are compared to ideal-fluid flow calculations and real-fluid flow analyses. Thus the students are exposed to a professional design approach involving a high level of expertise in fluid mechanics, with sufficient academic guidance to achieve carefully defined learning goals, while retaining sufficient flexibility for students to construct there own learning goals. The overall pedagogy is a blend of problem-based and project-based learning, which reflects academic research and professional practice. The assessment is a mix of peer-assessed oral presentations and written reports that aims to maximise student reflection and development. Student feedback indicated a strong motivation for courses that include a well-designed project component.

Use of the web to provide learning support for a large metabolism and nutrition class

To support student learning in a large Metabolism and Nutrition class, we have introduced a web-based package, using a commercially available program, WebCT. The package was developed at a minimal cost and with limited resources. In addition to downloadable (PDF) versions of lecture Powerpoint presentations, tutorial outlines and a practical class exercise, web-based self-directed learning exercises were included to reinforce and extend lecture material in an active learning environment. The web-site also contained a variety of formative and summative assessment tasks that examined both factual recall and higher order thinking Detailed course information, timetables and a bulletin board were also readily accessible. Student usage of the site was generally high, but varied widely between individual students. Students who achieved a high overall score for the course completed on average three times as many formative assessment items and achieved a higher score for all tests than students who did poorly. Student feedback about the site was very positive with the majority of students reporting that the course material and assessment items that were available were useful to their learning. Administration of the course was also facilitated. (C) 2001 IUBMB. Published by Elsevier Science Ltd. All rights reserved.

Responding to our customers' needs: modifications to assessment in Obstetrics and Gynaecology over 20 years

Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.

Problem-based learning: a case study in providing e-health education using the Internet

The current trend among many universities is to increase the number of courses available online. However, there are fundamental problems in transferring traditional education courses to virtual formats. Delivering current curricula in an online format does not assist in overcoming the negative effects on student motivation which are inherent in providing information passively. Using problem-based learning (PBL) online is a method by which computers can become a tool to encourage active learning among students. The delivery of curricula via goal-based scenarios allows students to learn at different rates and can successfully shift online learning from memorization to discovery. This paper reports on a Web-based e-health course that has been delivered via PBL for the past 12 months. Thirty distance-learning students undertook postgraduate courses in e-health delivered via the Internet (asynchronous communication). Data collected via online student surveys indicated that the PBL format was both flexible and interesting. PBL has the potential to increase the quality of the educational experience of students in online environments.

Factors affecting student attitudes toward flexible online learning in management education

In response to recent technological advances and the trend toward flexible learning in education, the authors examined the factors affecting student satisfaction with flexible online learning. The authors identified 2 key student attributes of student satisfaction: (a) positive perceptions of technology in terms of ease of access and use of online flexible learning material and (b) autonomous and innovative learning styles. The authors derived measures of perceptions of technology from research on the Technology Acceptance Model and used locus of control and innovative attitude as indicators of an autonomous and innovative learning mode. First-year students undertaking an introductory management course completed surveys at the beginning (n = 248) and at the end (n = 256) of course work. The authors analyzed the data by using structural equation modeling. Results suggest that student satisfaction is influenced by positive perceptions toward technology and an autonomous learning mode.

Modern methods for traditional tasks: Developing an electronic version of student fieldwork assessment at The University of Queensland.

Fieldwork placements are an integral part of many professional tertiary programmes. At The University of Queensland, Occupational Therapy students undertake block fieldwork affiliations off campus at a wide range of sites as part of their studies. Students’ fieldwork performance has traditionally been assessed using a hard copy format of the Student Placement Evaluation Form (SPEF), which is posted to the university on completion by the clinical supervisor. This project aimed to develop an electronic version of the UQ Occupational Therapy Student Placement Evaluation Form (SPEF), to allow the assessment to be completed and returned in an on line format. Practitioners had become very comfortable with using the existing print based form so in order to encourage and assist users to extend beyond their comfort zones, numerous steps were taken to ease the learning process including incorporating the existing page layout, consistent colour coding, considerable user instruction, testing and software enhancement cycles. Additionally, the e-version of the SPEF aimed to provide a range of benefits such as on screen assistance in the form of instructions, roll overs and feedback to supervisors, increased accuracy, faster completion, cost savings to the School, up to date design, improved security and confidential and anonymous storage of fieldwork results for potential future research.

Sharing Narratives Online: An international, self-organising curriculum in rural health

The aim of the Rural Medicine Rotation (RMR) at the University of Queensland (UQ) is to give all third year medical students exposure to and an understanding of, clinical practice in Australian rural or remote locations. A difficulty in achieving this is the relatively short period of student clinical placements, in only one or two rural or remote locations. A web-based Clinical Discussion Board (CDB) has been introduced to address this problem by allowing students at various rural sites to discuss their rural experiences and clinical issues with each other. The rationale is to encourage an understanding of the breadth and depth of rural medicine through peer-based learning. Students are required to submit a minimum of four contributions over the course of their six week rural placement. Analysis of student usage patterns shows that the majority of students exceeded the minimum submission criteria indicating motivation rather than compulsion to contribute to the CDB. There is clear evidence that contributing or responding to the CDB develops studentâ??s critical thinking skills by giving and receiving assistance from peers, challenging attitudes and beliefs and stimulating reflective thought. This is particularly evident in regard to issues involving ethics or clinical uncertainty, subject areas that are not in the medical undergraduate curriculum, yet are integral to real-world medical practice. The CDB has proved to be a successful way to understand the concerns and interests of third year medical students immersed in their RMR and also in demonstrating how technology can help address the challenge of supporting students across large geographical areas. We have recently broadened this approach by including students from the Rural Program at The Ohio State University College of Medicine. This important international exchange of ideas and approaches to learning is expected to broaden clinical training content and improve understanding of rural issues.

EOPAS, the EthnoER online representation of interlinear text

One of the goals of the ARC funded Eresearch project called Sharing access and analytical tools for ethnographic digital media using high speed networks, or simply EthnoER is to take outputs of normal linguistic analytical processes and present them online in a system we have called the EthnoER online presentation and annotation system, or EOPAS.

Development of the student placement evaluation form: A tool for assessing student fieldwork performance

Evaluation of students undertaking fieldwork education placements is a critical process in the health professions. As training programs and practice evolve, systems for assessing students need to be reviewed and updated constantly. In 1995, staff of the occupational therapy training program at the University of Queensland, Australia decided to develop a new tool for assessing student fieldwork performance. Using an action research methodology, a team developed the Student Placement Evaluation Form, a flexible and comprehensive criterion-referenced evaluation tool. The present paper examines action research as an appropriate methodology for considering real-life organisational problems in a systematic and participatory manner. The action research cycles undertaken, including preliminary information gathering, tool development, trial stages and current use of the tool, are detailed in the report. Current and future development of the tool is also described.

A simple data logger for student-designed rocket experiments.

The final-year project for Mechanical & Space Engineering students at UQ often involves the design and flight testing of an experiment. This report describes the design and use of a simple data logger that should be suitable for collecting data from the students' flight experiments. The exercise here was taken as far as the construction of a prototype device that is suitable for ground-based testing, say, the static firing of a hybrid rocket motor.

The interaction between technologies and society: Lessons learnt from 160 evolutionary years of online news services

In mapping the evolutionary process of online news and the socio-cultural factors determining this development, this paper has a dual purpose. First, in reworking the definition of “online communication”, it argues that despite its seemingly sudden emergence in the 1990s, the history of online news started right in the early days of the telegraphs and spread throughout the development of the telephone and the fax machine before becoming computer-based in the 1980s and Web-based in the 1990s. Second, merging macro-perspectives on the dynamic of media evolution by DeFleur and Ball-Rokeach (1989) and Winston (1998), the paper consolidates a critical point for thinking about new media development: that something technically feasible does not always mean that it will be socially accepted and/or demanded. From a producer-centric perspective, the birth and development of pre-Web online news forms have been more or less generated by the traditional media’s sometimes excessive hype about the power of new technologies. However, placing such an emphasis on technological potentials at the expense of their social conditions not only can be misleading but also can be detrimental to the development of new media, including the potential of today’s online news.

An unexpected role for visual feedback in vehicle steering control

Some motor tasks can be completed, quite literally, with our eyes shut. Most people can touch their nose without looking or reach for an object after only a brief glance at its location. This distinction leads to one of the defining questions of movement control: is information gleaned prior to starting the movement sufficient to complete the task (open loop), or is feedback about the progress of the movement required (closed loop)? One task that has commanded considerable interest in the literature over the years is that of steering a vehicle, in particular lane-correction and lane-changing tasks. Recent work has suggested that this type of task can proceed in a fundamentally open loop manner [1 and 2], with feedback mainly serving to correct minor, accumulating errors. This paper reevaluates the conclusions of these studies by conducting a new set of experiments in a driving simulator. We demonstrate that, in fact, drivers rely on regular visual feedback, even during the well-practiced steering task of lane changing. Without feedback, drivers fail to initiate the return phase of the maneuver, resulting in systematic errors in final heading. The results provide new insight into the control of vehicle heading, suggesting that drivers employ a simple policy of “turn and see,” with only limited understanding of the relationship between steering angle and vehicle heading.

Undergraduate student experiences and perceptions of group projects

This paper reports the experiences and perceptions of student group projects of three cohorts of undergraduates: a 3rd year capstone course in professional communication (N = 54), a 3rd year elective in chemical engineering (N = 29), and a core 2nd-year course in chemical engineering (N = 74).