Responding to our customers' needs: modifications to assessment in Obstetrics and Gynaecology over 20 years

Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.

How can experience in clinical and community settings contribute to early medical education? A BEME systematic review

Review date: Review period January 1992-December 2001. Final analysis July 2004-January 2005. Background and review context: There has been no rigorous systematic review of the outcomes of early exposure to clinical and community settings in medical education. Objectives of review: (1) Identify published empirical evidence of the effects of early experience in medical education, analyse it, and synthesize conclusions from it. (2) Identify the strengths and limitations of the research effort to date, and identify objectives for future research. Search strategy: Ovid search of. BEI, ERIC, Medline, CIATAHL and EMBASE Additional electronic searches of: Psychinfo, Timelit, EBM reviews, SIGLE, and the Cochrane databases. Hand-searches of: Medical Education, Medical Teacher, Academic Medicine, Teaching and Learning in Medicine, Advances in Health Sciences Education, Journal of Educational Psychology. Criteria: Definitions: Experience: Authentic (real as opposed to simulated) human contact in a social or clinical context that enhances learning of health, illness and/or disease, and the role of the health professional. Early: What would traditionally have been regarded as the preclinical phase, usually the first 2 years. Inclusions: All empirical studies (verifiable, observational data) of early experience in the basic education of health professionals, whatever their design or methodology, including papers not in English. Evidence from other health care professions that could be applied to medicine was included. Exclusions: Not empirical; not early; post-basic; simulated rather than 'authentic' experience. Data collection: Careful validation of selection processes. Coding by two reviewers onto an extensively modified version of the standard BEME coding sheet. Accumulation into an Access database. Secondary coding and synthesis of an interpretation. Headline results: A total of 73 studies met the selection criteria and yielded 277 educational outcomes; 116 of those outcomes (from 38 studies) were rated strong and important enough to include in a narrative synthesis of results; 76% of those outcomes were from descriptive studies and 24% from comparative studies. Early experience motivated and satisfied students of the health professions and helped them acclimatize to clinical environments, develop professionally, interact with patients with more confidence and less stress, develop self-reflection and appraisal skill, and develop a professional identity. It strengthened their learning and made it more real and relevant to clinical practice. It helped students learn about the structure and function of the healthcare system, and about preventive care and the role of health professionals. It supported the learning of both biomedical and behavioural/social sciences and helped students acquire communication and basic clinical skills. There were outcomes for beneficiaries other than students, including teachers, patients, populations, organizations and specialties. Early experience increased recruitment to primary care/rural medical practice, though mainly in US studies which introduced it for that specific purpose as part of a complex intervention. Conclusions: Early experience helps medical students socialize to their chosen profession. It. helps them acquire a range of subject matter and makes their learning more real and relevant. It has potential benefits for other stakeholders, notably teachers and patients. It can influence career choices.

Children's cooperative behavior and interactions in trained and untrained work groups in regular classrooms

This study examined group and individual factors that facilitate changes in cooperation and learning outcomes in trained and untrained work groups of elementary school-age children. The study had two foci. The first was to determine if the cooperative behaviors and interactions of children in classroom groups who were trained in cooperative learning skins were different from those of children who were given no training, and the second was to investigate small group interactions and achievement in these groups over time. The results showed that there were observable differences between student interactions in the two conditions and these differences were maintained over time. Compared with children in the untrained groups, those in the trained groups were consistently more cooperative and helpful to each other; they actively tried to involve each other in the learning task by using language which was more inclusive (e.g., frequent use of ''we''), and they gave more explanations to assist each other as they worked together. It appeared that as the children worked together over time, they became more responsive to the learning needs of each other. Furthermore, the children in the trained groups performed significantly better on the learning outcomes questionnaire than those in the untrained groups. (C) 1997 Society for the Study of School Psychology. Published by Elsevier Science Ltd.

The Australian Universities Teaching Committee project in 'Learning Outcomes and Curriculum Development in Psychology'

The Australian Universities Teaching Committee (AUTC) funds projects intended to improve the quality of teaching and learning in specific disciplinary areas. The project brief for 'Learning Outcomes and Curriculum Development in Psychology' for 2004/2005 was to 'produce an evaluative overview of courses ... with a focus on the specification and assessment of learning outcomes and ... identify strategic directions for universities to enhance teaching and learning'. This project was awarded to a consortium from The University of Queensland, University of Tasmania, and Southern Cross University. The starting point for this project is an analysis of the scientist-practitioner model and its role in curriculum design, a review of current challenges at a conceptual level, and consideration of the implications of recent changes to universities relating to such things as intemationalisation of programs and technological advances. The project will seek to bring together stakeholders from around the country in order to survey the widest possible range of perspectives on the project brief requirements. It is hoped also to establish mechanisms for fiiture scholarly discussion of these issues, including the establishment of an Australian Society for the Teaching of Psychology and an annual conference.

Project to investigate improving literacy and numeracy outcomes of distance education students in the early years of schooling

The project was commissioned to investigate and analyse the issue of effective support for distance education students in the early years of school to maximise literacy and numeracy outcomes. The scope of this project was limited to students living in rural and remote areas who are undertaking education at home and who are in their early years of schooling. For the purpose of this project, the early years are conceptualised as the first three years of formal compulsory schooling in each of the States and Territories. There were a number of key tasks for the project which included: 1. Examining of the role of home tutors/supervisors This included interviewing personnel from the State and Territory distance education providers as well as the principals, teachers, home tutors and children. 2. Describing literacy and numeracy teaching and learning, and the use of information and communication technologies (ICT) in distance education This aspect of the project involved a critical review and analysis of relevant literature and reports in the last five years, and a consideration of the new initiatives that had been implemented in the States and Territories in the last two years. 3. The development of resources Through examination of the role of home tutors/supervisors, and an examination of literacy and numeracy and the use of technology in distance education, three resources were developed: ● A guide for home tutors/supervisors and schools of distance education about effective intervention and assessment strategies to support students’ learning and to assist the home tutors/supervisors in implementing ICT to support the development of literacy and numeracy in the early years. ● A calendar of activities for literacy and numeracy that would act as a stimulus for integrated and authentic activity for young children. ● An embryonic website of resources for the stakeholders in rural and distance education that might act as a catalyst for future resource building and sharing. In this way the final key task of the project, which was to create a context for a strategic dissemination plan, was realised when a strategy to address effective dissemination of the findings of the project so as to maximise their usefulness for the relevant groups was achieved.

A sociocultural analysis of language learning: New forms of literacy practices in a language and culture awareness programme

This paper reports on a sociocultural study conducted in a Catholic primary school in the Australian outback and provides insights into how policy related to Languages Other Than English (LOTE) programmes is implemented in a specific location and interwoven within the literacy practices of children, parents and teachers. A case study that tracked a Year Four student's learning and development during a Language and Culture Awareness Programme is discussed within a discourse of cultural and linguistic practices. Significant aspects of the student's learning related to a phenomenon called multi-tiered scaffolding temporarily disrupted the established literacy practices in the school community. Implications of the research for second-language teaching and learning in Australian primary schools are elaborated.

The role of the learning community in the development of discipline knowledge and generic graduate outcomes

In this paper we describe a study of learning outcomes at a research-intensive Australian university. Three graduate outcome variables (discipline knowledge and skills, communication and problem solving, and ethical and social sensitivity) are analysed separately using OLS regression and comparisons are made of the patterns of unique contributions from four independent variables (the CEQ Good Teaching and Learning Communities Scales, and two new, independent, scales for measuring Teaching and Program Quality). Further comparisons of these patterns are made across the Schools of the university. Results support the view that teaching and program quality are not the only important determinants of students' learning outcomes. It is concluded that, whilst it continues to be appropriate for universities to be concerned with the quality of their teaching and programs, the interactive, social and collaborative aspects of students' learning experiences, captured in the notion of the Learning Community, are also very important determinants of graduate outcomes, and so should be included in the focus of attempts at enhancing the quality of student learning.

Fundamental Skills in Physics: Embedded Learning

Student attitudes towards a subject affect their learning. For students in physics service courses, relevance is emphasised by vocational applications. A similar strategy is being used for students who aspire to continued study of physics, in an introduction to fundamental skills in experimental physics – the concepts, computational tools and practical skills involved in appropriately obtaining and interpreting measurement data. An educational module is being developed that aims to enhance the student experience by embedding learning of these skills in the practicing physicist’s activity of doing an experiment (gravity estimation using a rolling pendulum). The group concentrates on particular skills prompted by challenges such as: • How can we get an answer to our question? • How good is our answer? • How can it be improved? This explicitly provides students the opportunity to consider and construct their own ideas. It gives them time to discuss, digest and practise without undue stress, thereby assisting them to internalise core skills. Design of the learning activity is approached in an iterative manner, via theoretical and practical considerations, with input from a range of teaching staff, and subject to trials of prototypes.

Special issue on methods and learning in functional MRI: Introductory remarks

This special issue represents a further exploration of some issues raised at a symposium entitled “Functional magnetic resonance imaging: From methods to madness” presented during the 15th annual Theoretical and Experimental Neuropsychology (TENNET XV) meeting in Montreal, Canada in June, 2004. The special issue’s theme is methods and learning in functional magnetic resonance imaging (fMRI), and it comprises 6 articles (3 reviews and 3 empirical studies). The first (Amaro and Barker) provides a beginners guide to fMRI and the BOLD effect (perhaps an alternative title might have been “fMRI for dummies”). While fMRI is now commonplace, there are still researchers who have yet to employ it as an experimental method and need some basic questions answered before they venture into new territory. This article should serve them well. A key issue of interest at the symposium was how fMRI could be used to elucidate cerebral mechanisms responsible for new learning. The next 4 articles address this directly, with the first (Little and Thulborn) an overview of data from fMRI studies of category-learning, and the second from the same laboratory (Little, Shin, Siscol, and Thulborn) an empirical investigation of changes in brain activity occurring across different stages of learning. While a role for medial temporal lobe (MTL) structures in episodic memory encoding has been acknowledged for some time, the different experimental tasks and stimuli employed across neuroimaging studies have not surprisingly produced conflicting data in terms of the precise subregion(s) involved. The next paper (Parsons, Haut, Lemieux, Moran, and Leach) addresses this by examining effects of stimulus modality during verbal memory encoding. Typically, BOLD fMRI studies of learning are conducted over short time scales, however, the fourth paper in this series (Olson, Rao, Moore, Wang, Detre, and Aguirre) describes an empirical investigation of learning occurring over a longer than usual period, achieving this by employing a relatively novel technique called perfusion fMRI. This technique shows considerable promise for future studies. The final article in this special issue (de Zubicaray) represents a departure from the more familiar cognitive neuroscience applications of fMRI, instead describing how neuroimaging studies might be conducted to both inform and constrain information processing models of cognition.

Beyond the middle: A report about literacy and numeracy development of target group students in the middle years of schooling: Volume 1

The report was commissioned by the Department of Education, Science and Training to investigate the perceived efficacy of middle years programmes in all States and Territories in improving the quality of teaching, learning and student outcomes, especially in literacy and numeracy and for student members of particular target groups. These target groups included students from lower socio-economic communities, Aboriginal and Torres Strait Islander communities, students with a language background other than English, rural and remote students, and students struggling with the transition from middle/upper primary to the junior secondary years. The project involved large scale national and international literature reviews on Australian and international middle years approaches as well as an analysis of key literacy and numeracy teaching and learning strategies being used. In the report, there is emergent evidence of the relative efficacy of a combination of explicit state policy, dedicated funding and curriculum and professional development frameworks that are focused on the improvement of classroom pedagogy in the middle years. The programs that evidenced the greatest current and potential value for target group students tended to have developed in state policy environments that encouraged a structural rather than adjunct approach to middle years innovations. The authors conclude that in order to translate the gains made into sustainable improvement of educational results in literacy and numeracy for target groups, there is a need for a second generation of middle years theorising, research, development and practice.

Stimulus competition in affective and relational learning

Evaluative learning theory states that affective learning, the acquisition of likes and dislikes, is qualitatively different from relational learning, the learning of predictive relationships among stimuli. Three experiments tested the prediction derived from evaluative learning theory that relational learning, but not affective learning, is affected by stimulus competition by comparing performance during two conditional stimuli, one trained in a superconditioning procedure and the other in a blocking procedure. Ratings of unconditional stimulus expectancy and electrodermal responses indicated stimulus competition in relational learning. Evidence for stimulus competition in affective learning was provided by verbal ratings of conditional stimulus pleasantness and by measures of blink startle modulation. Taken together, the present experiments demonstrate stimulus competition in relational and affective learning, a result inconsistent with evaluative learning theory. (C) 2001 Academic Press.