Does the summative assessment of real world learning using criterion-referenced assessment need to be discipline specific?

This paper synthesises the existing literature on the contemporary conception of ‘real world’ and compares it with similar notions such as ‘authentic’ and ‘work integrated learning’. While the term ‘real world’ may be partly dependent on the discipline, it does not necessarily follow that the criterion-referenced assessment of ‘real world’ assessment must involve criteria and performance descriptors that are discipline specific. Two examples of summative assessment (court report and trial process exercise) from a final year core subject at the Queensland University of Technology, LWB432 Evidence, emphasise real world learning, are authentic, innovative and better prepare students for the transition into the workplace than more generic forms of assessment such as tutorial participation or oral presentations. The court report requires students to attend a criminal trial in a Queensland Court and complete a two page report on what they saw in practice compared with what they learned in the classroom. The trial process exercise is a 50 minute written closed book activity conducted in tutorials, where students plan questions that they would ask their witness in examination-in-chief, plan questions that they would ask their opponent’s witness in cross-examination, plan questions that they would ask in reexamination given what their opponent asked in cross-examination, and prepare written objections to their opponent’s questions. The trial process exercise simulates the real world, whereas the court report involves observing the real world, and both assessment items are important to the role of counsel. The design of the criterion-referenced assessment rubrics for the court report and trial process exercise is justified by the literature. Notably, the criteria and performance descriptors are not necessarily law specific and this paper highlights the parts that may be easily transferred to other disciplines.

Sustainable assessment for large science classes : non-multiple choice, randomised assignments through a Learning Management System

This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs’ SOLO taxonomy. However, written assessment items require extensive resources for marking, and are susceptible to copying as well as marking inconsistencies for large classes. This project developed an assessment tool which is valid, reliable and sustainable and that addresses the issues identified above. The tool provides each student with an assignment assessing the same learning outcomes, but containing different questions, with responses in the form of words or numbers. Practice questions are available, enabling students to obtain feedback on their approach before submitting their assignment. Thus, the tool incorporates automatic marking (essential for large classes), randomised tasks to each student (reducing copying), the capacity to give credit for working (feedback on the application of theory), and the capacity to target higher order learning outcomes by requiring students to derive their answers rather than choosing them. Results and feedback from students are presented, along with technical implementation details.

Teaching engineering tribology: Elements of assessment design for different learning styles

This study involves teaching engineering students concepts in lubrication engineering that are heavily dependent on mathematics. Excellent learning outcomes have been observed when assessment tasks are devised for a diversity of learning styles. Providing different pathways to knowledge reduces the probability that a single barrier halts progress towards the ultimate learning objective. The interdisciplinary nature of tribology can be used advantageously to tie together multiple elements of engineering to solve real physical problems—an approach that seems to benefit a majority of engineering students. To put this into practice, various assessment items were devised on the study of hydrodynamics, culminating in a project to provide a summative evaluation of the students’ learning achievement. A survey was also conducted to assess other aspects of students’ learning experiences under the headings: ‘perception of learning’ and ‘overall satisfaction’. High degrees of achievement and satisfaction were observed. An attempt has been made to identify the elements contributing to success so that they may be applied to other challenging concepts in engineering education.

SAVOURING ABILITIES SCALE (SAS): THE DEVELOPMENT OF A STRENGTHS - BASED ASSESSMENT FOR THERAPEUTIC RECREATION PROFESSIONALS

The purpose of this study was to develop and evaluate an assessment that measured savouring leisure. The assessment items developed were reviewed for content validity by eight international therapeutic recreation (TR) educators and administrators as well as eleven TR practitioners. An exploratory factor analysis was conducted to determine the most suitable items for the assessment. The results suggest that the original three subscale design needed to be modified to five. The reliability of the total assessment is α=.84. Statistical analysis for construct validity reveal 58.52% of the variance explained, and a moderate correlation was found between this study and other savouring assessments. The implications of the shift in conceptualization are reviewed through discussing factor analysis issues, the lived experience of savouring leisure, and the impact of the content validity process. This study contributes to the ongoing dialog of savouring leisure. Recommendations for future research are discussed.

Health assessment document for 2,3,7,8-tetrachlorodibenzo-p-dioxin (TCDD) and related compounds.

"Draft, do not quote or cite."

An Assessment of maritime trade and technology : summary.

Mode of access: Internet.

What it means to become a public relations professional: student perceptions of professional identity through real-world learning

Public relations educators need new solutions to prepare students to become tomorrow's practitioner today. Managers and employers in the new creative workforce (McWilliam, 2008) expect graduates to be problem solvers, critical and creative thinkers, reflective, and self reliant (Barrie, 2008; David, 2004). Enabling students to develop these attributes requires a collaborative and creative approach to pedagogy (Jeffrey & Craft, 2001, 2004). A model for the next generation of public relations education was developed to integrate industry partnerships as a way to bridge pedagogy and professional practice. The model suggests (a) that industry partnerships be embedded in learning activities, (b) that assessment items be considered on a continuum and delivered incrementally across a course of study, and (c) that connections between classroom and workplace activities are clearly signposted for students.

Assessing students in senior science: an analysis of questions in contextualised chemistry exams

This study explores the development of a coding system for analysing test questions in two context-based chemistry exams. We describe our unique analytical procedures before contrasting the data from both tests. Our findings indicate that when a new curriculum is developed such as a context-based curriculum, teachers are required to combine the previously separate domains of context and concept to develop contextualised assessment. We argue that constructing contextualised assessment items requires teachers to view concepts and context as interconnected rather than as separate entities that may polarise scientific endeavour. Implications for practice, curriculum and assessment-development in context-based courses are proposed.

Nurses driving change to improve access to education and quality in lcinical teaching : A partnership between Australia and Viet Nam

In Viet Nam, standards of nursing care fail to meet international competency standards. This increases risks to patient safety (eg. hospital acquired infection), consequently the Ministry of Health identified the need to strengthen nurse education in Viet Nam. This paper presents experiences of a piloted clinical teaching model developed in Ha Noi, to strengthen nurse led institutional capacity for in-service education and clinical teaching. Historically 90% of nursing education was conducted by physicians and professional development in hospitals for nurses was limited. There was minimal communication between hospitals and nursing schools about expectations of students and assessment and quality of the learning experience. As a result when students came to the clinical sites, no-one understood how to plan their learning objectives and utilise teaching and learning approaches appropriate to their level. Therefore student learning outcomes were variable. They focussed on procedures and techniques and “learning how to do” rather than learning how to plan, implement and evaluate patient care. This project is part of a multi-component capacity building program designed to improve nurse education in Viet Nam. The project was funded jointly by Queensland University of Technology (QUT) and the Australian Agency for International Development. Its aim was to develop a collaborative clinically-based model of teaching to create an environment that encourages evidence-based, student-centred clinical learning. Accordingly, strategies introduced promoted clinical teaching of competency based nursing practice utilising the regionally endorsed nurse core competency standards. Thirty nurse teachers from Viet Duc University Hospital and Hanoi Medical College participated in the program. These nurses and nurse teachers undertook face to face education in three workshops, and completed three assessment items. Assessment was applied, where participants integrated the concepts learned in each workshop and completed assessment tasks related to planning, implementing and evaluating teaching in the clinical area. Twenty of these participants were then selected to undertake a two week study tour in Brisbane, Australia where the clinical teaching model was refined and an action plan developed to integrate into both organisations with possible implementation across Viet Nam. Participants on this study tour also experienced clinical teaching and learning at QUT by attending classes held at the university, and were able to visit selected hospitals to experience clinical teaching in these settings as well. Effectiveness of the project was measured throughout the implementation phase and in follow up visits to the clinical site. To date changes have been noted on an individual and organisational level. There is also significant planning underway to incorporate the clinical teaching model developed across the organisation and how this may be implemented in other regions. Two participants have also been involved in disseminating aspects of this approach to clinical teaching in Ho Chi Minh, with further plans for more in-depth dissemination to occur throughout the country.

Is anybody there? Bootstrapping attendance with engagement

The report card for the introductory programming unit at our university has historically been unremarkable in terms of attendance rates, student success rates and student retention in both the unit and the degree course. After a course restructure recently involving a fresh approach to introducing programming, we reported a high retention in the unit, with consistently high attendance and a very low failure rate. Following those encouraging results, we collected student attendance data for several semesters and compared attendance rates to student results. We have found that interesting workshop material which directly relates to course-relevant assessment items and therefore drives the learning, in an engaging collaborative learning environment has improved attendance to an extraordinary extent, with student failure rates plummeting to the lowest in recorded history at our university.

Using technology to facilitate grading consistency in large classes

University classes in marketing are often large, and therefore require teams of teachers to cover all of the necessary activities. A major problem with teaching teams is the inconsistency that results from myriad individuals offering subjective opinions. This innovation uses the latest moderation techniques along with Audience Response Technology (ART) to enhance the learning experience by providing more consistent and reliable grading in large classes. Assessment items are moderated before they are graded in meetings that employ ART. Results show the process is effective when the teaching team is very large, or there is a diverse range of experienced and inexperienced teachers. This “behind the scenes” innovation is not immediately apparent to students, but results in more consistent grades, more useful feedback for students, and more confident graders.

The development of the graphics-decoding proficiency instrument

The Graphics-Decoding Proficiency (G-DP) instrument was developed as a screening test for the purpose of measuring students’ (aged 8-11 years) capacity to solve graphics-based mathematics tasks. These tasks include number lines, column graphs, maps and pie charts. The instrument was developed within a theoretical framework which highlights the various types of information graphics commonly presented to students in large-scale national and international assessments. The instrument provides researchers, classroom teachers and test designers with an assessment tool which measures students’ graphics decoding proficiency across and within five broad categories of information graphics. The instrument has implications for a number of stakeholders in an era where graphics have become an increasingly important way of representing information.

Australian adolescents’ perceived school-based barriers and facilitators to engagement in physical activity

OBJECTIVE: School-aged youth spend a significant amount of time either in transit to and from school, or within school settings performing a range of varying learning-based activities. Adolescent physical activity has also been shown to increase the likelihood of maintaining physical activity throughout adulthood. The purpose of this study is to investigate adolescents’ perceived school-based barriers and facilitators to engagement in physical activity. METHODS: One-hundred and twenty four participants (38 males and 86 females) were recruited from two non-denominational same-sex private schools, in Brisbane, Australia. The mean age and standard deviation (SD) was 13.83 (0.56) and 14.40 (2.33) for males and females respectively. Participants responded to a series questions regarding perceived barriers and facilitators to engagement in physical activity. Quantitative data was analysed using descriptive statistics and frequency distributions, and qualitative data with thematic analysis. RESULTS: A total of 121 (97.6%) participants had complete data sets and were included in the analysis. School timetable (44.6%), homework (81.8%), and assessment (81.0%) were identified as the most prominent perceived factors, increasing the difficulty of physical activity engagement. Physical Education classes (71.9%) and school sport programs (80.2%) were identified as the most prominent perceived factors that facilitate engagement in physical activity. There was no significant gender effect. CONCLUSIONS: Each of the identified factors perceived by adolescent's as either barriers or facilitators to engagement in physical activity may be addressed by administrators at a school and government policy level. These may include strategies such as; increasing the assigned hours to physical education classes, providing additional extra-curricular sporting opportunities, and reviewing the time allocated to homework and assessment items. This may provide a simpler, low-cost solution to increasing youth physical activity, as opposed to contemporary higher-cost strategies utilising increased staff commitment, mass media, provision of equipment and counsellors and other health professionals.

The “Engineers without Borders” Challenge : does it engage Australian and New Zealand students with sustainability?

This paper explores the rationale, experience and impact of thirteen Australia and New Zealand universities that have integrated the Engineers Without Borders (EWB) challenge into their first year engineering curriculum. EWB is a national competition for university students, who work in teams to develop conceptual designs for real sustainable development projects across the globe. This project investigated “what works and what doesn’t” in engineering curriculum renewal, utilising content analysis, multiple in-depth interviews with students and staff (coordinators, lecturers, tutors) and observation. EWB comprises between 25 to 100% of the total assessment items. This paper specifically focuses on student’s experience of EWB, documenting how the project teaches sustainability and systems-thinking approaches, engages students with different cultures, and fosters teamwork, new ways of thinking and communication skills. We identify key benefits and challenges of EWB, as well as mechanisms and contexts that foster student engagement and learning outcomes.