Blended delivery and online assessment : scaffolding student reflections in work-integrated learning

This paper documents a teaching innovation addressing the challenges of embedding and assessing reflective practice in work-integrated learning, specifically marketing internships. We identify four issues relating to this problem: lack of knowledge or skill for reflection, limitations of physical journals, facilitation of different forms of reflection, and suitable models for teaching and assessing reflection. The paper outlines a blended approach combining face-to-face workshops and online resources, and using online reflective journals and digital stories as assessment. The approach and assessment tasks can be implemented in a variety of marketing and business units.

Evaluation of assessment in the context of work-based learning: Qualitative perspectives of new graduates

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focussed on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians’ perceptions of these evaluations. This study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly-graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, with differing assessment experiences was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences whilst a student. Data was thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) Transparency and consistency are critical elements of work-based competency assessment. (ii) Students are willing to take greater responsibility in their assessment process. (iii) Work-based competency assessment prepares students for employment. (iv) The relationship between students and their assessors can impact on the student experience and their assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in designing valid competency-based assessment approaches.

Development of an electronic role-play assessment initiative in bioscience for nursing students

Devising authentic assessments for subjects with large enrolments is a challenge. This study describes an electronic role-play assessment for approximately 600 first-year nursing students to learn and apply pathophysiology (bioscience) concepts to nursing practice. Students used Microsoft Office PowerPoint® to prepare electronic role-plays both between a nurse and patient, and between two nurses, thus simulating workplace scenarios. Student feedback demonstrated that respondents found this assessment useful for learning pathophysiology, and for applying pathophysiology to a nursing clinical setting. This electronic presentation circumvented issues associated with a traditional oral presentation such as embarrassment and logistics of scheduling groups, and rated well with students of non-English speaking background. The electronic role-play assessment initiative encouraged students to apply their bioscience knowledge to a clinical setting, and allowed students to conceptualise the importance of bioscience within both the nursing degree and the profession.

Teachers using annotations to engage students in assessment conversations : recontextualising knowledge

Assessment for Learning practices with students such as feedback, and self- and peer assessment are opportunities for teachers and students to develop a shared understanding of how to create quality learning performances. Quality is often represented through achievement standards. This paper explores how primary school teachers in Australia used the process of annotating work samples to develop shared understanding of achievement standards during their curriculum planning phase, and how this understanding informed their teaching so that their students also developed this understanding. Bernstein's concept of the pedagogic device is used to identify the ways teachers recontextualised their assessment knowledge into their pedagogic practices. Two researchers worked alongside seven primary school teachers in two schools over a year, gathering qualitative data through focus groups and interviews. Three general recontextualising approaches were identified in the case studies; recontextualising standards by reinterpreting the role of rubrics, recontextualising by replicating the annotation process with the students and recontextualising by reinterpreting practices with students. While each approach had strengths and limitations, all of the teachers concluded that annotating conversations in the planning phase enhanced their understanding, and informed their practices in helping students to understand expectations for quality.

Improving criteria and feedback in student assessment in law

Spurred on by both the 1987 Pearce Report1 and the general changes to higher education spawned by the “Dawkins revolution” from 1988, there has been much critical self-evaluation leading to profound improvements to the quality of teaching in Australian law schools.2 Despite the changes there are still areas of general law teaching practice which have lagged behind recent developments in our understanding of what constitutes high quality teaching. One such area is assessment criteria and feedback. The project Improving Feedback in Student Assessment in Law is an attempt to remedy this. It aims to produce a manual containing key principles for the design of assessment and the provision of feedback, with practical yet flexible ideas and illustrations which law teachers may adopt or modify. Most of the examples have been developed by teachers at the University of Melbourne Law School. The project was supported in 1996 by a Committee for the Advancement of University Teaching grant and the manual will be published late in 1997.3 This note summarises the core principles which are elaborated further in the manual.

Assessment of robust autonomy for unmanned systems : progress and challenges

The growing number of potential applications of Unmanned Aircraft Systems (UAS) in civilian operations and national security is putting pressure of National Airworthiness Authorities to provide a path for certification and allow UAS integration into the national airspace. The success of this integration depends not only on developments in improved UAS reliability and safety, but also on regulations for certification, and methodologies for operational performance and safety assessment. This paper focuses on the latter and describes progress in relation to a previously proposed framework for evaluating robust autonomy of UAS. The paper draws parallels between the proposed evaluation framework and the evaluation of pilots during the licensing process. It discusses how the data from the proposed evaluation can be used as an aid for decision making in certification and UAS designs. Finally, it discusses challenges associated with the evaluation.

Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

Teaching peer review reflective processes in accounting

A well designed peer review process in higher education subjects can lead to more confident and reflective learners who become skilled at making independent judgements of their own and others’ work; essential requirements for successful lifelong learning. The challenge for educators is to ensure their students gain these important graduate attributes within the constraints of a range of internal and external tensions currently facing higher education systems, including, respectively, the realities of large undergraduate Accounting subjects, culturally diverse and time-poor academics and students, and increased calls for public accountability of the Higher Education sector by groups such as the OECD. Innovative curriculum and assessment design and collaborative technologies have the capacity to simultaneously provide some measure of relief from these internal and external tensions and to position students as responsible partners in their own learning. This chapter reports on a two phase implementation of an online peer review process as part of the assessment in a large, under-graduate, International Accounting class. Phase One did not include explicit reflective strategies within the process, and anonymous and voluntary student views served to clearly highlight that students were ‘confused’ and ‘hesitant’ about moving away from their own ideas; often mistrusting the conflicting advice received from multiple peer reviewers. A significant number of students also felt that they did not have the skills to constructively review the work of their peers. Phase Two consequently utilised the combined power of e-Technology, peer review feedback and carefully scaffolded and supported reflective practices from Ryan and Ryan’s Teaching and Assessing Reflective Learning (TARL) model (see Chap. 2). Students found the reflective skills support workshop introduced in Phase Two to be highly useful in maximising the benefits of the peer review process, with 83 % reporting it supported them in writing peer reviews, while 90 % of the respondents reporting the workshop supported them in utilising peer and staff feedback.

Teacher education for high-poverty schools : keeping the bar high

For some time now, there has been a focus, both in Australia and internationally, on quality teaching as a fundamental component that affects the educational outcomes of all students. The question of how teacher education programs in Australia prepare effective teachers to work across all school settings-including low-SES schools-has been elevated to national prominence by data from the 20 12 Programme for International Student Assessment (PIS A), which revealed a fall in Australian students' world ranking across Mathematics, Reading and Science. Education is commonly acknowledged as a "foundation capability" that improves a person's life chances, including employment prospects, and it is widely understood to be a "route out of disadvantage" (McLachlan, Gilfillan, and Gordon 20 13). The Australian Bureau of Statistics 201 1- 12 data suggest that around 2.6 million (11.8%) Australians currently live under the poverty line (Phillips et a!. 2012, 8). According to the Organisation for Economic Cooperation and Development (OECD), despite the significant effects teachers have on student performance, disadvantaged schools are not always staffed with the highest quality teachers (see Darling-Hammond, 2006).

Great Expectations : stability and change in English teaching : the teacher as chameleon

Curriculum is always in a state of flux and so often the moves to ‘reform’ it are political rather than pedagogical. So often in these days of accountability we focus on the learner. I want to focus on the teacher in this presentation. As English educators we have to ‘fit’ whatever new policy model comes our way. The Australian curriculum seems to have tried to please every stakeholder in its process and as such has been formed without a single, unifying coherent theoretical basis. How do we challenge this paper tiger? We have to find the pedagogical models within the current framework and see what still works in practice. At the chalk-face there are still teaching, learning and assessment practices in English surviving from the last few decades of pedagogical change; and there is also room for accommodating new practices. Embracing and adapting the old and the new may be the key to staying creative and passionately engaged with our subject area.

The clinical utility of the Cornell Scale for Depression in Dementia as a routine assessment in nursing homes

Objective To examine the clinical utility of the Cornell Scale for Depression in Dementia (CSDD) in nursing homes. Setting 14 nursing homes in Sydney and Brisbane, Australia. Participants 92 residents with a mean age of 85 years. Measurements Consenting residents were assessed by care staff for depression using the CSDD as part of their routine assessment. Specialist clinicians conducted assessment of depression using the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders for residents without dementia or the Provisional Diagnostic Criteria for Depression in Alzheimer Disease for residents with dementia to establish expert clinical diagnoses of depression. The diagnostic performance of the staff completed CSDD was analyzed against expert diagnosis using receiver operating characteristic (ROC) curves. Results The CSDD showed low diagnostic accuracy, with areas under the ROC curve being 0.69, 0.68 and 0.70 for the total sample, residents with dementia and residents without dementia, respectively. At the standard CSDD cutoff score, the sensitivity and specificity were 71% and 59% for the total sample, 69% and 57% for residents with dementia, and 75% and 61% for residents without dementia. The Youden index (for optimizing cut-points) suggested different depression cutoff scores for residents with and without dementia. Conclusion When administered by nursing home staff the clinical utility of the CSDD is highly questionable in identifying depression. The complexity of the scale, the time required for collecting relevant information, and staff skills and knowledge of assessing depression in older people must be considered when using the CSDD in nursing homes.

The use of multimodal technologies to enhance reflective writing in teacher education

For preservice teachers new to the teaching profession, reflective practice can be a difficult process. Yet reflective writing, once mastered, has the capacity to support preservice teachers to make connections between teaching theory and professional practice, and to start to take control of their own professional learning journey. The reflective practice described in this chapter was scaffolded through a framework for writing, the use of annotated work samples and explicit teaching. This approach was enhanced through multimodal resources including written peer assessment, audio teacher feedback and a video recording of the class presentation. The video footage assisted the preservice teachers to reconcile the feedback that they received from multiple sources. This chapter describes and analyses the implementation of the PRT Pattern (Prompting Reflection using Technology). Results of this practice revealed that the multiple forms of feedback assisted the preservice teachers to analyse their performance in terms of their developing professional identity and practice.

Teaching and Assessing for Understanding at University in the South Pacific

Pacific people have their own unique ways of knowing that shape how they learn and this should be taken into account in planning curriculum and in teaching. Pacific people are more likely to want to learn by doing, seeing, collaborating and in a concrete environment whereas for Western students learning becomes formal quickly and depends more on words and theories. This assumed difference in learning preferences could present a problem for formal learning with the need to bridge the gap psychologically and epistemologically between concrete and formal modes of learning. It could be the reason why some students in the Pacific, even at the tertiary level, rely heavily on rote learning. This chapter is a discussion of learning and assessment practices that help to foster understanding as they might apply to teaching at university in the South Pacific.

Functional brain maps of Tower of London performance : a positron emission tomography and functional magnetic resonance imaging study

Regional cerebral blood flow (rCBF) and blood oxygenation level-dependent (BOLD) contrasts represent different physiological measures of brain activation. The present study aimed to compare two functional brain imaging techniques (functional magnetic resonance imaging versus [15O] positron emission tomography) when using Tower of London (TOL) problems as the activation task. A categorical analysis (task versus baseline) revealed a significant BOLD increase bilaterally for the dorsolateral prefrontal and inferior parietal cortex and for the cerebellum. A parametric haemodynamic response model (or regression analysis) confirmed a task-difficulty-dependent increase of BOLD and rCBF for the cerebellum and the left dorsolateral prefrontal cortex. In line with previous studies, a task-difficulty-dependent increase of left-hemispheric rCBF was also detected for the premotor cortex, cingulate, precuneus, and globus pallidus. These results imply consistency across the two neuroimaging modalities, particularly for the assessment of prefrontal brain function when using a parametric TOL adaptation.

Tornado Damage Assessment in the aftermath of the May 20th 2013 Moore Oklahoma Tornado

This report presents observations, findings, and recommendations from an engineering reconnaissance trip following the May 20th, 2013 tornado that struck Moore, Oklahoma. A team of faculty, research scientists, professional engineers, and civil engineering students were tasked with investigating and documenting the performance of critical facility buildings and residences, (IBC Occupancy Category II, III, and IV), in Moore, OK. The Enhanced Fujita (EF) 5 tornado created a 17-mile long damage swath destroying over 12,000 buildings and killing 24 people. The total economic loss from this single event was estimated at $3 billion. The May 20th tornado was the third major tornado to hit Moore in the previous 15 years.