Editorial - Assessment of EAL/D learners : the validity of teachers' professional judgements

Assessment is a recurring theme in this issue of TESOL in Context. It is the focus of a themed section; addressed in some of the award-winning thesis research we feature; and one of several topics in an article on EFL teacher preparation in an Australian university. In the first section of the issue we are pleased to publish précis of the theses produced by the joint winners of the Penny McKay Memorial Award for Best Thesis in Language Education. Penny was a major figure in the development of EAL/D education in Australia (see Dooley & Moore, 2009). Her work is remembered and continued through an Award established by the Australian Council of TESOL Associations (ACTA) and the Applied Linguistics Association of Australia (ALAA). The award recognises doctoral research which makes an outstanding contribution to second/additional language education in Australian schools (http://www.tesol.org.au/About-ACTA/PENNY-MCKAY-MEMORIAL-FUND)...

Sustainable Pedagogical Change for Embedding Reflective Learning Across Higher Education Programs

For pedagogical change to be sustained over time, and over the span of higher education courses, it needs to be framed widely, rather than ‘tacked on’. The framing includes curriculum reform and resource provision alongside staff pedagogical development. This is especially true for initiatives (such as reflective writing and assessment) that target broad-based, high-level skills and dispositions. For various reasons, such initiatives can easily become lost because of the discipline-specific focus of a syllabus outweighs the initiative, or because lack of resources compromises a desired approach. Course improvement in higher education contexts is typically difficult and episodic. In such circumstances, we argue that a strategic and trustworthy approach is necessary where practitioner-lead pedagogic development is fostered through trust and communication and is purposefully embedded within key dimensions of curriculum integration and resource provision. This chapter describes an approach to pedagogical change where curriculum, pedagogy and resources are simultaneously and collaboratively orchestrated to provide an effective framework for sustainable and effective change. A robust conceptual model is proposed to guide the implementation of such change.

Class participation as a learning and assessment strategy in law : facilitating students’ engagement, skills development and deep learning

Assessment has widely been described as being ‘at the centre of the student experience’. It would be difficult to conceive of the modern teaching university without it. Assessment is accepted as one of the most important tools that an educator can deploy to influence both what and how students learn. Evidence suggests that how students allocate time and effort to tasks and to developing an understanding of the syllabus is affected by the method of assessment utilised and the weighting it is given. This is particularly significant in law schools where law students may be more preoccupied with achieving high grades in all courses than their counterparts from other disciplines. However, well-designed assessment can be seen as more than this. It can be a vehicle for encouraging students to learn and engage more broadly than with the minimums required to complete the assessment activity. In that sense assessment need not merely ‘drive’ learning, but can instead act as a catalyst for further learning beyond what a student had anticipated. In this article we reconsider the potential roles and benefits in legal education of a form of interactive classroom learning we term assessable class participation (‘ACP’), both as part of a pedagogy grounded in assessment and learning theory, and as a platform for developing broader autonomous approaches to learning amongst students. We also consider some of the barriers students can face in ACP and the ways in which teacher approaches to ACP can positively affect the socio-emotional climates in classrooms and thus reduce those barriers. We argue that the way in which a teacher facilitates ACP is critical to the ability to develop positive emotional and learning outcomes for law students, and for teachers themselves.

Valuable learning, unwelcome assessment : what LLB and JD students really think about group work

This article contributes to current debates about the appropriate role of group work in legal curricula by providing insights into the attitudes of Bachelor of Laws (‘LLB’) and Juris Doctor (‘JD’) students towards such tasks. It begins by reviewing arguments for incorporating group work in legal education, both as a result of the recognition of its educational benefits, and as a response to increasing regulatory expectations regarding student collaboration skills. The article then reports the findings of a UNSW Law School Student Assessment Survey designed to determine how law students perceive group work and its assessment in law. One of the most striking findings is that many of the law students surveyed recognise and appreciate the learning and skills development benefits of group tasks, but are resistant to summative assessment of group work. Moreover, there are marked differences in attitude between LLB and JD students, and across year cohorts within those degrees. These findings suggest that further thought needs to be directed towards the specific purposes underpinning the choice of group work as a pedagogical tool, and assessment that is congruent with those purposes, taking into account the varying needs and experiences of different cohorts of students. The article concludes by considering whether meaningful group work can exist without summative assessment.

Early years national curriculum documents : revisiting inclusive education

Early years education encompasses early childhood education and care (ECEC) and the early years of school across the age range birth to eight years. The introduction of two national curriculum documents for early years education – the Early Years Learning Framework (Department of Education, Employment and Workplace Relations DEEWR, 2009) for ECEC programs and the Australian Curriculum (Australian Curriculum, Assessment and Reporting Authority ACARA, 2011a) – indicates a trend towards national coherence, yet highlights a gap between notions of inclusion in the ECEC and school sectors of early years education. These gaps have the potential to impact negatively on school transition experiences through reductions in continuity of pedagogy and partnerships with families. Australian definitions of inclusion have moved beyond integration (i.e., mainstream classroom placement with support services and accommodations to address disability or lack of English), to encompass curricular and pedagogic differentiation catering for the participation rights and sense of belonging of children with a diverse range of abilities and backgrounds. This paper considers improved curriculum alignment and pedagogic continuity through enactment of elements relevant to inclusion.

Balancing the books : an assessment of financial stress associated with social work and human service student placements

This report presents the findings from a study of the financial impact of work-integrated learning commonly referred to as 'placement' among social work and human services students. Based on a survey of 214 respondants, 14 in-depth interviews and two focus groups, the findings indicate that two thirds of the surveyed group felt tired and anxious about their experience of balancing paid work and placement, with 2 in 5 reporting their learning experience was compromised as a result. The significant implications and potential solutions are also discussed.

In pursuit of some appreciation: Assessment and group membership in children’s second stories

Group membership is central to social interaction. Within peer groups, social hierarchies and affiliations are matters to which members seriously attend (Corsaro, 2014). Studies of peer groups highlight how status is achieved through oppositional actions. This paper examines the way in which competition and collaboration in a children’s peer group accomplishes status during the production and management of “second stories” (Sacks 1992). We present analysis of the interaction of young boys in a preparatory year playground who are engaged in a single instance of storytelling “rounds”. Analysis highlights the pivotal role of members’ contributions, assessments and receipts in a series of second stories that enact a simultaneously competitive and collaborative local order.

MITIE C-Arm - Advanced innovation in education

Aim: In 2013 QUT introduced the Medical Imaging Training Immersive Environment (MITIE) as a virtual reality (VR) platform that allowed students to practice general radiography. The system software has been expanded to now include C-Arm. The aim of this project was to investigate the use of this technology in the pedagogy of undergraduate medical imaging students who have limited to no experience in the use of the C-Arm clinically. Method: The Medical Imaging Training Immersive Environment (MITIE) application provides students with realistic and fully interactive 3D models of C-Arm equipment. As with VR initiatives in other health disciplines (1–2) the software mimics clinical practice as much as possible and uses 3D technology to enhance 3D spatial awareness and realism. The application allows students to set up and expose a virtual patient in a 3D environment as well as creating the resultant “image” for comparison with a gold standard. Automated feedback highlights ways for the student to improve their patient positioning, equipment setup or exposure factors. The students' equipment knowledge was tested using an on line assessment quiz and surveys provided information on the students' pre-clinical confidence scale, with post-clinical data comparisons. Ethical approval for the project was provided by the university ethics panel. Results: This study is currently under way and this paper will present analysis of initial student feedback relating to the perceived value of the application for confidence in a high risk environment (i.e. operating theatre) and related clinical skills development. Further in-depth evaluation is ongoing with full results to be presented. Conclusion: MITIE C-Arm has a development role to play in the pre-clinical skills training for Medical Radiation Science students. It will augment their theoretical understanding prior to their clinical experience. References 1. Bridge P, Appleyard R, Ward J, Phillips R, Beavis A. The development and evaluation of a virtual radiotherapy treatment machine using an immersive visualisation environment. Computers and Education 2007; 49(2): 481–494. 2. Gunn T, Berry C, Bridge P et al. 3D Virtual Radiography: Development and Initial Feedback. Paper presented at the 10th Annual Scientific Meeting of Medical Imaging and Radiation Therapy, March 2013 Hobart, Tasmania.

The effect of feedback from pupil to teacher on assessment for leaning and visible learning: An ethnographic case study in a community school in England and the outcome in a state high school in Queensland, Australia

This study shows that there is positive regulatory effect of feedback from pupils to teachers on Assessment for Learning (AfL), classroom proactiveness, and on visible and progressive learning but not on behaviour. This research finding further articulates feedback from pupil to teacher as a paradigm shift from the classical paradigm of feedback from teacher to pupil. Here, the emphasis is geared towards pupils understanding of objectives built from previous knowledge. These are then feedback onto the teachers by the pupils in the form of discrete loops of cues and questions, where they are with their learning. This therefore enables them to move to the next level of understanding, and thus acquired independence, which in turn is reflected by their success in both formative and summative assessments. This study therefore shows that when feedback from pupil to teacher is used in combination with teacher to pupil feedback, AfL is ameliorated and hence, visible and accelerated learning occurs in a gender, nor subject non-dependent manner.

A three dimensional virtual medical imaging computed tomography suite: Innovation in education

Aims: The Medical Imaging Training Immersive Environment(MITIE) Computed Tomography(CT) system is an innovative virtual reality (VR) platform that allows students to practice a range of CT techniques. The aim of this pilot study was to harvest user feedback about the educational value of teh application and inform future pedagogical development. This presentation explores the use of this technology for skills training. Background: MITIE CT is a 3D VR environment that allows students to position a patient,and set CT technical parameters including IV contrast dose and dose rate. As with VR initiatives in other health disciplines the software mimics clinical practice as much as possible and uses 3D technology to enhance immersion and realism. The software is new and was developed by the Medical Imaging Course Team at a provider University with funding from a Health Workforce Australia 'Simulated Learning Environments' grant Methods: Current third year medical imaging students were provided with additional 1 hour MITIE laboratory tutorials and studnet feedback was collated with regard to educational value and performance. Ethical approval for the project was provided by the university ethics panel Results: This presentation provides qualitative analysis of student perceptions relating to satisfaction, usability and educational value. Students reported high levels of satisfaction and both feedback and assessment results confirmed the application's significance as a pre-clinical tool. There was a clear emerging theme that MITIE could be a useful learning tool that students could access to consolidate their clinical learning, either on campus or during their clinical placement. Conclusion: Student feedback indicates that MITIE CT has a valuable role to play in the clinial skills training for medical imaging students both in the academic and clinical environment. Future work will establish a framework for an appropriate supprting pedagogy that can cross the boundary between the two environments

Too much knowledge for a nurse? Use of physical assessment by final-semester nursing students

There is debate around the scope of physical assessment skills that should be taught in undergraduate nursing programs. Yet this debate is largely uninformed by evidence on what is learned and practiced by nursing students. This study examined the pattern and correlates of physical assessment skill utilization by 208 graduating nursing students at an Australian university, including measures of knowledge, frequency of use and perceived barriers to physical assessment skills during clinical practice. Of the 126 skills surveyed, on average only five were used every time students practiced. Core skills reflected inspection or general observation of the patient; none involved complex palpation, percussion or auscultation. Skill utilization was also shaped by specialty area. Most skills (70%) were, on average, never performed or learned and students perceived nursing physical assessment was marginalized in both university and workplace contexts. Lack of confidence was thus a significant barrier to use of skills. Based on these findings we argue that the current debate must shift to how we might best support students to integrate comprehensive physical assessment into nursing practice.

Enhanced student learning in accounting utilising web-based technology, peer-review feedback and reflective practices: A learning community approach to assessment

Higher education is becoming a major driver of economic competitiveness in an increasingly knowledge-driven global economy. Maintaining the competitive edge has seen an increase in public accountability of higher education institutions through the mechanism of ranking universities based on the quality of their teaching and learning outcomes. As a result, assessment processes are under scrutiny, creating tensions between standardisation and measurability and the development of creative and reflective learners. These tensions are further highlighted in the context of large undergraduate subjects, learner diversity and time-poor academics and students. Research suggests that high level and complex learning is best developed when assessment, combined with effective feedback practices, involves students as partners in these processes. This article reports on a four-phase, cross-institution and cross-discipline project designed to embed peer-review processes as part of the assessment in two large, undergraduate accounting classes. Using a social constructivist view of learning, which emphasises the role of both teacher and learner in the development of complex cognitive understandings, we undertook an iterative process of peer review. Successive phases built upon students’ feedback and achievements and input from language/learning and curriculum experts to improve the teaching and learning outcomes.

Exploring links between pedagogical knowledge practices and student outcomes in STEM education for primary schools

Science, technology, engineering, and mathematics (STEM) education is an emerging initiative in Australia, particularly in primary schools. This qualitative research aimed to understand Year 4 students' involvement in an integrated STEM education unit that focused on science concepts (e.g., states of matter, testing properties of materials) and mathematics concepts (e.g., 3D shapes and metric measurements) for designing, making and testing a strong and safe medical kit to insulate medicines (ice cubes) at desirable temperatures. Data collection tools included student work samples, photographs, written responses from students and the teacher, and researcher notes. In a post-hoc analysis, a pedagogical knowledge practice framework (i.e., planning, timetabling, preparation, teaching strategies, content knowledge, problem solving, classroom management, questioning, implementation, assessment, and viewpoints) was used to explain links to student outcomes in STEM education. The study showed how pedagogical knowledge practices may be linked to student outcomes (knowledge, understanding, skill development, and values and attitudes) for a STEM education activity.

Education in stroke prevention: Efficacy of an educational counselling intervention to increase knowledge in stroke survivors

BACKGROUND Motivational interviewing and stages of change are approaches to increasing knowledge and effecting behavioural change. This study examined the application of this approach on stroke knowledge acquisition and changing individual lifestyle risk factors in an outpatient clinic. METHODS RCT in which 200 participants were allocated to an education-counselling interview (ECI) or a control group. ECI group participants mapped their individual risk factors on a stage of change model and received an appointment to the next group lifestyle class. Participants completed a stroke knowledge questionnaire at baseline (T1), post-appointment, and three months (T3) post-appointment. Passive to active changes in lifestyle behaviour were self-reported at three months. RESULTS There was a statistically significant difference between groups from T1 toT3 in stroke knowledge (p < 0.001). While there was a significant shift from a passive to active stage of change for the overall study sample (p < 0.000), there was no significant difference between groups on the identified risk factors. CONCLUSIONS Although contact with patients in ambulatory clinical settings is limited due to time constraints, it is still possible to improve knowledge and initiate lifestyle changes utilizing motivational interviewing and a stage of change model. Stroke nurses may wish to consider these techniques in their practice setting.