Work-based assessment : qualitative perspectives of novice nutrition and dietetics educators

Background The assessment of competence for health professionals including nutrition and dietetics professionals in work-based settings is challenging. The present study aimed to explore the experiences of educators involved in the assessment of nutrition and dietetics students in the practice setting and to identify barriers and enablers to effective assessment. Methods A qualitative research approach using in-depth interviews was employed with a convenience sample of inexperienced dietitian assessors. Interviews explored assessment practices and challenges. Data were analysed using a thematic approach within a phenomenological framework. Twelve relatively inexperienced practice educators were purposefully sampled to take part in the present study. Results Three themes emerged from these data. (i) Student learning and thus assessment is hindered by a number of barriers, including workload demands and case-mix. Some workplaces are challenged to provide appropriate learning opportunities and environment. Adequate support for placement educators from the university, managers and their peers and planning are enablers to effective assessment. (ii) The role of the assessor and their relationship with students impacts on competence assessment. (iii) There is a lack of clarity in the tasks and responsibilities of competency-based assessment. Conclusions The present study provides perspectives on barriers and enablers to effective assessment. It highlights the importance of reflective practice and feedback in assessment practices that are synonymous with evidence from other disciplines, which can be used to better support a work-based competency assessment of student performance.

Towards an authentically assessed science curriculum

The intentions of the science curriculum are very often constrained by the forms of student learning that are required by, or are currently available within, the system of education. Furthermore, little attention is given to developing new approaches to assessment that would encourage these good intentions. In this chapter, we argue that achieving this broadening of the intentions of science education will require a diversity of assessment techniques and that only a profile of each student’s achievement will capture the range of intended learnings. We explore a variety of assessment modes that match some of these new aspects of science learning and that also provide students with both formative information and a more comprehensive and authentic summative profile of their performances. Our discussion is illustrated with research-based examples of assessment practice in relation to three aspects of science education that are increasingly referred to in curriculum statements as desirable human dimensions of science: context-based science education, decision-making processes and socioscientific issues and integrated science education. We conclude with some notes on what these broader kinds of assessment mean for teachers and the support they would need to include them in their day-to-day practices in the science classrooms if, and when, the mainstream of science teaching and learning takes these curricular intentions seriously.

A grand challenge : reflecting on university science curriculum design, collaborative partnerships and integration of information literacy skills

In 2012, Queensland University of Technology (QUT) committed to the massive project of revitalizing its Bachelor of Science (ST01) degree. Like most universities in Australia, QUT has begun work to align all courses by 2015 to the requirements of the updated Australian Qualifications Framework (AQF) which is regulated by the Tertiary Education Quality and Standards Agency (TEQSA). From the very start of the redesigned degree program, students approach scientific study with an exciting mix of theory and highly topical real world examples through their chosen “grand challenge.” These challenges, Fukushima and nuclear energy for example, are the lenses used to explore science and lead to 21st century learning outcomes for students. For the teaching and learning support staff, our grand challenge is to expose all science students to multidisciplinary content with a strong emphasis on embedding information literacies into the curriculum. With ST01, QUT is taking the initiative to rethink not only content but how units are delivered and even how we work together between the faculty, the library and learning and teaching support. This was the desired outcome but as we move from design to implementation, has this goal been achieved? A main component of the new degree is to ensure scaffolding of information literacy skills throughout the entirety of the three year course. However, with the strong focus on problem-based learning and group work skills, many issues arise both for students and lecturers. A move away from a traditional lecture style is necessary but impacts on academics’ workload and comfort levels. Therefore, academics in collaboration with librarians and other learning support staff must draw on each others’ expertise to work together to ensure pedagogy, assessments and targeted classroom activities are mapped within and between units. This partnership can counteract the tendency of isolated, unsupported academics to concentrate on day-to-day teaching at the expense of consistency between units and big picture objectives. Support staff may have a more holistic view of a course or degree than coordinators of individual units, making communication and truly collaborative planning even more critical. As well, due to staffing time pressures, design and delivery of new curriculum is generally done quickly with no option for the designers to stop and reflect on the experience and outcomes. It is vital we take this unique opportunity to closely examine what QUT has and hasn’t achieved to be able to recommend a better way forward. This presentation will discuss these important issues and stumbling blocks, to provide a set of best practice guidelines for QUT and other institutions. The aim is to help improve collaboration within the university, as well as to maximize students’ ability to put information literacy skills into action. As our students embark on their own grand challenges, we must challenge ourselves to honestly assess our own work.

The ABCs of teaching alphabet knowledge : affordances and challenges of ‘weaving’ visible and invisible pedagogies

As researchers interested in the pursuit of high quality/high equity literacy learning outcomes, we focus on the learning experiences of five early years French students, with a special regard for those who are already considered as being at-risk of educational failure. We narrow the empirical focus to a single lesson on a mechanical concept of print, that is matching lower and upper case alphabet letters. In doing so, we examine a deeply philosophical question: Which pedagogical practices dis/enable what sorts of early years students as literacy learners? We extend Cazden’s (2006) notion of ‘weaving’ knowledge across dimensions of knowing to describe how the case study teacher ‘weaves’ visible and invisible pedagogies over the four movements of a lesson. The findings reveal different pedagogical framings (Bernstein, 1996) have potentially different cognitive and social effects that constitute different kinds of literacy knowledge and oppressive subject positions for at-risk students (Young, 1990).

Not all dimensions of work self-efficacy are equal : understanding the role of tertiary work placements in the development of the elements of work self-efficacy

This paper examines the relationship between a final year tertiary work placement for criminology students at Griffith University in Brisbane and the development of their work self-efficacy. Using a work self-efficacy instrument developed by Professor Joe Raelin at Northeastern University in Boston, a pilot phase in 2006 and a larger study in 2007 investigated the students’ responses across seven self-efficacy factors of learning, problem-solving, teamwork, sensitivity, politics, pressure, and role expectations. Both studies utilised a pre- and post-test and comparisons between these indicated that they believed their abilities to participate constructively in their professional work contexts significantly improved as a result of their placement experience except in the areas of learning, teamwork and sensitivity. This finding will allow us to continue to refine the processes of work placements in order to ensure the integrity of this method for student learning.

Challenges of elementary science teaching: an Australian perspective

This chapter profiles research that has explored the role of affect in the teaching of science in Australia particularly on primary or elementary science education. Affect is a complex set of characteristics that relate to the interactions between an individual’s knowledge and emotional responses to a stimulus. Thus, there are many dimensions and theoretical frameworks that inform our understanding of how and why people behave in particular ways.

Reimagining school libraries : emerging teacher pedagogic practices

Agile learning spaces have the potential to afford flexible and innovative pedagogic practice. However there is little known about the experiences of teachers and learners in newly designed learning spaces, and whether the potential for reimagined pedagogies is being realised. This paper uses data from a recent study into the experiences of teacher-librarians, teachers, students and leaders of seven Queensland school libraries built with Building the Education Revolution (BER) funding, to explore the question, “how does the physical environment of school libraries influence pedagogic practices?” This paper proposes that teachers explored new pedagogies within the spaces when there was opportunity for flexibility and experimentation and the spaces sufficiently supported their beliefs about student learning. The perspectives of a range of library users were gathered through an innovative research design incorporating student drawings, videoed library tours and reflections, and interviews. The research team collected qualitative data from school libraries throughout 2012. The libraries represented a variety of geographic locations, socioeconomic conditions and both primary and secondary campuses. The use of multiple data sources, and also the perspectives of the multiple researchers who visited the sites and then coded the data, enabled complementary insights and synergies to emerge. Principles of effective teacher learning that can underpin school wide learning about the potential for agile learning spaces to enhance student learning, are identified. The paper concludes that widespread innovative use of the new library spaces was significantly enhanced when the school leadership fostered whole school discussions about the type of learning the spaces might provoke. This research has the potential to inform school designers, teachers and teacher-librarians to make the most of the transformative potential of next generation learning spaces.

Technology : A mobilising force for a radical design pedagogy [Editorial - Special Issue]

This special issue of the Journal of Learning Design, led by Jill Franz and Lindy Osborne, from the School of Design in the Creative Industries Faculty at the Queensland University of Technology, is grounded in Design Education. Its papers are drawn from differing fields of design: digital media, architecture, and environmental design. Each makes use of technologies in differing ways but all share the singular purpose of achieving enhanced learning outcomes from students.

Reframe : QUT's evaluation framework survey business rules

Reframe is changing our approach to the evaluation of courses, units, teaching and student experience at QUT. We are moving away from a single survey tool to a richer, more holistic and customisable approach. This approach will help our academics design and deliver high-quality learning experiences, and review the impact of their teaching practice on student learning. Through it, we will also be able to provide more timely access to specialised support and meet external reporting requirements.

Innovations in dietetic training in foodservice management : can early exposure to practice enhance final year competency development?

Student engagement in the delivery of theoretical course materials is a current challenge in the tertiary sector including for dietetic training. In 2011 with the creation of a new nutritionist position for Queensland Meals on Wheels (QMOW), a service learning approach to support this organisation was used with third year dietetic students undertaking two days of structured activities at various QMOW sites in South East Queensland, aligned with coursework in Foodservice Management (FSM). This cohort of students was then followed in their final year post successful completion of five weeks professional practice in FSM to see if this experience supported readiness for placement and competency development. Evaluation was undertaken of eligible students (n = 50) via paper based survey (response rate 94%) with all participating in targeted focus groups. Findings showed that students acknowledged the QMOW experience (on reflection 14 months later) providing opportunity for participation and/or observation in 5 of 12 FSM areas taught in third year, including food safety, meal production, assembly, delivery and dishwashing. Over half the students identified good exposure to FSM competency areas during the QMOW experience, with 83% satisfied with their competency exposure and subsequent practice during final year placements. A consistent theme emerged from focus groups supporting inclusion of practical opportunities with the theoretical component of the FSM subject to highlight relevance to learning. These findings highlight the importance of such teaching initiatives to met student learning preferences, linking theory with practice and supporting competency development in the final year of training programs.

Good practice report : clinical teaching

Clinical experience, or experience in the ‘real world’ of practice, is a fundamental component of many health professional courses. It often involves students undertaking practical experience in clinical workplace settings, typically referred to as clinical placements, under the supervision of health professionals. Broadly speaking, the role of clinical supervisors, or teachers, is aimed at assisting students to integrate the theoretical and skills based components of the curriculum within the context of patient/client care (Erstzen et al 2009). Clinical experience also provides students with the opportunity to assimilate the attitudes, values and skills which they require to become appropriately skilled professionals in the environments in which they will eventually practise. However, clinical settings are particularly challenging learning environments for students. Unlike classroom learning, students in the clinical setting frequently find themselves involved in unplanned and often complex activities with patients and other health care providers, being supervised by a variety of clinical staff who have very different methods and styles of teaching, and negotiating bureaucratic or hierarchical structures in busy clinical workplaces where they may only be spending a limited amount of time. Kilminster et al (2007) also draw attention to tensions that may exist between the learning needs of students and the provision of quality care or need to prevent harm to the patient (e.g. Elkind et al 2007). All of these factors complicate the realisation of clinical education goals and underscore the need for effective clinical teaching practices that maximise student learning in clinical environments. This report provides a summary of work that has been achieved in relation to ALTC projects and fellowships associated with clinical teaching, and a review of scholarly publications relevant to this field. The report also makes recommendations based on issues identified and/or where further work is indicated. The projects and fellowships reviewed cover a range of discipline areas including Biology, Paramedic Practice, Clinical Exercise Physiology, Occupational Therapy, Speech Pathology, Physiotherapy, Pharmacy, Nursing and Veterinary Science. The main areas of focus cover issues related to curriculum, particularly in relation to industry expectations of ‘work-ready’ graduates and the implications for theoretical and practical, or clinical preparation; development of competency assessment tools that are nationally applicable across discipline-specific courses; and improvement of clinical learning through strategies targeting the clinical learning environment, building the teaching capacity of clinical supervisors and/or enhancing the clinical learning/teaching process.

Promoting resilience and effective workplace functioning in international students in health courses

The purpose of this project was to improve the quality of the learning experiences of international students in nursing, public health and nutrition and dietetics, both at university and in the clinical setting. The university worked in partnership with three major metropolitan health care facilities/services in Queensland to develop a framework and resources designed to promote quality work-integrated learning experiences for international students and clinical supervisory staff. The Resilience in International Student Education (RISE) model consists of student and staff workshops complemented by a purpose-built Cultural Connections for Learning (CCL) website that provides access to a wide variety of information and other learning resources. Quantitative and qualitative evaluations indicate that the approach is highly valued by participants as it promotes useful dialogue, sharing of experiences and greater understanding regarding quality learning experiences for international students in the health workplace. It provides an ideal springboard for promoting collaboration between international students and clinical supervisors in the workplace. The resources developed have the potential to enhance student learning as well as clinical teaching. The challenge will be to achieve continued progress within international student education through the development of sustainable strategies to embed the program within the context of individual curricula.

Teaching and assessing ethics and social responsibility in undergraduate science : a position paper

Institutional graduate capabilities and discipline threshold learning outcomes require science students to demonstrate ethical conduct and social responsibility. However, neither the teaching nor the assessment of these concepts is straightforward. Australian chemistry academics participated in a workshop in 2013 to discuss and develop teaching and assessment in these areas and this paper reports on the outcomes of that workshop. Controversial issues discussed included: How broad is the mandate of the teacher, how should the boundaries between personal values and ethics be drawn, and how can ethics be assessed without moral judgement? In this position paper, I argue for a deep engagement with ethics and social justice, achieved through case studies and assessed against criteria that require discussion and debate. Strategies to effectively assess science students’ understanding of ethics and social responsibility are detailed.

Micropolitical insights into Assistant Regional Directors’ leadership in Queensland Education

The position of Assistant Regional Directors, School Performance (ARD-SP) was established by the Department of Education and Training (DET), the government provider of public education in Queensland, in 2010, to improve student learning across Queensland by providing close supervision of principals. Based on interviews with 18 ARDs-SP and two of their immediate supervisors, this paper explores their views about this relatively new position and their understandings of the role. Following Blase and Anderson (1995), it uses micropolitical leadership theory to analyse comments made by the participants. A key finding was a view of leadership based on a differentiated supervision model whereby ARDs-SP worked with principals to ensure they met the corporate agenda. Participants’ comments favoured a leadership approach that was both adversarial (drawing upon power over and power through) and facilitative (drawing upon power through and power over) and for those principals deemed under-performing, an authoritarian leadership approach was apparent.