A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Skill development and social inclusion via peer assisted learning in first-year higher education : an evaluation of student experiences across two law units

Because professions seek graduates who can 'collaborate, share skills and knowledge, and communicate' (Kruck and Reif, 2001, p 37), it is important that university graduates are not equipped solely with the content knowledge of their discipline, but also with prospective employment skills. Furthermore, when students 'interact more in positive ways with their teachers and peers, they gain more in terms of essential skills and competencies, such as critical thinking, problem~solving [and] effective communication' (NSSE, 2000, p 2)./n this way, peer assisted fellowing has the potential to enhance students' professional development, and provide the social inclusion and engagement necessary for effective learning. This session describes two peer assisted learning models embedded within first year QUT Faculty of Law units. Through a partnership between teaching staff, student mentors and mentees, the models aim to facilitate student socialisation whilst supplementing understanding of substantive law with the development of academic and work·related skills. Mentor and mentee perceptions, and program implications, are considered.

Education for social responsibility: Ethics and imagination for engaging students and teachers in educational reform

In this chapter we make assumptions about the primary role of education for the life of its beneficiaries and for society. Undoubtedly, formal education plays an important role in enhancing the likelihood for participation in future social life, including enjoyment and employment, by the student as well as the development of the well being of society in general. Similarly, education is often seen as a main means for intergenerational transmission of knowledge and culture. However, as Dewey (1916) argues, in liberal societies, education has the capacity of enhancing democratic participation in society that goes beyond passive participation by its members. One can argue that the achievement of the ideals of democracy demands a free and strong education system. In other words, while education can function as an instrument to integrate students into the present society, it also has the potential to become an instrument for its transformation by means of which citizens can develop an understanding of how their society functions and a sense of agency towards its transformation. Arguably, this is what Freire (1985) meant when he talked about the role of education to “read and write” the world. A stream of progressive educators (e.g., Apple (2004), Freire, (1985), Giroux (2001) and McLaren (2002)) taught us that the reading of the world that is capable of leading into writing the world is a critical reading; i.e., a reading that poses “Why” questions and imagines “What else can be” (Carr & Kemmis, 1987).

Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform

Teacher assessment literacy is a phrase that is often used but rarely defined. Yet understanding teacher assessment literacy is important in an international curriculum and assessment reform context that continues to challenge teachers’ assessment practices. In this article situated examples of classroom assessment literacies are analysed using Bernstein’s (Pedagogy, symbolic control and identity: Theory, research and critique, Taylor and Francis, London, 1996; Br J Sociol Educ 20(2):157–173, 1999) theoretical tools of vertical and horizontal discourses, classification and framing. Drawing on a sociocultural view of learning, the authors define teacher assessment literacies as dynamic social practices which are context dependent and which involve teachers in articulating and negotiating classroom and cultural knowledges with one another and with learners, in the initiation, development and practice of assessment to achieve the learning goals of students. This conceptualisation of assessment literacy aims to make explicit some underpinning theoretical constructs of assessment literacy to inform dialogue and decision making for policy and practice to benefit student learning and achievement.

Standardising radiation therapy undergraduate competency levels

QUT Bachelor of Radiation Therapy students progress from first visiting a radiation therapy department to graduation and progression into the NPDP over a span of three years. Although there are clear guidelines as to expected competency level post-NPDP, there is still a variety of perceived levels prior to this. Staff and students feedback both suggest that different centres and within centres different staff have differing opinions of these levels. Indeed, many staff members object to the use of the word “competency” for a pre-NPODP undergraduate, preferring the term “achievement”. While it is acknowledged that students progress at different rates, it is vitally important for equity that staff expectations of students at different academic levels are identical. Provision of guidelines for different stages of progression are essential for equitable assessment and most assessments, including the NRTAT are complemented by statements to enable level to be determined. For the University-specific competency assessments some level of consensus between clinical staff is required, especially where students are placed at a large number of different placement sites. Aims The main aim of this initial study is to gauge staff opinions of levels of student progression in order to judge cross-centres consistency. A secondary objective is to evaluate the degree of correlation between staff seniority and perception of student levels. Informal feedback suggests that staff at or just post NPDP level have a different perception of student competency expectations than more senior staff. If these perceptions change with level it will make agreement of guidelines statements more challenging. Study Methods A standard evaluation questionnaire was provided to RT staff participating in ongoing updates to clinical assessment. As part of curriculum development staff were asked to provide anonymous and optional answers to further questions in order to audit current practice. This involved assigning level of student progression to different statements relating to tasks or competencies. After data collation, scores were assigned to level and totals used to rank statements according to perceived student level. Descriptive statistical analysis was used to identify which statements were easier to assign to student level and which were more ambiguous. Further sub-analysis was performed for each category of staff seniority to judge differences in perception. Strength of correlation between seniority and expectation was calculated to confirm or contradict the informal feedback. Results By collating different staff perceptions of competencies for different student levels commonly agreed statements can be used to define achievement level. This presentation outlines the results of the audit including statements that most staff perceived as relevant to a specific student group and statements that staff found to be harder to attribute. Strength of correlation between staff perception and seniority will be outlined where statistically significant.

Examining the Assessment Opportunities for Cultural Connectedness for Student Learning : A Sociocultural Analysis

The disparity that exists between the highest and lowest achievers together with deficit approaches to teaching, learning and assessment raise serious equity issues related to fairness, validity, culture and access, which were analysed in a recent Australian Research Council funded project. This chapter explores the potential that exists for teachers to work with Indigenous Teacher Assistants (ITAs) to secure cultural connectedness in teaching, learning and assessment of Indigenous students. The study was a design experiment, which was conducted in seven Catholic and Independent primary schools in northern Queensland and involved semi-structured focus group interviews with Year 4 and 6 Indigenous students, principals, teachers and Indigenous Teacher Assistants. Classroom observations and document analyses were also conducted. This corpus of data was analysed using a sociocultural theoretical lens. The use of a sociocultural analysis helped to identify cultural influences, Indigenous students’ funds of knowledge and values. The information from this analysis was made explicit to teachers to demonstrate how they could enhance their pedagogic and assessment practices by embracing and extending the cultural spaces for learning and teaching of Indigenous students. The way in which teachers construct their interactions for greater cultural connectedness and enhanced learning would appear to rely on relationship building with Indigenous staff, Indigenous students’ cultural knowledge, and improved understanding of assessment and related equity issues.

The enactment of formative assessment in English language classrooms in two Chinese universities : teacher and student responses

The College English Curriculum Requirements (CECR), announced by the Chinese Ministry of Education in 2007, recommended the inclusion of formative assessment into the existing summative assessment framework of College English. This policy had the potential to fundamentally change the nature of assessment and its role in the teaching and learning of English in Chinese universities. In order to document and analyse these changes, case studies involving English language teachers and learners were undertaken in two Chinese Universities: one a Key university in the national capital; the other a non-Key university in a western province. The case study design incorporated classroom observations and interviews with English language teachers and their students. The type and focus of feedback and the engagement of students in assessment were analysed in the two contexts. Fundamental to the analysis was the concept of enactment, with the focus of this study on the ways that policy ideas and principles were enacted in the practices of the Chinese university classroom. Understandings of formative assessment as applied in contexts other than the predominantly Western, Anglophone contexts from where many of its principles derive, are offered.

Ensuring student success : establishing a community of practice for culturally and linguistically diverse preservice teachers

This paper discusses the primacy of communities of practice within learning contexts at university and during practicum for culturally and linguistically diverse preservice teachers. The study illustrates that learning occurs when there are adequate opportunities for participation and practice. Data from interviews with 28 culturally and linguistically diverse preservice teachers illustrate that tensions created by social, cultural differences impact upon modes of identification and dimensions of practice (Lave & Wenger, 1991; Wenger, 1998). The study concludes by reiterating the importance of establishing proactive communities of practice to ensure success in learning and practice for this group of preservice teachers.

Good practice for safeguarding student learning engagement in higher education institutions : Final Report 2012

The project 'Good practice for safeguarding student learning engagement in higher education institutions' commenced in late 2010 as a Competitive Grant with funding provided by the Australian Learning and Teaching Council. The project is now overseen by the Office for Learning and Teaching within the Australian Department of Industry, Innovation, Science, Research and Tertiary Education. The project was completed in December 2012. The project was lead by QUT and comprised of the project team: Professor Karen Nelson, (project leader), Ms Tracy Creagh, (project manager) and Adjunct Professor John Clarke. Commencing in late 2010 the project invited a total of eight institutions across Australia and New Zealand (including QUT) who had either: existing programs and activities that monitored student learning engagement (MSLE); were in the early stages of implementing MSLE programs, or; who were piloting MSLE activities. As well, the project involved an advisory group and project evaluator comprising of academic and professional staff across two additional universities.

Changing relationships : Re-activating student and staff engagement in the design studio learning environment

QUT Teaching and Learning Support Services 'Revisiting University Teaching’program for mid-career academics. 'Innovations in Teaching at QUT' presentations. Presentations were part of a 2 day program that provides opportunities for experienced academic staff with responsibilities for teaching to review their current teaching practices and explore innovations in teaching that will assist them to enhance student learning and develop their own scholarship of teaching. The presenter responded to the following: 1.What is the innovation you have incorporated into your teaching? - give a brief overview/ description/ demonstration of the innovation 2.What challenges/issues prompted you to make changes in your approach? Were they discipline specific? Operational? Opportunistic? 3.What factors did you need to consider in implementing these changes? Which factors enabled success or hindered? 4.What has this innovation achieved so far? How have learners responded? How have the broader teaching team and academic staff from other units in your course responded? 5.How could this innovation be used by other academics in their teaching? What do you see as the possibilities for further expansion of this innovation? (NB. This question could be answered as part of a final sharing of group discussion). Presenter: Shannon Satherley

Community Partnerships for Fostering Student Interest and Engagement in STEM

The foundations of Science, Technology, Engineering and Mathematics (STEM) education begins in the early years of schooling when students encounter formal learning experiences primarily in mathematics and science. Politicians, economists and industrialists recognise the importance of STEM in society, and therefore a number of strategies have been implemented to foster interest. Similarly, most students see the importance of science and mathematics in their lives, but school science and mathematics is usually seen as irrelevant, particularly by students in developed countries. This paper reports on the establishment and implementation of partnerships with industry experts from one jurisdiction which have, over a decade, attempted to reconcile the interests of youth and the contemporary world of science. Four case studies are presented and qualitative findings analyzed in terms of program outcomes and student engagement. The key finding is that the formation of relationships and partnerships, in which students have high degree of autonomy and sense of responsibility, is paramount to positive dispositions towards STEM. Those features of successful partnerships are also discussed. The findings raise some hope that innovative schools and partnerships can foster innovation and connect youth with the real world.

Using a maturity model to move student engagement practices beyond the generational approach

This paper proposes that the generational approach to conceptualising first year student learning behaviour, while it has made a very useful contribution to understanding that behaviour, can be expanded upon. The generational approach has an explicit focus on student behaviour and it is suggested that a capability maturity model interpretation may provide a complementary extension of that as it allows an assessment of institutional capability to initiate, plan, manage and evaluate institutional student engagement practices. The development of a Student Engagement, Success and Retention Maturity Model (SESR-MM) is discussed along with Australasian FYE generational data and Australian SESR-MM data.

The place of higher education institutions in assessing student engagement, success and retention : a maturity model to guide practice

The perennial issues of student engagement, success and retention in higher education continue to attract attention as the salience of teaching and learning funding and performance measures has increased. This paper addresses the question of the responsibility or place of higher education institutions (HEIs) for initiating, planning, managing and evaluating their student engagement, success and retention programs and strategies. An evaluation of the current situation indicates the need for a sophisticated approach to assessing the ability of HEIs to proactively design programs and practices that enhance student engagement. An approach—the Student Engagement Success and Retention Maturity Model (SESR-MM)—is proposed and its development, current status, and relationship with and possible use in benchmarking are discussed.