Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Assessment by interview and portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in Higher Education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a one-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with pre-service early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the four-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.

Sampling perceptions; testing reality : an evidence-based approach to measurably improve information literacy and student research skills

Do commencing students possess the level of information literacy (IL) knowledge and skills they need to succeed at university? What impact does embedding IL within the engineering and design curriculum have? This paper reports on the self-perception versus the reality of IL knowledge and skills, across a large cohort of first year built environment and engineering students. Acting on the findings of this evaluation, the authors (a team of academic librarians) developed an intensive IL skills program which was integrated into a faculty wide unit. Perceptions, knowledge and skills were re-evaluated at the end of the semester to determine if embedded IL education made a difference. Findings reveal that both the perception and reality of IL skills were significantly and measurably improved.

Histology challenge : an interactive program for 1st year students

Our students come from diverse backgrounds. They need flexibility in their learning, and opportunities to review aspects of curriculum they are less confident with. An online teaching and learning programme called the Histology Challenge has been developed to supplement learning experiences offered in several first year anatomy and anatomy & physiology units at QUT. The programme is designed to be integrated with the existing Blackboard sites. The Histology Challenge emphasises the foundation concept that a complex system, such as the human body, can be better understood by examining its simpler components. The tutorial allows students to examine the cells and tissues which ultimately determine structural and functional properties of body organs. The program is interactive, asking students to make decisions and choices, demonstrating an integrated understanding of systemic and cellular aspects. It provides users with the ability to progress at their own pace and to test their understanding and knowledge. For the developer the learning activity can be easily controlled and modified via the use of text files. There are several key elements of this programme, designed to promote specific aspects of student learning. Minimum text is used, instead there is a strong emphasis on instructive artwork and original, high quality histology images presented within a framework that reinforces learning and promotes problem solving skills.

Student perceptions of the impact of online discussion forum participation on learning outcomes

Choosing the “right” type of technology, either synchronous or asynchronous, to facilitate learning outcomes is a new challenge as the pace of emerging technologies increases and diversifies. Teachers are encouraged to design courses that require collaboration in online learning communities to facilitate the development of higher order thinking skills for life long learning. It is therefore important to gather evidence of the kinds of opportunities afforded to students and whether the students themselves endorse collaborative online tools as a legitimate method of assisting in their learning. This paper outlines the way in which one secondary school has used an online discussion forum to support students in the International Baccalaureate (IB) Diploma Program in enhancing research skills and skills for lifelong learning. The paper considers whether online collaborative tools are perceived by students as a positive way to improve learning outcomes.

An economic case for systematic student monitoring and intervention in the first year in higher education

Previous work has established the effectiveness of systematically monitoring first year higher education students and intervening with those identified as at-risk of attrition. This nuts-and-bolts paper establishes an economic case for a systematic monitoring and intervention program, identifying the visible costs and benefits of such a program at a major Australian university. The benefit of such a program is measured in savings to the institution which would otherwise be lost revenue, in the form of retained equivalent full-time student load (EFTSL). The session will present an economic model based on a number of assumptions. These assumptions are explored along with the applicability of the model to other institutions.

Distance Education and the Integration of E-learning in a Graduate Program

Historically, distance education consisted of a combination of face-to-face blocks of time and surface mailed packages. However, advances in information technology literacy and the abundance of personal computers has placed e-learning in increased demand. The authors describe the planning, implementation, and evaluation of the blending of e-learning with face-to-face education in the postgraduate nursing forum. Experiences of this particular student group are also discussed.

A meta-study of SAP financials in the Queensland Government

This thesis consists of three related studies: an ERP Major Issues Study; an Historical Study of the Queensland Government Financial Management System; and a Meta-Study that integrates these and other related studies conducted under the umbrella of the Cooperative ERP Lifecycle Knowledge Management research program. This research provides a comprehensive view of ERP lifecycle issues encountered in SAP R/3 projects across the Queensland Government. This study follows a preliminary ERP issues study (Chang, 2002) conducted in five Queensland Government agencies. The Major Issues Study aims to achieve the following: (1) identify / explicate major issues in relation to the ES life-cycle in the public sector; (2) rank the importance of these issues; and, (3) highlight areas of consensus and dissent among stakeholder groups. To provide a rich context for this study, this thesis includes an historical recount of the Queensland Government Financial Management System (QGFMS). This recount tells of its inception as a centralised system; the selection of SAP and subsequent decentralisation; and, its eventual recentralisation under the Shared Services Initiative and CorpTech. This historical recount gives an insight into the conditions that affected the selection and ongoing management and support of QGFMS. This research forms part of a program entitled Cooperative ERP Lifecycle Knowledge Management. This thesis provides a concluding report for this research program by summarising related studies conducted in the Queensland Government SAP context: Chan (2003); Vayo et al (2002); Ng (2003); Timbrell et al (2001); Timbrell et al (2002); Chang (2002); Putra (1998); and, Niehus et al (1998). A study of Oracle in the United Arab Emirates by Dhaheri (2002) is also included. The thesis then integrates the findings from these studies in an overarching Meta-Study. The Meta-Study discusses key themes across all of these studies, creating an holistic report for the research program. Themes discussed in the meta-study include common issues found across the related studies; knowledge dynamics of the ERP lifecycle; ERP maintenance and support; and, the relationship between the key players in the ERP lifecycle.

Working together for Toby : early childhood student teachers engaging in collaborative problem-based learning around child abuse and neglect

Early childhood teacher education programs have a responsibility, amongst many, to prepare teachers for decision-making on real world issues, such as child abuse and neglect. Their repertoire of skills can be enhanced by engaging with others, either face-to-face or online, in authentic problem-based learning. This paper draws on a study of early childhood student teachers who engaged in an authentic learning experience, which was to consider and to suggest how they would act upon a real-life case of child abuse encountered in an early childhood classroom in Queensland. This was the case of Toby (a pseudonym), who was suspected of being physically abused at home. Students drew upon relevant legislation, policy and resource materials to tackle Toby’s case. The paper provides evidence of students grappling with the complexity of a child abuse case and establishing, through collaboration with others, a proactive course of action. The paper has a dual focus. First, it discusses the pedagogical context in which early childhood student teachers deal with issues of child abuse and neglect in the course of their teacher education program. Second, it examines evidence of students engaging in collaborative problem-solving around issues of child abuse and neglect and teachers’ responsibilities, both legal and professional, to the children and families they work with. Early childhood policy-makers, practitioners and teacher educators are challenged to consider how early childhood teachers are best equipped to deal with child protection and early intervention.

Student autonomy enhancing science learning : Observations from a Primary Connections implementation

This case study involved a detailed analysis of the changes in beliefs and teaching practices of teachers who adopted the Primary Connections program as a professional development initiative. When implementing an inquiry-based learning model, teachers observed that their students learnt more when they intervened less. By scaffolding open-ended nquiries they achieved more diverse, complex and thorough learning outcomes than previously achieved with teacher-led discussions or demonstrations. Initially, student autonomy presented erceived threats to teachers, including possible selection of topics outside the teachers’ science knowledge. In practice, when such issues arose, resolving them became a stimulating part of the earning for both teachers and students. The teachers’ observation of enhanced student learning became a powerful motivator for change in their beliefs and practices. Implications for developers of PD programs are (1) the importance of modeling student-devised inquiries, and (2) recognising the role of successful classroom implementation in facilitating change.

Building organizational capability through a quality assurance program within a business school and encouraging organizational culture change

This study explores organizational capability and culture change through a project developing an assurance of learning program in a business school. In order to compete internationally for high quality faculty, students, strategic partnerships and research collaborations it is essential for Universities to develop and maintain an international focus and a quality produce that predicts excellence in the student experience and graduate outcomes that meet industry needs. Developing, marketing and delivering that quality product requires an organizational strategy to which all members of the organization contribute and adhere. Now, the ability to acquire, share and utilize knowledge has become a critical organizational capability in academia as well as other industries. Traditionally the functional approach to business school structures and disparate nature of the social networks and work contact limit the sharing of knowledge between academics working in different disciplines. In this project a community of practice program was established to include academics in the development of an embedded assurance of learning program affecting more than 5000 undergraduate students and 250 academics from nine different disciplines across four schools. The primary outcome from the fully developed and implemented assurance of learning program was the five year accreditation of the business schools programs by two international accrediting bodies, EQUIS and AACSB. However this study explores a different outcome, namely the change in organizational culture and individual capabilities as academics worked together in teaching and learning teams. This study uses a survey and interviews with academics involved, through a retrospective panel design which contained an experimental group and a control group. Results offer insights into communities of practice as a means of addressing organizational capability and changes in organizational culture. Knowledge management and shared learning can achieve strategic and operational benefits equally within academia as within other industrial enterprises but it comes at a cost. Traditional structures, academics that act like individual contractors and deep divides across research, teaching and service interest served a different master and required fewer resources. Collaborative structures; fewer master categories of discrete knowledge areas; specific strategic goals; greater links between academics and industry; and the means to share learned insights will require a different approach to resourcing both the individual and the team.

Ensuring student success : the role of support services in improving the quality of the student learning experience

This paper is based on the premise that universities have an obligation to provide adequate student support services, such as learning assistance (that is, assistance with academic writing and other study skills) and that in order to be effective such services must be responsive to the wider policy and social implications of student attrition and retention. The paper outlines briefly some of the factors that have influenced the development of learning assistance practices in Australia and America. This is followed by an account of experiences at one Australian metropolitan university where learning assistance service provision shifted from a decentralised, faculty-based model to a centralised model of service delivery. This shift was in response to concerns about lack of quality and consistency in a support model dependent upon faculty resources yet a follow up study identified other problems in the centralised delivery of learning assistance services. These problems, clustered under the heading contextualised versus decontextualised learning assistance, include the relevance of generic learning assistance services to students struggling with specific course related demands; the apparent tensions between challenging students and assisting students at risk of failure; and variations in the level of collaboration between learning advisers and academic staff in supporting students in the learning environment. These problems are analysed using the theoretical modelling derived from the tools made available through cultural historical activity theory and expansive visibilisation (Engeström & Miettinen, 1999).

The development of a new signal processing program at the Queensland University of Technology

The School of Electrical and Electronic Systems Engineering at Queensland University of Technology, Brisbane, Australia (QUT), offers three bachelor degree courses in electrical and computer engineering. In all its courses there is a strong emphasis on signal processing. A newly established Signal Processing Research Centre (SPRC) has played an important role in the development of the signal processing units in these courses. This paper describes the unique design of the undergraduate program in signal processing at QUT, the laboratories developed to support it, and the criteria that influenced the design.

A transition program in first year law : adopting the First Year Curriculum Principles

The First Year Curriculum Principles espouse a student-focused consistent and explicit curriculum, acknowledging diversity and the need to scaffold skills and learning. Commencing law students are no different to other first year students in that they must deal with changes in teaching and learning approaches and expectations. As well as the generic issues of transition, law students must grapple with learning the skills which are necessary for the study of law from the very start of their degree. A transition program at the commencement of a law degree as part of a planned first year curriculum provides an opportunity to introduce students to the study of law, the requisite skills as well as assist with transition to tertiary education.

Applying a social justice framework to ensure good practice in monitoring student learning engagement

A current Australian Learning and Teaching Council (ALTC) funded action research project aims to provide a set of practical resources founded on a social justice framework, to guide good practice for monitoring student learning engagement (MSLE) in higher education. The project involves ten Australasian institutions, eight of which are engaged in various MSLE type projects. A draft framework, consisting of six social justice principles which emerged from the literature has been examined with reference to the eight institutional approaches for MSLE in conjunction with the personnel working on these initiatives during the first action research cycle. The cycle will examine the strategic and operational implications of the framework in each of the participating institutions. Cycle 2 will also build capacity to embed the principles within the institutional MSLE program and will identify and collect examples and resources that exemplify the principles in practice. The final cycle will seek to pilot the framework to guide new MSLE initiatives. In its entirety, the project will deliver significant resources to the sector in the form of a social justice framework for MSLE, guidelines and sector exemplars for MSLE. As well as increasing the awareness amongst staff around the criticality of transition to university (thereby preventing attrition) and the significance of the learning and teaching agenda in enhancing student engagement, the project will build leadership capacity within the participating institutions and provide a knowledge base and institutional capacity for the Australasian HE sector to deploy the deliverables that will safeguard student learning engagement At this early stage of the project the workshop session provides an opportunity to discuss and examine the draft set of social justice principles and to discuss their potential value for the participants’ institutional contexts. Specifically, the workshop will explore critical questions associated with the principles.