Assessment by interview and portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in Higher Education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a one-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with pre-service early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the four-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.

Sampling perceptions; testing reality : an evidence-based approach to measurably improve information literacy and student research skills

Do commencing students possess the level of information literacy (IL) knowledge and skills they need to succeed at university? What impact does embedding IL within the engineering and design curriculum have? This paper reports on the self-perception versus the reality of IL knowledge and skills, across a large cohort of first year built environment and engineering students. Acting on the findings of this evaluation, the authors (a team of academic librarians) developed an intensive IL skills program which was integrated into a faculty wide unit. Perceptions, knowledge and skills were re-evaluated at the end of the semester to determine if embedded IL education made a difference. Findings reveal that both the perception and reality of IL skills were significantly and measurably improved.

Histology challenge : an interactive program for 1st year students

Our students come from diverse backgrounds. They need flexibility in their learning, and opportunities to review aspects of curriculum they are less confident with. An online teaching and learning programme called the Histology Challenge has been developed to supplement learning experiences offered in several first year anatomy and anatomy & physiology units at QUT. The programme is designed to be integrated with the existing Blackboard sites. The Histology Challenge emphasises the foundation concept that a complex system, such as the human body, can be better understood by examining its simpler components. The tutorial allows students to examine the cells and tissues which ultimately determine structural and functional properties of body organs. The program is interactive, asking students to make decisions and choices, demonstrating an integrated understanding of systemic and cellular aspects. It provides users with the ability to progress at their own pace and to test their understanding and knowledge. For the developer the learning activity can be easily controlled and modified via the use of text files. There are several key elements of this programme, designed to promote specific aspects of student learning. Minimum text is used, instead there is a strong emphasis on instructive artwork and original, high quality histology images presented within a framework that reinforces learning and promotes problem solving skills.

Student perceptions of the impact of online discussion forum participation on learning outcomes

Choosing the “right” type of technology, either synchronous or asynchronous, to facilitate learning outcomes is a new challenge as the pace of emerging technologies increases and diversifies. Teachers are encouraged to design courses that require collaboration in online learning communities to facilitate the development of higher order thinking skills for life long learning. It is therefore important to gather evidence of the kinds of opportunities afforded to students and whether the students themselves endorse collaborative online tools as a legitimate method of assisting in their learning. This paper outlines the way in which one secondary school has used an online discussion forum to support students in the International Baccalaureate (IB) Diploma Program in enhancing research skills and skills for lifelong learning. The paper considers whether online collaborative tools are perceived by students as a positive way to improve learning outcomes.

An economic case for systematic student monitoring and intervention in the first year in higher education

Previous work has established the effectiveness of systematically monitoring first year higher education students and intervening with those identified as at-risk of attrition. This nuts-and-bolts paper establishes an economic case for a systematic monitoring and intervention program, identifying the visible costs and benefits of such a program at a major Australian university. The benefit of such a program is measured in savings to the institution which would otherwise be lost revenue, in the form of retained equivalent full-time student load (EFTSL). The session will present an economic model based on a number of assumptions. These assumptions are explored along with the applicability of the model to other institutions.

Distance Education and the Integration of E-learning in a Graduate Program

Historically, distance education consisted of a combination of face-to-face blocks of time and surface mailed packages. However, advances in information technology literacy and the abundance of personal computers has placed e-learning in increased demand. The authors describe the planning, implementation, and evaluation of the blending of e-learning with face-to-face education in the postgraduate nursing forum. Experiences of this particular student group are also discussed.

Working together for Toby : early childhood student teachers engaging in collaborative problem-based learning around child abuse and neglect

Early childhood teacher education programs have a responsibility, amongst many, to prepare teachers for decision-making on real world issues, such as child abuse and neglect. Their repertoire of skills can be enhanced by engaging with others, either face-to-face or online, in authentic problem-based learning. This paper draws on a study of early childhood student teachers who engaged in an authentic learning experience, which was to consider and to suggest how they would act upon a real-life case of child abuse encountered in an early childhood classroom in Queensland. This was the case of Toby (a pseudonym), who was suspected of being physically abused at home. Students drew upon relevant legislation, policy and resource materials to tackle Toby’s case. The paper provides evidence of students grappling with the complexity of a child abuse case and establishing, through collaboration with others, a proactive course of action. The paper has a dual focus. First, it discusses the pedagogical context in which early childhood student teachers deal with issues of child abuse and neglect in the course of their teacher education program. Second, it examines evidence of students engaging in collaborative problem-solving around issues of child abuse and neglect and teachers’ responsibilities, both legal and professional, to the children and families they work with. Early childhood policy-makers, practitioners and teacher educators are challenged to consider how early childhood teachers are best equipped to deal with child protection and early intervention.

Student autonomy enhancing science learning : Observations from a Primary Connections implementation

This case study involved a detailed analysis of the changes in beliefs and teaching practices of teachers who adopted the Primary Connections program as a professional development initiative. When implementing an inquiry-based learning model, teachers observed that their students learnt more when they intervened less. By scaffolding open-ended nquiries they achieved more diverse, complex and thorough learning outcomes than previously achieved with teacher-led discussions or demonstrations. Initially, student autonomy presented erceived threats to teachers, including possible selection of topics outside the teachers’ science knowledge. In practice, when such issues arose, resolving them became a stimulating part of the earning for both teachers and students. The teachers’ observation of enhanced student learning became a powerful motivator for change in their beliefs and practices. Implications for developers of PD programs are (1) the importance of modeling student-devised inquiries, and (2) recognising the role of successful classroom implementation in facilitating change.

Building organizational capability through a quality assurance program within a business school and encouraging organizational culture change

This study explores organizational capability and culture change through a project developing an assurance of learning program in a business school. In order to compete internationally for high quality faculty, students, strategic partnerships and research collaborations it is essential for Universities to develop and maintain an international focus and a quality produce that predicts excellence in the student experience and graduate outcomes that meet industry needs. Developing, marketing and delivering that quality product requires an organizational strategy to which all members of the organization contribute and adhere. Now, the ability to acquire, share and utilize knowledge has become a critical organizational capability in academia as well as other industries. Traditionally the functional approach to business school structures and disparate nature of the social networks and work contact limit the sharing of knowledge between academics working in different disciplines. In this project a community of practice program was established to include academics in the development of an embedded assurance of learning program affecting more than 5000 undergraduate students and 250 academics from nine different disciplines across four schools. The primary outcome from the fully developed and implemented assurance of learning program was the five year accreditation of the business schools programs by two international accrediting bodies, EQUIS and AACSB. However this study explores a different outcome, namely the change in organizational culture and individual capabilities as academics worked together in teaching and learning teams. This study uses a survey and interviews with academics involved, through a retrospective panel design which contained an experimental group and a control group. Results offer insights into communities of practice as a means of addressing organizational capability and changes in organizational culture. Knowledge management and shared learning can achieve strategic and operational benefits equally within academia as within other industrial enterprises but it comes at a cost. Traditional structures, academics that act like individual contractors and deep divides across research, teaching and service interest served a different master and required fewer resources. Collaborative structures; fewer master categories of discrete knowledge areas; specific strategic goals; greater links between academics and industry; and the means to share learned insights will require a different approach to resourcing both the individual and the team.

A case for addressing the literacy demands of student assessment

The development and implementation of the Australian Curriculum together with national testing of students and the publication of school results place new demands on teachers. In this article we address the importance of teachers becoming attuned to the silent assessors in assessment generally and in the National Literacy and Numeracy Program (NAPLAN) more specifically. Using the concept of literacies, we develop a method to conduct a literacy audit of assessment tasks that teachers can use to help both themselves and their students. Providing assistance to students as a consequence of such an audit is imperative to improve the outcomes for students and to address issues of equity.

The development of a new signal processing program at the Queensland University of Technology

The School of Electrical and Electronic Systems Engineering at Queensland University of Technology, Brisbane, Australia (QUT), offers three bachelor degree courses in electrical and computer engineering. In all its courses there is a strong emphasis on signal processing. A newly established Signal Processing Research Centre (SPRC) has played an important role in the development of the signal processing units in these courses. This paper describes the unique design of the undergraduate program in signal processing at QUT, the laboratories developed to support it, and the criteria that influenced the design.

A transition program in first year law : adopting the First Year Curriculum Principles

The First Year Curriculum Principles espouse a student-focused consistent and explicit curriculum, acknowledging diversity and the need to scaffold skills and learning. Commencing law students are no different to other first year students in that they must deal with changes in teaching and learning approaches and expectations. As well as the generic issues of transition, law students must grapple with learning the skills which are necessary for the study of law from the very start of their degree. A transition program at the commencement of a law degree as part of a planned first year curriculum provides an opportunity to introduce students to the study of law, the requisite skills as well as assist with transition to tertiary education.

Applying a social justice framework to ensure good practice in monitoring student learning engagement

A current Australian Learning and Teaching Council (ALTC) funded action research project aims to provide a set of practical resources founded on a social justice framework, to guide good practice for monitoring student learning engagement (MSLE) in higher education. The project involves ten Australasian institutions, eight of which are engaged in various MSLE type projects. A draft framework, consisting of six social justice principles which emerged from the literature has been examined with reference to the eight institutional approaches for MSLE in conjunction with the personnel working on these initiatives during the first action research cycle. The cycle will examine the strategic and operational implications of the framework in each of the participating institutions. Cycle 2 will also build capacity to embed the principles within the institutional MSLE program and will identify and collect examples and resources that exemplify the principles in practice. The final cycle will seek to pilot the framework to guide new MSLE initiatives. In its entirety, the project will deliver significant resources to the sector in the form of a social justice framework for MSLE, guidelines and sector exemplars for MSLE. As well as increasing the awareness amongst staff around the criticality of transition to university (thereby preventing attrition) and the significance of the learning and teaching agenda in enhancing student engagement, the project will build leadership capacity within the participating institutions and provide a knowledge base and institutional capacity for the Australasian HE sector to deploy the deliverables that will safeguard student learning engagement At this early stage of the project the workshop session provides an opportunity to discuss and examine the draft set of social justice principles and to discuss their potential value for the participants’ institutional contexts. Specifically, the workshop will explore critical questions associated with the principles.

High fidelity simulation; challenges encountered in developing and implementing student learning experiences, staff education and researching approaches to learning

High fidelity simulation as a teaching and learning approach is being embraced by many schools of nursing. Our school embarked on integrating high fidelity (HF) simulation into the undergraduate clinical education program in 2011. Low and medium fidelity simulation has been used for many years, but this did not simplify the integration of HF simulation. Alongside considerations of how and where HF simulation would be integrated, issues arose with: student consent and participation for observed activities; data management of video files; staff development, and conceptualising how methods for student learning could be researched. Simulation for undergraduate student nurses commenced as a formative learning activity, undertaken in groups of eight, where four students undertake the ‘doing’ role and four are structured observers, who then take a formal role in the simulation debrief. Challenges for integrating simulation into student learning included conceptualising and developing scenarios to trigger students’ decision making and application of skills, knowledge and attitudes explicit to solving clinical ‘problems’. Developing and planning scenarios for students to ‘try out’ skills and make decisions for problem solving lay beyond choosing pre-existing scenarios inbuilt with the software. The supplied scenarios were not concept based but rather knowledge, skills and technology (of the manikin) focussed. Challenges lay in using the technology for the purpose of building conceptual mastery rather than using technology simply because it was available. As we integrated use of HF simulation into the final year of the program, focus was on building skills, knowledge and attitudes that went beyond technical skill, and provided an opportunity to bridge the gap with theory-based knowledge that students often found difficult to link to clinical reality. We wished to provide opportunities to develop experiential knowledge based on application and clinical reasoning processes in team environments where problems are encountered, and to solve them, the nurse must show leadership and direction. Other challenges included students consenting for simulations to be videotaped and ethical considerations of this. For example if one student in a group of eight did not consent, did this mean they missed the opportunity to undertake simulation, or that others in the group may be disadvantaged by being unable to review their performance. This has implications for freely given consent but also for equity of access to learning opportunities for students who wished to be taped and those who did not. Alongside this issue were the details behind data management, storage and access. Developing staff with varying levels of computer skills to use software and undertake a different approach to being the ‘teacher’ required innovation where we took an experiential approach. Considering explicit learning approaches to be trialled for learning was not a difficult proposition, but considering how to enact this as research with issues of blinding, timetabling of blinded groups, and reducing bias for testing results of different learning approaches along with gaining ethical approval was problematic. This presentation presents examples of these challenges and how we overcame them.