Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Educational and occupational outcomes amongst African men from refugee backgrounds living in urban and regional Southeast Queensland

Over the last ten years, approximately one third of refugee and humanitarian entrants to Australia have been adult men. To date, little research has been done on their health and settlement issues. Many of these men have come from the African continent. This paper reports on the educational and employment outcomes of a group of 173 recently arrived adult African men from refugee backgrounds who have settled in Southeast Queensland. Given the current government policy focus on regional resettlement, the paper compares key outcomes between the adult African men who settled in metropolitan Brisbane with those living in the Toowoomba-Gatton region. The study uses a peer interviewer model and a mixed method approach. Overall, we have found that African men who have settled in regional areas face significantly greater educational and occupational challenges than those who settled in the urban area. They report more negative experiences at educational institutions, are more likely to take jobs that are below their level of skills and qualifications, are more dissatisfied with their jobs, and report greater discrimination and difficulties while trying to secure adequate employment in Australia. A number of policy implications are discussed.

The trials and tribulations of a BYOD science classroom

The increase in the availability and use of portable mobile devices has had a number of impacts on society. In particular, this impact has been seen within Higher Education Institutions where staff and students are using these devices for both simple and complex tasks. Within undergraduate teacher education courses there is an expectation that students will be fully prepared for teaching their respective areas of expertise as well as having the ability to use ICT, and in particular portable mobile devices, to support teaching and learning. This paper reports on a small case study into the use of portable mobile devices in a science unit, where the students (N=16) bring their own devices into the classroom and use them in lectures, tutorials and workshops. The study highlights the changing nature of classroom practice within the university setting and the challenges faced by teaching staff and students when using these devices.

Satisfiers and dissatisfiers for international students of higher education : an exploratory study in Australia

This paper explores the main satisfiers and dissatisfiers for international students in Australia’s higher educational sector. Using a critical incident technique, this study is conducted with international students of higher education in Australia. Four categories of satisfiers and dissatisfiers emerge from the data which are related to individual performance, quality of the educational service, socialisation, and living conditions.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Open educational resources in China : a governmentality analysis

Using a sociological approach, this study examines China’s reform of open educational resources (OER), which has prompted significant changes to the nation’s higher education sector. Through an analysis of the policy processes that have driven the reform, this study demonstrates that the reform has involved and brought significant changes to its participants as resource administrators, providers, and receivers. By using governmentality as a poststructuralist analytical framework, this study shows the particular ways in which the reform process has been governed and the ways in which the governing practices have changed the conduct of higher education. The study reveals the power relations exercised through the reform and offers a critique of China’s higher education sector.

The practice of quality assuring learning in higher education

There remains a lack of published empirical data on the substantive outcomes of higher learning and the establishment of quality processes for determining them. Studies that do exist are nationally focused with available rankings of institutions reflecting neither the quality of teaching and learning nor the diversity of institutions. This paper describes two studies in which Associate Deans from Australian higher education institutions and focus groups of management and academics identify current issues and practices in the design, development and implementation of processes for assuring the quality of learning and teaching. Results indicate that developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program necessitates knowledge creation and new inclusive processes. Common elements supporting consistently superior outcomes included: inclusivity; embedded graduate attributes; consistent and appropriate assessment; digital collection mechanisms; and systematic analysis of outcomes used in program review. Quality measures for assuring learning are proliferating nationally and changing the processes, systems and culture of higher education as a result.

Using a Capability Maturity Model to build on the generational approach to student engagement practices

The generational approach to conceptualising first year student learning behaviour has made a useful contribution to understanding student engagement. It has an explicit focus on student behaviour and we suggest that a capability maturity model interpretation may provide a complementary extension of that understanding as it builds on the generational approach by allowing an assessment of institutional capability to initiate, plan, manage, evaluate and review institutional student engagement practices. The development of a Student Engagement, Success and Retention Maturity Model (SESR-MM) is discussed along with its application in an Australian higher education institution. In this case study, the model identified first, second and third generation approaches and in addition achieved a ‘complementary extension’ of the generational approach, building on it by identifying additional practices not normally considered within the generational concept and indicating the capability of the institution to provide and implement the practices.

The role of motivation and motivational strategies in Saudi students' communicative competence in English

This study explored how motivation and motivational strategies influence the communicative competence of students from Saudi Arabia. Participants included Saudi students enrolled in English courses in Australian educational institutions, and Saudi students living in Saudi Arabia studying in English language institutes in Saudi Arabia. Phase One involved interviews with16 participants. In Phase Two, 279 participants completed a questionnaire. Findings included differences between participants’ measured and self-reported communicative competence, with the Australian group having higher levels of measured and self-reported communicative competence. In addition, motivation teaching strategies were found to affect students’ motivation, but not their communicative competence.

Peer review of teaching practice and resources : exploring new spaces to embrace cultural change

The implementation of systematic peer review as a professional development activity, and as a support for educational design activities is under-utilised in many Australian higher education institutions. This case study reports on the first stages of planning and implementation of an institution-wide project to enhance teaching and learning quality at a remote and regional university, where one of the major strategies for improvement is peer review. Through a systematic process of staff engagement in peer review, within and from outside the organisation, a substantial change in flexible learning is envisaged. A mix of new and different learning spaces are to be used in the project, including blended learning spaces for academic development. This paper describes the research framework that will guide the peer review process and examines the early findings of the design-based research. Leadership, awareness raising and development of a supportive community of inquiry are seen as key components for successful implementation of peer review. In addition, unique contextual elements add to the complexity of designing for transformative change within such a relatively new organization.

Teaching Teachers for the Future (TTF) Project TPACK Survey : summary of the key findings

This paper presents a summary of the key findings of the TTF TPACK Survey developed and administered for the Teaching the Teachers for the Future (TTF) Project implemented in 2011. The TTF Project, funded by an Australian Government ICT Innovation Fund grant, involved all 39 Australian Higher Education Institutions which provide initial teacher education. TTF data collections were undertaken at the end of Semester 1 (T1) and at the end of Semester 2 (T2) in 2011. A total of 12881 participants completed the first survey (T1) and 5809 participants completed the second survey (T2). Groups of like-named items from the T1 survey were subject to a battery of complementary data analysis techniques. The psychometric properties of the four scales: Confidence - teacher items; Usefulness - teacher items; Confidence - student items; Usefulness- student items, were confirmed both at T1 and T2. Among the key findings summarised, at the national level, the scale: Confidence to use ICT as a teacher showed measurable growth across the whole scale from T1 to T2, and the scale: Confidence to facilitate student use of ICT also showed measurable growth across the whole scale from T1 to T2. Additional key TTF TPACK Survey findings are summarised.

LeaD-In : a cultural change model for peer review of teaching in higher education

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or constructive manner, and this paper advances and analyses a conceptual model to highlight conditions and strategies necessary for the implementation of sustainable peer review in higher education institutions. The model highlights leadership, development and implementation, which are critical to the success and formation of a culture of peer review of teaching. The work arises from collaborative research funded by the Office for Learning and Teaching to foster and advance a culture of peer review of teaching across several universities in Australia.

Enabling a positive first year experience in higher education through social media and mobile technologies

The first year experience for students within Higher Education institutions has become increasingly important as these institutions strive to improve student retention rates. With many universities also focusing on transforming teaching and learning in an effort to attract and retain students, there is a growing demand to understand and respond to individual student requirements, such as the need to feel a sense of belonging. The literature identifies a sense of belonging as being paramount to a students satisfaction with the institution and it is within this context that this paper reports on a three year study of how first year pre-service education students use social media and mobile technologies in their personal lives and their formal education. More specifically, the study identifies trends in the use of these technologies and the growing need for students to use digital media sharing tools to connect and engage with their peers. The paper contrasts the differences in use between these groups as it seeks to identify the role these technologies can play in their teaching and learning, as well as in promoting an overall positive first year experience.

Moderation in higher education: Four discourses

Across the globe, higher education institutions are working in environments of increasing accountability with little sign of this trend abating. This heightened focus on accountability has placed greater demands on institutions to provide evidence of quality and the achievement of standards that assure that quality. Moderation is one quality assurance process that plays a central role in the teaching, learning and assessment cycle in higher education institutions. While there is a growing body of research globally on teaching, learning and , to a lesser degree, assessment in higher education, the process of moderation has received even less attention (Watty, Freeman, Howieson, Hancock, O'Connell, et al. 2013). Until recently, moderation processes in Australian universities have been typically located within individual institutions, with universities given the responsibility for developing their own specific policies and practices. However, in 2009 the Australian Government announced that an independent national quality and regulatory body for higher education institutions would be established. With the introduction of the Tertiary Education Quality Standards Authority (TEQSA), more formalised requirements for moderation of assessment are being mandated. In light of these reforms, the purpose of this qualitative study was to identify and investigate current moderation practices operating within one faculty, the Faculty of Education, in a large urban university in eastern Australia. The findings of this study revealed four discourses of moderation: equity, justification, community building and accountability. These discourses provide a starting point for academics to engage in substantive conversations around assessment and to further critique the processes of moderation.

Preparing engineering graduates for the knowledge economy through blended delivery of mathematics

Contemporary higher education institutions are making significant efforts to develop cohesive, meaningful and effective learning experiences for Science, Technology, Engineering and Mathematics (STEM) curricula to prepare graduates for challenges in the modern knowledge economy, thus enhancing their employability (Carnevale et al, 2011). This can inspire innovative redesign of learning experiences embedded in technology-enhanced educational environments and the development of research-informed, pedagogically reliable strategies fostering interactions between various agents of the learning-teaching process. This paper reports on the results of a project aimed at enhancing students’ learning experiences by redesigning a large, first year mathematics unit for Engineering students at a large metropolitan public university. Within the project, the current study investigates the effectiveness of selected, technology-mediated pedagogical approaches used over three semesters. Grounded in user-centred instructional design, the pedagogical approaches explored the opportunities for learning created by designing an environment containing technological, social and educational affordances. A qualitative analysis of mixed-type questionnaires distributed to students indicated important inter-relations between participants’ frames of references of the learning-teaching process and stressed the importance (and difficulty) of creating appropriate functional context. Conclusions drawn from this study may inform instructional design for blended delivery of STEM-focused programs that endeavor to enhance students’ employability by educating work-ready graduates.