Transferring knowledge through peer-reviewed assessment : the creation of a community of practice and the threats to its survival

While it is generally accepted in the learning and teaching literature that assessment is the single biggest influence on how students approach their learning, assessment methods within higher education are generally conservative and inflexible. Constrained by policy and accreditation requirements and the need for the explicit articulation of assessment standards for public accountability purposes, assessment tasks can fail to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design can simultaneously deliver program objectives and active learning through a knowledge transfer process which increases student participation. This social constructivist view highlights that acquiring an understanding of assessment processes, criteria and standards needs active student participation. Within this context, a peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes of this assessment innovation was that student failure rates declined 15%, tutorial participation increased fourfold, tutorial engagement increased six-fold and there was a 100% approval rating for the retention of the assessment task. In contributing to the core conference theme of “seismic” shifts within higher education, in stark contrast to the positive student response, staff-related issues of assessment conservatism and the necessity of meeting increasing research commitments, threatened the assessment task’s survival. These opposing forces to change have the potential to weaken the ability of higher education assessment arrangements to adequately serve either a new generation of students or the sector's community stakeholders.

Transferring knowledge through peer-reviewed assessment : the creation of a community of practice and the threats to its survival

While it is generally accepted in the learning and teaching literature that assessment is the single biggest influence on how students approach their learning, assessment methods within higher education are generally conservative and inflexible. Constrained by policy and accreditation requirements and the need for the explicit articulation of assessment standards for public accountability purposes, assessment tasks can fail to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design can simultaneously deliver program objectives and active learning through a knowledge transfer process which increases student participation. This social constructivist view highlights that acquiring an understanding of assessment processes, criteria and standards needs active student participation. Within this context, a peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes of this assessment innovation was that student failure rates declined 15%, tutorial participation increased fourfold, tutorial engagement increased six-fold and there was a 100% approval rating for the retention of the assessment task. In contributing to the core conference theme of “seismic” shifts within higher education, in stark contrast to the positive student response, staff-related issues of assessment conservatism and the necessity of meeting increasing research commitments, threatened the assessment task’s survival. These opposing forces to change have the potential to weaken the ability of higher education assessment arrangements to adequately serve either a new generation of students or the sector's community stakeholders.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Coming to belong : a narrative analysis of international students’ experiences in an Australian university

This thesis reports on an interview study with 17 international students about their experiences of coming to belong in an Australian university. All used English as an additional language (EAL). The students’ narratives of ‘coming to belong’ are conceptualised through the theory of Bourdieu, in particular the concepts of field, capital, habitus and legitimation; and the methodological premises of critical realism’s layered ontology. The literature review argues that access to and accrual of a range of capital is critical to successful adaptation to a new educational system. This, and processes of legitimation by others in the fields, affects the senses of belonging for students of various linguistic backgrounds, of different countries of origin, studying from primary to higher education in diverse parts of the world. Data were collected by semi-structured interviews and email dialogues at three points during the students’ first year of study in Australia. The analysis shows how the students’ empirical experiences were ordered in terms of narrative structure—orientation, complication, evaluation, resolution and coda—and highlight the emotions generated by the sequence of events. The findings show that EAL international students sought new field positions through legitimation in multiple senses across (sub-)fields. They also show that academic, social and linguistic legitimacy granted by others produced a spectrum of belonging: in the centre, at the margin, and/or to meaningful intercultural encounters. This study makes a contribution to the growing literature around the experience of international students in higher education, and to empirical literature using Bourdieu to understand educational relations.

Implementing academagogy : the first case study

As proposed in McAuliffe, Winter, Chadwick and Hargreaves (2008), academagogy could be used as an “umbrella” term allowing the teacher to select from a range of teaching approaches – pedagogy (teacher as source of all information to student without power or knowledge), andragogy (teacher as source of information for adult student), or heutagogy (student with knowledge seeking information from teacher to fill the gaps in their own knowledge). During Semester 1, 2009, one of the authors of this paper decided to treat his third-year students in a more heutagogical manner by allowing them to experience ownership of their own learning. This article is a case study of that experience which reveals that, although initially more time-consuming, academagogy can result in better student outcomes.

Rank and file : assessing research quality in Australia

In this paper, the author describes recent developments in the assessment of research activity and publication in Australia. Of particular interest to readers will be the move to rank academic journals. Educational Philosophy and Theory (EPAT) received the highest possible ranking, however, the process is far from complete. Some implications for the field, for this journal and particularly, for the educational foundations are discussed.

Widening participation in university learning

This paper reports how one Australian university and the Queensland Department of Education and Training (DET) are working together to increase the number of school students from low socio-economic backgrounds enrolling in undergraduate university degrees. This innovative program involves university lecturers and school teachers working together in the delivery and assessment of four Bachelor of Education units (or subjects) to a cohort of Year eleven and twelve students at a secondary school. Focus group interviews collected data from 26 students, 7 parents, 4 school and 3 university staff to assess the effectiveness of the program. All stakeholders viewed the program as a highly valuable opportunity to experience university learning with 31 high school graduating students being made offers to enter full-time university in the 2010 and 2011. This positive result has particular significance in the current drive in Australia and elsewhere to increase the participation in higher education of young people from under-represented groups.

Open educational resources in China : a governmentality analysis

Using a sociological approach, this study examines China’s reform of open educational resources (OER), which has prompted significant changes to the nation’s higher education sector. Through an analysis of the policy processes that have driven the reform, this study demonstrates that the reform has involved and brought significant changes to its participants as resource administrators, providers, and receivers. By using governmentality as a poststructuralist analytical framework, this study shows the particular ways in which the reform process has been governed and the ways in which the governing practices have changed the conduct of higher education. The study reveals the power relations exercised through the reform and offers a critique of China’s higher education sector.

Preparing culturally and linguistically diverse nursing students for clinical practice in the health care setting

The number of culturally and linguistically diverse (CALD) students seeking enrollment in higher education courses in Western countries where English is the predominant language has grown considerably in the past decade, especially in undergraduate health care courses. When enrolled in nursing courses, students are required to complete clinical placements. Such experiences can create significant challenges for CALD students where language, cultural differences, and interpretation of cultural norms complicate the learning process. To assist CALD nursing students to transition successfully, an extracurricular integrated curriculum program was developed and implemented at a university in Queensland, Australia. The program is a series of interactive workshops based on the principles of caring pedagogy and student-centered learning. The program applies strategies that combine small-group discussions with peers, role-plays, and interactions with final-year nursing student volunteers. Evaluation of the program suggests it has assisted most of the students surveyed to be successful in their clinical studies.

International students’ experiences of informed learning : a pedagogical case study

This case study explores the theory and practice of informed learning (Bruce, 2008) in a culturally diverse higher education context. It presents research findings about learning and teaching in a postgraduate unit of study entitled Personalised Language Development, an elective in the Master of TESOL and TEFL programs at Queensland University of Technology (QUT). This unit aims to enable international students to extend their disciplinary knowledge of English language teaching, their academic and linguistic fluency and awareness of their own information using processes. The paper outlines the case study research approach; describes the design and implementation of the unit; demonstrates how informed learning principles and characteristics underpin the unit design; presents findings about the international students’ experiences of informed learning through their reflections; and finally the paper discusses the implications of the findings for educators, including the potential transferability of informed learning across higher education disciplines.

Snapshots of informed learning : LIS and beyond

Responding to the need for innovative LIS curriculum and pedagogy, grounded in both information and learning theory, this paper introduces the theory and practice of informed learning. After explaining how informed learning originated within the LIS discipline we outline the principles and characteristics of informed learning. Then we present snapshots of three units of study from LIS programs at Queensland University of Technology (QUT), followed by an overview of informed learning developments in a varied range of educational contexts beyond LIS programs. Finally, we reflect upon the relevance of informed learning to LIS education and its wider contribution to learning and teaching in higher education.

Kaleidoscope : shaping a better future through a stakeholder approach to widespread organisational change

The main focus of ‘Kaleidoscope: Reframing evaluation through a stakeholder approach to sustainable, cultural change in Higher Education’ is to develop a set of principles to guide user-led engagement in widespread organisational change and maximise its impact. The word kaleidoscope represents the unique lens through which each institution will need to view their cultural specificity and local context through an extensive process of collaboration and engagement, followed by communication and dissemination. Kaleidoscope has particular relevance when new approaches to learning and teaching evaluation are introduced by tertiary institutions. Building on the Reframe Project, which involved three years of user-led consultation and was designed to meet stakeholders’ needs, QUT successfully introduced a new evaluation framework in 2013 across the university. Reframe was evidence based, involved scholarly reflection and was founded on a strong theoretical framework. The evolution of the evaluation framework included analysis of scholarly literature and environmental scans across the higher education sector (Alderman, et al., 2012), researched development of conceptual theory (Alderman, et al., in press 2013), incorporated the stakeholder voice and framed within project management principles (Alderman & Melanie, 2012). Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sectors. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own projects and maximise the impact. In correlation with a our conference paper, this round table presents the Draft Guidelines and Framework ready for external peer review by evaluation practitioners, as part of Kaleidoscope’s dissemination (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and linked round table discussions (Shapiro, et al., 1983; Jacobs, 2000).

Starting out in STEM : a study of young men and women in first year science, technology, engineering and mathematics courses

In late 2011, first year university students in science, technology, engineering and mathematics (STEM) courses across Australia were invited to participate in the international Interests and Recruitment in Science (IRIS) study. IRIS investigates the influences on young people's decisions to choose university STEM courses and their subsequent experiences of these courses. The study also has a particular focus on the motivations and experiences of young women in courses such as physics, IT and engineering given the low rates of female participation in these fields. Around 3500 students from 30 Australian universities contributed their views on the relative importance of various school and non-school influences on their decisions, as well as insights into their experiences of university STEM courses so far. It is hoped that their contributions will help improve recruitment, retention and gender equity in STEM higher education and careers.

Creating and sharing : teens' information practices in digital communities

Introduction In a connected world youth are participating in digital content creating communities. This paper introduces a description of teens' information practices in digital content creating and sharing communities. Method The research design was a constructivist grounded theory methodology. Seventeen interviews with eleven teens were collected and observation of their digital communities occurred over a two-year period. Analysis The data were analysed iteratively to describe teens' interactions with information through open and then focused coding. Emergent categories were shared with participants to confirm conceptual categories. Focused coding provided connections between conceptual categories resulting in the theory, which was also shared with participants for feedback. Results The paper posits a substantive theory of teens' information practices as they create and share content. It highlights that teens engage in the information actions of accessing, evaluating, and using information. They experienced information in five ways: participation, information, collaboration, process, and artefact. The intersection of enacting information actions and experiences of information resulted in five information practices: learning community, negotiating aesthetic, negotiating control, negotiating capacity, and representing knowledge. Conclusion This study contributes to our understanding of youth information actions, experiences, and practices. Further research into these communities might indicate what information practices are foundational to digital communities.