Protocols : Reframe : QUT's evaluation framework

Reframe is changing our approach to the evaluation of courses, units, teaching and student experience at QUT. We are moving away from a single survey tool to a richer, more holistic and customisable approach. These protocols allows academic staff and administrators access to the ways in which the policy is enacted through process.

Reframe at a glance

Reframe is changing our approach to the evaluation of courses, units, teaching and student experience at QUT. This graphic image represents the evaluation framework and its purpose in a single page.

Evaluation of assessment in the context of work-based learning: Qualitative perspectives of new graduates

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focussed on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians’ perceptions of these evaluations. This study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly-graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, with differing assessment experiences was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences whilst a student. Data was thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) Transparency and consistency are critical elements of work-based competency assessment. (ii) Students are willing to take greater responsibility in their assessment process. (iii) Work-based competency assessment prepares students for employment. (iv) The relationship between students and their assessors can impact on the student experience and their assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in designing valid competency-based assessment approaches.

Class participation as a learning and assessment strategy in law : facilitating students’ engagement, skills development and deep learning

Assessment has widely been described as being ‘at the centre of the student experience’. It would be difficult to conceive of the modern teaching university without it. Assessment is accepted as one of the most important tools that an educator can deploy to influence both what and how students learn. Evidence suggests that how students allocate time and effort to tasks and to developing an understanding of the syllabus is affected by the method of assessment utilised and the weighting it is given. This is particularly significant in law schools where law students may be more preoccupied with achieving high grades in all courses than their counterparts from other disciplines. However, well-designed assessment can be seen as more than this. It can be a vehicle for encouraging students to learn and engage more broadly than with the minimums required to complete the assessment activity. In that sense assessment need not merely ‘drive’ learning, but can instead act as a catalyst for further learning beyond what a student had anticipated. In this article we reconsider the potential roles and benefits in legal education of a form of interactive classroom learning we term assessable class participation (‘ACP’), both as part of a pedagogy grounded in assessment and learning theory, and as a platform for developing broader autonomous approaches to learning amongst students. We also consider some of the barriers students can face in ACP and the ways in which teacher approaches to ACP can positively affect the socio-emotional climates in classrooms and thus reduce those barriers. We argue that the way in which a teacher facilitates ACP is critical to the ability to develop positive emotional and learning outcomes for law students, and for teachers themselves.

The "virtuous circle": A case study examining the case for better embedding of Work Integrated Learning approaches into university journalism cirriculums

This paper explores the potential to focus and develop the approach to Work Integrated Learning (WIL)in journalism courses where this method is seen as a core principal of the program. It argues that, in many cases, such approaches are ill-defined and underdeveloped, a fact that weakens the possibility for strong course outcomes. It then examines the particular case of QUT coverage of the 2014 G20 Leader's summit to illustrate how an all-of-course WIL approach to G20 coverage-coupled with a tailored interaction with the library-might provide an enhanced student experience as well as unlock the potential for greater knowledge transfer between university journalism courses and industry partners.

"Social Stuff" and institutional micro-processes: Alcohol use by students in Australian university residential colleges

The literature on alcohol consumption among university and residential college students in Australia and comparable countries shows a high incidence of heavy and/or frequent drinking. In this article, we report the findings from a study on alcohol consumption among undergraduate university students living in residential colleges in Australia. The aim of the study was to examine residents’ alcohol use as part of a broader set of institutional practices in higher education that are constructed as central to the student experience. The data were collected through in-depth semistructured interviews with 29 students from seven residential colleges. We found that inclusion of alcohol in many students’ social and extracurricular activities while residing in college is associated with heavy and/or frequent drinking. We suggest that the use of alcohol among students is shaped by the colleges’ institutional micro-processes, leading to a tension between college managements’ aim to foster alcohol citizenship and students’ liberty to engage in frequent and/or heavy drinking.

Bouncing back : Students learning through real-world experiences

The Bouncing Back research study, which began after the Queensland flooding in January 2011, has organically expanded through a number of architectural student design projects and exhibitions, which have sought to respond to catastrophic flooding events. In September 2011, 10 Queensland University of Technology architecture students travelled to Sydney to help construct a 1:1 true-to-life scale shelter, for the Emergency Shelter Exhibition at Customs House in Circular Quay. During the construction of the shelter, data were collected in situ, through dynamic interviews with the students. Using a grounded theory methodology, data were coded and then thematically analysed, to reveal three influential factors that positively impacted the students’ learning in this informal context. These were the student experience, the process of learning through physical making/fabrication, and development of empathy with the community. Analysis of these three factors demonstrated how this informal situated learning activity promoted vitally important learning in a real-world context, which is difficult to replicate in a physical on-campus environment.

Laboratories transformation

BACKGROUND OR CONTEXT Laboratories provide the physical spaces for engineering students to connect with theory and have a personal hands-on learning experience. Learning space design and development is well established in many universities however laboratories are often not part of that movement. While active, collaborative and group learning pedagogies are all key words in relation to these new spaces the concepts have always been central to laboratory based learning. The opportunity to build on and strengthen good practice in laboratories is immense. In the 2001 review “Universities in Crisis” many references are made to the decline of laboratories. One such comment in the review was made by Professor Ian Chubb (AVCC), who in 2013, as Chief Scientist for Australia, identifies the national concern about STEM education and presents a strategic plan to address the challenges ahead. What has been achieved and changed in engineering teaching and research laboratories in this time? PURPOSE OR GOAL A large number of universities in Australia and New Zealand own laboratory and other infrastructure designed well for the era they were built but now showing signs of their age, unable to meet the needs of today’s students, limiting the effectiveness of learning outcomes and presenting very low utilisation rates. This paper will present a model for new learning space design that improves student experience and engagement, supporting academic aims and significantly raising the space utilisation rate. APPROACH A new approach in laboratory teaching and research including new management has been adopted by the engineering disciplines at QUT. Flexibility is an underpinning principle along with the modularisation of fixed teaching and learning equipment, high utilisation of spaces and dynamic pedagogical approaches. The revitalised laboratories and workshop facilities are used primarily for the engineering disciplines and increasingly for integrated use across many disciplines in the STEM context. The new approach was built upon a base of an integrated faculty structure from 2005 and realised in 2010 as an associated development with the new Science and Engineering Centre (SEC). Evaluation through student feedback surveys for practical activities, utilisation rate statistics and uptake by academic and technical staff indicate a very positive outcome. DISCUSSION Resulting from this implementation has been increased satisfaction by students, creation of social learning and connecting space and an environment that meets the needs and challenges of active, collaborative and group learning pedagogies. Academic staff are supported, technical operations are efficient and laboratories are effectively utilised. RECOMMENDATIONS/IMPLICATIONS/CONCLUSION Future opportunities for continuous improvement are evident in using the student feedback to rectify faults and improve equipment, environment and process. The model is easily articulated and visible to other interested parties to contribute to sector wide development of learning spaces.

Enabling people to ‘see what they can be’… The Community Aspirations Program (CAP-ED)

The Community Aspirations Program in Education (CAP-ED) was delivered by CQUniversity’s Office of Indigenous Engagement to increase Aboriginal and Torres Strait Islander student participation in higher education. CAP-ED was developed through scoping studies of six individual communities within the CQuniversity footprint, including a designated Aboriginal and Torres Strait Islander community and rural and regional communities. The scoping process included developing community profiles and extensive consultation with Traditional Owners, Elders, community members and key stakeholders. This process proved to be an essential component of CAP-ED’s success, resulting in Indigenous participation in the program’s networking lunches, through to the delivery of information and workshop sessions. Moreover, it witnessed engagement with people in communities as partners in the program’s delivery and co-presenters in workshops and other events. The CAP-ED workshops focus on identity, culture, aspirations and assist participants to see that they have the potential to participate in higher education. The other essential components of the program’s success have included enabling people to ‘see what they can be’, offering opportunities for people to ask questions, voice honest concerns, and build confidence. The flexibility of delivery was paramount in accommodating the varying needs of each community and the differences in cultural protocols and community approaches, while the face to face engagement between knowledgeable and skilled staff and community members proved to be vital. Over the life of the project, CAP-ED has developed into a broad based strategy that has successfully matched community needs and university based responses through the process of community engagement.

Enabling Indigenous education success beyond regional borders

Higher education is a powerful tool for reducing social and economic disadvantage. But access to higher education can be difficult, particularly for Indigenous Australians who face multiple levels of social, economic and geographical isolation. While enabling programs can support Indigenous students to gain university entry, the experience at Central Queensland University (CQUniversity) suggests that their past success has been limited. In this paper, the authors describe the enabling program available to Indigenous students at CQUniversity. They suggest that the newly developed, flexible, online version of the program is helping to address geographical and social isolation and improve successful outcomes for Indigenous Australians.

Path+Ways. Towards best practice bridging and Indigenous participation through regional dual-sector universities

Regional and remote Indigenous students are underrepresented in both higher education and vocational education and training. Enabling education courses are important in lifting participation rates and potentially in encouraging mobility between the sectors, yet there is a clear lack of evidence underpinning their development. This report provides an overview of the data collection and analysis activities undertaken via a research project funded by the National Centre for Student Equity in Higher Education. The project purpose was to explore current practices dealing with Indigenous enabling courses, particularly in the context of regional, dual-sector universities. In particular, the project examined how these programs vary by institution (and region) in terms of structure, mode and ethos of offering; and direct and indirect impacts of these initiatives on Indigenous student participation and attainment; with a view to designing a best practice framework and implementation statement. Through its focus on students accessing Indigenous and mainstream enabling education, the project focussed on range of equity groups including those of low socio-economic status (both school leaver and mature-age categories), regional and/or remote students, Indigenous students and students with disability.

Enterprise education: For all, or just some?

Purpose The purpose of this paper is to provocatively enter four imagined worlds of enterprise education with the express aim of contemplating an emerging future. The authors do so not to expressly determine what positioning is most appropriate for enterprise/entrepreneurship education, but rather to consider the issues associated with each of the four imagined worlds. Design/methodology/approach The authors’ approach is built around a combination of cycles of reflective practice and the use of scenario development processes. The authors seek to suspend their collective judgement whilst entering the four imagined worlds, but ultimately do not claim to have hidden their personal biases. Findings It is concluded that enterprise/entrepreneurship education should be shared across the university and not owned by any school or faculty. While the authors find it difficult to dismiss the underlying purpose of each scenario, they sense an opportunity to unite their common focus on the development of a transformative student experience. Practical implications This process has provided unexpected insights into the potential of scenario planning as a tool that could conceivably be employed more often to tackle complex issues, such as the positioning of enterprise/entrepreneurship education in Higher Education. Originality/value This paper, despite its inherent biases, offers the reader an opportunity to gain a sense of the various roles forced upon enterprise/entrepreneurship education by its various key stakeholders. In doing so, the shortcomings of the current situation are highlighted.

Can active learning principles be applied to the bioscience assessments of nursing students? A review of the literature

- Objectives To explore if active learning principles be applied to nursing bioscience assessments and will this influence student perception of confidence in applying theory to practice? - Design and Data Sources A review of the literature utilising searches of various databases including CINAHL, PUBMED, Google Scholar and Mosby's Journal Index. - Methods The literature search identified research from twenty-six original articles, two electronic books, one published book and one conference proceedings paper. - Results Bioscience has been identified as an area that nurses struggle to learn in tertiary institutions and then apply to clinical practice. A number of problems have been identified and explored that may contribute to this poor understanding and retention. University academics need to be knowledgeable of innovative teaching and assessing modalities that focus on enhancing student learning and address the integration issues associated with the theory practice gap. Increased bioscience education is associated with improved patient outcomes therefore by addressing this “bioscience problem” and improving the integration of bioscience in clinical practice there will subsequently be an improvement in health care outcomes. - Conclusion From the literature several themes were identified. First there are many problems with teaching nursing students bioscience education. These include class sizes, motivation, concentration, delivery mode, lecturer perspectives, student's previous knowledge, anxiety, and a lack of confidence. Among these influences the type of assessment employed by the educator has not been explored or identified as a contributor to student learning specifically in nursing bioscience instruction. Second that educating could be achieved more effectively if active learning principles were applied and the needs and expectations of the student were met. Lastly, assessment influences student retention and the student experience and as such assessment should be congruent with the subject content, align with the learning objectives and be used as a stimulus tool for learning.

How do you change the learning landscape?

Analysis of the Changing the Learning Landscape strategic conversations with senior managers, staff and students in 58 institutions was undertaken in order to identify trends and direction of change in relation to technology-enhanced learning (TEL) and the student experience.

Cloud email case study

Assessing how the University of the West of England (UWE) made large savings and improved the student experience through cloud email.