Reframe QUT's evaluation framework : a case study of planning, policy and positioning leading to educational best practice

Every university in Australia has a set of policies that guide the institution in its educational practices, however, the policies are often developed in isolation to each other. Now imagine a space where policies are evidence-based, refined annually, cohesively interrelated, and meet stakeholders’ needs. Is this happenstance or the result of good planning? Culturally, Queensland University of Technology (QUT) is a risk-averse institution that takes pride in its financial solvency and is always keen to know “how are we going?” With a twenty-year history of annual reporting that assures the quality of course performance through multiple lines of evidence, QUT’s Learning and Teaching Unit went one step further and strategically aligned a suite of policies that take into consideration the needs of their stakeholders, collaborate with other areas across the institution and use multiple lines of evidence to inform curriculum decision-making. In QUT’s experience, strategic planning can lead to policy that is designed to meet stakeholders’ needs, not manage them; where decision-making is supported by evidence, not rhetoric; where all feedback is incorporated, not ignored; and where policies are cohesively interrelated, not isolated. While many may call this ‘policy nirvana’, QUT has positioned itself to demonstrate good educational practice through Reframe, its evaluation framework. In this case, best practice was achieved through the application of a theory of change and a design-led logic model that allows for transition to other institutions with different cultural specificity. The evaluation approach follows Seldin’s (2003) notion to offer depth and breadth to the evaluation framework along with Berk’s (2005) concept of multiple lines of evidence. In summary, this paper offers university executives, academics, planning and quality staff an opportunity to understand the critical steps that lead to strategic planning and design of evidence-based educational policy that positions a university for best practice in learning and teaching.

Implementing the self-management threshold learning outcome for law : some intentional design strategies from the current curriculum toolbox

There is a growing awareness of the high levels of psychological distress being experienced by law students and the practising profession in Australia. In this context, a Threshold Learning Outcome (TLO) on self-management has been included in the six TLOs recently articulated as minimum learning outcomes for all Australian graduates of the Bachelor of Laws degree (LLB). The TLOs were developed during 2010 as part of the Australian Learning and Teaching Council’s (ALTC’s) project funded by the Australian Government to articulate ‘Learning and Teaching Academic Standards’. The TLOs are the result of a comprehensive national consultation process led by the ALTC’s Discipline Scholars: Law, Professors Sally Kift and Mark Israel.1 The TLOs have been endorsed by the Council of Australian Law Deans (CALD) and have received broad support from members of the judiciary and practising profession, representative bodies of the legal profession, law students and recent graduates, Legal Services Commissioners and the Law Admissions Consultative Committee. At the time of writing, TLOs for the Juris Doctor (JD) are also being developed, utilising the TLOs articulated for the LLB as their starting point but restating the JD requirements as the higher order outcomes expected of graduates of a ‘Masters Degree (Extended)’, this being the award level designation for the JD now set out in the new Australian Qualifications Framework.2 As Australian law schools begin embedding the learning, teaching and assessment of the TLOs in their curricula, and seek to assure graduates’ achievement of them, guidance on the implementation of the self-management TLO is salient and timely.

Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Robots, the internet and teaching history in the age of the NBN and the Australian curriculum

Have you ever wished you were Doctor Who and could pop yourself and your students into a Tardis and teleport them to an historical event or to meet a historical figure? We all know that unfortunately time travel is not (yet) possible, but maybe student and teacher teleportation just might be – sort of. Over the past few centuries and in lieu of time travel our communities have developed museums as a means of experiencing some of our history...

Blended learning extension in a global collaborative learning environment

The advancement of technology and the internet have created global collaborative learning opportunities and changed learning and teaching in any discipline around the world, including in developing countries. The availability of web-based resources and high-speed internet infrastructure has extended the opportunities to conduct blended learning and new ways of distance learning beyond virtual class room webinars. The aim of this exploratory paper is to review the challenges and opportunities for increasing student engagement in virtual learning. A reflective analysis of international collaborative learning case studies, published articles and practices in virtual learning is used to explore the extension of blended learning organised and participated by institutions from multiple countries. The lessons learnt from flexible learning delivery in professional practice courses in Property Education are used to evaluate potential extensions of blended learning implementation in a global context.

Cross cultural similarities in using mobile technologies to engage and connect with students

The access to mobile technologies is growing at an exponential rate in developed and developing countries, with some developing countries surpassing developed countries in terms of device ownership. It is both the demand for, and high usage of mobile technologies that have driven new and emerging pedagogical practices in higher education. These technologies have also exponentially increased access to information in a knowledge economy. While differences are often drawn between developing and developed countries in terms of the access and use of information and communication technologies (ICT), this paper will report on a study detailing how higher education students use mobile technologies and social media in their studies and in their personal lives. It will contrast the similarities in how students from an Australian and Vietnamese university access and use mobile and social media technologies while also highlighting ways in which these technologies can be embraced by academics to connect and engage with students.

Democratic and participatory citizenship: Youth action for sustainability in Australia

Purpose – The purpose of this paper is to provide a critical analysis of recent examples of action competence among young people engaged in democratic participatory action in sustainability programs in Australia. It explores examples of priorities identified for citizen action, the forms this action takes and the ways that democratic participation can achieve positive outcomes for future sustainability. It suggests multiple ways for developing action competence that provides further opportunities for authentic and engaging citizen action for youth connected to school- and community-based learning, in new and powerful ways. Design/methodology/approach – This conceptual paper examines international literature on the theory of “action competence,” its significance for education for sustainability (EfS) and the ways it can inform education for young people’s democratic participatory citizenship and civic engagement. It analyses examples of the development of action competency among young people in Australia, including the problems and priorities identified for citizen action, the forms this action takes and how it can achieve positive outcomes for sustainability. Following this analysis, the paper suggests multiple ways for developing action competence in EfS in schools and communities in new and powerful ways. Findings – Developing EfS to increase democratic and participatory action among young citizens is now widely regarded as an urgent education priority. There are growing exemplars of school and community organizations’ involvement in developing EfS learning and teaching to increase participatory citizenship. Young people are being empowered to develop a greater sense of agency through involvement in programs that develop action competence with a focus on sustainability in and out of school. New forms of participation include student action teams and peer collaboration among youth who are marshaling social media and direction action to achieve change. Originality/value – It contributes to the literature on multiple ways for developing action competence in EfS.

Undergraduate public health students and perceptions of qualitative research: A trajectory of understanding from airy fairy to a valuable tool

Many undergraduate public health students enter introductory qualitative research units with limited or negative perceptions of qualitative research, potentially compromising learning outcomes. Unit teaching, structure and assessment provide opportunities for students to develop positive perceptions of qualitative research. Through a mixed-methods study of undergraduate public health students enrolled in a qualitative research unit, we establish students’ perceptions of qualitative research at the commencement and conclusion of the unit, and determine the critical teaching and learning events which contributed to positive changes in students’ perceptions. This study demonstrates that the structuring of an introductory qualitative research unit around varied opportunities for experiential learning provides a positive introductory learning experience and enables undergraduate public health students to recognise the real-world uses and value of qualitative research.

Client learning and the performance of collaborative infrastructure projects

Australia is a leading user of collaborative procurement methods, which are used to deliver large and complex infrastructure projects. Project alliances, Early Contractor Involvement (ECI), and partnering are typical examples of collaborative procurement models. In order to increase procurement effectiveness and value for money (VfM), clients have adopted various learning strategies for new contract development. However client learning strategies and behaviours have not been systematically analysed before. Therefore, the current paper undertakes a literature review addressing the research question “How can client learning capabilities be effectively understood?”. From the resource-based and dynamic capability perspectives, this paper proposes that the collaborative learning capability (CLC) of clients drives procurement model evolution. Learning routines underpinning CLC carry out exploratory, transformative and exploitative learning phases associated with collaborative project delivery. This learning improves operating routines, and ultimately performance. The conceptualization of CLC and the three sequential learning phases is used to analyse the evidence in the construction management literature. The main contribution of this study is the presentation of a theoretical foundation for future empirical studies to unveil effective learning strategies, which help clients to improve the performance of collaborative projects in the dynamic infrastructure market.

A comparison of motivation to learn English between English major and non-English major students in a Vietnamese university

Despite the plethora of literature examining higher education students’ motivation to learn a second language, it is not known if students who choose to study English as their major differ from those who are required to study English as the minor component of their wider degree. Drawing on self-determination theory, this paper reports on the findings of a quantitative study designed to investigate the types of motivation demonstrated by English major (n=180) and non-English major students (n=242), and their levels of effort expended in learning English in a Vietnamese university. The findings revealed that both groups demonstrated high levels of motivation to learn English to prepare for their future profession. English major students felt more intrinsically motivated and less obligated to learn English. In addition, for both groups, intrinsically motivated students invested the highest levels of effort in learning English. This paper argues that it is imperative for lecturers to foster students’ intrinsic aspirations to learn English to improve the quality of the teaching and learning of English in Vietnamese higher education.

Effectiveness of on-line resources to enhance student learning and engagement

BACKGROUND For engineering graduates to be work-ready with marketable skills they must not only be well-versed with engineering science and its applications, but also able to adapt to using commercial software that is widely used in engineering practice. Hydrological/hydraulic modelling is one aspect of engineering practice which demands the ability to apply fundamentals into design and construction using software. The user manuals for such software are usually tailored for the experienced engineer but not for undergraduates who typically are novices to concepts of modelling and software tools. As the focus of a course such as Advanced Water Engineering is on the wider aspects of engineering application of hydrological and hydraulic concepts, it is ineffective for the lecturers to direct the students to user manuals as students have neither the time nor the desire to sift through numerous pages in a manual. An alternative and efficient way to demonstrate the use of the software is enabling students to develop a model to simulate real-world scenario using the tools of the software and directing them to make informed decisions based on outcomes. PURPOSE Past experience of the lecturer showed that the resources available for the students left a knowledge gap leading to numerous student queries outside contact hours. The purpose of this study is to assess how effective purpose-built video resources can be in supplementing the traditional learning resources to enhance student learning. APPROACH Short-length animated video clips comprising guided step-by-step instructions were prepared using screen capture software to capture screen activity and later edited to focus on specific features using pop-up annotations; Vocal narration was purposely excluded to avoid disturbances due to noise and allow different learning paces of individual students. The video clips were made available to the students alongside the traditional resources/approaches such as in-class demonstrations, guideline notes, and tips for efficient and error-free procedural descriptions. The number of queries the lecturer received from the student cohort outside the lecture times was recorded. An anonymous survey to assess the usefulness and adequacy of the courseware was conducted. OUTCOMES While a significant decline in the number of student queries was noted, an overwhelming majority of the survey respondents confirmed the usefulness of the purpose-developed courseware. CONCLUSIONS/RECOMMENDATIONS/SUMMARY The survey and lecturer’s experience indicated that animated demonstration video clips illustrating the various steps involved in developing hydrologic and hydraulic models and simulating design scenarios is an effective supplement for traditional learning resources. Among the many advantages of the custom-made video clips as a learning resource are that they (1) highlight the aspects that are important to undergraduate learning but not available in the software manuals as the latter are designed for more mature users/learners; (2) provide short, to-the point communication in a step-by-step manner; (3) allow students flexibility to self-learn at their own pace; (4) enhance student learning; and (5) enable time savings for the lecturer in the long term by avoiding queries of a repetitive nature. It is expected that these newly developed resources will be improved to incorporate students’ suggestions before being offered to future cohorts of students. The concept can also be expanded to other relevant courses where animated demonstrations of key modelling steps are beneficial to student learning.

Investigating the effectiveness of an ecological approach to learning design in a first year mathematics for engineering unit

This paper reports on the results of a project aimed at creating a research-informed, pedagogically reliable, technology-enhanced learning and teaching environment that would foster engagement with learning. A first-year mathematics for engineering unit offered at a large, metropolitan Australian university provides the context for this research. As part of the project, the unit was redesigned using a framework that employed flexible, modular, connected e-learning and teaching experiences. The researchers, interested in an ecological perspective on educational processes, grounded the redesign principles in probabilistic learning design (Kirschner et al., 2004). The effectiveness of the redesigned environment was assessed through the lens of the notion of affordance (Gibson, 1977,1979, Greeno, 1994, Good, 2007). A qualitative analysis of the questionnaire distributed to students at the end of the teaching period provided insight into factors impacting on the successful creation of an environment that encourages complex, multidimensional and multilayered interactions conducive to learning.