REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Comparison of moped, scooter and motorcycle crashes : implications for rider training and education

Scooter and moped sales have increased at a faster rate than motorcycle sales over the last decade in countries such as Australia, Canada and the United States. This may be particularly evident in jurisdictions where moped riding is permitted for car license holders and a motorcycle license is not required, such as in Queensland, Australia. Having historically comprised only a small proportion of powered two-wheelers (PTWs) outside of Europe and Asia, the safety of scooters and mopeds has received relatively little focused research attention. However, the recent trends in sales and crash involvement have stimulated greater interest in these PTW types. The current paper examines differences and similarities between scooters (over 50cc), mopeds (up to 50cc) and motorcycles in crash involvement and crash characteristics through analyses of crash and registration data from Queensland, Australia. The main findings include that moped and scooter riders are similar in terms of usage patterns, but the evidence suggests superior skills, greater experience and safer behaviour among scooter riders than moped riders. The requirement in Queensland for scooter riders but not moped riders to hold a motorcycle license, usually obtained through competency-based training and assessment, may help to explain some of this difference. Findings also suggest that scooter riders are safer than motorcycle riders in some respects, despite both being subject to the same licensing requirements which encourage participation in rider training. Safer attitudes and motivations rather than superior skills and knowledge may therefore underlie the differences between scooter and motorcycle riders. In summary, riders of larger scooters exhibit a combination of skills and behavior suggestive of safer riding than both their moped and motorcycle riding counterparts. It is reasonable to expect that mopeds and scooters will remain popular and that their usage may increase further, along with that of motorcycles. This research therefore has important practical implications regarding pathways to improved PTW safety. Future policy and planning should consider options for encouraging moped riders to acquire better riding skills and greater safety awareness, as apparent among scooter riders, including rider training, education and licensing. As is noted in recent literature and reflected in some contemporary rider training programs, motorcycle safety may be improved by addressing rider attitudes more comprehensively in addition to developing skills and knowledge.

Incorporating translation in qualitative studies : two case studies in education

Cross-language qualitative research in education continues to increase. However, there has been inadequate discussion in the literature concerning the translation process that ensures research trustworthiness applicable for bilingual researchers. Informed by the literature on evaluation criteria for qualitative data translation, this paper compares two different procedures for incorporating translation in education qualitative research to provide a clear depiction of the complexities involved in translating qualitative data and the strengths and weaknesses of each procedure. To maintain the trustworthiness of the qualitative research, it is necessary to minimise translation errors, provide detailed accounts of the translation process, involve more than one translator and remain open to scrutiny from those seeking to access the translation process. Taking into account the resource constraints often faced by novice qualitative researchers, this paper provides some strategies that can be employed in similar contexts.

Purposes of transnational higher education programs : lessons from two Indonesian universities

While intended to facilitate knowledge transfer from international universities and develop Indonesian universities’ capacity, transnational higher education programs (TEPs) in Indonesia have been criticised for operating merely as an international trade in education – implying discrepancy between the rhetoric and reality surrounding the key purposes for establishing TEPs among Indonesian universities. This case study seeks to ascertain what actually drives Indonesian universities to operate the TEPs. Interview and document data from two private Indonesian universities were thematically analysed to identify the key purposes for establishing TEPs in light of the conflicting global–national–local agendas and unequal power relations between TEP partners. The findings suggest the Indonesian universities actively advanced their particular institutional purposes within the Indonesian national agenda and negotiate mutually beneficial outcomes with their global partners. This study informs other universities to devise clear purposes and expectations in managing TEPs to avoid functioning merely as student recruitment pathways for international partners.

A snapshot of 40 years in early childhood education and care through oral histories

The year 2012 marked 40 years since the introduction of the Child Care Act 1972 and the federal government introduced financial support for the provision of child care services in Australia. Significant changes have occurred in social, political and theoretical contexts of early childhood education and care (ECEC) during this time. Bringing these to life, this paper investigates archival data of key changes in ECEC in association with oral histories of staff, parents and children associated with The Gowrie Qld during the years 1972‒2012. With narrative analysis considered alongside historical information, two dominant issues emerge as integral to ECEC in the past, now and the future. These are: 1) what constitutes effective teaching and learning in the educational program and 2) professional expectations in ECEC. Building an historical picture, this paper provides for critical reflection on the past to inform current and future practices.

Literacy education in a changing policy environment : introduction

Literacy has long been at the heart of discussions about improving the quality and equitable distribution of educational outcomes. The last decade, however, has seen a dramatic redirection of policy effort in this regard. The effects of this policy redirection are playing out now; it may be that new policy emphases may have consequences for how educators think about what matters in literacy, how they can, and should, make judgements about what matters, and how they can, and should, act on those judgements. This issue of the Journal focuses on the changing landscape of policy and practice in literacy education. Educators in many countries have encountered increasingly intensive government moves to centralise and standardise school education. In Australia national testing of literacy and numeracy began relatively recently. The results for individual schools have been publically reported since 2009. Following trialling in 2010 and 2011, most states and sectors are now beginning to implement new Australian curriculum in English, Mathematics, Science and History...

A wound management education and training needs analysis of health consumers and the relevant health workforce and stocktake of available education and training activities and resources

The goals of this project were to determine the education and training needs of health consumers and the relevant health workforce and to identify and map the available education and training activities and resources. The methods used to collect the data included online surveys and one on one interviews of relevant patients and their carers. The project manager actively sought to engage with the key wound management leaders and advanced clinicians to gain their support and views on the priority education and training issues. The response to all data collection methods was pleasing with almost five hundred responses to the general wound workforce online survey. The data supported the need for more wound management education and training and identified some particular topics of need, such as utilising wound investigations and understanding wound products, pharmaceuticals and devices. The occupational groups with the highest need appear to be those working in primary health care, such as practice nurses and GPs, and those working in residential aged care facilities. The education and training stocktake identified a wide range of activities currently available, the majority being provided in a face to face format. The next stage of the project will be to form some clear and achievable priority action areas based on the available data. An online directory of wound management education and training activities and resources will be developed and further development will be undertaken on a knowledge and skills framework for the wound management workforce. Additionally, transfer of learning factors in the general practice environment will be assessed and strategies will be developed to improve the pre-entry or undergraduate wound management training within relevant higher education programs.

Dementia education for all

As all hospital staff are highly likely to interact with people living with dementia, education about their needs must be accessible to all staff, not only clinicians. Catherine Travers and David Lie evaluate the results of providing dementia education to non-clinical staff in a large teaching hospital. Dementia training programs offered in the hospital setting can improve staff knowledge and confidence in caring for patients with dementia (Foreman & Gardner 2005; McPhail et al 2009). It’s also been shown that a relatively minor investment in staff education can have noticeable effects on both staff attitudes and hospital practices regarding the care and support of patients with dementia and cognitive impairment (Foreman & Gardner 2005)...

Troubled Times in Australian Teacher Education : 2012-2013

The 2012 OLT National Teaching Fellowship described in this report has mapped and analysed the complex and competing internal and external agencies impacting on the whole-of-curriculum design in contemporary higher education in Australia, particularly on degrees in Education with an emphasis on initial teacher education. The Fellowship was conducted at a time of both heightened public and political scrutiny of teacher education and the imposition of new nationally-consistent accreditation processes. This scrutiny culminated in a call by the previous Federal Government for TEQSA (Tertiary Education Quality Standards Agency) to conduct a comprehensive review of teacher education beginning in 2014 and the incoming Government announcing it will establish a short term ministerial advisory group to report on the “priority issue of improving teacher quality” (Pyne, 2013).

International assessments of science learning : their positive and negative contributions to science education

The establishment and continuity of two international comparative assessments of science learning—the IEA’s TIMSS project and the OECD’s PISA project—have meant that there are now high-status reference points for other national and more local approaches to assessing the efficacy of science teaching and learning. Both projects, albeit with very different senses of what the outcome of science learning should be, have contributed positively and negatively to the current state of assessment of school science. The TIMSS project looks back at the science that is commonly included in the curricula of the participating countries. It is thus not about established school science nor about innovations in it. PISA is highly innovative looking, prospectively forward to see how students can use their science learning in everyday life situations. In this chapter some of these positives and negatives are discussed.

A brief staff dementia education program : implementation and evaluation

Brief dementia education training programs appear to be effective in improving knowledge about dementia and self-confidence in interacting with patients with dementia. It is recommended that brief dementia training sessions be provided on a regular, on-going basis, particularly in view of frequent staff changes in the acute hospital environment.

The use of Facebook in tertiary education : case study of a unit-related Facebook page in a university justice class

Purpose – This study aims to evaluate the usefulness of a university unit Facebook page, which was established to support a first-year university justice unit. The study pays particular regard to the Facebook page's impact on students learning outcomes and communications amongst students and between students and teaching staff. Design/methodology/approach – All students enrolled in the unit were asked to complete an online survey, which sought to determine whether they used the unit Facebook page and if so, the nature and extent of their use. Findings – The study found that the unit Facebook page was useful in achieving most learning objectives for the unit. This included enhancing students' knowledge and understanding of unit content, as well as their ability to critically analyse unit materials. Students also indicated that they found the Facebook page better than the university's central learning management system across a range of areas. It was particularly useful for facilitating unit-related discussions. Research limitations/implications – The survey results reported in this paper are based on a relatively small sample of students (n=67) from a first-year university justice unit. Future studies should seek to garner evidence from broader and larger samples that transcend specific unit populations. However, the findings of this study do indicate further support for the use of Facebook as a supplementary tool in university education. Originality/value – This study focuses on two aspects of social networking technologies that have not been previously researched and thus contributes to the growing literature on the uses and benefits of Facebook in tertiary education.

Democracy and the Project of Liberal Inclusion

Democracy is a multi-dimensional concept, ranging from definitions based exclusively on institutional frameworks (for example, Held, 2005, Przeworski, Alvarez, Cheibub and Limongi, 2000) to complex and integrated measures that include political and civil rights, democratic practices, values and, finally, a diverse set of institutional arrangements in society, including welfare, education, industrial relations and the legal system (Inglehart and Welzel, 2005, Jaggers and Gurr, 1995, O'Donnell, Cullel and Iazetta, 2004). This reflects the range of and distinction between merely formal electoral democracy and genuinely 'effective liberal democracy' (Inglehart and Welzel, 2005: 149), where democracy is firmly embedded not only in its institutions but in the values of its citizenry. Evidence from cross-national research confirms that formal democratic institutions, different dimensions of effective democracy, and democratic values are indeed strongly linked (Inglehart and Welzel, 2005: 154, Jaggers and Gurr, 1995: 446). Democracy is more than just a set of institutions, rules and mechanisms: it is a set of core values engrained in the 'lived experience' of its citizens. Core values of democracies are individual autonomy and egalitarianism, tolerance of diversity, and freedom from oppression for both individuals and institutions. Democracies restrain their governments by the rule of law and grant its citizens equal access to and equal treatment by legal institutions. Among these institutions, criminal justice and the treatment of those who violated rules and regulations represent sensitive seismographs for the quality of effective democracies, and the ways how democracies realise their core values.

Scaffolding techniques : a teacher training for cooperative learning in Thailand primary education

Using cooperative learning in classrooms promotes academic achievement, communication skills, problem-solving, social skills and student motivation. Yet it is reported that cooperative learning as a Western educational concept may be ineffective in Asian cultural contexts. The study aims to investigate the utilisation of scaffolding techniques for cooperative learning in Thailand primary mathematics classes. A teacher training program was designed to foster Thai primary school teachers’ cooperative learning implementation. Two teachers participated in this experimental program for one and a half weeks and then implemented cooperative learning strategies in their mathematics classes for six weeks. The data collected from teacher interviews and classroom observations indicates that the difficulty or failure of implementing cooperative learning in Thailand education may not be directly derived from cultural differences. Instead, it does indicate that Thai culture can be constructively merged with cooperative learning through a teacher training program and practices of scaffolding techniques.