Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Threshold concepts in property education : a case study

First year Property Economics students enrolled in the Bachelor of Urban Development at QUT are required to undertake a number of compulsory subjects, alongside students undertaking studies in other disciplines. One such common unit is ‘Stewardship of Land’, an interdisciplinary unit that introduces students to the characteristics of land and land tenure with a focus on land use and property rights. It covers a range of issues including: native title, land contamination, heritage values, alternative uses, the property development process, impact of environmental and social factors, and the management of land, both urban and regional. Teaching such a diverse content to a diverse audience has in previous years proved difficult, from the perspectives of relevance, engagement and content overload. In 2011 a project was undertake to redevelop this unit to reflect ‘threshold concepts’, concepts that are “transformative, probably irreversible, integrative, often troublesome and probably bounded” (Meyer & Land, 2003) . This project involved the development of a new set of underlying concepts students should draw from the unit, application of these to the unit curriculum, and a survey of the student response to these changes. This paper reports on the threshold concepts developed for this unit, the changes this made to the unit curriculum, and a preliminary report on survey responses. Recommendations for other educators seeking to incorporate threshold concepts into their curricula are provided.

Australian learning and teaching council projects in the mathematical sciences : a retrospective

Since 2004, the Australian Learning and Teaching Council (ALTC) and its predecessor, the Carrick Institute for Learning and Teaching in Higher Education, have funded numerous teaching and educational research-based projects in the Mathematical Sciences. In light of the Commonwealth Government’s decision to close the ALTC in 2011, it is appropriate to take account of the ALTCs input into the Mathe- matical Sciences in higher education. Here we present an overview of ALTC projects in the Mathematical Sciences, as well as report on the contributions they have made to the Discipline.

Learning and teaching reflection : developing capacities for lifelong learning

Reflection is an essential part of being an effective learner and working as a productive teacher. It enables the learner or teacher to deliberate about the factors that lead to successful learning and teaching for them and/or their students, in a particular place and for a specific purpose, so they can make reasoned and effective choices. This chapter introduces important frameworks that cover a century of thinking around reflection in education, and illustrates how preservice teachers can use these ideas across three phases. First, becoming a reflective learner as a university student to enhance learning and assessment outcomes; second, becoming a reflective teacher to improve classroom teaching and learning outcomes; and third, developing the reflective capacities of primary students so they can enhance their skills for lifelong learning.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Grenada, Education and Revolution, 1979-83

Grenada’s New Jewel Movement, led by Maurice Bishop, was the first indigenous political grouping in the history of the English-speaking Caribbean to overthrow an existing government by armed force. Yet most of the four and a half years of the Revolution (1979-83) were characterized by considerable popular support for the new People’s Revolutionary Government before it came to it’s tragic, unexpected and shocking end in October 1983. Social, economic and political change seems possible in the 1970s and ‘80s. People in newly decolonizing countries were encouraged by the beginnings of the Non-Aligned Movement of Third World nations demanding new international economic order that would win them some economic justice after the ravages of colonialism. People also saw that some radical regimes, such as that led by Michael Manley in Jamaica and the Sandinistas in Nicaragua, were articulating and implementing basic rights that held the promise of countering the social and political oppression that they had endured throughout the centuries of colonial history. A majority of Grenadians committed themselves to fighting by the side of the People’s Revolutionary Government for such new goals. This chapter will analyse how the Grenada Revolution reconceptualised the education, planned new goals, and implemented bold new educational policies. It will discuss the extent to which the government and people were able to reshape education as a tool for national reconstruction and the raising of national consciousness.

The Cuban Revolution and Internationalism: Structuring Education and Health

The Capacity to Share is the first book to document how Cubans share their highly developed educational services with other low-income states, especially those in Africa, Latin America, and the Caribbean. A variety of international and Cuban authors break new ground in presenting this research. They investigate the experiences of people who have studied in Cuba on scholarships from the Cuban government, the implications for their home countries, and the work of Cuban teachers and administrators to support education in other countries. The authors discuss how the Cuban "solidarity" approach prioritizes global educational cooperation for mutual support, rather than imposing conditional aid. The book offers original and unusual insights into issues of culture, education, aid, development, and change as they relate to low-income states.

The legacy of Ian Hunter's work on literature education and the history of reading practices : some preliminary remarks

Ian Hunter's early work on the history of literature education and the emergence of English as school subject issued a bold challenge to traditional accounts that have in the main focused on English either as knowledge of a particular field or as ideology. The alternative proposal put forward by Hunter and supported by detailed historical analysis is that English exists as a series of historically contingent techniques and practices for shaping the self-managing capacities of children. The challenge for the field is to advance this historical work and to examine possible implications for English teaching.

Kaleidoscope : illuminating learning and teaching evaluation for a shared stakeholder lens

Within the Australian higher education sector, institutions are required to evaluate teaching, units and courses to assure the quality of the student learning experience, however with hardly any regulatory parameters guiding institutions, and with disparate practices, there are few opportunities to benchmakr across institutions or the sector. QUT has received interest and requests from national and international universities on accessing Reframe: QUT's Evaluation Framework.

A snapshot of 40 years in early childhood education and care through oral histories

The year 2012 marked 40 years since the introduction of the Child Care Act 1972 and the federal government introduced financial support for the provision of child care services in Australia. Significant changes have occurred in social, political and theoretical contexts of early childhood education and care (ECEC) during this time. Bringing these to life, this paper investigates archival data of key changes in ECEC in association with oral histories of staff, parents and children associated with The Gowrie Qld during the years 1972‒2012. With narrative analysis considered alongside historical information, two dominant issues emerge as integral to ECEC in the past, now and the future. These are: 1) what constitutes effective teaching and learning in the educational program and 2) professional expectations in ECEC. Building an historical picture, this paper provides for critical reflection on the past to inform current and future practices.

Residential real estate education and globalisation in Australian real estate markets and practices

The purpose of this scoping paper is to offer an overview of the literature to determine the development to date in the area of residential real estate agency academic and career education in respect to Foreign Direct Investment (FDI) transactions and implications in Australia. This paper will review studies on the issue of foreign real estate ownership and FDI in Australian real estate markets to develop an understanding of the current state of knowledge on residential real estate agency practice, career education and real estate licensing requirements in Australia. The distinction between the real estate profession education, compared to other professions such as accounting, legal and finance is based on the intensity of the professional career training prior or post formal academic training. Real estate education could be carried out with relatively higher standards in terms of licensing requirement, career and academic education. As FDI in the Australian real estate market is a complex globalisation and economic phenomenon, a simple content of residential real estate training and education may not promote proper management or capacity in dealing with relevant foreign residential property market transaction. The preliminary summarising from the literature of residential real estate agency education, with its current relevant or emerging licensing requirement are focused on its role and effectiveness and impact in residential real estate market. Particular focus will be directed to the FDI relevant residential real estate agency transactions and practices, which have been strongly influenced by the current residential real estate market and agency practices. Taken together, there are many opportunities for future research to extend our understanding and improving the residential real estate agency education and training of Foreign Direct Investment in the Australian residential real estate sector.

Physical activity and health-related quality of life among physiotherapists : a cross sectional survey in an Australian hospital and health service

Background Physiotherapists are a professional group with a high rate of attrition and at high risk of musculoskeletal disorders. The purpose of this investigation was to examine the physical activity levels and health-related quality of life of physiotherapists working in metropolitan clinical settings in an Australian hospital and health service. It was hypothesized that practicing physiotherapists would report excellent health-related quality of life and would already be physically active. Such a finding would add weight to a claim that general physical activity conditioning strategies may not be useful for preventing musculoskeletal disorders among active healthy physiotherapists, but rather, future investigations should focus on the development and evaluation of role specific conditioning strategies. Methods A questionnaire was completed by 44 physiotherapists from three inpatient units and three ambulatory clinics (63.7% response rate). Physical activity levels were reported using the Active Australia Survey. Health-related quality of life was examined using the EQ-5D instrument. Physical activity and EQ-5D data were examined using conventional descriptive statistics; with domain responses for the EQ-5D presented in a frequency histogram. Results The majority of physiotherapists in this sample were younger than 30 years of age (n = 25, 56.8%) consistent with the presence of a high attrition rate. Almost all respondents exceeded minimum recommended physical activity guidelines (n = 40, 90.9%). Overall the respondents engaged in more vigorous physical activity (median = 180 minutes) and walking (median = 135 minutes) than moderate exercise (median = 35 minutes) each week. Thirty-seven (84.1%) participants reported no pain or discomfort impacting their health-related quality of life, with most (n = 35,79.5%) being in full health. Conclusions Physical-conditioning based interventions for the prevention of musculoskeletal disorders among practicing physiotherapists may be better targeted to role or task specific conditioning rather than general physical conditioning among this physically active population. It is plausible that an inherent attrition of physiotherapists may occur among those not as active or healthy as therapists who cope with the physical demands of clinical practice. Extrapolation of findings from this study may be limited due to the sample characteristics. However, this investigation addressed the study objectives and has provided a foundation for larger scale longitudinal investigations in this field.

Mandate for remote sensing education and the remote sensing core curriculum

Consensus was developed by the remote sensing community during the 1980s and early 1990s regarding the need for an organized approach to teaching remote sensing fundamentals for collegiate institutions. Growth of the remote sensing industry might be seriously hampered without concerted efforts to bolster the capacity to teach state-of-the-practice remote sensing theory and practice to the next generation of professionals. A concerted effort of educators, researchers, government, and industry began in 1992 to meet these demands leading to the creation of the Remote Sensing Core Curriculum. The RSCC is currently sustained by cooperative efforts of the ASPRS, ICRSE, NASA, NCGIA, and others in the remote sensing community. Growth of the RSCC into the K-12 community resulted from its Internet teaching foundation that enables comprehensive and response reference links to the whole of the education community.