REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Symone Anstis : the tax advocate for higher education students

Many who have taken a tax course in the last few years will be aware of the plight of Ms Symone Anstis. Her story is a simple one. The year is 2006 and Ms Anstis, an undergraduate student is undertaking a teaching degree at the Australian Catholic University. To support herself she works at Katies earning $14,946, and receives Youth Allowance of $3,622. In her tax return for that year Ms Anstis claims $920 for ‘self-education expenses’ comprising travel, supplies, student administration fees, depreciation on her computer, textbooks and stationery. These expenses totalling $1,170 are correctly reduced by the non-deductible first $250, per s 82A of the Income Tax Assessment Act (1997) (Cth) (ITAA97). Ms Anstis claims a deduction for ‘self-education expenses’ on the basis that a condition of receiving Youth Allowance is the enrolment and satisfactory progress in an acceptable course of study. Generally, a deduction is allowed where a loss or outgoing is incurred in gaining or producing assessable income and that loss or outgoing is not of a private or domestic nature. Ms Anstis claims the expenses are incurred to meet the requirements of maintaining Youth Allowance so the nexus is satisfied. On assessment, the Commissioner of Taxation disallows the deduction claimed on the basis that ‘self-education expenses’ are only deductible if they have a relevant connection to the taxpayer’s current income-earning activities or they are likely to lead to an increase in a taxpayer’s income from his or her current income-earning activities in the future.

Information literacy : a theoretical framework for higher education

Information literacy has been a significant issue in the library community for many years. It is now being recognised as an important issue by the higher education community. This theoretical framework draws together important elements of the information literacy agenda specifically for tertiary educators and administrators. The frame-work examines three areas of primary concern: the possible outcomes of information literacy education (through outlining the characteristics of information literate people); the nature of information literacy education; and the potential role of stake-holders (including information services, faculty, staff developers and learning counsellors) in helping staff and students to be information literate. This theoretical framework forms part of the Griffith University Information Literacy Blueprint. The Blueprint was designed between June and August of 1994. The project, a quality initiative of the Division of Information Services, was led by Janice Rickards, University Librarian.

Faculty-librarian partnerships in Australian higher education : critical dimensions

Australian higher education is presently subject to a period of substantial change. The needs of the economy and workforce, together with the broader educational role of the university are leading to focus on lifelong learning as a tool for bringing together the apparently diverging needs of different groups. Within this broader context, the emphasis on lifelong learning and associated graduate capabilities is leading to opportunities for new partnerships between faculty and librarians, partnerships that bring the two groups together in ways that are helping to transform the experience of teaching and learning. This paper explores emerging partnerships in diverse areas, including research and scholarship, curriculum, policy, supervision, and staff development. They are in the early phases of development and result from a broad focus on the learning and information literacy needs of students, as opposed to a narrow focus on using the library and its information resources. Taken together, and viewed from a system-wide perspective, these partnerships reveal a complex dynamic that is deserving of wider attention across the Australian higher education system and internationally.

The practice of quality assuring learning in higher education

There remains a lack of published empirical data on the substantive outcomes of higher learning and the establishment of quality processes for determining them. Studies that do exist are nationally focused with available rankings of institutions reflecting neither the quality of teaching and learning nor the diversity of institutions. This paper describes two studies in which Associate Deans from Australian higher education institutions and focus groups of management and academics identify current issues and practices in the design, development and implementation of processes for assuring the quality of learning and teaching. Results indicate that developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program necessitates knowledge creation and new inclusive processes. Common elements supporting consistently superior outcomes included: inclusivity; embedded graduate attributes; consistent and appropriate assessment; digital collection mechanisms; and systematic analysis of outcomes used in program review. Quality measures for assuring learning are proliferating nationally and changing the processes, systems and culture of higher education as a result.

Conceptual and thematic analysis of policies and guidelines on engineering asset management of different states in Australia

The role of government in developing policies and guidelines for asset management is becoming increasingly important especially in view of ageing infrastructure and increasing financial risks for building infrastructure. This paper reviews policies and guidelines developed by Australian state authorities against industry developed principles. It utilizes the software program Leximancer to; a) produce conceptual visualisations of the key themes and concepts embedded within state-wide policies and guidelines, and b) systematically compare the differing asset management foci between states. The analyses reveal mixed results in terms of policy priorities and guidelines for managing assets at a strategic level across states. This paper outlines a rigorous analytical methodology to inform specific policy changes.

REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Purposes of transnational higher education programs : lessons from two Indonesian universities

While intended to facilitate knowledge transfer from international universities and develop Indonesian universities’ capacity, transnational higher education programs (TEPs) in Indonesia have been criticised for operating merely as an international trade in education – implying discrepancy between the rhetoric and reality surrounding the key purposes for establishing TEPs among Indonesian universities. This case study seeks to ascertain what actually drives Indonesian universities to operate the TEPs. Interview and document data from two private Indonesian universities were thematically analysed to identify the key purposes for establishing TEPs in light of the conflicting global–national–local agendas and unequal power relations between TEP partners. The findings suggest the Indonesian universities actively advanced their particular institutional purposes within the Indonesian national agenda and negotiate mutually beneficial outcomes with their global partners. This study informs other universities to devise clear purposes and expectations in managing TEPs to avoid functioning merely as student recruitment pathways for international partners.

Monitoring and benchmarking government policies and actions to improve the healthiness of food environments : a proposed Government Healthy Food Environment Policy Index

Government action is essential to increase the healthiness of food environments and reduce obesity, diet-related non-communicable diseases (NCDs), and their related inequalities. This paper proposes a monitoring framework to assess government policies and actions for creating healthy food environments. Recommendations from relevant authoritative organizations and expert advisory groups for reducing obesity and NCDs were examined, and pertinent components were incorporated into a comprehensive framework for monitoring government policies and actions. A Government Healthy Food Environment Policy Index (Food-EPI) was developed, which comprises a ‘policy’ component with seven domains on specific aspects of food environments, and an ‘infrastructure support’ component with seven domains to strengthen systems to prevent obesity and NCDs. These were revised through a week-long consultation process with international experts. Examples of good practice statements are proposed within each domain, and these will evolve into benchmarks established by governments at the forefront of creating and implementing food policies for good health. A rating process is proposed to assess a government's level of policy implementation towards good practice. The Food-EPI will be pre-tested and piloted in countries of varying size and income levels. The benchmarking of government policy implementation has the potential to catalyse greater action to reduce obesity and NCDs.

A proposed approach to monitor private-sector policies and practices related to food environments, obesity and non-communicable disease prevention

Private-sector organizations play a critical role in shaping the food environments of individuals and populations. However, there is currently very limited independent monitoring of private-sector actions related to food environments. This paper reviews previous efforts to monitor the private sector in this area, and outlines a proposed approach to monitor private-sector policies and practices related to food environments, and their influence on obesity and non-communicable disease (NCD) prevention. A step-wise approach to data collection is recommended, in which the first (‘minimal’) step is the collation of publicly available food and nutrition-related policies of selected private-sector organizations. The second (‘expanded’) step assesses the nutritional composition of each organization's products, their promotions to children, their labelling practices, and the accessibility, availability and affordability of their products. The third (‘optimal’) step includes data on other commercial activities that may influence food environments, such as political lobbying and corporate philanthropy. The proposed approach will be further developed and piloted in countries of varying size and income levels. There is potential for this approach to enable national and international benchmarking of private-sector policies and practices, and to inform efforts to hold the private sector to account for their role in obesity and NCD prevention.

Educating for digital futures : what the learning strategies of digital content professionals can teach higher education

Beginning in the second half of the 20th century, ICTs transformed many societies from industrial societies in which manufacturing was the central focus, into knowledge societies in which dealing effectively with data and information has become a central element of work (Anderson, 2008). To meet the needs of the knowledge society, universities must reinvent their structures and processes, their curricula and pedagogic practices. In addition to this, of course higher education is itself subject to the sweeping influence of ICTs. But what might effective higher education look like in the 21st century? In designing higher education systems and learning experiences which are responsive to the learning needs of the future and exploit the possibilities offered by ICTs, we can learn much from the existing professional development strategies of people who are already successful in 21st century fields, such as digital media. In this study, I ask: (1) what are the learning challenges faced by digital media professionals in the 21st century? (2) what are the various roles of formal and informal education in their professional learning strategies at present? (3) how do they prefer to acquire needed capabilities? In-depth interviews were undertaken with successful Australian digital media professionals working in micro businesses and SMEs to answer these questions. The strongest thematic grouping that emerged from the interviews related to the need for continual learning and relearning because of the sheer rate of change in the digital media industries. Four dialectical relationships became apparent from the interviewees’ commentaries around the learning imperatives arising out of the immense and continual changes occurring in the digital content industries: (1) currency vs best practice (2) diversification vs specialisation of products and services (3) creative outputs vs commercial outcomes (4) more learning opportunities vs less opportunity to learn. These findings point to the importance of ‘learning how to learn’ as a 21st century capability. The interviewees were ambivalent about university courses as preparation for professional life in their fields. Higher education was described by several interviewees as having relatively little value-add beyond what one described as “really expensive credentialling services.” For all interviewees in this study, informal learning strategies were the preferred methods of acquiring the majority of knowledge and skills, both for ongoing and initial professional development. Informal learning has no ‘curriculum’ per se, and tends to be opportunistic, unstructured, pedagogically agile and far more self-directed than formal learning (Eraut, 2004). In an industry impacted by constant change, informal learning is clearly both essential and ubiquitous. Inspired by the professional development strategies of the digital media professionals in this study, I propose a 21st century model of the university as a broad, open learning ecology, which also includes industry, professionals, users, and university researchers. If created and managed appropriately, the university learning network becomes the conduit and knowledge integrator for the latest research and industry trends, which students and professionals alike can access as needed.

A higher education quality assurance model for small states : the Maldives case study

Increasing globalisation and local expansion of Higher Education presents challenges to manage quality of the education services. This study investigated key stakeholders' perspectives on what constitutes key elements and attributes of an effective Quality Assurance (QA) system in Higher Education. The findings highlighted the need for: i) legislation to support a strong QA regulatory framework, ii) independence of the QA agency, iii) development of minimum quality standards through broad stakeholder involvement, and iv) a cyclical approach. The findings of this study proposed a QA model which has implications for strengthening of HE QA systems of Small State.

Design thinking and management education : benefits for problem framing and problem solving

Design and design thinking are identified as making valuable contributions to business and management. The numbers of higher education programs that teach design thinking to business students and executives are growing, however to date little information about the outcomes of these initiatives has emerged. This paper presents the findings from the incorporation of design thinking and methods in one unit of an MBA program. All 90 participants from three MBA classes wholeheartedly expressed their support for this initiative. An evaluation of this experiment found positive reactions, learning, changes in behaviour and positive results for their companies. The challenges and future directions for the inclusion of design thinking and design methods in management education programs are proposed.

Realigning capital portfolios : international students' educational experiences in higher education

This paper reports on first year experiences of international students who use English as an additional language (EAL) in higher education in Australia. It examines how valued resources can foster a positive educational experience of these students from sociological perspectives. It draws data from an interview study, exploring narrative accounts of 17 EAL international students from nine countries about their educational relations and strategies across their first year of study. Their narratives were analysed through Bourdieu's concepts of field, habitus, capital and legitimation, as well as tools of narrative inquiry. The paper finds that the students took up strategies to realign their capital portfolios with new rules of the game. Their decisions were dependent on their personal trajectories and conditions on offer. This paper suggests that more effort needs to be made to understand international students' differentiated access to valued resources in higher education.

A theory of literacies for considering the role of adult and community education in postcolonial change

In this paper, I use a case study drawn from education in the Grenada revolution and afterwards to discuss lessons that postcolonial societies can learn from comparing two approaches to adult basic and popular education. I argue that some approaches to adult education provide subordinate literacies and catch-up schooling on the cheap, while others contribute to sociopolitical change by helping participants develop powerful literacies that challenge the structures of injustice, inefficiency, and dysfunctionality that are still entrenched in most societies. The paper puts forward the concept of epistemic, humanist and public ‘literacies’ as a tool for considering the role of adult education in national development.