Vertikale Integrationsstrukturen kommunaler Verkehrsunternehmen : eine transaktionskostentheoretische Evaluation

Der Markt für öffentlichen Personennahverkehr (ÖPNV) wird liberalisiert, in die gewachsenen Monopolstrukturen werden Marktmechanismen implementiert. Ziel der neuen ordnungspolitischen Rahmenbedingungen ist die Steigerung der Effizienz des defizitären Verkehrsbereichs, der von kommunalen Verkehrsunternehmen dominiert wird. Diese erbringen als Quasi-Monopolisten traditionell die Verkehrsdurchführung, regelmäßig anfallende Defizite werden von der öffentlichen Hand ausgeglichen. Bedingt durch ihre Leistungsstrukturen sind kommunale Verkehrsunternehmen in einem Wettbewerbsmarkt kaum konkurrenzfähig. Charakteristisch für diesen Unternehmenstyp ist der hohe Grad an vertikal integrierten Wertschöpfungsstufen. Im Gegensatz zu anderen Branchen erbringen kommunale Verkehrsunternehmen die wesentlichen Teile der gesamten ÖPNV-Wertschöpfungskette innerhalb der eigenen Unternehmensgrenzen. An dem hohen vertikalen Integrationsgrad setzt die Untersuchung an. Mit dem von Williamson entwickelten Instrumentarium der Transaktionskostentheorie werden die Leistungsbereiche einer transaktionskostentheoretischen Bewertung unterzogen. Als Alternativen zum institutionellen Arrangement der vertikalen Integration – das als Hierarchie bezeichnet wird – stehen die Arrangements Kooperation und Markt zur Verfügung. Die Bewertung zeigt, welche Leistungsbereiche unter transaktionskostentheoretischen Gesichtspunkten hierarchisch institutionalisiert werden sollten und welche alternativ erbracht werden können. Aus den Ergebnissen werden Strategieempfehlungen abgeleitet, die als Arbeitshypothesen einer anschließenden empirischen Überprüfung unterzogen werden. Die befragten ÖPNV-Experten bewerten somit die Marktfähigkeit der Strategieempfehlungen. Die Untersuchungsergebnisse werden für die Erarbeitung eines alternativen Koordinierungsarrangements für kommunale Verkehrsunternehmen herangezogen. Das Modell basiert auf der Grundlage Strategischer Netzwerke. Kommunale Verkehrsunternehmen nehmen in dem Modell die Rolle des Nukleus ein, der eine Vielzahl von Netzwerkpartnern steuert und für die Erbringung der ÖPNV-Leistungen mit diesen kooperiert.

Evaluation of the agricultural vocational training programmes conducted by the Krishi Vigyan Kendras (Farm Science Centres) in Indian Punjab

Krishin Vigyan Kendras-KVKs (Farm Science Centres) have been established by the Indian Council of Agricultural Research in 569 districts. The trust areas of KVKs are refinement and demonstration of technologies, and training of farmers and extension functionaries. Imparting vocational trainings in agriculture and allied fields for the rural youth is one of its mandates. The study was undertaken to do a formative and summative (outcome and impact) evaluation of the beekeeping and mushroom growing vocational training programmes in the Indian state of Punjab. One-group pre and post evaluation design was employed for conducting a formative and outcome evaluation. The knowledge tests were administered to 35 beekeeping and 25 mushroom cultivation trainees, before and after the training programmes organized in 2004. The trainees significantly gained in knowledge. A separate sample of 640 trainees, trained prior to 2004, was selected for finding the adoption status. Out of 640, a sample of 200 was selected by proportionate sampling technique out of three categories, namely: non-adopters, discontinued-adopters and continued-adopters for evaluating the long-term impact of these training programmes. Ex-post-facto one-shot case study design was applied for this impact analysis. The vocational training programmes have resulted in continued-adoption of beekeeping and mushroom cultivation enterprises by 20% and 51% trained farmers, respectively. Age and trainee occupation had significant influence on the adoption decision of beekeeping vocation, whereas education and family income significantly affected the adoption decision of mushroom cultivation. The continued adopters of beekeeping and mushroom growing had increased their family income by 49% and 24%, respectively. These training programmes are augmenting the dwindling farm income of the farmers in Indian Punjab.

Evaluaci??n de las medidas de atenci??n a la diversidad de la educaci??n primaria en Galicia : impacto escolar. 'Evaluation of the measures of attention to the diversity in the primary education in Galicia : school impact'

Resumen tomado de la publicaci??n. Con el apoyo econ??mico del departamento MIDE de la UNED

Mid-term evaluation of African Technology Policy Studies Network Phase VI Strategic Plan: for the period January 1, 2009 to December 31, 2010

The African Technology Policy Studies Network (ATPS) is a multidisciplinary network of researchers, private sector actors, policymakers and civil society. ATPS has the vision to become the leading international centre of excellence and reference in science, technology and innovation (STI) systems research, training and capacity building, communication and sensitization, knowledge brokerage, policy advocacy and outreach in Africa. It has a Regional Secretariat in Nairobi Kenya, and operates through national chapters in 29 countries (including 27 in Africa and two Chapters in the United Kingdom and USA for Africans in the Diaspora) with an expansion plan to cover the entire continent by 2015. The ATPS Phase VI Strategic Plan aims to improve the understanding and functioning of STI processes and systems to strengthen the learning capacity, social responses, and governance of STI for addressing Africa's development challenges, with a specific focus on the Millennium Development Goals (MDGs). A team of external evaluators carried out a midterm review to assess the effectiveness and efficiency of the implementation of the Strategic Plan for the period January 1, 2009 to December 31, 2010. The evaluation methodology involved multiple quantitative and qualitative methods to assess the qualitative and quantitative inputs (human resources, financial resources, time, etc.) into ATPS activities (both thematic and facilitative) and their tangible and intangible outputs, outcomes and impacts. Methods included a questionnaire survey of ATPS members and stakeholders, key informant interviews, and focus group discussions (FGDs) with members in six countries. Effectiveness of Programmes Under all six strategic goals, very good progress has been made towards planned outputs and outcomes. This is evidenced by key performance indicators (KPIs) generated from desk review, ratings from the survey respondents, and the themes that run through the FGDs. Institutional and Programme Cost Effectiveness Institutional Effectiveness: assessment of institutional effectiveness suggests that adequate management frameworks are in place and are being used effectively and transparently. Also technical and financial accounting mechanisms are being followed in accordance with grant agreements and with global good practice. This is evidenced by KPIs generated from desk review. Programme Cost Effectiveness: assessment of cost-effectiveness of execution of programmes shows that organisational structure is efficient, delivering high quality, relevant research at relatively low cost by international standards. The evidence includes KPIs from desk review: administrative costs to programme cost ratio has fallen steadily, to around 10%; average size of research grants is modest, without compromising quality. There is high level of pro bono input by ATPS members. ATPS Programmes Strategic Evaluation ATPS research and STI related activities are indeed unique and well aligned with STI issues and needs facing Africa and globally. The multi-disciplinary and trans-boundary nature of the research activities are creating a unique group of research scientists. The ATPS approach to research and STI issues is paving the way for the so called Third Generation University (3GU). Understanding this unique positioning, an increasing number of international multilateral agencies are seeking partnership with ATPS. ATPS is seeing an increasing level of funding commitments by Donor Partners. Recommendations for ATPS Continued Growth and Effectiveness On-going reform of ATPS administrative structure to continue The on-going reforms that have taken place within the Board, Regional Secretariat, and at the National Chapter coordination levels are welcomed. Such reform should continue until fully functional corporate governance policy and practices are fully established and implemented across the ATPS governance structures. This will further strengthen ATPS to achieve the vision of being the leading STI policy brokerage organization in Africa. Although training in corporate governance has been carried out for all sectors of ATPS leadership structure in recent time, there is some evidence that these systems have not yet been fully implemented effectively within all the governance structures of the organization, especially at the Board and National chapter levels. Future training should emphasize practical application with exercises relevant to ATPS leadership structure from the Board to the National Chapter levels. Training on Transformational Leadership - Leading a Change Though a subject of intense debate amongst economists and social scientists, it is generally agreed that cultural mindsets and attitudes could enhance and/or hinder organizational progress. ATPS’s vision demands transformational leadership skills amongst its leaders from the Board members to the National Chapter Coordinators. To lead such a change, ATPS leaders must understand and avoid personal and cultural mindsets and value systems that hinder change, while embracing those that enhance it. It requires deliberate assessment of cultural, behavioural patterns that could hinder progress and the willingness to be recast into cultural and personal habits that make for progress. Improvement of relationship amongst the Board, Secretariat, and National Chapters A large number of ATPS members and stakeholders feel they do not have effective communications and/or access to Board, National Chapter Coordinators and Regional Secretariat activities. Effort should be made to improve the implementation of ATPS communication strategy to improve on information flows amongst the ATPS management and the members. The results of the survey and the FGDs suggest that progress has been made during the past two years in this direction, but more could be done to ensure effective flow of pertinent information to members following ATPS communications channels. Strategies for Increased Funding for National Chapters There is a big gap between the fundraising skills of the Regional Secretariat and those of the National Coordinators. In some cases, funds successfully raised by the Secretariat and disbursed to national chapters were not followed up with timely progress and financial reports by some national chapters. Adequate training in relevant skills required for effective interactions with STI key policy players should be conducted regularly for National Chapter coordinators and ATPS members. The ongoing training in grant writing should continue and be made continent-wide if funding permits. Funding of National Chapters should be strategic such that capacity in a specific area of research is built which, with time, will not only lead to a strong research capacity in that area, but also strengthen academic programmes. For example, a strong climate change programme is emerging at University of Nigeria Nsukka (UNN), with strong collaborations with Universities from neighbouring States. Strategies to Increase National Government buy-in and support for STI Translating STI research outcomes into policies requires a great deal of emotional intelligence, skills which are often lacking in the first and second generation universities. In the epoch of the science-based or 2GUs, governments were content with universities carrying out scientific research and providing scientific education. Now they desire to see universities as incubators of new science- or technology-based commercial activities, whether by existing firms or start-ups. Hence, governments demand that universities take an active and leading role in the exploitation of their knowledge and they are willing to make funds available to support such activities. Thus, for universities to gain the attention of national leadership they must become centres of excellence and explicit instruments of economic development in the knowledge-based economy. The universities must do this while working collaboratively with government departments, parastatals, and institutions and dedicated research establishments. ATPS should anticipate these shifting changes and devise programmes to assist both government and universities to relate effectively. New administrative structures in member organizations to sustain and manage the emerging STI multidisciplinary teams Second Generation universities (2GUs) tend to focus on pure science and often do not regard the application of their know-how as their task. In contrast, Third Generation Universities (3GUs) objectively stimulate techno-starters – students or academics – to pursue the exploitation or commercialisation of the knowledge they generate. They view this as being equal in importance to the objectives of scientific research and education. Administratively, research in the 2GU era was mainly monodisciplinary and departments were structured along disciplines. The emerging interdisciplinary scientific teams with focus on specific research areas functionally work against the current mono-disciplinary faculty-based, administrative structure of 2GUs. For interdisciplinary teams, the current faculty system is an obstacle. There is a need for new organisational forms for university management that can create responsibilities for the task of know-how exploitation. ATPS must anticipate this and begin to strategize solutions for their member institutions to transition to 3Gus administrative structure, otherwise ATPS growth will plateau, and progress achieved so far may be stunted.

Tapping into Floor Staff: Using the knowledge of floor staff to conduct formative evaluations of exhibits in a Canadian science centre

Most science centres in Canada employ science-educated floor staff to motivate visitorsto have fun while enhancing the educational reach of the exhibits. Although bright andsensitive to visitors’ needs, floor staff are rarely consulted in the planning,implementation, and modification phases of an exhibit. Instead, many developmentteams rely on costly third-party evaluations or skip the front-end and formativeevaluations all together, leading to costly errors that could have been avoided. This studywill seek to reveal a correlation between floor staff’s perception of visitors’ interactionswith an exhibit and visitors’ actual experiences. If a correlation exists, a recommendationcould be made to encourage planning teams to include floor staff in the formative andsummative evaluations of an exhibit. This is especially relevant to science centres withlimited budgets and for whom a divide exists between floor staff and management.In this study, a formative evaluation of one exhibit was conducted, measuring both floorstaff’s perceptions of the visitor experience and visitors’ own perceptions of the exhibit.Floor staff were then trained on visitor evaluation methods. A week later, floor staff andvisitors were surveyed a second time on a different exhibit to determine whether anincrease in accuracy existed.The training session increased the specificity of the motivation and comprehensionresponses and the enthusiasm of the staff, but not their ability to predict observedbehaviours with respect to ergonomics, learning indicators, holding power, and successrates. The results revealed that although floor staff underestimated visitors’ success ratesat the exhibits, staff accurately predicted visitors’ behaviours with respect to holdingpower, ergonomics, learning indicators, motivation and comprehension, both before andafter the staff training.

Enhancing quality in online learning : scaffolding planning and design through proactive evaluation

A major issue confronting educators is the extent to which they wish to conform to so-called paradigm shifts in teaching and learning. In the contemporary world of tertiary education these shifts embrace both pedagogy (from instructivist to constructivist) and technology (from classroom to online). As teachers and learners are faced with the potential of these new learning environments, the extent to which learning outcomes are achieved remains a high priority and subject to a wide range of evaluation strategies. Conventionally, evaluation has been positioned at the end of the instructional development cycle, to assess first whether or not the creative effort achieved the original product goals and second whether or not the desired learning outcomes were realized. In the context of online teaching and learning environments, however, the level of understanding teachers, learners and developers have of the medium can impact the ultimate effectiveness of the product. This paper articulates an additional dimension to post-development evaluation processes in proposing proactive evaluation, a framework that identifies critical online learning factors and influences that will better inform the planning, design and development of learning resources. This notion of proactive evaluation advocates resource development being undertaken where all planning activities are assessed against the evaluation criteria that would normally be applied during formative assessment. By performing these evaluation checks proactively, online learning resources will, in principle, work first time as all relevant factors and issues will have been considered and resolved. More importantly, for those participants who are new to online environments, proactive evaluation will perform a scaffolding and professional development role by enhancing online teaching or learning competencies.

Analysis of the potential and problems of new institutional economics for third world development

Purpose – The aim of this paper is to provide a critical evaluation of the potential of new institutional economics (NIE) in third world development.

Design/methodology/approach – The paper reviews various theories under NIE from both conceptual and empirical perspectives. It then reviews the various definitions of institutions and show that institutions are essential to overcome problems of information and uncertainty.

Findings – The review finds that weak institutions can undermine development and hence governments in developing countries should strengthen their institutions to provide greater scope for efficient functioning of markets. Where the market does not work owing to high transactions costs, traditional institutions of collective action and group decision making can work and hence need to be recognised.

Research limitations/implications – The major implications of the paper is that in developing countries, a clear understanding of various institutions such as user groups, inter-linked credit markets, rotational irrigation etc. is needed before they are replaced or modified by other institutions. The main limitations of NIE are that there can be capture by elites of various institutional innovations in rural areas, and that it does not explicitly consider income distribution and uncertainty which are glossed over and hence remain areas for future research.

Originality/value – This paper critically reviews the various institutional environments that developing countries face in addressing development issues.

Evaluation of cervial range of motion and isometric nech muscle strngth: reliability and validity

Objective: To examine the test–retest reliability and construct validity of cervical active range of motion and isometric neck muscle strength as measured by the Multi Cervical Rehabilitation Unit (Hanoun Medical Inc., Ontario).
Design: A cross-sectional study.
Setting: Institutional practice.
Subjects: Twenty-one patients with neck pain and 25 healthy volunteers.
Methods: After a trial-run session, active range of motion (AROM) was measured in the subsequent two sessions, with 2–3 days in between. During each session, three measurements were taken for each direction (flexion, extension, lateral flexions and rotations). The measurement of isometric strength was after a 15-minute break following completion of the measurement of AROM. Three measurements were made for each of the six directions (flexion, extension, lateral flexions, protraction and retraction). The software of the Multi Cervical Rehabilitation Unit automatically recorded and calculated the maximum AROM and isometric strength.
Results: There was a good to high level of reliability in the measurement of AROM for both groups of subjects, with intraclass correlation coefficients (ICCs) ranging from 0.81 to 0.96. Results also demonstrated very good to excellent reliability in isometric strength measurement (ICCs ranged from 0.92 to 0.99). Moreover, there was a significant difference in isometric neck muscle strength (p = 0.001) and in AROM (p = 0.034) between the two groups.
Conclusions: The Multi Cervical Rehabilitation Unit was found to be reliable and valid for testing the cervical active range of motion and isometric neck muscle strength for both normal and patient subjects.

Benchmarking publishing activity of U.S. colleges and universities across the leading journals : a grouped evaluation

This paper examines institutional research productivity across two sets of journals – Hult et al. (1997) and Polonsky and Whitelaw (2006), based on institutions' Carnegie Foundation Classification, funding type (private or public) and whether institutions' offer PhD's in marketing. It is identified that while Research Intensive institutions publish more than other types of organizations across journal types, the type of funding and offering PhD's in Marketing are equally if not more important. As such, institutions seeking to compare themselves to other institutions should choose a 'similar' set of institutions on which to base any comparisons.

Anticipating policy and logics of practice : Australian institutional and academic responses to the globalising "quality research" agenda

Research assessment is now an international trend. This article mobilises a critical policy sociology informed by Bourdieu to unpack the differential effects of research policy shifts in Australia on universities, academics and the field of educational research. It argues in anticipating policy moves - from surveying the logics of practice that have emerged elsewhere from research assessment - that institutional, individual and field responses, while specific to the Australian policy context and mix, have assumed a logic of practice counter productive to "quality" research, education as a field, and equity.

Evaluation of a large group method in an educational Institution : the World café versus Large Group facilitation.

This article reports on the use of a large group method, theWorld Café, compared to large group facilitation in an educational institutional setting in Oman. Change is central to many educational institutions as they aspire to ensure quality procedures and processes are implemented and maintained. One of the difficulties of introducing change within this context is the number of stakeholders involved, as well as the inherent hierarchical nature of these settings. Large group methods (LGM) are one such intervention for change that seeks to involve a maximum number of stakeholders and minimise hierarchies, while at the same time encouraging participation and creating engagement. To evaluate LGM within this setting, the study compared two different workshop techniques: one workshop was run using the LGM theWorld Café, while the other was conducted using large group facilitation (LGF). Results indicated that theWorld Café was superior to LGF in terms of increases in participant knowledge and understanding. Participants who took part in the LGM were also significantly more likely to indicate that the technique was beneficial to their learning, compared to those who took part in the LGF. Qualitative data in the form of comments also provide support for LGM. Further research is needed to assess the applicability of the findings in educational settings in other countries. Moreover, more stringent research is required to assess over time, changes in behaviours occurring following LGM, to provide further evidence as to their value in facilitating change in institutional settings.

Assessing the efficacy and standardization potential of five competing venture capital investment evaluation approaches

The research objective behind this article was to perform a critical evaluation and comparison of five representative business plan evaluation aids (BPEAs) to facilitate constructive discussion of the proposition that greater standardization of venture capital decision-making might be both desirable and possible. The five BPEAs were systematically compared using a structured, taxonomic process. The evidence of this investigation suggests a clear superiority of BPEAs that are based on the researched attributes of successful ventures and use actuarial modeling. Discussion centered on the importance of using BPEAs in a quest for greater consistency during venture capital investment decision-making.

Evaluation of the effectiveness of marine protected areas in temperate waters of Australasia

An evaluation of the effectiveness of Marine Protected Areas (MPAs) in temperate waters of Australasia has been conducted for this thesis. The aim was to identify key elements needed in a strategy for establishment and management of MPA’s in temperate waters of Australasia. This aim was achieved by assessing how effective a sample of MPA’s has been in meeting the conservation objectives for their establishment and by identifying factors that have contributed to success or failure of the MPA’s in meeting these objectives. Particular attention was paid to the objectives of ecological sustainability and biodiversity preservation. A MPA for the purposes of this research was defined as an area of coastal or marine environment, with a substantial subtidal component, set aside by law primarily for conservation purposes. The study region encompassed the coastal zones of Victoria, Tasmania and South Australia (Australia) and New Zealand. The questions posed in order to address the aim of this thesis were; a) Have existing MPA’s been effective in achieving conservation objectives? b) What have been the important influences on effectiveness of existing MPA’s? c) What are the key elements required for implementation of effective MPA’s? The thesis is divided into three parts. Part I is a review of the literature on implementation and effectiveness of MPA’s. Part II presents a detailed evaluation of one MPA: Point Lonsdale Marine Reserve (PLMR), Victoria, Australia. Part in is an evaluation of a number of Australasian temperate MPA’s based on information provided in a survey of people involved in management of MPA’s, and from a variety of published and unpublished documents. The MPA’s are described, evidence about ecological effectiveness is presented and factors that have enhanced and limited the ability of these MPA’s to achieve conservation objectives are derived. A substantial amount of scientific evidence was found for increases in abundance, mean size and size range of fish and invertebrate populations within the boundaries of ‘no-take’ MPA’s, Some evidence was found for ‘spillover’ of adults and juveniles into adjacent fishing grounds. Ecological effects detected within ‘no-take’ MPA’s in Australasia matched those described in the literature. The abundance and mean size of a number of previously exploited species have increased, migration into adjacent fishing grounds has been documented, and species richness has increased in at least one MPA. The PLMR was established primarily to protect the scientifically significant intertidal rock platforms. The results of the case study suggest that this objective has been achieved. Opinions about effectiveness were obtained for 28 MPA’s. Of these 19 were considered to be achieving some objectives and 10 were considered to be performing well in terms of overall ecological effectiveness. Positive effects on biodiversity were generally assumed as a result of reduction of damaging anthropogenic effects on habitat. Many questionnaire respondents noted an increase in community awareness about and support for marine conservation as a result of proclamation of MPA’s, Overall, the results support the value of MPA’s for sustainability of fish stocks and preservation of biodiversity, but there is substantial doubt over whether some of the MPA’s are too small to maintain benefits in the long-term. ‘No-take’ MPA’s, particularly those more remote from the impacts of human activities, have been the most effective in achieving objectives. A number of interacting factors important to eventual success of MPA’s were identified. The most important enhancing factors identified for the PLMR were physical attributes that limit the extent of human use and a strong conservation ethic amongst many of the visitors to this marine reserve. Limiting factors were far more numerous. Of most concern is the inadequacy of at-site management. Almost half of visitors to the area were not aware of its marine reserve status, despite the fact many were frequent visitors. The need for better educational and interpretative material on-site is highlighted by the results of the PLMR visitor survey. A total of 56 factors that have enhanced effectiveness and 46 factors that have limited effectiveness of Australasian temperate MPA’s were identified. A number of factors were important in more than one MPA and this was used to derive a set of critical, or key, factors. For example, a conclusion of all three approaches used in this study is that failure to implement day-to-day management through lack of resources was a major constraint on effectiveness. The importance of MPA’s to marine conservation depends, in part, on how well they are managed. The key factors that influence MPA effectiveness were used as the basis for derivation of the main requirements for implementation of MPA’s that will be capable of meeting the objectives for their establishment. The most important needs are: • that ‘no-take’ areas surrounded by buffer zones form the basis for a system of MPA’s; • that a high level of protection is bestowed by legislation and regulations; • that a minimum size be set for the ‘no-take’ core areas; • that the selection of sites for MPA’s takes into account land-based impacts; • that institutional arrangements are developed specifically for MPA’s; • that funding for MPA’s is increased to enable effective management; • that day-to-day management is implemented in all MPA’s, with enforcement and education programs as priority areas; • that a monitoring program for one or more MPA in each 'State' is established to provide evidence of ecological effects of reservation; • that public and stakeholder involvement in development and implementation of MPA’s is encouraged as this will influence the degree of public support and compliance; • that community-based programs to educate the general public, stakeholders, the media and decision-makers about the value of MPA’s are essential; and • that measures to reduce financial impact on affected stakeholders be implemented.

Developing a scholarly approach to the evaluation of assessment practices

Purpose – The purpose of this paper is to examine and reflect on current assessment practice in a large undergraduate accounting programme delivered both in Australia and offshore, from the perspective of academics in their first semester at a “new-to-them” university.

Design/methodology/approach – The changing higher education environment and the reality of assessment in the current context are considered, as they raise a number of important issues around assessment practice. Some of the often cited literature linking teaching, learning and assessment, including student-centred learning and Confucian heritage culture, is also discussed. A reflective approach is used where Säljö's five categories of student learning are used as the basis for informed reflection of the assessment used in the “new” academics' first semester at the university. The use of empirical evidence to test these reflections would be the next step in this scholarly approach to teaching and learning.

Findings – The reflections reveal a disparity between reality and the ideal in relation to assessment practice. Issues regarding timely feedback to students and timing of assessments can result in summative assessment when it has the potential to be formative. This paper has provided an opportunity for “new” academics to engage with the higher education literature early in their careers.

Originality/value – This paper is a resource for academics beginning to engage with the higher education literature around assessment, teaching and learning and can also be used to inform and improve the teaching and learning practices of many academics in higher education.

Linking student evaluations to institutional goals : a change story

For the past 30 years, beginning with the seminal work of Herbert Marsh in Australia and New Zealand, institutions of higher education have developed internal practices and procedures to collect and analyse student evaluations of teaching and learning. However, the question remains: has this development resulted in the achievement of institutional goals that maximise learning across all teaching contexts? As is the case in many other countries, a recent review of Australian national student evaluation data failed to conclude that student evaluations have improved overall teaching. However, these data have made student perceptions of teaching and learning more salient in the minds of tertiary educators. Certainly, teaching staff are aware of the impacts of student evaluations on informed decision-making, such as the continuation or discontinuation of courses, and on their promotion processes. This paper will review student evaluation practices according to criteria used in change theories, such as the transtheoretical change model (TTM). TTM construes organisational change as a process involving progress through a series of five stages: precontemplation, contemplation, preparation, action and maintenance. This paper will focus on organisational and behavioural outcomes that can be linked to the use of student data. It will recommend strategies for better aligning evaluation results to the stages of change.