Preparing for Research Assessment: Co-evolution and Gamesmanship

In this paper we adopt a complex systems perspective to examine the perturbations caused by the introduction of the Research Quality Framework (RQF) at a research-intensive Australian university. This case is instructive as it 1) presents a Federal policy initiative that attempted to fundamentally alter the recognition and reward mechanism within a regulated funding environment, 2) analyses the strategies of an institution and its research groups as they sought to not only comply with the implementation of the RQF but to maximise their outcome,and 3) it reveals the ways that some actors used this perturbation to advance their own interests. In short, this case represents an instrumental study into the dynamics of how information systems, organisations, and individuals co-evolve in practice as they seek to navigate a complex problem scenario.

Peer state assessment of TxDOT maintenance program and practices : workshop and road rally findings

In an effort to evaluate and improve their practices to ensure the future excellence of the Texas highway system, the Texas Department of Transportation (TxDOT) sought a forum in which experts from other state departments of transportation could share their expertise. Thus, the Peer State Review of TxDOT Maintenance Practices project was organized and conducted for TxDOT by the Center for Transportation Research (CTR) at The University of Texas at Austin. The goal of the project was to conduct a workshop at CTR and in the Austin District that would educate the visiting peers on TxDOT’s maintenance practices and invite their feedback. CTR and TxDOT arranged the participation of the following directors of maintenance: Steve Takigawa, CA; Roy Rissky, KS; Eric Pitts, GA; Jim Carney, MO; Jennifer Brandenburg, NC; and David Bierschbach, WA. One of the means used to capture the peer reviewers’ opinions was a carefully designed booklet of 15 questions. The peers provided TxDOT with written responses to these questions, and the oral comments made during the workshop were also captured. This information was then compiled and summarized in the following report. An examination of the peers’ comments suggests that TxDOT should use a more holistic, statewide approach to funding and planning rather than funding and planning for each district separately. Additionally, the peers stressed the importance of allocating funds based on the actual conditions of the roadways instead of on inventory. The visiting directors of maintenance also recommended continuing and proliferating programs that enhance communication, such as peer review workshops.

Frock Paper Scissors [website]

Frock Paper Sissors (http://www.frockpaperscissors.com): curated web based fashion work. Research has focussed on creating a professional and ‘real world’ website (available in the international/public arena) while producing a high quality design and journalistic fashion medium. The hard copy Frock Paper Scissors magazine has been the focus of assessment in a Fashion and Style Journalism class for the last five years, and for the last three years, students from an Advanced Web Design class have been involved in the production of the accompanying web site, http://www.frockpapersissors.com. This project researches the ways in which synergies across design disciplines can be developed through student engagement on authentic design projects. The Frock Paper Scissors website is a curated collaboration of work from the Fashion,Journalism, Creative Industries and Communication Design discipline areas in the Creative Industries Faculty at Queensland University of Technology (QUT). Research focusses on how this authentic assessment task has been integrated into the two design (and communication)classes; discussing the different approaches taken by teaching staff, the challenges faced, and the ways in which student learning outcomes have been improved through interactions between design disciplines. The final curated work is a public/international website which successfully displays student work and engages students from different design (and creative industries) fields on an authentic design project within their studies.

Frock Paper Scissors [annual hard copy fashion magazine editions]

The Frock Paper Scissors magazine (and accompanying web site, www.frockpapersissors.com ) has been the focus of assessment in a Fashion and Style Journalism unit from 2006 to 2011 (current). The research has focused on the ways in which synergies across disciplines can be developed through student engagement on authentic projects (with a public audience). Up to 80 students from the Fashion Design, Journalism, Media Communication, Creative Industries, Business, Creative Writing and Communication Design discipline areas in the Creative Industries Faculty at Queensland University of Technology (QUT) work on the content, production, layout and funding for the Frock Paper Scissors magazine (and web site). Research focusses on how this authentic assessment task has been integrated into the classes; discussing the approaches taken by teaching staff, the challenges faced, and the ways in which student learning outcomes have been improved and their career outcomes enhanced. The final output requires staff to curate a professional hard copy fashion magazine(and website) where 5,000 copies are distributed annually throughout south east Queensland, Sydney, Melbourne, London, New York and Amsterdam.

Assessing population limits : a carrying capacity approach to planning

While purporting to enhance Australia’s sustainability, the federal government’s Population Strategy rejects the assessment of the limiting factors to future population growth, thus avoiding urgent threshold issues such as resource depletion and environmental destruction. A more forward-thinking and whole-system perspective would assess and incorporate critical biophysical limits into governance processes with suitable prioritisation. It would encourage communities to examine their individual and collective responsibilities in the context of these limits in order to most equitably optimise outcomes; and it would employ both a resource-based examination of minimum population requirements, and an impact-based assessment of maximum thresholds. This carrying capacity approach to planning could help guide society towards a more sustainable future.

A Cochrane review on the effects of end-of-life care pathways : do they improve patient outcomes?

Clinical pathways for end-of-life care management are used widely around the world and have been regarded as the gold standard. The aim of this review was to assess the effects of end-of-life care pathways (EOLCP), compared with usual care (no pathway) or with care guided by a different end-of-life care pathway, across all healthcare settings (e.g. hospitals, residential aged care facilities, community). We searched the Cochrane Register of Controlled Trials (CENTRAL), the Pain, Palliative and Supportive Care Review group specialised register, MEDLINE, EMBASE, review articles and reference lists of relevant articles. The search was carried out in September 2009. All randomised controlled trials (RCTs), quasi-randomised trials or high quality controlled before and after studies comparing use versus non-use of an EOLCP in caring for the dying were considered for inclusion. The search identified 920 potentially relevant titles, but no studies met criteria for inclusion in the review. Without further available evidence, recommendations for the use of end-of-life pathways in caring for the dying cannot be made. There are now recent concerns regarding the big scale roll-out of EOLCP despite the lack of evidence, nurses should report any safety concerns or adverse effects associated with such pathways.

An assessment of development funding for new housing post GFC in Queensland, Australia

Purpose: The purpose of this paper is to identify changes in bank lending criteria due to the GFC and to explore the associated impacts on new housing supply in Queensland, Australia. Design/methodology/approach: This research involves a survey of each of Australia’s big four banks, as well as two prominent arrangers of development finance. Data on key lending criteria was collected: Pre GFC, during the GFC, and GFC recovery stage. Findings: The GFC has resulted in a retraction of funds available for residential development. The few institutions lending are filtering out only the best credit risks by way of constrictive loan covenants including: low loan to value ratios, high cash equity requirements, regional “no go” zones, and demonstrated borrower track record. The ability of developers to proceed with new housing developments is being constrained by their inability to obtain sufficient finance. Research limitations/implications: This research uses survey data, together with an understanding of the project finance process to extrapolate impacts on the residential development industry across Queensland. No regional or sub-market analysis is included. Future research will include subsequent surveys to track any loosening of credit policies over time and sub-market sector analysis. Practical implications: The inability to obtain project finance is identified as a key constraint to new housing supply. This research will inform policy makers and provide important quantitative evidence of the importance of availability of development finance in the housing supply chain. Social implications: Queensland is facing a supply shortfall, which if not corrected, may lead to upward pressure on house prices and falling housing affordability. Originality/value: There is very little academic research on development funding. This research is unique in linking bank lending criteria to new housing supply and demonstrating the impact on the development industry.

Development and evaluation of the Clinician Suicide Risk Assessment Checklist

This paper describes the development and evaluation of a new instrument - the Clinician Suicide Risk Assessment Checklist (CSRAC). The instrument assesses the clinician's competency in three areas: clinical interviewing, assessment of specific suicide risk factors, and formulating a management plan. A draft checklist was constructed by integrating information from 1) literature review 2) expert clinician focus group and 3) consultation with experts. It was utilised in a simulated clinical scenario with clinician trainees and a trained actor in order to test for inter-rater agreement. Agreement was calculated and the checklist was re-drafted with the aim of maximising agreement. A second phase of simulated clinical scenarios was then conducted and inter-rater agreement was calculated for the revised checklist. In the first phase of the study, 18 of 35 items had inadequate inter-rater agreement (60%>), while in the second phase, using the revised version, only 3 of 39 items failed to achieve adequate inter-rater agreement. Further evidence of reliability and validity are required. Continued development of the CSRAC will be necessary before it can be utilised to assess the effectiveness of risk assessment training programs.

Hunters & gatherers : strategies for curriculum mapping and data collection for assurance of learning

Assurance of learning is a predominant feature in both quality enhancement and assurance in higher education. Assurance of learning is a process that articulates explicit program outcomes and standards, and systematically gathers evidence to determine the extent to which performance matches expectations. Benefits accrue to the institution through the systematic assessment of whole of program goals. Data may be used for continuous improvement, program development, and to inform external accreditation and evaluation bodies. Recent developments, including the introduction of the Tertiary Education and Quality Standards Agency (TEQSA) will require universities to review the methods they use to assure learning outcomes. This project investigates two critical elements of assurance of learning: 1. the mapping of graduate attributes throughout a program; and 2. the collection of assurance of learning data. An audit was conducted with 25 of the 39 Business Schools in Australian universities to identify current methods of mapping graduate attributes and for collecting assurance of learning data across degree programs, as well as a review of the key challenges faced in these areas. Our findings indicate that external drivers like professional body accreditation (for example: Association to Advance Collegiate Schools of Business (AACSB)) and TEQSA are important motivators for assuring learning, and those who were undertaking AACSB accreditation had more robust assurance of learning systems in place. It was reassuring to see that the majority of institutions (96%) had adopted an embedding approach to assuring learning rather than opting for independent standardised testing. The main challenges that were evident were the development of sustainable processes that were not considered a burden to academic staff, and obtainment of academic buy in to the benefits of assuring learning per se rather than assurance of learning being seen as a tick box exercise. This cultural change is the real challenge in assurance of learning practice.

Quantitative fit assessment of a precontoured fracture fixation plate : its automation and an investigation on the borderline cases

Virtual methods to assess the fitting of a fracture fixation plate were proposed recently, however with limitations such as simplified fit criteria or manual data processing. This study aims to automate a fit analysis procedure using clinical-based criteria, and then to analyse the results further for borderline fit cases. Three dimensional (3D) models of 45 bones and of a precontoured distal tibial plate were utilized to assess the fitting of the plate automatically. A Matlab program was developed to automatically measure the shortest distance between the bone and the plate at three regions of interest and a plate-bone angle. The measured values including the fit assessment results were recorded in a spreadsheet as part of the batch-process routine. An automated fit analysis procedure will enable the processing of larger bone datasets in a significantly shorter time, which will provide more representative data of the target population for plate shape design and validation. As a result, better fitting plates can be manufactured and made available to surgeons, thereby reducing the risk and cost associated with complications or corrective procedures. This in turn, is expected to translate into improving patients' quality of life.

Evaluating the transport impacts of transit oriented developments (TODS)

Sustainable transport has become a necessity instead of an option, to address the problems of congestion and urban sprawl, whose effects include increased trip lengths and travel time. A more sustainable form of development, known as Transit Oriented Development (TOD) is presumed to offer sustainable travel choices with reduced need to travel to access daily destinations, by providing a mixture of land uses together with good quality of public transport service, infrastructure for walking and cycling. However, performance assessment of these developments with respect to travel characteristics of their inhabitants is required. This research proposes a five step methodology for evaluating the transport impacts of TODs. The steps for TOD evaluation include pre–TOD assessment, traffic and travel data collection, determination of traffic impacts, determination of travel impacts, and drawing outcomes. Typically, TODs are comprised of various land uses; hence have various types of users. Assessment of characteristics of all user groups is essential for obtaining an accurate picture of transport impacts. A case study TOD, Kelvin Grove Urban Village (KGUV), located 2km of north west of the Brisbane central business district in Australia was selected for implementing the proposed methodology and to evaluate the transport impacts of a TOD from an Australian perspective. The outcomes of this analysis indicated that KGUV generated 27 to 48 percent less traffic compared to standard published rates specified for homogeneous uses. Further, all user groups of KGUV used more sustainable modes of transport compared to regional and similarly located suburban users, with higher trip length for shopping and education trips. Although the results from this case study development support the transport claims of reduced traffic generation and sustainable travel choices by way of TODs, further investigation is required, considering different styles, scales and locations of TODs. The proposed methodology may be further refined by using results from new TODs and a framework for TOD evaluation may be developed.

Mediators of the relationship between person-organisation fit and individual outcomes

To date, research on P-O fit has focused heavily on the effect of P-O fit on individual and organisational outcomes. Few studies have attempted to explain how or why P-O fit leads to these outcomes. Meglino, Ravlin, and Adkins (1989) and Schein (1985) identified several intervening mechanisms for explaining fit-outcome relationships but only few of these explanations have been tested empirically (Cable & Edwards, 2004; Edwards & Cable, 2009; Kalliath, Bluedorn, & Strube, 1999). This thesis investigates role conflict, cognitive style and organisational justice as three potential mediating mechanisms in the relationship between P-O fit (defined as fit between personal and organisational values – value congruence or value fit) and outcomes including job satisfaction, job performance, service performance, affective commitment and continuance commitment. The study operationalised P-O fit using three measures: subjective fit, perceived fit and objective fit. The mediation model of subjective fit was tested using a Mplus analytical technique, while the mediation models of both perceived and objective fit were tested by modeling the difference between two scores (that is, between personal values and organisational values) using a polynomial regression and response surface analysis (Edwards, 1993). A survey of 558 mid-level managers from seven Brunei public sector organisations provided the data. Our results showed that the relationship between P-O fit and outcomes was partially mediated by organisational justice and cognitive style - for all the three measures of fit, while role conflict had no mediating effects. The findings from this research therefore have both theoretical and practical implications. This research contributes to the literature by combining these theoretical explanations for value congruence effects into one integrated model, and by providing evidence on the partial mediating effects of organisational justice and cognitive style. Future research needs to address and investigate other potential mechanisms by which value congruence affects individual and organisational outcomes. In addition, the study is considered to be the first to test these mediating roles for a value fit-outcomes relationship using three different measures of fit in a non-Western context.

Social outcomes in the construction industry : the case of the Western Australia ‘Percent for Art’ policy

Social outcomes, in particular intangible social outcomes, are generally difficult to achieve in the construction industry due to the predominantly episodic, fragmented and heavily regulated nature of construction that presupposes a tendency towards mainstream construction processes and design. The Western Australian ‘Percent for Art’ policy is recognized for stimulating social outcomes, by creating richer and more aesthetically pleasing social environments through the incorporation of artwork into public buildings. A case study of four Percent for Art projects highlights the role of the Artwork Selection Committee in incorporating artwork into construction. A total of 20 semi-structured interviews were conducted with committee members and policy officers. Data analysis involved a combination of pattern coding and matrix categorization, and resulted in the identification of the committee’s three key elements of collaborative communication, democratic decision-making and project champions. The findings suggest these key elements foster the interaction, communication and relationships needed to facilitate feedback, enhance relationships, create cross-functional teams and lower project resistance, which are all necessary to overcome constraints to social outcomes in construction. The findings provide greater insight into the mechanisms for achieving social outcomes and a basis for future discussion about the processes for achieving social outcomes in the construction industry.

The student as customer model and its impact on the academic leadership role in higher education

This paper posits that the 'student as customer' model has a negative impact upon the academic leadership which in turn is responsible for the erosion of objectivity in the assessment process in the higher education sector. The paper draws on the existing literature to explore the relationship between the student as customer model, academic leadership, and student assessment. The existing research emanating from the literature provides the basis from which the short comings of the student as customer model are exposed. From a practical perspective the arguments made in this paper provide the groundwork for possible future research into the adverse affects of the student as customer model on academic leadership and job satisfaction in the academic work force. The concern for quality may benefit from empirical investigation of the relationship between the student as customer model and quality learning and assessment outcomes in the higher education sector. The paper raises awareness of the faults with the present reliance on the student as customer model and the negative impact on both students and academic staff. The issues explored have the potential to influence the future directions of the higher education sector with regard to the social implications of their quest for quality educational outcomes. The paper addresses a gap in the literature in regard to use of the student as customer model and the subsequent adverse affect on academic leadership and assessment in higher education.