Spatial and temporal distribution of falciparum malaria in China

Background: Falciparum malaria is the most deadly among the four main types of human malaria. Although great success has been achieved since the launch of the National Malaria Control Programme in 1955, malaria remains a serious public health problem in China. This paper aimed to analyse the geographic distribution, demographic patterns and time trends of falciparum malaria in China. Methods: The annual numbers of falciparum malaria cases during 1992–2003 and the individual case reports of each clinical falciparum malaria during 2004–2005 were extracted from communicable disease information systems in China Center for Diseases Control and Prevention. The annual number of cases and the annual incidence were mapped by matching them to corresponding province- and county-level administrative units in a geographic information system. The distribution of falciparum malaria by age, gender and origin of infection was analysed. Time-series analysis was conducted to investigate the relationship between the falciparum malaria in the endemic provinces and the imported falciparum malaria in non-endemic provinces. Results: Falciparum malaria was endemic in two provinces of China during 2004–05. Imported malaria was reported in 26 non-endemic provinces. Annual incidence of falciparum malaria was mapped at county level in the two endemic provinces of China: Yunnan and Hainan. The sex ratio (male vs. female) for the number of cases in Yunnan was 1.6 in the children of 0–15 years and it reached 5.7 in the adults over 15 years of age. The number of malaria cases in Yunnan was positively correlated with the imported malaria of concurrent months in the non-endemic provinces. Conclusion: The endemic area of falciparum malaria in China has remained restricted to two provinces, Yunnan and Hainan. Stable transmission occurs in the bordering region of Yunnan and the hilly-forested south of Hainan. The age and gender distribution in the endemic area is characterized by the predominance of adult men cases. Imported falciparum malaria in the non-endemic area of China, affected mainly by the malaria transmission in Yunnan, has increased both spatially and temporally. Specific intervention measures targeted at the mobile population groups are warranted.

Emergency Health Services (EHS) : demand and service delivery models. [Monograph 2 : Queensland EHS users’ profile]

Emergency health is a critical component of Australia’s health system and one which is increasingly congested from growing demand and blocked access to inpatient beds. The Emergency Health Services Queensland (EHSQ) study aims to identify the factors driving increased demand for emergency health and to evaluate strategies which may safely reduce the future demand growth. This monograph addresses the characteristics of users of emergency health services with an aim to identify those that appear to contribute to demand growth. This study utilises data on patients treated by Emergency Departments (ED) and Queensland Ambulance Service (QAS) across Queensland. ED data was derived from the Emergency Department Information System (EDIS) for the period 2001-02 through to 2010-11. Ambulance data was extracted from the QAS’ Ambulance Information Management System (AIMS) and electronic Ambulance Report Form (eARF) for the period 2001-02 through to 2009-10. Due to discrepancies and comparability issues for ED data, this monograph compares data from the 2003-04 time period with 2010-11 data for 21 of the reporting EDs. Also a snapshot of users for the 2010-11 financial year for 31 reporting EDs is used to describe the characteristics of users and to compare those characteristics with population demographics. For QAS data, the 2002-03 and 2009-10 time periods were selected for detailed analyses to identify trends. • Demand for emergency health care services is increasing, representing both increased population and increased relative utilisation. Per capita demand for ED attention has increased by 2% per annum over the last decade and for ambulance attention by 3.7% per annum. • The growth in ED demand is prominent in more urgent triage categories with actual decline in less urgent patients. An estimated 55% of patients attend hospital EDs outside of normal working hours. There is no evidence that patients presenting out of hours are significantly different to those presenting within working hours; they have similar triage assessments and outcomes. • Patients suffering from injuries and poisoning comprise 28% of the ED workload (an increase of 65% in the study period), whilst declines of 32% in cardiovascular and circulatory conditions, and musculoskeletal problems have been observed. • 25.6% of patients attending EDs are admitted to hospital. 19% of admitted patients and 7% of patients who die in the ED are triage category 4 or 5 on arrival. • The average age of ED patients is 35.6 years. Demand has grown in all age groups and amongst both men and women. Men have higher utilisation rates for ED in all age groups. The only group where the growth rate in women has exceeded men is in the 20-29 age group; this growth is particularly in the injury and poisoning categories. • Considerable attention has been paid publicly to ED performance criteria. It is worth noting that 50% of all patients were treated within 33 minutes of arrival. • Patients from lower socioeconomic areas appear to have higher utilisation rates and the utilisation rate for indigenous people appears to exceed those of European and other backgrounds. The utilisation rates for immigrant people is generally less than that of Australian born however it has not been possible to eliminate the confounding impact of different age and socioeconomic profiles. • Demand for ambulance service is also increasing at a rate that exceeds population growth. Utilisation rates have increased by an average of 5% per annum in Queensland compared to 3.6% nationally, and the utilisation rate in Queensland is 27% higher than the national average. • The growth in ambulance utilisation has also been amongst the more urgent categories of dispatch and utilisation rates are higher in rural and regional areas than in the metropolitan area. The demand for ambulance increases with age but the growth in demand for ambulance service has been more prominent in younger age groups. These findings contribute significantly to an understanding of the growth in demand for emergency health. It shows that the growth is amongst patients in genuine need of emergency healthcare and public rhetoric that the congestion of emergency health services is due to inappropriate attendees is unable to be substantiated. The consistency of the growth in demand over the last decade reflects not only the changing demographics of the Australian population but also the changes in health status, standards of acute health care and other social factors. The growth is also amongst patients with acute injury and poisoning which is inconsistent with rates of chronic disease as a fundamental driver. We have also interviewed patients in regard to their decision making choices for acute health care and the factors that influence these decisions and this will be the subject of a third Monograph and publications.

Improving self care of patients with chronic disease using online personal health record

BACKGROUND: Effective management of chronic diseases such as prostate cancer is important. Research suggests a tendency to use self-care treatment options such as over-the-counter (OTC) complementary medications among prostate cancer patients. The current trend in patient-driven recording of health data in an online Personal Health Record (PHR) presents an opportunity to develop new data-driven approaches for improving prostate cancer patient care. However, the ability of current online solutions to share patients' data for better decision support is limited. An informatics approach may improve online sharing of self-care interventions among these patients. It can also provide better evidence to support decisions made during their self-managed care. AIMS: To identify requirements for an online system and describe a new case-based reasoning (CBR) method for improving self-care of advanced prostate cancer patients in an online PHR environment. METHOD: A non-identifying online survey was conducted to understand self-care patterns among prostate cancer patients and to identify requirements for an online information system. The pilot study was carried out between August 2010 and December 2010. A case-base of 52 patients was developed. RESULTS: The data analysis showed self-care patterns among the prostate cancer patients. Selenium (55%) was the common complementary supplement used by the patients. Paracetamol (about 45%) was the commonly used OTC by the patients. CONCLUSION: The results of this study specified requirements for an online case-based reasoning information system. The outcomes of this study are being incorporated in design of the proposed Artificial Intelligence (Al) driven patient journey browser system. A basic version of the proposed system is currently being considered for implementation.

Spatial clusters of suicide in Australia

Background: Understanding the spatial distribution of suicide can inform the planning, implementation and evaluation of suicide prevention activity. This study explored spatial clusters of suicide in Australia, and investigated likely socio-demographic determinants of these clusters. Methods: National suicide and population data at a statistical local area (SLA) level were obtained from the Australian Bureau of Statistics for the period of 1999 to 2003. Standardised mortality ratios (SMR) were calculated at the SLA level, and Geographic Information System (GIS) techniques were applied to investigate the geographical distribution of suicides and detect clusters of high risk in Australia. Results: Male suicide incidence was relatively high in the northeast of Australia, and parts of the east coast, central and southeast inland, compared with the national average. Among the total male population and males aged 15 to 34, Mornington Shire had the whole or a part of primary high risk cluster for suicide, followed by the Bathurst-Melville area, one of the secondary clusters in the north coastal area of the Northern Territory. Other secondary clusters changed with the selection of cluster radius and age group. For males aged 35 to 54 years, only one cluster in the east of the country was identified. There was only one significant female suicide cluster near Melbourne while other SLAs had very few female suicide cases and were not identified as clusters. Male suicide clusters had a higher proportion of Indigenous population and lower median socio-economic index for area (SEIFA) than the national average, but their shapes changed with selection of maximum cluster radii setting. Conclusion: This study found high suicide risk clusters at the SLA level in Australia, which appeared to be associated with lower median socio-economic status and higher proportion of Indigenous population. Future suicide prevention programs should focus on these high risk areas.

Language and utilisation of emergency care in Queensland

Objective: To compare access and utilisation of EDs in Queensland public hospitals between people who speak only English at home and those who speak another language at home. Methods: A retrospective analysis of a Queensland statewide hospital ED dataset (ED Information System) from 1 January 2008 to 31 December 2010 was conducted. Access to ED care was measured by the proportion of the state’s population attending EDs. Logistic regression analyses were performed to determine the relationships between ambulance use and language, and between hospital admission and language, both after adjusting for age, sex and triage category. Results: The ED utilisation rate was highest in English only speakers (290 per 1000 population), followed by Arabic speakers (105), and lowest among German speakers (30). Compared with English speakers, there were lower rates of ambulance use in Chinese (odds ratio 0.50, 95% confidence interval, 0.47–0.54), Vietnamese (0.87, 0.79–0.95), Arabic (0.87, 0.78–0.97), Spanish (0.56, 0.50–0.62), Italian (0.88, 0.80–0.96), Hindi (0.61, 0.53–0.70) and German (0.87, 0.79–0.90) speakers. Compared with English speakers, German speakers had higher admission rates (odds ratio 1.17, 95% confidence interval, 1.02–1.34), whereas there were lower admission rates in Chinese (0.90, 0.86–0.99), Arabic (0.76, 0.67–0.85) and Spanish (0.83, 0.75–0.93) speakers. Conclusion: This study showed that there was a significant association between lower utilisation of emergency care and speaking languages other than English at home. Further researches are needed using in-depth methodology to investigate if there are language barriers in accessing emergency care in Queensland.

Action research and unit improvement in higher education : a case study approach

Student satisfaction data has been collected on a national basis in Australia since 1972. In recent years this data has been used by federal government agencies to allocate funding, and by students in selecting their universities of choice. The purpose of this paper is to present the findings of an action research project designed to identify and implement unit improvement initiatives over a three year period for an underperforming unit. This research utilises student survey data and teacher reflections to identify areas of unit improvement, with a view to aligning learning experiences, teaching and assessment to learning outcomes and improved student satisfaction. This research concludes that whilst a voluntary student survey system may be imperfect, it nevertheless provides important data that can be utilised to the benefit of the unit, learning outcomes and student satisfaction ratings, as well as wider course related outcomes. Extrapolation of these findings is recommended to other underperforming units.

A Comprehensive Benchmarking Framework (CoBeFra) for conformance analysis between procedural process models and event logs in ProM

Process mining encompasses the research area which is concerned with knowledge discovery from information system event logs. Within the process mining research area, two prominent tasks can be discerned. First of all, process discovery deals with the automatic construction of a process model out of an event log. Secondly, conformance checking focuses on the assessment of the quality of a discovered or designed process model in respect to the actual behavior as captured in event logs. Hereto, multiple techniques and metrics have been developed and described in the literature. However, the process mining domain still lacks a comprehensive framework for assessing the goodness of a process model from a quantitative perspective. In this study, we describe the architecture of an extensible framework within ProM, allowing for the consistent, comparative and repeatable calculation of conformance metrics. For the development and assessment of both process discovery as well as conformance techniques, such a framework is considered greatly valuable.

Why stagnant? behind the scenes in Indonesia’s reformed state asset management policies

This study seeks to answer the question of “why is policy innovation in Indonesia, in particular reformed state asset management laws and regulations, stagnant?” through an empirical and qualitative approach, identifying and exploring potential impeding influences to the full and equal implementation of said laws and regulations. The policies and regulations governing the practice of state asset management has emerged as an urgent question among many countries worldwide (Conway, 2006; Dow, Gillies, Nichols, & Polen, 2006; Kaganova, McKellar, & Peterson, 2006; McKellar, 2006b) for there is heightened awareness of the complex and crucial role that state assets play in public service provision. Indonesia is an example of such country, introducing a ‘big-bang’ reform in state asset management laws, policies, regulations, and technical guidelines. Two main reasons propelled said policy innovation: a) world-wide common challenges in state asset management practices - such as incomplete information system, accountability, and governance adherence/conceptualisation (Kaganova, McKellar and Peterson 2006); and b) unfavourable state assets audit results in all regional governments across Indonesia. The latter reasoning is emphasised, as the Indonesian government admits to past neglect in ensuring efficiency and best practice in its state asset management practices. Prior to reform there was euphoria of building and developing state assets and public infrastructure to support government programs of the day. Although this euphoria resulted in high growth within Indonesia, there seems to be little attention paid to how state assets bought/built is managed. Up until 2003-2004 state asset management is considered to be minimal; inventory of assets is done manually, there is incomplete public sector accounting standards, and incomplete financial reporting standards (Hadiyanto 2009). During that time transparency, accountability, and maintenance state assets was not the main focus, be it by the government or the society itself (Hadiyanto 2009). Indonesia exemplified its enthusiasm in reforming state asset management policies and practices through the establishment of the Directorate General of State Assets in 2006. The Directorate General of State Assets have stressed the new direction that it is taking state asset management laws and policies through the introduction of Republic of Indonesia Law Number 38 Year 2008, which is an amended regulation overruling Republic of Indonesia Law Number 6 Year 2006 on Central/Regional Government State Asset Management (Hadiyanto, 2009c). Law number 38/2008 aims to further exemplify good governance principles and puts forward a ‘the highest and best use of assets’ principle in state asset management (Hadiyanto, 2009a). The methodology of this study is that of qualitative case study approach, with a triangulated data collection method of document analysis (all relevant state asset management laws, regulations, policies, technical guidelines, and external audit reports), semi-structured interviews, and on-site observation. Empirical data of this study involved a sample of four Indonesian regional governments and 70 interviews, performed during January-July 2010. The analytical approach of this study is that of thematic analysis, in an effort to identify common influences and/or challenges to policy innovation within Indonesia. Based on the empirical data of this study specific impeding influences to state asset management reform is explored, answering the question why innovative policy implementation is stagnant. An in-depth analysis of each influencing factors to state asset management reform, and the attached interviewee’s opinions for each factor, suggests the potential of an ‘excuse rhetoric’; whereby the influencing factors identified are a smoke-screen, or are myths that public policy makers and implementers believe in; as a means to explain innovative policy stagnancy. This study offers insights to Indonesian policy makers interested in ensuring the conceptualisation and full implementation of innovative policies, particularly, although not limited to, within the context of state asset management practices.

Extending and validating the is-impact model in Saudi Arabia : accounting for computer network quality

Organizations from every industry sector seek to enhance their business performance and competitiveness through the deployment of contemporary information systems (IS), such as Enterprise Systems (ERP). Investments in ERP are complex and costly, attracting scrutiny and pressure to justify their cost. Thus, IS researchers highlight the need for systematic evaluation of information system success, or impact, which has resulted in the introduction of varied models for evaluating information systems. One of these systematic measurement approaches is the IS-Impact Model introduced by a team of researchers at Queensland University of technology (QUT) (Gable, Sedera, & Chan, 2008). The IS-Impact Model is conceptualized as a formative, multidimensional index that consists of four dimensions. Gable et al. (2008) define IS-Impact as "a measure at a point in time, of the stream of net benefits from the IS, to date and anticipated, as perceived by all key-user-groups" (p.381). The IT Evaluation Research Program (ITE-Program) at QUT has grown the IS-Impact Research Track with the central goal of conducting further studies to enhance and extend the IS-Impact Model. The overall goal of the IS-Impact research track at QUT is "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable, 2009). In order to achieve that, the IS-Impact research track advocates programmatic research having the principles of tenacity, holism, and generalizability through extension research strategies. This study was conducted within the IS-Impact Research Track, to further generalize the IS-Impact Model by extending it to the Saudi Arabian context. According to Hofsted (2012), the national culture of Saudi Arabia is significantly different from the Australian national culture making the Saudi Arabian culture an interesting context for testing the external validity of the IS-Impact Model. The study re-visits the IS-Impact Model from the ground up. Rather than assume the existing instrument is valid in the new context, or simply assess its validity through quantitative data collection, the study takes a qualitative, inductive approach to re-assessing the necessity and completeness of existing dimensions and measures. This is done in two phases: Exploratory Phase and Confirmatory Phase. The exploratory phase addresses the first research question of the study "Is the IS-Impact Model complete and able to capture the impact of information systems in Saudi Arabian Organization?". The content analysis, used to analyze the Identification Survey data, indicated that 2 of the 37 measures of the IS-Impact Model are not applicable for the Saudi Arabian Context. Moreover, no new measures or dimensions were identified, evidencing the completeness and content validity of the IS-Impact Model. In addition, the Identification Survey data suggested several concepts related to IS-Impact, the most prominent of which was "Computer Network Quality" (CNQ). The literature supported the existence of a theoretical link between IS-Impact and CNQ (CNQ is viewed as an antecedent of IS-Impact). With the primary goal of validating the IS-Impact model within its extended nomological network, CNQ was introduced to the research model. The Confirmatory Phase addresses the second research question of the study "Is the Extended IS-Impact Model Valid as a Hierarchical Multidimensional Formative Measurement Model?". The objective of the Confirmatory Phase was to test the validity of IS-Impact Model and CNQ Model. To achieve that, IS-Impact, CNQ, and IS-Satisfaction were operationalized in a survey instrument, and then the research model was assessed by employing the Partial Least Squares (PLS) approach. The CNQ model was validated as a formative model. Similarly, the IS-Impact Model was validated as a hierarchical multidimensional formative construct. However, the analysis indicated that one of the IS-Impact Model indicators was insignificant and can be removed from the model. Thus, the resulting Extended IS-Impact Model consists of 4 dimensions and 34 measures. Finally, the structural model was also assessed against two aspects: explanatory and predictive power. The analysis revealed that the path coefficient between CNQ and IS-Impact is significant with t-value= (4.826) and relatively strong with â = (0.426) with CNQ explaining 18% of the variance in IS-Impact. These results supported the hypothesis that CNQ is antecedent of IS-Impact. The study demonstrates that the quality of Computer Network affects the quality of the Enterprise System (ERP) and consequently the impacts of the system. Therefore, practitioners should pay attention to the Computer Network quality. Similarly, the path coefficient between IS-Impact and IS-Satisfaction was significant t-value = (17.79) and strong â = (0.744), with IS-Impact alone explaining 55% of the variance in Satisfaction, consistent with results of the original IS-Impact study (Gable et al., 2008). The research contributions include: (a) supporting the completeness and validity of IS-Impact Model as a Hierarchical Multi-dimensional Formative Measurement Model in the Saudi Arabian context, (b) operationalizing Computer Network Quality as conceptualized in the ITU-T Recommendation E.800 (ITU-T, 1993), (c) validating CNQ as a formative measurement model and as an antecedent of IS Impact, and (d) conceptualizing and validating IS-Satisfaction as a reflective measurement model and as an immediate consequence of IS Impact. The CNQ model provides a framework to perceptually measure Computer Network Quality from multiple perspectives. The CNQ model features an easy-to-understand, easy-to-use, and economical survey instrument.

Benefits and issues for bus travel time estimation and prediction

Bus travel time estimation and prediction are two important modelling approaches which could facilitate transit users in using and transit providers in managing the public transport network. Bus travel time estimation could assist transit operators in understanding and improving the reliability of their systems and attracting more public transport users. On the other hand, bus travel time prediction is an important component of a traveller information system which could reduce the anxiety and stress for the travellers. This paper provides an insight into the characteristic of bus in traffic and the factors that influence bus travel time. A critical overview of the state-of-the-art in bus travel time estimation and prediction is provided and the needs for research in this important area are highlighted. The possibility of using Vehicle Identification Data (VID) for studying the relationship between bus and cars travel time is also explored.

Language affects length of stay in emergency departments in Queensland public hospitals

BACKGROUND: A long length of stay (LOS) in the emergency department (ED) associated with overcrowding has been found to adversely affect the quality of ED care. The objective of this study is to determine whether patients who speak a language other than English at home have a longer LOS in EDs compared to those whose speak only English at home. METHODS: A secondary data analysis of a Queensland state-wide hospital EDs dataset (Emergency Department Information System) was conducted for the period, 1 January 2008 to 31 December 2010. RESULTS: The interpreter requirement was the highest among Vietnamese speakers (23.1%) followed by Chinese (19.8%) and Arabic speakers (18.7%). There were significant differences in the distributions of the departure statuses among the language groups (Chi-squared=3236.88, P<0.001). Compared with English speakers, the Beta coeffi cient for the LOS in the EDs measured in minutes was among Vietnamese, 26.3 (95%CI: 22.1–30.5); Arabic, 10.3 (95%CI: 7.3–13.2); Spanish, 9.4 (95%CI: 7.1–11.7); Chinese, 8.6 (95%CI: 2.6–14.6); Hindi, 4.0 (95%CI: 2.2–5.7); Italian, 3.5 (95%CI: 1.6–5.4); and German, 2.7 (95%CI: 1.0–4.4). The fi nal regression model explained 17% of the variability in LOS. CONCLUSION: There is a close relationship between the language spoken at home and the LOS at EDs, indicating that language could be an important predictor of prolonged LOS in EDs and improving language services might reduce LOS and ease overcrowding in EDs in Queensland's public hospitals.

Slice, mine and dice : complexity-aware automated discovery of business process models

Automated process discovery techniques aim at extracting models from information system logs in order to shed light into the business processes supported by these systems. Existing techniques in this space are effective when applied to relatively small or regular logs, but otherwise generate large and spaghetti-like models. In previous work, trace clustering has been applied in an attempt to reduce the size and complexity of automatically discovered process models. The idea is to split the log into clusters and to discover one model per cluster. The result is a collection of process models -- each one representing a variant of the business process -- as opposed to an all-encompassing model. Still, models produced in this way may exhibit unacceptably high complexity. In this setting, this paper presents a two-way divide-and-conquer process discovery technique, wherein the discovered process models are split on the one hand by variants and on the other hand hierarchically by means of subprocess extraction. The proposed technique allows users to set a desired bound for the complexity of the produced models. Experiments on real-life logs show that the technique produces collections of models that are up to 64% smaller than those extracted under the same complexity bounds by applying existing trace clustering techniques.

Empirical investigation of the usefulness of Gateway constructs in process models

Process modeling grammars are used to create scripts of a business domain that a process-aware information system is intended to support. A key grammatical construct of such grammars is known as a Gateway. A Gateway construct is used to describe scenarios in which the workflow of a process diverges or converges according to relevant conditions. Gateway constructs have been subjected to much academic discussion about their meaning, role and usefulness, and have been linked to both process-modeling errors and process-model understandability. This paper examines perceptual discriminability effects of Gateway constructs on an individual's abilities to interpret process models. We compare two ways of expressing two convergence and divergence patterns – Parallel Split and Simple Merge – implemented in a process modeling grammar. On the basis of an experiment with 98 students, we provide empirical evidence that Gateway constructs aid the interpretation of process models due to a perceptual discriminability effect, especially when models are complex. We discuss the emerging implications for research and practice, in terms of revisions to grammar specifications, guideline development and design choices in process modeling.

The growing demand for emergency healthcare

Emergency health is a critical component of health systems; one increasingly congested from growing demand and blocked access to care. The Emergency Health Services Queensland (EHSQ) study aimed to identify the factors driving increased demand for emergency healthcare. This study examined data on patients treated by the ambulance service and Emergency Departments across Queensland. Data was derived from the Queensland Ambulance Service’s (QAS) Ambulance Information Management System and electronic Ambulance Report Form and from the Emergency Department Information System (EDIS). Data was obtained for the period 2001-02 through to 2009-10. A snapshot of users for the 2009-10 year was used to describe the characteristics of users and comparisons made with the year 2003-04 to identify trends. Per capita demand for EDs has increased by 2% per annum over the decade and for ambulance by 3.7% per annum. The growth in ED demand is most significant in more urgent triage categories with decline in less urgent patients. The growth is most prominent amongst patients suffering injuries and poisoning, amongst both men and women and across all age groups. Patients from lower socioeconomic areas appear to have higher utilisation rates and the utilisation rate for indigenous people exceeds those of other backgrounds. The utilisation rates for immigrant people is less than Australian born however it has not been possible to eliminate the confounding impact of age and socioeconomic profiles. These findings contribute to an understanding of the growth in demand for emergency health. It is evident that the growth is amongst patients in genuine need of emergency healthcare and public rhetoric that congested emergency health services is due to inappropriate attendees is unsustainable. The growth in demand over the last decade reflects not only on changing demographics of the Australian population but also changes in health status, standards of acute health care and other social factors.

REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.