The role of evaluation in decision-making in the management of health services

The management of health services is a complex administrative practice due to the breadth of the field of health and the need to reconcile individual, corporate and collective interests that are not always convergent. In this context, the evaluation needs to have specific characteristics in order to fulfill its role. The scope of this study was to establish the characteristics that the evaluation for the management of health services should have to contribute to decision-making. Usefulness, opportunity, feasibility, reliability, objectivity and directionality represent the set of principles upon which the evaluation should be based. Evaluations should lead to decisions that guarantee not only their efficiency and effectiveness but also their implementation. The evaluation process should ensure that decisions involve all stakeholders in order to render the implementation of decisions feasible, and take into account the health needs of the population and the goals set for the services. The scope of this article is to elicit a debate among different stakeholders in the evaluation in the hope that it can contribute to the reflection on the real usefulness of evaluations in which the political component in management has been increasingly prevalent.

Development of modelling method selection tool for health services management: From problem structuring methods to modelling and simulation methods

Background: There is an increasing recognition that modelling and simulation can assist in the process of designing health care policies, strategies and operations. However, the current use is limited and answers to questions such as what methods to use and when remain somewhat underdeveloped. Aim. The aim of this study is to provide a mechanism for decision makers in health services planning and management to compare a broad range of modelling and simulation methods so that they can better select and use them or better commission relevant modelling and simulation work. Methods. This paper proposes a modelling and simulation method comparison and selection tool developed from a comprehensive literature review, the research team's extensive expertise and inputs from potential users. Twenty-eight different methods were identified, characterised by their relevance to different application areas, project life cycle stages, types of output and levels of insight, and four input resources required (time, money, knowledge and data). Results: The characterisation is presented in matrix forms to allow quick comparison and selection. This paper also highlights significant knowledge gaps in the existing literature when assessing the applicability of particular approaches to health services management, where modelling and simulation skills are scarce let alone money and time. Conclusions: A modelling and simulation method comparison and selection tool is developed to assist with the selection of methods appropriate to supporting specific decision making processes. In particular it addresses the issue of which method is most appropriate to which specific health services management problem, what the user might expect to be obtained from the method, and what is required to use the method. In summary, we believe the tool adds value to the scarce existing literature on methods comparison and selection. © 2011 Jun et al.

Collaborative practice:a strategy to improve the relevance of health services research.

Health services research has emerged as a tool for decision makers to make services more effective and efficient. While its value as a basis for decision making is well established, the incorporation of such evidence into decision making remains inconsistent. To this end, strengthening collaborative relationships between researchers and healthcare decision makers has been identified as a significant strategy for putting research evidence into practice.

Mobile competence network for community health workers in rural Myanmar: a supportive information system that facilitates the improvement of health services.

The goal of this project is the development of international cooperation for fostering solutions to provide better access to basic healthcare services.

Health status and use of health services among recently arrived men with refugee backgrounds: A comparative analysis of urban and regional settlement in South-east Queensland

Approximately one-third of refugee and humanitarian entrants to Australia are adult men. Many of these men and their families settle in regional areas. Little is known about the health status of refugee men and the use of health services, and whether or not there are differences between those living in urban and regional areas. This paper reports on the cross-sectional differences in health status and use of health services among a group of 233 recently arrived refugee men living in urban and regional areas of South-east Queensland. Overall, participants reported good levels of subjective health status, moderate to good levels of well-being, and low prevalence of mental illness. Men living in urban areas were more likely to have a longstanding illness and report poorer health status than those settled in regional areas. In contrast, men living in regional areas reported poorer levels of well-being in the environment domain and were more likely to visit hospital emergency departments. Targeted health promotion programs will ensure that refugee men remain healthy and develop their full potential as members of the Australian community. Programs that facilitate refugees’ access to primary health care in regional areas may promote more appropriate use of hospital emergency departments by these communities.

From theory to practice:Improving the impact of health services research

Background: While significant strides have been made in health research, the incorporation of research evidence into healthcare decision-making has been marginal. The purpose of this paper is to provide an overview of how the utility of health services research can be improved through the use of theory. Integrating theory into health services research can improve research methodology and encourage stronger collaboration with decision-makers. Discussion: Recognizing the importance of theory calls for new expectations in the practice of health services research. These include: the formation of interdisciplinary research teams; broadening the training for those who will practice health services research; and supportive organizational conditions that promote collaboration between researchers and decision makers. Further, funding bodies can provide a significant role in guiding and supporting the use of theory in the practice of health services research. Summary: Institutions and researchers should incorporate the use of theory if health services research is to fulfill its potential for improving the delivery of health care. © 2005 Brazil et al; licensee BioMed Central Ltd.

Effects of a demand-led evidence briefing service on the uptake and use of research evidence by commissioners of health services: protocol for a controlled before and after study

Background: Clinical Commissioning Groups (CCGs) are mandated to use research evidence effectively to ensure optimum use of resources by the National Health Service (NHS), both in accelerating innovation and in stopping the use of less effective practices and models of service delivery. We intend to evaluate whether access to a demand-led evidence service improves uptake and use of research evidence by NHS commissioners compared with less intensive and less targeted alternatives. 

Methods/design: This is a controlled before and after study involving CCGs in the North of England. Participating CCGs will receive one of three interventions to support the use of research evidence in their decision-making:1) consulting plus responsive push of tailored evidence; 2) consulting plus an unsolicited push of non-tailored evidence; or 3) standard service unsolicited push of non-tailored evidence. Our primary outcome will be changed at 12 months from baseline of a CCGs ability to acquire, assess, adapt and apply research evidence to support decision-making. Secondary outcomes will measure individual clinical leads and managers’ intentions to use research evidence in decision making. Documentary evidence of the use of the outputs of the service will be sought. A process evaluation will evaluate the nature and success of the interactions both within the sites and between commissioners and researchers delivering the service. 

Discussion: The proposed research will generate new knowledge of direct relevance and value to the NHS. The findings will help to clarify which elements of the service are of value in promoting the use of research evidence.Those involved in NHS commissioning will be able to use the results to inform how best to build the infrastructure they need to acquire, assess, adapt and apply research evidence to support decision-making and to fulfil their statutory duties under the Health and Social Care Act.

Ethnicity and the use of health services in Belize

Includes bibliography

From Theory to Practice: Improving the Impact of Health Services Research.

BACKGROUND: While significant strides have been made in health research, the incorporation of research evidence into healthcare decision-making has been marginal. The purpose of this paper is to provide an overview of how the utility of health services research can be improved through the use of theory. Integrating theory into health services research can improve research methodology and encourage stronger collaboration with decision-makers. DISCUSSION: Recognizing the importance of theory calls for new expectations in the practice of health services research. These include: the formation of interdisciplinary research teams; broadening the training for those who will practice health services research; and supportive organizational conditions that promote collaboration between researchers and decision makers. Further, funding bodies can provide a significant role in guiding and supporting the use of theory in the practice of health services research. SUMMARY: Institutions and researchers should incorporate the use of theory if health services research is to fulfill its potential for improving the delivery of health care.