The Evaluation of health and safety auditing systems

The specific objective of the research was to evaluate proprietary audit systems. Proprietary audit systems comprise question sets containing approximately 500 questions dealing with selected aspects of health and safety management. Each question is allotted a number of points and an organisation seeks to judge its health and safety performance by the overall score achieved in the audit. Initially it was considered that the evaluation method might involve comparing the proprietary audit scores with other methods of measuring safety performance. However, what appeared to be missing in the first instance was information that organisations could use to compare the contrast question set content against their own needs. A technique was developed using the computer database FileMaker Pro. This enables questions in an audit to be sorted into categories using a process of searching for key words. Questions that are not categorised by word searching can be identified and sorted manually. The process can be completed in 2-3 hours which is considerably faster than manual categorisation of questions which typically takes about 10 days. The technique was used to compare and contrast three proprietary audits: ISRS, CHASE and QSA. Differences and similarities between these audits were successfully identified. It was concluded that in general proprietary audits need to focus to a greater extent on identifying strengths and weaknesses in occupational health and safety management systems. To do this requires the inclusion of more probing questions which consider whether risk control measures are likely to be successful.

Hospital accounting and the history of health-care rationing

Focussing on the period from 1948 to 1997, this paper examines the history of rationing in the British National Health Service (NHS), with special reference to the role of hospital accounting in this context. The paper suggests that concerns regarding rationing first emerged in the 1960s and 1970s in response to the application of economic theories to the health services, and that rationing only became an issue of wider concern when the NHS increasingly came to resemble economic models of health services in the early 1990s. The paper moreover argues that, unlike in the USA, hospital accounting did not play a significant role in allocating or withholding health resources in Britain. Rudimentary information systems as well as resistance from medical professionals are identified as significant factors in this context.

An evaluation of certain aspects of an occupational health service

This thesis has been concerned with obtaining evidence to explore the proposition that the provision of occupational health services as arranged at the present time represents a misallocation of resources. The research has been undertaken within the occupational health service of a large Midlands food factory. As the research progressed it became evident that questions were being raised about the nature and scope of occupational health as well as the contribution, in combating danger at work, that occupational health services can make to the health and safety team. These questions have been scrutinized in depth, as they are clearly important, and a resolution of the problem of the definition of occupational health has been proposed. I have taken the approach of attempting to identify specific objectives or benefits of occupational health activities so that it is possible to assess how far these objectives are being achieved. I have looked at three aspects of occupational health; audiometry, physiotherapy and pre-employment medical examinations as these activities embody crucial concepts which are common to all activities in an occupational health programme. A three category classification of occupational health activities is proposed such that the three activities provide examples within each category. These are called personnel therapy, personnel input screening and personnel throughput screening. I conclude that I have not shown audiometry to be cost-effective. My observations of the physiotherapy service lead me to support the suggestion that there is a decline in sickness absence rates due to physiotherapy in industry. With pre-employment medical examinations I have shown that the service is product safety oriented and that benefits are extremely difficult to identify. In regard to the three services studied, in the one factory investigated, and because of the immeasurability of certain activities, I find support for the proposition that the mix of occupational health services as provided at the present time represents a misallocation of resources.

Development and psychometric evaluation of a new team effectiveness scale for all types of community adult mental health teams:a mixed-methods approach

Defining 'effectiveness' in the context of community mental health teams (CMHTs) has become increasingly difficult under the current pattern of provision required in National Health Service mental health services in England. The aim of this study was to establish the characteristics of multi-professional team working effectiveness in adult CMHTs to develop a new measure of CMHT effectiveness. The study was conducted between May and November 2010 and comprised two stages. Stage 1 used a formative evaluative approach based on the Productivity Measurement and Enhancement System to develop the scale with multiple stakeholder groups over a series of qualitative workshops held in various locations across England. Stage 2 analysed responses from a cross-sectional survey of 1500 members in 135 CMHTs from 11 Mental Health Trusts in England to determine the scale's psychometric properties. Based on an analysis of its structural validity and reliability, the resultant 20-item scale demonstrated good psychometric properties and captured one overall latent factor of CMHT effectiveness comprising seven dimensions: improved service user well-being, creative problem-solving, continuous care, inter-team working, respect between professionals, engagement with carers and therapeutic relationships with service users. The scale will be of significant value to CMHTs and healthcare commissioners both nationally and internationally for monitoring, evaluating and improving team functioning in practice.

A joint approach to treating dental phobia:a re-evaluation of a collaboration between community dental services and specialist psychotherapy services ten years on

Objective To audit the records of a group of patients who had previously benefited from cognitive behavioural therapy (CBT) for dental phobia.Aim To ascertain if they had returned to the use of intravenous (IV) sedation to facilitate dental treatment. Ten years ago these patients were routinely requiring IV sedation to facilitate dental treatment due to severe dental phobia.Method Sixty patients entered the original pilot project. Of those, 30 were offered CBT and 21 attended. Twenty of those patients (95.2%) were subsequently able to have dental treatment without IV sedation. In this follow-up study the electronic records of 19 of the 20 patients who had originally been successful with CBT were re-audited. Our purpose was to see if there was any record of subsequent IV sedation administration in the intervening ten years.Results Of the 19 successful CBT patients available to follow-up, 100% had not received IV sedation since the study ten years ago. This may suggest the initial benefit of CBT has endured over the ten-year period.Conclusion This study indicates that the use of CBT for patients with dental phobia proves beneficial not only in the initial treatment but that the benefits may endure over time. This results in a significant reduction in health risks to the patient from repeated IV sedation. It may also translate into significant financial savings for dental care providers. Our evidence for CBT as treatment for dental phobia suggests dental services should be implementing this approach now rather than pursuing further research. © 2011 Macmillan Publishers Limited. All rights reserved.

Evaluation of low vision services on the quality of life of individuals with age-related macular degeneration

Background: Age-related macular degeneration (ARMD) is a major cause of irreversible visual loss in the elderly and a significant threat to their quality of life. Although low vision services often improve the functional outcomes of individuals with macular disease, it remains unclear whether or not they have any impact on quality of life. The principal aim of this study was to determine the effect of a hospital-based low vision clinic on the quality of life of individuals with ARMD. Methods: Forty patients with ARMD attended the low vision clinic at Milton Keynes University Hospital. Quality of life was measured with the vision-specific Low Vision Quality of Life (LVQOL) questionnaire and the general health EuroQol (EQ-5D-5L) questionnaire. Measures were completed at baseline (time zero, T0), and at three- (T3) and six-month (T6) follow-up visits. Results: The near visual acuity of individuals attending the low vision clinic for the first time improved significantly between visits T0 and T3 (p=0.005), reflecting the practiced use of their newly-dispensed low vision aids. As expected, there was no significant change in near acuity over this time period for existing patients. For both new and existing patients, a significant increase in LVQOL score was evident between visits T0 and T3, with a further significant improvement between T3 and T6. Similarly, there was a significant decrease in EQ-5D-5L questionnaire scores between visits T0 and T6. Conclusions: The higher LVQOL scores obtained at the end of the study period (T6) provide evidence that low vision services at Milton Keynes University Hospital served to improve patient quality of life. The reduction in EQ-5D-5L scores over the same time period suggests that low vision services also provide for an improvement in general health-related quality of life. Impact: The findings support the cause of low vision services to improve not only the vision and functional outcomes of individuals with macular disease but also their quality of life. Moreover, the findings suggest that a more efficient allocation of resources at low vision clinics may be possible through the standardisation of patient follow-up frequency.

Lay perceptions of type 2 diabetes in Scotland:bringing health services back in

The growing prevalence of type 2 diabetes is placing Scottish health services under considerable strain. Consequently, diabetes services are undergoing a major process of reorganisation, including the devolvement of routine diabetes care/diabetic review from secondary to primary healthcare settings. This qualitative study was devised to explore newly diagnosed type 2 diabetes patients' perceptions of their disease and the health services they receive at a time when this restructuring of services is taking place. The sample comprised 40 patients resident in Lothian, Scotland, who had diverse experiences of services, some receiving GP-based care only, others having varying contact with hospital diabetes clinics. In-depth interviews were undertaken with patients, three times at six monthly intervals over 1 year, enabling their experiences to be tracked at critical junctures during the post-diagnostic period. Disease perceptions and health service delivery were found to be mutually informing and effecting. Not only did (different types of) health service delivery influence the ways in which patients thought about and self-managed their disease, over time patients' disease perceptions also informed their expectations of, and preferences for, diabetes services. We thus argue that there is a need for a reconceptualisation within the medical social sciences to take into account the context of healthcare and the economic/policy factors that inform health service delivery when looking at patients' disease perceptions. We also discuss the logistical and ethical challenges of drawing upon patients' perspectives, preferences and views in the design and delivery of future health services. © 2004 Elsevier Ltd. All rights reserved.

Evaluation of the Heart of Birmingham teaching Primary Care Trust (HoBtPCT): My Choice Weight Management Programme:report commissioned by Heart of Birmingham teaching Primary Care Trust

This report details an evaluation of the My Choice Weight Management Programme undertaken by a research team from the School of Pharmacy at Aston University. The My Choice Weight Management Programme is delivered through community pharmacies and general practitioners (GPs) contracted to provide services by the Heart of Birmingham teaching Primary Care Trust. It is designed to support individuals who are ‘ready to change’ by enabling the individual to work with a trained healthcare worker (for example, a healthcare assistant, practice nurse or pharmacy assistant) to develop a care plan designed to enable the individual to lose 5-10% of their current weight. The Programme aims to reduce adult obesity levels; improve access to overweight and obesity management services in primary care; improve diet and nutrition; promote healthy weight and increased levels of physical activity in overweight or obese patients; and support patients to make lifestyle changes to enable them to lose weight. The Programme is available for obese patients over 18 years old who have a Body Mass Index (BMI) greater than 30 kg/m2 (greater than 25 kg/m2 in Asian patients) or greater than 28 kg/m2 (greater than 23.5 kg/m2 in Asian patients) in patients with co-morbidities (diabetes, high blood pressure, cardiovascular disease). Each participant attends weekly consultations over a twelve session period (the final iteration of these weekly sessions is referred to as ‘session twelve’ in this report). They are then offered up to three follow up appointments for up to six months at two monthly intervals (the final of these follow ups, taking place at approximately nine months post recruitment, is referred to as ‘session fifteen’ in this report). A review of the literature highlights the dearth of published research on the effectiveness of primary care- or community-based weight management interventions. This report may help to address this knowledge deficit. A total of 451 individuals were recruited on to the My Choice Weight Management Programme. More participants were recruited at GP surgeries (n=268) than at community pharmacies (n=183). In total, 204 participants (GP n=102; pharmacy n=102) attended session twelve and 82 participants (GP n=22; pharmacy 60) attended session fifteen. The unique demographic characteristics of My Choice Weight Management Programme participants – participants were recruited from areas with high levels of socioeconomic deprivation and over four-fifths of participants were from Black and Minority Ethnic groups; populations which are traditionally underserved by healthcare interventions – make the achievements of the Programme particularly notable. The mean weight loss at session 12 was 3.8 kg (equivalent to a reduction of 4.0% of initial weight) among GP surgery participants and 2.4 kg (2.8%) among pharmacy participants. At session 15 mean weight loss was 2.3 kg (2.2%) among GP surgery participants and 3.4 kg (4.0%) among pharmacy participants. The My Choice Weight Management Programme improved the general health status of participants between recruitment and session twelve as measured by the validated SF-12 questionnaire. While cost data is presented in this report, it is unclear which provider type delivered the Programme more cost-effectively. Attendance rates on the Programme were consistently better among pharmacy participants than among GP participants. The opinions of programme participants (both those who attended regularly and those who failed to attend as expected) and programme providers were explored via semi-structured interviews and, in the case of the participants, a selfcompletion postal questionnaire. These data suggest that the Programme was almost uniformly popular with both the deliverers of the Programme and participants on the Programme with 83% of questionnaire respondents indicating that they would be happy to recommend the Programme to other people looking to lose weight. Our recommendations, based on the evidence provided in this report, include: a. Any consideration of an extension to the study also giving comparable consideration to an extension of the Programme evaluation. The feasibility of assigning participants to a pharmacy provider or a GP provider via a central allocation system should also be examined. This would address imbalances in participant recruitment levels between provider type and allow for more accurate comparison of the effectiveness in the delivery of the Programme between GP surgeries and community pharmacies by increasing the homogeneity of participants at each type of site and increasing the number of Programme participants overall. b. Widespread dissemination of the findings from this review of the My Choice Weight Management Project should be undertaken through a variety of channels. c. Consideration of the inclusion of the following key aspects of the My Choice Weight Management Project in any extension to the Programme: i. The provision of training to staff in GP surgeries and community pharmacies responsible for delivery of the Programme prior to patient recruitment. ii. Maintaining the level of healthcare staff input to the Programme. iii. The regular schedule of appointments with Programme participants. iv. The provision of an increased variety of printed material. d. A simplification of the data collection method used by the Programme commissioners at the individual Programme delivery sites.

The evaluation of information systems in the organisational context of the National Health Service. Available in 2 volumes.

This thesis describes a project which has investigated the evaluation of information systems. The work took place in, and is related to, a specific organisational context, that of the National Health Service (NHS). It aims to increase understanding of the evaluation which takes place in the service and the way in which this is affected by the NHS environment. It also investigates the issues which surround some important types of evaluation and their use in this context. The first stage of the project was a postal survey in which respondents were asked to describe the evaluation which took place in their authorities and to give their opinions about it. This was used to give an overview of the practice of IS evaluation in the NHS and to identify its uses and the problems experienced. Three important types of evaluation were then examined in more detail by means of action research studies. One of these dealt with the selection and purchase of a large hospital information system. The study took the form of an evaluation of the procurement process, and examined the methods used and the influence of organisational factors. The other studies are concerned with post-implementation evaluation, and examine the choice of an evaluation approach as well as its application. One was an evaluation of a community health system which had been operational for some time but was of doubtful value, and suffered from a number of problems. The situation was explored by means of a study of the costs and benefits of the system. The remaining study was the initial review of a system which was used in the administration of a Breast Screening Service. The service itself was also newly operational and the relationship between the service and the system was of interest.

An evaluation of the effectiveness of intervention strategies for the promotion of health and safety performance in small firms

Recognition of the contribution of small firms to the UK economy has grown considerably since 1995 when this research first began. The poor record of small firms in managing health and safety effectively has caused concern, and efforts made to improve knowledge and awareness of the target group through various initiatives have had some success. This research thesis attempts to identify the range of intervention routes and methods available to reach the target group, and to consider ways of evaluating the outcome of such efforts. Various interventions were tested with small firms, including a Workshop; use of Questionnaires; short postal Reply Slip survey; leading to a closer evaluation of a specific industry- the Licensed Trade. Attitudes and beliefs of the sample were identified, and observations carried out to consider actions taken by workers and others in the workplace. These empirical research findings were used to develop the theme of Primary and Secondary interventions intended to change behaviours, and to confirm assumptions about what small firms currently do to manage health and safety risks. Guidance for small firms was developed as a Secondary intervention tool to support Primary interventions, such as inspection or insurance provision.

An exploratory study of the role of trust in medication management within mental health services

Objective - To develop understandings of the nature and influence of trust in the safe management of medication within mental health services. Setting - Mental health services in the UK. Method - Qualitative methods were applied through focus groups across three different categories of service user—older adult, adults living in the community and forensic services. An inductive thematic analysis was carried out, using the method of constant comparison derived from grounded theory. Main Outcome - Measure Participants’ views on the key factors influencing trust and the role of trust in safe medication management. Results - The salient factors impacting trust were: the therapeutic relationship; uncertainty and vulnerability; and social control. Users of mental health services may be particularly vulnerable to adverse events and these can damage trust. Conclusion - Safe management of medication is facilitated by trust. However, this trust may be difficult to develop and maintain, exposing service users to adverse events and worsening adherence. Practice and policy should be oriented towards developing trust.

Data envelopment analysis model for the appraisal and relative performance evaluation of nurses at an intensive care unit

The appraisal and relative performance evaluation of nurses are very important and beneficial for both nurses and employers in an era of clinical governance, increased accountability and high standards of health care services. They enhance and consolidate the knowledge and practical skills of nurses by identification of training and career development plans as well as improvement in health care quality services, increase in job satisfaction and use of cost-effective resources. In this paper, a data envelopment analysis (DEA) model is proposed for the appraisal and relative performance evaluation of nurses. The model is validated on thirty-two nurses working at an Intensive Care Unit (ICU) at one of the most recognized hospitals in Lebanon. The DEA was able to classify nurses into efficient and inefficient ones. The set of efficient nurses was used to establish an internal best practice benchmark to project career development plans for improving the performance of other inefficient nurses. The DEA result confirmed the ranking of some nurses and highlighted injustice in other cases that were produced by the currently practiced appraisal system. Further, the DEA model is shown to be an effective talent management and motivational tool as it can provide clear managerial plans related to promoting, training and development activities from the perspective of nurses, hence increasing their satisfaction, motivation and acceptance of appraisal results. Due to such features, the model is currently being considered for implementation at ICU. Finally, the ratio of the number DEA units to the number of input/output measures is revisited with new suggested values on its upper and lower limits depending on the type of DEA models and the desired number of efficient units from a managerial perspective.