Hospitalization in Geriatric Wards: Considerations on the Evaluation of the Outcome

Within a defined law framework, the Italian central health system dictates the standards for hospitalization to local care units, which are in turn allowed to establish their own effectiveness criteria. The appropriateness of the hospitalization decision is therefore predetermined at patients admission, whereas its effectiveness relies on the ex post patient well-being as a result of the complex system of reciprocal relations between patients and healthcare agents at the ward level. We consider the outcomes in geriatric wards referring to the national health system, with respect both to patients traits at the individual level and wards/hospital settings. The risk that models the healthcare outcome is accordingly adjusted for covariates at the different levels of analysis (Goldstein & Spiegelhalter, 1996), thus allowing to differentiate among outcomes in terms of the hospitalization structure and, when appropriate, of territorial aggregation.

Managing patient deterioration: evaluation of what works.

Background: Rapid Response Systems (RRS) have been implemented nationally and internationally to improve patient safety in hospital. However, to date the majority of the RRS research evidence has focused on measuring the effectiveness of the intervention on patient outcomes. To evaluate RRS it has been recommended that a multimodal approach is required to address the broad range of process and outcome measures required to determine the effectiveness of the RRS concept. Aim: The aim of this paper is to evaluate the official RRS programme theoretical assumptions regarding how the programme is meant to work against actual practice in order to determine what works. Methods: The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews with a purposive sample of 75 nurses and doctors, observation of ward practices and documentary analysis. The findings from the case studies were analysed and compared within and across cases to identify what works for whom and in what circumstances. Results: The RRS programme theories were critically evaluated and compared with study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of RRS implementation.  Conclusion:These findings highlight the combination of factors that can improve the implementation of RRS and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for their success and sustainability.References: 1.Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; LondonType of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

A realistic evaluation of track and trigger systems and acute care training for early recognition and treatment of deteriorating ward-based patients: research protocol.

Aim The aim of the study is to evaluate factors that enable or constrain the implementation and service delivery of early warnings systems or acute care training in practice. Background To date there is limited evidence to support the effectiveness of acute care initiatives (early warning systems, acute care training, outreach) in reducing the number of adverse events (cardiac arrest, death, unanticipated Intensive Care admission) through increased recognition and management of deteriorating ward based patients in hospital [1-3]. The reasons posited are that previous research primarily focused on measuring patient outcomes following the implementation of an intervention or programme without considering the social factors (the organisation, the people, external influences) which may have affected the process of implementation and hence measured end-points. Further research which considers the social processes is required in order to understand why a programme works, or does not work, in particular circumstances [4]. Method The design is a multiple case study approach of four general wards in two acute hospitals where Early Warning Systems (EWS) and Acute Life-threatening Events Recognition and Treatment (ALERT) course have been implemented. Various methods are being used to collect data about individual capacities, interpersonal relationships and institutional balance and infrastructures in order to understand the intended and unintended process outcomes of implementing EWS and ALERT in practice. This information will be gathered from individual and focus group interviews with key participants (ALERT facilitators, nursing and medical ALERT instructors, ward managers, doctors, ward nurses and health care assistants from each hospital); non-participant observation of ward organisation and structure; audit of patients' EWS charts and audit of the medical notes of patients who deteriorated during the study period to ascertain whether ALERT principles were followed. Discussion & progress to date This study commenced in January 2007. Ethical approval has been granted and data collection is ongoing with interviews being conducted with key stakeholders. The findings from this study will provide evidence for policy-makers to make informed decisions regarding the direction for strategic and service planning of acute care services to improve the level of care provided to acutely ill patients in hospital. References 1. Esmonde L, McDonnell A, Ball C, Waskett C, Morgan R, Rashidain A et al. Investigating the effectiveness of Critical Care Outreach Services: A systematic review. Intensive Care Medicine 2006; 32: 1713-1721 2. McGaughey J, Alderdice F, Fowler R, Kapila A, Mayhew A, Moutray M. Outreach and Early Warning Systems for the prevention of Intensive Care admission and death of critically ill patients on general hospital wards. Cochrane Database of Systematic Reviews 2007, Issue 3. www.thecochranelibrary.com 3. Winters BD, Pham JC, Hunt EA, Guallar E, Berenholtz S, Pronovost PJ (2007) Rapid Response Systems: A systematic review. Critical Care Medicine 2007; 35 (5): 1238-43 4. Pawson R and Tilley N. Realistic Evaluation. London; Sage: 1997

A realistic evaluation of Early Warning Systems and acute care training in Northern Ireland: findings and recommendations

Statement of purpose The purpose of this concurrent session is to present the main findings and recommendations from a five year study evaluating the implementation of Early Warning Systems (EWS) and the Acute Life-threatening Events: Recognition and Treatment (ALERT) course in Northern Ireland. The presentation will provide delegates with an understanding of those factors that enable and constrain successful implementation of EWS and ALERT in practice in order to provide an impetus for change. Methods The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. The stages included identifying the programme theories underpinning EWS and ALERT, generating hypotheses, gathering empirical evidence and refining the programme theories. This approach used a variety of mixed methods including individual and focus group interviews, observation and documentary analysis of EWS compliance data and ALERT training records. A within and across case comparison facilitated the development of mid-range theories from the research evidence. Results The official RRS theories developed from the realist synthesis were critically evaluated and compared with the study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of EWS and ALERT implementation. Each concept is presented as ‘context, mechanism and outcome configurations’ to provide an understanding of how the context impacts on individual reasoning or behaviour to produce certain outcomes. Conclusion These findings highlight the combination of factors that can improve the implementation and sustainability of EWS and ALERT and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for future policy development. References: 1. Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; London Type of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Protocol: A randomised controlled trial evaluation of Cancer Focus NI’s ‘Dead Cool’ smoking prevention programme in post-primary schools

This paper presents a research protocol for a randomised controlled efficacy trial of the ‘Dead Cool’ smoking prevention programme. Dead Cool is a three to four-hour programme designed to be used by teachers with Year 9 students in Northern Ireland. The main outcome of the programme is to prevent students from starting to smoke. The protocol reports a research design intended to test the efficacy of the programme in 20 post-primary school settings. Selected schools included those from secondary /grammar/integrated/single sex/coeducational, rural and urban schools from both the maintained and controlled state sector and independent sector schools. Outcome measures include self-reported behaviours, monitoring of carbon monoxide (CO) in exhaled breath and focus groups designed to assess implementation fidelity and opinions on efficacy in intervention schools and explore the ‘counterfactual’ potential treatments in control schools.

Essays in health economics: Volume-Outcome Effect, upcoding behaviour and the evaluation of a short-term intervention program

Evidence in the literature suggests a negative relationship between volume of medical procedures and mortality rates in the health care sector. In general, high-volume hospitals appear to achieve lower mortality rates, although considerable variation exists. However, most studies focus on US hospitals, which face different incentives than hospitals in a National Health Service (NHS). In order to add to the literature, this study aims to understand what happens in a NHS. Results reveal a statistically significant correlation between volume of procedures and better outcomes for the following medical procedures: cerebral infarction, respiratory infections, circulatory disorders with AMI, bowel procedures, cirrhosis, and hip and femur procedures. The effect is explained with the practice-makes-perfect hypothesis through static effects of scale with little evidence of learning-by-doing. The centralization of those medical procedures is recommended given that this policy would save a considerable number of lives (reduction of 12% in deaths for cerebral infarction).

Critical evaluation of outcome scales to assess outcome after lateral ankle ligament repair

Introduction: Several scores are commonly used to evaluate patients' postoperative satisfaction after lateral ankle ligament repair, including: AOFAS, FAAM, CAIT and CAIS. Comparing published studies in the literature is difficult, as the same patient can have markedly different results depending on which scoring system is used. The current study aims to address this gap in the literature by developing a system to compare these tests, to allow better analysis and comparison of published studies. Patients and methods: This is a retrospective cohort study of 47 patients following lateral ankle ligament repair using a modified Broström-Gould technique. All patients were operated between 2005 and 2010 by a single surgeon and followed the same post operative rehabilitation protocol. Six patients were excluded from the study because of concomitant surgery. Patients were assessed by an independent observer. We used the Pearson correlation coefficient to analyse the concordance of the scores, as well as scatter plots to assess the linear relationship between them. Results: A linear distribution between the scores was found when the results were analysed using scatter plots. We were thus able to use the Pearson correlation coefficient to evaluate the relationship between each of the different postoperative scores. The correlation was found to be above 0.5 in all cases except for the comparison between the CAIT and the FAAM for the activities of daily living (0.39). We were, therefore, able to compare the results obtained and assess the relative concordance of the scoring systems. The results showed that the more specific the scale is, the worst the score is and inversely. So the CAIT and the CAIS appeared to be more severe than the AOFAS and the FAAM measuring the activities of daily living. The sports subscale of the FAAM demonstrated intermediate results. Conclusion: This study outlines a system to compare different postoperative scores commonly used to evaluate outcome after ankle stabilization surgery. The impact of this study is that it makes comparison of published studies easier, even though they use a variety of different clinical scores, thus facilitating better outcome analysis of operative techniques.

Superior outcome of women with stage I/II cutaneous melanoma: pooled analysis of four European Organisation for Research and Treatment of Cancer phase III trials.

PURPOSE: Several studies observed a female advantage in the prognosis of cutaneous melanoma, for which behavioral factors or an underlying biologic mechanism might be responsible. Using complete and reliable follow-up data from four phase III trials of the European Organisation for Research and Treatment of Cancer (EORTC) Melanoma Group, we explored the female advantage across multiple end points and in relation to other important prognostic indicators. PATIENTS AND METHODS: Patients diagnosed with localized melanoma were included in EORTC adjuvant treatment trials 18832, 18871, 18952, and 18961 and randomly assigned during the period of 1984 to 2005. Cox proportional hazard models were used to calculate hazard ratios (HRs) and 95% CIs for women compared with men, adjusted for age, Breslow thickness, body site, ulceration, performed lymph node dissection, and treatment. RESULTS: A total of 2,672 patients with stage I/II melanoma were included. Women had a highly consistent and independent advantage in overall survival (adjusted HR, 0.70; 95% CI, 0.59 to 0.83), disease-specific survival (adjusted HR, 0.74; 95% CI, 0.62 to 0.88), time to lymph node metastasis (adjusted HR, 0.70; 95% CI, 0.51 to 0.96), and time to distant metastasis (adjusted HR, 0.69; 95% CI, 0.59 to 0.81). Subgroup analysis showed that the female advantage was consistent across all prognostic subgroups (with the possible exception of head and neck melanomas) and in pre- and postmenopausal age groups. CONCLUSION: Women have a consistent and independent relative advantage in all aspects of the progression of localized melanoma of approximately 30%, most likely caused by an underlying biologic sex difference.

Work values and the job characteristics - job outcome relationship

The importance and achievement of work values were found to be significant variables in the job characteristics-job outcome relationship when investigated with a sample of 117 correctional nurses. Data collected via mailed questionnaires were analyzed using Pearson correlation coefficients and stepwise multiple regression. The results indicated that the achievement of intrinsic work values was found to mediate the relationship between job characteristics and internal work motivation and satisfaction, adding considerable explained variance to each of the job outcomes. In addition, the importance of the same intrinsic work values moderated the overall relationship as well as the relationship between job characteristics and achievement of work values. The importance of work values did not, however, moderate the achievement of work values-job outcome relationship as predicted. The practical implications for correctional administrators and nurses, as well as implications for further research were discussed.

The development, assessment, and implementation of an evaluation of the EMPOWER Program at shelters for abused women /

The development, assessment, and implementation of a program evaluation instrument was carried out to evaluate the impact and efficacy of the EMPOWER Program. This intervention was created to educate residents at a shelter for abused women with an anticipated outcome of prevention. Participants included the staff and residents at 2 shelters in Southern Ontario. Client pre, post and follow-up measures were obtained and analyzed statistically and using keyword content analysis. A single staff measure was obtained and summarized using keyword content analysis. Qualitative results were suggestive of important change in participants. All women in the post and follow-up measures believed their participation in the EMPOWER Program provided them with the knowledge, skills, and confidence to avoid abusive relationships in the fliture. This transformational impact was repeatedly expressed in both resident and staff feedback. Limitations of this research, as well as suggestions for future study were discussed.

Top-down and Bottom-up influences on ACC activation: Evaluation of a proposed model of the feedback-related negativity

The Feedback-Related Negativity (FRN) is thought to reflect the dopaminergic prediction error signal from the subcortical areas to the ACC (i.e., a bottom-up signal). Two studies were conducted in order to test a new model of FRN generation, which includes direct modulating influences of medial PFC (i.e., top-down signals) on the ACC at the time of the FRN. Study 1 examined the effects of one’s sense of control (top-down) and of informative cues (bottom-up) on the FRN measures. In Study 2, sense of control and instruction-based (top-down) and probability-based expectations (bottom-up) were manipulated to test the proposed model. The results suggest that any influences of medial PFC on the activity of the ACC that occur in the context of incentive tasks are not direct. The FRN was shown to be sensitive to salient stimulus characteristics. The results of this dissertation partially support the reinforcement learning theory, in that the FRN is a marker for prediction error signal from subcortical areas. However, the pattern of results outlined here suggests that prediction errors are based on salient stimulus characteristics and are not reward specific. A second goal of this dissertation was to examine whether ACC activity, measured through the FRN, is altered in individuals at-risk for problem-gambling behaviour (PG). Individuals in this group were more sensitive to the valence of the outcome in a gambling task compared to not at-risk individuals, suggesting that gambling contexts increase the sensitivity of the reward system to valence of the outcome in individuals at risk for PG. Furthermore, at-risk participants showed an increased sensitivity to reward characteristics and a decreased response to loss outcomes. This contrasts with those not at risk whose FRNs were sensitive to losses. As the results did not replicate previous research showing attenuated FRNs in pathological gamblers, it is likely that the size and time of the FRN does not change gradually with increasing risk of maladaptive behaviour. Instead, changes in ACC activity reflected by the FRN in general can be observed only after behaviour becomes clinically maladaptive or through comparison between different types of gain/loss outcomes.

Essays in partial identification and applications to treatment effects and policy evaluation.

Dans cette thèse, je me suis interessé à l’identification partielle des effets de traitements dans différents modèles de choix discrets avec traitements endogènes. Les modèles d’effets de traitement ont pour but de mesurer l’impact de certaines interventions sur certaines variables d’intérêt. Le type de traitement et la variable d’intérêt peuvent être défini de manière générale afin de pouvoir être appliqué à plusieurs différents contextes. Il y a plusieurs exemples de traitement en économie du travail, de la santé, de l’éducation, ou en organisation industrielle telle que les programmes de formation à l’emploi, les techniques médicales, l’investissement en recherche et développement, ou l’appartenance à un syndicat. La décision d’être traité ou pas n’est généralement pas aléatoire mais est basée sur des choix et des préférences individuelles. Dans un tel contexte, mesurer l’effet du traitement devient problématique car il faut tenir compte du biais de sélection. Plusieurs versions paramétriques de ces modèles ont été largement étudiées dans la littérature, cependant dans les modèles à variation discrète, la paramétrisation est une source importante d’identification. Dans un tel contexte, il est donc difficile de savoir si les résultats empiriques obtenus sont guidés par les données ou par la paramétrisation imposée au modèle. Etant donné, que les formes paramétriques proposées pour ces types de modèles n’ont généralement pas de fondement économique, je propose dans cette thèse de regarder la version nonparamétrique de ces modèles. Ceci permettra donc de proposer des politiques économiques plus robustes. La principale difficulté dans l’identification nonparamétrique de fonctions structurelles, est le fait que la structure suggérée ne permet pas d’identifier un unique processus générateur des données et ceci peut être du soit à la présence d’équilibres multiples ou soit à des contraintes sur les observables. Dans de telles situations, les méthodes d’identifications traditionnelles deviennent inapplicable d’où le récent développement de la littérature sur l’identification dans les modèles incomplets. Cette littérature porte une attention particuliere à l’identification de l’ensemble des fonctions structurelles d’intérêt qui sont compatibles avec la vraie distribution des données, cet ensemble est appelé : l’ensemble identifié. Par conséquent, dans le premier chapitre de la thèse, je caractérise l’ensemble identifié pour les effets de traitements dans le modèle triangulaire binaire. Dans le second chapitre, je considère le modèle de Roy discret. Je caractérise l’ensemble identifié pour les effets de traitements dans un modèle de choix de secteur lorsque la variable d’intérêt est discrète. Les hypothèses de sélection du secteur comprennent le choix de sélection simple, étendu et généralisé de Roy. Dans le dernier chapitre, je considère un modèle à variable dépendante binaire avec plusieurs dimensions d’hétérogéneité, tels que les jeux d’entrées ou de participation. je caractérise l’ensemble identifié pour les fonctions de profits des firmes dans un jeux avec deux firmes et à information complète. Dans tout les chapitres, l’ensemble identifié des fonctions d’intérêt sont écrites sous formes de bornes et assez simple pour être estimées à partir des méthodes d’inférence existantes.

Evaluation of the agricultural vocational training programmes conducted by the Krishi Vigyan Kendras (Farm Science Centres) in Indian Punjab

Krishin Vigyan Kendras-KVKs (Farm Science Centres) have been established by the Indian Council of Agricultural Research in 569 districts. The trust areas of KVKs are refinement and demonstration of technologies, and training of farmers and extension functionaries. Imparting vocational trainings in agriculture and allied fields for the rural youth is one of its mandates. The study was undertaken to do a formative and summative (outcome and impact) evaluation of the beekeeping and mushroom growing vocational training programmes in the Indian state of Punjab. One-group pre and post evaluation design was employed for conducting a formative and outcome evaluation. The knowledge tests were administered to 35 beekeeping and 25 mushroom cultivation trainees, before and after the training programmes organized in 2004. The trainees significantly gained in knowledge. A separate sample of 640 trainees, trained prior to 2004, was selected for finding the adoption status. Out of 640, a sample of 200 was selected by proportionate sampling technique out of three categories, namely: non-adopters, discontinued-adopters and continued-adopters for evaluating the long-term impact of these training programmes. Ex-post-facto one-shot case study design was applied for this impact analysis. The vocational training programmes have resulted in continued-adoption of beekeeping and mushroom cultivation enterprises by 20% and 51% trained farmers, respectively. Age and trainee occupation had significant influence on the adoption decision of beekeeping vocation, whereas education and family income significantly affected the adoption decision of mushroom cultivation. The continued adopters of beekeeping and mushroom growing had increased their family income by 49% and 24%, respectively. These training programmes are augmenting the dwindling farm income of the farmers in Indian Punjab.