Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study

Background: The harmonization of European health systems brings with it a need for tools to allow the standardized collection of information about medical care. A common coding system and standards for the description of services are needed to allow local data to be incorporated into evidence-informed policy, and to permit equity and mobility to be assessed. The aim of this project has been to design such a classification and a related tool for the coding of services for Long Term Care (DESDE-LTC), based on the European Service Mapping Schedule (ESMS). Methods: The development of DESDE-LTC followed an iterative process using nominal groups in 6 European countries. 54 researchers and stakeholders in health and social services contributed to this process. In order to classify services, we use the minimal organization unit or “Basic Stable Input of Care” (BSIC), coded by its principal function or “Main Type of Care” (MTC). The evaluation of the tool included an analysis of feasibility, consistency, ontology, inter-rater reliability, Boolean Factor Analysis, and a preliminary impact analysis (screening, scoping and appraisal). Results: DESDE-LTC includes an alpha-numerical coding system, a glossary and an assessment instrument for mapping and counting LTC. It shows high feasibility, consistency, inter-rater reliability and face, content and construct validity. DESDE-LTC is ontologically consistent. It is regarded by experts as useful and relevant for evidence-informed decision making. Conclusion: DESDE-LTC contributes to establishing a common terminology, taxonomy and coding of LTC services in a European context, and a standard procedure for data collection and international comparison.

Audit and comprehensive health assessment programme in the primary healthcare of adults with intellectual disability: a pilot study

International research has demonstrated significant shortcomings in the health of adults with intellectual disability (ID). Because general practitioners (GPs) are the main providers of primary healthcare for this population, strategies to improve general practice care are an important aspect of rectifying these shortcomings. The present pilot study aimed to determine the effect of various interventions on health maintenance activities and to assess their acceptability to GPs, with a view to informing larger scale studies. The GPs were recruited through an earlier questionnaire-based postal survey. The GPs identified all their adult patients with ID, then obtained consent for participation from three patients randomly selected by the investigators. The GPs completed two self-evaluation forms and case note audits 12 months apart, read a synopsis of the relevant literature provided by the researchers, and completed a comprehensive health assessment (CHA) of their three patients. Forty-five GPs agreed to participate in the CHA programme (CHAP), and 15 completed the project. Thirty-eight patients completed the project. The number of patient-GP dyads who completed the project was too small to demonstrate statistically significant changes in health issues over time. The GPs found that the synopsis of the literature was the best intervention for increasing knowledge and was also the most practical to use in general practice. The CHAP was the intervention that prompted the most action from the GP which would not have been undertaken otherwise. The CHAP appeared to provide a superior review process compared to the other interventions used in the present study. The numbers of health maintenance activities found to be overdue and the number of health issues detected as a result of the process were considerable. The CHAP served as a communication tool and an educative instrument, providing a basis for future studies and strategies to improve the general practice care of adults with ID.

The hospital survey on patient safety culture in Portuguese hospitals: instrument validity and reliability

Purpose – Quantitative instruments to assess patient safety culture have been developed recently and a few review articles have been published. Measuring safety culture enables healthcare managers and staff to improve safety behaviours and outcomes for patients and staff. The study aims to determine the AHRQ Hospital Survey on Patient Safety Culture (HSPSC) Portuguese version's validity and reliability. Design/methodology/approach – A missing-value analysis and item analysis was performed to identify problematic items. Reliability analysis, inter-item correlations and inter-scale correlations were done to check internal consistency, composite scores. Inter-correlations were examined to assess construct validity. A confirmatory factor analysis was performed to investigate the observed data's fit to the dimensional structure proposed in the AHRQ HSPSC Portuguese version. To analyse differences between hospitals concerning composites scores, an ANOVA analysis and multiple comparisons were done. Findings – Eight of 12 dimensions had Cronbach's alphas higher than 0.7. The instrument as a whole achieved a high Cronbach's alpha (0.91). Inter-correlations showed that there is no dimension with redundant items, however dimension 10 increased its internal consistency when one item is removed. Originality/value – This study is the first to evaluate an American patient safety culture survey using Portuguese data. The survey has satisfactory reliability and construct validity.

Emancipatory practices of nurses in primary health care: the home visit as an instrument of health needs assessment

Objective Identify nurses’ emancipatory practices in primary care, to contribute to the improvement of health care. Method A case study type social research of qualitative nature, in which nurses of a primary health care service unit in São Paulo were interviewed. Results The home visit was identified as a nursing practice possible to be expanded in order to identify social determinants of health, triggering emancipatory practices in the service. This expansion occurred because the design of health care labour intended by the service team changed its focus from the traditional object of health services, the disease. Conclusion First, it is advocated that social policies lead projects with the purpose of improving health needs. On the other hand, the daily labour needs to provide opportunities for reflection and discussion of healthcare projects, leading workers to propose labour-processes targeted to both the social determinants of health and people’s illness.

Adherence to best care practices in normal birth: construction and validation of an instrument

Abstract OBJECTIVE To describe the stages of construction and validation of an instrument in order to analyze the adherence to best care practices during labour and birth. METHOD Methodological research, carried out in three steps: construction of dimensions and items, face and content validity and semantic analysis of the items. RESULTS The face and content validity was carried out by 10 judges working in healthcare, teaching and research. Items with Content Validity Index (CVI) ≥ 0.9 were kept in full or undergone revisions as suggested by the judges. Semantic analysis, performed twice, indicated that there was no difficulty in understanding the items. CONCLUSION The instrument with three dimensions (organization of healthcare network to pregnancy and childbirth, evidence-based practices and work processes) followed the steps recommended in the literature, concluded with 50 items and total CVI of 0.98.

Statewide Assessment Instrument, June 15, 2010

The Iowa Department of Human Services (IDHS) has responsibility for Iowa’s child welfare system. Iowa’s child welfare system focuses on children that have been or are at risk of being abused or neglected, as well as children that are determined by the Juvenile Court to be a child in need of assistance (CINA). The child welfare system is focused on three major results that are safety, permanency, and child and family well-being.

Development and initial validation of the Parental PELICAN Questionnaire (PaPEQu) - an instrument to assess parental experiences and needs during their child's end-of-life care.

AIM: To develop and test the Parental PELICAN Questionnaire, an instrument to retrospectively assess parental experiences and needs during their child's end-of-life care. BACKGROUND: To offer appropriate care for dying children, healthcare professionals need to understand the illness experience from the family perspective. A questionnaire specific to the end-of-life experiences and needs of parents losing a child is needed to evaluate the perceived quality of paediatric end-of-life care. DESIGN: This is an instrument development study applying mixed methods based on recommendations for questionnaire design and validation. METHOD: The Parental PELICAN Questionnaire was developed in four phases between August 2012-March 2014: phase 1: item generation; phase 2: validity testing; phase 3: translation; phase 4: pilot testing. Psychometric properties were assessed after applying the Parental PELICAN Questionnaire in a sample of 224 bereaved parents in April 2014. Validity testing covered the evidence based on tests of content, internal structure and relations to other variables. RESULTS: The Parental PELICAN Questionnaire consists of approximately 90 items in four slightly different versions accounting for particularities of the four diagnostic groups. The questionnaire's items were structured according to six quality domains described in the literature. Evidence of initial validity and reliability could be demonstrated with the involvement of healthcare professionals and bereaved parents. CONCLUSION: The Parental PELICAN Questionnaire holds promise as a measure to assess parental experiences and needs and is applicable to a broad range of paediatric specialties and settings. Future validation is needed to evaluate its suitability in different cultures.

Ressources résidentielles pour adultes avec un trouble mental : développement d'un modèle et d'un instrument de mesure

Ce projet de recherche revisite la conceptualisation du logement et des ressources résidentielles pour les adultes avec un trouble mental. Les objectifs visent : (1) à identifier les attributs, dimensions et domaines ; (2) à développer un nouveau modèle ; (3) à concevoir un instrument de mesure pour décrire l’éventail des ressources résidentielles en santé mentale. Méthodologie : Phase 1: Le devis de recherche s’articule autour de la cartographie de concepts, caractérisée par une méthodologie mixte. L’échantillonnage, par choix raisonné, a permis de recueillir une pluralité de perceptions et d’expériences (p.ex. personnes utilisatrices de services, proches, responsables de ressources résidentielles, gestionnaires). Les participants proviennent de cinq régions du Québec (nombre total de participations = 722). Au cours des six étapes de la cartographie de concepts, les participants ont généré des attributs décrivant le logement (n = 221), leur ont accordé une cote numérique (n = 416) et les ont regroupés en catégories (n = 73). Douze participants ont interprété des cartes conceptuelles produites par des analyses multivariées, soit l’échelonnage multidimensionnel (MDS) et la typologie hiérarchique. Des analyses par composantes principales (PCAs) ont été utilisées pour raffiner la conceptualisation (n = 228). Phase II: L’instrument a été développé, utilisé et ajusté à la suite de deux groupes de discussions (n = 23) et d’une étude transversale auprès de ressources résidentielles (n = 258). La passation se fait via une entrevue téléphonique semi-structurée enregistrée, d’une durée moyenne de 130 minutes. Résultats : Les participants ont généré 1382 idées (99.5% de saturation). Les cartes conceptuelles issues de la cartographie de concepts comprennent 140 idées (attributs du logement), 12 dimensions et cinq domaines (indice de stress MDS = 0.2302, 10 itérations). Les analyses PCAs ont permis de retenir quatre domaines, 11 composantes (α = 0.600 à 0.933) et 81 attributs. Les domaines sont : (1) environnement géophysique; (2) atmosphère et fonctionnement du milieu; (3) soutien et interventions offerts; (4) pratiques organisationnelles et managériales. L’instrument développé comprend quatre domaines, 10 dimensions et 83 attributs. À cela s’ajoutent des variables descriptives. L’instrument résulte des Phases I et II de ce projet. Conclusion : L’instrument a été développé en collaboration avec diverses parties prenantes, à partir de considérations ontologiques, réalistes, causales et statistiques. Il dresse le profil détaillé d’une ressource résidentielle sous ses différentes facettes et s’appuie sur la prémisse qu’il n’existe pas de milieu résidentiel idéal pour tous.

Metoder och instrument för att mäta följsamheten till hygienföreskrifter : En litteraturöversikt

Syfte: Att genom vetenskaplig litteratur beskriva vilka metoder och instrument somanvänds inom hälso- och sjukvård för att mäta följsamheten tillhygienföreskrifter.Metod: Föreliggande studie har genomförts som en litteraturöversikt. Artiklar söktes viaCinahl, PubMed och Web Of Science.Resultat: Resultatet grundar sig på 14 artiklar. Fem kategorier av metoder beskrevs, medtio tillhörande instrument. I tio av studierna användes manuell observation sommätmetod. Två studier tog upp provtagning på ytor (ATP-mätning) för attutvärdera städrutiner. Även elektronisk observation, självskattning samt intervjubeskrevs. Instrumenten som beskrevs var fyra typer av observationsformulär, tvåtyper av ATP-mätare, två typer av enheter som registrerar elektroniska signaler,ett intervjuformulär samt ett självskattningsformulär.Slutsats: Att mäta följsamheten till hygienregler behöver inte vara svårt eller kostsamt,men kan hjälpa oss i arbetet mot en högre patientsäkerhet. Mätningar kan ge ossen bild av våra svaga punkter i följsamhet till hygienregler. I och med attsynliggöra svagheterna kan vi också arbeta med att förbättra dem.

Validity evidence and reliability of a Simulated Patient Feedback Instrument

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Use of cognitive interviewing in the development of a Spanish language genetic knowledge instrument

Study purpose. Genetic advances are significantly impacting healthcare, yet recent studies of ethnic group participation in genetic services demonstrate low utilization rates by Latinos. Limited genetic knowledge is a major barrier. The purpose of this study was to field test items in a Spanish-language instrument that will be used to measure genetic knowledge relevant to type 2 diabetes among members of the ethnically heterogeneous U.S. Latino community. Accurate genetic knowledge measurement can provide the foundation for interventions to enhance genetic service utilization. ^ Design. Three waves of cognitive interviews were conducted in Spanish to field test 44 instrument items Thirty-six Latinos, with 12 persons representative of Mexican, Central and South American, and Cuban heritage participated, including 7 males and 29 females between 22 and 60 years of age; 17 participants had 12 years or less of education. ^ Methods. Text narratives from transcriptions of audiotaped interviews were qualitatively analyzed using a coding strategy to indicate potential sources of response error. Through an iterative process of instrument refinement, codes that emerged from the data were used to guide item revisions at the conclusion of each phase; revised items were examined in subsequent interview waves. ^ Results. Inter-cultural and cross-cultural themes associated with difficulties in interpretation and grammatical structuring of items were identified; difficulties associated with comprehension reflected variations in educational level. Of the original 44 items, 32 were retained, 89% of which were revised. Six additional items reflective of cultural knowledge were constructed, resulting in a 38-item instrument. ^ Conclusions. Use of cognitive interviewing provided a valuable tool for detecting both potential sources of response error and cultural variations in these sources. Analysis of interview data guided successive instrument revisions leading to improved item interpretability and comprehension. Although testing in a larger sample will be essential to test validity and reliability, the outcome of field testing suggests initial content validity of a Spanish-language instrument to measure genetic knowledge relative to type 2 diabetes. ^ Keywords. Latinos, genetic knowledge, instrument development, cognitive interviewing ^

Development of ``HealthServe'': A measure of customer service orientation in healthcare

An assessment tool designed to measure a customer service orientation among RN's and LPN's was developed using a content-oriented approach. Critical incidents were first developed by asking two samples of healthcare managers (n = 52 and 25) to identify various customer-contact situations. The critical incidents were then used to formulate a 121-item instrument. Patient-contact workers from 3 hospitals (n = 102) completed the instrument along with the NEO-FFI, a measure of the Big Five personality factors. Concurrently, managers completed a performance evaluation scale on the employees participating in the study in order to determine the predictive validity of the instrument.^ Through a criterion-keying approach, the instrument was scaled down to 38 items. The correlation between HealthServe and the supervisory ratings of performance evaluation data supported the instrument's criterion-related validity (r =.66, p $<$.0001). Incremental validity of HealthServe over the Big Five was found with HealthServe accounting for 46% of the variance.^ The NEO-FFI was used to assess the correlation between personality traits and HealthServe. A factor analysis of HealthServe suggested 4 factors which were correlated with the NEO-FFI scores. Results indicated that HealthServe was related to Extraversion, Openness to Experience, Agreeableness, Conscientiousness and negatively related to Neuroticism.^ The benefits of the test construction procedure used here over the use of broad-based measures of personality were discussed as well as the limitations of using a concurrent validation strategy. Recommendations for future studies were provided. ^

Chemotherapy patient perception regarding communication with the healthcare staff

Purpose: To qualitatively explore the communication between healthcare professionals and oncology patients based on the perception of patients undergoing chemotherapy.Method: Qualitative and exploratory design. Participants were 14 adult patients undergoing chemotherapy at different stages of the disease. A socio-demographic and clinical data form was utilized along with semi-structured interviews. The interviews were audio-recorded, transcribed and content analysis was performed. Two independent judges evaluated the interview content in regards to emerging categories and obtained a Kappa index of 0.834.Results: Three categories emerged from the data: 1) Technical communication without emotional support, in which the information provided is composed of strictly technical information regarding the diagnosis, treatment and/or prognosis; 2) Technical communication, in which the information provided is oriented towards the technical aspects of the patient’s physical condition, while also providing psychological support for the patients’ subjective needs; and 3) Insufficient technical communication, win which there are gaps in the information provided causing confusion and suffering to the patient.Conclusions: Communication with emotional support contributes to greater satisfaction of chemotherapy patients. Practical implications: the results provide elements for the training of healthcare professionals regarding the importance of the emotional support that can be offered to cancer patients during their treatment.

Discrete-event Simulation and Optimization to Improve the Performance of a Healthcare System

Thesis (Ph.D.)--University of Washington, 2016-08

Satisfaction with the healthcare provided of women who had undergone a mastectomy

Abstract Introduction: Breast cancer is the most common form of cancer among women worldwide and, therefore, deserves the highest attention and assistance from medical services. Considering patients’ satisfaction as an indication of healthcare quality, women who have undergone a mastectomy will assess the medical care received. This assessment will be based on what is expected from that medical care and on the expected improvement of her health condition. . Objective: To determine the level of satisfaction of women who have undergone a mastectomy with the medical care provided by nurses, doctors and by the way hospital services are organized. Design: A descriptive and cross-sectional study, developed in Portugal. Participants: A non-probabilistic sample formed by 153 women who underwent a mastectomy with an average age of 55, married (67.3%), unemployed (56.2%), living in a rural area (71.2%) and living on minimum wage (54.9%). Measurement instrument: European Organization for Research and Treatment of Cancer (EORTC) IN-PATSAT32 questionnaire. Results: 113 (73.85%) of the 153 women are satisied with the medical care provided and 40 (26.14%) of them show their lack of satisfaction. A highly signiicant percentage of women (49.01%) feel fairly satisied with the medical care provided by nurses and with the way services are organized (37.9). On the other hand (37.9%) show their dissatisfaction towards doctors. The family network proved to be a predictor of the satisfaction with doctors (β = 0.163; P = .044) and the period of hospitalization predicts the satisfaction with the organization (β = 0.171; P = .011). Both predictors will be useful to explain the 3% variability in patients’ satisfaction. Conclusions: Monitoring the satisfaction with the medical care received is a fundamental strategy to promote the well-being of women who underwent a mastectomy.