913 resultados para inter-rater reliability
Resumo:
Case linkage, the linking of crimes into series, is used in policing in the UK and other countries. Previous researchers have proposed using rapists' speech in this practice; however, researching this application requires the development of a reliable coding system for rapists' speech. A system was developed based on linguistic theories of pragmatics which allowed for the categorization of an utterance into a speech act type (e.g. directive). Following this classification, the qualitative properties of the utterances (e.g. the degree of threat it carried) could be captured through the use of rating scales. This system was tested against a previously developed system using 188 rapists' utterances taken from victims' descriptions of rape. The pragmatics-based system demonstrated higher inter-rater reliability whilst enabling the classification of a greater number of rapists' utterances. Inter-rater reliability for the subscales was also tested using a sub-sample of 50 rapists' utterances and inter-item correlations were calculated. Seventy-six per cent of the subscales had satisfactory to high inter-rater reliability. Based on these findings and the inter-item correlations, the classification system was revised. The potential use of this system for the practices of case linkage and offender profiling is discussed.
Resumo:
Background - This study investigates the coverage of adherence to medicine by the UK and US newsprint media. Adherence to medicine is recognised as an important issue facing healthcare professionals and the newsprint media is a key source of health information, however, little is known about newspaper coverage of medication adherence. Methods - A search of the newspaper database Nexis®UK from 2004–2011 was performed. Content analysis of newspaper articles which referenced medication adherence from the twelve highest circulating UK and US daily newspapers and their Sunday equivalents was carried out. A second researcher coded a 15% sample of newspaper articles to establish the inter-rater reliability of coding. Results - Searches of newspaper coverage of medication adherence in the UK and US yielded 181 relevant articles for each country. There was a large increase in the number of scientific articles on medication adherence in PubMed® over the study period, however, this was not reflected in the frequency of newspaper articles published on medication adherence. UK newspaper articles were significantly more likely to report the benefits of adherence (p = 0.005), whereas US newspaper articles were significantly more likely to report adherence issues in the elderly population (p = 0.004) and adherence associated with diseases of the central nervous system (p = 0.046). The most commonly reported barriers to adherence were patient factors e.g. poor memory, beliefs and age, whereas, the most commonly reported facilitators to adherence were medication factors including simplified regimens, shorter treatment duration and combination tablets. HIV/AIDS was the single most frequently cited disease (reported in 20% of newspaper articles). Poor quality reporting of medication adherence was identified in 62% of newspaper articles. Conclusion - Adherence is not well covered in the newspaper media despite a significant presence in the medical literature. The mass media have the potential to help educate and shape the public’s knowledge regarding the importance of medication adherence; this potential is not being realised at present.
Resumo:
Background: Pharmacogenetics is a rapidly growing field that aims to identify the genes that influence drug response. This science can be used as a powerful tool to tailor drug treatment to the genetic makeup of individuals. The present study explores the coverage of the topic of pharmacogenetics and its potential benefit in personalised medicine by the UK newsprint media. Methods: The LexisNexis database was used to identify and retrieve full text articles from the 10 highest circulation national daily newspapers and their Sunday equivalents in the UK. Content analysis of newspaper articles which referenced pharmacogenetic testing was carried out. A second researcher coded a random sample (21%) of newspaper articles to establish the inter-rater reliability of coding. Results: Of the 256 articles captured by the search terms, 96 articles (with pharmacogenetics as a major component) met the study inclusion criteria. The majority of articles over-stated the benefits of pharmacogenetic testing while paying less attention to the associated risks. Overall beneficial effects were mentioned 5.3 times more frequently than risks (p < 0.001). The most common illnesses for which pharmacogenetically based personalised medicine was discussed were cancer, cardiovascular disease and CNS diseases. Only 13% of newspaper articles that cited a specific scientific study mentioned this link in the article. There was a positive correlation between the size of the article and both the number of benefits and risks stated (P < 0.01). Conclusion: More comprehensive coverage of the area of personalised medicine within the print media is needed to inform public debate on the inclusion of pharmacogentic testing in routine practice.
Resumo:
This thesis extended previous research on critical decision making and problem solving by refining and validating a measure designed to assess the use of critical thinking and critical discussion in sociomoral dilemmas. The purpose of this thesis was twofold: 1) to refine the administration of the Critical Thinking Subscale of the CDP to elicit more adequate responses and for purposes of refining the coding and scoring procedures for the total measure, and 2) to collect preliminary data on the initial reliabilities of the measure. Subjects consisted of 40 undergraduate students at Florida International University. Results indicate that the use of longer probes on the Critical Thinking Subscale was more effective in eliciting adequate responses necessary for coding and evaluating the subjects performance. Analyses on the psychometric properties of the measure consisted of test-retest reliability and inter-rater reliability.
Resumo:
Technological advances combined with healthcare assistance bring increased risks related to patient safety, causing health institutions to be environments susceptible to losses in the provided care. Sectors of high complexity, such as Intensive Care Units have such characteristics highlighted due to being spaces designed for the care of patients in serious medical condition, when the use of advanced technological devices becomes a necessity. Thus, the aim of this study was to assess nursing care from the perspective of patient safety in intensive care units. This is an evaluative research, which combines various forms of data collection and analysis in order to conduct a deepened investigation. Data collection occurred in loco, from April to July 2014 in hospitals equipped with adult intensive care unit services. For this, a checklist instrument and semi-structured interviews conducted with patients, families, professionals were used in order to evaluate the structure-process-outcome triad. The instrument for nursing care assessment regarding Patient Safety included 97 questions related to structure and processes. Interviews provided data for outcome analysis. The selection of interviewees/participants was based on the willingness of potential participants. The following methods were used to collect data resulting from the instrument: statistical analysis of inter-rater reliability measure known as kappa (K); observations from judges resulting from the observation process; and added information obtained from the literature on the thematic. Data analysis from the interviews was carried out with IRAMUTEQ software, which used Descending Hierarchical Classification and Similarity analysis to aid in data interpretation. Research steps followed the ethical principles presented by Resolution No. 466 of December 12, 2012, and the results were presented in three manuscripts: 1) Evaluation of patient safety in Intensive Care Units: a focus on structure; 2) Health evaluation processes: a nursing care perspective on patient safety; 3) Patient safety in intensive care units: perception of nurses, family members and patients. The first article, related to the structure, refers to the use of 24 items of the employed instrument, showing that most of the findings were not aligned with the adequacy standards, which indicates poor conditions in structures offered in health services. The second article provides an analysis of the pillar of Processes, with the use of 73 items of the instrument, showing that 50 items did not meet the required standards for safe handling due to the absence of adequate scientific guidance and effective communication in nursing care process. For the third article, results indicate that intensive care units were safe places, yet urges for changes, especially in the physical structure and availability of materials and communication among professionals, patients and families. Therefore, our findings suggest that the nursing care being provided in the evaluated intensive care units contains troubling shortcomings with regards to patient safety, thereby evidencing an insecure setting for the assistance offered, in addition to a need for urgent measures to remedy the identified inadequacies with appropriate structures and implement protocols and care guidelines in order to consolidate an environment more favorable to patient safety.
Resumo:
Aims. To validate the Swedish version of the Sheffield Care Environment Assessment Matrix (S-SCEAM). The instrument’s items measure environmental elements important for supporting the needs of older people, and conceptualized within eight domains. Methods. Item relevance was assessed by a group of experts and measured using content validity index (CVI). Test-retest and inter-rater reliability tests were performed. The domain structure was assessed by the inter-rater agreement of a second group of experts, and measured using Fleiss kappa. Results. All items attained a CVI above 0.78, the suggested criteria for excellent content validity. Test-retest reliability showed high stability (96% and 95% for two independent raters respectively), and inter-rater reliability demonstrated high levels of agreement (95% and 94% on two separate rating occasions). Kappa values were very good for test-retest (κ = 0.903 and 0.869) and inter-rater reliability (κ = 0.851 and 0.832). Domain structure was good, Fleiss’ kappa was 0.63 (range 0.45 to 0.75). Conclusion. The S-SCEAM of 210 items and eight domains showed good content validity and construct validity. The instrument is suggested for use in measuring of the quality of the physical environment in residential care facilities for older persons.
Resumo:
Background and Objectives: Lack of insight is a cardinal feature of psychosis. Insight has been found to be a multidimensional concept, including awareness of having a mental illness, ability to relabel psychotic phenomena as abnormal and compliance with treatment., which can be measured with the Schedule for Assessment of Insight (SAI-E). The aim of this study was to validate the Spanish version of SAI-E. Methods: The SAI-E was translated into Spanish and back-translated into English, which was deemed appropriate by the original scale author. Next, the Spanish version of the SAI-E was administered to 39 patients with schizophrenia or schizoaffective disorder (DSM-IV criteria) from a North Peruvian psychiatric hospital. The Positive and Negative Syndrome Scale for Schizophrenia (PANSS) and the Scale of Unawareness of Mental Disorder (SUMD) were also administered. Specifically, internal consistency and convergent validity were assessed. Results: Internal consistency between the 11 items of the SAI-E was found to be good to excellent (α = 0.942). Compliance items did not contribute to internal consistency (A = 0.417, B = 572). Inter-rater reliability was excellent (ICC = 0.99). Regarding concurrent validity, the SAI-E total score correlated negatively with the lack of insight and judgement item of the PANNS (r = -0.91, p <0.01) and positively with the SUMD total score (r = 0.92, p <0.001). Conclusions: The Spanish version of the SAI-E scale was demonstrated to have both excellent reliability and external validity in our sample of South American Spanish-speaking patients with schizophrenia spectrum disorders.
Resumo:
Introduction: Free tissue transfer using an abdominal tissue flap is a commonly used method of breast reconstruction. However, there are well recognised complications including venous congestion, fat necrosis and flap loss associated with the perfusion of these flaps. Post-operative aesthetic outcome assessment of such breast reconstructions have also proven to be difficult with current methods displaying poor inter-rater reliability and patient correlation. The aim of this research was to investigate potential improvements to the post-operative outcome of free abdominal tissue transfer breast reconstruction by assessing the effects of vascular augmentation interventions on flap perfusion and to assess the use of real-time digital video as a post-operative assessment tool. Methods: An in-vivo pilot study carried out on 12 patients undergoing DIEP flap breast reconstruction assessed the effect on Zone IV perfusion, using LDI and ICG angiography, of vascular augmentation of the flap using the contralateral SIEA and SIEV. A further animal experimental study was carried out on 12 Sprague Dawley rats to assess the effects on main pedicle arterial blood flow and on Zone I and Zone IV perfusion of vascular augmentation of the abdominal flap using the contralateral vascular system. A separate post-operative assessment study was undertaken on 35 breast reconstruction patients who evaluated their own reconstructions via patient questionnaire and underwent photograph and real-time digital video capture of their reconstructions with subsequent panel assessment. Results: Our results showed that combined vascular augmentation of DIEP flaps, using both the SIEA and SIEV together, led to an increase in Zone IV perfusion. Vascular augmentation of the rat abdominal flaps also led to a significant increase in Zone I/IV perfusion, but the augmentation procedure resulted in a decreased main pedicle arterial blood flow. Our post-operative assessment study revealed that real-time digital video footage led to greater inter-rater agreement with regards to cosmesis and shape than photography and also correlated more with patient self-assessment. Conclusion: Vascular augmentation of abdominal free tissue flaps using the contralateral vascular system results in an increase to Zone IV perfusion, however this may lead to decreased main pedicle arterial blood flow. Real-time digital video is a valid post-operative aesthetic assessment method of breast reconstruction outcome and is superior to static photography when coupled with panel assessment.
Resumo:
Objective: The purpose of this study was to develop and test psychometric properties of a Mealtime Interaction Clinical Observation Tool (MICOT) that could be used to facilitate assessment and behavioural intervention in childhood feeding difficulties. Methods: Thematic analysis of four focus groups with feeding and behaviour experts identified the content and structure of the MICOT. Following refinement, inter-rater reliability was tested between three healthcare professionals. Results: Six themes were identified for the MICOT, which utilises a traffic-light system to identify areas of strength and areas for intervention. Despite poor inter-rater reliability, for which a number of reasons are postulated, some correlation between psychologists’ ratings was evident. Healthcare professionals liked the tool and reported that it could have good clinical utility. Conclusion: The study provides a promising first version of a clinical observation tool that facilitates assessment and behavioural intervention in childhood feeding difficulties.
Resumo:
•Objetivos: Se tradujo, adaptó y evaluaron las propiedades clinimétricas de la escala POSAS en pacientes con cicatrices hipertróficas (CHT) y queloides (CQ) cómo secuelas de quemadura, que fueron manejados con Z plastias en la Fundación del Quemado en Bogotá (Colombia), entre Junio de 2015 a Abril de 2016. •Métodos: Estudio de evaluación de las propiedades clinimétricas de una escala. Se hizo una traducción y adaptación transcultural siguiendo el método de traducción-retrotraducción. Se aplicó el instrumento adaptado a cincuenta y dos pacientes (n=52) antes y después de la intervención quirúrgica. Se evaluó la validez, confiabilidad, sensibilidad al cambio y la utilidad de la escala. •Resultados: Se hallaron diferencias significativas en los puntajes obtenidos del Observador y del Paciente, antes y después de la intervención quirúrgica (p<0.000); a excepción de prurito. La escala POSAS demostró ser altamente confiable para la Escala del Observador y del Paciente (α = 0.912 y 0.765). Hubo alta correlación en las evaluaciones de dos observadores para las variables ordinales de la Escala del Observador (r>0.6). La concordancia entre las evaluaciones de dos observadores para las variables categóricas de la Escala del Paciente fue buena para la evaluación antes de la intervención para pigmentación y relieve (κ>0.61). Se demostró que el instrumento es capaz de detectar cambios clínicos en el tiempo (p<0.0000), a excepción de prurito (p= 0.271). •Conclusiones: La escala POSAS demostró ser un instrumento válido, confiable y útil para evaluar la calidad de la cicatriz en pacientes con CHT y CQ cómo secuelas de quemadura.
Resumo:
Research on outcomes from psychiatric disorders has highlighted the importance of expressed emotion (EE), but its cost-effective measurement remains a challenge. This article describes development of the Family Attitude Scale (FAS), a 30-item instrument that can be completed by any informant. Its psychometric characteristics are reported in parents of undergraduate students and in 70 families with a schizophrenic member. The total FAS had high internal consistency in all samples, and reports of angry behaviour in FAS items showed acceptable inter-rater agreement. The FAS was associated with the reported anger, anger expression and anxiety of respondents. Substantial associations between the parents' FAS and the anger and anger expression of students was also observed. Parents of schizophrenic patients had higher FAS scores than parents of students, and the FAS was higher if disorder duration was longer or patient functioning was poorer. Hostility, high criticism and low warmth on the Camberwell Family Interview (CFI) were associated with a more negative FAS. The highest FAS in the family was a good predictor of a highly critical environment on the CFI. The FAS is a reliable and valid indicator of relationship stress and expressed anger that has wide applicability.
Resumo:
This study aimed to evaluate the reliability of Neupsilin Brief Neuropsychological Assessment Instrument, a brief battery developed in Brazil. Hundred two Brazilian man and women participated, from 18 to 40 years of age. It was evaluated the test-retest reliability of the Neupsilin tasks and the reliability of the correction of the constructional praxis task by different evaluators. The data were analyzed by Spearman’s correlation, intraclass correlation and Cronbach’s alpha. Language, memory, praxis and executive functions presented the highest correlations in the test-retest analyses. The agreement in the correction of the constructional praxis task was moderate to high. The results indicate temporal reliability of Neupsilin tasks and inter-rater agreement in the correction of the constructional praxis task. Suggestions to improve the tasks, the validity and reliability of Neupsilin were presented.
Resumo:
This paper describes the development and evaluation of a new instrument - the Clinician Suicide Risk Assessment Checklist (CSRAC). The instrument assesses the clinician's competency in three areas: clinical interviewing, assessment of specific suicide risk factors, and formulating a management plan. A draft checklist was constructed by integrating information from 1) literature review 2) expert clinician focus group and 3) consultation with experts. It was utilised in a simulated clinical scenario with clinician trainees and a trained actor in order to test for inter-rater agreement. Agreement was calculated and the checklist was re-drafted with the aim of maximising agreement. A second phase of simulated clinical scenarios was then conducted and inter-rater agreement was calculated for the revised checklist. In the first phase of the study, 18 of 35 items had inadequate inter-rater agreement (60%>), while in the second phase, using the revised version, only 3 of 39 items failed to achieve adequate inter-rater agreement. Further evidence of reliability and validity are required. Continued development of the CSRAC will be necessary before it can be utilised to assess the effectiveness of risk assessment training programs.
Resumo:
BACKGROUND: Conjunctival ultraviolet autofluorescence (UVAF) photography was developed to detect and characterise pre-clinical sunlight-induced UV damage. The reliability of this measurement and its relationship to outdoor activity are currently unknown. METHODS: 599 people aged 16-85 years in the cross-sectional Norfolk Island Eye Study were included in the validation study. 196 UVAF individual photographs (49 people) and 60 UVAF photographs (15 people) of Norfolk Island Eye Study participants were used for intra- and inter-observer reliability assessment, respectively. Conjunctival UVAF was measured using UV photography. UVAF area was calculated using computerised methods by one grader on two occasions (intra-observer analysis) or two graders (inter-observer analysis). Outdoor activity category, during summer and winter separately, was determined with a UV questionnaire. Total UVAF equalled the area measured in four conjunctival areas (nasal/temporal conjunctiva of right and left eyes). RESULTS: Intra-observer (ρ_c=0.988, 95% CI 0.967 to 0.996, p<0.001), and inter-observer concordance correlation coefficients (ρ_c=0.924, 95% CI 0.870 to 0.956, p<0.001) of total UVAF exceeded 0.900. When grouped according to 10 mm(2) total UVAF increments, intra- and inter-observer reliability was very good (κ=0.81) and good (κ=0.71), respectively. Increasing time outdoors was strongly with increasing total UVAF in summer and winter (p(trend) <0.001). CONCLUSION: Intra- and inter-observer reliability of conjunctival UVAF is high. In this population, UVAF correlates strongly with the authors' survey-based assessment of time spent outdoors.
Resumo:
Background High-risk foot complications such as neuropathy, ischaemia, deformity, infections, ulcers and amputations consume considerable health care resources and typically result from chronic diseases. This study aimed to develop and test the validity and reliability of a Queensland High Risk Foot Form (QHRFF) tool. Methods Phase one involved developing a QHRFF using an existing diabetes high-risk foot tool, literature search, expert panel and several state-wide stakeholder groups. Phase two tested the criterion-related validity along with inter- and intra-rater reliability of the final QHRFF. Three cohorts of patients (n = 94) and four clinicians, representing different levels of expertise, were recruited. Validity was determined by calculating sensitivity, specificity and positive predictive values (PPV). Kappa and intra-class correlation (ICC) statistics were used to establish reliability. Results A QHRFF tool containing 46-items across seven domains was developed and endorsed. The majority of QHRFF items achieved moderate-to-perfect validity (PPV = 0.71 – 1) and reliability (Kappa/ICC = 0.41 – 1). Items with weak validity and/or reliability included those identifying health professionals previously attending the patient, other (non-listed) co-morbidity, previous foot ulcer, foot deformity, optimum offloading and optimum footwear. Conclusions The QHRFF had moderate-to-perfect validity and reliability across the majority of items, particularly identifying individual co-morbidities and foot complications. Items with weak validity or reliability need to be re-defined or removed. Overall, the QHRFF appears to be a valid and reliable tool to assess, collect and measure clinical data pertaining to high-risk foot complications for clinical or research purposes.