5 resultados para inter-rater reliability
em DigitalCommons@The Texas Medical Center
Resumo:
BACKGROUND: Our objective was to analyze subjective explanations for unsuccessful weight loss among bariatric surgery candidates. METHODS: This was a retrospective analysis of 909 bariatric surgery candidates (78.2% female, average body mass index [BMI] 47.3) at a university center from 2001 to April 2007 who answered an open-ended question about why they were unable to lose weight. We generated a coding scheme for answers to the question and established inter-rater reliability of the coding process. Associations with demographic parameters and initial BMI were tested. RESULTS: The most common categories of answers were nonspecific explanations related to diet (25.3%), physical activity (21.0%), or motivation (19.7%), followed by diet-related motivation (12.7%) and medical conditions or medications affecting physical activity (12.7%). Categories related to time, financial cost, social support, physical environment, and knowledge occurred in less than 4% each. Men were more likely than women to cite a medical condition or medication affecting physical activity (19.2% vs 10.8%, P = 0.002, odds ratio [OR] = 1.96, 95% confidence interval [CI] = 1.28-2.99) but less likely to cite diet-related motivation (7.1% vs 14.2%, P = 0.008, OR = 0.46, 95% CI = 0.26-0.82). CONCLUSIONS: Our findings suggest that addressing diet, physical activity, and motivation in a comprehensive approach would meet the stated needs of obese patients. Raising patient awareness of under-recognized barriers to weight loss, such as the physical environment and lack of social support, should also be considered. Lastly, anticipating gender-specific attributions may facilitate tailoring of interventions.
Resumo:
Critically ill and injured patients require pain relief and sedation to reduce the body's stress response and to facilitate painful diagnostic and therapeutic procedures. Presently, the level of sedation and analgesia is guided by the use of clinical scores which can be unreliable. There is therefore, a need for an objective measure of sedation and analgesia. The Bispectral Index (BIS) and Patient State Index (PSI) were recently introduced into clinical practice as objective measures of the depth of analgesia and sedation. ^ Aim. To compare the different measures of sedation and analgesia (BIS and PSI) to the standard and commonly used modified Ramsay Score (MRS) and determine if the monitors can be used interchangeably. ^ Methods. MRS, BIS and PSI values were obtained in 50 postoperative cardiac surgery patients requiring analgesia and sedation from June to December 2004. The MRS, BIS and PSI values were assessed hourly for up to 6-h by a single observer. ^ The relationship between BIS and PSI values were explored using scatter plots and correlation between MRS, BIS and PSI was determined using Spearman's correlation coefficient. Intra-class correlation (ICC) was used to determine the inter-rater reliability of MRS, BIS and PSI. Kappa statistics was used to further evaluate the agreement between BIS and PSI at light, moderate and deep levels of sedation. ^ Results. There was a positive correlation between BIS and PSI values (Rho = 0.731, p<0.001). Intra-class correlation between BIS and PSI was 0.58, MRS and BIS 0.43 and MRS and PSI 0.27. Using Kappa statistics, agreement between MRS and BIS was 0.35 (95% CI: 0.27–0.43) and for MRS and PSI was 0.21 (95% CI: 0.15–0.28). The kappa statistic for BIS and PSI was 0.45 (95% CI: 0.37–0.52). Receiver operating characteristics (ROC) curves constructed to detect undersedation indicated an area under the curve (AUC) of 0.91 (95% CI = 0.87 to 0.94) for the BIS and 0.84 (95% CI = 0.79 to 0.88) for the PSI. For detection of oversedation, AUC for the BIS was 0.89 (95% CI = 0.84 to 0.92) and 0.80 (95% CI = 0.75 to 0.85) for the PSI. ^ Conclusions. There is a statistically significant positive correlation between the BIS and PSI but poor correlation and poor test agreement between the MRS and BIS as well as MRS and PSI. Both the BIS and PSI demonstrated a high level of prediction for undersedation and oversedation; however, the BIS and PSI can not be considered interchangeable monitors of sedation. ^
Resumo:
In the United States, “binge” drinking among college students is an emerging public health concern due to the significant physical and psychological effects on young adults. The focus is on identifying interventions that can help decrease high-risk drinking behavior among this group of drinkers. One such intervention is Motivational interviewing (MI), a client-centered therapy that aims at resolving client ambivalence by developing discrepancy and engaging the client in change talk. Of late, there is a growing interest in determining the active ingredients that influence the alliance between the therapist and the client. This study is a secondary analysis of the data obtained from the Southern Methodist Alcohol Research Trial (SMART) project, a dismantling trial of MI and feedback among heavy drinking college students. The present project examines the relationship between therapist and client language in MI sessions on a sample of “binge” drinking college students. Of the 126 SMART tapes, 30 tapes (‘MI with feedback’ group = 15, ‘MI only’ group = 15) were randomly selected for this study. MISC 2.1, a mutually exclusive and exhaustive coding system, was used to code the audio/videotaped MI sessions. Therapist and client language were analyzed for communication characteristics. Overall, therapists adopted a MI consistent style and clients were found to engage in change talk. Counselor acceptance, empathy, spirit, and complex reflections were all significantly related to client change talk (p-values ranged from 0.001 to 0.047). Additionally, therapist ‘advice without permission’ and MI Inconsistent therapist behaviors were strongly correlated with client sustain talk (p-values ranged from 0.006 to 0.048). Simple linear regression models showed a significant correlation between MI consistent (MICO) therapist language (independent variable) and change talk (dependent variable) and MI inconsistent (MIIN) therapist language (independent variable) and sustain talk (dependent variable). The study has several limitations such as small sample size, self-selection bias, poor inter-rater reliability for the global scales and the lack of a temporal measure of therapist and client language. Future studies might consider a larger sample size to obtain more statistical power. In addition the correlation between therapist language, client language and drinking outcome needs to be explored.^
Resumo:
This study of the Behavior Assessment System for Children, Second Edition (BASC-2), had two objectives. First, was to compare the Strengths and Difficulties Questionnaire (SDQ) and the BASC-2. Participants were students from SBISD, identified as having difficulties, assessed with the BASC-2 and completed the SDQ. Based on the small sample (N=8), scores from the SDQ and the BASC-2 were found to correlate highly with one another on most conceptually similar scales. With both Parent and Teacher raters, diagnostic concordance was high for nearly all behavior and emotional problem scales. While the diagnostic concordance of the SDQ and BASC-2 looks promising, results need to be replicated with a larger sample. ^ The second objective was to assess the BASC-2 inter-informant concordance (parent, teacher and child). Participants were 145 students, 3-17 years, 78.6% male, 28% Hispanic, 37% White, 34% Black, and 64% were economically disadvantaged. Of the four dyads, teacher-teacher pairs had the highest correlations and agreement levels, especially on externalizing scale items, regardless of the subjects' age group, gender or ethnicity. ^ Overall, parent-teacher pairs had low to moderate concordance for most scale items, with slightly higher agreement for externalizing problems, with better concordance for preschool children, very low correlations with girls' ratings, but moderate correlations with boy ratings. Correlational results were generally moderate for teachers and parents of White children and low for teachers and parents of Hispanic and Black children. ^ Parent-child self-reports had low concordance for nearly all scale items evaluated, particularly with girl self-raters, but moderate with the boys. Conversely, Teacher-Girl pairs had larger correlations than with Boy. Parents reported substantially higher frequency of disorder endorsement than reported by the children, regardless of the child's ethnicity or gender. While generally low, Teachers and Black students had higher concordance on internalizing measures than Hispanic or White students. Parents of Black students had higher frequency of disorder endorsements than other ethnicities. ^ The difference in format and lack of externalizing measures on the self-report version (SRP) hinders inter-rater comparisons. Future studies using the revised, BASC-2 with children in a school-based setting are needed to assess further its rater reliability. ^
Resumo:
Background: Obesity is a major health problem in the United States that has reached epidemic proportions. With most U.S adults spending the majority of their waking hours at work, the influence of the workplace environment on obesity is gaining in importance. Recent research implicates worksites as providing an 'obesogenic' environment as they encourage overeating and reduce the opportunity for physical activity. Objective: The aim of this study is to describe the nutrition and physical activity environment of Texas Medical Center (TMC) hospitals participating in the Shape Up Houston evaluation study to develop a scoring system to quantify the environmental data collected using the Environmental Assessment Tool (EAT) survey and to assess the inter-observer reliability of using the EAT survey. Methods: A survey instrument that was adapted from the Environmental Assessment Tool (EAT) developed by Dejoy DM et al in 2008 to measure the hospital environmental support for nutrition and physical activity was used for this study. The inter-observer reliability of using the EAT survey was measured and total percent agreement scores were computed. Most responses on the EAT survey are dichotomous (Yes and No) and these responses were coded with a '0' for a 'no' response and a '1' for a 'yes' response. A summative scoring system was developed to quantify these responses. Each hospital was given a score for each scale and subscale on the EAT survey in addition to a total score. All analyses were conducted using Stata 11 software. Results: High inter-observer reliability is observed using EAT. The percentage agreement scores ranged from 94.4%–100%. Only 2 of the 5 hospitals had a fitness facility onsite and scores for exercise programs and outdoor facilities available for hospital employees ranged from 0–62% and 0–37.5%, respectively. The healthy eating percentage for hospital cafeterias range from 42%–92% across the different hospitals while the healthy vending scores were 0%–40%. The total TMC 'healthy hospital' score was 49%. Conclusion: The EAT survey is a reliable instrument for measuring the physical activity and nutrition support environment of hospital worksites. The study results showed a large variability among the TMC hospitals in the existing physical activity and nutrition support environment. This study proposes cost effective policy changes that can increase environmental support to healthy eating and active living among TMC hospital employees.^