116 resultados para Inter-rater reliability


Relevância:

100.00% 100.00%

Publicador:

Resumo:

Context: Electronic bibliographic databases are a key source for professional publications about social work and community care more generally. This article describes and evaluates a method of identifying relevant articles as part of a systematic review of research evidence. Decision making about institutional and home care services for older people is used as an example. Method: Four databases (Social Science Citation Index, Medline, CINAHL, and Caredata) that abstract publications relevant to health and social services were searched systematically to identify relevant research studies. The items retrieved were appraised independently using a standard form developed for the purpose. The searches were compared in terms of sensitivity, precision, overlap between databases, and inter-rater reliability. Results: The search retrieved 525 articles, of which 276 were relevant. The four databases retrieved 55%, 41%, 19%, and 1% of the relevant articles respectively, achieving these sensitivities with precision levels of 54%, 48%, 84% and 94%. The databases retrieved 116, 73, 24 and 15 unique relevant articles respectively, showing the need to use a range of databases. Discussion: A general approach to creating a search to retrieve relevant research has been developed. The development of an international, indexed database dedicated to literature relevant to social services is a priority to enable progress in evidence-based policy and practice in social work. Editors and researchers should consider using structured abstracts in order to improve the retrieval and dissemination of research.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

Background: This study investigates the coverage of adherence to medicine by the UK and US newsprint media. Adherence to medicine is recognised as an important issue facing healthcare professionals and the newsprint media is a key source of health information, however, little is known about newspaper coverage of medication adherence.

Methods. A search of the newspaper database Nexis®UK from 2004-2011 was performed. Content analysis of newspaper articles which referenced medication adherence from the twelve highest circulating UK and US daily newspapers and their Sunday equivalents was carried out. A second researcher coded a 15% sample of newspaper articles to establish the inter-rater reliability of coding.

Results: Searches of newspaper coverage of medication adherence in the UK and US yielded 181 relevant articles for each country. There was a large increase in the number of scientific articles on medication adherence in PubMed® over the study period, however, this was not reflected in the frequency of newspaper articles published on medication adherence. UK newspaper articles were significantly more likely to report the benefits of adherence (p = 0.005), whereas US newspaper articles were significantly more likely to report adherence issues in the elderly population (p = 0.004) and adherence associated with diseases of the central nervous system (p = 0.046). The most commonly reported barriers to adherence were patient factors e.g. poor memory, beliefs and age, whereas, the most commonly reported facilitators to adherence were medication factors including simplified regimens, shorter treatment duration and combination tablets. HIV/AIDS was the single most frequently cited disease (reported in 20% of newspaper articles). Poor quality reporting of medication adherence was identified in 62% of newspaper articles.

Conclusion: Adherence is not well covered in the newspaper media despite a significant presence in the medical literature. The mass media have the potential to help educate and shape the public's knowledge regarding the importance of medication adherence; this potential is not being realised at present. © 2013 Goodfellow et al.; licensee BioMed Central Ltd.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

Purpose
Music has historically aided health and loss-adaptation, however, cancer patients’ experience of music for self-care is not well understood. This study examines adult cancer patients’ views about music’s role before and after diagnosis.
Methods
Constructivist approach, with grounded theory informed design using convenience, snowball and theoretical sampling. Patients from Australian metropolitan cancer and hospice settings completed demographic questionnaires and participated in semi-structured interviews. Qualitative inter-rater reliability was applied.
Results
Fifty-two patients reported comparable time spent experiencing music pre-post diagnosis. Music may remain incidental; however, many patients adapt music usage to ameliorate cancer’s aversive effects. Patients often draw from their musical lives and explore unfamiliar music to: remain connected with pre-illness identities; strengthen capacity for enduring treatment, ongoing survival (even when knowing “you’re going to die”), or facing death; reframe upended worlds; and live enriched lives. Patients can ascribe human or physical properties to music when describing its transformative effects. Familiar lyrics maybe reinterpreted, and patients’ intensified emotional reactions to music can reflect their threatened mortality. Sometimes music becomes inaccessible, elusive, and/or intensifies distress and is avoided. Families’, friends’ and professionals’ recognition of patients’ altered musical lives and music-based suggestions can extend patients’ use of music for self-care.
Conclusion
Health professionals can support patients by inquiring about their music behaviours and recognising that altered music usage may signify vulnerability. Although commonly recommended, hospital concerts and music broadcasts need sensitive delivery. Patients’ preferred music should be available in diagnostic, treatment and palliative settings because it can promote endurance and life enrichment.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

BACKGROUND: Assessing methodological quality of primary studies is an essential component of systematic reviews. Following a systematic review which used a domain based system [United States Preventative Services Task Force (USPSTF)] to assess methodological quality, a commonly used numerical rating scale (Downs and Black) was also used to evaluate the included studies and comparisons were made between quality ratings assigned using the two different methods. Both tools were used to assess the 20 randomized and quasi-randomized controlled trials examining an exercise intervention for chronic musculoskeletal pain which were included in the review. Inter-rater reliability and levels of agreement were determined using intraclass correlation coefficients (ICC). Influence of quality on pooled effect size was examined by calculating the between group standardized mean difference (SMD).

RESULTS: Inter-rater reliability indicated at least substantial levels of agreement for the USPSTF system (ICC 0.85; 95% CI 0.66, 0.94) and Downs and Black scale (ICC 0.94; 95% CI 0.84, 0.97). Overall level of agreement between tools (ICC 0.80; 95% CI 0.57, 0.92) was also good. However, the USPSTF system identified a number of studies (n = 3/20) as "poor" due to potential risks of bias. Analysis revealed substantially greater pooled effect sizes in these studies (SMD -2.51; 95% CI -4.21, -0.82) compared to those rated as "fair" (SMD -0.45; 95% CI -0.65, -0.25) or "good" (SMD -0.38; 95% CI -0.69, -0.08).

CONCLUSIONS: In this example, use of a numerical rating scale failed to identify studies at increased risk of bias, and could have potentially led to imprecise estimates of treatment effect. Although based on a small number of included studies within an existing systematic review, we found the domain based system provided a more structured framework by which qualitative decisions concerning overall quality could be made, and was useful for detecting potential sources of bias in the available evidence.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

Background: This study investigated the nature of newspaper reporting about online health information in the UK and US. Internet users frequently search for health information online, although the accuracy of the information retrieved varies greatly and can be misleading. Newspapers have the potential to influence public health behaviours, but information has been lacking in relation to how newspapers portray online health information to their readers.

Methods: The newspaper database Nexis (R) UK was searched for articles published from 2003 - 2012 relating to online health information. Systematic content analysis of articles published in the highest circulation newspapers in the UK and US was performed. A second researcher coded a 10% sample to establish inter-rater reliability of coding.

Results: In total, 161 newspaper articles were included in the analysis. Publication was most frequent in 2003, 2008 and 2009, which coincided with global threats to public health. UK broadsheet newspapers were significantly more likely to cover online health information than UK tabloid newspapers (p = 0.04) and only one article was identified in US tabloid newspapers. Articles most frequently appeared in health sections. Among the 79 articles that linked online health information to specific diseases or health topics, diabetes was the most frequently mentioned disease, cancer the commonest group of diseases and sexual health the most frequent health topic. Articles portrayed benefits of obtaining online health information more frequently than risks. Quotations from health professionals portrayed mixed opinions regarding public access to online health information. 108 (67.1%) articles directed readers to specific health-related web sites. 135 (83.9%) articles were rated as having balanced judgement and 76 (47.2%) were judged as having excellent quality reporting. No difference was found in the quality of reporting between UK and US articles.

Conclusions: Newspaper coverage of online health information was low during the 10-year period 2003 to 2012. Journalists tended to emphasise the benefits and understate the risks of online health information and the quality of reporting varied considerably. Newspapers directed readers to sources of online health information during global epidemics although, as most articles appeared in the health sections of broadsheet newspapers, coverage was limited to a relatively small readership.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

Background: Pharmacogenetics is a rapidly growing field that aims to identify the genes that influence drug response. This science can be used as a powerful tool to tailor drug treatment to the genetic makeup of individuals. The present study explores the coverage of the topic of pharmacogenetics and its potential benefit in personalised medicine by the UK newsprint media. 

Methods: The LexisNexis database was used to identify and retrieve full text articles from the 10 highest circulation national daily newspapers and their Sunday equivalents in the UK. Content analysis of newspaper articles which referenced pharmacogenetic testing was carried out. A second researcher coded a random sample (21%) of newspaper articles to establish the inter-rater reliability of coding. 

Results: Of the 256 articles captured by the search terms, 96 articles (with pharmacogenetics as a major component) met the study inclusion criteria. The majority of articles over-stated the benefits of pharmacogenetic testing while paying less attention to the associated risks. Overall beneficial effects were mentioned 5.3 times more frequently than risks (p < 0.001). The most common illnesses for which pharmacogenetically based personalised medicine was discussed were cancer, cardiovascular disease and CNS diseases. Only 13% of newspaper articles that cited a specific scientific study mentioned this link in the article. There was a positive correlation between the size of the article and both the number of benefits and risks stated (P < 0.01). 

Conclusion: More comprehensive coverage of the area of personalised medicine within the print media is needed to inform public debate on the inclusion of pharmacogentic testing in routine practice.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

Data obtained with any research tool must be reproducible, a concept referred to as reliability. Three techniques are often used to evaluate reliability of tools using continuous data in aging research: intraclass correlation coefficients (ICC), Pearson correlations, and paired t tests. These are often construed as equivalent when applied to reliability. This is not correct, and may lead researchers to select instruments based on statistics that may not reflect actual reliability. The purpose of this paper is to compare the reliability estimates produced by these three techniques and determine the preferable technique. A hypothetical dataset was produced to evaluate the reliability estimates obtained with ICC, Pearson correlations, and paired t tests in three different situations. For each situation two sets of 20 observations were created to simulate an intrarater or inter-rater paradigm, based on 20 participants with two observations per participant. Situations were designed to demonstrate good agreement, systematic bias, or substantial random measurement error. In the situation demonstrating good agreement, all three techniques supported the conclusion that the data were reliable. In the situation demonstrating systematic bias, the ICC and t test suggested the data were not reliable, whereas the Pearson correlation suggested high reliability despite the systematic discrepancy. In the situation representing substantial random measurement error where low reliability was expected, the ICC and Pearson coefficient accurately illustrated this. The t test suggested the data were reliable. The ICC is the preferred technique to measure reliability. Although there are some limitations associated with the use of this technique, they can be overcome.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Previous research has highlighted theoretical and empirical links between measures of both personality and trait emotional intelligence (EI), and the ability to decode facial expressions of emotion. Research has also found that the posed, static characteristics of the photographic stimuli used to explore these links affects the decoding process and differentiates them from the natural expressions they represent. This undermines the ecological validity of established trait-emotion decoding relationships. This study addresses these methodological shortcomings by testing relationships between the reliability of participant ratings of dynamic, spontaneously elicited expressions of emotion with personality and trait EI. Fifty participants completed personality and self-report EI questionnaires, and used a computer-logging program to continuously rate change in emotional intensity expressed in video clips. Each clip was rated twice to obtain an intra-rater reliability score. The results provide limited support for links between both trait EI and personality variables and how reliably we decode natural expressions of emotion. Limitations and future directions are discussed.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Assessment of infant pain is a pressing concern, especially within the context of neonatal intensive care where infants may be exposed to prolonged and repeated pain during lengthy hospitalization. In the present study the feasibility of carrying out the complete Neonatal Facial Coding System (NFCS) in real time at bedside, specifically reliability, construct and concurrent validity, was evaluated in a tertiary level Neonatal Intensive Care Unit (NICU). Heel lance was used as a model of procedural pain, and observed with n = 40 infants at 32 weeks gestational age. Infant sleep/wake state, NFCS facial activity and specific hand movements were coded during baseline, unwrap, swab, heel lance, squeezing and recovery events. Heart rate was recorded continuously and digitally sampled using a custom designed computer system. Repeated measures analysis of variance (ANOVA) showed statistically significant differences across events for facial activity (P <0.0001) and heart rate (P <0.0001). Planned comparisons showed facial activity unchanged during baseline, swab and unwrap, then increased significantly during heel lance (P <0.0001), increased further during squeezing (P <0.003), then decreased during recovery (P <0.0001). Systematic shifts in sleep/wake state were apparent. Rise in facial activity was consistent with increased heart rate, except that facial activity more closely paralleled initiation of the invasive event. Thus facial display was more specific to tissue damage compared with heart rate. Inter-observer reliability was high. Construct validity of the NFCS at bedside was demonstrated as invasive procedures were distinguished from tactile. While bedside coding of behavior does not permit raters to be blind to events, mechanical recording of heart rate allowed for an independent source of concurrent validation for bedside application of the NFCS scale.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The overall aim of this study was to assess the accuracy, reproducibility and stability of a high resolution passive stereophotogrammetry system to image a female mannequin torso, to validate measurements made on the textured virtual surface compared with those obtained using manual techniques and to develop an approach to make objective measurements of the female breast. 3D surface imaging was carried out on a textured female torso and measurements made in accordance with the system of mammometrics. Linear errors in measurements were less than 0.5 mm, system calibration produced errors of less than 1.0 mm over 94% over the surface and intra-rater reliability measured by ICC = 0.999. The mean difference between manual and digital curved surface distances was 1.36 mm with maximum and minimum differences of 3.15 mm and 0.02 mm, respectively. The stereophotogrammetry system has been demonstrated to perform accurately and reliably with specific reference to breast assessment. (C) 2011 IPEM. Published by Elsevier Ltd. All rights reserved.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Sheep transport within Europe involves 9.5 million animals yearly, 63% of which travel over longjourneys (> 8 h). Livestock transport, particularly over long journeys, gives rise to concern about the welfare of transported animals. The European Commission stimulates the development of market-oriented animal welfare standards for all phases of livestock production, providing an alternative to the 'regulatory approach'. This study aimed to develop and test a new sheep welfare assessment protocol to be used following transport, irrespective of the journey purpose. The protocol included outcome (animal-based measures) and input variables (resource-based and management-based measures), being welfare-relevant aspects of both transport and unloading procedures. Weighted Cohen's Kappa and Heiss' Kappa index of agreement were calculated to evaluate the raters accuracy and the inter-observer reliability.Overall, good agreement levels were found. The protocol was tested on 40 commercial transports arriving at previously selected assembly centres and slaughterhouses in Italy and Greece. The protocol was found to be feasible when applied to commercial transports, allowing for a comprehensive and quick sheep welfare assessment during unloading, without impairing stockman work. Univariate analysis was carried out to evaluate associations between outcome and input variables. In this study, significant association between outcome measures and risk factors were identified when associated to unloading procedures but not to travel conditions. In collaboration with the relevant stakeholders, this protocol might be developed into a tool for routine checks for certification purposes and could provide direct feedback to all professionals involved in animal transportation on the weaknesses and strengths of their work.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The angle concept is a multifaceted concept having static and dynamic definitions. The static definition of the angle refers to “the space between two rays” or “the intersection of two rays at the same end point” (Mitchelmore & White, 1998), whereas the dynamic definition of the angle concept highlights that the size of angle is the amount of rotation in direction (Fyhn, 2006). Since both definitions represent two diverse situations and have unique limitations (Henderson & Taimina, 2005), students may hold misconceptions about the angle concept. In this regard, the aim of this research was to explore high achievers’ knowledge regarding the definition of the angle concept as well as to investigate their erroneous answers on the angle concept.

104 grade 6 students drawn from four well-established elementary schools of Yozgat, Turkey were participated in this research. All participants were selected via a purposive sampling method and their mathematics grades were 4 or 5 out of 5, and. Data were collected through four questions prepared by considering the learning competencies set out in the grade 6 curriculum in Turkey and the findings of previous studies whose purposes were to identify students’ misconceptions of the angle concept. The findings were analyzed by two researchers, and their inter-rater agreement was calculated as 0.91, or almost perfect. Thereafter, coding discrepancies were resolved, and consensus was established.

The angle concept is a multifaceted concept having static and dynamic definitions.The static definition of the angle refers to “the space between two rays” or“the intersection of two rays at the same end point” (Mitchelmore & White, 1998), whereas the dynamicdefinition of the angle concept highlights that the size of angle is the amountof rotation in direction (Fyhn, 2006). Since both definitionsrepresent two diverse situations and have unique limitations (Henderson & Taimina, 2005), students may holdmisconceptions about the angle concept. In this regard, the aim of thisresearch was to explore high achievers’ knowledge regarding the definition ofthe angle concept as well as to investigate their erroneous answers on theangle concept.

104grade 6 students drawn from four well-established elementary schools of Yozgat,Turkey were participated in this research. All participants were selected via a purposive sampling method and their mathematics grades were 4 or 5 out of 5,and. Data were collected through four questions prepared by considering the learning competencies set out in the grade 6 curriculum in Turkey and the findings of previous studies whose purposes were to identify students’ misconceptions of the angle concept. The findings were analyzed by two researchers, and their inter-rater agreement was calculated as 0.91, or almost perfect. Thereafter, coding discrepancies were resolved, and consensus was established.

In the first question, students were asked to answer a multiple choice questions consisting of two statics definitions and one dynamic definition of the angle concept. Only 38 of 104 students were able to recognize these three definitions. Likewise, Mitchelmore and White (1998) investigated that less than10% of grade 4 students knew the dynamic definition of the angle concept. Additionally,the purpose of the second question was to figure out how well students could recognize 0-degree angle. We found that 49 of 104 students were unable to recognize MXW as an angle. While 6 students indicated that the size of MXW is0, other 6 students revealed that the size of MXW is 360. Therefore, 12 of 104students correctly answered this questions. On the other hand, 28 of 104students recognized the MXW angle as 180-degree angle. This finding demonstrated that these students have difficulties in naming the angles.Moreover, the third question consisted of three concentric circles with center O and two radiuses of the outer circle, and the intersection of the radiuses with these circles were named. Then, students were asked to compare the size of AOB, GOD and EOF angles. Only 36 of 104 students answered correctly by indicating that all three angles are equal, whereas 68 of 104 students incorrectly responded this question by revealing AOB<GOD< EOF. These students erroneously thought the size of the angle is related to either the size of the arc marking the angle or the area between the arms of the angle and the arc marking angle. These two erroneous strategies for determining the size of angles have been found by a few studies (Clausen-May,2008; Devichi & Munier, 2013; Kim & Lee, 2014; Mithcelmore, 1998;Wilson & Adams, 1992). The last question, whose aim was to determine how well students can adapt theangle concept to real life, consisted of an observer and a barrier, and students were asked to color the hidden area behind the barrier. Only 2 of 104students correctly responded this question, whereas 19 of 104 students drew rays from the observer to both sides of the barrier, and colored the area covered by the rays, the observer and barrier. While 35 of 104 students just colored behind the barrier without using any strategies, 33 of 104 students constructed two perpendicular lines at the both end of the barrier, and colored behind the barrier. Similarly, Munier, Devinci and Merle (2008) found that this incorrect strategy was used by 27% of students.

Consequently, we found that although the participants in this study were high achievers, they still held several misconceptions on the angle concept and had difficulties in adapting the angle concept to real life.

Keywords: the angle concept;misconceptions; erroneous answers; high achievers

References

Clausen-May, T. (2008). AnotherAngle on Angles. Australian Primary Mathematics Classroom, 13(1),4–8.

Devichi, C., & Munier, V.(2013). About the concept of angle in elementary school: Misconceptions andteaching sequences. The Journal of Mathematical Behavior, 32(1),1–19. http://doi.org/10.1016/j.jmathb.2012.10.001

Fyhn, A. B. (2006). A climbinggirl’s reflections about angles. The Journal of Mathematical Behavior, 25(2),91–102. http://doi.org/10.1016/j.jmathb.2006.02.004

Henderson, D. W., & Taimina,D. (2005). Experiencing geometry: Euclidean and non-Euclidean with history(3rd ed.). New York, USA: Prentice Hall.

Kim, O.-K., & Lee, J. H.(2014). Representations of Angle and Lesson Organization in Korean and AmericanElementary Mathematics Curriculum Programs. KAERA Research Forum, 1(3),28–37.

Mitchelmore, M. C., & White,P. (1998). Development of angle concepts: A framework for research. MathematicsEducation Research Journal, 10(3), 4–27.

Mithcelmore, M. C. (1998). Youngstudents’ concepts of turning and angle. Cognition and Instruction, 16(3),265–284.

Munier, V., Devichi, C., &Merle, H. (2008). A Physical Situation as a Way to Teach Angle. TeachingChildren Mathematics, 14(7), 402–407.

Wilson, P. S., & Adams, V.M. (1992). A Dynamic Way to Teach Angle and Angle Measure. ArithmeticTeacher, 39(5), 6–13.