From text to codings: intercoder reliability assessment in qualitative content analysis

BACKGROUND: High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis. OBJECTIVE: To illustrate how ICR assessment can be used to improve codings in qualitative content analysis. METHODS: Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain. RESULTS: First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results. DISCUSSION: The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.

Unique and shared techniques in cognitive-behavioural and short-term psychodynamic psychotherapy: a content analysis of randomised trials on depression

Randomised controlled trials (RCTs) of psychotherapeutic interventions assume that specific techniques are used in treatments, which are responsible for changes in the client's symptoms. This assumption also holds true for meta-analyses, where evidence for specific interventions and techniques is compiled. However, it has also been argued that different treatments share important techniques and that an upcoming consensus about useful treatment strategies is leading to a greater integration of treatments. This makes assumptions about the effectiveness of specific interventions ingredients questionable if the shared (common) techniques are more often used in interventions than are the unique techniques. This study investigated the unique or shared techniques in RCTs of cognitive-behavioural therapy (CBT) and short-term psychodynamic psychotherapy (STPP). Psychotherapeutic techniques were coded from 42 masked treatment descriptions of RCTs in the field of depression (1979-2010). CBT techniques were often used in studies identified as either CBT or STPP. However, STPP techniques were only used in STPP-identified studies. Empirical clustering of treatment descriptions did not confirm the original distinction of CBT versus STPP, but instead showed substantial heterogeneity within both approaches. Extraction of psychotherapeutic techniques from the treatment descriptions is feasible and could be used as a content-based approach to classify treatments in systematic reviews and meta-analyses.

Lifestyle factors and colorectal cancer risk (1): systematic review and meta-analysis of associations with body mass index

OBJECTIVE: Excess body weight, defined by body mass index (BMI), may increase the risk of colorectal cancer. As a prerequisite to the determination of lifestyle attributable risks, we undertook a systematic review and meta-analysis of prospective observational studies to quantify colorectal cancer risk associated with increased BMI and explore for differences by gender, sub-site and study characteristics. METHOD: We searched MEDLINE and EMBASE (to December 2007), and other sources, selecting reports based on strict inclusion criteria. Random-effects meta-analyses and meta-regressions of study-specific incremental estimates were performed to determine the risk ratio (RR) and 95% confidence intervals (CIs) associated with a 5 kg/m(2) increase in BMI. RESULTS: We analysed 29 datasets from 28 articles, including 67,361 incident cases. Higher BMI was associated with colon (RR 1.24, 95% CIs: 1.20-1.28) and rectal (1.09, 1.05-1.14) cancers in men, and with colon cancer (1.09, 1.04-1.12) in women. Associations were stronger in men than in women for colon (P < 0.001) and rectal (P = 0.005) cancers. Associations were generally consistent across geographic populations. Study characteristics and adjustments accounted for only moderate variations of associations. CONCLUSION: Increasing BMI is associated with a modest increased risk of developing colon and rectal cancers, but this modest risk may translate to large attributable proportions in high-prevalence obese populations. Inter-gender differences point to potentially important mechanistic differences, which merit further research.

Non-selective beta-blockers may reduce risk of hepatocellular carcinoma: a meta-analysis of randomized trials

BACKGROUND & AIMS Non-selective beta-blockers (NSBB) are used in patients with cirrhosis and oesophageal varices. Experimental data suggest that NSBB inhibit angiogenesis and reduce bacterial translocation, which may prevent hepatocellular carcinoma (HCC). We therefore assessed the effect of NSBB on HCC by performing a systematic review with meta-analyses of randomized trials. METHODS Electronic and manual searches were combined. Authors were contacted for unpublished data. Included trials assessed NSBB for patients with cirrhosis; the control group could receive any other intervention than NSBB. Fixed and random effects meta-analyses were performed with I(2) as a measure of heterogeneity. Subgroup, sensitivity, regression and sequential analyses were performed to evaluate heterogeneity, bias and the robustness of the results after adjusting for multiple testing. RESULTS Twenty-three randomized trials on 2618 patients with cirrhosis were included, of which 12 reported HCC incidence and 23 reported HCC mortality. The mean duration of follow-up was 26 months (range 8-82). In total, 47 of 694 patients randomized to NSBB developed HCC vs 65 of 697 controls (risk difference -0.026; 95% CI-0.052 to -0.001; number needed to treat 38 patients). There was no heterogeneity (I(2) = 7%) or evidence of small study effects (Eggers P = 0.402). The result was not confirmed in sequential analysis, which suggested that 3719 patients were needed to achieve the required information size. NSBB did not reduce HCC-related mortality (RD -0.011; 95% CI -0.040 to 0.017). CONCLUSIONS Non-selective beta-blockers may prevent HCC in patients with cirrhosis.

Avalanche risk assessment - a multi-temporal approach, results from Galtür, Austria

Snow avalanches pose a threat to settlements and infrastructure in alpine environments. Due to the catastrophic events in recent years, the public is more aware of this phenomenon. Alpine settlements have always been confronted with natural hazards, but changes in land use and in dealing with avalanche hazards lead to an altering perception of this threat. In this study, a multi-temporal risk assessment is presented for three avalanche tracks in the municipality of Galtür, Austria. Changes in avalanche risk as well as changes in the risk-influencing factors (process behaviour, values at risk (buildings) and vulnerability) between 1950 and 2000 are quantified. An additional focus is put on the interconnection between these factors and their influence on the resulting risk. The avalanche processes were calculated using different simulation models (SAMOS as well as ELBA+). For each avalanche track, different scenarios were calculated according to the development of mitigation measures. The focus of the study was on a multi-temporal risk assessment; consequently the used models could be replaced with other snow avalanche models providing the same functionalities. The monetary values of buildings were estimated using the volume of the buildings and average prices per cubic meter. The changing size of the buildings over time was inferred from construction plans. The vulnerability of the buildings is understood as a degree of loss to a given element within the area affected by natural hazards. A vulnerability function for different construction types of buildings that depends on avalanche pressure was used to assess the degree of loss. No general risk trend could be determined for the studied avalanche tracks. Due to the high complexity of the variations in risk, small changes of one of several influencing factors can cause considerable differences in the resulting risk. This multi-temporal approach leads to better understanding of the today's risk by identifying the main changes and the underlying processes. Furthermore, this knowledge can be implemented in strategies for sustainable development in Alpine settlements.

Chances and risks of publication of quality data - the perspectives of Swiss physicians and nurses

Background The release of quality data from acute care hospitals to the general public is based on the aim to inform the public, to provide transparency and to foster quality-based competition among providers. Due to the expected mechanisms of action and possibly the adverse consequences of public quality comparison, it is a controversial topic. The perspective of physicians and nurses is of particular importance in this context. They are mainly responsible for the collection of quality-control data, and are directly confronted with the results of public comparison. The research focus of this qualitative study was to discover what the views and opinions of the Swiss physicians and nurses were regarding these issues. It was investigated as to how the two professional groups appraised the opportunities as well as the risks of the release of quality data in Switzerland. Methods A qualitative approach was chosen to answer the research question. For data collection, four focus groups were conducted with physicians and nurses who were employed in Swiss acute care hospitals. Qualitative content analysis was applied to the data. Results The results revealed that both occupational groups had a very critical and negative attitude regarding the recent developments. The perceived risks were dominating their view. In summary, their main concerns were: the reduction of complexity, the one-sided focus on measurable quality variables, risk selection, the threat of data manipulation and the abuse of published information by the media. An additional concern was that the impression is given that the complex construct of quality can be reduced to a few key figures, and it that it is constructed from a false message which then influences society and politics. This critical attitude is associated with the different value system and the professional self-concept that both physicians and nurses have, in comparison to the underlying principles of a market-based economy and the economic orientation of health care business. Conclusions The critical and negative attitude of Swiss physicians and nurses must, under all conditions, be heeded to and investigated regarding its impact on work motivation and identification with the profession. At the same time, the two professional groups are obligated to reflect upon their critical attitude and take a proactive role in the development of appropriate quality indicators for the publication of quality data in Switzerland.

Reasons for the persistence of adverse events in the era of safer surgery - a qualitative approach

OBJECTIVE We sought to evaluate potential reasons given by board-certified doctors for the persistence of adverse events despite efforts to improve patient safety in Switzerland. SUMMARY BACKGROUND DATA In recent years, substantial efforts have been made to improve patient safety by introducing surgical safety checklists to standardise surgeries and team procedures. Still, a high number of adverse events remain. METHODS Clinic directors in operative medicine in Switzerland were asked to answer two questions concerning the reasons for persistence of adverse events, and the advantages and disadvantages of introducing and implementing surgical safety checklists. Of 799 clinic directors, the arguments of 237 (29.7%) were content-analysed using Mayring's content analysis method, resulting in 12 different categories. RESULTS Potential reasons for the persistence of adverse events were mainly seen as being related to the "individual" (126/237, 53.2%), but directors of high-volume clinics identified factors related to the "group and interactions" significantly more often as a reason (60.2% vs 40.2%; p = 0.003). Surgical safety checklists were thought to have positive effects on the "organisational level" (47/237, 19.8%), the "team level" (37/237, 15.6%) and the "patient level" (40/237, 16.9%), with a "lack of willingness to implement checklists" as the main disadvantage (34/237, 14.3%). CONCLUSION This qualitative study revealed the individual as the main player in the persistence of adverse events. Working conditions should be optimised to minimise interface problems in the case of cross-covering of patients, to assure support for students, residents and interns, and to reduce strain. Checklists are helpful on an "organisational level" (e.g., financial benefits, quality assurance) and to clarify responsibilities.

People, protected areas and ecosystem services: a qualitative and quantitative analysis of local people's perception and preferences in Côte d'Ivoire

The long-term integrity of protected areas (PAs), and hence the maintenance of related ecosystem services (ES), are dependent on the support of local people. In the present study, local people's perceptions of ecosystem services from PAs and factors that govern local preferences for PAs are assessed. Fourteen study villages were randomly selected from three different protected forest areas and one control site along the southern coast of Côte d'Ivoire. Data was collected through a mixed-method approach, including qualitative semi-structured interviews and a household survey based on hypothetical choice scenarios. Local people's perceptions of ecosystem service provision was decrypted through qualitative content analysis, while the relation between people's preferences and potential factors that affect preferences were analyzed through multinomial models. This study shows that rural villagers do perceive a number of different ecosystem services as benefits from PAs in Côte d'Ivoire. The results based on quantitative data also suggest that local preferences for PAs and related ecosystem services are driven by PAs' management rules, age, and people's dependence on natural resources.

Attitudes towards a maintenance (-agonist) treatment approach in high-dose benzodiazepine-dependent patients: a qualitative study

BACKGROUND High-dose benzodiazepine dependence constitutes a major clinical concern. Although withdrawal treatment is recommended, it is unsuccessful for a significant proportion of affected patients. More recently, a benzodiazepine maintenance approach has been suggested as an alternative for patients' failing discontinuation treatment. While there is some data supporting its effectiveness, patients' perceptions of such an intervention have not been investigated. METHODS An exploratory qualitative study was conducted among a sample of 41 high-dose benzodiazepine (BZD)-dependent patients, with long-term use defined as doses equivalent to more than 40 mg diazepam per day and/or otherwise problematic use, such as mixing substances, dose escalation, recreational use, or obtainment by illegal means. A qualitative content analysis approach was used to evaluate findings. RESULTS Participants generally favored a treatment discontinuation approach with abstinence from BZD as its ultimate aim, despite repeated failed attempts at withdrawal. A maintenance treatment approach with continued prescription of a slow-onset, long-acting agonist was viewed ambivalently, with responses ranging from positive and welcoming to rejection. Three overlapping themes of maintenance treatment were identified: "Only if I can try to discontinue…and please don't call it that," "More stability and less criminal activity…and that is why I would try it," and "No cure, no brain and no flash…and thus, just for everybody else!" CONCLUSIONS Some patients experienced slow-onset, long-acting BZDs as having stabilized their symptoms and viewed these BZDs as having helped avoid uncontrolled withdrawal and abstain from criminal activity. We therefore encourage clinicians to consider treatment alternatives if discontinuation strategies fail.

A meta-analysis of trabecular bone score in fracture risk prediction and its relationship to FRAX

Trabecular bone score (TBS) is a grey-level textural index of bone microarchitecture derived from lumbar spine dual-energy X-ray absorptiometry (DXA) images. TBS is a BMD-independent predictor of fracture risk. The objective of this meta-analysis was to determine whether TBS predicted fracture risk independently of FRAX probability and to examine their combined performance by adjusting the FRAX probability for TBS. We utilized individual level data from 17,809 men and women in 14 prospective population-based cohorts. Baseline evaluation included TBS and the FRAX risk variables and outcomes during follow up (mean 6.7 years) comprised major osteoporotic fractures. The association between TBS, FRAX probabilities and the risk of fracture was examined using an extension of the Poisson regression model in each cohort and for each sex and expressed as the gradient of risk (GR; hazard ratio per 1SD change in risk variable in direction of increased risk). FRAX probabilities were adjusted for TBS using an adjustment factor derived from an independent cohort (the Manitoba Bone Density Cohort). Overall, the GR of TBS for major osteoporotic fracture was 1.44 (95% CI: 1.35-1.53) when adjusted for age and time since baseline and was similar in men and women (p > 0.10). When additionally adjusted for FRAX 10-year probability of major osteoporotic fracture, TBS remained a significant, independent predictor for fracture (GR 1.32, 95%CI: 1.24-1.41). The adjustment of FRAX probability for TBS resulted in a small increase in the GR (1.76, 95%CI: 1.65, 1.87 vs. 1.70, 95%CI: 1.60-1.81). A smaller change in GR for hip fracture was observed (FRAX hip fracture probability GR 2.25 vs. 2.22). TBS is a significant predictor of fracture risk independently of FRAX. The findings support the use of TBS as a potential adjustment for FRAX probability, though the impact of the adjustment remains to be determined in the context of clinical assessment guidelines. This article is protected by copyright. All rights reserved.

The unspoken disease: symptom experience in women with vulval neoplasia and surgical treatment: a qualitative study

Women with vulval neoplasia often experience severe post-surgical complications. This study focuses on symptom experience of women during the first 6 months following surgical treatment for vulval neoplasia considering their socio-cultural context. In this qualitative study using a critical hermeneutic approach, narrative interviews were conducted. A purposeful sample of 20 patients was recruited from one Swiss and two German university hospitals. Content analysis was employed to analyse the transcribed interviews considering women's experiences and social perceptions. Narratives showed eight interrelated themes: delayed diagnosis, disclosed disease, disturbed self-image, changed vulva care, experienced wound-related symptoms, evoked emotions, affected interpersonal interactions and feared illness progression. The women experienced a general lack of information pertaining to above themes and all described strategies used to handle their situation, which affected their distress. The communication, assessment and treatment of symptoms were hampered by the society's and the health system's tendency to overlook these symptoms and leave them in the realm of the unspeakable. Health professionals need new strategies to support these women to recognise, assess and evaluate the seriousness of symptoms, and to communicate their symptom experience so that timely medical treatment is sought. This support may minimise potentially preventable complications and symptom-related distress.

[Experiences of patients and family members during the stay on a nursing unit]

In 2004, the university hospital of Berne ran a pilot project with a Nursing Unit (NU). In this unit patients who no longer needed a close surveillance by physicians were cared for. They needed primarily complex professional nursing care which could not be provided by other hospitals, nursing homes, home care or family members. The nurses were responsible for the coordination of care. This qualitative study investigated experiences of patients and family members with the care concept of the NU. Thematically focused interviews were conducted with nine patients and five family members. Qualitative content analysis was used for data analysis. Results show that patients and family members mostly accepted the new care concept. They positively experienced the quiet and restful atmosphere, the patient-centred and continuous care by competent nurses, the education and the discharge planning. Some study participants reported missing information at the time of their transfer to the NU, insufficient assessments or unsuitable educational scripts. The study provides evidence to positive effects of a patient-centred care approach.