From text to codings: intercoder reliability assessment in qualitative content analysis

BACKGROUND: High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis. OBJECTIVE: To illustrate how ICR assessment can be used to improve codings in qualitative content analysis. METHODS: Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain. RESULTS: First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results. DISCUSSION: The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.

People, protected areas and ecosystem services: a qualitative and quantitative analysis of local people's perception and preferences in Côte d'Ivoire

The long-term integrity of protected areas (PAs), and hence the maintenance of related ecosystem services (ES), are dependent on the support of local people. In the present study, local people's perceptions of ecosystem services from PAs and factors that govern local preferences for PAs are assessed. Fourteen study villages were randomly selected from three different protected forest areas and one control site along the southern coast of Côte d'Ivoire. Data was collected through a mixed-method approach, including qualitative semi-structured interviews and a household survey based on hypothetical choice scenarios. Local people's perceptions of ecosystem service provision was decrypted through qualitative content analysis, while the relation between people's preferences and potential factors that affect preferences were analyzed through multinomial models. This study shows that rural villagers do perceive a number of different ecosystem services as benefits from PAs in Côte d'Ivoire. The results based on quantitative data also suggest that local preferences for PAs and related ecosystem services are driven by PAs' management rules, age, and people's dependence on natural resources.

Skin and mucosa care in systemic sclerosis - patients' and family caregivers' experiences and expectations of a specific education programme: a qualitative study

BACKGROUND Skin and mucosal manifestations such as skin thickening, pruritus, reduced microvascular circulation, digital lesions, appearance-related changes, and dryness of the eyes and mucosa are common in systemic sclerosis (SSc). A specific skin and mucosa care education programme for patients and their family caregivers should increase their self-efficacy and improve coping strategies. AIMS The aims of this qualitative study were to explore the participants' experiences of both everyday life with skin and mucosal manifestations and the programme itself, while identifying unmet needs for programme development. METHODS Narrative interviews were conducted with eight SSc patients and two family caregivers of individuals with SSc. Using qualitative content analysis techniques, the transcribed interviews were systematically summarized and categories inductively developed. RESULTS The findings illustrated participants' experiences of skin and mucosal symptoms and revealed them to be experts in finding the right therapy mix alone (before diagnosis) and also in collaboration with health professionals (after diagnosis). Participants emphasized that the programme gave them useful education on skin and mucosa care. They described how they had to cope alone with the lack of information on pathophysiology, people's reactions, and the impact on their family and working lives. Nevertheless, participants said that they maintained a positive attitude by not dwelling on future disabilities. CONCLUSIONS Patients and family caregivers benefited from the individualized and SSc-specific education on skin and mucosa care. Future improvements to the programme should focus on imparting understandable information on SSc pathophysiology, dealing with disfigurement and seeking reliable disease information, as well as facilitating peer support.

Assessing collective defensive performances in football: A Qualitative Comparative Analysis of central back pairs

Ahead of the World Cup in Brazil the crucial question for the Swiss national coach is the nomination of the starting eleven central back pair. A fuzzy set Qualitative Comparative Analysis assesses the defensive performances of different Swiss central back pairs during the World Cup campaign (2011 – 2014). This analysis advises Ottmar Hitzfeld to nominate Steve von Bergen and Johan Djourou as the starting eleven central back pair. The alternative with a substantially weaker empirical validity would be Johan Djourou together with Phillippe Senderos. Furthermore, this paper aims to be a step forward in mainstream football analytics. It analyses the undervalued and understudied defense (Anderson and Sally 2012, Statsbomb 2013) by explaining collective defensive performances instead of assessments of individual player or team performances. However, a qualitatively (better defensive metrics) and quantitatively (more games) improved and extended data set would allow for a more sophisticated analysis of collective defensive performances.

Is output performance all about the resources? A fuzzy-set Qualitative Comparative Analysis of street-level bureaucrats in Switzerland

This article refines Lipsky’s (1980) assertion that lacking resources negatively affect output performance. It uses fuzzy-set Qualitative Comparative Analysis to analyse the nuanced interplay of contextual and individual determinants of the output performance of veterinary inspectors as street-level bureaucrats in Switzerland. Moving ‘beyond Lipsky’, the study builds on recent theoretical contributions and a systematic comparison across organizational contexts. Against a widespread assumption, output performance is not all about the resources. The impact of perceived available resources hinges on caseloads, which prove to be more decisive. These contextual factors interact with individual attitudes emerging from diverse public accountabilities. The results contextualize the often-emphasized importance of worker-client interaction. In a setting where clients cannot escape the interaction, street-level bureaucrats are not primarily held accountable by them. Studies of output performance should thus sensibly consider gaps between what is being demanded of and offered to street-level bureaucrats, and the latter’s multiple embeddedness.

Unique and shared techniques in cognitive-behavioural and short-term psychodynamic psychotherapy: a content analysis of randomised trials on depression

Randomised controlled trials (RCTs) of psychotherapeutic interventions assume that specific techniques are used in treatments, which are responsible for changes in the client's symptoms. This assumption also holds true for meta-analyses, where evidence for specific interventions and techniques is compiled. However, it has also been argued that different treatments share important techniques and that an upcoming consensus about useful treatment strategies is leading to a greater integration of treatments. This makes assumptions about the effectiveness of specific interventions ingredients questionable if the shared (common) techniques are more often used in interventions than are the unique techniques. This study investigated the unique or shared techniques in RCTs of cognitive-behavioural therapy (CBT) and short-term psychodynamic psychotherapy (STPP). Psychotherapeutic techniques were coded from 42 masked treatment descriptions of RCTs in the field of depression (1979-2010). CBT techniques were often used in studies identified as either CBT or STPP. However, STPP techniques were only used in STPP-identified studies. Empirical clustering of treatment descriptions did not confirm the original distinction of CBT versus STPP, but instead showed substantial heterogeneity within both approaches. Extraction of psychotherapeutic techniques from the treatment descriptions is feasible and could be used as a content-based approach to classify treatments in systematic reviews and meta-analyses.

High-Dose Benzodiazepine Dependence: A Qualitative Study of Patients' Perceptions on Initiation, Reasons for Use, and Obtainment

BACKGROUND High-dose benzodiazepine (BZD) dependence is associated with a wide variety of negative health consequences. Affected individuals are reported to suffer from severe mental disorders and are often unable to achieve long-term abstinence via recommended discontinuation strategies. Although it is increasingly understood that treatment interventions should take subjective experiences and beliefs into account, the perceptions of this group of individuals remain under-investigated. METHODS We conducted an exploratory qualitative study with 41 adult subjects meeting criteria for (high-dose) BZD-dependence, as defined by ICD-10. One-on-one in-depth interviews allowed for an exploration of this group's views on the reasons behind their initial and then continued use of BZDs, as well as their procurement strategies. Mayring's qualitative content analysis was used to evaluate our data. RESULTS In this sample, all participants had developed explanatory models for why they began using BZDs. We identified a multitude of reasons that we grouped into four broad categories, as explaining continued BZD use: (1) to cope with symptoms of psychological distress or mental disorder other than substance use, (2) to manage symptoms of physical or psychological discomfort associated with somatic disorder, (3) to alleviate symptoms of substance-related disorders, and (4) for recreational purposes, that is, sensation-seeking and other social reasons. Subjects often considered BZDs less dangerous than other substances and associated their use more often with harm reduction than as recreational. Specific obtainment strategies varied widely: the majority of participants oscillated between legal and illegal methods, often relying on the black market when faced with treatment termination. CONCLUSIONS Irrespective of comorbidity, participants expressed a clear preference for medically related explanatory models for their BZD use. We therefore suggest that clinicians consider patients' motives for long-term, high-dose BZD use when formulating treatment plans for this patient group, especially since it is known that individuals are more compliant with approaches they perceive to be manageable, tolerable, and effective.

Attitudes towards a maintenance (-agonist) treatment approach in high-dose benzodiazepine-dependent patients: a qualitative study

BACKGROUND High-dose benzodiazepine dependence constitutes a major clinical concern. Although withdrawal treatment is recommended, it is unsuccessful for a significant proportion of affected patients. More recently, a benzodiazepine maintenance approach has been suggested as an alternative for patients' failing discontinuation treatment. While there is some data supporting its effectiveness, patients' perceptions of such an intervention have not been investigated. METHODS An exploratory qualitative study was conducted among a sample of 41 high-dose benzodiazepine (BZD)-dependent patients, with long-term use defined as doses equivalent to more than 40 mg diazepam per day and/or otherwise problematic use, such as mixing substances, dose escalation, recreational use, or obtainment by illegal means. A qualitative content analysis approach was used to evaluate findings. RESULTS Participants generally favored a treatment discontinuation approach with abstinence from BZD as its ultimate aim, despite repeated failed attempts at withdrawal. A maintenance treatment approach with continued prescription of a slow-onset, long-acting agonist was viewed ambivalently, with responses ranging from positive and welcoming to rejection. Three overlapping themes of maintenance treatment were identified: "Only if I can try to discontinue…and please don't call it that," "More stability and less criminal activity…and that is why I would try it," and "No cure, no brain and no flash…and thus, just for everybody else!" CONCLUSIONS Some patients experienced slow-onset, long-acting BZDs as having stabilized their symptoms and viewed these BZDs as having helped avoid uncontrolled withdrawal and abstain from criminal activity. We therefore encourage clinicians to consider treatment alternatives if discontinuation strategies fail.

Social Network Analysis and Qualitative Comparative Analysis: Their mutual benefit for the explanation of policy network structures

By switching the level of analysis and aggregating data from the micro-level of individual cases to the macro-level, quantitative data can be analysed within a more case-based approach. This paper presents such an approach in two steps: In a first step, it discusses the combination of Social Network Analysis (SNA) and Qualitative Comparative Analysis (QCA) in a sequential mixed-methods research design. In such a design, quantitative social network data on individual cases and their relations at the micro-level are used to describe the structure of the network that these cases constitute at the macro-level. Different network structures can then be compared by QCA. This strategy allows adding an element of potential causal explanation to SNA, while SNA-indicators allow for a systematic description of the cases to be compared by QCA. Because mixing methods can be a promising, but also a risky endeavour, the methodological part also discusses the possibility that underlying assumptions of both methods could clash. In a second step, the research design presented beforehand is applied to an empirical study of policy network structures in Swiss politics. Through a comparison of 11 policy networks, causal paths that lead to a conflictual or consensual policy network structure are identified and discussed. The analysis reveals that different theoretical factors matter and that multiple conjunctural causation is at work. Based on both the methodological discussion and the empirical application, it appears that a combination of SNA and QCA can represent a helpful methodological design for social science research and a possibility of using quantitative data with a more case-based approach.