Integrating technology to improve the efficiency of qualitative data analysis - A note on methods

Qualitative data analysis (QDA) is often a time-consuming and laborious process usually involving the management of large quantities of textual data. Recently developed computer programs offer great advances in the efficiency of the processes of QDA. In this paper we report on an innovative use of a combination of extant computer software technologies to further enhance and simplify QDA. Used in appropriate circumstances, we believe that this innovation greatly enhances the speed with which theoretical and descriptive ideas can be abstracted from rich, complex, and chaotic qualitative data. © 2001 Human Sciences Press, Inc.

The Patientʼs Perception of Eosinophilic Esophagitis Related Symptoms: a Qualitative Content Analysis

Background and Aims: The international EEsAI study group is currently developing an activity index for Eosinophilic Esophagitis (EoE). A potential discrepancy between patient and physician reported EoE symptoms has not been assessed yet. Therefore, we aimed to evaluate patient reported items describing their EoE activity and to compare these with the physicianʼs perception. Methods: A questionnaire was sent to 100 EoE patients in Switzerland. EoE-related symptoms dependent and independent of food intake were reported by patients. Results were analyzed using a qualitative content analysis and compared with symptoms reported by international EoE experts in Delphi rounds. Results: The questionnaire response rate was 64/100. The following items were developed by combining categories based on patients answers: food-consistency related dysphagia, frequency and severity of dysphagia, food impaction, strategies to avoid food impaction, food allergy, drinking-related retrosternal pain. The following food categories associated with dysphagia were identified: meat, rice, dry bread, French fries, raw, fibrous foods, others. Sports and psychological stress were identified as triggers for non-food intake related EoE symptoms. A good correlation was found between patient and physicianʼs reported EoE related symptoms. Conclusions: There is a good correlation between patient reported symptoms and the physicianʼs perception of clinical items as reported by international EoE experts. These patient reported outcomes will now be incorporated into the EEsAI questionnaire that measures EoE activity.

From text to codings: intercoder reliability assessment in qualitative content analysis

BACKGROUND: High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis. OBJECTIVE: To illustrate how ICR assessment can be used to improve codings in qualitative content analysis. METHODS: Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain. RESULTS: First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results. DISCUSSION: The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.

Assessing collective defensive performances in football: A Qualitative Comparative Analysis of central back pairs

Ahead of the World Cup in Brazil the crucial question for the Swiss national coach is the nomination of the starting eleven central back pair. A fuzzy set Qualitative Comparative Analysis assesses the defensive performances of different Swiss central back pairs during the World Cup campaign (2011 – 2014). This analysis advises Ottmar Hitzfeld to nominate Steve von Bergen and Johan Djourou as the starting eleven central back pair. The alternative with a substantially weaker empirical validity would be Johan Djourou together with Phillippe Senderos. Furthermore, this paper aims to be a step forward in mainstream football analytics. It analyses the undervalued and understudied defense (Anderson and Sally 2012, Statsbomb 2013) by explaining collective defensive performances instead of assessments of individual player or team performances. However, a qualitatively (better defensive metrics) and quantitatively (more games) improved and extended data set would allow for a more sophisticated analysis of collective defensive performances.

Is output performance all about the resources? A fuzzy-set Qualitative Comparative Analysis of street-level bureaucrats in Switzerland

This article refines Lipsky’s (1980) assertion that lacking resources negatively affect output performance. It uses fuzzy-set Qualitative Comparative Analysis to analyse the nuanced interplay of contextual and individual determinants of the output performance of veterinary inspectors as street-level bureaucrats in Switzerland. Moving ‘beyond Lipsky’, the study builds on recent theoretical contributions and a systematic comparison across organizational contexts. Against a widespread assumption, output performance is not all about the resources. The impact of perceived available resources hinges on caseloads, which prove to be more decisive. These contextual factors interact with individual attitudes emerging from diverse public accountabilities. The results contextualize the often-emphasized importance of worker-client interaction. In a setting where clients cannot escape the interaction, street-level bureaucrats are not primarily held accountable by them. Studies of output performance should thus sensibly consider gaps between what is being demanded of and offered to street-level bureaucrats, and the latter’s multiple embeddedness.

Mechanisms that Trigger a Good Health-Care Response to Intimate Partner Violence in Spain. Combining Realist Evaluation and Qualitative Comparative Analysis Approaches

Background. Health care professionals, especially those working in primary health-care services, can play a key role in preventing and responding to intimate partner violence. However, there are huge variations in the way health care professionals and primary health care teams respond to intimate partner violence. In this study we tested a previously developed programme theory on 15 primary health care center teams located in four different Spanish regions: Murcia, C Valenciana, Castilla-León and Cantabria. The aim was to identify the key combinations of contextual factors and mechanisms that trigger a good primary health care center team response to intimate partner violence. Methods. A multiple case-study design was used. Qualitative and quantitative information was collected from each of the 15 centers (cases). In order to handle the large amount of information without losing familiarity with each case, qualitative comparative analysis was undertaken. Conditions (context and mechanisms) and outcomes, were identified and assessed for each of the 15 cases, and solution formulae were calculated using qualitative comparative analysis software. Results. The emerging programme theory highlighted the importance of the combination of each team’s self-efficacy, perceived preparation and women-centredness in generating a good team response to intimate partner violence. The use of the protocol and accumulated experience in primary health care were the most relevant contextual/intervention conditions to trigger a good response. However in order to achieve this, they must be combined with other conditions, such as an enabling team climate, having a champion social worker and having staff with training in intimate partner violence. Conclusions. Interventions to improve primary health care teams’ response to intimate partner violence should focus on strengthening team’s self-efficacy, perceived preparation and the implementation of a woman-centred approach. The use of the protocol combined with a large working experience in primary health care, and other factors such as training, a good team climate, and having a champion social worker on the team, also played a key role. Measures to sustain such interventions and promote these contextual factors should be encouraged.

Social Network Analysis and Qualitative Comparative Analysis: Their mutual benefit for the explanation of policy network structures

By switching the level of analysis and aggregating data from the micro-level of individual cases to the macro-level, quantitative data can be analysed within a more case-based approach. This paper presents such an approach in two steps: In a first step, it discusses the combination of Social Network Analysis (SNA) and Qualitative Comparative Analysis (QCA) in a sequential mixed-methods research design. In such a design, quantitative social network data on individual cases and their relations at the micro-level are used to describe the structure of the network that these cases constitute at the macro-level. Different network structures can then be compared by QCA. This strategy allows adding an element of potential causal explanation to SNA, while SNA-indicators allow for a systematic description of the cases to be compared by QCA. Because mixing methods can be a promising, but also a risky endeavour, the methodological part also discusses the possibility that underlying assumptions of both methods could clash. In a second step, the research design presented beforehand is applied to an empirical study of policy network structures in Swiss politics. Through a comparison of 11 policy networks, causal paths that lead to a conflictual or consensual policy network structure are identified and discussed. The analysis reveals that different theoretical factors matter and that multiple conjunctural causation is at work. Based on both the methodological discussion and the empirical application, it appears that a combination of SNA and QCA can represent a helpful methodological design for social science research and a possibility of using quantitative data with a more case-based approach.

Why Do Some Water Utilities Recycle More than Others? A Qualitative Comparative Analysis in New South Wales, Australia

Although the recycling of municipal wastewater can play an important role in water supply security and ecosystem protection, the percentage of wastewater recycled is generally low and strikingly variable. Previous research has employed detailed case studies to examine the factors that contribute to recycling success but usually lacks a comparative perspective across cases. In this study, 25 water utilities in New South Wales, Australia, were compared using fuzzy-set Qualitative Comparative Analysis (fsQCA). This research method applies binary logic and set theory to identify the minimal combinations of conditions that are necessary and/or sufficient for an outcome to occur within the set of cases analyzed. The influence of six factors (rainfall, population density, coastal or inland location, proximity to users; cost recovery and revenue for water supply services) was examined for two outcomes, agricultural use and "heavy" (i.e., commercial/municipal/industrial) use. Each outcome was explained by two different pathways, illustrating that different combinations of conditions are associated with the same outcome. Generally, while economic factors are crucial for heavy use, factors relating to water stress and geographical proximity matter most for agricultural reuse. These results suggest that policies to promote wastewater reuse may be most effective if they target uses that are most feasible for utilities and correspond to the local context. This work also makes a methodological contribution through illustrating the potential utility of fsQCA for understanding the complex drivers of performance in water recycling.

A course in qualitative chemical analysis,

Mode of access: Internet.