From text to codings: intercoder reliability assessment in qualitative content analysis

BACKGROUND: High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis. OBJECTIVE: To illustrate how ICR assessment can be used to improve codings in qualitative content analysis. METHODS: Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain. RESULTS: First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results. DISCUSSION: The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.

Meta-analysis in medical research: potentials and limitations

Meta-analysis, the statistical combination of results from several studies to produce a single estimate of a treatment effect or size of an association, continues to attract controversy. We illustrate and discuss the promises and limitations of meta-analysis. Meta-analysis of clinical trials can prevent delays in the introduction of effective treatments or lead to the timely identification of adverse effects. However, meta-analyses are liable to numerous biases, both at the level of the individual study and the selection of studies for inclusion in meta-analysis. The biases and confounding factors that threaten the validity of individual studies will also affect meta-analyses of observational studies. We argue that meta-analyses should only be performed within the framework of systematic reviews that have been prepared using methods that minimize bias and address the combinability of studies.

Complementary Medicine in Nursing Homes - Results of a Mixed Methods Pilot Study

Background ‘Kneipp Therapy’ (KT) is a form of Complementary and Alternative Medicine (CAM) that includes a combination of hydrotherapy, herbal medicine, mind-body medicine, physical activities, and healthy eating. Since 2007, some nursing homes for older adults in Germany began to integrate CAM in the form of KT in care. The study investigated how KT is used in daily routine care and explored the health status of residents and caregivers involved in KT. Methods We performed a cross-sectional pilot study with a mixed methods approach that collected both quantitative and qualitative data in four German nursing homes in 2011. Assessments in the quantitative component included the Quality of Life in Dementia (QUALIDEM), the Short Form 12 Health Survey (SF-12), the Barthel-Index for residents and the Work Ability Index (WAI) and SF-12 for caregivers. The qualitative component addressed the residents’ and caregivers’ subjectively experienced changes after integration of KT. It was conceptualized as an ethnographic rapid appraisal by conducting participant observation and semi-structured interviews in two of the four nursing homes. Results The quantitative component included 64 residents (53 female, 83.2 ± 8.1 years (mean and SD)) and 29 caregivers (all female, 42.0 ± 11.7 years). Residents were multimorbid (8 ± 3 diagnoses), and activities of daily living were restricted (Barthel-Index 60.6 ± 24.4). The caregivers’ results indicated good work ability (WAI 37.4 ± 5.1), health related quality of life was superior to the German sample (SF-12 physical CSS 49.2 ± 8.0; mental CSS 54.1 ± 6.6). Among both caregivers and residents, 89% considered KT to be positive for well-being. The qualitative analysis showed that caregivers perceived emotional and functional benefits from more content and calmer residents, a larger variety in basic care practices, and a more self-determined scope of action. Residents reported gains in attention and caring, and recognition of their lay knowledge. Conclusion Residents showed typical characteristics of nursing home inhabitants. Caregivers demonstrated good work ability. Both reported to have benefits from KT. The results provide a good basis for future projects, e.g. controlled studies to evaluate the effects of CAM in nursing homes.

Social Network Analysis and Qualitative Comparative Analysis: Their mutual benefit for the explanation of policy network structures

By switching the level of analysis and aggregating data from the micro-level of individual cases to the macro-level, quantitative data can be analysed within a more case-based approach. This paper presents such an approach in two steps: In a first step, it discusses the combination of Social Network Analysis (SNA) and Qualitative Comparative Analysis (QCA) in a sequential mixed-methods research design. In such a design, quantitative social network data on individual cases and their relations at the micro-level are used to describe the structure of the network that these cases constitute at the macro-level. Different network structures can then be compared by QCA. This strategy allows adding an element of potential causal explanation to SNA, while SNA-indicators allow for a systematic description of the cases to be compared by QCA. Because mixing methods can be a promising, but also a risky endeavour, the methodological part also discusses the possibility that underlying assumptions of both methods could clash. In a second step, the research design presented beforehand is applied to an empirical study of policy network structures in Swiss politics. Through a comparison of 11 policy networks, causal paths that lead to a conflictual or consensual policy network structure are identified and discussed. The analysis reveals that different theoretical factors matter and that multiple conjunctural causation is at work. Based on both the methodological discussion and the empirical application, it appears that a combination of SNA and QCA can represent a helpful methodological design for social science research and a possibility of using quantitative data with a more case-based approach.

Unique and shared techniques in cognitive-behavioural and short-term psychodynamic psychotherapy: a content analysis of randomised trials on depression

Randomised controlled trials (RCTs) of psychotherapeutic interventions assume that specific techniques are used in treatments, which are responsible for changes in the client's symptoms. This assumption also holds true for meta-analyses, where evidence for specific interventions and techniques is compiled. However, it has also been argued that different treatments share important techniques and that an upcoming consensus about useful treatment strategies is leading to a greater integration of treatments. This makes assumptions about the effectiveness of specific interventions ingredients questionable if the shared (common) techniques are more often used in interventions than are the unique techniques. This study investigated the unique or shared techniques in RCTs of cognitive-behavioural therapy (CBT) and short-term psychodynamic psychotherapy (STPP). Psychotherapeutic techniques were coded from 42 masked treatment descriptions of RCTs in the field of depression (1979-2010). CBT techniques were often used in studies identified as either CBT or STPP. However, STPP techniques were only used in STPP-identified studies. Empirical clustering of treatment descriptions did not confirm the original distinction of CBT versus STPP, but instead showed substantial heterogeneity within both approaches. Extraction of psychotherapeutic techniques from the treatment descriptions is feasible and could be used as a content-based approach to classify treatments in systematic reviews and meta-analyses.

Gender-Fair language and professional self-reference: The case of female psychologists in Polish

The struggle to achieve gender equality is accompanied by efforts to introduce gender-fair language. In languages with grammatical gender this implies the use of gender-appropriate forms (feminine for women and masculine for males). In the present research, results of a mixed method approach—a corpus analysis, a survey, and an experiment—provide consistent evidence that in Polish, feminine forms are still infrequent in women’s self-reference and that women psychologists continue to use masculine titles. Moreover, a qualitative inquiry examines the reasons why women prefer masculine over feminine job titles. Integrating findings from the two-stage design, we are able to identify the obstacles to promoting social change with the help of language and to understand the reasons behind them.

Itineraries of pottery: a mixed methods approach to mobility

Neolithic wetland sites in the Swiss Plateau provide an extraordinary database for the study of mobilities, entanglements and transformations in material culture. Based on dendrochronologically dated settlements between 3900 and 3500 BC, two regional pottery styles and their local variations are well known, Pfyn and Cortaillod. The vessels share the same habitus and were made of local raw materials. However, some vessels specific to other pottery styles are also present in the sites. By focusing on itineraries of vessels and shifts in pottery knowledge, their appropriation in different contexts and the resulting material entanglements, we want to approach the multiple regimes of mobility: At Lake Constance - known for Pfyn pottery - specific Michelsberg vessels like tulip beakers and lugged jars occur in small numbers. These travelling objects were produced with exogenous raw materials and transported to the sites from Southern Germany. At Concise (Lake Neuchâtel) besides the local Cortaillod pottery the whole repertoire of NMB pottery, characteristic for Eastern France, was also produced. Further cases from the same space-time frame point to other regimes of mobility. In our two PhD-projects we compare pottery practices - styles, techniques, raw materials - from over 20 key sites in the region. Based on Bourdieu’s reflexive anthropology, we apply different qualitative and quantitative archaeological and archaeometrical methods, thus striving for a deeper understanding of habitus and the transformative potential of moving people, objects and ideas on local and regional scales and related social contexts.

Mobilities, Entanglements, Transformations. Outline of a Research Project on Pottery Practices in Neolithic Wetland Sites of the Swiss Plateau

A large number of later Neolithic sites (3900–3500BC) in Switzerland, Southern Germany and Eastern France offer outstandingly well preserved archaeological materials from cultural layers. Due to the wide use of dendrochronology, settlement remains and artefact assemblages can now be placed into a precise and fixed chronological framework, thus presenting a unique case within prehistoric archaeology. In earlier research, chronological and regional units were constructed on the basis of pottery. These spacial and temporal units of typical pottery sets were understood as Neolithic cultures, as culturally more or less homogenous entities connected with (ethnic) identities. Today, with a larger data corpus of excavated settlements at hand, we can begin to understand that this period of the past was in fact characterised by a multitude of cultural entanglements and transformations. This is indicated by the occurrence of local and non-local pottery styles in one and the same settlement: for example typically local Cortaillod pottery is found together with NMB-styled pottery in settlements at Lake Neuchâtel or Michelsberg pottery is regularly occurring in settlements at Lake Constance where Pfyn pottery style is the typical local one. These and many more examples show that there must have been complex entanglements of social ties expanding between Eastern France, Southern Germany and the Swiss Plateau. Given these circumstances the former notions of Neolithic culture should be critically revised. Therefore, in late 2014, the Prehistoric Archaeology Department at the Archaeological Institute of University of Berne started a four-year research project funded by Swiss National Science Foundation in late 2014: ‘Mobilities, Entanglements and Transformations in Neolithic Societies of the Swiss Plateau (3900-3500 BC)’. It’s objective is to address the topic sketched above by adopting a mixed methods research (MMR)-design combining qualitative and quantitative approaches from archaeology and archaeometry. The approach is theoretically based on Pierre Bourdieu’s reflexive sociology and his concept of habitus but includes further concepts of practice theories. By shifting the focus to the movement of people, ideas and things – to pottery production practices in contexts of mobility – a deeper understanding of the transformative capacities of encounters can be achieved. This opens the path for new insights of Neolithic societies including social, cultural and economic dynamics that were underestimated in former research.

Comparison of different methods for thin section EM analysis of Mycobacterium smegmatis

Bacteria are generally difficult specimens to prepare for conventional resin section electron microscopy and mycobacteria, with their thick and complex cell envelope layers being especially prone to artefacts. Here we made a systematic comparison of different methods for preparing Mycobacterium smegmatis for thin section electron microscopy analysis. These methods were: (1) conventional preparation by fixatives and epoxy resins at ambient temperature. (2) Tokuyasu cryo-section of chemically fixed bacteria. (3) rapid freezing followed by freeze substitution and embedding in epoxy resin at room temperature or (4) combined with Lowicryl HM20 embedding and ultraviolet (UV) polymerization at low temperature and (5) CEMOVIS, or cryo electron microscopy of vitreous sections. The best preservation of bacteria was obtained with the cryo electron microscopy of vitreous sections method, as expected, especially with respect to the preservation of the cell envelope and lipid bodies. By comparison with cryo electron microscopy of vitreous sections both the conventional and Tokuyasu methods produced different, undesirable artefacts. The two different types of freeze-substitution protocols showed variable preservation of the cell envelope but gave acceptable preservation of the cytoplasm, but not lipid bodies, and bacterial DNA. In conclusion although cryo electron microscopy of vitreous sections must be considered the 'gold standard' among sectioning methods for electron microscopy, because it avoids solvents and stains, the use of optimally prepared freeze substitution also offers some advantages for ultrastructural analysis of bacteria.