Generating best evidence from qualitative research: the role of data analysis

Objective: To outline the importance of the clarity of data analysis in the doing and reporting of interview-based qualitative research.

Approach: We explore the clear links between data analysis and evidence. We argue that transparency in the data analysis process is integral to determining the evidence that is generated. Data analysis must occur concurrently with data collection and comprises an ongoing process of 'testing the fit' between the data collected and analysis. We discuss four steps in the process of thematic data analysis: immersion, coding, categorising and generation of themes.

Conclusion: Rigorous and systematic analysis of qualitative data is integral to the production of high-quality research. Studies that give an explicit account of the data analysis process provide insights into how conclusions are reached while studies that explain themes anchored to data and theory produce the strongest evidence.

Qualitative methods in early-phase drug trials : data and methods from a trial of N-acetylcysteine in schizophrenia

Objective: The pharmacokinetic profile of a drug often gives little indication of its potential therapeutic application, with many therapeutic uses of drugs being discovered serendipitously while being studied for different indications. As hypothesis-driven, quantitative research methodology is exclusively used in early-phase trials, unexpected but important phenomena may escape detection. In this context, this study aimed to examine the potential for integrating qualitative research methods with quantitative methods in early-phase drug trials. To our knowledge, this mixed methodology has not previously been applied to blinded psychopharmacologic trials.

Method: We undertook qualitative data analysis of clinical observations on the dataset of a randomized, double-blind, placebo-controlled trial of N-acetylcysteine (NAC) in patients with DSM-IV-TR–diagnosed schizophrenia (N = 140). Textual data on all participants, deliberately collected for this purpose, were coded using NVivo 2, and emergent themes were analyzed in a blinded manner in the NAC and placebo groups. The trial was conducted from November 2002 to July 2005.

Results: The principal findings of the published trial could be replicated using a qualitative methodology. In addition, significant differences between NAC- and placebo-treated participants emerged for positive and affective symptoms, which had not been captured by the rating scales utilized in the quantitative trial. Qualitative data in this study subsequently led to a positive trial of NAC in bipolar disorder.

Conclusions: The use of qualitative methods may yield broader data and has the potential to complement traditional quantitative methods and detect unexpected efficacy and safety signals, thereby maximizing the findings of early-phase clinical trial research.

User centric design, data analysis and performance of snowboard bindings

This study focuses on soft boot snowboard bindings by looking at how users interact with their binding and proposes a possible solution to overcome such issues. Snowboarding is a multibillion-dollar sport that has only reached mainstream in the last 30 years its levels of progression in technology have evolved in that time. However, snowboard bindings for the most part still consist of the same basic architecture in the last 20 years. This study was aimed at taking a user centric point of view and using additive manufacturing technologies to be able to generate a new snowboard binding that is completely adaptable to the user. The initial part of the study was a survey of 280 snowboarders focussing on preferences, style and habits. This survey was generated from over 15 nations with the vast majority of boarders on the snow for five to fifty days a year. Significant emphasis was placed on the relationship between boarder binding set-up and occurrence of pain and/or injury. From the detailed survey it was found that boarder's experienced pain in the front foot/toe area as a result from the toe strap being too tight. However boarders wanted tighter bindings to increase responsiveness. Survey data was compared to ankle and foot biomechanics to build a relationship to assess the problem of pain versus responsiveness. The design stage of the study was to develop a binding that overcame the over-tightening of the binding but still maintain equivalent or better responsiveness compared to traditional bindings. The resulting design integrated the snowboard boot much more into the design, by using the sole as a "semi-rigid" platform and locking it in laterally between the heel cup and the new toe strap arrangement. The new design developed using additive manufacturing techniques was tested via qualitative and quantitative measures in the snow and in the lab. It was found that using the new arrangement in a system resulted in no loss of performance or responsiveness to the user. Due to the design and manufacturing approach users have the ability to customise the design to their specific needs.

There are always two sides to a story: the use of social dramas as a mode of data analysis in information systems

With the continually evolving social nature of information systems research there is a need to identify different “modes of analysis” (Myers, 1997) to uncover our understanding of the complex, messy and often chaotic nature of human factors. One suggested mode of analysis is that of social dramas, a tool developed in the anthropological discipline by Victor Turner. The use of social dramas also utilises the work by Goffman (1959; 1997) and enables the researcher to investigate events from the front stage, reporting obvious issues in systems implementation, and from the back stage, identifying the hidden aspects of systems implementation and the underpinning discourses. A case study exploring the social dramas involved in systems selection and implementation has been provided to support the use of this methodological tool.

A clustering based hybrid system for mass spectrometry data analysis

Recently, much attention has been given to the mass spectrometry (MS) technology based disease classification, diagnosis, and protein-based biomarker identification. Similar to microarray based investigation, proteomic data generated by such kind of high-throughput experiments are often with high feature-to-sample ratio. Moreover, biological information and pattern are compounded with data noise, redundancy and outliers. Thus, the development of algorithms and procedures for the analysis and interpretation of such kind of data is of paramount importance. In this paper, we propose a hybrid system for analyzing such high dimensional data. The proposed method uses the k-mean clustering algorithm based feature extraction and selection procedure to bridge the filter selection and wrapper selection methods. The potential informative mass/charge (m/z) markers selected by filters are subject to the k-mean clustering algorithm for correlation and redundancy reduction, and a multi-objective Genetic Algorithm selector is then employed to identify discriminative m/z markers generated by k-mean clustering algorithm. Experimental results obtained by using the proposed method indicate that it is suitable for m/z biomarker selection and MS based sample classification.

Email correspondence : a qualitative data collection tool for organisational researchers

This paper proposes a novel method for qualitative data collection in organisational research, that of email correspondence. This approach involves written communication between the researcher and each respondent, as a conversational dialogue is constructed. An overview of this method of engaging vvith respondents is provided. The author then discusses how email correspondence was used in two studies of middle managers, outlining both the benefits and challenges experienced. Lessons learned for future use of the method are also considered. Email correspondence proved a valuable tool in revealing respondents' workplace experiences, and this method provides opportunity for organisational researchers seeking to explore employees' personal reflections.

A panel data analysis of the military expenditure-external debt nexus : evidence from six middle eastern countries

While a number of studies examine the nexus between military expenditure and economic growth, little consideration has been give to the effect of military expenditure on external debt. This article examines the impact of military expenditure and income on external debt for a panel of six Middle Eastern countries - Oman, Syria, Yemen, Bahrain, Iran, and Jordan - over the period 1988 to 2002. The Middle East represents an interesting study of the effect of military expenditure on external debt because it has one of the highest rates of arms imports in the world and it is one of the most indebted regions in the world. The study first establishes whether there is a long-run relationship between military expenditure, income, and external debt in the six countries using a panel unit root and panel cointegration framework and then proceeds to estimate the long-run and short-run effects of military expenditure and income on external debt. The study finds that external debt is elastic with respect to military expenditure in the long run and inelastic with respect to military expenditure in the short run. For the panel of six Middle Eastern countries, in the long run a 1% increase in military expenditure results in between a 1.1 % and 1.6% increase in external debt, while a 1% increase in income reduces external debt by between 0.6% and 0.8%, depending on the specific estimator employed. In the short run, a 1% increase in military expenditure increases external debt by 0.2%, while the effect of income on external debt is statistically insignificant.

A panel data analysis of the determinants of oil consumption : the case of Australia

The goal of this paper is to examine the determinants of oil consumption for a panel consisting of six Australian States and one territory, namely Queensland, New South Wales, Victoria, Tasmania, South Australia, Western Australia, and the Northern territory, for the period 1985–2006. We find that oil consumption, oil prices and income are panel cointegrated. We estimate long-run elasticities and find that oil prices have had a statistically insignificant impact on oil consumption, while income has had a statistically significant positive effect on oil consumption.

Analysing audio-recorded data : using computer software applications

Conventional methods of qualitative data analysis require transcription of audio-recorded data prior to conduct of the coding and analysis process. In this paper Alison Hutchinson describes and illustrates an innovative method of data analysis that comprises the use of audio-editing software to save selected audio bytes from digital audio recordings of meetings. The use of a database to code and manage the linked audio files and generate detailed and summary reports, including reporting of code frequencies according to participant code and/or meeting, is also highlighted. The advantage of using this approach in the analysis of audio-recorded data is that the process may be undertaken in the medium in which the data were collected. Though time-consuming, this process negates the need for expensive and time intensive transcription of recorded data.

Tourism and economic growth: a panel data analysis for Pacific Island countries

The contribution of tourism to the economic growth of Pacific Island countries (PICs) has achieved significance in the past decade. The shift in the economic policies of the PICs from the late 1980s has been decisively away from import substitution and agriculture to urban-based manufacturing and services sectors. Tourism is the main component of the services sector in the PICs. The contribution of tourism to economic growth in Fiji, Tonga, the Solomon Islands and Papua New Guinea is expected to grow. The authors use panel data for the four PICs to test the long-run relationship between real GDP and real tourism exports. They find support for panel cointegration and the results suggest that a 1% increase in tourism exports increases GDP by 0.72% in the long run and by 0.24% in the short run.

An agent-based hybrid system for microarray data analysis

This article reports our experience in agent-based hybrid construction for microarray data analysis. The contributions are twofold: We demonstrate that agent-based approaches are suitable for building hybrid systems in general, and that a genetic ensemble system is appropriate for microarray data analysis in particular. Created using an agent-based framework, this genetic ensemble system for microarray data analysis excels in both sample classification accuracy and gene selection reproducibility.

An embedded two-layer feature selection approach for microarray data analysis

Feature selection is an important technique in dealing with application problems with large number of variables and limited training samples, such as image processing, combinatorial chemistry, and microarray analysis. Commonly employed feature selection strategies can be divided into filter and wrapper. In this study, we propose an embedded two-layer feature selection approach to combining the advantages of filter and wrapper algorithms while avoiding their drawbacks. The hybrid algorithm, called GAEF (Genetic Algorithm with embedded filter), divides the feature selection process into two stages. In the first stage, Genetic Algorithm (GA) is employed to pre-select features while in the second stage a filter selector is used to further identify a small feature subset for accurate sample classification. Three benchmark microarray datasets are used to evaluate the proposed algorithm. The experimental results suggest that this embedded two-layer feature selection strategy is able to improve the stability of the selection results as well as the sample classification accuracy.