Methods to increase response to postal and electronic questionnaires

Background: Postal and electronic questionnaires are widely used for data collection in epidemiological studies but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of health research. Objectives: To identify effective strategies to increase response to postal and electronic questionnaires. Search strategy: We searched 14 electronic databases to February 2008 and manually searched the reference lists of relevant trials and reviews, and all issues of two journals. We contacted the authors of all trials or reviews to ask about unpublished trials. Where necessary, we also contacted authors to confirm methods of allocation used and to clarify results presented. We assessed the eligibility of each trial using pre-defined criteria. Selection criteria: Randomised controlled trials of methods to increase response to postal or electronic questionnaires. Data collection and analysis: We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity among trial odds ratios using a Chi 2 test and the degree of inconsistency between trial results was quantified using the I 2 statistic. Main results: Postal We found 481 eligible trials.The trials evaluated 110 different ways of increasing response to postal questionnaires.We found substantial heterogeneity among trial results in half of the strategies. The odds of response were at least doubled using monetary incentives (odds ratio 1.87; 95% CI 1.73 to 2.04; heterogeneity P < 0.00001, I 2 = 84%), recorded delivery (1.76; 95% CI 1.43 to 2.18; P = 0.0001, I 2 = 71%), a teaser on the envelope - e.g. a comment suggesting to participants that they may benefit if they open it (3.08; 95% CI 1.27 to 7.44) and a more interesting questionnaire topic (2.00; 95% CI 1.32 to 3.04; P = 0.06, I 2 = 80%). The odds of response were substantially higher with pre-notification (1.45; 95% CI 1.29 to 1.63; P < 0.00001, I 2 = 89%), follow-up contact (1.35; 95% CI 1.18 to 1.55; P < 0.00001, I 2 = 76%), unconditional incentives (1.61; 1.36 to 1.89; P < 0.00001, I 2 = 88%), shorter questionnaires (1.64; 95%CI 1.43 to 1.87; P < 0.00001, I 2 = 91%), providing a second copy of the questionnaire at follow up (1.46; 95% CI 1.13 to 1.90; P < 0.00001, I 2 = 82%), mentioning an obligation to respond (1.61; 95% CI 1.16 to 2.22; P = 0.98, I 2 = 0%) and university sponsorship (1.32; 95% CI 1.13 to 1.54; P < 0.00001, I 2 = 83%). The odds of response were also increased with non-monetary incentives (1.15; 95% CI 1.08 to 1.22; P < 0.00001, I 2 = 79%), personalised questionnaires (1.14; 95% CI 1.07 to 1.22; P < 0.00001, I 2 = 63%), use of hand-written addresses (1.25; 95% CI 1.08 to 1.45; P = 0.32, I 2 = 14%), use of stamped return envelopes as opposed to franked return envelopes (1.24; 95% CI 1.14 to 1.35; P < 0.00001, I 2 = 69%), an assurance of confidentiality (1.33; 95% CI 1.24 to 1.42) and first class outward mailing (1.11; 95% CI 1.02 to 1.21; P = 0.78, I 2 = 0%). The odds of response were reduced when the questionnaire included questions of a sensitive nature (0.94; 95% CI 0.88 to 1.00; P = 0.51, I 2 = 0%). Electronic: We found 32 eligible trials. The trials evaluated 27 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity among trial results in half of the strategies. The odds of response were increased by more than a half using non-monetary incentives (1.72; 95% CI 1.09 to 2.72; heterogeneity P < 0.00001, I 2 = 95%), shorter e-questionnaires (1.73; 1.40 to 2.13; P = 0.08, I 2 = 68%), including a statement that others had responded (1.52; 95% CI 1.36 to 1.70), and a more interesting topic (1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third using a lottery with immediate notification of results (1.37; 95% CI 1.13 to 1.65), an offer of survey results (1.36; 95% CI 1.15 to 1.61), and using a white background (1.31; 95% CI 1.10 to 1.56). The odds of response were also increased with personalised e-questionnaires (1.24; 95% CI 1.17 to 1.32; P = 0.07, I 2 = 41%), using a simple header (1.23; 95% CI 1.03 to 1.48), using textual representation of response categories (1.19; 95% CI 1.05 to 1.36), and giving a deadline (1.18; 95% CI 1.03 to 1.34). The odds of response tripled when a picture was included in an e-mail (3.05; 95% CI 1.84 to 5.06; P = 0.27, I 2 = 19%). The odds of response were reduced when "Survey" was mentioned in the e-mail subject line (0.81; 95% CI 0.67 to 0.97; P = 0.33, I 2 = 0%), and when the e-mail included a male signature (0.55; 95% CI 0.38 to 0.80; P = 0.96, I 2 = 0%). Authors' conclusions: Health researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this systematic review. Copyright © 2009 The Cochrane Collaboration. Published by John Wiley & Sons, Ltd.


--------------------------------------------------------------------------------

Reaxys Database Information|

--------------------------------------------------------------------------------

Methadone as Social Control: Institutionalized Stigma and the Prospect of Recovery

Methadone maintenance treatment (MMT) is an intervention used to treat opioid (heroin) dependence. Several investigators have found that MMT is effective in reducing heroin use and other behaviors; however, a disproportionate number of MMT clients leave treatment prematurely. Moreover, MMT outcome variables are often limited in terms of their measurement. Utilizing an integrated theoretical framework of social control and stigma, we focused on the experiences of methadone maintenance from the perspective of clients. We pooled interview data from four qualitative studies in two jurisdictions and found linkages between social control and institutional stigma that serve to reinforce "addict" identities, expose undeserving customers to the public gaze, and encourage clients to be passive recipients of treatment. We discuss the implications for recovery and suggest recommendations for change.

Surveillance for ocular hypertension: An evidence synthesis and economic evaluation

OBJECTIVES: To determine effective and efficient monitoring criteria for ocular hypertension [raised intraocular pressure (IOP)] through (i) identification and validation of glaucoma risk prediction models; and (ii) development of models to determine optimal surveillance pathways.

DESIGN: A discrete event simulation economic modelling evaluation. Data from systematic reviews of risk prediction models and agreement between tonometers, secondary analyses of existing datasets (to validate identified risk models and determine optimal monitoring criteria) and public preferences were used to structure and populate the economic model.

SETTING: Primary and secondary care.

PARTICIPANTS: Adults with ocular hypertension (IOP > 21 mmHg) and the public (surveillance preferences).

INTERVENTIONS: We compared five pathways: two based on National Institute for Health and Clinical Excellence (NICE) guidelines with monitoring interval and treatment depending on initial risk stratification, 'NICE intensive' (4-monthly to annual monitoring) and 'NICE conservative' (6-monthly to biennial monitoring); two pathways, differing in location (hospital and community), with monitoring biennially and treatment initiated for a ≥ 6% 5-year glaucoma risk; and a 'treat all' pathway involving treatment with a prostaglandin analogue if IOP > 21 mmHg and IOP measured annually in the community.

MAIN OUTCOME MEASURES: Glaucoma cases detected; tonometer agreement; public preferences; costs; willingness to pay and quality-adjusted life-years (QALYs).

RESULTS: The best available glaucoma risk prediction model estimated the 5-year risk based on age and ocular predictors (IOP, central corneal thickness, optic nerve damage and index of visual field status). Taking the average of two IOP readings, by tonometry, true change was detected at two years. Sizeable measurement variability was noted between tonometers. There was a general public preference for monitoring; good communication and understanding of the process predicted service value. 'Treat all' was the least costly and 'NICE intensive' the most costly pathway. Biennial monitoring reduced the number of cases of glaucoma conversion compared with a 'treat all' pathway and provided more QALYs, but the incremental cost-effectiveness ratio (ICER) was considerably more than £30,000. The 'NICE intensive' pathway also avoided glaucoma conversion, but NICE-based pathways were either dominated (more costly and less effective) by biennial hospital monitoring or had a ICERs > £30,000. Results were not sensitive to the risk threshold for initiating surveillance but were sensitive to the risk threshold for initiating treatment, NHS costs and treatment adherence.

LIMITATIONS: Optimal monitoring intervals were based on IOP data. There were insufficient data to determine the optimal frequency of measurement of the visual field or optic nerve head for identification of glaucoma. The economic modelling took a 20-year time horizon which may be insufficient to capture long-term benefits. Sensitivity analyses may not fully capture the uncertainty surrounding parameter estimates.

CONCLUSIONS: For confirmed ocular hypertension, findings suggest that there is no clear benefit from intensive monitoring. Consideration of the patient experience is important. A cohort study is recommended to provide data to refine the glaucoma risk prediction model, determine the optimum type and frequency of serial glaucoma tests and estimate costs and patient preferences for monitoring and treatment.

FUNDING: The National Institute for Health Research Health Technology Assessment Programme.

Gay men and intimate partner violence: a gender analysis

Though intimate partner violence (IPV) is predominately understood as a women’s health issue most often emerging within heterosexual relationships, there is increasing recognition of the existence of male victims of IPV. In this qualitative study we explored connections between masculinities and IPV among gay men. The findings show how recognising IPV was based on an array of participant experiences, including the emotional, physical and sexual abuse inflicted by their partner, which in turn led to three processes. Normalising and concealing violence referred to the participants’ complicity in accepting violence as part of their relationship and their reluctance to disclose that they were victims of IPV. Realising a way out included the participants’ understandings that the triggers for, and patterns of, IPV would best be quelled by leaving the relationship. Nurturing recovery detailed the strategies employed by participants to mend and sustain their wellbeing in the aftermath of leaving an abusive relationship. In terms of masculinities and men’s health research, the findings reveal the limits of idealising hegemonic masculinities and gender relations as heterosexual, while highlighting a plurality of gay masculinities and the need for IPV support services that bridge the divide between male and female as well as between homosexual and heterosexual.

Simvastatin in the Acute Respiratory Distress Syndrome

Background

Studies in animals and in vitro and phase 2 studies in humans suggest that statins may be beneficial in the treatment of the acute respiratory distress syndrome (ARDS). This study tested the hypothesis that treatment with simvastatin would improve clinical outcomes in patients with ARDS.

Methods

In this multicenter, double-blind clinical trial, we randomly assigned (in a 1:1 ratio) patients with an onset of ARDS within the previous 48 hours to receive enteral simvastatin at a dose of 80 mg or placebo once daily for a maximum of 28 days. The primary outcome was the number of ventilator-free days to day 28. Secondary outcomes included the number of days free of nonpulmonary organ failure to day 28, mortality at 28 days, and safety.

Results

The study recruited 540 patients, with 259 patients assigned to simvastatin and 281 to placebo. The groups were well matched with respect to demographic and baseline physiological variables. There was no significant difference between the study groups in the mean (±SD) number of ventilator-free days (12.6±9.9 with simvastatin and 11.5±10.4 with placebo, P=0.21) or days free of nonpulmonary organ failure (19.4±11.1 and 17.8±11.7, respectively; P=0.11) or in mortality at 28 days (22.0% and 26.8%, respectively; P=0.23). There was no significant difference between the two groups in the incidence of serious adverse events related to the study drug.

Conclusions

Simvastatin therapy, although safe and associated with minimal adverse effects, did not improve clinical outcomes in patients with ARDS. (Funded by the U.K. National Institute for Health Research Efficacy and Mechanism Evaluation Programme and others; HARP-2 Current Controlled Trials number, ISRCTN88244364.)

Optical coherence tomography for the diagnosis, monitoring and guiding of treatment for neovascular age-related macular degeneration:a systematic review and economic evaluation

BACKGROUND: Age-related macular degeneration is the most common cause of sight impairment in the UK. In neovascular age-related macular degeneration (nAMD), vision worsens rapidly (over weeks) due to abnormal blood vessels developing that leak fluid and blood at the macula.

OBJECTIVES: To determine the optimal role of optical coherence tomography (OCT) in diagnosing people newly presenting with suspected nAMD and monitoring those previously diagnosed with the disease.

DATA SOURCES: Databases searched: MEDLINE (1946 to March 2013), MEDLINE In-Process & Other Non-Indexed Citations (March 2013), EMBASE (1988 to March 2013), Biosciences Information Service (1995 to March 2013), Science Citation Index (1995 to March 2013), The Cochrane Library (Issue 2 2013), Database of Abstracts of Reviews of Effects (inception to March 2013), Medion (inception to March 2013), Health Technology Assessment database (inception to March 2013).

REVIEW METHODS: Types of studies: direct/indirect studies reporting diagnostic outcomes.

INDEX TEST: time domain optical coherence tomography (TD-OCT) or spectral domain optical coherence tomography (SD-OCT).

COMPARATORS: clinical evaluation, visual acuity, Amsler grid, colour fundus photographs, infrared reflectance, red-free images/blue reflectance, fundus autofluorescence imaging, indocyanine green angiography, preferential hyperacuity perimetry, microperimetry. Reference standard: fundus fluorescein angiography (FFA). Risk of bias was assessed using quality assessment of diagnostic accuracy studies, version 2. Meta-analysis models were fitted using hierarchical summary receiver operating characteristic curves. A Markov model was developed (65-year-old cohort, nAMD prevalence 70%), with nine strategies for diagnosis and/or monitoring, and cost-utility analysis conducted. NHS and Personal Social Services perspective was adopted. Costs (2011/12 prices) and quality-adjusted life-years (QALYs) were discounted (3.5%). Deterministic and probabilistic sensitivity analyses were performed.

RESULTS: In pooled estimates of diagnostic studies (all TD-OCT), sensitivity and specificity [95% confidence interval (CI)] was 88% (46% to 98%) and 78% (64% to 88%) respectively. For monitoring, the pooled sensitivity and specificity (95% CI) was 85% (72% to 93%) and 48% (30% to 67%) respectively. The FFA for diagnosis and nurse-technician-led monitoring strategy had the lowest cost (£39,769; QALYs 10.473) and dominated all others except FFA for diagnosis and ophthalmologist-led monitoring (£44,649; QALYs 10.575; incremental cost-effectiveness ratio £47,768). The least costly strategy had a 46.4% probability of being cost-effective at £30,000 willingness-to-pay threshold.

LIMITATIONS: Very few studies provided sufficient information for inclusion in meta-analyses. Only a few studies reported other tests; for some tests no studies were identified. The modelling was hampered by a lack of data on the diagnostic accuracy of strategies involving several tests.

CONCLUSIONS: Based on a small body of evidence of variable quality, OCT had high sensitivity and moderate specificity for diagnosis, and relatively high sensitivity but low specificity for monitoring. Strategies involving OCT alone for diagnosis and/or monitoring were unlikely to be cost-effective. Further research is required on (i) the performance of SD-OCT compared with FFA, especially for monitoring but also for diagnosis; (ii) the performance of strategies involving combinations/sequences of tests, for diagnosis and monitoring; (iii) the likelihood of active and inactive nAMD becoming inactive or active respectively; and (iv) assessment of treatment-associated utility weights (e.g. decrements), through a preference-based study.

STUDY REGISTRATION: This study is registered as PROSPERO CRD42012001930.

FUNDING: The National Institute for Health Research Health Technology Assessment programme.

A cluster randomised controlled trial evaluation and cost-effectiveness analysis of the Roots of Empathy schools-based programme for improving social and emotional wellbeing outcomes among 8-9 year olds in Northern Ireland

A substantial body of evidence suggest that well designed school based prevention programmes can be effective in improving a variety of social, health and academic outcomes for children and young people. This poster presents the methodology for evaluating the Roots of Empathy (ROE) programme. ROE is a universal programme delivered on a whole-class basis for one academic year. It consists of 27 lessons that run over a school year and is based around a monthly classroom visit by an infant and parent, typically recruited from the local community, whom the class 'adopts' at the start of the school year. The evaluation aims to evaluate the immediate and longer term impact of ROE on social and emotional wellbeing outcomes among 8-9 year old pupils, as well as evaluate the cost-effectiveness of the programme.

Challenges to undertaking randomised trials with looked after children in social care settings

Background: Randomised controlled trials (RCTs) are widely viewed as the gold standard for assessing effectiveness in health research; however many researchers and practitioners believe that RCTs are inappropriate and un-doable in social care settings, particularly in relation to looked after children. The aim of this article is to describe the challenges faced in conducting a pilot study and phase II RCT of a peer mentoring intervention to reduce teenage pregnancy in looked after children in a social care setting.

Methods: Interviews were undertaken with social care professionals and looked after children, and a survey conducted with looked after children, to establish the feasibility and acceptability of the intervention and research design.

Results: Barriers to recruitment and in managing the intervention were identified, including social workers acting as informal gatekeepers; social workers concerns and misconceptions about the recruitment criteria and the need for and purpose of randomisation; resource limitations, which made it difficult to prioritise research over other demands on their time and difficulties in engaging and retaining looked after children in the study.

Conclusions: The relative absence of a research infrastructure and culture in social care and the lack of research support funding available for social care agencies, compared to health organisations, has implications for increasing evidence-based practice in social care settings, particularly in this very vulnerable group of young people.

PAlliative Care in chronic Kidney diSease: the PACKS study—quality of life, decision making, costs and impact on carers in people managed without dialysis

BACKGROUND: The number of patients with advanced chronic kidney disease opting for conservative management rather than dialysis is unknown but likely to be growing as increasingly frail patients with advanced renal disease present to renal services. Conservative kidney management includes ongoing medical input and support from a multidisciplinary team. There is limited evidence concerning patient and carer experience of this choice. This study will explore quality of life, symptoms, cognition, frailty, performance decision making, costs and impact on carers in people with advanced chronic kidney disease managed without dialysis and is funded by the National Institute of Health Research in the UK.

METHODS: In this prospective, multicentre, longitudinal study, patients will be recruited in the UK, by renal research nurses, once they have made the decision not to embark on dialysis. Carers will be asked to 'opt-in' with consent from patients. The approach includes longitudinal quantitative surveys of quality of life, symptoms, decision making and costs for patients and quality of life and costs for carers, with questionnaires administered quarterly over 12 months. Additionally, the decision making process will be explored via qualitative interviews with renal physicians/clinical nurse specialists.

DISCUSSION: The study is designed to capture patient and carer profiles when conservative kidney management is implemented, and understand trajectories of care-receiving and care-giving with the aim of optimising palliative care for this population. It will explore the interactions that lead to clinical care decisions and the impact of these decisions on informal carers with the intention of improving clinical outcomes for patients and the experiences of care givers.