Methods to increase response to postal and electronic questionnaires

Background: Postal and electronic questionnaires are widely used for data collection in epidemiological studies but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of health research. Objectives: To identify effective strategies to increase response to postal and electronic questionnaires. Search strategy: We searched 14 electronic databases to February 2008 and manually searched the reference lists of relevant trials and reviews, and all issues of two journals. We contacted the authors of all trials or reviews to ask about unpublished trials. Where necessary, we also contacted authors to confirm methods of allocation used and to clarify results presented. We assessed the eligibility of each trial using pre-defined criteria. Selection criteria: Randomised controlled trials of methods to increase response to postal or electronic questionnaires. Data collection and analysis: We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity among trial odds ratios using a Chi 2 test and the degree of inconsistency between trial results was quantified using the I 2 statistic. Main results: Postal We found 481 eligible trials.The trials evaluated 110 different ways of increasing response to postal questionnaires.We found substantial heterogeneity among trial results in half of the strategies. The odds of response were at least doubled using monetary incentives (odds ratio 1.87; 95% CI 1.73 to 2.04; heterogeneity P < 0.00001, I 2 = 84%), recorded delivery (1.76; 95% CI 1.43 to 2.18; P = 0.0001, I 2 = 71%), a teaser on the envelope - e.g. a comment suggesting to participants that they may benefit if they open it (3.08; 95% CI 1.27 to 7.44) and a more interesting questionnaire topic (2.00; 95% CI 1.32 to 3.04; P = 0.06, I 2 = 80%). The odds of response were substantially higher with pre-notification (1.45; 95% CI 1.29 to 1.63; P < 0.00001, I 2 = 89%), follow-up contact (1.35; 95% CI 1.18 to 1.55; P < 0.00001, I 2 = 76%), unconditional incentives (1.61; 1.36 to 1.89; P < 0.00001, I 2 = 88%), shorter questionnaires (1.64; 95%CI 1.43 to 1.87; P < 0.00001, I 2 = 91%), providing a second copy of the questionnaire at follow up (1.46; 95% CI 1.13 to 1.90; P < 0.00001, I 2 = 82%), mentioning an obligation to respond (1.61; 95% CI 1.16 to 2.22; P = 0.98, I 2 = 0%) and university sponsorship (1.32; 95% CI 1.13 to 1.54; P < 0.00001, I 2 = 83%). The odds of response were also increased with non-monetary incentives (1.15; 95% CI 1.08 to 1.22; P < 0.00001, I 2 = 79%), personalised questionnaires (1.14; 95% CI 1.07 to 1.22; P < 0.00001, I 2 = 63%), use of hand-written addresses (1.25; 95% CI 1.08 to 1.45; P = 0.32, I 2 = 14%), use of stamped return envelopes as opposed to franked return envelopes (1.24; 95% CI 1.14 to 1.35; P < 0.00001, I 2 = 69%), an assurance of confidentiality (1.33; 95% CI 1.24 to 1.42) and first class outward mailing (1.11; 95% CI 1.02 to 1.21; P = 0.78, I 2 = 0%). The odds of response were reduced when the questionnaire included questions of a sensitive nature (0.94; 95% CI 0.88 to 1.00; P = 0.51, I 2 = 0%). Electronic: We found 32 eligible trials. The trials evaluated 27 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity among trial results in half of the strategies. The odds of response were increased by more than a half using non-monetary incentives (1.72; 95% CI 1.09 to 2.72; heterogeneity P < 0.00001, I 2 = 95%), shorter e-questionnaires (1.73; 1.40 to 2.13; P = 0.08, I 2 = 68%), including a statement that others had responded (1.52; 95% CI 1.36 to 1.70), and a more interesting topic (1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third using a lottery with immediate notification of results (1.37; 95% CI 1.13 to 1.65), an offer of survey results (1.36; 95% CI 1.15 to 1.61), and using a white background (1.31; 95% CI 1.10 to 1.56). The odds of response were also increased with personalised e-questionnaires (1.24; 95% CI 1.17 to 1.32; P = 0.07, I 2 = 41%), using a simple header (1.23; 95% CI 1.03 to 1.48), using textual representation of response categories (1.19; 95% CI 1.05 to 1.36), and giving a deadline (1.18; 95% CI 1.03 to 1.34). The odds of response tripled when a picture was included in an e-mail (3.05; 95% CI 1.84 to 5.06; P = 0.27, I 2 = 19%). The odds of response were reduced when "Survey" was mentioned in the e-mail subject line (0.81; 95% CI 0.67 to 0.97; P = 0.33, I 2 = 0%), and when the e-mail included a male signature (0.55; 95% CI 0.38 to 0.80; P = 0.96, I 2 = 0%). Authors' conclusions: Health researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this systematic review. Copyright © 2009 The Cochrane Collaboration. Published by John Wiley & Sons, Ltd.


--------------------------------------------------------------------------------

Reaxys Database Information|

--------------------------------------------------------------------------------

WTO government procurement rules and the local dynamics of procurement policies: A malaysian case study

This article examines efforts to create binding international rules regulating public procurement and considers, in particular, the failure to reach a WTO agreement oil transparency in government procurement. The particular focus of the discussion is the approach taken by Malaysia to these international procurement rules and to the negotiation of an agreement on transparency. Rules governing public procurement directly implicate fundamental arrangements of authority amongst and between different parts of government, its citizens and non-citizens. At the same time, the rules touch upon areas that are particularly sensitive for some developing countries. Many governments use preferences in public procurement to accomplish important redistributive and developmental goals. Malaysia has long used significant preferences in public procurement to further sensitive developmental policies targeted at improving the economic strength of native Malays. Malaysia also has political and legal arrangements substantially at odds with fundamental elements of proposed global public procurement rules. Malaysia has, therefore, been forceful in resisting being bound by international public procurement rules, and has played all important role in defeating the proposed agreement oil transparency. We suggest that our case study has implications beyond procurement. The development of international public procurement rules appears to be guided by many of the same values that guide the broader effort to create a global administrative law. This case study, therefore, has implications for the broader exploration of these efforts to develop a global administrative law, in particular the relationship between such efforts and the interests of developing countries.

The Government – Voluntary Sector Compacts: Governance, Governmentality and Civil Society

In 1998 government and the main representatives of the voluntary sector in each of the four countries in the United Kingdom published "compacts" on relations between government and the voluntary sector. These were joint documents, carrying forward ideas expressed by the Labor Party when in opposition, and directed at developing a new relationship for partnership with those "not-for-profit organizations" that are involved primarily in the areas of policy and service delivery. This article seeks to use an examination of the compacts, and the processes that produced them and that they have now set in train, to explore some of the wider issues about the changing role of government and its developing relationships with civil society. In particular, it argues that the new partnership builds upon a movement from welfarism to economism which is being developed further through the compact process. Drawing upon a governmentality approach, and illustrating the account with interview material obtained from some of those involved in compact issues from within both government and those umbrella groups which represent the voluntary sector, an argument is made that this overall process represents the beginning of a new reconfiguration of the state that is of considerable constitutional significance.

The role of operations management in public sector policy and practice alignment: a local government analysis

In responding to the demand for change and improvement, local government has applied a plethora of operations management-based methods, tools and techniques. This article explores how these methods, specifically in the form of performance management models, are used to improve alignment between central government policy and local government practice, an area which has thus far been neglected in the literature. Using multiple case studies from Environmental Waste Management Services, this research reports that models derived in the private sector are often directly ‘implanted’ into the public sector. This has challenged the efficacy of all performance management models. However, those organisations which used models most effectively did so by embedding (contextualisation) and extending (reconceptualisation) them beyond their original scope. Moreover, success with these models created a cumulative effect whereby other operations management approaches were probed, adapted and used.