Online-questionnaire design:establishing guidelines and evaluating existing eupport

As a new medium for questionnaire delivery, the internet has the potential to revolutionise the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability [1, 2]. For instance, delivery is faster, responses are received more quickly, and data collection can be automated or accelerated [1- 3]. Online-questionnaires can also provide many capabilities not found in traditional paper-based questionnaires: they can include pop-up instructions and error messages; they can incorporate links; and it is possible to encode difficult skip patterns making such patterns virtually invisible to respondents. Like many new technologies, however, online-questionnaires face criticism despite their advantages. Typically, such criticisms focus on the vulnerability of online-questionnaires to the four standard survey error types: namely, coverage, non-response, sampling, and measurement errors. Although, like all survey errors, coverage error (“the result of not allowing all members of the survey population to have an equal or nonzero chance of being sampled for participation in a survey” [2, pg. 9]) also affects traditional survey methods, it is currently exacerbated in online-questionnaires as a result of the digital divide. That said, many developed countries have reported substantial increases in computer and internet access and/or are targeting this as part of their immediate infrastructural development [4, 5]. Indicating that familiarity with information technologies is increasing, these trends suggest that coverage error will rapidly diminish to an acceptable level (for the developed world at least) in the near future, and in so doing, positively reinforce the advantages of online-questionnaire delivery. The second error type – the non-response error – occurs when individuals fail to respond to the invitation to participate in a survey or abandon a questionnaire before it is completed. Given today’s societal trend towards self-administration [2] the former is inevitable, irrespective of delivery mechanism. Conversely, non-response as a consequence of questionnaire abandonment can be relatively easily addressed. Unlike traditional questionnaires, the delivery mechanism for online-questionnaires makes estimation of questionnaire length and time required for completion difficult1, thus increasing the likelihood of abandonment. By incorporating a range of features into the design of an online questionnaire, it is possible to facilitate such estimation – and indeed, to provide respondents with context sensitive assistance during the response process – and thereby reduce abandonment while eliciting feelings of accomplishment [6]. For online-questionnaires, sampling error (“the result of attempting to survey only some, and not all, of the units in the survey population” [2, pg. 9]) can arise when all but a small portion of the anticipated respondent set is alienated (and so fails to respond) as a result of, for example, disregard for varying connection speeds, bandwidth limitations, browser configurations, monitors, hardware, and user requirements during the questionnaire design process. Similarly, measurement errors (“the result of poor question wording or questions being presented in such a way that inaccurate or uninterpretable answers are obtained” [2, pg. 11]) will lead to respondents becoming confused and frustrated. Sampling, measurement, and non-response errors are likely to occur when an online-questionnaire is poorly designed. Individuals will answer questions incorrectly, abandon questionnaires, and may ultimately refuse to participate in future surveys; thus, the benefit of online questionnaire delivery will not be fully realized. To prevent errors of this kind2, and their consequences, it is extremely important that practical, comprehensive guidelines exist for the design of online questionnaires. Many design guidelines exist for paper-based questionnaire design (e.g. [7-14]); the same is not true for the design of online questionnaires [2, 15, 16]. The research presented in this paper is a first attempt to address this discrepancy. Section 2 describes the derivation of a comprehensive set of guidelines for the design of online-questionnaires and briefly (given space restrictions) outlines the essence of the guidelines themselves. Although online-questionnaires reduce traditional delivery costs (e.g. paper, mail out, and data entry), set up costs can be high given the need to either adopt and acquire training in questionnaire development software or secure the services of a web developer. Neither approach, however, guarantees a good questionnaire (often because the person designing the questionnaire lacks relevant knowledge in questionnaire design). Drawing on existing software evaluation techniques [17, 18], we assessed the extent to which current questionnaire development applications support our guidelines; Section 3 describes the framework used for the evaluation, and Section 4 discusses our findings. Finally, Section 5 concludes with a discussion of further work.

What difference doguidelines make? An observational study of online-questionnaire design guidelines put to practical use

As a new medium for questionnaire delivery, the Internet has the potential to revolutionize the survey process. Online-questionnaires can provide many capabilities not found in traditional paper-based questionnaires. Despite this, and the introduction of a plethora of tools to support online-questionnaire creation, current electronic survey design typically replicates the look-and-feel of paper-based questionnaires, thus failing to harness the full power of the electronic delivery medium. A recent environmental scan of online-questionnaire design tools found that little, if any, support is incorporated within these tools to guide questionnaire designers according to best-practice [Lumsden & Morgan 2005]. This paper briefly introduces a comprehensive set of guidelines for the design of online-questionnaires. Drawn from relevant disparate sources, all the guidelines incorporated within the set are proven in their own right; as an initial assessment of the value of the set of guidelines as a practical reference guide, we undertook an informal study to observe the effect of introducing the guidelines into the design process for a complex online-questionnaire. The paper discusses the qualitative findings — which are encouraging for the role of the guidelines in the ‘bigger picture’ of online survey delivery across many domains such as e-government, e-business, and e-health — of this case study.

TQM in e-Learning: a Self-assessment Model and Questionnaire

Organizations are seeking new, integrated systems that enable rapid changes through early identification of opportunities and problems, tracking of progress against plans, flexible allocation of resources to achieve goals, and consistent operations. Total Quality Management (TQM) is an overall business strategy. It means that all activities of the company will be focused on satisfying all stakeholders of the company. TQM can be realised by using the EFQM model. The EFQM model is a tool that organizations may use as a framework for self-evaluation that enables an organization to identify its strengths and areas for improvement and the extent to which its operations and results are in line with the characteristics of an excellent organization. We focus on a training organisation or to the learning department of an organization. So we are limiting the EFQM model to the training /learning activities. We can apply EFQM perfect on the level of an activity (business line) of a company. We selected the main criteria for which the learner can play the role of assessor. So only three main criteria left: the enabling resources, the enabling processes and the (learning) results for the learner. We limited the last one to “learning results” based on the Kirkpatrick model.

Validation of the drinking motives questionnaire - revised in six European countries

Highlights •This paper assesses the validity of the DMQ-R (Cooper, 1994) among university students in six different European countries. •Results provide support for similar DMQ-R factor structures across countries. •Drinking motives have similar meanings among European university students.

Questionnaire Construction

Questionnaires used in survey research can elicit excellent data for analysis for any part of the industry. The author discusses how to design questions, construct the survey, and watch for errors in conducting the re- search so that the results secured advance scientific inquiry.

Social determinants of fruit and vegetable intake and validation of Pro-Children Eating Habits Questionnaire for 3rd and 5th grade children

BACKGROUND: The Pro Children Eating Habits Questionnaire has been evaluated as a valid and reliable tool in Europe to measure determinants of fruit and vegetable intake for children; however, it has not been validation for United States populations. The purpose of this study was to (1) assess the reliability and discrimination validity of fruit and vegetable correlates for the Pro Children Eating Habits Questionnaire; (2) investigate the predictive validity of determinants of fruit and vegetable consumption for multi-ethnic elementary school children; and, (3) to assess the association of social determinants with fruit and vegetable consumption. METHODS: One hundred and thirty elementary school students from the 3rd and 5th grades completed this cross-sectional study. RESULTS: Fruit and vegetable determinants, had satisfactory internal consistencies. No differences were found between the test and the retest for the individual questions with the exception of the question for mean perceived vegetable intake. The discriminatory validity indicated the questionnaire could show differences across grade and gender levels for barriers of fruit and vegetables but not for other factors. Grade together with gender explained barriers to eating fruit and vegetables. Greater availability of fruit in the home and school was associated with higher frequency of consumption. CONCLUSIONS: The results of this study indicate the Pro-Children Eating Habits Questionnaire may be a reliable and valid tool for assessing fruit and vegetable consumption of children in the United States.

Acculturation and Hispanic identity/ethnicity as a predictor of change on the brief situational confidence questionnaire

The purpose of this study was to investigate whether level of acculturation among Hispanic adolescent males (n = 174) influenced treatment outcome in a substance abuse program, specifically on the Brief Situational Confidence Questionnaire (BSCQ) which measures relapse confidence. It was hypothesized that lower levels of acculturation were likely to be predictive of positive change, whereas higher levels of acculturation were likely to be predictive of no change or negative change. It was found that adolescents changed over time in BSCQ scores regardless of which acculturation variable was measured. Contrary to expectations, for those adolescents placed in family treatment, place of birth was not significantly associated with treatment response. However, both, U.S. and non-U.S. born adolescents demonstrated a change over time when receiving family treatment, suggesting that the family substance abuse treatment utilized in this intervention effected change over time.

Assessing the relative validity of the Scottish Collaborative Group Food Frequency Questionnaire for measuring dietary intake in adults

Peer reviewed

Traduction et validation transculturelle du questionnaire Sources of Sport-Confidence : questionnaire auprès d'une population canadienne-française

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

Implementation of supply chain management theory in practice:a questionnaire survey in the United Kingdom

Purpose: The purpose of the research described in this paper is to disentangle the rhetoric from the reality in relation to supply chain management (SCM) adoption in practice. There is significant evidence of a divergence between theory and practice in the field of SCM. Research Approach: The authors’ review of the extant SCM literature highlighted a lack of replication studies in SCM, leading to the concept of refined replication being developed. The authors conducted a refined replication of the work of Sweeney et al. (2015) where a new SCM definitional construct – the Four Fundamentals – was proposed. The work presented in this article refines the previous study but adopts the same three-phase approach: focussed interviews, a questionnaire survey, and focus groups. This article covers the second phase of the refined replication study and describes an integrated research design of a questionnaire research to be undertaken in Britain. Findings and Originality: The article presents an integrated research design of a questionnaire research with emphases on the refined replication of previous work of Sweeney et al. (2015) carried out in Ireland and adapting it to the British context. Research Impact: The authors introduce the concept of refined replication in SCM research. This allows previous research to be built upon in order to test understanding of SCM theory and its practical implementation - based on the Four Fundamentals construct - among SCM professionals in Britain. Practical Impact: The article presents the integrated research design of a questionnaire research that may be used in similar studies.

Traduction et validation transculturelle du questionnaire Sources of Sport-Confidence : questionnaire auprès d'une population canadienne-française

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

Constructing the Vulvar Pain Assessment Questionnaire Inventory

The goals of this program of research were to examine the link between self-reported vulvar pain and clinical diagnoses, and to create a user-friendly assessment tool to aid in that process. These goals were undertaken through a series of four empirical studies (Chapters 2-6): one archival study, two online studies, and one study conducted in a Women’s Health clinic. In Chapter 2, the link between self-report and clinical diagnosis was confirmed by extracting data from multiple studies conducted in the Sexual Health Research Laboratory over the course of several years. We demonstrated the accuracy of diagnosis based on multiple factors, and explored the varied gynecological presentation of different diagnostic groups. Chapter 3 was based on an online study designed to create the Vulvar Pain Assessment Questionnaire (VPAQ) inventory. Following the construct validation approach, a large pool of potential items was created to capture a broad selection of vulvar pain symptoms. Nearly 300 participants completed the entire item pool, and a series of factor analyses were utilized to narrow down the items and create scales/subscales. Relationships were computed among subscales and validated scales to establish convergent and discriminant validity. Chapters 4 and 5 were conducted in the Department of Obstetrics & Gynecology at Oregon Health & Science University. The brief screening version of the VPAQ was employed with patients of the Program in Vulvar Health at the Center for Women’s Health. The accuracy and usefulness of the VPAQscreen was determined from the perspective of patients as well as their health care providers, and the treatment-seeking experiences of patients was explored. Finally, a second online study was conducted to confirm the factor structure, internal consistency, and test-retest reliability of the VPAQ inventory. The results presented in these chapters confirm the link between targeted questions and accurate diagnoses, and provide a guideline that is useful and accessible for providers and patients.

Secure and Scalable Statistical Computation of Questionnaire Data in R

Collecting data via a questionnaire and analyzing them while preserving respondents’ privacy may increase the number of respondents and the truthfulness of their responses. It may also reduce the systematic differences between respondents and non-respondents. In this paper, we propose a privacy-preserving method for collecting and analyzing survey responses using secure multi-party computation (SMC). The method is secure under the semi-honest adversarial model. The proposed method computes a wide variety of statistics. Total and stratified statistical counts are computed using the secure protocols developed in this paper. Then, additional statistics, such as a contingency table, a chi-square test, an odds ratio, and logistic regression, are computed within the R statistical environment using the statistical counts as building blocks. The method was evaluated on a questionnaire dataset of 3,158 respondents sampled for a medical study and simulated questionnaire datasets of up to 50,000 respondents. The computation time for the statistical analyses linearly scales as the number of respondents increases. The results show that the method is efficient and scalable for practical use. It can also be used for other applications in which categorical data are collected.