Online-questionnaire design:establishing guidelines and evaluating existing eupport

As a new medium for questionnaire delivery, the internet has the potential to revolutionise the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability [1, 2]. For instance, delivery is faster, responses are received more quickly, and data collection can be automated or accelerated [1- 3]. Online-questionnaires can also provide many capabilities not found in traditional paper-based questionnaires: they can include pop-up instructions and error messages; they can incorporate links; and it is possible to encode difficult skip patterns making such patterns virtually invisible to respondents. Like many new technologies, however, online-questionnaires face criticism despite their advantages. Typically, such criticisms focus on the vulnerability of online-questionnaires to the four standard survey error types: namely, coverage, non-response, sampling, and measurement errors. Although, like all survey errors, coverage error (“the result of not allowing all members of the survey population to have an equal or nonzero chance of being sampled for participation in a survey” [2, pg. 9]) also affects traditional survey methods, it is currently exacerbated in online-questionnaires as a result of the digital divide. That said, many developed countries have reported substantial increases in computer and internet access and/or are targeting this as part of their immediate infrastructural development [4, 5]. Indicating that familiarity with information technologies is increasing, these trends suggest that coverage error will rapidly diminish to an acceptable level (for the developed world at least) in the near future, and in so doing, positively reinforce the advantages of online-questionnaire delivery. The second error type – the non-response error – occurs when individuals fail to respond to the invitation to participate in a survey or abandon a questionnaire before it is completed. Given today’s societal trend towards self-administration [2] the former is inevitable, irrespective of delivery mechanism. Conversely, non-response as a consequence of questionnaire abandonment can be relatively easily addressed. Unlike traditional questionnaires, the delivery mechanism for online-questionnaires makes estimation of questionnaire length and time required for completion difficult1, thus increasing the likelihood of abandonment. By incorporating a range of features into the design of an online questionnaire, it is possible to facilitate such estimation – and indeed, to provide respondents with context sensitive assistance during the response process – and thereby reduce abandonment while eliciting feelings of accomplishment [6]. For online-questionnaires, sampling error (“the result of attempting to survey only some, and not all, of the units in the survey population” [2, pg. 9]) can arise when all but a small portion of the anticipated respondent set is alienated (and so fails to respond) as a result of, for example, disregard for varying connection speeds, bandwidth limitations, browser configurations, monitors, hardware, and user requirements during the questionnaire design process. Similarly, measurement errors (“the result of poor question wording or questions being presented in such a way that inaccurate or uninterpretable answers are obtained” [2, pg. 11]) will lead to respondents becoming confused and frustrated. Sampling, measurement, and non-response errors are likely to occur when an online-questionnaire is poorly designed. Individuals will answer questions incorrectly, abandon questionnaires, and may ultimately refuse to participate in future surveys; thus, the benefit of online questionnaire delivery will not be fully realized. To prevent errors of this kind2, and their consequences, it is extremely important that practical, comprehensive guidelines exist for the design of online questionnaires. Many design guidelines exist for paper-based questionnaire design (e.g. [7-14]); the same is not true for the design of online questionnaires [2, 15, 16]. The research presented in this paper is a first attempt to address this discrepancy. Section 2 describes the derivation of a comprehensive set of guidelines for the design of online-questionnaires and briefly (given space restrictions) outlines the essence of the guidelines themselves. Although online-questionnaires reduce traditional delivery costs (e.g. paper, mail out, and data entry), set up costs can be high given the need to either adopt and acquire training in questionnaire development software or secure the services of a web developer. Neither approach, however, guarantees a good questionnaire (often because the person designing the questionnaire lacks relevant knowledge in questionnaire design). Drawing on existing software evaluation techniques [17, 18], we assessed the extent to which current questionnaire development applications support our guidelines; Section 3 describes the framework used for the evaluation, and Section 4 discusses our findings. Finally, Section 5 concludes with a discussion of further work.

Guidelines for the design of online-questionnaires

As a new medium for questionnaire delivery, the internet has the potential to revolutionise the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability (Bandilla et al., 2003; Dillman, 2000; Kwak and Radler, 2002). Online-questionnaires can also provide many capabilities not found in traditional paper-based questionnaires: they can include pop-up instructions and error messages; they can incorporate links; and it is possible to encode difficult skip patterns making such patterns virtually invisible to respondents. Despite this, and the introduction of numerous tools to support online-questionnaire creation, current electronic survey design typically replicates that of paper-based questionnaires, failing to harness the full power of the electronic delivery medium. Worse, a recent environmental scan of online-questionnaire design tools found that little, if any, support is incorporated within these tools to guide questionnaire designers according to best-practice (Lumsden and Morgan, 2005). This article introduces a comprehensive set of guidelines - a practical reference guide - for the design of online-questionnaires.

The Usability of a Commercial Game Physics Engine to Develop Physics Educational Materials: an Investigation

Commercial computer games contain “physics engine” components, responsible for providing realistic interactions among game objects. The question naturally arises of whether these engines can be used to develop educational materials for high school and university physics education. To answer this question, the author's group recently conducted a detailed scientific investigation of the physics engine of Unreal Tournament 2004 (UT2004). This article presents their motivation, methodology, and results. The author presents the findings of experiments that probed the accessibility and fidelity of UT2004's physics engine, examples of educational materials developed, and an evaluation of their use in high school classes. The associated pedagogical implications of this approach are discussed, and the author suggests guidelines for educators on how to deploy the approach. Key resources are presented on an associated Web site.

Five Years Of Implementation Of Guidelines In Hematology And Transfusion Medicine In Brazil.

36

Guidelines On The Treatment Of Anemia Of Chronic Renal Failure Using Recombinant Human Erythropoietin: Associação Brasileira De Hematologia, Hemoterapia E Terapia Celular Guidelines Project: Associação Médica Brasileira - 2014.

36

Comparative analysis of the new guidelines and consensuses for the management of hypothyroidism, thyroid nodules, and differentiated thyroid cancer

233

New Guidelines Of Cerebral Cardiopulmonary Resuscitation By The American Heart Association (2005 - 2006) [novas Diretrizes De Reanimação Cardiorrespiratória Cerebral Da Sociedade Americana De Cardiologia (2005 - 2006)]

No abstract available

Vancomycin use in a brazilian teaching hospital: comparison with the Hospital Infection Controlpractices Advisory Committee Guidelines (HICPAC)

This study describes vancomycin prescribing patterns in an average complexity hospital and compare the guidelines proposed by the Hospital Infection Control Practices Advisory Committee (HICPAC). The study was conducted in a 256-bed secondary-care hospital. Data were collected of all patients given vancomycin from March 2003 to February 2004, using a standardized chart-extraction form designed. Appropriate and inappropriate use was reviewed according to the Hospital Infection Control Practices Advisory Committee (HICPAC) guidelines on prudent vancomycin use. Out of 118 prescriptions, 95 (80.5%) were considered appropriate. Out of these 95 orders, 77 (81.1%) were administered for empiric treatment of suspected Gram-positive infections, 17 (17.9%) were administered for treatment of proven Gram-positive infections (76.5% identified as Staphyloccocus aureus-like agents) and 1 (1.0%) for beta-lactam allergy. The majority of the patients (96.6%) had recently used an antimicrobial medication (3 months). The mean pre-treatment hospitalization period was 11±10 days. Out of the 118 treatments, 67 (56.8%) were for nosocomial infections. The more frequent indications for vancomycin use were pneumonia (48.3%) and primary sepsis (18.6%), accounting for more than 66% of all treatments. No restriction policy was suggested because vancomycin use was considered adequate in the majority of the treatment cases. The broad empiric use of this antimicrobial was greater than expected in the institution and its use should be revised.

The need for adequate ethical guidelines for qualitative health research

O artigo discute a adequação de aplicar a Resolução 196/961 do Conselho Nacional de Saúde - CNS, às pesquisas qualitativas em saúde, que se baseiam em paradigmas não positivistas. Nestas pesquisas, freqüentemente as decisões sobre a pesquisa são tomadas conjuntamente com a comunidade em estudo. Há a preocupação de favorecer a justiça e a mudança social. E, uma vez que a subjetividade pode ser considerada seu instrumento privilegiado, busca-se o balanço entre objetividade e subjetividade, e discute-se como superar a visão do pesquisador. Estudamos o âmbito de aplicação e a concepção de pesquisa presentes nas diretrizes éticas internacionais e brasileiras. Verificamos que elas adotam uma concepção positivista de pesquisa, que prevê: teste de hipótese, definição prévia de todos os procedimentos pelo pesquisador e neutralidade do pesquisador e do conhecimento produzido. Serão apresentadas algumas características das pesquisas qualitativas, as implicações éticas da maneira como a pesquisa qualitativa é concebida nos paradigmas não positivistas e um breve histórico dos documentos sobre ética em pesquisa. Concluímos que não é adequado analisar estas pesquisas com base nestes documentos e sugerimos a elaboração de diretrizes específicas