Online-questionnaire design:establishing guidelines and evaluating existing eupport

As a new medium for questionnaire delivery, the internet has the potential to revolutionise the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability [1, 2]. For instance, delivery is faster, responses are received more quickly, and data collection can be automated or accelerated [1- 3]. Online-questionnaires can also provide many capabilities not found in traditional paper-based questionnaires: they can include pop-up instructions and error messages; they can incorporate links; and it is possible to encode difficult skip patterns making such patterns virtually invisible to respondents. Like many new technologies, however, online-questionnaires face criticism despite their advantages. Typically, such criticisms focus on the vulnerability of online-questionnaires to the four standard survey error types: namely, coverage, non-response, sampling, and measurement errors. Although, like all survey errors, coverage error (“the result of not allowing all members of the survey population to have an equal or nonzero chance of being sampled for participation in a survey” [2, pg. 9]) also affects traditional survey methods, it is currently exacerbated in online-questionnaires as a result of the digital divide. That said, many developed countries have reported substantial increases in computer and internet access and/or are targeting this as part of their immediate infrastructural development [4, 5]. Indicating that familiarity with information technologies is increasing, these trends suggest that coverage error will rapidly diminish to an acceptable level (for the developed world at least) in the near future, and in so doing, positively reinforce the advantages of online-questionnaire delivery. The second error type – the non-response error – occurs when individuals fail to respond to the invitation to participate in a survey or abandon a questionnaire before it is completed. Given today’s societal trend towards self-administration [2] the former is inevitable, irrespective of delivery mechanism. Conversely, non-response as a consequence of questionnaire abandonment can be relatively easily addressed. Unlike traditional questionnaires, the delivery mechanism for online-questionnaires makes estimation of questionnaire length and time required for completion difficult1, thus increasing the likelihood of abandonment. By incorporating a range of features into the design of an online questionnaire, it is possible to facilitate such estimation – and indeed, to provide respondents with context sensitive assistance during the response process – and thereby reduce abandonment while eliciting feelings of accomplishment [6]. For online-questionnaires, sampling error (“the result of attempting to survey only some, and not all, of the units in the survey population” [2, pg. 9]) can arise when all but a small portion of the anticipated respondent set is alienated (and so fails to respond) as a result of, for example, disregard for varying connection speeds, bandwidth limitations, browser configurations, monitors, hardware, and user requirements during the questionnaire design process. Similarly, measurement errors (“the result of poor question wording or questions being presented in such a way that inaccurate or uninterpretable answers are obtained” [2, pg. 11]) will lead to respondents becoming confused and frustrated. Sampling, measurement, and non-response errors are likely to occur when an online-questionnaire is poorly designed. Individuals will answer questions incorrectly, abandon questionnaires, and may ultimately refuse to participate in future surveys; thus, the benefit of online questionnaire delivery will not be fully realized. To prevent errors of this kind2, and their consequences, it is extremely important that practical, comprehensive guidelines exist for the design of online questionnaires. Many design guidelines exist for paper-based questionnaire design (e.g. [7-14]); the same is not true for the design of online questionnaires [2, 15, 16]. The research presented in this paper is a first attempt to address this discrepancy. Section 2 describes the derivation of a comprehensive set of guidelines for the design of online-questionnaires and briefly (given space restrictions) outlines the essence of the guidelines themselves. Although online-questionnaires reduce traditional delivery costs (e.g. paper, mail out, and data entry), set up costs can be high given the need to either adopt and acquire training in questionnaire development software or secure the services of a web developer. Neither approach, however, guarantees a good questionnaire (often because the person designing the questionnaire lacks relevant knowledge in questionnaire design). Drawing on existing software evaluation techniques [17, 18], we assessed the extent to which current questionnaire development applications support our guidelines; Section 3 describes the framework used for the evaluation, and Section 4 discusses our findings. Finally, Section 5 concludes with a discussion of further work.

What difference doguidelines make? An observational study of online-questionnaire design guidelines put to practical use

As a new medium for questionnaire delivery, the Internet has the potential to revolutionize the survey process. Online-questionnaires can provide many capabilities not found in traditional paper-based questionnaires. Despite this, and the introduction of a plethora of tools to support online-questionnaire creation, current electronic survey design typically replicates the look-and-feel of paper-based questionnaires, thus failing to harness the full power of the electronic delivery medium. A recent environmental scan of online-questionnaire design tools found that little, if any, support is incorporated within these tools to guide questionnaire designers according to best-practice [Lumsden & Morgan 2005]. This paper briefly introduces a comprehensive set of guidelines for the design of online-questionnaires. Drawn from relevant disparate sources, all the guidelines incorporated within the set are proven in their own right; as an initial assessment of the value of the set of guidelines as a practical reference guide, we undertook an informal study to observe the effect of introducing the guidelines into the design process for a complex online-questionnaire. The paper discusses the qualitative findings — which are encouraging for the role of the guidelines in the ‘bigger picture’ of online survey delivery across many domains such as e-government, e-business, and e-health — of this case study.

Development and initial validation of the Parental PELICAN Questionnaire (PaPEQu) - an instrument to assess parental experiences and needs during their child's end-of-life care.

AIM: To develop and test the Parental PELICAN Questionnaire, an instrument to retrospectively assess parental experiences and needs during their child's end-of-life care. BACKGROUND: To offer appropriate care for dying children, healthcare professionals need to understand the illness experience from the family perspective. A questionnaire specific to the end-of-life experiences and needs of parents losing a child is needed to evaluate the perceived quality of paediatric end-of-life care. DESIGN: This is an instrument development study applying mixed methods based on recommendations for questionnaire design and validation. METHOD: The Parental PELICAN Questionnaire was developed in four phases between August 2012-March 2014: phase 1: item generation; phase 2: validity testing; phase 3: translation; phase 4: pilot testing. Psychometric properties were assessed after applying the Parental PELICAN Questionnaire in a sample of 224 bereaved parents in April 2014. Validity testing covered the evidence based on tests of content, internal structure and relations to other variables. RESULTS: The Parental PELICAN Questionnaire consists of approximately 90 items in four slightly different versions accounting for particularities of the four diagnostic groups. The questionnaire's items were structured according to six quality domains described in the literature. Evidence of initial validity and reliability could be demonstrated with the involvement of healthcare professionals and bereaved parents. CONCLUSION: The Parental PELICAN Questionnaire holds promise as a measure to assess parental experiences and needs and is applicable to a broad range of paediatric specialties and settings. Future validation is needed to evaluate its suitability in different cultures.

Psychometric properties of the Swedish version of the Fear of Complications Questionnaire

Objectives: To translate and evaluate the psychometric properties of the Swedish version of the Fear of Complications Questionnaire. Design: Cross-sectional study design and scale development. Settings: Totally, 469 adults (response rate 63.5%) with Type 1 diabetes completed the questionnaires. Participants were recruited from two university hospitals in Sweden. Participants: Eligible patients were those who met the following inclusion criteria: diagnosed with Type 1 diabetes, diabetes duration of at least 1 year and aged at least 18 years. Methods: The Fear of Complications Questionnaire was translated using the forward-backward translation method. Factor analyses of the questionnaire were performed in two steps using both exploratory and confirmatory factor analysis. Convergent validity was examined using the Hospital Anxiety and Depression Scale and the Fear of Hypoglycaemia Fear Survey. Internal consistency was estimated using Cronbach’s alpha.Results: Exploratory factor analysis supported a two-factor solution. One factor contained three items having to do with fear of kidney-related complications and one factor included the rest of items concerning fear of other diabetes-related complications, as well as fear of complications in general. Internal consistency was high Cronbach’s alpha 0.96. The findings also gave support for convergent validity, with significant positive correlations between measures (r = 0.51 to 0.54). Conclusion: The clinical relevance of the identified two-factor model with a structure of one dominant subdomain may be considered. We suggest, however a one-factor model covering all the items as a relevant basis to assess fear of complications among people with Type 1 diabetes.

Online-questionaire design guidelines

As a new medium for questionnaire delivery, the internet has the potential to revolutionize the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability. Designers of online-questionnaires are faced with a plethora of design tools to assist in the development of their electronic questionnaires. Little, if any, support is incorporated, however, within these tools to guide online-questionnaire designers according to best practice. In essence, an online-questionnaire combines questionnaire-based survey functionality with that of a webpage/site. As such, the design of an online-questionnaire should incorporate principles from both contributing fields. Drawing on existing guidelines for paper-based questionnaire design, website design (paying particular attention to issues of accessibility and usability), and existing but scarce guidelines for electronic surveys, we have derived a comprehensive set of guidelines for the design of online-questionnaires. This article introduces this comprehensive set of guidelines – as a practical reference guide – for the design of online-questionnaires.

Guidelines for the design of online-questionnaires

As a new medium for questionnaire delivery, the internet has the potential to revolutionise the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability (Bandilla et al., 2003; Dillman, 2000; Kwak and Radler, 2002). Online-questionnaires can also provide many capabilities not found in traditional paper-based questionnaires: they can include pop-up instructions and error messages; they can incorporate links; and it is possible to encode difficult skip patterns making such patterns virtually invisible to respondents. Despite this, and the introduction of numerous tools to support online-questionnaire creation, current electronic survey design typically replicates that of paper-based questionnaires, failing to harness the full power of the electronic delivery medium. Worse, a recent environmental scan of online-questionnaire design tools found that little, if any, support is incorporated within these tools to guide questionnaire designers according to best-practice (Lumsden and Morgan, 2005). This article introduces a comprehensive set of guidelines - a practical reference guide - for the design of online-questionnaires.

Maternal coping, appraisals and adjustment following diagnosis of fetal anomaly.

OBJECTIVE: So far, associations between appraisals, maternal adjustment and coping following diagnosis of fetal anomaly have not been investigated in women who continue with their pregnancy. METHOD: This study measured maternal coping and adjustment after and appraisal of a diagnosis of fetal anomaly in 40 mothers who had continued with their pregnancy using a cross-sectional questionnaire design. RESULTS: Based on retrospective reporting, 35% of participants met full diagnostic criteria for post-traumatic stress disorder after having received the diagnosis. Women were significantly more depressed (p < 0.001) and anxious (p < 0.001) and reported significantly less positive affect (p < 0.05) after having received the diagnosis in comparison to the time after childbirth. There were no significant differences between emotion-focused and problem-focused coping. Stressful life events, women's age, number of people providing support and problem-focused coping explained 57.6% of variance in anxiety and depression after childbirth. Satisfaction with social support, emotion-focused coping and problem-focused coping significantly explained 40.6% of variance in positive affect after childbirth. CONCLUSION: Following a prenatal diagnosis and for the remainder of their pregnancy, particular attention should be paid to older mothers, those experiencing additional stressful life events and those who are socially isolated, as these women may experience greater distress after childbirth.

Validación de la versión española del cuestionario sobre la práctica basada en la evidencia en enfermería

Background: The lack of adequate instruments prevents the possibility of assessing the competence of health care staff in evidence-based decision making and further, the identification of areas for improvement with tailored strategies. The aim of this study is to report about the validation process in the Spanish context of the Evidence-Based Practice Questionnaire (EBPQ) from Upton y Upton. Methods: A multicentre, cross-sectional, descriptive psychometric validation study was carried out. For cultural adaptation, a bidirectional translation was developed, accordingly to usual standards. The measuring model from the questionnaire was undergone to contrast, reproducing the original structure by Exploratory Factorial Analysis (EFA) and Confirmatory Factorial Analysis (CFA), including the reliability of factors. Results: Both EFA (57.545% of total variance explained) and CFA (chi2=2359,9555; gl=252; p<0.0001; RMSEA=0,1844; SRMR=0,1081), detected problems with items 7, 16, 22, 23 and 24, regarding to the original trifactorial version of EBPQ. After deleting some questions, a reduced version containing 19 items obtained an adequate factorial structure (62.29% of total variance explained), but the CFA did not fit well. Nevertheless, it was significantly better than the original version (chi2=673.1261; gl=149; p<0.0001; RMSEA=0.1196; SRMR=0.0648). Conclusions: The trifactorial model obtained good empiric evidence and could be used in our context, but the results invite to advance with further refinements into the factor “attitude”, testing it in more contexts and with more diverse professional profiles.

ATTITUDES TOWARD RUSSIAN CUSTOMERS IN THE FINNISH RETAIL TRADE SECTOR – A salesperson’s point of view

The amount of Russian tourists in Finland has increased significantly in the past years. The impact of Russian tourism to the Finnish retail trade sector is enormous, since Russian tourists often spend a lot of money particularly on shopping. Shopping tourism is mainly focused in the near border cities, such as Imatra and Lappeenranta, and in addition in Helsinki metropolitan area. The purpose of this study is to map the attitudes and perceptions of the sales personnel who are working in the Finnish retail trade sector towards Russian customers and to discover which elements affect these attitudes. The theories in this study are based on cultural elements and elements related to sales behavior and performance. Cultural differences between Finland and Russia, cultural distance and cultural intelligence form the cultural aspect of this study. Customer orientation vs. sales orientation (SOCO), adaptive selling, selling skills and job competency, salesperson’s affect and empathy toward customers, and job autonomy form the elements concerning sales behavior and performance. Furthermore, the attitude – behavior link, based on social psychology is addressed. A survey was conducted in two retail trade chains operating in Finland. These retail companies have stores and department stores in different geographical areas in Finland and the survey was conducted in altogether 19 cities. In addition to the theories that were discussed, two expert interviews were conducted in order to get a deeper understanding of the phenomenon at hand. Moreover the interviews helped in the formulation of the hypotheses and the questionnaire design. The questionnaires were sent directly to the stores, where they were placed so that they were available for the sales personnel. Altogether 487 usable responses were collected. The returned questionnaires were analyzed with IBM SPSS 21 statistics program. The results of this study indicated that the attitudes toward Russian customers are more negative compared to other foreign customers. However, the respondents’ attitudes toward and perceptions of Russian customers varied a lot. From the background variables age, education level, length of employment in current workplace, and length of experience in customer service had an effect on the attitudes of the respondents. In addition, the perceptions of Russian customers were more positive in the Eastern Finland compared to Helsinki metropolitan area. The cultural elements; cultural knowledge, cultural distance and cultural intelligence all affected the attitudes of the respondents. From the elements related to sales behavior and performance customer orientation, salesperson’s affect and empathy toward customers, and perceived job autonomy had an effect on the attitudes

3D movement and muscle activity patterns in a violin bowing task

Objective: Overuse injuries in violinists are a problem that has been primarily analyzed through the use of questionnaires. Simultaneous 3D motion analysis and EMG to measure muscle activity has been suggested as a quantitative technique to explore this problem by identifying movement patterns and muscular demands which may predispose violinists to overuse injuries. This multi-disciplinary analysis technique has, so far, had limited use in the music world. The purpose of this study was to use it to characterize the demands of a violin bowing task. Subjects: Twelve injury-free violinists volunteered for the study. The subjects were assigned to a novice or expert group based on playing experience, as determined by questionnaire. Design and Settings: Muscle activity and movement patterns were assessed while violinists played five bowing cycles (one bowing cycle = one down-bow + one up-bow) on each string (G, D, A, E), at a pulse of 4 beats per bow and 100 beats per minute. Measurements: An upper extremity model created using coordinate data from markers placed on the right acromion process, lateral epicondyle of the humerus and ulnar styloid was used to determine minimum and maximum joint angles, ranges of motion (ROM) and angular velocities at the shoulder and elbow of the bowing arm. Muscle activity in right anterior deltoid, biceps brachii and triceps brachii was assessed during maximal voluntary contractions (MVC) and during the playing task. Data were analysed for significant differences across the strings and between experience groups. Results: Elbow flexion/extension ROM was similar across strings for both groups. Shoulder flexion/extension ROM increaslarger for the experts. Angular velocity changes mirrored changes in ROM. Deltoid was the most active of the muscles assessed (20% MVC) and displayed a pattern of constant activation to maintain shoulder abduction. Biceps and triceps were less active (4 - 12% MVC) and showed a more periodic 'on and off pattern. Novices' muscle activity was higher in all cases. Experts' muscle activity showed a consistent pattern across strings, whereas the novices were more irregular. The agonist-antagonist roles of biceps and triceps during the bowing motion were clearly defined in the expert group, but not as apparent in the novice group. Conclusions: Bowing movement appears to be controlled by the shoulder rather than the elbow as shoulder ROM changed across strings while elbow ROM remained the same. Shoulder injuries are probably due to repetition as the muscle activity required for the movement is small. Experts require a smaller amount of muscle activity to perform the movement, possibly due to more efficient muscle activation patterns as a result of practice. This quantitative multidisciplinary approach to analysing violinists' movements can contribute to fuller understanding of both playing demands and injury mechanisms .

Medición de la percepción de marca: propuesta metodológica para la mejora de un sistema de simulación basado en agentes

Se propone integrar los esfuerzos provenientes de las ciencias sociales para el desarrollo de las herramientas de gestión a través de las ciencias computacionales. Se busca desarrollar propuestas metodológicas que permitan el mejoramiento de un modelo computacional que haga posible el simular el desempeño de una marca dada, asociada a una empresa, frente a sus consumidores. Se procura que con esta monografía se establezcan formas que permitan una óptima recolección de información, insumo clave dentro de un modelo de simulación de inteligencia artificial que se aplicará al comportamiento de grupos poblacionales buscando comprender la respuestas que presentan los sujetos frente a la marca organizacional a partir del principio percepción-razonamiento-acción.

Social networks and performance in knowledge creation. An application and a methodological proposal

El objetivo de esta tesis es predecir el rendimiento de los estudiantes de doctorado en la Universidad de Girona según características personales (background), actitudinales y de redes sociales de los estudiantes. La población estudiada son estudiantes de tercer y cuarto curso de doctorado y sus directores de tesis doctoral. Para obtener los datos se ha diseño un cuestionario web especificando sus ventajas y teniendo en cuenta algunos problemas tradicionales de no cobertura o no respuesta. El cuestionario web se hizo debido a la complejidad que comportan de las preguntas de red social. El cuestionario electrónico permite, mediante una serie de instrucciones, reducir el tiempo para responder y hacerlo menos cargado. Este cuestionario web, además es auto administrado, lo cual nos permite, según la literatura, unas respuestas mas honestas que cuestionario con encuestador. Se analiza la calidad de las preguntas de red social en cuestionario web para datos egocéntricos. Para eso se calcula la fiabilidad y la validez de este tipo de preguntas, por primera vez a través del modelo Multirasgo Multimétodo (Multitrait Multimethod). Al ser datos egocéntricos, se pueden considerar jerárquicos, y por primera vez se una un modelo Multirasgo Multimétodo Multinivel (multilevel Multitrait Multimethod). Las la fiabilidad y validez se pueden obtener a nivel individual (within group component) o a nivel de grupo (between group component) y se usan para llevar a cabo un meta-análisis con otras universidades europeas para analizar ciertas características de diseño del cuestionario. Estas características analizan si para preguntas de red social hechas en cuestionarios web son más fiables y validas hechas "by questions" o "by alters", si son presentes todas las etiquetas de frecuencia para los ítems o solo la del inicio y final, o si es mejor que el diseño del cuestionario esté en con color o blanco y negro. También se analiza la calidad de la red social en conjunto, en este caso específico son los grupos de investigación de la universidad. Se tratan los problemas de los datos ausentes en las redes completas. Se propone una nueva alternativa a la solución típica de la red egocéntrica o los respondientes proxies. Esta nueva alternativa la hemos nombrado "Nosduocentered Network" (red Nosduocentrada), se basa en dos actores centrales en una red. Estimando modelos de regresión, esta "Nosduocentered network" tiene mas poder predictivo para el rendimiento de los estudiantes de doctorado que la red egocéntrica. Además se corrigen las correlaciones de las variables actitudinales por atenuación debido al pequeño tamaño muestral. Finalmente, se hacen regresiones de los tres tipos de variables (background, actitudinales y de red social) y luego se combinan para analizar cual para predice mejor el rendimiento (según publicaciones académicas) de los estudiantes de doctorado. Los resultados nos llevan a predecir el rendimiento académico de los estudiantes de doctorado depende de variables personales (background) i actitudinales. Asimismo, se comparan los resultados obtenidos con otros estudios publicados.

Aplicação do método AHP para hierarquização de condicionantes de corrida de massa

Among the flow, the flows have the highest destructive potential, may cause disasters with a very high number of victims, as recorded in the events Caraguatatuba (SP) and the Serra das Araras (RJ) in 1967; Valeu do Rio Figueira, in Timbé do Sul (SC) between 1995 and 1996; Vale do Itajaí in Santa Catarina, in 2008, Teresópolis, Petrópolis and Nova Friburgo (RJ), in December 2010 and January 2011. This project aimed to prioritize the main determinants of inducing processes of debris flows by applying the method of decision making AHP (Analytical Hierarch Process). Therefore, the following stages of work were defined: research of the major factors of debris flows, questionnaire design method for application of AHP expert on the subject, analysis of the results obtained from calculating the ratio of consistency and preparation of proposal for hierarchical of conditions for debris flows. From the surveys it was possible to establish a relationship of conditions according to the scale of work, defining three levels: regional (1:250,000 to 1:100,000), Semi-Detail (1:50,000 to 1:25,000) and Detail (1: 10,000 or higher). The factors found were: concentration time, the flood wave, rain, landslide susceptibility (slope), drainage and development in the deposition. The project analyzed the results obtained from the questionnaires, which allowed the ranking of the constraints, contributing to weight constraints in studies of multicriteria mapping of susceptibility to the occurrence of debris flows. The study showed that the most of the analyzed datas were inconsistent because of the different opinion of the judges

Quality of life assessment septoplasty in patients with nasal obstruction

Naasal obstruction is a common complaint in the population. When caused by a deviated nasal septum, septoplasty is the procedure of choice for treating these patients. NOSE is a tool for assessing the disease-specific quality of life related to nasal obstruction. Aim: To assess the impact of septoplasty on patients with nasal obstruction secondary to deviated nasal septum based on the disease-specific quality-of-life questionnaire. Design: Prospective. Methods: Patients undergoing septoplasty with/without turbinectomy after no clinical improvement with medical treatment were assessed by the NOSE questionnaire before and 3 months after surgery. We evaluated the surgical improvement based on total score, the magnitude of the surgery in the disease-specific quality of life and the correlation between the preoperative score and postoperatively improvement. Results: Fourty-six patients were included in the study. There was a statistically significant improvement in the preoperative NOSE score (md = 75, IQR = 26) and after three months (md = 10, IQR = 20) (p < 0.001.T-Wilcoxon). The standardized response mean was 3.07. We found a strong correlation between the preoperative score in the NOSE questionnaire and improvements in the postoperative period (r = -0.789, p < 0.001, Spearman). No difference was found in improvement scores by gender. (p = 0.668, U-Mann-Whitney). Conclusion: Septoplasty resulted in a statistically significant improvement in the disease-specific QOL questionnaire.