A productivity map of cognitive pretest methods for improving survey questions

Resumen tomado de la publicaci??n

Feasibility planning study for a behavior data base. Volume 1 - summary. Volume 2 - appendix A: summary information on the drinking and driving and occupant restraint surveys. Volume 3 - appendix B: compendium of survey questions on drinking and driving and occupant restraints. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Week 8 Survey presentation

A few survey questions asked during Week 8 (Semester 1) 2007/08

How do people perceive, understand, and anticipate responding to flash flood risks and warnings? Results from a public survey in Boulder, Colorado, USA

This study investigates flash flood forecast and warning communication, interpretation, and decision making, using data from a survey of 418 members of the public in Boulder, Colorado, USA. Respondents to the public survey varied in their perceptions and understandings of flash flood risks in Boulder, and some had misconceptions about flash flood risks, such as the safety of crossing fast-flowing water. About 6% of respondents indicated consistent reversals of US watch-warning alert terminology. However, more in-depth analysis illustrates the multi-dimensional, situationally dependent meanings of flash flood alerts, as well as the importance of evaluating interpretation and use of warning information along with alert terminology. Some public respondents estimated low likelihoods of flash flooding given a flash flood warning; these were associated with lower anticipated likelihood of taking protective action given a warning. Protective action intentions were also lower among respondents who had less trust in flash flood warnings, those who had not made prior preparations for flash flooding, and those who believed themselves to be safer from flash flooding. Additional analysis, using open-ended survey questions about responses to warnings, elucidates the complex, contextual nature of protective decision making during flash flood threats. These findings suggest that warnings can play an important role not only by notifying people that there is a threat and helping motivate people to take protective action, but also by helping people evaluate what actions to take given their situation.

Deakin Studies Online student survey 2004/2005

The data was collected to gauge Deakin University students' perceptions of the university's centralised learning management system, especially if it enhanced their learning experience. It identified the features that were most used and valued by the students and those they felt could be improved.

The dataset consists of a set of survey questions and the survey results in an electronic database. It comprises of 2908 responses from 2004 and 2526 responses from 2005; including approximately 1000 open-ended comments providing rich qualitative data.

The data includes the following categories of information:
• demographic and background information (including gender, mode of study);
• perception of importance of and satisfaction with a range of LMS functions;
• a number of overall LMS satisfaction measures; and
• open-ended written comments about the LMS.

Deakin Studies Online staff survey 2004/2005

The data was collected to guage Deakin University staff perceptions of the university's centralised learning management system, especially if it enhanced their teaching. It identified the features that were most used and valued by the teaching staff and those they felt could be improved.

The dataset is comprised of a set of survey questions and the survey results in an electronic database. It consists of 156 responses from 2004 and 120 responses from 2005; including approximately 100 open-ended comments providing rich qualitative data.

The data includes the following categories of information:
• demographic and background information (including gender, mode of study);
• perception of importance of and satisfaction with a range of LMS functions;
• a number of overall LMS satisfaction measures; and
• open-ended written comments about the LMS.

THE DESIGN AND DEVELOPMENT OF A SURVEY INSTRUMENT FOR THE ASSESSMENT OF OCCUPATIONAL STRESS

Using stress and coping as a unifying theoretical concept, a series of five models was developed in order to synthesize the survey questions and to classify information. These models identified the question, listed the research study, described measurements, listed workplace data, and listed industry and national reference data.^ A set of 38 instrument questions was developed within the five coping correlate categories. In addition, a set of 22 stress symptoms was also developed. The study was conducted within two groups, police and professors, on a large university campus. The groups were selected because their occupations were diverse, but they were a part of the same macroenvironment. The premise was that police officers would be more highly stressed than professors.^ Of a total study group of 80, there were 37 respondents. The difference in the mean stress responses was observable between the two groups. Not only were the responses similar within each group, but the stress level of response was also similar within each group. While the response to the survey instrument was good, only 3 respondents answered the stress symptom survey properly. It was determined that none of the 37 respondents believed that they were ill. This perception of being well was also evidenced by the grand mean of the stress scores of 2.76 (3.0 = moderate stress). This also caused fewer independent variables to be entered in the multiple regression model.^ The survey instrument was carefully designed to be universal. Universality is the ability to transcend occupational or regional definitions as applied to stress. It is the ability to measure responses within broad categories such as physiological, emotional, behavioral, social, and cognitive functions without losing the ability to measure the detail within the individual questions, or the relationships between questions and categories.^ Replication is much easier to achieve with standardized categories, questions, and measurement procedures such as those developed for the universal survey instrument. Because the survey instrument is universal it can be used as an analytical device, an assessment device, a basic tool for planning and a follow-up instrument to measure individual response to planned reductions in occupational stress. (Abstract shortened with permission of author.) ^

Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?

Web surveys are becoming increasingly popular in survey research including stated preference surveys. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. This is the first study that tests whether the use of mobile devices, tablets or smartphones, affects survey characteristics and stated preferences in a web-based choice experiment. The web survey on expanding renewable energy production in Germany was carried out with 3182 respondents, of which 12% used a mobile device. Propensity score matching is used to account for selection bias in the use of mobile devices for survey completion. We find that mobile device users spent more time than desktop/laptop users to answer the survey. Yet, desktop/laptop users and mobile device users do not differ in acquiescence tendency as an indicator of extreme response patterns. For mobile device users only, we find a negative correlation between screen size and interview length and a positive correlation between screen size and acquiescence tendency. In the choice experiment data, we do not find significant differences in the tendency to choose the status quo option and scale between both subsamples. However, some of the estimates of implicit prices differ, albeit not in a unidirectional fashion. Model results for mobile device users indicate a U-shaped relationship between error variance and screen size. Together, the results suggest that using mobile devices is not detrimental to survey quality.

Fluid resuscitation practice patterns in intensive care units of the USA: a cross-sectional survey of critical care physicians.

BACKGROUND: Fluid resuscitation is a cornerstone of intensive care treatment, yet there is a lack of agreement on how various types of fluids should be used in critically ill patients with different disease states. Therefore, our goal was to investigate the practice patterns of fluid utilization for resuscitation of adult patients in intensive care units (ICUs) within the USA. METHODS: We conducted a cross-sectional online survey of 502 physicians practicing in medical and surgical ICUs. Survey questions were designed to assess clinical decision-making processes for 3 types of patients who need volume expansion: (1) not bleeding and not septic, (2) bleeding but not septic, (3) requiring resuscitation for sepsis. First-choice fluid used in fluid boluses for these 3 patient types was requested from the respondents. Descriptive statistics were performed using a Kruskal-Wallis test to evaluate differences among the physician groups. Follow-up tests, including t tests, were conducted to evaluate differences between ICU types, hospital settings, and bolus volume. RESULTS: Fluid resuscitation varied with respect to preferences for the factors to determine volume status and preferences for fluid types. The 3 most frequently preferred volume indicators were blood pressure, urine output, and central venous pressure. Regardless of the patient type, the most preferred fluid type was crystalloid, followed by 5 % albumin and then 6 % hydroxyethyl starches (HES) 450/0.70 and 6 % HES 600/0.75. Surprisingly, up to 10 % of physicians still chose HES as the first choice of fluid for resuscitation in sepsis. The clinical specialty and the practice setting of the treating physicians also influenced fluid choices. CONCLUSIONS: Practice patterns of fluid resuscitation varied in the USA, depending on patient characteristics, clinical specialties, and practice settings of the treating physicians.

Prevalence and risk factors of childhood allergic diseases in eight metropolitan cities in China: A multicenter study

Background Several studies conducted during the past two decades suggested increasing trend of childhood allergic diseases in China. However, few studies have provided detailed description of geographic variation and explored risk factors of these diseases. This study investigated the pattern and risk factors of asthma, allergic rhinitis and eczema in eight metropolitan cities in China. Methods We conducted a cross-sectional survey during November-December 2005 in eight metropolitan cities in China. A total of 23791 children aged 6-13 years participated in this survey. Questions from the standard questionnaire of the International Study of Asthma and Allergies in Children (ISAAC) were used to examine the pattern of current asthma, allergic rhinitis and eczema. Logistic regression analyses were performed to assess the risk factors for childhood allergies. Results The average prevalence of childhood asthma, allergic rhinitis and eczema across the eight cities was 3∙3% (95% Confidence interval (CI): 3∙1%, 3∙6%), 9∙8% (95% CI: 9∙4%, 10∙2%) and 5∙5% (95% CI: 5∙2%, 5∙8%), respectively. Factors related to lifestyle, mental health and socio-economic status were found to be associated with the prevalence of childhood allergies. These risk factors were unevenly distributed across cities and disproportionately affected the local prevalence. Conclusions There was apparent geographic variation of childhood allergies in China. Socio-environmental factors had strong impacts on the prevalence of childhood allergies; but these impacts differed across regions. Thus public health policies should specifically target at the local risk factors for each individual area.

Comparative eye tracking of experts and novices in web single sign-on

Security indicators in web browsers alert users to the presence of a secure connection between their computer and a web server; many studies have shown that such indicators are largely ignored by users in general. In other areas of computer security, research has shown that technical expertise can decrease user susceptibility to attacks. In this work, we examine whether computer or security expertise affects use of web browser security indicators. Our study takes place in the context of web-based single sign-on, in which a user can use credentials from a single identity provider to login to many relying websites; single sign-on is a more complex, and hence more difficult, security task for users. In our study, we used eye trackers and surveyed participants to examine the cues individuals use and those they report using, respectively. Our results show that users with security expertise are more likely to self-report looking at security indicators, and eye-tracking data shows they have longer gaze duration at security indicators than those without security expertise. However, computer expertise alone is not correlated with recorded use of security indicators. In survey questions, neither experts nor novices demonstrate a good understanding of the security consequences of web-based single sign-on.

Pre-service Physical Education teachers and concerns regarding their ability to successfully facilitate school-based physical activity promotion strategies

Regular physical activity (PA) in youth has numerous immediate and long-term health benefits. With several studies indicating low levels of youth PA globally, schools settings have become increasingly critical settings for youth health promotion strategies. The role of physical education (PE) teachers has long been considered central to the facilitation of such strategies. However, PE teachers have a selfreported lack of knowledge, skills, understanding, and competence to successfully implement these strategies. Tertiary education programs are fundamental to adequately preparing, and shaping the attitudes and philosophies of future PE teachers towards their involvement within these programs. The aim of this investigation was to explore the beliefs and perceptions of future secondary school PE teachers, regarding their potential roles in future school-based programs designed to promote student PA. Fifty-seven (21 males and 36 females) pre-service PE teachers completed a series of open-ended survey questions concerning their perceptions towards participating in school-based PA promotion programs both as preservice during practicum, and prospectively as practising teachers. Responses were analysed thematically. Participants responded both positively and enthusiastically to both questions. Concerns regarding time, and the intention or expectation to participate in such programs were also key themes for pre-service and practicing teacher participation respectively. Critically in this study, participants did not identify any limitations which may impact upon their ability to successfully promote youth PA in school settings. This may indicate that participants have misconceptions regarding their ability to fulfil this role, or conversely, the deficiency of current PE teachers regarding school-based PA promotion has been recognised by the tertiary institution, and addressed to adequately prepare its students. School-based PA promotion is an integral element of pre-service PE teacher education, and ongoing professional development of practicing PE teachers. This trend is expected to continue in the future, in order to address ongoing public health concerns.

Integration of Saudi Arabia’s conservative Islamic culture in sustainable housing design

The cities of Saudi Arabia have perhaps the largest growth rates of cities in the Middle East, such that it has become a cause in shortage of housing for mid and low-income families, as is the case in other developing countries. Even when housing is found, it is not sustainable nor is it providing the cultural needs of those families. The aim of this paper is to integrate the unique conservative Islamic Saudi culture into the design of sustainable housing. This paper is part of a preliminary study of an on-going PhD thesis, which utilises a semistructured interview of a panel of nine experts in collecting the data. The interviews consisted of ten questions ranging from general questions such as stating their expertise and work position to more specific question such as listing the critical success factors and/or barriers for applying sustainability to housing in Saudi Arabia. Since the participants were selected according to their experience, the answers to the interview questions were satisfactory where the generation of the survey questions for the second stage in the PhD thesis took place after analysing the participant’s answers to the interview questions. This paper recommends design requirements for accommodating the conservative Islamic Saudi Culture in low cost sustainable houses. Such requirements include achieving privacy through the use of various types of traditional Saudi architectural elements, such as the method of decorative screening of windows, called Mashrabiya, and having an inner courtyard where the house looks inward rather than outward. Other requirements include educating firms on how to design sustainable housing, educating the public on the advantages of sustainable housing and implementing new laws that enforce the utilisation of sustainable methods to housing construction. This paper contributes towards the body of knowledge by proposing initial findings on how to integrate the conservative Islamic culture of Saudi Arabia into the design of a sustainable house specifically for mid and low-income families. This contribution can be implemented on developing countries in the region that are faced with housing shortage for mid and low-income families.

Are mothers of young children really inactive?

Australian surveys have found that only 43% of women meet the current recommendation for regular moderate physical activity, and that women who are mothers of young children are even less likely to be adequately active for health benefit. These women spend a significant proportion of their day in occupational, household and care-giving activities, which may not be ‘captured’ in conventional physical activity surveys. The purpose of this study was to compare physical activity in young mothers and age-matched controls using three different measures of physical activity. 35 women (16 mothers of young children, M) and 19 age-matched comparison women (NM) completed a survey which asked about walking to and from places, and about moderate and vigorous activity in leisure time and at work (paid and unpaid). They also kept a detailed diary of all their activities for two week-days and two week-end days, and wore a pedometer (Yamax digiwalker) on these days. Each activity in the diary was assigned an energy expenditure (EE) score based on it's intensity (Compendium of Physical Activity) and time spent in that activity. There were no differences between M and NM for pedometer steps (M: 9270 sd 2947; NM: 9768 sd 3051) or for daily energy expenditure (EE) calculated from the diaries (M: 2029 sd 189; NM: 2015 sd 169 METS.mins) or survey (M: 2079 sd 448; NM: 1495 sd 325). There was a significant correlation between pedometer steps and daily METs.mins estimated from the diaries (r = 0.35, p = 0.04); however no relationship was observed between pedometer steps and EE from the survey (r = .09, p = .56). Further analysis of the individual survey items found pedometer steps to be related to EE from walking to and from places (r = .34) and leisure time (r = .31), but not work related activity (r = -.08). There were no significant relationships between EE computed from the diaries and any of the survey questions. The three activity measures indicate that the physical activity levels of the young mothers in our sample were comparable to age-matched non-mothers. The results of the correlation analyses highlight the difficulty of assessing low-intensity work-related physical activity via self-report. Supported by Australian Commonwealth Department of Health and Aged Care.