Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?

Web surveys are becoming increasingly popular in survey research including stated preference surveys. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. This is the first study that tests whether the use of mobile devices, tablets or smartphones, affects survey characteristics and stated preferences in a web-based choice experiment. The web survey on expanding renewable energy production in Germany was carried out with 3182 respondents, of which 12% used a mobile device. Propensity score matching is used to account for selection bias in the use of mobile devices for survey completion. We find that mobile device users spent more time than desktop/laptop users to answer the survey. Yet, desktop/laptop users and mobile device users do not differ in acquiescence tendency as an indicator of extreme response patterns. For mobile device users only, we find a negative correlation between screen size and interview length and a positive correlation between screen size and acquiescence tendency. In the choice experiment data, we do not find significant differences in the tendency to choose the status quo option and scale between both subsamples. However, some of the estimates of implicit prices differ, albeit not in a unidirectional fashion. Model results for mobile device users indicate a U-shaped relationship between error variance and screen size. Together, the results suggest that using mobile devices is not detrimental to survey quality.

Comparability of skin screening histories obtained by telephone interviews and mailed questionnaires: A randomized crossover study

The comparability of information collected through telephone interviews and information collected through mailed questionnaires has not been well studied. As part of the first phase of a randomized controlled trial of population screening for melanoma in Queensland, Australia, the authors compared histories of skin examination reported in telephone interviews and self-administered mailed questionnaires. A total of 1,270 subjects each completed a telephone interview and a mailed questionnaire 1 month apart in 1999; 564 subjects received the interview first, and 706 received the mailed questionnaire first. Agreement between the two methods was 91.2% and 88.6% for whole-body skin examination by a physician in the last 12 months and the last 3 years, respectively, and 81.9% for whole-body skin self-examination in the last 12 months. Agreement was lower for any skin self-examination. Agreement between the two methods was similar regardless of whether the interview or the questionnaire was administered first. Missing data were less frequent for interviews (0.5%) than for mailed questionnaires (3.8%). Costs were estimated at A$9.55 (US$6.21) per completed interview and A$3.01 (US$1.96) per questionnaire. The similarity of results obtained using telephone interviews and mailed questionnaires, coupled with the substantially higher cost of telephone interviews, suggests that self-administered mailed questionnaires are an appropriate method of assessing this health behavior.

Differences in mail and telephone responses to self-rated health: use of multiple imputation in correcting for response bias

Objectives: To estimate differences in self-rated health by mode of administration and to assess the value of multiple imputation to make self-rated health comparable for telephone and mail. Methods: In 1996, Survey 1 of the Australian Longitudinal Study on Women's Health was answered by mail. In 1998, 706 and 11,595 mid-age women answered Survey 2 by telephone and mail respectively. Self-rated health was measured by the physical and mental health scores of the SF-36. Mean change in SF-36 scores between Surveys 1 and 2 were compared for telephone and mail respondents to Survey 2, before and after adjustment for socio-demographic and health characteristics. Missing values and SF-36 scores for telephone respondents at Survey 2 were imputed from SF-36 mail responses and telephone and mail responses to socio-demographic and health questions. Results: At Survey 2, self-rated health improved for telephone respondents but not mail respondents. After adjustment, mean changes in physical health and mental health scores remained higher (0.4 and 1.6 respectively) for telephone respondents compared with mail respondents (-1.2 and 0.1 respectively). Multiple imputation yielded adjusted changes in SF-36 scores that were similar for telephone and mail respondents. Conclusions and Implications: The effect of mode of administration on the change in mental health is important given that a difference of two points in SF-36 scores is accepted as clinically meaningful. Health evaluators should be aware of and adjust for the effects of mode of administration on self-rated health. Multiple imputation is one method that may be used to adjust SF-36 scores for mode of administration bias.

A survey of e-mentoring among New Zealand midwives

Mentoring is a strategy that may assist the midwifery profession to support new graduates and midwives working in rural and remote areas. We conducted a survey of 1577 New Zealand midwives about their opinions and experiences of mentoring. The questionnaire comprised 33 questions, nine of which were open questions. There was a 44% response rate. While the telephone was commonly utilized by mentors (37%) and mentored midwives (37%), the Internet and email played only a small part. Participants acknowledged the potential of these avenues for communication, but midwives felt that mentoring could be provided only by immediate, face-to-face contact. Nevertheless, e-mentoring could be a viable option and requires further investigation. About one-third of midwives identified geographical isolation as a barrier to being a mentor (38%) and being mentored (36%). The use of e-mentoring could remove the barrier of location and allow the midwife to chose a mentor who meets her needs, rather than because she is the only mentor available.

Evaluation of Mobile Telephone Text Message Reminders for People with Antipsychotic Medication

Nonadherence to treatment is a worldwide problem among people with severe mental disorders. Patient treatment adherence may be supported with simple reminding methods e.g. text message reminders. However, there is limited evidence of its benefits. Intervention evaluation is essential in mHealth research. Therefore, this evaluative study was conducted. This study aimed to evaluate text message reminder use in encouraging patients’treatment adherence among people with antipsychotic medication. The data were collected between September 2011 and December 2013. First, a systematic literature review revealed that text message reminders were widely used in healthcare. However, its impacts were conflicting. Second, a sub-sample (n = 562) analysis showed that patients preferred humorous text message reminders and preferred to receive them in the morning, at the beginning of the week. Age, gender and marital status seemed to have different effects on the preferred amount and timing of the selected reminders. Third, a cross-sectional survey revealed that people with antipsychotic medication (n = 408) expressed overall satisfaction towards the reminder system. Finally, the evaluative design showed that patient recruitment for a randomized controlled trial concerning people with antipsychotic medication was challenging due to low rates of eligible participants. Follow-up drop-out rates varied depending on the data collection method. Participants’ demographic characteristics were associated with the risk of dropping out from the trial. This study suggests that text messages are a potential reminder system in healthcare services among people with antipsychotic medication. More research is needed to gain a comprehensive picture of the impacts and effectiveness of text message reminders.

Survey design: Insights from a public sector ERP success story

Research on the impact of Information Systems (IS) reported in both academic literature and popular press has reported confounding results. Some studies have reported encouraging results of IS, while others have reported nil or detrimental results. The contradictory results of these research studies can be partially attributed to the weaknesses in survey instruments. In an attempt to increase the validity of conclusions of IS assessment studies, survey instrument design should follow a rigorous and scientific procedure. This paper illustrates key validity and reliability issues in measuring Information Systems performance, using examples from a study designed to assess Enterprise Resource Planning systems success. The article emphasizes on the importance of the survey method and the theoretical considerations of item derivation, scale development and item evaluation. Examples are provided from the ERP assessment study to supplement the readers understanding of the theoretical concepts of survey design.

Australian national survey: preliminary findings

The National survey was the third phase in an ongoing initiative to identify critical success factors in ICT mediated supply chains. This study has been designed to harness the tacit and explicit knowledge to be found on the subject from the widest range of appropriate sources. At its core is the assumption that, provided with the fullest list of candidate success factors, a representative sample of experienced industry-based practitioners will (with the aid of statistical analysis) reveal a set of critical success factors. A postal survey has been judged to be the most appropriate mechanism for achieving this outcome.

Brite innovation survey : executive summary

This report summarises the fi ndings of an innovation survey of the Australian construction industry undertaken by the BRITE Project of the CRC for Construction Innovation in 2004. The BRITE Innovation Survey can be viewed in full at www.brite.crcci.info.The objective of the BRITE project is to improve the incidence and quality of innovation in the Australian construction industry. Many stakeholders in the industry are sceptical about the potential for innovation and its likely benefi ts. Many also lack the linkages and capabilities required for successful innovation. The BRITE Project is redressing this situation through demonstration and benchmarking activities. The term ‘innovation’ is defi ned as a new or signifi cantly improved technology or advanced business practice. Innovation may be technological or organisational, and it may be new to the world, or just new to the industry or business concerned. The defi nition includes the adoption of existing advancements developed outside a particular business. The survey sample was drawn from 3,500 businesses in the road/bridge and commercial building sectors in New South Wales, Victoria and Queensland, covering main contractors, trade contractors, consultants, suppliers and clients. Onethird of this population was sampled and a response rate of almost 30% was achieved. The survey collected information about respondents’ perceptions of innovation determinants in the industry, comprising various aspects of business strategy and business environment.