How important are interview methods and questionnaire designs in research on self-reported juvenile delinquency? An experimental comparison of internet vs. paper-and-pencil questionnaires and different definitions of the reference period

There has been relatively little change over recent decades in the methods used in research on self-reported delinquency. Face-to-face interviews and selfadministered interviews in the classroom are still the predominant alternatives envisaged. New methods have been brought into the picture by recent computer technology, the Internet, and an increasing availability of computer equipment and Internet access in schools. In the autumn of 2004, a controlled experiment was conducted with 1,203 students in Lausanne (Switzerland), where "paper-and-pencil" questionnaires were compared with computer-assisted interviews through the Internet. The experiment included a test of two different definitions of the (same) reference period. After the introductory question ("Did you ever..."), students were asked how many times they had done it (or experienced it), if ever, "over the last 12 months" or "since the October 2003 vacation". Few significant differences were found between the results obtained by the two methods and for the two definitions of the reference period, in the answers concerning victimisation, self-reported delinquency, drug use, failure to respond (missing data). Students were found to be more motivated to respond through the Internet, take less time for filling out the questionnaire, and were apparently more confident of privacy, while the school principals were less reluctant to allow classes to be interviewed through the Internet. The Internet method also involves considerable cost reductions, which is a critical advantage if self-reported delinquency surveys are to become a routinely applied method of evaluation, particularly so in countries with limited resources. On balance, the Internet may be instrumental in making research on self-reported delinquency far more feasible in situations where limited resources so far have prevented its implementation.

Trends in drug use among students in Brazil: analysis of four surveys in 1987, 1989, 1993 and 1997

The consumption of psychotropic drugs among Brazilian secondary school students was examined by comparing data from four surveys using a questionnaire adapted from the WHO's Program on Research and Reporting on the Epidemiology of Drug Dependence. Students filled out the form in their classrooms without the presence of teachers. The target population consisted of 10-18-year-old students (on average, 15,000 students responded to each survey) in Brazil's ten largest state capitals: Belém, Belo Horizonte, Brasília, Curitiba, Fortaleza, Porto Alegre, Recife, Rio de Janeiro, Salvador, and São Paulo. Among the legal drugs, lifetime use (use at least once during life) of tobacco was increased in seven cities (the exceptions were Brasília, Porto Alegre and Rio de Janeiro). There was also a significant increase in frequent use of alcohol (six times or more per month) in 6 of the cities, from an average of 9.2% in 1987 to 15.0% in 1997. With respect to illegal drugs, there was a significant increase in lifetime use of marijuana (a 3-fold increase from 2.8% in 1987 to 7.6% in 1997). Cocaine use increased 4-fold over the survey period (0.5% in 1987 to 2.0% in 1997). Lifetime use of cocaine significantly increased in eight capitals (except Recife and Rio de Janeiro). However, frequent cocaine use increased in only three capitals (Belém, Fortaleza and Porto Alegre), from an average of 1.0% in 1987 to 3.6% in 1997. Lifetime use of medications such as anxiolytics and amphetamines increased 2-fold on average over the survey period. Comparing the four studies, the main conclusion is that there were significant increases in the frequencies for lifetime use, frequent use and heavy use of many drugs.

Comparaison de la victimisation des jeunes telle qu’observée dans la traduction du Juvenile Victimisation Questionnaire et l’Enquête Sociale Générale

L’objectif de la recherche est de comparer une traduction d’un questionnaire américain, le Juvenile Victimization Questionnaire (JVQ) avec un questionnaire de victimisation préexistant au Canada, l’Enquête Sociale Générale (ESG). À l’aide d’une base de données formée par le JVQ en 2009, une comparaison a été conduite entre les victimisations de 783 jeunes âgés entre 15 et 17 ans afin de les comparer avec les victimisations de 631 jeunes âgés entre 15 et 17 ans de la base de données de l’ESG de 2009. Sur la majorité des points de comparaison établis entre les deux questionnaires, il existe des différences significatives entre les résultats obtenus par le JVQ et l’ESG. Pour les comparaisons des taux de victimisation des 12 derniers mois, 3 des 8 taux de victimisation comparés étaient similaires. Pour les comparaisons des taux de victimisation à vie, les 7 taux comparés étaient significativement différents. Cependant, il existe des explications méthodologiques et échantillonnales afin de rendre compte de ces différences. Les résultats indiquent qu’avec les différences inhérentes aux deux questionnaires, les échantillons des 15 à 17 ans présentent des taux relativement différents. Il est possible de valider l’utilisation du JVQ sur la population afin de recueillir des informations fiables sur la victimisation. Toutefois, en comparant les différentes questions individuellement, il est possible d’apporter des améliorations aux deux questionnaires utilisés.

Towards an information society measurement instrument for Latin America and the Caribbean: getting started with census, household and business surveys

Includes bibliography

Questionnaire and survey methodology. Saint Lucia: Survey of living condition and household budgets 2005/2006

This manual documents some of the material related to the Survey of Living Conditions and Household Budgets (SLC/HBS) conducted in Saint Lucia by the Kairi Consultants Limited and National Assessment Team between 2005 and 2006. The SLC/HBS is a sample survey which generates data on households and individuals in the country. The main objectives of this survey were (i) to collect information from households on their expenditure patterns, income and other characteristics and; (ii) to revise the 'average shopping basket' used in constructing the Consumer Price Index (CPI) for the country, and the relative weights of the items in the basket. The survey also provided valuable data for an assessment of the impact of socio-economic policies on the living conditions of the resident population in Saint Lucia. Further, data on households gathered in the survey also provide valuable inputs for the compilation of the country's National Accounts statistics relating to the household sector. This manual was developed by the Economic Commission for Latin America and the Caribbean (ECLAC) – Subregional Headquarters in the Caribbean as a supplementary document for the Caribbean Household Surveys Database (CHSD). The main components of this manual include survey methodology and the questionnaires used for data collection. The latter are included in the annex at the end of the document. All information contained therein was provided by the Statistics Department in Saint Lucia. The ECLAC Subregional Headquarters for the Caribbean is pleased to acknowledge the Saint Lucia Statistics Department for graciously consenting to the use of their surveys and metadata under the project Improving Caribbean Household Surveys. Due recognition must also be given to the Statistics and Economics Projection Division at ECLAC (Santiago) who provided guidance in the standardization of the datasets and the creation of the Caribbean Household Surveys Databank.

Validation of the Short-Version of Rose Angina Questionnaire in Brazil

Background: Stable angina pectoris is a serious condition with few epidemiological studies in Brazil. Objective: To validate the short-version of the Rose angina questionnaire in Brazilian Portuguese for its implementation in surveys and longitudinal studies. Methods: A total of 116 consecutive patients from an outpatient clinic without prior myocardial infarction and/or coronary revascularization were enrolled for application of three questions of the Rose angina questionnaire addressing chest pain after exertion. We used the treadmill test as the gold standard with the Ellestad protocol. Results: The short-version of the Rose angina questionnaire of the 116 subjects submitted to the exercise treadmill test disclosed 89.7% of accuracy, 25% of sensitivity, 92.0% of specificity, 10.0% of positive predictive value, 97.2% of negative predictive value, and 3.1 of positive likelihood ratio and 0.82 of negative likelihood ratio. Conclusion: The Portuguese version with three items of the Rose angina questionnaire is suitable for epidemiological purposes. (Arq Bras Cardiol 2012; 99(5): 1056-1059)

The GABRIEL Advanced Surveys: study design, participation and evaluation of bias

Exposure to farming environments has been shown to protect substantially against asthma and atopic disease across Europe and in other parts of the world. The GABRIEL Advanced Surveys (GABRIELA) were conducted to determine factors in farming environments which are fundamental to protecting against asthma and atopic disease. The GABRIEL Advanced Surveys have a multi-phase stratified design. In a first-screening phase, a comprehensive population-based survey was conducted to assess the prevalence of exposure to farming environments and of asthma and atopic diseases (n = 103,219). The second phase was designed to ascertain detailed exposure to farming environments and to collect biomaterial and environmental samples in a stratified random sample of phase 1 participants (n = 15,255). A third phase was carried out in a further stratified sample only in Bavaria, southern Germany, aiming at in-depth respiratory disease and exposure assessment including extensive environmental sampling (n = 895). Participation rates in phase 1 were around 60% but only about half of the participating study population consented to further study modules in phase 2. We found that consenting behaviour was related to familial allergies, high parental education, wheeze, doctor diagnosed asthma and rhinoconjunctivitis, and to a lesser extent to exposure to farming environments. The association of exposure to farm environments with asthma or rhinoconjunctivitis was not biased by participation or consenting behaviour. The GABRIEL Advanced Surveys are one of the largest studies to shed light on the protective 'farm effect' on asthma and atopic disease. Bias with regard to the main study question was able to be ruled out by representativeness and high participation rates in phases 2 and 3. The GABRIEL Advanced Surveys have created extensive collections of questionnaire data, biomaterial and environmental samples promising new insights into this area of research.

Erosive tooth wear and wedge-shaped defects in 1996 and 2006: cross- sectional surveys of Swiss army recruits.

The purpose of this study was to determine the prevalence and possible etiological factors of erosive tooth wear and wedge-shaped defects in Swiss Army recruits and compare the findings with those of an analogous study conducted in 1996. In 2006, 621 recruits between 18 and 25 years of age (1996: 417 recruits; ages 19 to 25) were examined for erosive tooth wear and wedge-shaped defects. Additional data was acquired using a questionnaire about personal details, education, dentitions subjective condition, oral hygiene, eating and drinking habits, medications used, and general medical problems. In 2006, 60.1% of those examined exhibited occlusal erosive tooth wear not involving the dentin (1996: 82.0%) and 23.0% involving the dentin (1996: 30.7%). Vestibular erosive tooth wear without dentin involvement was seen in 7.7% in 2006 vs. 14.4% in 1996. Vestibular erosive tooth wear with dentin involvement was rare in both years (0.5%). Oral erosive tooth wear lacking exposed dentin was also rare in those years, although more teeth were affected in 2006 (2.1%) than in 1996 (0.7%). The examinations in 2006 found one or more initial wedge-shaped lesions in 8.5% of the recruits, while 20.4% of the study participants exhibited such in 1996. In 1996, 53% consumed acidic foods and beverages more than 5 times/day; in 2006, 83.9% did so. In neither study did multivariate regression analyses show any significant correlations between occurrence and location of erosive tooth wear and wedge-shaped defects and various other parameters, e.g., eating and hygiene habits, or dentin hyper-sensitivity. Despite a significant increase in consumption of acidic products between 1996 and 2006, the latter study found both fewer erosive tooth wear and fewer wedge-shaped defects (i.e., fewer non-carious lesions.).

"Attacks" or "Whistling": Impact of Questionnaire Wording on Wheeze Prevalence Estimates.

BACKGROUND Estimates of prevalence of wheeze depend on questionnaires. However, wording of questions may vary between studies. We investigated effects of alternative wording on estimates of prevalence and severity of wheeze, and associations with risk factors. METHODS White and South Asian children from a population-based cohort (UK) were randomly assigned to two groups and followed up at one, four and six years (1998, 2001, 2003). Parents were asked either if their child ever had "attacks of wheeze" (attack group, N=535), or "wheezing or whistling in the chest" (whistling group, N=2859). All other study aspects were identical, including questions about other respiratory symptoms. RESULTS Prevalence of wheeze ever was lower in the attack group than in the whistling group for all surveys (32 vs. 40% in white children aged one year, p<0.001). Prevalence of other respiratory symptoms did not differ between groups. Wheeze tended to be more severe in the attack group. The strength of association with risk factors was comparable in the two groups. CONCLUSIONS The wording of questions on wheeze can affect estimates of prevalence, but has less impact on measured associations with risk factors. Question wording is a potential source of between-study-heterogeneity in meta-analyses.

Census reform : questionnaire test shows simplification holds promise /

"July 1, 1992."

Test-retest reliability of four physical activity measures used in population surveys

Accurate monitoring of prevalence and trends in population levels of physical activity (PA) is a fundamental public health need. Test-retest reliability (repeatability) was assessed in population samples for four self-report PA measures: the Active Australia survey (AA, N=356), the short International Physical Activity Questionnaire (IPAQ, N=104), the physical activity items in the Behavioral Risk Factor Surveillance System (BRFSS, N=127) and in the Australian National Health Survey (NHS, N=122). Percent agreement and Kappa statistics were used to assess reliability of classification of activity status as 'active', 'insufficiently active' or 'sedentary'. Intraclass correlations (ICCs) were used to assess agreement on minutes of activity reported for each item of each survey and for total minutes. Percent agreement scores for activity status were very good on all four instruments, ranging from 60% for the NHS to 79% for the IPAQ. Corresponding Kappa statistics ranged from 0.40 (NHS) to 0.52 (AA). For individual items, ICCs were highest for walking (0.45 to 0.78) and vigorous activity (0.22 to 0.64) and lowest for the moderate questions (0.16 to 0.44). All four measures provide acceptable levels of test-retest reliability for assessing both activity status and sedentariness, and moderate reliability for assessing total minutes of activity.

Online-questionnaire design:establishing guidelines and evaluating existing eupport

As a new medium for questionnaire delivery, the internet has the potential to revolutionise the survey process. Online (web-based) questionnaires provide several advantages over traditional survey methods in terms of cost, speed, appearance, flexibility, functionality, and usability [1, 2]. For instance, delivery is faster, responses are received more quickly, and data collection can be automated or accelerated [1- 3]. Online-questionnaires can also provide many capabilities not found in traditional paper-based questionnaires: they can include pop-up instructions and error messages; they can incorporate links; and it is possible to encode difficult skip patterns making such patterns virtually invisible to respondents. Like many new technologies, however, online-questionnaires face criticism despite their advantages. Typically, such criticisms focus on the vulnerability of online-questionnaires to the four standard survey error types: namely, coverage, non-response, sampling, and measurement errors. Although, like all survey errors, coverage error (“the result of not allowing all members of the survey population to have an equal or nonzero chance of being sampled for participation in a survey” [2, pg. 9]) also affects traditional survey methods, it is currently exacerbated in online-questionnaires as a result of the digital divide. That said, many developed countries have reported substantial increases in computer and internet access and/or are targeting this as part of their immediate infrastructural development [4, 5]. Indicating that familiarity with information technologies is increasing, these trends suggest that coverage error will rapidly diminish to an acceptable level (for the developed world at least) in the near future, and in so doing, positively reinforce the advantages of online-questionnaire delivery. The second error type – the non-response error – occurs when individuals fail to respond to the invitation to participate in a survey or abandon a questionnaire before it is completed. Given today’s societal trend towards self-administration [2] the former is inevitable, irrespective of delivery mechanism. Conversely, non-response as a consequence of questionnaire abandonment can be relatively easily addressed. Unlike traditional questionnaires, the delivery mechanism for online-questionnaires makes estimation of questionnaire length and time required for completion difficult1, thus increasing the likelihood of abandonment. By incorporating a range of features into the design of an online questionnaire, it is possible to facilitate such estimation – and indeed, to provide respondents with context sensitive assistance during the response process – and thereby reduce abandonment while eliciting feelings of accomplishment [6]. For online-questionnaires, sampling error (“the result of attempting to survey only some, and not all, of the units in the survey population” [2, pg. 9]) can arise when all but a small portion of the anticipated respondent set is alienated (and so fails to respond) as a result of, for example, disregard for varying connection speeds, bandwidth limitations, browser configurations, monitors, hardware, and user requirements during the questionnaire design process. Similarly, measurement errors (“the result of poor question wording or questions being presented in such a way that inaccurate or uninterpretable answers are obtained” [2, pg. 11]) will lead to respondents becoming confused and frustrated. Sampling, measurement, and non-response errors are likely to occur when an online-questionnaire is poorly designed. Individuals will answer questions incorrectly, abandon questionnaires, and may ultimately refuse to participate in future surveys; thus, the benefit of online questionnaire delivery will not be fully realized. To prevent errors of this kind2, and their consequences, it is extremely important that practical, comprehensive guidelines exist for the design of online questionnaires. Many design guidelines exist for paper-based questionnaire design (e.g. [7-14]); the same is not true for the design of online questionnaires [2, 15, 16]. The research presented in this paper is a first attempt to address this discrepancy. Section 2 describes the derivation of a comprehensive set of guidelines for the design of online-questionnaires and briefly (given space restrictions) outlines the essence of the guidelines themselves. Although online-questionnaires reduce traditional delivery costs (e.g. paper, mail out, and data entry), set up costs can be high given the need to either adopt and acquire training in questionnaire development software or secure the services of a web developer. Neither approach, however, guarantees a good questionnaire (often because the person designing the questionnaire lacks relevant knowledge in questionnaire design). Drawing on existing software evaluation techniques [17, 18], we assessed the extent to which current questionnaire development applications support our guidelines; Section 3 describes the framework used for the evaluation, and Section 4 discusses our findings. Finally, Section 5 concludes with a discussion of further work.

Sexual dysfunction in breast cancer survivors: cross-cultural adaptation of the Sexual Activity Questionnaire for use in Portugal

"Introduction: The increasing survivor population of breast cancer has shifted research and practice interests into the impacts of the disease and treatment in quality of life aspects. The lack of tools available in Portuguese to objectively evaluate sexual function led to the development of this study, which aimed to cross-culturally adapt and validate the Sexual Activity Questionnaire for use in Portugal. Material and Methods: The questionnaire was translated and back-translated, refined following face-to-face interviews with seven breast cancer survivors, and then self-administered by a larger sample at baseline and a fortnight later to test validity and reliability. Results: Following cognitive debriefing (n = 7), minor changes were made and the Sexual Activity Questionnaire was then tested with 134 breast cancer survivors. A 3-factor structure explained 75.5% of the variance, comprising the Pleasure, Habit and Discomfort scales, all yielding good internal consistency (Cronbach’s α > 0.70). Concurrent validity with the FACt-An and the BCPT checklist was good (Spearman’s r > 0.65; p-value < 0.001) and reliability acceptable (Cohen’s k > 0.444). The Sexual Activity Questionnaire allowed the identification of 23.9% of sexually inactive women, for whom the main reasons were lack of interest or motivation and not having a partner. Discussion: Patient-reported outcomes led to a more comprehensive and improved approach to cancer, tackling areas previously abandoned. Future research should focus on the validation of this scale in samples with different characteristics and even in the overall population to enable generalizability of the findings. Conclusion: The adapted Sexual Activity Questionnaire is a valid tool for assessing sexual function in breast cancer survivors in Portugal."

Psychometric Properties Evaluation Of A New Ergonomics-related Job Factors Questionnaire Developed For Nursing Workers.

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers.