Reliability assessments in qualitative health promotion research

This article contributes to the debate about the use of reliability assessments in qualitative research in general, and health promotion research in particular. In this article, I examine the use of reliability assessments in qualitative health promotion research in response to health promotion researchers’ commonly held misconception that reliability assessments improve the rigor of qualitative research. All qualitative articles published in the journal Health Promotion International from 2003 to 2009 employing reliability assessments were examined. In total, 31.3% (20/64) articles employed some form of reliability assessment. The use of reliability assessments increased over the study period, ranging from ,20% in 2003/2004 to 50% and above in 2008/2009, while at the same time the total number of qualitative articles decreased. The articles were then classified into four types of reliability assessments, including the verification of thematic codes, the use of inter-rater reliability statistics, congruence in team coding and congruence in coding across sites. The merits of each type were discussed, with the subsequent discussion focusing on the deductive nature of reliable thematic coding, the limited depth of immediately verifiable data and the usefulness of such studies to health promotion and the advancement of the qualitative paradigm.

Reliability and validity of psychosocial and environmental correlates measures of physical activity and screen-based behaviors among Chinese children in Hong Kong

Background : Insufficient participation in physical activity and excessive screen time have been observed among Chinese children. The role of social and environmental factors in shaping physical activity and sedentary behaviors among Chinese children is under-investigated. The purpose of the present study was to assess the reliability and validity of a questionnaire to measure child- and parent-reported psychosocial and environmental correlates of physical activity and screen-based behaviors among Chinese children in Hong Kong.

Methods : A total of 303 schoolchildren aged 9-14 years and their parents volunteered to participate in this study and 160 of them completed the questionnaire twice within an interval of 10 days. Intraclass correlation coefficients (ICCs), kappa statistics, and percent agreement were performed to evaluate test-retest reliability of the continuous and categorical variables, respectively. Exploratory factor analyses (EFAs) were conducted to assess convergent validity of the emergent scales. Cronbach's alpha and ICCs were performed to assess internal and test-retest reliability of the emergent scales. Criterion validity was assessed by correlating psychosocial and environmental measures with self-reported physical activity and screen-based behaviors, measured by a validated questionnaire.

Results : Reliability statistics for both child- and parent-reported continuous variables showed acceptable consistency for all of the ICC values greater than 0.70. Kappa statistics showed fair to perfect test-retest reliability for the categorical items. Adequate internal consistency and test-retest reliability were observed in most of the emergent scales. Criterion validity assessed by correlating psychosocial and environmental measures with child-reported physical activity found associations with physical activity in the self-efficacy scale (r = 0.25, P < 0.05), the peer support for physical activity scale (r = 0.25, P < 0.05) and home physical activity environmental (r = 0.14, P < 0.05). Children's screen-based behaviors were associated with the family support for physical activity scale (r = -0.22, P < 0.05) and parental role modeling of TV (r = 0.12, P = 0.053).

Conclusions : The findings provide psychometric support for using this questionnaire for examining psychosocial and environmental correlates of physical activity and screen-based behaviors among Chinese children in Hong Kong. Further research is needed to develop more robust measures based on the current questionnaire, especially for peer influence on physical activity and parental rules on screen-based behaviors.

Highway safety: reliability and validity of DOT crash tests.

Mode of access: Internet.

An in-service evaluation of the performance, reliability, maintainability, and durability of antilock braking systems (ABSs) for semitrailers. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

The factorial validity of emotional intelligence : an unresolved issue

An unresolved but pertinent issue in the field of emotional intelligence (EI) is factorial validity. Numerous studies have investigated this issue (Gignac, 2005; Mayer, Salovey, Caruso, & Sitarenios, 2003; Petrides & Furnham, 2000; Saklofske, Austin, & Minski, 2003), but most are based on correlations among subscale scores from relevant measures, making the implicit assumption that subscale scores are unidimensional, rather than questioning the structure of subscales themselves. Accordingly, the present study adopts the Anderson and Gerbing (1988) two-step strategy of first considering the structure within subscales before examining the relationship between subscales. An evaluation was undertaken using the Emotional Intelligence Scale (EIS, Schutte et al., 1998), the Work Profile Questionnaire – Emotional Intelligence Version (WQPei, Cameron, 1999) and the Mayer–Salovey–Caruso Emotional Intelligence Test (MSCEIT V.2., Mayer, Salovey, & Caruso, 1999b). Results were characterised by instability, heterogeneity and inconsistency. Specifically, the EIS was not found to form the homogenous structure postulated by authors. Similarly, support was not found for the seven factor model of the WPQei. Large discrepancies exist between the one, two and four factor models described by Mayer et al. (2003) for the MSCEIT V.2. and the 21 components revealed at the primary level in the current analyses. Additionally, reliability statistics for the MSCEIT V.2. were less than optimal. Questions remain regarding the clarity, reliability and validity of the instruments examined.

Qualidade em serviços de saúde: uma contribuição à definição de um modelo paramétrico e padrão de qualidade do tempo agendado para consulta ambulatorial

This work presents a study in quality of health care, with focus on consulting appointment. The main purpose is to define a statistical model and propose a quality grade of the consulting appointment time. The time considered is that from the day the patient get the appointment done to the day the consulting is realized. It is used reliability techniques and functions that has as main characteristic the analysis of data regarding the time of occurrence certain event. It is gathered a random sample of 1743 patients in the appointment system of a University Hospital - the Hospital Universitário Onofre Lopes - of the Federal University of Rio Grande do Norte, Brazil. The sample is randomly stratified in terms on clinical specialty. The data were analyzed against the parametric methods of the reliability statistics and the adjustment of the regression model resulted in the Weibull distribution being best fit to data. The quality grade proposed is based in the PAHO criteria for a consulting appointment and result that no clinic got the PAHO quality grade. The quality grade proposed could be used to define priority for improvement and as criteria to quality control

Tri-level study: modification. Task 3: validity assessment of police-reported accident data. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Statistical analysis of preliminary data for the safe performance curriculum driving knowledge test. Interim report.

DeKalb County School System, Decatur, Ga.

Ambulance electrical system study. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Results of automotive test equipment manufacturer interviews. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

A solid state digital data recorder for monitoring autmotive crash environments. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Program evaluation support for the motor vehicle diagnostic inspection demonstration projects. Volume III: Final evaluation report.

National Highway Traffic Safety Administration, Office of State Vehicle Programs, Washington, D.C.

Evaluation of screening breath testing in traffic law enforcement. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Energy use and other comparisons between diesel and gasoline pickup trucks. Interim report.

Transportation Systems Center, Cambridge, Mass.

Towards a low cost highly reliable anti-lock brake system for small motorcycles. Final report.

National Highway Traffic Safety Administration, Washington, D.C.