Development and validation of the influenza intensity and impact questionnaire (FluiiQ™)

Clinical trials of new agents to reduce the severity and impact of influenza require accurate assessment of the effect of influenza infection. Because there are limited high-quality adult influenza Patient Reported Outcomes (PRO) measures, the aim was to develop and validate a simple but comprehensive questionnaire for epidemiological research and clinical trials.

The inclusion of ‘then-test’ questions in post-test questionnaires alters post-test responses: a randomized study of bias in health program evaluation

Objectives Program evaluations are frequently based on ‘then-test’ data, i.e., pre-test collected in retrospect. While the application of the then-test has practical advantages, little is known about the validity of then-test data. Because of the collection of then-test in close proximity to post-test questions, this study was aimed at exploring whether the presence of then-test questions in post-test questionnaires influenced subjects’ responses to post-test.
Patients and methods To test the influence of then-test questions, we designed a randomized three-group study in the context of chronic disease self-management programs. Interventions had comparable goals and philosophies, and all 949 study participants filled out identical Health Education Impact Questionnaires (heiQ) at pre-test. At post-test, participants were then randomized to one of the following three groups: Group A responded to post-test questions only (n = 331); Group B filled out transition questions in addition to post-test (n = 304); and Group C filled out then-test questions in addition to post-test (n = 314).
Results Significant post-test differences were found in six of eight heiQ scales, with respondents who filled out then test questions reporting significantly higher post-test scores than respondents of the other groups.
Conclusions This study provides evidence that the inclusion of then-test questions alters post-test responses,
suggesting that change scores based on then-test data be interpreted with care.

Adaptation and validation of the Japanese version of the health education impact questionnaire (heiQ-J) for the evaluation of self-management education interventions

Aim:  

Cross-cultural adaption of the Health Educaiton Impact Questionnaire: experimental study showed expert committee, not back-translation, added value

Objectives
To assess the contribution of back-translation and expert committee to the content and psychometric properties of a translated multidimensional questionnaire.

Study Design and Setting
Recommendations for questionnaire translation include back-translation and expert committee, but their contribution to measurement properties is unknown. Four English to French translations of the Health Education Impact Questionnaire were generated with and without committee or back-translation. Face validity, acceptability, and structural properties were compared after random assignment to people with rheumatoid arthritis (N = 1,168), chronic renal failure (N = 2,368), and diabetes (N = 538). For face validity, 15 bilingual people compared translations quality with the original. Psychometric properties were examined using confirmatory factor analysis (metric and scalar invariance) and item response theory.

Results
Qualitatively, there were five types of translation errors: style, intensity, frequency/time frame, breadth, and meaning. Bilingual assessors ranked best the translations with committee (P = 0.0026). All translations had good structural properties (root mean square error of approximation <0.05; comparative fit index [CFI], ≥0.899; and Tucker–Lewis index, ≥0.889). Full measurement invariance was observed between translations (ΔCFI ≤ 0.01) with metric invariance between translations and original (lowest ΔCFI = 0.022 between fully constrained models and models with free intercepts). Item characteristic curve analyses revealed no significant differences.

Conclusion
This is the first experimental evidence that back-translation has moderate impact, whereas expert committee helps to ensure accurate content.

Development and validation of the influenza intensity and impact questionnaire (FluiiQ™)

Objective
Clinical trials of new agents to reduce the severity and impact of influenza require accurate assessment of the effect of influenza infection. Because there are limited high-quality adult influenza Patient Reported Outcomes (PRO) measures, the aim was to develop and validate a simple but comprehensive questionnaire for epidemiological research and clinical trials.

Methods
Construct and item generation was guided by the literature, concept mapping, focus groups, and interviews with individuals with laboratory-confirmed influenza and expert physicians. Items were administered to 311 people with influenza-like illness (ILI) across 25 US sites. Analyses included classic psychometrics, structural equation modeling (SEM), and Rasch analyses.

Results
Concept mapping generated 149 concepts covering the influenza experience and clustered into symptoms and impact on daily activities, emotions, and others. Items were drafted using simplicity and brevity criteria. Eleven symptoms from the literature underwent review by physicians and patients, and two were removed and one added. The symptoms domain factored into systemic and respiratory symptoms, whereas the impact domains were unidimensional. All domains displayed good internal consistency (Cronbach α ≥ 0.8) except the three-item respiratory domain (α = 0.48). A five-factor SEM indicated excellent fit where systemic, respiratory, and daily activities domains differentiated patients with ILI or confirmed influenza. All scales were responsive over time.

Conclusions
Patient and clinician consultations resulted in an influenza PRO measure with high validity and good overall evidence of reliability and responsiveness. The Influenza Intensity and Impact Questionnaire (FluiiQ™) will improve the evaluation of existing and future agents designed to prevent or control influenza infection by increasing the breadth and depth of measurement in this field.

The OPtimising HEalth LIterAcy (Ophelia) process: study protocol for using health literacy profiling and community engagement to create and implement health reform

Health literacy is a multi-dimensional concept comprising a range of cognitive, affective, social, and personal skills and attributes. This paper describes the research and development protocol for a large communities-based collaborative project in Victoria, Australia that aims to identify and respond to health literacy issues for people with chronic conditions. The project, called Ophelia (OPtimising HEalth LIterAcy) Victoria, is a partnership between two universities, eight service organisations and the Victorian Government. Based on the identified issues, it will develop and pilot health literacy interventions across eight disparate health services to inform the creation of a health literacy response framework to improve health outcomes and reduce health inequalities.

Factor structure and measurement invariance of the Health Education Impact Questionnaire: does the subjectivity of the response perspective threaten the contextual validity of inferences?

Objective:
On-going evidence is required to support the validity of inferences about change and group differences in the
evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.
Methods:
An archived dataset of responses to the most recent version of the English-language Health Education Impact
Questionnaire that uses four rather than six response options (N=3221) was analysed using exploratory structural equation
modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were
studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum
constraints necessary for model identification.
Results:
The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was
found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar
invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).
Conclusion:
The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre–post evaluation designs and system-level monitoring and evaluation.

Cultural adaptation and validation of the Health Literacy Questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model

Health literacy is an important construct in population health and healthcare requiring rigorous measurement. The Health Literacy Questionnaire (HLQ), with nine scales, measures a broad perception of health literacy. This study aimed to adapt the HLQ to the Danish setting, and to examine the factor structure, homogeneity, reliability and discriminant validity. The HLQ was adapted using forward-backward translation, consensus conference and cognitive interviews (n = 15). Psychometric properties were examined based on data collected by face-to-face interview (n = 481). Tests included difficulty level, composite scale reliability and confirmatory factor analysis (CFA). Cognitive testing revealed that only minor re-wording was required. The easiest scale to respond to positively was 'Social support for health', and the hardest were 'Navigating the healthcare system' and 'Appraisal of health information'. CFA of the individual scales showed acceptably high loadings (range 0.49-0.93). CFA fit statistics after including correlated residuals were good for seven scales, acceptable for one. Composite reliability and Cronbach's α were >0.8 for all but one scale. A nine-factor CFA model was fitted to items with no cross-loadings or correlated residuals allowed. Given this restricted model, the fit was satisfactory. The HLQ appears robust for its intended application of assessing health literacy in a range of settings. Further work is required to demonstrate sensitivity to measure changes.

Book review: The Postwar Legacy of Appeasement: British Foreign Policy since 1945. By R. Gerald Hughes (London: Bloomsbury, 2014), pp. xii +331pp, AU$40.99 (pb).

“Appeaser”; since the Second World War there is perhaps no other label that prime ministers and presidents in the English-speaking world have strived so hard to avoid. It is extraordinary how powerful and long-lasting the term appeasement, the name Neville Chamberlain and the place Munich have been in the discourse of post-war international relations. It is a reflection of the all-powerful historical legacy of the Second World War that these terms still resonate with policy makers and their publics well into the twenty-first century. Such a phenomenon deserves scholarly attention and R. Gerald Hughes has done justice to this topic in his very fine book The Postwar Legacy of Appeasement: British Foreign Policy Since 1945.