Tests of measurement invariance failed to support the application of the "then-test"

Objective
The use of then-test (retrospective pre-test) scores has frequently been proposed as a solution to potential confounding of change scores because of response shift, as it is assumed that then-test and post-test responses are provided from the same perspective. However, this assumption has not been formally tested using robust quantitative methods. The aim of this study was to compare the psychometric performance of then-test/post-test with traditional pre-test/post-test data and assessing whether the resulting data structures support the application of the then-test for evaluations of chronic disease self-management interventions.

Study Design and Setting
Pre-test, post-test, and then-test data were collected from 314 participants of self-management courses using the Health Education Impact Questionnaire (heiQ). The derived change scores (pre-test/post-test; then-test/post-test) were examined for their psychometric performance using tests of measurement invariance.

Results
Few questionnaire items were noninvariant across pre-test/post-test, with four items identified and requiring removal to enable an unbiased comparison of factor means. In contrast, 12 items were identified and required removal in then-test/post-test data to avoid biased change score estimates.

Conclusion
Traditional pre-test/post-test data appear to be robust with little indication of response shift. In contrast, the weaker psychometric performance of then-test/post-test data suggests psychometric flaws that may be the result of implicit theory of change, social desirability, and recall bias.

Comparison of the pre-post and transition question assessments in a health education setting

Objective : This study examined the classical pre-intervention/post-intervention assessment (pre–post) and the single post-intervention transition question assessment (transition question) to determine how well these methods reflected qualitative interview–based participant-reported outcomes from chronic disease self-management education programs (CDSMEPs).

Study Design and Setting : A mixed-method qualitative and quantitative approach was applied in 25 interviews with participants recruited from CDSMEPs within Australia. Qualitative interviews with participants were used as a relative “gold standard” and compared with questionnaire-based pre–post and transition question assessments.

Results : Comparison of the two questionnaire-based assessments showed that most of the individual paired responses were discordant (61%). Using participant's qualitative narratives as a “true” indicator, the pre–post assessment was found on more occasions to be discordant with participant-reported outcomes than the transition question. The origin of the inconsistency was largely because of a change in respondents' perspective that had occurred after pretest, which was mediated by CDSMEPs' experiences and insights.

Conclusion : This study suggests that the pre–post assessment has poor validity for the assessment of health education program outcomes. Alternative assessments, such as the transition question, may result in a more accurate reflection of the impact of such programs on participants.

The inclusion of ‘then-test’ questions in post-test questionnaires alters post-test responses: a randomized study of bias in health program evaluation

Objectives Program evaluations are frequently based on ‘then-test’ data, i.e., pre-test collected in retrospect. While the application of the then-test has practical advantages, little is known about the validity of then-test data. Because of the collection of then-test in close proximity to post-test questions, this study was aimed at exploring whether the presence of then-test questions in post-test questionnaires influenced subjects’ responses to post-test.
Patients and methods To test the influence of then-test questions, we designed a randomized three-group study in the context of chronic disease self-management programs. Interventions had comparable goals and philosophies, and all 949 study participants filled out identical Health Education Impact Questionnaires (heiQ) at pre-test. At post-test, participants were then randomized to one of the following three groups: Group A responded to post-test questions only (n = 331); Group B filled out transition questions in addition to post-test (n = 304); and Group C filled out then-test questions in addition to post-test (n = 314).
Results Significant post-test differences were found in six of eight heiQ scales, with respondents who filled out then test questions reporting significantly higher post-test scores than respondents of the other groups.
Conclusions This study provides evidence that the inclusion of then-test questions alters post-test responses,
suggesting that change scores based on then-test data be interpreted with care.

Measurement issues in the evaluation of chronic disease self-management programs

Objectives: 

Evidence-based guidelines for interpreting change scores for the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30

Aim: To use published literature and experts' opinion to investigate the clinical meaning and magnitude of changes in the Quality of Life (QOL) of groups of patients measured with the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30 (EORTC QLQ-C30). Methods: An innovative method combining systematic review of published studies, expert opinions and meta-analysis was used to estimate large, medium, and small mean changes over time for QLQ-C30 scores. Results: Nine hundred and eleven papers were identified, leading to 118 relevant papers. One thousand two hundred and thirty two mean changes in QOL over time were combined in the meta-analysis, with timescales ranging from four days to five years. Guidelines were produced for trivial, small, and medium size classes, for each subscale and for improving and declining scores separately. Estimates for improvements were smaller than respective estimates for declines. Conclusions: These guidelines can be used to aid sample size calculations and interpretation of mean changes over time from groups of patients. Observed mean changes in the QLQ-C30 scores are generally small in most clinical situations, possibly due to response shift. Careful consideration is needed when planning studies where QOL changes over time are of primary interest; the timing of follow up, sample attrition, direction of QOL changes, and subscales of primary interest are key considerations. (C) 2012 Elsevier Ltd. All rights reserved.

Self-perceived distress and impairment in problem gamblers: a study of pre- to post-treatment measurement invariance

Gambling help services typically evaluate treatment outcomes using self-reported responses and measurements. However, gamblers’ conceptualisations and prioritisations with respect to these measurements may shift over time. Thus, changes in the self-reported responses may not always reflect true change in the individuals. This study investigated for response shift in self-report measures of psychological distress and impairment in 293 help-seeking problem gamblers. We used confirmatory factor analysis to model data structures from pre-treatment to post-treatment. The findings indicated that a response shift had occurred. Two items became less important and one item became more important in measuring psychological distress. Measurement invariance was achieved for the complete set of items for impairment. These findings provide a more in-depth understanding of the nature of self-report outcomes in otherwise routinely collected data.

Self-perceived distress and impairment in problem gamblers : a study of pre- to post-treatment measurement invariance

Gambling help services typically evaluate treatment outcomes using self-reported responses and measurements. However, gamblers’ conceptualisations and prioritisations with respect to these measurements may shift over time. Thus, changes in the self-reported responses may not always reflect true change in the individuals. This study investigated for response shift in self-report measures of psychological distress and impairment in 293 help-seeking problem gamblers. We used confirmatory factor analysis to model data structures from pre-treatment to post-treatment. The findings indicated that a response shift had occurred. Two items became less important and one item became more important in measuring psychological distress. Measurement invariance was achieved for the complete set of items for impairment. These findings provide a more in-depth understanding of the nature of self-report outcomes in otherwise routinely collected data.

Ghost and self: Jung's paradigm shift and a response to Zinkin

Zinkin's lucid challenge to Jung makes perfect sense. Indeed, it is the implications of this `making sense' that this paper addresses. For Zinkin's characterization of the `self' takes it as a `concept' requiring coherence; a variety of abstract non-contextual knowledge that itself has a mythical heritage. Moreover, Zinkin's refinement of Jung seeks to make his work fit for the scientific paradigm of modernity. In turn, modernity's paradigm owes much to Newton's notion of knowledge via reductionism. Here knowledge or investigation is divided up into the smallest possible units with the aim of eventually putting it all together into `one' picture of scientific truth. Unfortunately, `reductionism' does not do justice to the resonant possibilities of Jung's writing. These look forward to a new scientific paradigm of the twenty-first century, of the interactive `field', emergence and complexity theory. The paper works paradoxically by discovering Zinkin's `intersubjective self' after all, in two undervalued narratives by Jung, his doctoral thesis and a short late ghost story. However, in the ambivalences and radical fictional experimentation of these fascinating texts can be discerned an-Other self, one both created and found. [From the Publisher]

Pulse-response TAP studies of the reverse water-gas shift reaction over a Pt/CeO2 catalyst

The temporal analysis of products (TAP) technique was successfully applied for the first time to investigate the reverse water-gas shift (RWGS) reaction over a 2% Pt/CeO2 catalyst. The adsorption/desorption rate constants for CO2 and H-2 were determined in separate TAP pulse-response experiments, and the number of H-containing exchangeable species was determined using D-2 multipulse TAP experiments. This number is similar to the amount of active sites observed in previous SSITKA experiments. The CO production in the RWGS reaction was studied in a TAP experiment using separate (sequential) and simultaneous pulsing Of CO2 and H-2. A small yield of CO was observed when CO2 was pulsed alone over the reduced catalyst, whereas a much higher CO yield was observed when CO2 and H-2 were pulsed consecutively. The maximum CO yield was observed when the CO2 pulse was followed by a H-2 pulse with only a short (1 s) delay. Based on these findings, we conclude that an associative reaction mechanism dominates the RWGS reaction under these experimental conditions. The rate constants for several elementary steps can be determined from the TAP data. In addition, using a difference in the time scale of the separate reaction steps identified in the TAP experiments, it is possible to distinguish a number of possible reaction pathways. (c) 2005 Elsevier Inc. All rights reserved.

Weaning diet induces sustained metabolic phenotype shift in the pig and influences host response to Bifidobacterium lactis NCC2818

Background The process of weaning causes a major shift in intestinal microbiota and is a critical period for developing appropriate immune responses in young mammals.Objective To use a new systems approach to provide an overview of host metabolism and the developing immune system in response to nutritional intervention around the weaning period.Design Piglets (n=14) were weaned onto either an egg-based or soya-based diet at 3 weeks until 7 weeks, when all piglets were switched onto a fish-based diet. Half the animals on each weaning diet received Bifidobacterium lactis NCC2818 supplementation from weaning onwards. Immunoglobulin production from immunologically relevant intestinal sites was quantified and the urinary (1)H NMR metabolic profile was obtained from each animal at post mortem (11 weeks).Results Different weaning diets induced divergent and sustained shifts in the metabolic phenotype, which resulted in the alteration of urinary gut microbial co-metabolites, even after 4 weeks of dietary standardisation. B lactis NCC2818 supplementation affected the systemic metabolism of the different weaning diet groups over and above the effects of diet. Additionally, production of gut mucosa-associated IgA and IgM was found to depend upon the weaning diet and on B lactis NCC2818 supplementation.ConclusionThe correlation of urinary (1)H NMR metabolic profile with mucosal immunoglobulin production was demonstrated, thus confirming the value of this multi-platform approach in uncovering non-invasive biomarkers of immunity. This has clear potential for translation into human healthcare with the development of urine testing as a means of assessing mucosal immune status. This might lead to early diagnosis of intestinal dysbiosis and with subsequent intervention, arrest disease development. This system enhances our overall understanding of pathologies under supra-organismal control.

Weaning diet induces sustained metabolic phenotype shift in the pig and influences host response to Bifidobacterium lactis NCC2818

Background: The process of weaning causes a major shift in intestinal microbiota and is a critical period for developing appropriate immune responses in young mammals. Objective: To use a new systems approach to provide an overview of host metabolism and the developing immune system in response to nutritional intervention around the weaning period. Design: Piglets (n¼14) were weaned onto either an eggbased or soya-based diet at 3 weeks until 7 weeks, when all piglets were switched onto a fish-based diet. Half the animals on each weaning diet received Bifidobacterium lactis NCC2818 supplementation from weaning onwards. Immunoglobulin production from immunologically relevant intestinal sites was quantified and the urinary 1H NMR metabolic profile was obtained from each animal at post mortem (11 weeks). Results: Different weaning diets induced divergent and sustained shifts in the metabolic phenotype, which resulted in the alteration of urinary gut microbial co-metabolites, even after 4 weeks of dietary standardisation. B lactis NCC2818 supplementation affected the systemic metabolism of the different weaning diet groups over and above the effects of diet. Additionally, production of gut mucosa-associated IgA and IgM was found to depend upon the weaning diet and on B lactis NCC2818 supplementation. Conclusion: The correlation of urinary 1H NMR metabolic profile with mucosal immunoglobulin production was demonstrated, thus confirming the value of this multiplatform approach in uncovering non-invasive biomarkers of immunity. This has clear potential for translation into human healthcare with the development of urine testing as a means of assessing mucosal immune status. This might lead to early diagnosis of intestinal dysbiosis and with subsequent intervention, arrest disease development. This system enhances our overall understanding of pathologies under supra-organismal control.

No shift to a deeper water uptake depth in response to summer drought of two lowland and sub-alpine C3-grasslands in Switzerland

Temperate C3-grasslands are of high agricultural and ecological importance in Central Europe. Plant growth and consequently grassland yields depend strongly on water supply during the growing season, which is projected to change in the future. We therefore investigated the effect of summer drought on the water uptake of an intensively managed lowland and an extensively managed sub-alpine grassland in Switzerland. Summer drought was simulated by using transparent shelters. Standing above- and belowground biomass was sampled during three growing seasons. Soil and plant xylem waters were analyzed for oxygen (and hydrogen) stable isotope ratios, and the depths of plant water uptake were estimated by two different approaches: (1) linear interpolation method and (2) Bayesian calibrated mixing model. Relative to the control, aboveground biomass was reduced under drought conditions. In contrast to our expectations, lowland grassland plants subjected to summer drought were more likely (43–68 %) to rely on water in the topsoil (0–10 cm), whereas control plants relied less on the topsoil (4–37 %) and shifted to deeper soil layers (20–35 cm) during the drought period (29–48 %). Sub-alpine grassland plants did not differ significantly in uptake depth between drought and control plots during the drought period. Both approaches yielded similar results and showed that the drought treatment in the two grasslands did not induce a shift to deeper uptake depths, but rather continued or shifted water uptake to even more shallower soil depths. These findings illustrate the importance of shallow soil depths for plant performance under drought conditions.

Drought-induced shift of a forest–woodland ecotone: Rapid landscape response to climate variation

In coming decades, global climate changes are expected to produce large shifts in vegetation distributions at unprecedented rates. These shifts are expected to be most rapid and extreme at ecotones, the boundaries between ecosystems, particularly those in semiarid landscapes. However, current models do not adequately provide for such rapid effects—particularly those caused by mortality—largely because of the lack of data from field studies. Here we report the most rapid landscape-scale shift of a woody ecotone ever documented: in northern New Mexico in the 1950s, the ecotone between semiarid ponderosa pine forest and piñon–juniper woodland shifted extensively (2 km or more) and rapidly (<5 years) through mortality of ponderosa pines in response to a severe drought. This shift has persisted for 40 years. Forest patches within the shift zone became much more fragmented, and soil erosion greatly accelerated. The rapidity and the complex dynamics of the persistent shift point to the need to represent more accurately these dynamics, especially the mortality factor, in assessments of the effects of climate change.

Influence of check and field size on the visual evoked magnetic response to a pattern shift stimulus

A decrease in the check size of a pattern shift stimulus increases the latency and amplitude of the visual evoked potential (VEP) P100. In addition, for a given check size, decreasing the size of the stimulus field increases the latency and amplitude of the P100. These results imply that the central regions of the retina make a significant contribution to the generation of the electrical P100. However, the corresponding magnetic P100m may have a different origin. We have studied the effects of check and field size on the P100m in five normal subjects using a DC-Squid, second-order gradiometer. Magnetic responses were recorded at the positive maximum of the P100m over the occipital scalp to six check sizes (10-100') presented in a large (13 degrees 34') and small (5 degrees 14') field and to a large check (100') presented in seven field sizes (1 degree 45' - 15 degrees 10'). No responses were recorded to any check size with a small field. Decreasing the check size presented in a large field increased latency of the P100m by approx. 30 ms while the amplitude of the response decreased with the largest reduction occurring between 70' and 12' checks. Using a large check, latency increased and amplitude decreased as the field size was reduced. The latency changes in response to check and field size were similar to those described for the VEP although the magnitudes of the magnetic changes were greater. Unlike the VEP, amplitude responses were maximal when large checks were presented in a large stimulus field. This suggests that regions outside the central retina make a more significant contribution to the visual evoked magnetic response than they do to the VEP, and that the P100m may be useful clinically in the study of diseases that affect the more peripheral regions of the retina.

Modulation of the Chlamydia trachomatis In vitro transcriptome response by the sex hormones estradiol and progesterone

BACKGROUND:Chlamydia trachomatis is a major cause of sexually transmitted disease in humans. Previous studies in both humans and animal models of chlamydial genital tract infection have suggested that the hormonal status of the genital tract epithelium at the time of exposure can influence the outcome of the chlamydial infection. We performed a whole genome transcriptional profiling study of C. trachomatis infection in ECC-1 cells under progesterone or estradiol treatment.RESULTS:Both hormone treatments caused a significant shift in the sub-set of genes expressed (25% of the transcriptome altered by more than 2-fold). Overall, estradiol treatment resulted in the down-regulation of 151 genes, including those associated with lipid and nucleotide metabolism. Of particular interest was the up-regulation in estradiol-supplemented cultures of six genes (omcB, trpB, cydA, cydB, pyk and yggV), which suggest a stress response similar to that reported previously in other models of chlamydial persistence. We also observed morphological changes consistent with a persistence response. By comparison, progesterone supplementation resulted in a general up-regulation of an energy utilising response.CONCLUSION:Our data shows for the first time, that the treatment of chlamydial host cells with key reproductive hormones such as progesterone and estradiol, results in significantly altered chlamydial gene expression profiles. It is likely that these chlamydial expression patterns are survival responses, evolved by the pathogen to enable it to overcome the host's innate immune response. The induction of chlamydial persistence is probably a key component of this survival response.