The inclusion of ‘then-test’ questions in post-test questionnaires alters post-test responses: a randomized study of bias in health program evaluation

Objectives Program evaluations are frequently based on ‘then-test’ data, i.e., pre-test collected in retrospect. While the application of the then-test has practical advantages, little is known about the validity of then-test data. Because of the collection of then-test in close proximity to post-test questions, this study was aimed at exploring whether the presence of then-test questions in post-test questionnaires influenced subjects’ responses to post-test.
Patients and methods To test the influence of then-test questions, we designed a randomized three-group study in the context of chronic disease self-management programs. Interventions had comparable goals and philosophies, and all 949 study participants filled out identical Health Education Impact Questionnaires (heiQ) at pre-test. At post-test, participants were then randomized to one of the following three groups: Group A responded to post-test questions only (n = 331); Group B filled out transition questions in addition to post-test (n = 304); and Group C filled out then-test questions in addition to post-test (n = 314).
Results Significant post-test differences were found in six of eight heiQ scales, with respondents who filled out then test questions reporting significantly higher post-test scores than respondents of the other groups.
Conclusions This study provides evidence that the inclusion of then-test questions alters post-test responses,
suggesting that change scores based on then-test data be interpreted with care.

Classifying and detecting group behaviour from visual surveillance data

We outline an approach to classifying and detecting behaviours from surveillance data. Simple pairwise movement patterns are learned and used as building blocks to describe behaviour over a temporal sequence, or compared with other pairs to detect group behaviour. As the pair primitives are easy to redefine and learn, and complex behaviour over time is specified by the user as a sequence of pair primitives, this approach provides a flexible yet robust method of detecting complex movement in a wide variety of domains.

The Yo-Yo Intermittent Recovery Test (Level 1) to discriminate elite junior Australian football players

The Yo-Yo Intermittent Recovery (IR) Test is currently used to assess endurance performance in team sport athletes. However, to date, no data has been presented on its application to an elite junior Australian football (AF) playing group. Therefore, the aim of this study was to evaluate the Yo-Yo Intermittent Recovery Test Level 1 (IR1) ability to discriminate between junior AF players at two different playing standards and a group of non-athletic healthy males. Sixty age matched participants (16.6 ± 0.5 years) spread over three groups (20 per group): elite junior footballers; sub-elite junior footballers; and non-athletic healthy males participated in this study. Participants undertook a single Yo-Yo test performance on an indoor basketball court for each group. A one-way ANOVA with Scheffe's post hoc analysis revealed the elite junior footballers covered a significantly greater total distance (p < 0.001) and completed a significantly greater number of high-intensity efforts (p < 0.001) in comparison to their sub-elite counterparts, whilst both AF groups performed significantly better (p < 0.001) than the non-athletic healthy males. This study demonstrates the ability of the Yo-Yo IR1 to discriminate endurance performance between elite and sub-elite AF players, whilst further distinguishing AF players from a non-athletic healthy control group.

Reliability and validity of a reactive agility test for Australian football

Purpose: The aim of this study was to test the reliability and construct validity of a reactive agility test (RAT), designed for Australian Football (AF).

Methods: Study I tested the reliability of the RAT, with 20 elite junior AF players (17.44 ± 0.55 y) completing the test on two occasions separated by 1 wk. Study II tested its construct validity by comparing the performance of 60 participants (16.60 ± 0.50 y) spread over three aged-matched population groups: 20 athletes participating in a State Under-18 AF league who had represented their state at national competitions (elite), 20 athletes participating in the same league who had not represented their state (subelite), and 20 healthy males who did not play AF (controls).

Results: Test-retest reliability reported a strong correlation (0.91), with no significant difference (P = .22) between the mean results (1.74 ± 0.07 s and 1.76 ± 0.07 s) obtained (split 2+3). Nonparametric tests (Kruskal-Wallis and Mann-Whitney) revealed both AF groups performed significantly faster on all measures than the control group (ranging from P = .001 to .005), with significant differences also reported between the two AF groups (ranging from P = .001 to .046). Stepwise discriminant analyses found total time discriminated between the groups, correctly classifying 75% of the participants.

Conclusions: The RAT used within this study demonstrates evidence of reliability and construct validity. It further suggests the ability of a reactive component within agility test designs to discriminate among athletes of different competition levels, highlighting its importance within training activities.

Does free recall moderate the effect of mental context reinstatement instructions on children's cued recall?

Cognitive Interview instructions increase children's recall of events; one important instruction is the mental reinstatement of context. We examined one factor that may affect mental context reinstatement: whether children had the opportunity to freely recall the event before answering cued recall questions. One hundred and fifty-two children aged 6, 9, or 11 years were interviewed twice about a staged event. The event consisted of an argument between two adults about whose turn it was to show the children a film. One week after the event, some of the children received mental context reinstatement instructions before having their cued recall tested. Some children also received a free recall test immediately before the cued recall test. In the second interview, 2 weeks after the first interview, all children freely recalled the event. The results showed no effects of mental context reinstatement instructions and no moderating effect of free recall on children's cued recall. The implications of these findings and directions for future research are discussed.

Osteo-cise : Strong bones for life': protocol for a community-based randomised controlled trial of a multi-modal exercise and osteoporosis education program for older adults at risk of falls and fractures

Background : Osteoporosis affects over 220 million people worldwide, and currently there is no 'cure' for the disease. Thus, there is a need to develop evidence-based, safe and acceptable prevention strategies at the population level that target multiple risk factors for fragility fractures to reduce the health and economic burden of the condition.

Methods : The 'Osteo-cise: Strong Bones for Life' study will investigate the effectiveness and feasibility of a multi-component targeted exercise, osteoporosis education/awareness and behavioural change program for improving bone health and muscle function, and reducing falls risk in community-dwelling older adults at an increased risk of fracture. Men and women aged 60 years or above will participate in an 18-month randomised controlled trial comprising a 12-month structured and supervised community-based program and a 6-month 'research to practise' translational phase. Participants will be randomly assigned to either the 'Osteo-cise' intervention or a self-management control group. The intervention will comprise a multi-modal exercise program incorporating high velocity progressive resistance training, moderate impact weight-bearing exercise and high challenging balance exercises performed three times weekly at local community-based fitness centres. A behavioural change program will be used to enhance exercise adoption and adherence to the program. Community-based osteoporosis education seminars will be conducted to improve participant knowledge and understanding of the risk factors and preventative measures for osteoporosis, falls and fractures. The primary outcomes measures, to be collected at baseline, 6, 12, and 18 months, will include DXA-derived hip and spine bone mineral density measurements and functional muscle power (timed stair-climb test). Secondary outcomes measures include: MRI-assessed distal femur and proximal tibia trabecular bone micro-architecture, lower limb and back maximal muscle strength, balance and function (four square step test, functional reach test, timed up-and-go test and 30-second sit-to-stand), falls incidence and health-related quality of life. Cost-effectiveness will also be assessed.

Discussion : The findings from the Osteo-cise: Strong Bones for Life study will provide new information on the efficacy of a targeted multi-modal community-based exercise program incorporating high velocity resistance training, together with an osteoporosis education and behavioural change program for improving multiple risk factors for falls and fracture in older adults at risk of fragility fracture. Trial Registration: Australian New Zealand Clinical Trials Registry reference ACTRN12609000100291

Reliability and validity of the Melbourne edge test and high/low contrast visual acuity chart

Purpose. The purposes of the study were to investigate the test-retest reliability and the validity of new versions of the Melbourne Edge Test (MET) and the High/Low Contrast Visual Acuity (H/LCVA) chart and to investigate the agreement between the original and new versions.

Methods. The MET original photographic version, MET new light box version, H/LCVA Chart original photographic version, H/LCVA Chart new printed version, and the Pelli-Robson chart were administered twice to one eye of 22 subjects with low vision and 20 soft contact lenses wearers.

Results. For the low vision group, the test-retest 95% limits of agreement were ±5.2 dB for the MET new light box version and ±0.39 logarithm of the minimum angle of resolution (logMAR) for the LCVA component of the H/LCVA new printed version. For the soft contact lens group, the test-retest 95% limits of agreement were ±2.1 dB for the MET new light box version and ± 0.26 logMAR for the LCVA component of the H/LCVA new printed version. Moderate to high correlations were obtained between contrast sensitivity tests, thus providing evidence of validity. Scores obtained for the new test versions were significantly higher than the original versions (p < 0.01).

Conclusions. Of all the tests administered, the MET original photographic version and the Pelli-Robson Chart had the highest test-retest reliability for the low vision group. For the soft contact lens group, the H/LCVA original version (low contrast letters, 18% Weber) and the Pelli-Robson Chart had the highest reliability.

A test of core assumptions of the catastrophic misinterpretation model of panic disorder

The catastrophic misinterpretation model of panic disorder proposes that spontaneous panic attacks are the result of misinterpretation of harmless autonomic arousal as precursors to physical (e.g. heart attack) or psychological (e.g. insanity) emergency. Mixed research findings to date have provided equivocal support. A modified form of the Body Sensations Interpretation Questionnaire was used to investigate core assumptions of the model amongst 38 people with panic disorder (PD), 20 with non-clinical panic, 21 with social anxiety disorder, and 34 non-anxious controls. The PD group gave more harm-related interpretations of ambiguous internal stimuli than all other groups only when anxiety-related responses (e.g. “I'm going to panic”) were scored as harm, however there was no evidence that anxiety-related interpretations were masking perceived catastrophic physical or psychological outcomes. Despite this, people with PD rated harm and anxiety outcomes as more negative than non-anxious controls. Results failed to unequivocally support core assumptions of the model.

Organizational memory and empowerment

Purpose – The aim of this paper is to test a model of the relationship between organizational memory and empowerment. The model posited that organizational memory would be related to requests to share knowledge, psychological empowerment in the workplace (meaning, competence, self-determination and impact), and organization-based self-esteem. Design/methodology/approach – The model was tested with 134 employees representing six companies using hierarchical regression analysis. Findings – Significant relationships were found between organizational memory and requests to share knowledge, empowerment, and organization-based self-esteem. Findings indicated that a positive stereotype may exist towards older workers and the frequency they are requested to share knowledge, and that a halo-type effect may operate, where knowledge of an organization's history is generalized to other knowledge domains. Research limitations/implications – Causal implications cannot be made as this was correlational research. Some of the research measures while achieving acceptable to good reliability were in an early development stage. The study utilized a convenience sample that may limit how the results can be generalized. Practical implications – The paper indicates that organizations can emphasize positive outcomes for those who are knowledge repositories and mentors. It is also important to consider possible “positive stereotypes” which may be operating when organizational members evaluate older workers as knowledge repositories and mentors. Originality/value – The paper addresses the assumptions in the human resources literature concerning the role of older workers as repositories of organizational memory and suitable mentors. The study introduces the “requests to share knowledge scale”.

Does behavior reflect phylogeny in swiftlets (Aves: Apodidae)? A test using cytochrome b mitochondrial DNA sequences

Swiftlets are small insectivorous birds, many of which nest in caves and are known to echolocate. Due to a lack of distinguishing morphological characters, the taxonomy of swiftlets is primarily based on the presence or absence of echolocating ability, together with nest characters. To test the reliability of these behavioral characters, we constructed an independent phylogeny using cytochrome b mitochondrial DNA sequences from swiftlets and their relatives. This phylogeny is broadly consistent with the higher classification of swifts but does not support the monophyly of swiftlets. Echolocating swiftlets (Aerodramus) and the nonecholocating "giant swiftlet" (Hydrochous gigas) group together, but the remaining nonecholocating swiftlets belonging to Collocalia are not sister taxa to these swiftlets. While echolocation may be a synapomorphy of Aerodramus (perhaps secondarily lost in Hydrochous), no character of Aerodramus nests showed a statistically significant fit to the molecular phylogeny, indicating that nest characters are not phylogenetically reliable in this group.

A parallel-group, randomised controlled trial of a multimedia, self-directed, coping skills training intervention for patients with cancer and their partners: design and rationale

Introduction:

The effects of familiarity and group size on mating preferences in the guppy, Poecilia reticulata

In recent years, it has become evident that frequency dependence in the attractiveness of a particular phenotype to mates can contribute to the maintenance of polymorphism. However, these preferences for rare and unfamiliar male phenotypes have only been demonstrated in small, controlled experiments. Here, we tested the preference for unfamiliar mates in groups of six to 96 individuals over 13 days, in the guppy (Poecilia reticulata). We observed individual behaviour in situ to test whether fish discriminate two unfamiliar individuals among many familiar ones. We found that unfamiliar males and females were preferred over the familiar fishes in all groups and that this effect decayed over time. Increasing group sizes and levels of sexual activity did not hamper the preference for unfamiliar mates, providing further support for the role of frequency dependent mate choice in the maintenance of trait polymorphism in natural populations.

Does implicit motor imagery ability predict reaching correction efficiency? A test of recent models of human motor control

Neurocomputational models of reaching indicate that efficient purposive correction of movement midflight (e.g., online control) depends on one's ability to generate and monitor an accurate internal (neural) movement representation. In the first study to test this empirically, the authors investigated the relationship between healthy young adults’ implicit motor imagery performance and their capacity to correct their reaching trajectory. As expected, after controlling for general reaching speed, hierarchical regression demonstrated that imagery ability was a significant predictor of hand correction speed; that is, faster and more accurate imagery performance associated with faster corrections to reaching following target displacement at movement onset. They argue that these findings provide preliminary support for the view that a link exists between an individual's ability to represent movement mentally and correct movement online efficiently.

Sex does not matter: gender bias and gender differences in peer assessments of contributions to group work

This paper considers the possibility of gender bias in peer ratings for contributions to team assignments, as measured by an online self-and-peer assessment tool. The research was conducted to determine whether peer assessment led to reliable and fair marking outcomes. The methodology of Falchikov and Magin was followed in order to test their finding that gender has no discernable impact on peer ratings. Data from over 1500 participants at two universities enrolled in four different degree programmes were analysed. The research indicates an absence of gender bias in six case studies. The research also found that women received significantly higher ratings than men.