Difference-based meta-analytic procedures for between-participant and/or within-participant designs : a tutorial review for sports and exercise scientists

The aim of this paper is to provide a contemporary summary of statistical and non-statistical meta-analytic procedures that have relevance to the type of experimental designs often used by sport scientists when examining differences/change in dependent measure(s) as a result of one or more independent manipulation(s). Using worked examples from studies on observational learning in the motor behaviour literature, we adopt a random effects model and give a detailed explanation of the statistical procedures for the three types of raw score difference-based analyses applicable to between-participant, within-participant, and mixed-participant designs. Major merits and concerns associated with these quantitative procedures are identified and agreed methods are reported for minimizing biased outcomes, such as those for dealing with multiple dependent measures from single studies, design variation across studies, different metrics (i.e. raw scores and difference scores), and variations in sample size. To complement the worked examples, we summarize the general considerations required when conducting and reporting a meta-analysis, including how to deal with publication bias, what information to present regarding the primary studies, and approaches for dealing with outliers. By bringing together these statistical and non-statistical meta-analytic procedures, we provide the tools required to clarify understanding of key concepts and principles.

An examination of the link between just world belief and schadenfreude

Schadenfreude is a pleasure derived from someone else’s misfortune. Just world belief is a desire to belief that people get what they deserve and deserve what they get (Lerner, 1965,1980). Interestingly, previous scholars documented the link between schadenfreude, responsibility and deservingness (e.g. van Dijk, Goslinga, & Ouwerkerk, 2008), i.e. the more failure is deserved, the more perceived responsibility for the failure, and subsequently more schadenfreude is evoked. Thus, the present study tested if a threat of a just world belief intensifies experience of schadenfreude. The participants (N=48, 31 women and 17 men, M age = 23.72), were randomly assigned to one of two experimental conditions (just world belief: threat versus no-threat) between-participant design. They read scenarios which were designed to threaten or maintain their just world belief. Next, they were transferred to an online magazine presenting funny stories about other peoples’ failures. The stories were selected in a pilot study in order to evoke schadenfreude. As presumed, the participants exposed to the threat of just world belief experienced more schadenfreude, i.e. spent more time on reading schadenfreude stories. The results confirmed the existence of a link between just world threat and schadenfreude.

Activity and affect:repeated within-participant assessment in people after joint replacement surgery

Objective: Between-participant research has shown that high negative affectivity predicts greater activity limitations and vice versa. This study examined both between- and within-participant associations of negative and positive affectivity with activity levels using ecological momentary assessment. Method: Participants were 25 people who had undergone joint replacement surgery 12 months previously. Participants made multiple reports of their activity and positive and negative affectivity over a single day using, a computerized diary. Activity was also objectively recorded using an activity monitor. The following day, participants made a self-report of their activity over the measurement day and general positive and negative affectivity levels were recorded. Results: Higher self-reported walking time over the whole measurement day was associated with higher general positive affectivity but not negative affectivity. However, using ecological momentary assessment, higher diary reports of negative affectivity predicted increased activity levels while positive affectivity neither predicted nor was predicted by activity. Conclusion: These findings demonstrate the importance of within-participant methodology in detecting subtle and immediate effects of individuals' mood on behavior that may differ from findings investigating between-participant effects over longer time periods.

Determinants of skin self-examination (SSE) in men aged 50 years or older

Background: Queensland men aged 50 years and older are at high risk for melanoma. Early detection via skin self examination (SSE) (particularly whole-body SSE) followed by presentation to a doctor with suspicious lesions, may decrease morbidity and mortality from melanoma. Prevalence of whole-body SSE (wbSSE) is lower in Queensland older men compared to other population subgroups. With the exception of the present study no previous research has investigated the determinants of wbSSE in older men, or interventions to increase the behaviour in this population. Furthermore, although past SSE intervention studies for other populations have cited health behaviour models in the development of interventions, no study has tested these models in full. The Skin Awareness Study: A recent randomised trial, called the Skin Awareness Study, tested the impact of a video-delivered intervention compared to written materials alone on wbSSE in men aged 50 years or older (n=930). Men were recruited from the general population and interviewed over the telephone at baseline and 13 months. The proportion of men who reported wbSSE rose from 10% to 31% in the control group, and from 11% to 36% in the intervention group. Current research: The current research was a secondary analysis of data collected for the Skin Awareness Study. The objectives were as follows: • To describe how men who did not take up any SSE during the study period differed from those who did take up examining their skin. • To determine whether the intervention program was successful in affecting the constructs of the Health Belief Model it was aimed at (self-efficacy, perceived threat, and outcome expectations); and whether this in turn influenced wbSSE. • To determine whether the Health Action Process Approach (HAPA) was a better predictor of wbSSE behaviour compared to the Health Belief Model (HBM). Methods: For objective 1, men who did not report any past SSE at baseline (n=308) were categorised as having ‘taken up SSE’ (reported SSE at study end) or ‘resisted SSE’ (reported no SSE at study end). Bivariate logistic regression, followed by multivariable regression, investigated the association between participant characteristics measured at baseline and resisting SSE. For objective 2 proxy measures of self-efficacy, perceived threat, and outcome expectations were selected. To determine whether these mediated the effect of the intervention on the outcome, a mediator analysis was performed with all participants who completed interviews at both time points (n=830) following the Baron and Kenny approach, modified for use with structural equation modelling (SEM). For objective 3, control group participants only were included (n=410). Proxy measures of all HBM and HAPA constructs were selected and SEM was used to build up models and test the significance of each hypothesised pathway. A likelihood ratio test compared the HAPA to the HBM. Results: Amongst men who did not report any SSE at baseline, 27% did not take up any SSE by the end of the study. In multivariable analyses, resisting SSE was associated with having more freckly skin (p=0.027); being unsure about the statement ‘if I saw something suspicious on my skin, I’d go to the doctor straight away’ (p=0.028); not intending to perform SSE (p=0.015), having lower SSE self-efficacy (p<0.001), and having no recommendation for SSE from a doctor (p=0.002). In the mediator analysis none of the tested variables mediated the relationship between the intervention and wbSSE. In regards to health behaviour models, the HBM did not predict wbSSE well overall. Only the construct of self-efficacy was a significant predictor of future wbSSE (p=0.001), while neither perceived threat (p=0.584) nor outcome expectations (p=0.220) were. By contrast, when the HAPA constructs were added, all three HBM variables predicted intention to perform SSE, which in turn predicted future behaviour (p=0.015). The HAPA construct of volitional self-efficacy was also associated with wbSSE (p=0.046). The HAPA was a significantly better model compared to the HBM (p<0.001). Limitations: Items selected to measure HBM and HAPA model constructs for objectives 2 and 3 may not have accurately reflected each construct. Conclusions: This research added to the evidence base on how best to target interventions to older men; and on the appropriateness of particular health behaviour models to guide interventions. Findings indicate that to overcome resistance those men with more negative pre-existing attitudes to SSE (not intending to do it, lower initial self-efficacy) may need to be targeted with more intensive interventions in the future. Involving general practitioners in recommending SSE to their patients in this population, alongside disseminating an intervention, may increase its success. Comparison of the HBM and HAPA showed that while two of the three HBM variables examined did not directly predict future wbSSE, all three were associated with intention to self-examine skin. This suggests that in this population, intervening on these variables may increase intention to examine skin, but not necessarily the behaviour itself. Future interventions could potentially focus on increasing both the motivational variables of perceived threat and outcome expectations as well as a combination of both action and volitional self-efficacy; with the aim of increasing intention as well as its translation to taking up and maintaining regular wbSSE.

A preliminary analysis of teacher perceptions of the effects of NAPLAN on pedagogy and curriculum

This paper reports preliminary survey findings of Western Australian and South Australian teacher perceptions of the impact of NAPLAN on curriculum and pedagogy in their classroom and school. The paper examines how teachers perceive the effects of NAPLAN on curriculum and pedagogy and whether these perceptions mediated by the teacher’s gender, the socioeconomics of the school, the State and the school system in which the teacher works. Teachers report that they are either choosing or being instructed to teach to the test, that this results in less time being spent on other curriculum areas and that these effects contribute in a negative way to the class environment and the engagement of students. This largely agrees with a body of international research that suggests that high-stakes literacy and numeracy tests often results in unintended consequences such as a narrow curriculum focus, a return to teacher-centred instruction and a decrease in motivation. Analysis suggests there is a relationship between participant responses to the effect of NAPLAN on curriculum based on the characteristics of which State the teacher taught in, the socioeconomic status of the school and the school system in which they were employed (State, Catholic, and Independent).

The effects of NAPLAN: Teacher perceptions of the impact of NAPLAN on pedagogy and curriculum

This paper reports preliminary findings of a survey of in-service teachers in WA and SA conducted in 2012. Participants completed an online survey open to all teachers in WA and SA. The survey ran for three months from April to June 2012. One section of the survey asked teachers to report their perceptions of the impact that NAPLAN has had on the curriculum and pedagogy of their classroom and school. Two principal research questions were addressed in this preliminary analysis. First what are teacher perceptions of the effects on NAPLAN on curriculum and pedagogy? Second, are there any interaction effects between gender, socioeconomics status, location and school system on teachers perceptions? Statistical analyses examined one- and two-way MANOVA to assess main effects and interaction effects on teachers' global perceptions. These were followed by a series of exploratory one- and two-way ANOVA of specific survey items to suggest potential sources for differences among teachers from different socioeconomic regions, states and systems. Teachers report that they are either choosing or being instructed to teach to the test, that this results in less time being spent on other curriculum areas and that these effects contribute in a negative way on the engagement of students. This largely agrees with a body of international research that suggests that high-stakes literacy and numeracy tests often results in unintended consequences such as a narrow curriculum focus (Au, 2007), a return to teacher-centred instruction (Barret, 2009) and a decrease in motivation (Ryan & Wesinstein, 2009). Preliminary results from early survey respondents suggests there is a relationship between participant responses to the effect of NAPLAN on curriculum and pedagogy based on the characteristics of which State the teacher taught in, their perceptions of the socioeconomic status of the school and the school system in which they were employed (State, Catholic, and Independent).

Levels and predictors of exercise referral scheme uptake and adherence: A systematic review

Background The effectiveness of exercise referral schemes (ERS) is influenced by uptake and adherence to the scheme. The identification of factors influencing low uptake and adherence could lead to the refinement of schemes to optimise investment. Objectives To quantify the levels of ERS uptake and adherence and to identify factors predictive of uptake and adherence. Methods A systematic review and meta-analysis was undertaken. MEDLINE, EMBASE, PsycINFO, Cochrane Library, ISI WOS, SPORTDiscus and ongoing trial registries were searched (to October 2009) and included study references were checked. Included studies were required to report at least one of the following: (1) a numerical measure of ERS uptake or adherence and (2) an estimate of the statistical association between participant demographic or psychosocial factors (eg, level of motivation, self-efficacy) or programme factors and uptake or adherence to ERS. Results Twenty studies met the inclusion criteria, six randomised controlled trials (RCTs) and 14 observational studies. The pooled level of uptake in ERS was 66% (95% CI 57% to 75%) across the observational studies and 81% (95% CI 68% to 94%) across the RCTs. The pooled level of ERS adherence was 49% (95% CI 40% to 59%) across the observational studies and 43% (95% CI 32% to 54%) across the RCTs. Few studies considered anything other than gender and age. Women were more likely to begin an ERS but were less likely to adhere to it than men. Older people were more likely to begin and adhere to an ERS. Limitations Substantial heterogeneity was evident across the ERS studies. Without standardised definitions, the heterogeneity may have been reflective of differences in methods of defining uptake and adherence across studies. Conclusions To enhance our understanding of the variation in uptake and adherence across ERS and how these variations might affect physical activity outcomes, future trials need to use quantitative and qualitative methods.

Recruitment bias and clinical characterstics of participants with severe cerebral palsy in a cross-sectional survey

Aim.  This article is a report of recruitment bias in a sample of 5–25-year-old patients with severe cerebral palsy.

Background.  The way in which study participants are recruited into research can be a source of bias.

Method.  A cross-sectional survey of 5–25-year-old patients with severe cerebral palsy using standardized questionnaires with parents/carers was undertaken in 2007/2008. A case register was used as the sampling frame, and 260 families were approached: 178/260 (68%) responded and 82/260 families never replied (non-respondents). Among responders: 127/178 (71%) opted in to the study, but only 123/127 were assessed, and 82/178 were opted out (or refused). Multivariable logistic regression giving odds ratios was used to study the association between participant characteristics and study outcomes (responders vs. non-responders; opting in vs. opting out; assessed vs. eligible, but not assessed).

Results.  Responders (compared with non-responders) were significantly more likely to have a family member with cerebral palsy who was male and resident in more affluent areas. Families who opted in (compared with those opting out and refusing) were more likely to have a family member with cerebral palsy and intellectual impairment and to reside in certain geographical areas. Families who were actually assessed (compared with all eligible, but not assessed) were more likely to have a family member with cerebral palsy and intellectual impairment.

Conclusion.  Several sources of bias were identified during recruitment for this study. This has implications for the interpretation and conclusions of surveys of people with disabilities and complex needs.

GENOTYPE-PHENOTYPE ASSOCIATIONS IN NEOVASCULAR AGE-RELATED MACULAR DEGENERATION.

PURPOSE:To examine associations between recognized genetic susceptibility loci and angiographic subphenotypes of the neovascular variant of age-related macular degeneration (nvAMD).METHODS:Participants (247 nvAMD, 52 early age-related macular degeneration [AMD], and 103 controls) were genotyped (complement factor H and ARMS2/HTRA1). nvAMD participants were assigned to one of two subcategories: mainly classic or mainly occult (based on the proportions of classic and occult choroidal neovascularization). nvAMD and early AMD were reassigned to two groups based on the extent and severity of drusen (retinal pigment epithelium dysfunction or not). Univariate and multivariate analysis were used to examine for associations between participant characteristics and genetic loci after adjusting for age, smoking status, and history of cardiovascular disease.RESULTS:Univariate analysis confirmed the known significant associations between AMD stage and age, hypertension, and a history of cardiovascular disease. Those with retinal pigment epithelium dysfunction (F = 5.46; P = 0.02) or a positive smoking history (F = 3.89; P = 0.05) were more likely to have been classified as having mainly an occult rather than a mainly classic lesion. Multivariate analysis showed that significant associations were noted with the number of ARMS2/HTRA1 risk alleles (P

Differences in perceived risks and benefits of herbal, over-the-counter conventional, and prescribed conventional, medicines, and the implications of this for the safe and effective use of herbal products

Objectives: To investigate people's views about the efficacy and specific risks of herbal, over-the-counter (OTC) conventional, and prescribed conventional medicines, and their likelihood of taking a second (herbal or OTC conventional) product in addition to a prescribed medicine. Methods: Experiment 1 (1 factor within-participant design); Experiment 2 (1 factor between-participant design). Convenience samples of general population were given a hypothetical scenario and required to make a number of judgements. Results: People believed herbal remedies to be less effective, but less risky than OTC and prescribed conventional medicines. Herbal medicines were not seen as being safer simply because of their easier availability. Participants indicated that they would be more likely to take a herbal medicine than a conventional OTC medicine in addition to a prescribed medicine, and less likely to consult their doctor in advance. Conclusion: People believe that herbal medicines are natural and relatively safe and can be used with less caution. People need to be given clear information about the risks and benefits of herbal medicines if they are to use such products safety and effectively. (c) 2006 Elsevier Ltd. All rights reserved.

Neural correlates of true and false memory in mild cognitive impairment

The goal of this research was to investigate the changes in neural processing in mild cognitive impairment. We measured phase synchrony, amplitudes, and event-related potentials in veridical and false memory to determine whether these differed in participants with mild cognitive impairment compared with typical, age-matched controls. Empirical mode decomposition phase locking analysis was used to assess synchrony, which is the first time this analysis technique has been applied in a complex cognitive task such as memory processing. The technique allowed assessment of changes in frontal and parietal cortex connectivity over time during a memory task, without a priori selection of frequency ranges, which has been shown previously to influence synchrony detection. Phase synchrony differed significantly in its timing and degree between participant groups in the theta and alpha frequency ranges. Timing differences suggested greater dependence on gist memory in the presence of mild cognitive impairment. The group with mild cognitive impairment had significantly more frontal theta phase locking than the controls in the absence of a significant behavioural difference in the task, providing new evidence for compensatory processing in the former group. Both groups showed greater frontal phase locking during false than true memory, suggesting increased searching when no actual memory trace was found. Significant inter-group differences in frontal alpha phase locking provided support for a role for lower and upper alpha oscillations in memory processing. Finally, fronto-parietal interaction was significantly reduced in the group with mild cognitive impairment, supporting the notion that mild cognitive impairment could represent an early stage in Alzheimer’s disease, which has been described as a ‘disconnection syndrome’.

Perception of thickness, mouth-coating and mouth-drying of dairy beverages by younger and older volunteer

Sensory perception has been found to change during ageing. The perception of mouth feel by older adults, and the role of ageing on the sensory perception of texture attributes is uncertain. . This study investigated perception of the textural attributes of thickness, mouth-coating and mouth-drying, in the context of dairy beverages, by older and younger adults. Just noticeable differences (JND) of a starch thickener and for cream concentration within milk were established for thickness and mouth-coating perception, finding no age-related differences between participant groups. Mouth-drying was assessed through the directional paired comparison of a mouth-drying milk beverage to a skimmed milk sample. The older adults were found to be more sensitive to mouth-drying (p=0.03) than the younger adults. This study found no age-related decline in texture perception with older adults finding perception of some attributes such as mouth-drying enhanced by ageing.

Self-Perceived Attractiveness and Its Influence on the Halo Effect and the Similar-to Me Effect

The present research examined the influences of the halo effect and the similar-tome effect on physical and sexual attractiveness for hiring decisions. It was hypothesized that the halo effect would cause applicants rated highly in physical and sexual attractiveness to receive higher ratings of hireability than unattractive applicants.However, if the similar-to-me effect is influential for levels of attractiveness in hiring situations, participants who rated themselves as less attractive should favor unattractive applicants. The results did not show an interaction between participant self-ratings and ratings of hireability, indicating the similar-to-me effect does not apply to physical or sexual attractiveness. There was a main effect of sexual attractiveness of the applicant forhireability, showing support for the halo effect. This effect was only found for White applicants, potentially due to in-group bias and out-group homogeneity.

Investigating the Role of System Justification in Mental Illness Stigma

The current study integrates system justification theory with research on mental illness stigma. Stereotypes of both low- and high-status groups in society can be a means of satisfying the system justification motive, or the motive to view societal inequalities as justified (as reviewed in Jost, Banaji, & Nosek, 2004). Corrigan, Watson, and Ottati (2003) proposed that system justification theory may be able to explain the origins of particular stereotypes of people with mental illness, such as dangerousness and incompetence. The primary goal of the present study was to investigate whether the stigmatization of people with mental illness – a specific form of stigmatization of a lowstatus group – can be at least partially attributed to a broader motive to justify societal inequalities. To test this, the current study included both an experimental manipulation of the perceived legitimacy of the social system and a measure of system-justifying beliefs. Stigmatization of individuals with mental illness was measured with both explicit selfreport measures (semantic differentials and the Attribution Questionnaire) and an implicit measure (a computer-based Implicit Association Test). The relationships between participant characteristics, such as personal experience with mental illness, and stigma were also investigated. Consistent with past research demonstrating only modest correlations between explicit and implicit stigma, greater self-reported fear toward a person with a chronic mental illness was weakly associated with increased implicit bias against mental illness in favor of physical disability. There was little support for the involvement of system justification in explicit stigma. Participants with personal experience with mental illness were less likely to self-report fear and avoidance of a person with a chronic mental illness. These findings have implications for stigmareduction efforts.

Sources of selection bias in evaluating social programs: An interpretation of conventional measures and evidence on the effectiveness of matching as a program evaluation method

This paper decomposes the conventional measure of selection bias in observational studies into three components. The first two components are due to differences in the distributions of characteristics between participant and nonparticipant (comparison) group members: the first arises from differences in the supports, and the second from differences in densities over the region of common support. The third component arises from selection bias precisely defined. Using data from a recent social experiment, we find that the component due to selection bias, precisely defined, is smaller than the first two components. However, selection bias still represents a substantial fraction of the experimental impact estimate. The empirical performance of matching methods of program evaluation is also examined. We find that matching based on the propensity score eliminates some but not all of the measured selection bias, with the remaining bias still a substantial fraction of the estimated impact. We find that the support of the distribution of propensity scores for the comparison group is typically only a small portion of the support for the participant group. For values outside the common support, it is impossible to reliably estimate the effect of program participation using matching methods. If the impact of participation depends on the propensity score, as we find in our data, the failure of the common support condition severely limits matching compared with random assignment as an evaluation estimator.