Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Social media and journalism during times of crisis

Around lunchtime on 22 February 2011, the New Zealand city of Christchurch – the country’s second largest city – was hit by a magnitude 6.3 earthquake. Built on a geological faultline, like Los Angeles and Tokyo, Christchurch is no stranger to tremors; indeed, it had experienced a magnitude 7.1 quake just months before, in September 2010, and technically, this new earthquake was no more than an aftershock of the earlier tremor. That earlier quake had caused significant structural damage, but no fatalities, but the February earthquake was different: with its epicentre located no more than ten kilometres from the Christchurch city centre, at a depth of only five kilometres, it proved considerably more destructive – and it affected buildings whose structural integrity had already been severely compromised by the September quake, in the middle of a weekday when schools and city offices would have been fully occupied. While the full death toll has yet to be determined, it is estimated at close to 200.

Neutrophil oxidative burst is primed by supernatant from stored red cells : implications for Transfusion-Related Acute Lung Injury (TRALI)

Aim/Background: Transfusion-related acute lung injury (TRALI) is a potentially fatal adverse transfusion reaction. It is hypothesised to occur via a two-insult mechanism: the recipient’s underlying co-morbidity in addition to the transfusion of blood products activate neutrophils in the lung resulting in damaged endothelium and capillary leakage. Neutrophil activation may occur by antibody or non-antibody related mechanisms, with the length of storage of cellular blood products implicated in the latter. This study investigated non-antibody mediated priming and/or activation of neutrophil oxidative burst. Methods: A cytochrome C reduction assay was used to assess priming and activation of neutrophil oxidative burst by pooled supernatant (SN) from day 1 (D1; n=75) and day 42 (D42; n=113) packed red blood cells (PRBC). Pooled PRBC-SN were assessed in parallel with PAF (priming), fMLP (activating), PAF + fMLP (priming + activating) and buffer only (negative) controls. Cytochrome C reduction was measured over 30min at 37oC (inclusive of 10min priming). Neutrophil activation by PRBC-SN was assessed cf. buffer only and neutrophil priming by PRBC-SN was assessed by co-incubation with fMLP cf. fMLP alone. One-way ANOVA; Newman-Keuls post-test; p<0.05; n=10 independent assays. Results: Neither D1- nor D42- PRBC-SN alone activated neutrophil oxidative burst. In addition, D1-PRBC-SN did not prime fMLP-activated neutrophil oxidative burst. D42-PRBC-SN did, however, prime neutrophils for subsequent activation of oxidative burst by fMLP, the magnitude of response being similar to PAF (a known neutrophil priming agonist). Conclusion: These findings are consistent with the two-insult mechanism of TRALI. Factors released into the SN during PRBC storage contributed to neutrophil priming synergistically with other neutrophil stimulating agonists. This implicates PRBC storage duration as a key factor contributing to non-immune neutrophil activation in the development of TRALI in patients with pre-disposing inflammatory conditions.

Stress, lifestyle and quality of life in midlife and older Australian women : results from the stress and the health of women study

Background Chronic psychological stress may pose a serious threat to health, although the mechanisms are not fully understood. This study examines the impact of stress on modifiable lifestyle factors, depressive symptoms, health-related quality of life (HRQOL) and chronic illness in older Australian women. Methods Cross-sectional data were collected from a random sample of 181 older adults aged 60-70 years from rural and urban areas of South-East Queensland, Australia. We used structural equation modelling to examine associations between stress, modifiable lifestyle factors, HRQoL, and chronic illness. Findings Parameter estimates show that older women who reported life stressors where they felt helpless and feared for their life (high magnitude stressors) also reported higher body mass index (p = 0.03) and more chronic illness (p <0.01). In contrast, duration of exposure to life stressors was associated with higher depressive symptom scores (CES-D, p = 0.02) and sleep disturbance scores (p <0.01). Conclusions Our findings support the link between traumatic personal histories (exposure to high magnitude stressors) and unhealthy lifestyle factors. Findings highlight the need for more research on how stress reduction healthy lifestyle and positive coping strategies can be used to reduce the effects of high magnitude stress on health-related quality of life and chronic illness.

The IL-6 response to Chlamydia from primary reproductive epithelial cells is highly variable and may be involved in differential susceptibility to the immunopathological consequences of chlamydial infection

Background Chlamydia trachomatis infection results in reproductive damage in some women. The process and factors involved in this immunopathology are not well understood. This study aimed to investigate the role of primary human cellular responses to chlamydial stress response proteases and chlamydial infection to further identify the immune processes involved in serious disease sequelae. Results Laboratory cell cultures and primary human reproductive epithelial cultures produced IL-6 in response to chlamydial stress response proteases (CtHtrA and CtTsp), UV inactivated Chlamydia, and live Chlamydia. The magnitude of the IL-6 response varied considerably (up to 1000 pg ml-1) across different primary human reproductive cultures. Thus different levels of IL-6 production by reproductive epithelia may be a determinant in disease outcome. Interestingly, co-culture models with either THP-1 cells or autologous primary human PBMC generally resulted in increased levels of IL-6, except in the case of live Chlamydia where the level of IL-6 was decreased compared to the epithelial cell culture only, suggesting this pathway may be able to be modulated by live Chlamydia. PBMC responses to the stress response proteases (CtTsp and CtHtrA) did not significantly vary for the different participant cohorts. Therefore, these proteases may possess conserved innate PAMPs. MAP kinases appeared to be involved in this IL-6 induction from human cells. Finally, we also demonstrated that IL-6 was induced by these proteins and Chlamydia from mouse primary reproductive cell cultures (BALB/C mice) and mouse laboratory cell models. Conclusions We have demonstrated that IL-6 may be a key factor for the chlamydial disease outcome in humans, given that primary human reproductive epithelial cell culture showed considerable variation in IL-6 response to Chlamydia or chlamydial proteins, and that the presence of live Chlamydia (but not UV killed) during co-culture resulted in a reduced IL-6 response suggesting this response may be moderated by the presence of the organism.

Visual analog scale and pressure pain threshold for delayed onset muscle soreness assessment

Objectives: To investigate the relationship between two assessments to quantify delayed onset muscle soreness [DOMS]: visual analog scale [VAS] and pressure pain threshold [PPT]. Methods: Thirty-one healthy young men [25.8 ± 5.5 years] performed 10 sets of six maximal eccentric contractions of the elbow flexors with their non-dominant arm. Before and one to four days after the exercise, muscle pain perceived upon palpation of the biceps brachii at three sites [5, 9 and 13 cm above the elbow crease] was assessed by VAS with a 100 mm line [0 = no pain, 100 = extremely painful], and PPT of the same sites was determined by an algometer. Changes in VAS and PPT over time were compared amongst three sites by a two-way repeated measures analysis of variance, and the relationship between VAS and PPT was analyzed using a Pearson product-moment correlation. Results: The VAS increased one to four days after exercise and peaked two days post-exercise, while the PPT decreased most one day post-exercise and remained below baseline for four days following exercise [p < 0.05]. No significant difference among the three sites was found for VAS [p = 0.62] or PPT [p = 0.45]. The magnitude of change in VAS did not significantly correlate with that of PPT [r = −0.20, p = 0.28]. Conclusion: These results suggest that the level of muscle pain is not region-specific, at least among the three sites investigated in the study, and VAS and PPT provide different information about DOMS, indicating that VAS and PPT represent different aspects of pain.

Competing together : assessing the dynamics of team-team and player-team synchrony in professional association football

This study investigated movement synchronization of players within and between teams during competitive association football performance. Cluster phase analysis was introduced as a method to assess synchronies between whole teams and between individual players with their team as a function of time, ball possession and field direction. Measures of dispersion (SD) and regularity (sample entropy – SampEn – and cross sample entropy – Cross-SampEn) were used to quantify the magnitude and structure of synchrony. Large synergistic relations within each professional team sport collective were observed, particularly in the longitudinal direction of the field (0.89 ± 0.12) compared to the lateral direction (0.73 ± 0.16, p < .01). The coupling between the group measures of the two teams also revealed that changes in the synchrony of each team were intimately related (Cross-SampEn values of 0.02 ± 0.01). Interestingly, ball possession did not influence team synchronization levels. In player–team synchronization, individuals tended to be coordinated under near in-phase modes with team behavior (mean ranges between −7 and 5° of relative phase). The magnitudes of variations were low, but more irregular in time, for the longitudinal (SD: 18 ± 3°; SampEn: 0.07 ± 0.01), compared to the lateral direction (SD: 28 ± 5°; SampEn: 0.06 ± 0.01, p < .05) on-field. Increases in regularity were also observed between the first (SampEn: 0.07 ± 0.01) and second half (SampEn: 0.06 ± 0.01, p < .05) of the observed competitive game. Findings suggest that the method of analysis introduced in the current study may offer a suitable tool for examining team’s synchronization behaviors and the mutual influence of each team’s cohesiveness in competing social collectives.

Capturing complex, non-linear team behaviours during competitive football performance

This study investigated changes in the complexity (magnitude and structure of variability) of the collective behaviours of association football teams during competitive performance. Raw positional data from an entire competitive match between two professional teams were obtained with the ProZone® tracking system. Five compound positional variables were used to investigate the collective patterns of performance of each team including: surface area, stretch index, team length, team width, and geometrical centre. Analyses involve the coefficient of variation (%CV) and approximate entropy (ApEn), as well as the linear association between both parameters. Collective measures successfully captured the idiosyncratic behaviours of each team and their variations across the six time periods of the match. Key events such as goals scored and game breaks (such as half time and full time) seemed to influence the collective patterns of performance. While ApEn values significantly decreased during each half, the %CV increased. Teams seem to become more regular and predictable, but with increased magnitudes of variation in their organisational shape over the natural course of a match.

The association of early life supplemental nutrition with lean body mass and grip strength in adulthood : evidence from APCAPS

In the present study, we examined the associations of early nutrition with adult lean body mass (LBM) and muscle strength in a birth cohort that was established to assess the long-term impact of a nutrition program. Participants (n = 1,446, 32% female) were born near Hyderabad, India, in 29 villages from 1987 to 1990, during which time only intervention villages (n = 15) had a government program that offered balanced protein-calorie supplementation to pregnant women and children. Participants’ LBM and appendicular skeletal muscle mass were measured using dual energy x-ray absorptiometry; grip strength and information on lifestyle indicators, including diet and physical activity level, were also obtained. Ages (mean = 20.3 years) and body mass indexes (weight (kg)/height (m)2; mean = 19.5) of participants in 2 groups were similar. Current dietary energy intake was higher in the intervention group. Unadjusted LBM and grip strength were similar in 2 groups. After adjustment for potential confounders, the intervention group had lower LBM (β = −0.75; P = 0.03), appendicular skeletal muscle mass, and grip strength than did controls, but these differences were small in magnitude (<0.1 standard deviation). Multivariable regression analyses showed that current socioeconomic position, energy intake, and physical activity level had a positive association with adult LBM and muscle strength. This study could not detect a “programming” effect of early nutrition supplementation on adult LBM and muscle strength.

Comparison of high level FPGA hardware design for solving tri-diagonal linear systems

Reconfigurable computing devices can increase the performance of compute intensive algorithms by implementing application specific co-processor architectures. The power cost for this performance gain is often an order of magnitude less than that of modern CPUs and GPUs. Exploiting the potential of reconfigurable devices such as Field-Programmable Gate Arrays (FPGAs) is typically a complex and tedious hardware engineering task. Re- cently the major FPGA vendors (Altera, and Xilinx) have released their own high-level design tools, which have great potential for rapid development of FPGA based custom accelerators. In this paper, we will evaluate Altera’s OpenCL Software Development Kit, and Xilinx’s Vivado High Level Sythesis tool. These tools will be compared for their per- formance, logic utilisation, and ease of development for the test case of a Tri-diagonal linear system solver.

Choroidal thickness in myopic and non-myopic children assessed with enhanced depth imaging optical coherence tomography

Purpose To examine choroidal thickness (ChT) and its topographical variation across the posterior pole in myopic and non-myopic children. Methods One hundred and four children aged 10-15 years of age (mean age 13.1 ± 1.4 years) had ChT measured using enhanced depth imaging optical coherence tomography (OCT). Forty one children were myopic (mean spherical equivalent -2.4 ± 1.5 D) and 63 non-myopic (mean +0.3 ± 0.3 D). Two series of 6 radial OCT line scans centred on the fovea were assessed for each child. Subfoveal ChT and ChT across a series of parafoveal zones over the central 6mm of the posterior pole were determined through manual image segmentation. Results Subfoveal ChT was significantly thinner in myopes (mean 303 ± 79 µm) compared to non-myopes (mean 359 ± 77 µm) (p<0.0001). Multiple regression analysis revealed both refractive error (r = 0.39, p<0.001) and age (r = 0.21, p = 0.02) were positively associated with subfoveal ChT. ChT also exhibited significant topographical variations, with the choroid being thicker in more central regions. The thinnest choroid was typically observed in nasal (mean 286 ± 77 µm) and inferior-nasal (306 ± 79 µm) locations, and the thickest in superior (346 ± 79 µm) and superior-temporal (341 ± 74 µm) locations. The difference in ChT between myopic and non-myopic children was significantly greater in central foveal regions compared to more peripheral regions (>3 mm diameter) (p<0.001). Conclusions Myopic children have significantly thinner choroids compared to non-myopic children of similar age, particularly in central foveal regions. The magnitude of difference in choroidal thickness associated with myopia appears greater than would be predicted by a simple passive choroidal thinning with axial elongation.

Stability of corneal topography and wavefront aberrations in young Singaporeans

Purpose To investigate the differences between and variations across time in corneal topography and ocular wavefront aberrations in young Singaporean myopes and emmetropes. Methods We used a videokeratoscope and wavefront sensor to measure the ocular surface topography and wavefront aberrations of the total eye optics in the morning, mid-day and late afternoon on two separate days. Topography data were used to derive the corneal surface wavefront aberrations. Both the corneal and total wavefronts were analysed up to the 4th radial order of the Zernike polynomial expansion, and were centred on the entrance pupil (5 mm). The participants included 12 young progressing myopes, 13 young stable myopes and 15 young age-matched emmetropes. Results For all subjects considered together there were significant changes in some of the aberrations terms across the day, such as spherical aberration ( ) and vertical coma ( ) (repeated measures ANOVA, p<0.05). The magnitude of positive spherical aberration ( ) was significantly lower in the progressing myope group than that of the stable myopes (p=0.04) and emmetrope group (p=0.02). There were also significant interactions between refractive group and time of day for with/against-the-rule astigmatism ( ). Significantly lower 4th order RMS of ocular wavefront aberrations were found in the progressing myope group compared with the stable myopes and emmetropes (p<0.01). Conclusions These differences and variations in the corneal and total aberrations may have significance for our understanding of refractive error development and for clinical applications requiring accurate wavefront measurements.

Diurnal variations in ocular aberrations of human eyes

Purpose: To investigate the diurnal variations in ocular wavefront aberrations over two consecutive days in young adult subjects. Materials and methods: Measurements of both lower-order (sphero-cylindrical refractive powers) and higher-order (3rd and 4th order aberration terms) ocular aberrations were collected for 30 young adult subjects at ten different times over two consecutive days using a Hartmann-Shack aberrometer. Fifteen subjects were myopic and 15 were emmetropic. Five sets of measurements were collected each day at approximately 3 hourly intervals, with the first measurement taken at ~9 am and the final measurement at ~9 pm. Results: Spherical equivalent refraction (p = 0.029) and spherical aberration (p = 0.043) were both found to undergo significant diurnal variation over the two measurement days. The spherical equivalent was typically found to be at a maximum (i.e. most hyperopic) at the morning measurement, with a small myopic shift of 0.37 ± 0.15 D observed over the course of the day. The mean spherical aberration of all subjects (0.038 ± 0.048 μm) was found to be positive during the day and gradually became more negative into the evening, with a mean amplitude of change of 0.036 ± 0.02 μm. None of the other considered sphero-cylindrical refractive power components or higher-order aberrations exhibited significant diurnal variation over the two days of the experiment (p>0.05). Except for the lower-order astigmatism at 90/180 deg (p = 0.040), there were no significant differences between myopes and emmetropes in the magnitude and timing of the observed diurnal variations (p>0.05). Conclusions: Significant diurnal variations in spherical equivalent and spherical aberration were consistently observed over two consecutive days of measurement. Research and clinical applications requiring precise refractive error and wavefront measurements should take these diurnal changes into account when interpreting wavefront data.

T helper cell cytokine profiles following endurance exercise

Endurance exercise can cause immunosuppression and increase the risk of upper respiratory illness. The present study examined changes in the secretion of T helper (Th) cell cytokines after endurance exercise. Ten highly trained road cyclists [mean±SEM: age 24.2±1.7 years; height 1.82±0.02 m; body mass 73.8±2.0 kg; peak oxygen uptake 65.9±2.3 mL/(kg•min)] performed 2 h of cycling exercise at 90% of the second ventilatory threshold. Peripheral blood mononuclear cells were isolated and stimulated with phytohemagglutinin. Plasma cortisol concentrations and the concentration of Th1/Th2/Th17 cell cytokines were examined. Data were analyzed using both traditional statistics and magnitude-based inferences. Results revealed a significant decrease in plasma cortisol at 4–24 h postexercise compared with pre-exercise values. Qualitative analysis revealed postexercise changes in concentrations of plasma cortisol, IL-2, TNF, IL-4, IL-6, IL-10, and IL-17A compared with pre-exercise values. A Th1/Th2 shift was evident immediately postexercise. Furthermore, for multiple cytokines, including IL-2 and TNF (Th1), IL-6 and IL-10 (Th2), and IL-17 (Th17), no meaningful change in concentration occurred until more than 4 h postexercise, highlighting the duration of exercise-induced changes in immune function. These results demonstrate the importance of considering “clinically” significant versus statistically significant changes in immune cell function after exercise.

The epidemiology of basal cell carcinoma

Basal cell carcinoma (BCC) is a skin cancer of particular importance to the Australian community. Its rate of occurrence is highest in Queensland, where 1% to 2% of people are newly affected annually. This is an order of magnitude higher than corresponding incidence estimates in European and North American populations. Individuals with a sun-sensitive complexion are particularly susceptible because sun exposure is the single most important causative agent, as shown by the anatomic distribution of BCC which is in general consistent with the levels of sun exposure across body sites. A distinguishing feature of BCC is the occurrence of multiple primary tumours within individuals, synchronously or over time, and their diagnosis and treatment costs contribute substantially to the major public health burden caused by BCC. A primary knowledge gap about BCC pathogenesis however was an understanding of the true frequency of multiple BCC occurrences and their body distribution, and why a proportion of people do develop more than one BCC in their life. This research project sought to address this gap under an overarching research aim to better understand the detailed epidemiology of BCC with the ultimate goal of reducing the burden of this skin cancer through prevention. The particular aim was to document prospectively the rate of BCC occurrence and its associations with constitutional and environmental (solar) factors, all the while paying special attention to persons affected by more than one BCC. The study built on previous findings and recent developments in the field but set out to confirm and extend these and propose more adequate theories about the complex epidemiology of this cancer. Addressing these goals required a new approach to researching basal cell carcinoma, due to the need to account for the phenomenon of multiple incident BCCs per person. This was enabled by a 20 year community-based study of skin cancer in Australians that provided the methodological foundation for this thesis. Study participants were originally randomly selected in 1986 from the electoral register of all adult residents of the subtropical township of Nambour in Queensland, Australia. On various occasions during the study, participants were fully examined by dermatologists who documented cumulative photodamage as well as skin cancers. Participants completed standard questionnaires about skin cancer-related factors, and consented to have any diagnosed skin cancers notified to the investigators by regional pathology laboratories in Queensland. These methods allowed 100% ascertainment of histologically confirmed BCCs in this study population. 1339 participants had complete follow-up to the end of 2007. Statistical analyses in this thesis were carried out using SAS and SUDAAN statistical software packages. Modelling methods, including multivariate logistic regressions, allowed for repeated measures in terms of multiple BCCs per person. This innovative approach gave new findings on two levels, presented in five chapters as scientific papers: 1. Incidence of basal cell carcinoma multiplicity and detailed anatomic distribution: longitudinal study of an Australian population The incidence of people affected multiple times by BCC was 705 per 100,000 person years compared to an incidence rate of people singly affected of 935 per 100,000 person years. Among multiply and singly affected persons alike, site-specific BCC incidence rates were far highest on facial subsites, followed by upper limbs, trunk, and then lower limbs 2. Melanocytic nevi and basal cell carcinoma: is there an association? BCC risk was significantly increased in those with forearm nevi (Odds Ratios (OR) 1.43, 95% Confidence Intervals (CI) 1.09-1.89) compared to people without forearm nevi, especially among those who spent their time mainly outdoors (OR 1.6, 95%CI 1.1-2.3) compared to those who spent their time mainly indoors. Nevi on the back were not associated with BCC. 3. Clinical signs of photodamage are associated with basal cell carcinoma multiplicity and site: a 16-year longitudinal study Over a 16-year follow-up period, 58% of people affected by BCC developed more than one BCC. Among these people 60% developed BCCs across different anatomic sites. Participants with high numbers of solar keratoses, compared to people without solar keratoses, were most likely to experience the highest BCC counts overall (OR 3.3, 95%CI 1.4-13.5). Occurrences of BCC on the trunk (OR 3.3, 95%CI 1.4-7.6) and on the limbs (OR 3.7, 95%CI 2.0-7.0) were strongly associated with high numbers of solar keratoses on these sites. 4. Occurrence and determinants of basal cell carcinoma by histological subtype in an Australian community Among 1202 BCCs, 77% had a single growth pattern and 23% were of mixed histological composition. Among all BCCs the nodular followed by the superficial growth patterns were commonest. Risk of nodular and superficial BCCs on the head was raised if 5 or more solar keratoses were present on the face (OR 1.8, 95%CI 1.2-2.7 and OR 4.5, 95%CI 2.1-9.7 respectively) and similarly on the trunk in the presence of multiple solar keratoses on the trunk (OR 4.2, 95%CI 1.5-11.9 and OR 2.2, 95%CI 1.1-4.4 respectively). 5. Basal cell carcinoma and measures of cumulative sun exposure: an Australian longitudinal community-based study Dermal elastosis was more likely to be seen adjacent to head and neck BCCs than trunk BCCs (p=0.01). Severity of dermal elastosis increased on each site with increasing clinical signs of cutaneous sun damage on that site. BCCs that occurred without perilesional elastosis per se, were always found in an anatomic region with signs of photodamage. This thesis thus has identified the magnitude of the burden of multiple BCCs. It does not support the view that people affected by more than one BCC represent a distinct group of people who are prone to BCCs on certain body sites. The results also demonstrate that BCCs regardless of site, histology or order of occurrence are strongly associated with cumulative sun exposure causing photodamage to the skin, and hence challenge the view that BCCs occurring on body sites with typically low opportunities for sun exposure or of the superficial growth pattern are different in their association with the sun from those on typically sun-exposed sites, or nodular BCCs, respectively. Through dissemination in the scientific and medical literature, and to the community at large, these findings can ultimately assist in the primary and secondary prevention of BCC, perhaps especially in high-risk populations.