Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Pattern-based topic models for information filtering

Topic modelling, such as Latent Dirichlet Allocation (LDA), was proposed to generate statistical models to represent multiple topics in a collection of documents, which has been widely utilized in the fields of machine learning and information retrieval, etc. But its effectiveness in information filtering is rarely known. Patterns are always thought to be more representative than single terms for representing documents. In this paper, a novel information filtering model, Pattern-based Topic Model(PBTM) , is proposed to represent the text documents not only using the topic distributions at general level but also using semantic pattern representations at detailed specific level, both of which contribute to the accurate document representation and document relevance ranking. Extensive experiments are conducted to evaluate the effectiveness of PBTM by using the TREC data collection Reuters Corpus Volume 1. The results show that the proposed model achieves outstanding performance.

Meta-analysis of individual patient data from randomized trials of chemotherapy plus cetuximab as first-line treatment for advanced non-small cell lung cancer

OBJECTIVES: Four randomized phase II/III trials investigated the addition of cetuximab to platinum-based, first-line chemotherapy in patients with advanced non-small cell lung cancer (NSCLC). A meta-analysis was performed to examine the benefit/risk ratio for the addition of cetuximab to chemotherapy. MATERIALS AND METHODS: The meta-analysis included individual patient efficacy data from 2018 patients and individual patient safety data from 1970 patients comprising respectively the combined intention-to-treat and safety populations of the four trials. The effect of adding cetuximab to chemotherapy was measured by hazard ratios (HRs) obtained using a Cox proportional hazards model and odds ratios calculated by logistic regression. Survival rates at 1 year were calculated. All applied models were stratified by trial. Tests on heterogeneity of treatment effects across the trials and sensitivity analyses were performed for all endpoints. RESULTS: The meta-analysis demonstrated that the addition of cetuximab to chemotherapy significantly improved overall survival (HR 0.88, p=0.009, median 10.3 vs 9.4 months), progression-free survival (HR 0.90, p=0.045, median 4.7 vs 4.5 months) and response (odds ratio 1.46, p<0.001, overall response rate 32.2% vs 24.4%) compared with chemotherapy alone. The safety profile of chemotherapy plus cetuximab in the meta-analysis population was confirmed as manageable. Neither trials nor patient subgroups defined by key baseline characteristics showed significant heterogeneity for any endpoint. CONCLUSION: The addition of cetuximab to platinum-based, first-line chemotherapy for advanced NSCLC significantly improved outcome for all efficacy endpoints with an acceptable safety profile, indicating a favorable benefit/risk ratio.

Successful outcomes in vocational education and training courses and mathematics: how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate Vocational Education and Training (VET) and teaching, Indigenous learners’ needs, employer culture and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty - nine teachers/trainers/teacher aides and two hundred and thirty - one students consented to participate in the project. Nine VET courses offered in schools and Technical and Further Education Institutes (TAFE) were nominated to be the focus on the study. This paper focuses on student questionnaire responses and interview responses from teachers/trainers one high school principal and five students as a result of these processes, the findings indicated that VET course teachers work hard to adopt contextualising strategies to their teaching; however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned by trainers and teachers. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

Generation and characterization of ionic and neutral dihydroxy boron B(OH)(2)(+/0) in the gas phase

The dicoordinated borinium ion, dihydroxyborinium, B(OH)(2)(+) is generated from methyl boronic acid CH3B(OH)(2) by dissociative electron ionization and its connectivity confirmed by collisional activation. Neutralization-reionization (NR) experiments on this ion indicate that the neutral B(OH)(2) radical is a viable species in the gas phase. Both vertical neutralization of B(OH)(2)(+) and reionization of B(OH)(2) in the NR experiment are, however, associated with particularly unfavorable Franck-Condon factors. The differences in adiabatic and vertical electron transfer behavior can be traced back to a particular pi stabilization of the cationic species compared to the sp(2)-type neutral radical. Thermochemical data on several neutral and cationic boron compounds are presented based on calculations performed at the G2 level of theory.

Efficient computation of causal behavioural profiles using structural decomposition

Identification of behavioural contradictions is an important aspect of software engineering, in particular for checking the consistency between a business process model used as system specification and a corresponding workflow model used as implementation. In this paper, we propose causal behavioural profiles as the basis for a consistency notion, which capture essential behavioural information, such as order, exclusiveness, and causality between pairs of activities. Existing notions of behavioural equivalence, such as bisimulation and trace equivalence, might also be applied as consistency notions. Still, they are exponential in computation. Our novel concept of causal behavioural profiles provides a weaker behavioural consistency notion that can be computed efficiently using structural decomposition techniques for sound free-choice workflow systems if unstructured net fragments are acyclic or can be traced back to S- or T-nets.

Cancer : the to and fro of tumour spread

The spread of cells from the primary site of a solid tumour to distant sites remains the major cause of disease and death associated with these cancers. For tumour cells to spread, or metastasize, they must modify their 'anchored' state and detach from their neighbouring cells; migrate through tissues into the blood and lymph systems; survive in these circulation systems; and then leave the vessels at an appropriate site to form another tumour1. Many of these events are favoured by conversions between two cellular states — the epithelial and mesenchymal phenotypes. But the role of these transitions in cancer metastasis is controversial. Writing in Cancer Cell, Tsai et al.2 and Ocaña et al.3 help to clarify this issue...

Revascularization and tissue regeneration of an empty root canal space is enhanced by a direct blood supply and stem cells

Background Regenerative endodontics is an innovative treatment concept aiming to regenerate pulp, dentin and root structures. In the diseased or necrotic tooth, the limitation in vascular supply renders successful tissue regeneration/generation in a whole tooth challenging. The aim of this study is to evaluate the ability of vascularized tissue to develop within a pulpless tooth using tissue engineering techniques. Materials and methods A pulpless tooth chamber, filled with collagen I gel containing isolated rat dental pulp cells (DPC) and angiogenic growth factors, was placed into a hole created in the femoral cortex or into its own tooth socket, respectively. The gross, histological and biochemical characteristics of the de novo tissue were evaluated at 4 and 8weeks post-transplantation. Results Tooth revascularization and tissue generation was observed only in the femur group, confirming the important role of vascular supply in tissue regeneration. The addition of cells and growth factors significantly promoted connective tissue production in the tooth chamber. Conclusion Successful revascularization and tissue regeneration in this model demonstrate the importance of a direct vascular supply and the advantages of a stem cell approach. © 2012 John Wiley & Sons A/S.

Breast cancer stem cells and epithelial mesenchymal plasticity : implications for chemoresistance

Tumour heterogeneity is a key characteristic of cancer and has significant implications relating to tumour response to chemotherapy as well as patient prognosis and potential relapse. It is being increasingly accepted that tumours are clonal in origin, suggestive of a tumour arising from a deregulated or mutated cell. Cancer stem cells (CSC) possess these capabilities, and with appropriate intracellular triggers and/or signalling from extracellular environments, can purportedly differentiate to initiate tumour formation. Additionally through epithelial mesenchymal plasticity (EMP), where cells gain and maintain characteristics of both epithelial and mesenchymal cell types, epithelial-derived tumour cells have been shown to de-differentiate to acquire cancer stem attributes, which also impart chemotherapy resistance. This new paradigm places EMP centrally in the process of tumour progression and metastasis, as well as modulating drug response to current forms of chemotherapy. Furthermore, EMP and CSCs have been identified in cancers arising from different tissue types making it a possible generic therapeutic target in cancer biology. Using breast cancer (BrCa) as an example, we summarise here the current understanding of CSCs, the role of EMP in cancer biology - especially in CSCs and different molecular subtypes, and the implications this has for current and future cancer treatment strategies.

An adipoinductive role of inflammation in adipose tissue engineering : key factors in the early development of engineered soft tissues

Tissue engineering and cell implantation therapies are gaining popularity because of their potential to repair and regenerate tissues and organs. To investigate the role of inflammatory cytokines in new tissue development in engineered tissues, we have characterized the nature and timing of cell populations forming new adipose tissue in a mouse tissue engineering chamber (TEC) and characterized the gene and protein expression of cytokines in the newly developing tissues. EGFP-labeled bone marrow transplant mice and MacGreen mice were implanted with TEC for periods ranging from 0.5 days to 6 weeks. Tissues were collected at various time points and assessed for cytokine expression through ELISA and mRNA analysis or labeled for specific cell populations in the TEC. Macrophage-derived factors, such as monocyte chemotactic protein-1 (MCP-1), appear to induce adipogenesis by recruiting macrophages and bone marrow-derived precursor cells to the TEC at early time points, with a second wave of nonbone marrow-derived progenitors. Gene expression analysis suggests that TNFα, LCN-2, and Interleukin 1β are important in early stages of neo-adipogenesis. Increasing platelet-derived growth factor and vascular endothelial cell growth factor expression at early time points correlates with preadipocyte proliferation and induction of angiogenesis. This study provides new information about key elements that are involved in early development of new adipose tissue.

Matrix metalloproteinase-9 of tubular and macrophage origin contributes to the pathogenesis of renal fibrosis via macrophage recruitment through osteopontin cleavage

A pro-fibrotic role of matrix metalloproteinase-9 (MMP-9) in tubular cell epithelial-mesenchymal transition (EMT) is well established in renal fibrosis; however studies from our group and others have demonstrated some previously unrecognized complexity of MMP-9 that has been overlooked in renal fibrosis. Therefore, the aim of this study was to determine the expression pattern, origin and the exact mechanism underlying the contribution of MMP-9 to unilateral ureteral obstruction (UUO), a well-established model of renal fibrosis via MMP-9 inhibition. Renal MMP-9 expression in BALB/c mice with UUO was examined on day 1, 3, 5, 7, 9, 11 and 14. To inhibit MMP-9 activity, MMP-2/9 inhibitor or MMP-9-neutralizing antibody was administered daily for 4 consecutive days from day 0-3, 6-9 or 10-13 and tissues harvested at day 14. In UUO, there was a bi-phasic early- and late-stage upregulation of MMP-9 activity. Interestingly, tubular epithelial cells (TECs) were the predominant source of MMP-9 during early stage, whereas TECs, macrophages and myofibroblasts produced MMP-9 during late-stage UUO. Early- and late-stage inhibition of MMP-9 in UUO mice significantly reduced tubular cell EMT and renal fibrosis. Moreover, MMP-9 inhibition caused a significant reduction in MMP-9-cleaved osteopontin and macrophage infiltration in UUO kidney. Our in vitro study showed MMP-9-cleaved osteopontin enhanced macrophage transwell migration and MMP-9 of both primary TEC and macrophage induced tubular cell EMT. In summary, our result suggests that MMP-9 of both TEC and macrophage origin may directly or indirectly contribute to the pathogenesis of renal fibrosis via osteopontin cleavage, which, in turn further recruit macrophage and induce tubular cell EMT. Our study also highlights the time dependency of its expression and the potential of stage-specific inhibition strategy against renal fibrosis.

PPARγ-independent induction of growth arrest and apoptosis in prostate and bladder carcinoma

Background Although PPARγ antagonists have shown considerable pre-clinical efficacy, recent studies suggest PPARγ ligands induce PPARγ-independent effects. There is a need to better define such effects to permit rational utilization of these agents. Methods We have studied the effects of a range of endogenous and synthetic PPARγ ligands on proliferation, growth arrest (FACS analysis) and apoptosis (caspase-3/7 activation and DNA fragmentation) in multiple prostate carcinoma cell lines (DU145, PC-3 and LNCaP) and in a series of cell lines modelling metastatic transitional cell carcinoma of the bladder (TSU-Pr1, TSU-Pr1-B1 and TSU-Pr1-B2). Results 15-deoxy-prostaglandin J2 (15dPGJ2), troglitazone (TGZ) and to a lesser extent ciglitazone exhibited inhibitory effects on cell number; the selective PPARγ antagonist GW9662 did not reverse these effects. Rosiglitazone and pioglitazone had no effect on proliferation. In addition, TGZ induced G0/G1 growth arrest whilst 15dPGJ2 induced apoptosis. Conclusion Troglitazone and 15dPGJ2 inhibit growth of prostate and bladder carcinoma cell lines through different mechanisms and the effects of both agents are PPARγ-independent.

Staurosporine augments EGF-mediated EMT in PMC42-LA cells through actin depolymerisation, focal contact size reduction and Snail1 induction : a model for cross-modulation

Background A feature of epithelial to mesenchymal transition (EMT) relevant to tumour dissemination is the reorganization of actin cytoskeleton/focal contacts, influencing cellular ECM adherence and motility. This is coupled with the transcriptional repression of E-cadherin, often mediated by Snail1, Snail2 and Zeb1/δEF1. These genes, overexpressed in breast carcinomas, are known targets of growth factor-initiated pathways, however it is less clear how alterations in ECM attachment cross-modulate to regulate these pathways. EGF induces EMT in the breast cancer cell line PMC42-LA and the kinase inhibitor staurosporine (ST) induces EMT in embryonic neural epithelial cells, with F-actin de-bundling and disruption of cell-cell adhesion, via inhibition of aPKC. Methods PMC42-LA cells were treated for 72 h with 10 ng/ml EGF, 40 nM ST, or both, and assessed for expression of E-cadherin repressor genes (Snail1, Snail2, Zeb1/δEF1) and EMT-related genes by QRT-PCR, multiplex tandem PCR (MT-PCR) and immunofluorescence +/- cycloheximide. Actin and focal contacts (paxillin) were visualized by confocal microscopy. A public database of human breast cancers was assessed for expression of Snail1 and Snail2 in relation to outcome. Results When PMC42-LA were treated with EGF, Snail2 was the principal E-cadherin repressor induced. With ST or ST+EGF this shifted to Snail1, with more extreme EMT and Zeb1/δEF1 induction seen with ST+EGF. ST reduced stress fibres and focal contact size rapidly and independently of gene transcription. Gene expression analysis by MT-PCR indicated that ST repressed many genes which were induced by EGF (EGFR, CAV1, CTGF, CYR61, CD44, S100A4) and induced genes which alter the actin cytoskeleton (NLF1, NLF2, EPHB4). Examination of the public database of breast cancers revealed tumours exhibiting higher Snail1 expression have an increased risk of disease-recurrence. This was not seen for Snail2, and Zeb1/δEF1 showed a reverse correlation with lower expression values being predictive of increased risk. Conclusion ST in combination with EGF directed a greater EMT via actin depolymerisation and focal contact size reduction, resulting in a loosening of cell-ECM attachment along with Snail1-Zeb1/δEF1 induction. This appeared fundamentally different to the EGF-induced EMT, highlighting the multiple pathways which can regulate EMT. Our findings add support for a functional role for Snail1 in invasive breast cancer.