Learning with symmetric label noise: The importance of being unhinged

Convex potential minimisation is the de facto approach to binary classification. However, Long and Servedio [2008] proved that under symmetric label noise (SLN), minimisation of any convex potential over a linear function class can result in classification performance equivalent to random guessing. This ostensibly shows that convex losses are not SLN-robust. In this paper, we propose a convex, classification-calibrated loss and prove that it is SLN-robust. The loss avoids the Long and Servedio [2008] result by virtue of being negatively unbounded. The loss is a modification of the hinge loss, where one does not clamp at zero; hence, we call it the unhinged loss. We show that the optimal unhinged solution is equivalent to that of a strongly regularised SVM, and is the limiting solution for any convex potential; this implies that strong l2 regularisation makes most standard learners SLN-robust. Experiments confirm the unhinged loss’ SLN-robustness.

Walter Godshaw (Gottschalk), Louise "Isa" Gottschalk nee Rosenthal and Peter Zander; England.

Digital Image

Portrait of Ernst Gottschalk with his wife Louise "Isa" nee Rosenthal; Welwyn Garden City, England.

Digital Image

Louisa (Isa) Gottschalk nee Rosenthal.

Digital Image

Woolies private label strategy will play directly into the hands of Aldi

Woolworths’ plan to rebrand its private label ranges in an attempt to meet changing shopper demands and combat the growth of Aldi will simply play into the hands of this German discounter. This new strategy, a replication of what Coles did in November 2015, will see their existing “Homebrand” and “Woolworths Essential” product ranges combined under the “Essentials” brand name. However, in focusing on price and private label ranges, supermarkets are in a race to the bottom where there are no points of difference in products except for price.

A multi-centre open-label randomised non-inferiority trial comparing watchful waiting to antibiotic treatment for acute otitis media without perforation in low-risk urban Aboriginal and Torres Strait Islander children (the WATCH trial): study protocol for a randomised controlled trial

Background Treatment guidelines recommend watchful waiting for children older than 2 years with acute otitis media (AOM) without perforation, unless they are at high risk of complications. The high prevalence of chronic suppurative otitis media (CSOM) in remote Aboriginal and Torres Strait Islander communities leads these children to be classified as high risk. Urban Aboriginal and Torres Strait Islander children are at lower risk of complications, but evidence to support the subsequent recommendation for watchful waiting in this population is lacking. Methods/Design This non-inferiority multi-centre randomised controlled trial will determine whether watchful waiting is non-inferior to immediate antibiotics for urban Aboriginal and Torres Strait Islander children with AOM without perforation. Children aged 2 − 16 years with AOM who are considered at low risk for complications will be recruited from six participating urban primary health care services across Australia. We will obtain informed consent from each participant or their guardian. The primary outcome is clinical resolution on day 7 (no pain, no fever of at least 38 °C, no bulging eardrum and no complications of AOM such as perforation or mastoiditis) as assessed by general practitioners or nurse practitioners. Participants and outcome assessors will not be blinded to treatment. With a sample size of 198 children in each arm, we have 80 % power to detect a non-inferiority margin of up to 10 % at a significance level of 5 %, assuming clinical improvement of at least 80 % in both groups. Allowing for a 20 % dropout rate, we aim to recruit 495 children. We will analyse both by intention-to-treat and per protocol. We will assess the cost- effectiveness of watchful waiting compared to immediate antibiotic prescription. We will also report on the implementation of the trial from the perspectives of parents/carers, health professionals and researchers. Discussion The trial will provide evidence for the safety and effectiveness of watchful waiting for the management of AOM in Aboriginal and Torres Strait Islander children living in urban settings who are considered to be at low risk of complications.

Using multi-label classification for acoustic pattern detection and assisting bird species surveys

Acoustics is a rich source of environmental information that can reflect the ecological dynamics. To deal with the escalating acoustic data, a variety of automated classification techniques have been used for acoustic patterns or scene recognition, including urban soundscapes such as streets and restaurants; and natural soundscapes such as raining and thundering. It is common to classify acoustic patterns under the assumption that a single type of soundscapes present in an audio clip. This assumption is reasonable for some carefully selected audios. However, only few experiments have been focused on classifying simultaneous acoustic patterns in long-duration recordings. This paper proposes a binary relevance based multi-label classification approach to recognise simultaneous acoustic patterns in one-minute audio clips. By utilising acoustic indices as global features and multilayer perceptron as a base classifier, we achieve good classification performance on in-the-field data. Compared with single-label classification, multi-label classification approach provides more detailed information about the distributions of various acoustic patterns in long-duration recordings. These results will merit further biodiversity investigations, such as bird species surveys.

Afatinib versus gefitinib as first-line treatment of patients with EGFR mutation-positive non-small-cell lung cancer (LUX-Lung 7): a phase 2B, open-label, randomised controlled trial

Background The irreversible ErbB family blocker afatinib and the reversible EGFR tyrosine kinase inhibitor gefitinib are approved for first-line treatment of EGFR mutation-positive non-small-cell lung cancer (NSCLC). We aimed to compare the efficacy and safety of afatinib and gefitinib in this setting. Methods This multicentre, international, open-label, exploratory, randomised controlled phase 2B trial (LUX-Lung 7) was done at 64 centres in 13 countries. Treatment-naive patients with stage IIIB or IV NSCLC and a common EGFR mutation (exon 19 deletion or Leu858Arg) were randomly assigned (1:1) to receive afatinib (40 mg per day) or gefitinib (250 mg per day) until disease progression, or beyond if deemed beneficial by the investigator. Randomisation, stratified by EGFR mutation type and status of brain metastases, was done centrally using a validated number generating system implemented via an interactive voice or web-based response system with a block size of four. Clinicians and patients were not masked to treatment allocation; independent review of tumour response was done in a blinded manner. Coprimary endpoints were progression-free survival by independent central review, time-to-treatment failure, and overall survival. Efficacy analyses were done in the intention-to-treat population and safety analyses were done in patients who received at least one dose of study drug. This ongoing study is registered with ClinicalTrials.gov, number NCT01466660. Findings Between Dec 13, 2011, and Aug 8, 2013, 319 patients were randomly assigned (160 to afatinib and 159 to gefitinib). Median follow-up was 27·3 months (IQR 15·3–33·9). Progression-free survival (median 11·0 months [95% CI 10·6–12·9] with afatinib vs 10·9 months [9·1–11·5] with gefitinib; hazard ratio [HR] 0·73 [95% CI 0·57–0·95], p=0·017) and time-to-treatment failure (median 13·7 months [95% CI 11·9–15·0] with afatinib vs 11·5 months [10·1–13·1] with gefitinib; HR 0·73 [95% CI 0·58–0·92], p=0·0073) were significantly longer with afatinib than with gefitinib. Overall survival data are not mature. The most common treatment-related grade 3 or 4 adverse events were diarrhoea (20 [13%] of 160 patients given afatinib vs two [1%] of 159 given gefitinib) and rash or acne (15 [9%] patients given afatinib vs five [3%] of those given gefitinib) and liver enzyme elevations (no patients given afatinib vs 14 [9%] of those given gefitinib). Serious treatment-related adverse events occurred in 17 (11%) patients in the afatinib group and seven (4%) in the gefitinib group. Ten (6%) patients in each group discontinued treatment due to drug-related adverse events. 15 (9%) fatal adverse events occurred in the afatinib group and ten (6%) in the gefitinib group. All but one of these deaths were considered unrelated to treatment; one patient in the gefitinib group died from drug-related hepatic and renal failure. Interpretation Afatinib significantly improved outcomes in treatment-naive patients with EGFR-mutated NSCLC compared with gefitinib, with a manageable tolerability profile. These data are potentially important for clinical decision making in this patient population.

Cilengitide combined with cetuximab and platinum-based chemotherapy as first-line treatment in advanced non-small-cell lung cancer (NSCLC) patients: Results of an open-label, randomized, controlled phase II study (CERTO)

Background: This multicentre, open-label, randomized, controlled phase II study evaluated cilengitide in combination with cetuximab and platinum-based chemotherapy, compared with cetuximab and chemotherapy alone, as first-line treatment of patients with advanced non-small-cell lung cancer (NSCLC). Patients and methods: Patients were randomized 1:1:1 to receive cetuximab plus platinum-based chemotherapy alone (control), or combined with cilengitide 2000 mg 1×/week i.v. (CIL-once) or 2×/week i.v. (CIL-twice). A protocol amendment limited enrolment to patients with epidermal growth factor receptor (EGFR) histoscore ≥200 and closed the CIL-twice arm for practical feasibility issues. Primary end point was progression-free survival (PFS; independent read); secondary end points included overall survival (OS), safety, and biomarker analyses. A comparison between the CIL-once and control arms is reported, both for the total cohorts, as well as for patients with EGFR histoscore ≥200. Results: There were 85 patients in the CIL-once group and 84 in the control group. The PFS (independent read) was 6.2 versus 5.0 months for CIL-once versus control [hazard ratio (HR) 0.72; P = 0.085]; for patients with EGFR histoscore ≥200, PFS was 6.8 versus 5.6 months, respectively (HR 0.57; P = 0.0446). Median OS was 13.6 for CIL-once versus 9.7 months for control (HR 0.81; P = 0.265). In patients with EGFR ≥200, OS was 13.2 versus 11.8 months, respectively (HR 0.95; P = 0.855). No major differences in adverse events between CIL-once and control were reported; nausea (59% versus 56%, respectively) and neutropenia (54% versus 46%, respectively) were the most frequent. There was no increased incidence of thromboembolic events or haemorrhage in cilengitide-treated patients. αvβ3 and αvβ5 expression was neither a predictive nor a prognostic indicator. Conclusions: The addition of cilengitide to cetuximab/chemotherapy indicated potential clinical activity, with a trend for PFS difference in the independent-read analysis. However, the observed inconsistencies across end points suggest additional investigations are required to substantiate a potential role of other integrin inhibitors in NSCLC treatment.

Multi Label Classification of Discrete Data

The paper describes an algorithm for multi-label classification. Since a pattern can belong to more than one class, the task of classifying a test pattern is a challenging one. We propose a new algorithm to carry out multi-label classification which works for discrete data. We have implemented the algorithm and presented the results for different multi-label data sets. The results have been compared with the algorithm multi-label KNN or ML-KNN and found to give good results.

Reduced graphene oxide-titania based platform for label-free biosensor

A label-free biosensor has been fabricated using a reduced graphene oxide (RGO) and anatase titania (ant-TiO2) nanocomposite, electrophoretically deposited onto an indium tin oxide coated glass substrate. The RGO-ant-TiO2 nanocomposite has been functionalized with protein (horseradish peroxidase) conjugated antibodies for the specific recognition and detection of Vibrio cholerae. The presence of Ab-Vc on the RGO-ant-TiO2 nanocomposite has been confirmed using electron microscopy, Fourier transform infrared spectroscopy and electrochemical techniques. Electrochemical studies relating to the fabricated Ab-Vc/RGO-ant-TiO2/ITO immunoelectrode have been conducted to investigate the binding kinetics. This immunosensor exhibits improved biosensing properties in the detection of Vibrio cholerae, with a sensitivity of 18.17 x 10(6) F mol(-1) L-1 m(-2) in the detection range of 0.12-5.4 nmol L-1, and a low detection limit of 0.12 nmol L-1. The association (k(a)), dissociation (k(d)) and equilibrium rate constants have been estimated to be 0.07 nM, 0.002 nM and 0.41 nM, respectively. This Ab-Vc/RGO-ant-TiO2/ITO immunoelectrode could be a suitable platform for the development of compact diagnostic devices.

Making risk minimization tolerant to label noise

In many applications, the training data, from which one needs to learn a classifier, is corrupted with label noise. Many standard algorithms such as SVM perform poorly in the presence of label noise. In this paper we investigate the robustness of risk minimization to label noise. We prove a sufficient condition on a loss function for the risk minimization under that loss to be tolerant to uniform label noise. We show that the 0-1 loss, sigmoid loss, ramp loss and probit loss satisfy this condition though none of the standard convex loss functions satisfy it. We also prove that, by choosing a sufficiently large value of a parameter in the loss function, the sigmoid loss, ramp loss and probit loss can be made tolerant to nonuniform label noise also if we can assume the classes to be separable under noise-free data distribution. Through extensive empirical studies, we show that risk minimization under the 0-1 loss, the sigmoid loss and the ramp loss has much better robustness to label noise when compared to the SVM algorithm. (C) 2015 Elsevier B.V. All rights reserved.

A Simple Label Switching Algorithm for Semisupervised Structural SVMs

In structured output learning, obtaining labeled data for real-world applications is usually costly, while unlabeled examples are available in abundance. Semisupervised structured classification deals with a small number of labeled examples and a large number of unlabeled structured data. In this work, we consider semisupervised structural support vector machines with domain constraints. The optimization problem, which in general is not convex, contains the loss terms associated with the labeled and unlabeled examples, along with the domain constraints. We propose a simple optimization approach that alternates between solving a supervised learning problem and a constraint matching problem. Solving the constraint matching problem is difficult for structured prediction, and we propose an efficient and effective label switching method to solve it. The alternating optimization is carried out within a deterministic annealing framework, which helps in effective constraint matching and avoiding poor local minima, which are not very useful. The algorithm is simple and easy to implement. Further, it is suitable for any structured output learning problem where exact inference is available. Experiments on benchmark sequence labeling data sets and a natural language parsing data set show that the proposed approach, though simple, achieves comparable generalization performance.

A Label-Free Multisensing Immunosensor Based on Imaging Ellipsometry

An immunosensor based on imaging ellipsometry and its potential applications was demonstrated in this paper. It has been proven a fast, reliable, and convenient method to quantify the thickness distribution of protein layers or detect protein concentration in solution. Combined with a protein chip, the immunosensor was able to detect multiple analytes simultaneously without any labeling. Preliminary results demonstrated how this immunosensor could be used to monitor several independent biospecific binding processes in real-time and in situ conditions.