Regularized nonnegative shared subspace learning

Joint modeling of related data sources has the potential to improve various data mining tasks such as transfer learning, multitask clustering, information retrieval etc. However, diversity among various data sources might outweigh the advantages of the joint modeling, and thus may result in performance degradations. To this end, we propose a regularized shared subspace learning framework, which can exploit the mutual strengths of related data sources while being immune to the effects of the variabilities of each source. This is achieved by further imposing a mutual orthogonality constraint on the constituent subspaces which segregates the common patterns from the source specific patterns, and thus, avoids performance degradations. Our approach is rooted in nonnegative matrix factorization and extends it further to enable joint analysis of related data sources. Experiments performed using three real world data sets for both retrieval and clustering applications demonstrate the benefits of regularization and validate the effectiveness of the model. Our proposed solution provides a formal framework appropriate for jointly analyzing related data sources and therefore, it is applicable to a wider context in data mining.

Multitasking: multiple, domain-specific cognitive functions in a virtual environment

Multitasking among three or more different tasks is a ubiquitous requirement of everyday cognition, yet rarely is it addressed in research on healthy adults who have had no specific training in multitasking skills. Participants completed a set of diverse subtasks within a simulated shopping mall and office environment, the Edinburgh Virtual Errands Test (EVET). The aim was to investigate how different cognitive functions, such as planning, retrospective and prospective memory, and visuospatial and verbal working memory, contribute to everyday multitasking. Subtasks were chosen to be diverse, and predictions were derived from a statistical model of everyday multitasking impairments associated with frontal-lobe lesions (Burgess, Veitch, de Lacy Costello, & Shallice, 2000b). Multiple regression indicated significant independent contributions from measures of retrospective memory, visuospatial working memory, and online planning, but not from independent measures of prospective memory or verbal working memory. Structural equation modelling showed that the best fit to the data arose from three underlying constructs, with Memory and Planning having a weak link, but with both having a strong directional pathway to an Intent construct that reflected implementation of intentions. Participants who followed their preprepared plan achieved higher scores than those who altered their plan during multitask performance. This was true regardless of whether the plan was efficient or poor. These results substantially develop and extend the Burgess et al. (2000b) model to healthy adults and yield new insight into the poorly understood area of everyday multitasking. The findings also point to the utility of using virtual environments for investigating this form of complex human cognition.

Factorial multi-task learning : a Bayesian nonparametric approach

Multi-task learning is a paradigm shown to improve the performance of related tasks through their joint learning. However, for real-world data, it is usually difficult to assess the task relatedness and joint learning with unrelated tasks may lead to serious performance degradations. To this end, we propose a framework that groups the tasks based on their relatedness in a subspace and allows a varying degree of relatedness among tasks by sharing the subspace bases across the groups. This provides the flexibility of no sharing when two sets of tasks are unrelated and partial/total sharing when the tasks are related. Importantly, the number of task-groups and the subspace dimensionality are automatically inferred from the data. To realize our framework, we introduce a novel Bayesian nonparametric prior that extends the traditional hierarchical beta process prior using a Dirichlet process to permit potentially infinite number of child beta processes. We apply our model for multi-task regression and classification applications. Experimental results using several synthetic and real datasets show the superiority of our model to other recent multi-task learning methods. Copyright 2013 by the author(s).

Multi-task transfer learning for in hospital-death prediction for ICU patients

Multi-Task Transfer Learning (MTTL) is an efficient approach for learning from inter-related tasks with small sample size and imbalanced class distribution. Since the intensive care unit (ICU) data set (publicly available in Physionet) has subjects from four different ICU types, we hypothesizethat there is an underlying relatedness amongst various ICU types. Therefore, this study aims to explore MTTL model for in-hospital mortality prediction of ICU patients. We used singletask learning (STL) approach on the augmented data as well as individual ICU data and compared the performance with the proposed MTTL model. As a performance measurement metrics, we used sensitivity (Sens), positive predictivity (+Pred), and Score. MTTL with class balancing showed the best performance with score of 0.78, 0.73, o.52 and 0.63 for ICU type 1(Coronary care unit), 2 (Cardiac surgery unit), 3 (Medical ICU) and 4 (Surgical ICU) respectively. In contrast the maximum score obtained using STL approach was 0.40 for ICU type 1 & 2. These results indicates that the performance of in-hospital mortality can be improved using ICU type information and by balancing the ’non-survivor’ class. The findings of the study may be useful for quantifying the quality of ICU care, managing ICU resources and selecting appropriate interventions.