Learning from Geometry

Subspaces and manifolds are two powerful models for high dimensional signals. Subspaces model linear correlation and are a good fit to signals generated by physical systems, such as frontal images of human faces and multiple sources impinging at an antenna array. Manifolds model sources that are not linearly correlated, but where signals are determined by a small number of parameters. Examples are images of human faces under different poses or expressions, and handwritten digits with varying styles. However, there will always be some degree of model mismatch between the subspace or manifold model and the true statistics of the source. This dissertation exploits subspace and manifold models as prior information in various signal processing and machine learning tasks.

A near-low-rank Gaussian mixture model measures proximity to a union of linear or affine subspaces. This simple model can effectively capture the signal distribution when each class is near a subspace. This dissertation studies how the pairwise geometry between these subspaces affects classification performance. When model mismatch is vanishingly small, the probability of misclassification is determined by the product of the sines of the principal angles between subspaces. When the model mismatch is more significant, the probability of misclassification is determined by the sum of the squares of the sines of the principal angles. Reliability of classification is derived in terms of the distribution of signal energy across principal vectors. Larger principal angles lead to smaller classification error, motivating a linear transform that optimizes principal angles. This linear transformation, termed TRAIT, also preserves some specific features in each class, being complementary to a recently developed Low Rank Transform (LRT). Moreover, when the model mismatch is more significant, TRAIT shows superior performance compared to LRT.

The manifold model enforces a constraint on the freedom of data variation. Learning features that are robust to data variation is very important, especially when the size of the training set is small. A learning machine with large numbers of parameters, e.g., deep neural network, can well describe a very complicated data distribution. However, it is also more likely to be sensitive to small perturbations of the data, and to suffer from suffer from degraded performance when generalizing to unseen (test) data.

From the perspective of complexity of function classes, such a learning machine has a huge capacity (complexity), which tends to overfit. The manifold model provides us with a way of regularizing the learning machine, so as to reduce the generalization error, therefore mitigate overfiting. Two different overfiting-preventing approaches are proposed, one from the perspective of data variation, the other from capacity/complexity control. In the first approach, the learning machine is encouraged to make decisions that vary smoothly for data points in local neighborhoods on the manifold. In the second approach, a graph adjacency matrix is derived for the manifold, and the learned features are encouraged to be aligned with the principal components of this adjacency matrix. Experimental results on benchmark datasets are demonstrated, showing an obvious advantage of the proposed approaches when the training set is small.

Stochastic optimization makes it possible to track a slowly varying subspace underlying streaming data. By approximating local neighborhoods using affine subspaces, a slowly varying manifold can be efficiently tracked as well, even with corrupted and noisy data. The more the local neighborhoods, the better the approximation, but the higher the computational complexity. A multiscale approximation scheme is proposed, where the local approximating subspaces are organized in a tree structure. Splitting and merging of the tree nodes then allows efficient control of the number of neighbourhoods. Deviation (of each datum) from the learned model is estimated, yielding a series of statistics for anomaly detection. This framework extends the classical {\em changepoint detection} technique, which only works for one dimensional signals. Simulations and experiments highlight the robustness and efficacy of the proposed approach in detecting an abrupt change in an otherwise slowly varying low-dimensional manifold.

Learning and Exploiting Camera Geometry for Computer Vision

This work explores the use of statistical methods in describing and estimating camera poses, as well as the information feedback loop between camera pose and object detection. Surging development in robotics and computer vision has pushed the need for algorithms that infer, understand, and utilize information about the position and orientation of the sensor platforms when observing and/or interacting with their environment.

The first contribution of this thesis is the development of a set of statistical tools for representing and estimating the uncertainty in object poses. A distribution for representing the joint uncertainty over multiple object positions and orientations is described, called the mirrored normal-Bingham distribution. This distribution generalizes both the normal distribution in Euclidean space, and the Bingham distribution on the unit hypersphere. It is shown to inherit many of the convenient properties of these special cases: it is the maximum-entropy distribution with fixed second moment, and there is a generalized Laplace approximation whose result is the mirrored normal-Bingham distribution. This distribution and approximation method are demonstrated by deriving the analytical approximation to the wrapped-normal distribution. Further, it is shown how these tools can be used to represent the uncertainty in the result of a bundle adjustment problem.

Another application of these methods is illustrated as part of a novel camera pose estimation algorithm based on object detections. The autocalibration task is formulated as a bundle adjustment problem using prior distributions over the 3D points to enforce the objects' structure and their relationship with the scene geometry. This framework is very flexible and enables the use of off-the-shelf computational tools to solve specialized autocalibration problems. Its performance is evaluated using a pedestrian detector to provide head and foot location observations, and it proves much faster and potentially more accurate than existing methods.

Finally, the information feedback loop between object detection and camera pose estimation is closed by utilizing camera pose information to improve object detection in scenarios with significant perspective warping. Methods are presented that allow the inverse perspective mapping traditionally applied to images to be applied instead to features computed from those images. For the special case of HOG-like features, which are used by many modern object detection systems, these methods are shown to provide substantial performance benefits over unadapted detectors while achieving real-time frame rates, orders of magnitude faster than comparable image warping methods.

The statistical tools and algorithms presented here are especially promising for mobile cameras, providing the ability to autocalibrate and adapt to the camera pose in real time. In addition, these methods have wide-ranging potential applications in diverse areas of computer vision, robotics, and imaging.

Machine Learning-based Techniques to Address Spectral Distortions in Photon Counting X-ray Computed Tomography

Spectral CT using a photon counting x-ray detector (PCXD) shows great potential for measuring material composition based on energy dependent x-ray attenuation. Spectral CT is especially suited for imaging with K-edge contrast agents to address the otherwise limited contrast in soft tissues. We have developed a micro-CT system based on a PCXD. This system enables full spectrum CT in which the energy thresholds of the PCXD are swept to sample the full energy spectrum for each detector element and projection angle. Measurements provided by the PCXD, however, are distorted due to undesirable physical eects in the detector and are very noisy due to photon starvation. In this work, we proposed two methods based on machine learning to address the spectral distortion issue and to improve the material decomposition. This rst approach is to model distortions using an articial neural network (ANN) and compensate for the distortion in a statistical reconstruction. The second approach is to directly correct for the distortion in the projections. Both technique can be done as a calibration process where the neural network can be trained using 3D printed phantoms data to learn the distortion model or the correction model of the spectral distortion. This replaces the need for synchrotron measurements required in conventional technique to derive the distortion model parametrically which could be costly and time consuming. The results demonstrate experimental feasibility and potential advantages of ANN-based distortion modeling and correction for more accurate K-edge imaging with a PCXD. Given the computational eciency with which the ANN can be applied to projection data, the proposed scheme can be readily integrated into existing CT reconstruction pipelines.

'Lines of flight': digital musical instruments, inclusive music bands, meaningful engagement in music-making and learning

In this study I examine the development of three inclusive music bands in Cork city. Derived from Jellison’s research on inclusive music education, inclusive music bands involve students with disabilities coming together with typically developing peers to make and learn music that is meaningful (Jellison, 2012). As part of this study, I established three inclusive music bands to address the lack of inclusive music making and learning experiences in Cork city. Each of these bands evolved and adapted in order to be socio-culturally relevant within formal and informal settings: Circles (community education band), Till 4 (secondary school band) and Mish Mash (third level and community band). I integrated Digital Musical Instruments into the three bands, in order to ensure access to music making and learning for band members with profound physical disabilities. Digital Musical Instruments are electronic music devices that facilitate active music making with minimal movement. This is the first study in Ireland to examine the experiences of inclusive music making and learning using Digital Musical Instruments. I propose that the integration of Digital Musical Instruments into inclusive music bands has the potential to further the equality and social justice agenda in music education in Ireland. In this study, I employed qualitative research methodology, incorporating participatory action research methodology and case study design. In this thesis I reveal the experiences of being involved in an inclusive music band in Cork city. I particularly focus on examining whether the use of this technology enhances meaningful music making and learning experiences for members with disabilities within inclusive environments. To both inform and understand the person centered and adaptable nature of these inclusive bands, I draw theoretical insights from Sen’s Capabilities Approach and Deleuze and Guatarri’s Rhizome Theory. Supported by descriptive narrative from research participants and an indepth examination of literature, I discover the optimum conditions and associated challenges of inclusive music practice in Cork city.

Computational Methods for Identifying Hypertrophic Cardiomyopathy using 12-lead ECG

Hypertrophic cardiomyopathy (HCM) is a cardiovascular disease where the heart muscle is partially thickened and blood flow is - potentially fatally - obstructed. It is one of the leading causes of sudden cardiac death in young people. Electrocardiography (ECG) and Echocardiography (Echo) are the standard tests for identifying HCM and other cardiac abnormalities. The American Heart Association has recommended using a pre-participation questionnaire for young athletes instead of ECG or Echo tests due to considerations of cost and time involved in interpreting the results of these tests by an expert cardiologist. Initially we set out to develop a classifier for automated prediction of young athletes’ heart conditions based on the answers to the questionnaire. Classification results and further in-depth analysis using computational and statistical methods indicated significant shortcomings of the questionnaire in predicting cardiac abnormalities. Automated methods for analyzing ECG signals can help reduce cost and save time in the pre-participation screening process by detecting HCM and other cardiac abnormalities. Therefore, the main goal of this dissertation work is to identify HCM through computational analysis of 12-lead ECG. ECG signals recorded on one or two leads have been analyzed in the past for classifying individual heartbeats into different types of arrhythmia as annotated primarily in the MIT-BIH database. In contrast, we classify complete sequences of 12-lead ECGs to assign patients into two groups: HCM vs. non-HCM. The challenges and issues we address include missing ECG waves in one or more leads and the dimensionality of a large feature-set. We address these by proposing imputation and feature-selection methods. We develop heartbeat-classifiers by employing Random Forests and Support Vector Machines, and propose a method to classify full 12-lead ECGs based on the proportion of heartbeats classified as HCM. The results from our experiments show that the classifiers developed using our methods perform well in identifying HCM. Thus the two contributions of this thesis are the utilization of computational and statistical methods for discovering shortcomings in a current screening procedure and the development of methods to identify HCM through computational analysis of 12-lead ECG signals.

Next generation e-learning platform: virtual laboratory simulations

Bioscience subjects require a significant amount of training in laboratory techniques to produce highly skilled science graduates. Many techniques which are currently used in diagnostic, research and industrial laboratories require expensive equipment for single users; examples of which include next generation sequencing, quantitative PCR, mass spectrometry and other analytical techniques. The cost of the machines, reagents and limited access frequently preclude undergraduate students from using such cutting edge techniques. In addition to cost and availability, the time taken for analytical runs on equipment such as High Performance Liquid Chromatography (HPLC) does not necessarily fit with the limitations of timetabling. Understanding the theory underlying these techniques without the accompanying practical classes can be unexciting for students. One alternative from wet laboratory provision is to use virtual simulations of such practical which enable students to see the machines and interact with them to generate data. The Faculty of Science and Technology at the University of Westminster has provided all second and third year undergraduate students with iPads so that these students all have access to a mobile device to assist with learning. We have purchased licences from Labster to access a range of virtual laboratory simulations. These virtual laboratories are fully equipped and require student responses to multiple answer questions in order to progress through the experiment. In a pilot study to look at the feasibility of the Labster virtual laboratory simulations with the iPad devices; second year Biological Science students (n=36) worked through the Labster HPLC simulation on iPads. The virtual HPLC simulation enabled students to optimise the conditions for the separation of drugs. Answers to Multiple choice questions were necessary to progress through the simulation, these focussed on the underlying principles of the HPLC technique. Following the virtual laboratory simulation students went to a real HPLC in the analytical suite in order to separate of asprin, caffeine and paracetamol. In a survey 100% of students (n=36) in this cohort agreed that the Labster virtual simulation had helped them to understand HPLC. In free text responses one student commented that "The terminology is very clear and I enjoyed using Labster very much”. One member of staff commented that “there was a very good knowledge interaction with the virtual practical”.

‘Learning to be Zen’: Women travellers and the imperative to happy

This paper follows the emotional management of lone, independent women travellers as they move through tourist spaces, based on my doctoral research Embodiment and Emotion in the experiences of independent women tourists (2012). Specifically, this paper will focus on ‘gendering happiness’ by arguing that women travellers are significantly compelled to feel and display characteristics of happiness, humour and ‘learning to be Zen’ in order to be successful travellers. The imperative to become, and remain, happy and humorous in the face of embodied, emotional and gendered constraints is a key feature of women’s reflections of their travelling experiences, mirroring the recent emergence of literature into happiness and positive thinking within feminist theory (Ehrenreich 2010, Ahmed 2010). Negotiating ‘bad’ emotions provides a powerful insight into the perceptions of women travellers; to remain happy can mask problematic power relations and other forms of resistance. This is not to say that emotional negotiation is not partly a form of effective resistance, rather, I wish to make room for the freedom to be unhappy and angry in travelling space without feeling failure for not achieving a successful travelling identity.

Learning Environments in Design Studio Culture

The paper reports on a study of design studio culture from a student perspective. Learning in design studio culture has been theorised variously as a signature pedagogy emulating professional practice models, as a community of practice and as a form of problem-based learning, all largely based on the study of teaching events in studio. The focus of this research has extended beyond formally recognized activities to encompass the student’s experience of their social and community networks, working places and study set-ups, to examine how these have contributed to studio culture and how there have been supported by studio teaching. Semi-structured interviews with final year undergraduate students of architecture formed the basis of the study using an interpretivist approach informed by Actor-network theory, with studio culture featured as the focal actor, enrolling students and engaging with other actors, together constituting an actor-network of studio culture. The other actors included social community patterns and activities; the numerous working spaces (including but not limited to the studio space itself); the equipment, tools of trade and material pre-requisites for working; the portfolio enrolling the other actors to produce work for it; and the various formal and informal events associated with the course itself. Studio culture is a highly charged social arena: The question is how, and in particular, which aspects of it support learning? Theoretical models of situated learning and communities of practice models have informed the analysis, with Bourdieu’s theory of practice, and his interrelated concepts of habitus, field and capital providing a means of relating individually acquired habits and modes of working to social contexts. Bourdieu’s model of habitus involves the externalisation through the social realm of habits and knowledge previously internalised. It is therefore a useful model for considering whole individual learning activities; shared repertoires and practices located in the social realm. The social milieu of the studio provides a scene for the exercise and display of ‘practicing’ and the accumulation of a form of ‘practicing-capital’. This capital is a property of the social milieu rather than the space, so working or practicing in the company of others (in space and through social media) becomes a more valued aspect of studio than space or facilities alone. This practicing-capital involves the acquisition of a habitus of studio culture, with the transformation of physical practices or habits into social dispositions, acquiring social capital (driving the social milieu) and cultural capital (practicing-knowledge) in the process. The research drew on students’ experiences, and their practicing ‘getting a feel for the game’ by exploring the limits or boundaries of the field of studio culture. The research demonstrated that a notional studio community was in effect a social context for supporting learning; a range of settings to explore and test out newly internalised knowledge, demonstrate or display ideas, modes of thinking and practicing. The study presents a nuanced interpretation of how students relate to a studio culture that involves a notional community, and a developing habitus within a field of practicing that extends beyond teaching scenarios.

Multilingualism and conceptual modelling

One of the leading motivations behind the multilingual semantic web is to make resources accessible digitally in an online global multilingual context. Consequently, it is fundamental for knowledge bases to find a way to manage multilingualism and thus be equipped with those procedures for its conceptual modelling. In this context, the goal of this paper is to discuss how common-sense knowledge and cultural knowledge are modelled in a multilingual framework. More particularly, multilingualism and conceptual modelling are dealt with from the perspective of FunGramKB, a lexico-conceptual knowledge base for natural language understanding. This project argues for a clear division between the lexical and the conceptual dimensions of knowledge. Moreover, the conceptual layer is organized into three modules, which result from a strong commitment towards capturing semantic knowledge (Ontology), procedural knowledge (Cognicon) and episodic knowledge (Onomasticon). Cultural mismatches are discussed and formally represented at the three conceptual levels of FunGramKB.

Grammar in dictionaries revisited: the case of verbs with se

This paper is a study about the way in which se structures are represented in 20 verb entries of nine dictionaries of Spanish language. There is a large number of these structures and they are problematic for native and non native speakers. Verbs of the analysis are middle-high frequency and, in the most part of the cases, very polysemous, and this allows to observe interconnections between the different se structures and the different meanings of each verb. Data of the lexicographic analysis are cross-checked with corpus analysis of the same units. As a result, it is observed that there is a large variety in the data which are offered in each dictionary and in the way they are offered, inter and intradictionary. The reasons range from the theoretical overall of each Project to practical performance. This leads to the conclusion that it is necessary to further progress in the dictionary model it is being handled, in order to offer lexico-grammatical phenomenon such as se verbs in an accurate, clear and exhaustive way.

Bootcamp EMMA MOOC Assessment for learning in practice

Formative assessment or assessment for learning is a relevant theme for teachers and educationalists. Formative assessment is a valuable tool for supporting the learning process. It is applied during learning and offers you more and better opportunities to guide your students. Formative assessment allows for more individual and/or personalised guidance. In this MOOC Assessment for learning in practice we will provide you with theory and guidelines for knowledge construction on the topic of formative assessment while offering support in designing assessments that can be applied as a tool for learning and training of competences. In this MOOC you can learn what formative assessment is, learn to differentiate between summative and formative assessment, and how formative assessment can contribute to the learning of your pupils or students. Design of rubrics, the role and functions of feedback, the use of technology for formative assessment are the topics of the MOOC.

Education and self-regulation of learning for gifted pupils: Systemic design and development.

Gifted pupils differ from their age-mates with respect to development potential, actual competencies, self-regulatory capabilities, and learning styles in one or more domains of competence. The question is how to design and develop education that fits and further supports such characteristics and competencies of gifted pupils. Analysis of various types of educational interventions for gifted pupils reflects positive cognitive or intellectual effects and differentiated social comparison or group-related effects on these pupils. Systemic preventive combination of such interventions could make these more effective and sustainable. The systemic design is characterised by three conditional dimensions: differentiation of learning materials and procedures, integration by and use of ICT support, and strategies to improve development and learning. The relationships to diagnostic, instructional, managerial, and systemic learning aspects are expressed in guidelines to develop or transform education. The guidelines imply the facilitation of learning arrangements that provide flexible self-regulation for gifted pupils. A three-year pilot in Dutch nursery and primary school is conducted to develop and implement the design in collaboration with teachers. The results constitute prototypes of structured competence domains and supportive software. These support the screening of entry characteristics of all four-year old pupils and assignment of adequate play and learning processes and activities throughout the school career. Gifted and other pupils are supported to work at their actual achievement or competency levels since their start in nursery school, in self-regulated learning arrangements either in or out of class. Each pupil can choose other pupils to collaborate with in small groups, at self-chosen tasks or activities, while being coached by the teacher. Formative evaluation of the school development process shows that the systemic prevention guidelines seem to improve learning and social progress of gifted pupils, including their self-regulation. Further development and implementation steps are discussed.

Learning for self-regulation: Improving instructional benefits for pupils, teachers, parents, schools, and society at large

Compulsory education laws oblige primary and secondary schools to give each pupil positive encouragement in, for example, social, emotional, cognitive, creative, and ethical respects. This is a fairly smooth process for most pupils, but it is not as easy to achieve with others. A pattern of pupil, home or family, and school variables turns out to be responsible for a long-term process that may lead to a pupil’s dropping out of education. A systemic approach will do much to introduce more clarity into the diagnosis, potential reduction and possible prevention of some persistent educational problems that express themselves in related phenomena, for example low school motivation and achievement; forced underachievement of high ability pupils; concentration of bullying and violent behaviour in and around some types of classes and schools; and drop-out percentages that are relatively constant across time. Such problems have a negative effect on pupils, teachers, parents, schools, and society alike. In this address, I would therefore like to clarify some of the systemic causes and processes that we have identified between specific educational and pupil characteristics. Both theory and practice can assist in developing, implementing, and checking better learning methods and coaching procedures, particularly for pupils at risk. This development approach will take time and require co-ordination, but it will result in much better processes and outcomes than we are used to. First, I will diagnose some systemic aspects of education that do not seem to optimise the learning processes and school careers of some types of pupils in particular. Second, I will specify cognitive, social, motivational, and self-regulative aspects of learning tasks and relate corresponding learning processes to relevant instructional and wider educational contexts. I will elaborate these theoretical notions into an educational design with systemic instructional guidelines and multilevel procedures that may improve learning processes for different types of pupils. Internet-based Information and Communication Technology, or ICT, also plays a major role here. Third, I will report on concrete developments made in prototype research and trials. The development process concerns ICT-based differentiation of learning materials and procedures, and ICT-based strategies to improve pupil development and learning. Fourth, I will focus on the experience gained in primary and secondary educational practice with respect to implementation. We can learn much from such practical experience, in particular about the conditions for developing and implementing the necessary changes in and around schools. Finally, I will propose future research. As I hope to make clear, theory-based development and implementation research can join forces with systemic innovation and differentiated assessment in educational practice, to pave the way for optimal “learning for self-regulation” for pupils, teachers, parents, schools, and society at large.

Learning to manage complexity through simulation: students' challenges and possible strategies

Many have called for medical students to learn how to manage complexity in healthcare. This study examines the nuances of students' challenges in coping with a complex simulation learning activity, using concepts from complexity theory, and suggests strategies to help them better understand and manage complexity.Wearing video glasses, participants took part in a simulation ward-based exercise that incorporated characteristics of complexity. Video footage was used to elicit interviews, which were transcribed. Using complexity theory as a theoretical lens, an iterative approach was taken to identify the challenges that participants faced and possible coping strategies using both interview transcripts and video footage.Students' challenges in coping with clinical complexity included being: a) unprepared for 'diving in', b) caught in an escalating system, c) captured by the patient, and d) unable to assert boundaries of acceptable practice.Many characteristics of complexity can be recreated in a ward-based simulation learning activity, affording learners an embodied and immersive experience of these complexity challenges. Possible strategies for managing complexity themes include: a) taking time to size up the system, b) attuning to what emerges, c) reducing complexity, d) boundary practices, and e) working with uncertainty. This study signals pedagogical opportunities for recognizing and dealing with complexity.

Addressing the theory practice gap in nurse education: evaluating teaching through audit against NMC standards and final management placement

Introduction
This paper outlines an innovative approach to auditing and evaluating the content of a management and leadership module for undergraduate nursing students after their final management clinical placement. Normally evaluations of teaching in a module take place at the end of a teaching module and therefore do not properly reflect the value of the teaching in relation to practical clinical experience.
Aim
This audit and evaluation sought to explore both the practical value of the teaching and learning, and also the degree to which it the teaching reflected against the NMC Standards of Education and Learning (2010 domain 3).
Methods
Having piloted the evaluative tool with an earlier cohort of nursing students, this evaluation explored both a quantitative assessment employing a Personal Response System (n =172), together with a qualitative dimension (n=116), thus delivering paper-based comments and reflections from students on the value and practicality of the module teaching theory to their final clinical management experience. The quantitative audit data were analysed for frequencies and cross tabulation and the qualitative audit data were thematically analysed.
Results
Results suggest a significant proportion of the students, appreciated the quality of the standard of teaching, but more importantly, ‘valued or highly valued’ the teaching and learning in relation to how it helped to significantly inform their management placement experience. A smaller proportion of the students underlined limitations and areas in which further improvement can be made in teaching and learning to the module.
Conclusion
Significantly positive evaluation by the students of the practical value of teaching and learning, to the theoretical management module. This has proved a useful auditing approach in assessing the theoretical teaching to student’s Level 3 clinical experience, and facilitated significant recommendations as far as developing the teaching and learning to better reflect the practice needs of nursing students