External knowledge and query strategies in active learning: A study in clinical information extraction

This paper presents a new active learning query strategy for information extraction, called Domain Knowledge Informativeness (DKI). Active learning is often used to reduce the amount of annotation effort required to obtain training data for machine learning algorithms. A key component of an active learning approach is the query strategy, which is used to iteratively select samples for annotation. Knowledge resources have been used in information extraction as a means to derive additional features for sample representation. DKI is, however, the first query strategy that exploits such resources to inform sample selection. To evaluate the merits of DKI, in particular with respect to the reduction in annotation effort that the new query strategy allows to achieve, we conduct a comprehensive empirical comparison of active learning query strategies for information extraction within the clinical domain. The clinical domain was chosen for this work because of the availability of extensive structured knowledge resources which have often been exploited for feature generation. In addition, the clinical domain offers a compelling use case for active learning because of the necessary high costs and hurdles associated with obtaining annotations in this domain. Our experimental findings demonstrated that 1) amongst existing query strategies, the ones based on the classification model’s confidence are a better choice for clinical data as they perform equally well with a much lighter computational load, and 2) significant reductions in annotation effort are achievable by exploiting knowledge resources within active learning query strategies, with up to 14% less tokens and concepts to manually annotate than with state-of-the-art query strategies.

Integration over song classification replicates: song variant analysis in the hihi

Human expert analyses are commonly used in bioacoustic studies and can potentially limit the reproducibility of these results. In this paper, a machine learning method is presented to statistically classify avian vocalizations. Automated approaches were applied to isolate bird songs from long field recordings, assess song similarities, and classify songs into distinct variants. Because no positive controls were available to assess the true classification of variants, multiple replicates of automatic classification of song variants were analyzed to investigate clustering uncertainty. The automatic classifications were more similar to the expert classifications than expected by chance. Application of these methods demonstrated the presence of discrete song variants in an island population of the New Zealand hihi (Notiomystis cincta). The geographic patterns of song variation were then revealed by integrating over classification replicates. Because this automated approach considers variation in song variant classification, it reduces potential human bias and facilitates the reproducibility of the results.

Generalizing the use of geographical weights in biodiversity modelling

Aim Determining how ecological processes vary across space is a major focus in ecology. Current methods that investigate such effects remain constrained by important limiting assumptions. Here we provide an extension to geographically weighted regression in which local regression and spatial weighting are used in combination. This method can be used to investigate non-stationarity and spatial-scale effects using any regression technique that can accommodate uneven weighting of observations, including machine learning. Innovation We extend the use of spatial weights to generalized linear models and boosted regression trees by using simulated data for which the results are known, and compare these local approaches with existing alternatives such as geographically weighted regression (GWR). The spatial weighting procedure (1) explained up to 80% deviance in simulated species richness, (2) optimized the normal distribution of model residuals when applied to generalized linear models versus GWR, and (3) detected nonlinear relationships and interactions between response variables and their predictors when applied to boosted regression trees. Predictor ranking changed with spatial scale, highlighting the scales at which different species–environment relationships need to be considered. Main conclusions GWR is useful for investigating spatially varying species–environment relationships. However, the use of local weights implemented in alternative modelling techniques can help detect nonlinear relationships and high-order interactions that were previously unassessed. Therefore, this method not only informs us how location and scale influence our perception of patterns and processes, it also offers a way to deal with different ecological interpretations that can emerge as different areas of spatial influence are considered during model fitting.

Automating marine mammal detection in aerial images captured during wildlife surveys: A deep learning approach

Aerial surveys conducted using manned or unmanned aircraft with customized camera payloads can generate a large number of images. Manual review of these images to extract data is prohibitive in terms of time and financial resources, thus providing strong incentive to automate this process using computer vision systems. There are potential applications for these automated systems in areas such as surveillance and monitoring, precision agriculture, law enforcement, asset inspection, and wildlife assessment. In this paper, we present an efficient machine learning system for automating the detection of marine species in aerial imagery. The effectiveness of our approach can be credited to the combination of a well-suited region proposal method and the use of Deep Convolutional Neural Networks (DCNNs). In comparison to previous algorithms designed for the same purpose, we have been able to dramatically improve recall to more than 80% and improve precision to 27% by using DCNNs as the core approach.

Eliciting and encoding expert knowledge on variable selection into classical or Bayesian species distribution models

The quality of species distribution models (SDMs) relies to a large degree on the quality of the input data, from bioclimatic indices to environmental and habitat descriptors (Austin, 2002). Recent reviews of SDM techniques, have sought to optimize predictive performance e.g. Elith et al., 2006. In general SDMs employ one of three approaches to variable selection. The simplest approach relies on the expert to select the variables, as in environmental niche models Nix, 1986 or a generalized linear model without variable selection (Miller and Franklin, 2002). A second approach explicitly incorporates variable selection into model fitting, which allows examination of particular combinations of variables. Examples include generalized linear or additive models with variable selection (Hastie et al. 2002); or classification trees with complexity or model based pruning (Breiman et al., 1984, Zeileis, 2008). A third approach uses model averaging, to summarize the overall contribution of a variable, without considering particular combinations. Examples include neural networks, boosted or bagged regression trees and Maximum Entropy as compared in Elith et al. 2006. Typically, users of SDMs will either consider a small number of variable sets, via the first approach, or else supply all of the candidate variables (often numbering more than a hundred) to the second or third approaches. Bayesian SDMs exist, with several methods for eliciting and encoding priors on model parameters (see review in Low Choy et al. 2010). However few methods have been published for informative variable selection; one example is Bayesian trees (O’Leary 2008). Here we report an elicitation protocol that helps makes explicit a priori expert judgements on the quality of candidate variables. This protocol can be flexibly applied to any of the three approaches to variable selection, described above, Bayesian or otherwise. We demonstrate how this information can be obtained then used to guide variable selection in classical or machine learning SDMs, or to define priors within Bayesian SDMs.

Towards vision-based deep reinforcement learning for robotic motion control

This paper introduces a machine learning based system for controlling a robotic manipulator with visual perception only. The capability to autonomously learn robot controllers solely from raw-pixel images and without any prior knowledge of configuration is shown for the first time. We build upon the success of recent deep reinforcement learning and develop a system for learning target reaching with a three-joint robot manipulator using external visual observation. A Deep Q Network (DQN) was demonstrated to perform target reaching after training in simulation. Transferring the network to real hardware and real observation in a naive approach failed, but experiments show that the network works when replacing camera images with synthetic images.

Developing and testing readability measurements for second language learners

This research constructed a readability measurement for French speakers who view English as a second language. It identified the true cognates, which are the similar words from these two languages, as an indicator of the difficulty of an English text for French people. A multilingual lexical resource is used to detect true cognates in text, and Statistical Language Modelling to predict the predict the readability level. The proposed enhanced statistical language model is making a step in the right direction by improving the accuracy of readability predictions for French speakers by up to 10% compared to state of the art approaches. The outcome of this study could accelerate the learning process for French speakers who are studying English. More importantly, this study also benefits the readability estimation research community, presenting an approach and evaluation at sentence level as well as innovating with the use of cognates as a new text feature.

Learning experiences in a giant interactive environment: Insights from The Cube

In November 2012, Queensland University of Technology in Australia launched a giant interactive learning environment known as The Cube. This article reports a phenomenographic investigation into visitors’ different experiences of learning in The Cube. At present very little is known about people’s learning experience in spaces featuring large interactive screens. We observed many visitors to The Cube and interviewed 26 people. Our analysis identified critical variation across the visitors’ experience of learning in The Cube. The findings are discussed as the learning strategy (in terms of Absorption, Exploration, Isolation and Collaboration); and the content learned (in terms of Technology, Skills and Topics). Other findings presented here are dimensions of the learning strategy and the content learned, with differing perspectives on each dimension. These outcomes provide early insights into the potential of giant interactive environments to enhance learning approaches and guide the design of innovative learning spaces in higher education.

Effective web service discovery using a combination of a semantic model and a data mining technique

With the advent of Service Oriented Architecture, Web Services have gained tremendous popularity. Due to the availability of a large number of Web services, finding an appropriate Web service according to the requirement of the user is a challenge. This warrants the need to establish an effective and reliable process of Web service discovery. A considerable body of research has emerged to develop methods to improve the accuracy of Web service discovery to match the best service. The process of Web service discovery results in suggesting many individual services that partially fulfil the user’s interest. By considering the semantic relationships of words used in describing the services as well as the use of input and output parameters can lead to accurate Web service discovery. Appropriate linking of individual matched services should fully satisfy the requirements which the user is looking for. This research proposes to integrate a semantic model and a data mining technique to enhance the accuracy of Web service discovery. A novel three-phase Web service discovery methodology has been proposed. The first phase performs match-making to find semantically similar Web services for a user query. In order to perform semantic analysis on the content present in the Web service description language document, the support-based latent semantic kernel is constructed using an innovative concept of binning and merging on the large quantity of text documents covering diverse areas of domain of knowledge. The use of a generic latent semantic kernel constructed with a large number of terms helps to find the hidden meaning of the query terms which otherwise could not be found. Sometimes a single Web service is unable to fully satisfy the requirement of the user. In such cases, a composition of multiple inter-related Web services is presented to the user. The task of checking the possibility of linking multiple Web services is done in the second phase. Once the feasibility of linking Web services is checked, the objective is to provide the user with the best composition of Web services. In the link analysis phase, the Web services are modelled as nodes of a graph and an allpair shortest-path algorithm is applied to find the optimum path at the minimum cost for traversal. The third phase which is the system integration, integrates the results from the preceding two phases by using an original fusion algorithm in the fusion engine. Finally, the recommendation engine which is an integral part of the system integration phase makes the final recommendations including individual and composite Web services to the user. In order to evaluate the performance of the proposed method, extensive experimentation has been performed. Results of the proposed support-based semantic kernel method of Web service discovery are compared with the results of the standard keyword-based information-retrieval method and a clustering-based machine-learning method of Web service discovery. The proposed method outperforms both information-retrieval and machine-learning based methods. Experimental results and statistical analysis also show that the best Web services compositions are obtained by considering 10 to 15 Web services that are found in phase-I for linking. Empirical results also ascertain that the fusion engine boosts the accuracy of Web service discovery by combining the inputs from both the semantic analysis (phase-I) and the link analysis (phase-II) in a systematic fashion. Overall, the accuracy of Web service discovery with the proposed method shows a significant improvement over traditional discovery methods.

Life cycle modelling and design knowledge development in 3D virtual environments : final report

Experience plays an important role in building management. “How often will this asset need repair?” or “How much time is this repair going to take?” are types of questions that project and facility managers face daily in planning activities. Failure or success in developing good schedules, budgets and other project management tasks depend on the project manager's ability to obtain reliable information to be able to answer these types of questions. Young practitioners tend to rely on information that is based on regional averages and provided by publishing companies. This is in contrast to experienced project managers who tend to rely heavily on personal experience. Another aspect of building management is that many practitioners are seeking to improve available scheduling algorithms, estimating spreadsheets and other project management tools. Such “micro-scale” levels of research are important in providing the required tools for the project manager's tasks. However, even with such tools, low quality input information will produce inaccurate schedules and budgets as output. Thus, it is also important to have a broad approach to research at a more “macro-scale.” Recent trends show that the Architectural, Engineering, Construction (AEC) industry is experiencing explosive growth in its capabilities to generate and collect data. There is a great deal of valuable knowledge that can be obtained from the appropriate use of this data and therefore the need has arisen to analyse this increasing amount of available data. Data Mining can be applied as a powerful tool to extract relevant and useful information from this sea of data. Knowledge Discovery in Databases (KDD) and Data Mining (DM) are tools that allow identification of valid, useful, and previously unknown patterns so large amounts of project data may be analysed. These technologies combine techniques from machine learning, artificial intelligence, pattern recognition, statistics, databases, and visualization to automatically extract concepts, interrelationships, and patterns of interest from large databases. The project involves the development of a prototype tool to support facility managers, building owners and designers. This final report presents the AIMMTM prototype system and documents how and what data mining techniques can be applied, the results of their application and the benefits gained from the system. The AIMMTM system is capable of searching for useful patterns of knowledge and correlations within the existing building maintenance data to support decision making about future maintenance operations. The application of the AIMMTM prototype system on building models and their maintenance data (supplied by industry partners) utilises various data mining algorithms and the maintenance data is analysed using interactive visual tools. The application of the AIMMTM prototype system to help in improving maintenance management and building life cycle includes: (i) data preparation and cleaning, (ii) integrating meaningful domain attributes, (iii) performing extensive data mining experiments in which visual analysis (using stacked histograms), classification and clustering techniques, associative rule mining algorithm such as “Apriori” and (iv) filtering and refining data mining results, including the potential implications of these results for improving maintenance management. Maintenance data of a variety of asset types were selected for demonstration with the aim of discovering meaningful patterns to assist facility managers in strategic planning and provide a knowledge base to help shape future requirements and design briefing. Utilising the prototype system developed here, positive and interesting results regarding patterns and structures of data have been obtained.

Life Cycle Modelling and Design Knowledge Development in 3D Virtual Environments

Experience plays an important role in building management. “How often will this asset need repair?” or “How much time is this repair going to take?” are types of questions that project and facility managers face daily in planning activities. Failure or success in developing good schedules, budgets and other project management tasks depend on the project manager's ability to obtain reliable information to be able to answer these types of questions. Young practitioners tend to rely on information that is based on regional averages and provided by publishing companies. This is in contrast to experienced project managers who tend to rely heavily on personal experience. Another aspect of building management is that many practitioners are seeking to improve available scheduling algorithms, estimating spreadsheets and other project management tools. Such “micro-scale” levels of research are important in providing the required tools for the project manager's tasks. However, even with such tools, low quality input information will produce inaccurate schedules and budgets as output. Thus, it is also important to have a broad approach to research at a more “macro-scale.” Recent trends show that the Architectural, Engineering, Construction (AEC) industry is experiencing explosive growth in its capabilities to generate and collect data. There is a great deal of valuable knowledge that can be obtained from the appropriate use of this data and therefore the need has arisen to analyse this increasing amount of available data. Data Mining can be applied as a powerful tool to extract relevant and useful information from this sea of data. Knowledge Discovery in Databases (KDD) and Data Mining (DM) are tools that allow identification of valid, useful, and previously unknown patterns so large amounts of project data may be analysed. These technologies combine techniques from machine learning, artificial intelligence, pattern recognition, statistics, databases, and visualization to automatically extract concepts, interrelationships, and patterns of interest from large databases. The project involves the development of a prototype tool to support facility managers, building owners and designers. This Industry focused report presents the AIMMTM prototype system and documents how and what data mining techniques can be applied, the results of their application and the benefits gained from the system. The AIMMTM system is capable of searching for useful patterns of knowledge and correlations within the existing building maintenance data to support decision making about future maintenance operations. The application of the AIMMTM prototype system on building models and their maintenance data (supplied by industry partners) utilises various data mining algorithms and the maintenance data is analysed using interactive visual tools. The application of the AIMMTM prototype system to help in improving maintenance management and building life cycle includes: (i) data preparation and cleaning, (ii) integrating meaningful domain attributes, (iii) performing extensive data mining experiments in which visual analysis (using stacked histograms), classification and clustering techniques, associative rule mining algorithm such as “Apriori” and (iv) filtering and refining data mining results, including the potential implications of these results for improving maintenance management. Maintenance data of a variety of asset types were selected for demonstration with the aim of discovering meaningful patterns to assist facility managers in strategic planning and provide a knowledge base to help shape future requirements and design briefing. Utilising the prototype system developed here, positive and interesting results regarding patterns and structures of data have been obtained.

Mainstreaming sustainability into pre-service teacher edcuation in Australia

There is a growing interest in and support for education for sustainability in Australian schools. Australian Government schemes such as the Australian Sustainable Schools Initiative (AuSSI), along with strategies such as Educating for a Sustainable Future: A National Environmental Education Statement for Australian Schools(NEES(Australian Government and Curriculum Corporation (2005) and Living Sustainably: The Australian Government’s National Action Plan for Education for Sustainability (Australian Government 2009), recognise the need and offer support for education for sustainability in Australian schools. The number of schools that have engaged with AuSSI indicates that this interest also exists within Australian schools. Despite this, recent research indicates that pre-service teacher education institutions and programs are not doing all they can to prepare teachers for teaching education for sustainability or for working within sustainable schools. The education of school teachers plays a vital role in achieving changes in teaching and learning in schools. Indeed, the professional development of teachers in education for sustainability has been identified as ‘the priority of priorities’. Much has been written about the need to ‘reorient teacher education towards sustainability’. Teacher education is seen as a key strategy that is yet to be effectively utilised to embed education for sustainability in schools. Mainstreaming sustainability in Australian schools will not be achieved without the preparation of teachers for this task. The Mainstreaming Sustainability model piloted in this study seeks to engage a range of stakeholder organisations and key agents of change within a system to all work simultaneously to bring about a change, such as the mainstreaming of sustainability. The model is premised on the understanding that sustainability will be mainstreamed within teacher education if there is engagement with key agents of change across the wider teacher education system and if the key agents of change are ‘deeply’ involved in making the change. The model thus seeks to marry broad engagement across a system with the active participation of stakeholders within that system. Such a systemic approach is a way of bringing together diverse viewpoints to make sense of an issue and harness that shared interpretation to define boundaries, roles and relationships leading to a better defined problem that can be acted upon more effectively. Like action research, the systemic approach is also concerned with modelling change and seeking plausible solutions through collaboration between stakeholders. This is important in ensuring that outcomes are useful to the researchers/stakeholders and the system being researched as it creates partnerships and commitments to the outcomes by stakeholder participants. The study reported on here examines whether the ‘Mainstreaming Sustainability’ model might be effective as a means to mainstream sustainability in pre-service teacher education. This model, developed in an earlier study, was piloted in the Queensland teacher education system in order to examine its effectiveness in creating organisational and systemic change. The pilot project in Queensland achieved a number of outcomes. The project: • provided useful insights into the effectiveness of the Mainstreaming Sustainability model in bringing about change while also building research capacity within the system • developed capacities within the teacher education community: o developing competencies in education for sustainability o establishing more effective interactions between decision-makers and other stakeholders o establishing a community of inquiry • changed teaching and learning approaches used in participating teacher education institutions through: o curriculum and resource development o the adoption of education for sustainability teaching and learning processes o the development of institutional policies • improved networks within the teacher education system through: o identifying key agents of change within the system o developing new, and building on existing, partnerships between schools, teacher education institutions and government agencies • engaged relevant stakeholders such as government agencies and non-government organisations to understand and support the change Our findings indicate that the Mainstreaming Sustainability model is able to facilitate organisational and systemic change – over time – if: • the individuals involved have the conceptual and personal capacities needed to facilitate change, that is, to be a key agent of change • stakeholders are engaged as participants in the process of change, not simply as ‘interested parties’ • there is a good understanding of systemic change and the opportunities for leveraging change within systems. In particular, in seeking to mainstream sustainability in pre-service teacher education in Queensland it has become clear that one needs to build capacity for change within participants such as knowledge of education for sustainability, conceptual skills in systemic thinking, action research and organisational change, and leadership skills. It is also of vital importance that key agents of change – those individuals who are ‘hubs’ within a system and can leverage for change across a wide range of the system – are identified and engaged with as early as possible. Key agents of change can only be correctly identified, however, if the project leaders and known participants have clearly identified the boundary to their system as this enables the system, sub-system and environment of the system to be understood. Through mapping the system a range of key organisations and stakeholders will be identified, including government and nongovernment organisations, teacher education students, teacher education academics, and so on. On this basis, key agents of change within the system and sub-system can be identified and invited to assist in working for change. A final insight is that it is important to have time – and if necessary the funding to ‘buy time’ – in seeking to bring about system-wide change. Seeking to bring about system-wide change is an ambitious project, one that requires a great deal of effort and time. These insights provide some considerations for those seeking to utilise the Mainstreaming Sustainability model to bring about change within and across a pre-service teacher education system.

Wellness as higher education curriculum: A comprehensive framework for health education and promotion

A number of studies in relation to the place, impact and purpose of Wellness curricula provide insight into the perceived benefits of Wellness education in university environments. Of particular note is the recommendation by many authors that curriculum design fosters personal experiences, reflective practice and active self-managed learning approaches in order to legitimise (give permission for) the adoption of wellness as a personal lifestyle approach in the frenetic pace of student life. From a broader educational perspective, Wellness education provides opportunities for students to engage in learning self regulation skills both within and beyond the context of the Wellness construct.To realise the suggested potential of Wellness education in higher learning, it is necessary that curricula overlay the principles from the domains of both self-regulation and Wellness, to highlight authentic learning as a means to lifelong approaches. Currently, however, systematic development and empirical examination of the Wellness construct have received limited academic investigation. Despite having a multitude of intended purposes from the educative to the therapy oriented goals of the original authors, most wellness models appear to be limited to the “what” of Wellness. Investigations of the “how” and “why” aspects of Wellness may serve to enhance currently existing models by incorporating behaviour modification and learning approaches in order to create more comprehensive frameworks for health education and promotion.It is also important to note that none of the current Wellness models actually address the educative framework necessary for an individual to learn and thus become aware or understand and make choices about their own Wellness.The literature reviewed within this paper would suggest that learner success is optimised by giving learners authentic opportunities to develop and practice self regulation strategies. Such opportunities include learning experiences that: provide options for self determined outcomes; require skills development; recognise principles of successful learning as outlined by the APA; and are scaffolded according to learner needs rather than in generic ways. Thus, configuring a learner centred curriculum in Wellness Education would potentially benefit from overlaying principles from the domains of both SRL and Wellness to highlight authentic learning as a means to lifelong approaches, triggered by undergraduate experiences.Student perceptions are a rich and significant data base for the measurement of their experiences, activities, practices and behaviours. Wellness undergraduate education, such as the “Fitness, Health and Wellness” unit offered by Queensland University of Technology, offers a context in which to confirm possibilities suggested by the literature reviewed in this paper in a practical, Australian context.