The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network

Sample complexity results from computational learning theory, when applied to neural network learning for pattern classification problems, suggest that for good generalization performance the number of training examples should grow at least linearly with the number of adjustable parameters in the network. Results in this paper show that if a large neural network is used for a pattern classification problem and the learning algorithm finds a network with small weights that has small squared error on the training patterns, then the generalization performance depends on the size of the weights rather than the number of weights. For example, consider a two-layer feedforward network of sigmoid units, in which the sum of the magnitudes of the weights associated with each unit is bounded by A and the input dimension is n. We show that the misclassification probability is no more than a certain error estimate (that is related to squared error on the training set) plus A3 √((log n)/m) (ignoring log A and log m factors), where m is the number of training patterns. This may explain the generalization performance of neural networks, particularly when the number of training examples is considerably smaller than the number of weights. It also supports heuristics (such as weight decay and early stopping) that attempt to keep the weights small during training. The proof techniques appear to be useful for the analysis of other pattern classifiers: when the input domain is a totally bounded metric space, we use the same approach to give upper bounds on misclassification probability for classifiers with decision boundaries that are far from the training examples.

Artful inquiry : an arts-based facilitation approach for individual and organisational learning and development

The research undertaken in these two major doctoral studies investigates the field of artsbased learning, a pedagogical approach to individual and organisational learning and development, my professional creative facilitation practice and development as a researcher. While the studies are stand-alone projects they are intended to build on each other in order to tell the evolving story of my research and professional practice. The first study combines The Role of Arts-based Learning in a Creative Economy; The Need for Artistry in Professional Education the art of knowing what to do when you don’t know what to do and Lines of Inquiry: Making Sense of Research and Professional Practice. The Role of Arts-based Learning in a Creative Economy provides an overview of the field of arts-based learning in business. The study focuses on the relevant literature and interviews with people working in the field. The paper argues that arts-based learning is a valuable addition to organisations for building a culture of creativity and innovation. The Need for Artistry in Professional Education continues that investigation. It explores the way artists approach their work and considers what skills and capabilities from artistic practice can be applied to other professions’ practices. From this research the Sphere of Professional Artistry model is developed and depicts the process of moving toward professional artistry. Lines of Inquiry: making sense of research and professional practice through artful inquiry is a self-reflective study. It explores my method of inquiry as a researcher and as a creative facilitation practitioner using arts-based learning processes to facilitate groups of people for learning, development and change. It discusses how my research and professional practice influence and inspire the other and draws on cased studies. The second major research study Artful Inquiry: Arts-based Learning for Inquiry, Reflection and Action in Professional Practice is a one year practice-led inquiry. It continues the research into arts-based and aesthetic learning experiences and my arts-based facilitation practice. The research is conducted with members of a Women’s Network in a large government service agency. It develops the concept of ‘Artful Inquiry’’ a creative, holistic, and embodied approach for facilitation, inquiry, learning, reflection, and action. Storytelling as Inquiry is used as a methodology for understanding participants’ experiences of being involved in arts-based learning experiences. The study reveals the complex and emergent nature of practice and research. It demonstrates what it can mean to do practice-led research with others, within an organisational context, and to what effect.

Optimum demand side response of smart grid with renewable energy source and electrical vehicles

The paper presents a demand side response scheme,which assists electricity consumers to proactively control own demands in such a way to deliberately avert congestion periods on the electrical network. The scheme allows shifting loads from peak to low demand periods in an attempt to flattening the national electricity requirement. The scheme can be concurrently used to accommodate the utilization of renewable energy sources,that might be available at user’s premises. In addition the scheme allows a full-capacity utilization of the available electrical infrastructure by organizing a wide-use of electric vehicles. The scheme is applicable in the Eastern and Southern States of Australia managed by the Australian Energy Market Operator. The results indicate the potential of the scheme to achieve energy savings and release capacity to accommodate renewable energy and electrical vehicle technologies.

Learning and teaching from the edge to centre stage : Critical factors in embedding sustainable university-wide engagement in external awards and grants funding initiatives.

Teaching awards, grants and fellowships are strategies used to recognise outstanding contributions to learning and teaching, encourage innovation, and to shift learning and teaching from the edge to centre stage. Examples range from school, faculty and institutional award and grant schemes to national schemes such as those offered by the Australian Learning and Teaching Council (ALTC), the Carnegie Foundation for the Advancement of Teaching in the United States, and the Fund for the Development of Teaching and Learning in higher education in the United Kingdom. The Queensland University of Technology (QUT) has experienced outstanding success in all areas of the ALTC funding since the inception of the Carrick Institute for Learning and Teaching in 2004. This paper reports on a study of the critical factors that have enabled sustainable and resilient institutional engagement with ALTC programs. As a lens for examining the QUT environment and practices, the study draws upon the five conditions of the framework for effective dissemination of innovation developed by Southwell, Gannaway, Orrell, Chalmers and Abraham (2005, 2010): 1. Effective, multi-level leadership and management 2. Climate of readiness for change 3. Availability of resources 4. Comprehensive systems in institutions and funding bodies 5. Funding design The discussion on the critical factors and practical and strategic lessons learnt for successful university-wide engagement offer insights for university leaders and staff who are responsible for learning and teaching award, grant and associated internal and external funding schemes.

Decision support to green technology implementation on Australian university campuses

As the societal awareness on sustainability is gaining momentum worldwide, the higher education sector is expected to take the lead in education, research and the promotion of sustainable development. Universities have the diversity of skills and knowledge to explore new concepts and issues, the academic freedom to offer unbiased observations, and the capacity to engage in experimentation for solutions. There is a global trend that universities have realized and responded to sustainability challenge. By adopting green technologies, buildings on university campuses have the potential to offer highly productive and green environments for a quality learning experience for students, while minimising environmental impacts. Despite the potential benefits and metaphorical link to sustainability, few universities have moved towards implementing Green Roof and Living Wall on campuses widely, which have had more successful applications in commercial and residential buildings. Few past research efforts have examined the fundamental barriers to the implementation of sustainable projects on campuses from organizational level. To address this deficiency, an on-going research project is undertaken by Queensland University of Technology in Australia. The research is aimed at developing a comprehensive framework to facilitate better decision making for the promotion of Green Roof and Living Wall application on campuses. It will explore and highlight organizational factors as well as investigate and emphasize project delivery issues. Also, the critical technical indicators for Green Roof and Living Wall implementation will be identified. The expected outcome of this research has the potential to enhance Green Roof and Living Wall delivery in Australian universities, as a vital step towards realizing sustainability in higher education sectors.

Overcoming the complexity of diagnostic problems due to sensor network architecture

In fault detection and diagnostics, limitations coming from the sensor network architecture are one of the main challenges in evaluating a system’s health status. Usually the design of the sensor network architecture is not solely based on diagnostic purposes, other factors like controls, financial constraints, and practical limitations are also involved. As a result, it quite common to have one sensor (or one set of sensors) monitoring the behaviour of two or more components. This can significantly extend the complexity of diagnostic problems. In this paper a systematic approach is presented to deal with such complexities. It is shown how the problem can be formulated as a Bayesian network based diagnostic mechanism with latent variables. The developed approach is also applied to the problem of fault diagnosis in HVAC systems, an application area with considerable modeling and measurement constraints.

Are low CO2 emitters in rural areas also socially excluded? An empirical investigation of travel diary data from rural Northern Ireland

The reduction of CO2 emissions and social exclusion are two key elements of UK transport strategy. Despite intensive research on each theme, little effort has so far been made linking the relationship between emissions and social exclusion. In addition, current knowledge on each theme is limited to urban areas; little research is available on these themes for rural areas. This research contributes to this gap in the literature by analysing 157 weekly activity-travel diary data collected from three case study areas with differential levels of area accessibility and area mobility options, located in rural Northern Ireland. Individual weekly CO2 emission levels from personal travel diaries (both hot exhaust emission and cold-start emission) were calculated using average speed models for different modes of transport. The socio-spatial patterns associated with CO2 emissions were identified using a general linear model whereas binary logistic regression analyses were conducted to identify mode choice behaviour and activity patterns. This research found groups that emitted a significantly lower level of CO2 included individuals living in an area with a higher level of accessibility and mobility, non-car, non-working, and low-income older people. However, evidence in this research also shows that although certain groups (e.g. those working, and residing in an area with a lower level of accessibility) emitted higher levels of CO2, their rate of participation in activities was however found to be significantly lower compared to their counterparts. Based on the study findings, this research highlights the need for both soft (e.g. teleworking) and physical (e.g. accessibility planning) policy measures in rural areas in order to meet government’s stated CO2 reduction targets while at the same time enhancing social inclusion.

Group maintenance scheduling : a case study for a pipeline network

This paper presents a group maintenance scheduling case study for a water distributed network. This water pipeline network presents the challenge of maintaining aging pipelines with the associated increases in annual maintenance costs. The case study focuses on developing an effective maintenance plan for the water utility. Current replacement planning is difficult as it needs to balance the replacement needs under limited budgets. A Maintenance Grouping Optimization (MGO) model based on a modified genetic algorithm was utilized to develop an optimum group maintenance schedule over a 20-year cycle. The adjacent geographical distribution of pipelines was used as a grouping criterion to control the searching space of the MGO model through a Judgment Matrix. Based on the optimum group maintenance schedule, the total cost was effectively reduced compared with the schedules without grouping maintenance jobs. This optimum result can be used as a guidance to optimize the current maintenance plan for the water utility.

Co-constructing self-efficacy narratives : a study of four mature age university students

This thesis reports on a study in which research participants, four mature aged females starting an undergraduate degree at a regional Australian university, collaborated with the researcher in co-constructing a self-efficacy narrative. For the purpose of the study, self-efficacy was conceptualized as a means by which an individual initiates action to engage in a task or set of tasks, applies effort to perform the task or set of tasks, and persists in the face of obstacles encountered in order to achieve successful completion of the task or set of tasks. Qualitative interviews were conducted with the participants, initially investigating their respective life histories for an understanding of how they made the decision to embark on their respective academic program. Additional data were generated from a written exercise, prompting participants to furnish specific examples of self-efficacy. These data were incorporated into the individual's self-efficacy narrative, produced as the outcome of the "narrative analysis". Another aspect of the study entailed "analysis of narrative" in which analytic procedures were used to identify themes common to the self-efficacy narratives. Five main themes were identified: (a) participants' experience of schooling . for several participants their formative experience of school was not always positive, and yet their narratives demonstrated their agency in persevering and taking on university-level studies as mature aged persons; (b) recognition of family as an early influence . these influences were described as being both positive, in the sense of being supportive and encouraging, as well as posing obstacles that participants had to overcome in order to pursue their goals; (c) availability of supportive persons – the support of particular persons was acknowledged as a factor that enabled participants to persist in their respective endeavours; (d) luck or chance factors were recognised as placing participants at the right place at the right time, from which circumstances they applied considerable effort in order to convert the opportunity into a successful outcome; and (e) self-efficacy was identified as a major theme found in the narratives. The study included an evaluation of the research process by participants. A number of themes were identified in respect of the manner in which the research process was experienced as a helpful process. Participants commented that: (a) the research process was helpful in clarifying their respective career goals; (b) they appreciated opportunities provided by the research process to view their life from a different perspective and to better understand what motivated them, and what their preferred learning styles were; (c) their past successes in a range of different spheres were made more evident to them as they were guided in self-reflection, and their self-efficacious behaviour was affirmed; and (d) the opportunities provided by their participation in the research process to identify strengths of which they had not been consciously aware, to find confirmation of strengths they knew they possessed, and in some instances to rectify misconceptions they had held about aspects of their personality. The study made three important contributions to knowledge. Firstly, it provided a detailed explication of a qualitative narrative method in exploring self-efficacy, with the potential for application to other issues in educational, counselling and psychotherapy research. Secondly, it consolidated and illustrated social cognitive theory by proposing a dynamic model of self-efficacy, drawing on constructivist and interpretivist paradigms and extending extant theory and models. Finally, the study made a contribution to the debate concerning the nexus of qualitative research and counselling by providing guidelines for ethical practice in both endeavours for the practitioner-researcher.

Building info-skills by degrees : embedding information literacy in university study

Late last year teaching staff at Griffith University participated in a symposium entitled 'Spotlight on Generic Skills & Flexible Learning'. This event brought together academic staff as well as library staff, learning advisers and other support staff interested in teaching and learning issues. The discussion was based on the premise that the University has a responsibility to ensure that its courses emphasise broad educational values and 'produce highly sought after graduates with globally applicable skills for the international market'(1). It was acknowledged that the University consistently scores very highly with graduates for its development of generic skills. However at the same time staff expressed concern at the challenge of developing more flexible, student-centred learning environments that have generic skills embedded across all programs (2). As a result there has been much debate in the University about which skills are important, how they will be acquired and how they could effectively be built into the curriculum. One outcome of these discussions is the project described in this paper. What follows is an overview of the project and a discussion about the integration and development of information literacy as a generic attribute in the curriculum and some suggestions on ways forward.

Quality and efficacy of the Indigenous Tutorial Assistance Scheme (ITAS) for university students

Designed as a 'supplementary' tuition scheme, the Indigenous Tutorial Assistance Scheme (hereafter referred to as ITAS) is a strategic initiative of the National Indigenous Education Policy (DEET, 1989). This paper seeks to contribute to the literature of the analysis of the quality and efficacy of ITAS. Currently, the delivery of ITAS to Indigenous students requires enormous administration and commitment by the staff of Indigenous education support centres. In exploring the essential but problematic provision of ITAS to Indigenous university students, this paper provides insights into significant aspects of our program that move beyond assumptions of student deficit, by researching the quality of teaching and learning through ITAS, analysing administrative workload, and sharing innovations to our program as a result of participatory research with important ITAS stakeholders.