Learning with noise and regularizers in multilayer neural networks

We study the effect of two types of noise, data noise and model noise, in an on-line gradient-descent learning scenario for general two-layer student network with an arbitrary number of hidden units. Training examples are randomly drawn input vectors labeled by a two-layer teacher network with an arbitrary number of hidden units. Data is then corrupted by Gaussian noise affecting either the output or the model itself. We examine the effect of both types of noise on the evolution of order parameters and the generalization error in various phases of the learning process.

Learning with regularizers in multilayer neural networks

We study the effect of regularization in an on-line gradient-descent learning scenario for a general two-layer student network with an arbitrary number of hidden units. Training examples are randomly drawn input vectors labelled by a two-layer teacher network with an arbitrary number of hidden units which may be corrupted by Gaussian output noise. We examine the effect of weight decay regularization on the dynamical evolution of the order parameters and generalization error in various phases of the learning process, in both noiseless and noisy scenarios.

On-line learning with adaptive back-propagation in two-layer networks

An adaptive back-propagation algorithm parameterized by an inverse temperature 1/T is studied and compared with gradient descent (standard back-propagation) for on-line learning in two-layer neural networks with an arbitrary number of hidden units. Within a statistical mechanics framework, we analyse these learning algorithms in both the symmetric and the convergence phase for finite learning rates in the case of uncorrelated teachers of similar but arbitrary length T. These analyses show that adaptive back-propagation results generally in faster training by breaking the symmetry between hidden units more efficiently and by providing faster convergence to optimal generalization than gradient descent.

Dynamics of learning with restricted training sets

The dynamics of supervised learning in layered neural networks were studied in the regime where the size of the training set is proportional to the number of inputs. The evolution of macroscopic observables, including the two relevant performance measures can be predicted by using the dynamical replica theory. Three approximation schemes aimed at eliminating the need to solve a functional saddle-point equation at each time step have been derived.

Visual data mining: integrating machine learning with information visualization

Today, the data available to tackle many scientific challenges is vast in quantity and diverse in nature. The exploration of heterogeneous information spaces requires suitable mining algorithms as well as effective visual interfaces. Most existing systems concentrate either on mining algorithms or on visualization techniques. Though visual methods developed in information visualization have been helpful, for improved understanding of a complex large high-dimensional dataset, there is a need for an effective projection of such a dataset onto a lower-dimension (2D or 3D) manifold. This paper introduces a flexible visual data mining framework which combines advanced projection algorithms developed in the machine learning domain and visual techniques developed in the information visualization domain. The framework follows Shneiderman’s mantra to provide an effective user interface. The advantage of such an interface is that the user is directly involved in the data mining process. We integrate principled projection methods, such as Generative Topographic Mapping (GTM) and Hierarchical GTM (HGTM), with powerful visual techniques, such as magnification factors, directional curvatures, parallel coordinates, billboarding, and user interaction facilities, to provide an integrated visual data mining framework. Results on a real life high-dimensional dataset from the chemoinformatics domain are also reported and discussed. Projection results of GTM are analytically compared with the projection results from other traditional projection methods, and it is also shown that the HGTM algorithm provides additional value for large datasets. The computational complexity of these algorithms is discussed to demonstrate their suitability for the visual data mining framework.

Learning with other health professions in the United Kingdom MPharm degree:Multidisciplinary and placement education

This paper reviews the approach to multidisciplinary and placement education in UK schools of pharmacy. The methodology involved triangulation of course documentation, staff interviews and a final year student survey. Staff members were supportive of multidisciplinary learning. The advantages were development of a wider appreciation of the students? future professional role and better understanding of the roles of other professional groups. The barriers were logistics (student numbers; multiple sites; different timetables), the achievement of balanced numbers between disciplines and engagement of students from all participating disciplines. Placement education was offered by all schools, predominantly in hospital settings. Key problems were funding and the lack of staff resources. Currently, multidisciplinary learning within the UK for pharmacy students is inadequate and is coupled with relatively low levels of placement education. In order for things to change, there should be a review of funding and support from government and the private sector employers.

Protein-protein interactions classification from text via local learning with class priors

Text classification is essential for narrowing down the number of documents relevant to a particular topic for further pursual, especially when searching through large biomedical databases. Protein-protein interactions are an example of such a topic with databases being devoted specifically to them. This paper proposed a semi-supervised learning algorithm via local learning with class priors (LL-CP) for biomedical text classification where unlabeled data points are classified in a vector space based on their proximity to labeled nodes. The algorithm has been evaluated on a corpus of biomedical documents to identify abstracts containing information about protein-protein interactions with promising results. Experimental results show that LL-CP outperforms the traditional semisupervised learning algorithms such as SVMand it also performs better than local learning without incorporating class priors.

Learning with a strategic management simulation game:a case study

The use of simulation games as a pedagogic method is well established though its effective use is context-driven. This study adds to the increasing growing body of empirical evidence of the effectiveness of simulation games but more importantly emphasises why by explaining the instructional design implemented reflecting best practices. This multi-method study finds evidence that student learning was enhanced through the use of simulation games, reflected in the two key themes; simulation games as a catalyst for learning and simulation games as a vehicle for learning. In so doing the research provides one of the few empirically based studies that support simulation games in enhancing learning and, more importantly, contextualizes the enhancement in terms of the instructional design of the curriculum. This research should prove valuable for those with an academic interest in the use of simulation games and management educators who use, or are considering its use. Further, the findings contribute to the academic debate concerning the effective implementation of simulation game-based training in business and management education.

Lifelong learning and environmental sustainability

The current policy focus on lifelong learning ensures a gendered and class-based skills-driven agenda, with lifelong learners expected to become neo-liberal subjects rather than empowered members of communities. What complexities and challenges arise from attempts to align lifelong learning with social justice? What are the costs of a focus on learning which rests on economic imperatives? Lifelong learning is at the forefront of the educational arena, both nationally and internationally, although what it means is highly contestable. In recent times, lifelong learning has increasingly come to mean vocational education and training within a globalised knowledge economy.

Municipal benchmarking:organisational learning and network performance in the public sector

The main purpose of this dissertation is to assess the relation between municipal benchmarking and organisational learning with a specific emphasis on benchlearning and performance within municipalities and between groups of municipalities in the building and housing sector in the Netherlands. The first and main conclusion is that this relation exists, but that the relative success of different approaches to dimensions of change and organisational learning are a key explanatory factor for differences in the success of benchlearning. Seven other important conclusions could be derived from the empirical research. First, a combination of interpretative approaches at the group level with a mixture of hierarchical and network strategies, positively influences benchlearning. Second, interaction among professionals at the inter-organisational level strengthens benchlearning. Third, stimulating supporting factors can be seen as a more important strategy to strengthen benchlearning than pulling down barriers. Fourth, in order to facilitate benchlearning, intrinsic motivation and communication skills matter, and are supported by a high level of cooperation (i.e., team work), a flat organisational structure and interactions between individuals. Fifth, benchlearning is facilitated by a strategy that is based on a balanced use of episodic (emergent) and systemic (deliberate) forms of power. Sixth, high levels of benchlearning will be facilitated by an analyser or prospector strategic stance. Prospectors and analysers reach a different learning outcome than defenders and reactors. Whereas analysers and prospectors are willing to change policies when it is perceived as necessary, the strategic stances of defenders and reactors result in narrow process improvements (i.e., single-loop learning). Seventh, performance improvement is influenced by functional perceptions towards performance, and these perceptions ultimately influence the elements adopted. This research shows that efforts aimed at benchlearning and ultimately improved service delivery, should be directed to a multi-level and multi-dimensional approach addressing the context, content and process of dimensions of change and organisational learning.

Practice based learning approaches in collaborative design and engineering education:a case study investigation into the benefits of a crossdisciplinary practice based learning strategy

This study explores the ongoing pedagogical development of a number of undergraduate design and engineering programmes in the United Kingdom. Observations and data have been collected over several cohorts to bring a valuable perspective to the approaches piloted across two similar university departments while trialling a number of innovative learning strategies. In addition to the concurrent institutional studies the work explores curriculum design that applies the principles of Co-Design, multidisciplinary and trans disciplinary learning, with both engineering and product design students working alongside each other through a practical problem solving learning approach known as the CDIO learning initiative (Conceive, Design Implement and Operate) [1]. The study builds on previous work presented at the 2010 EPDE conference: The Effect of Personality on the Design Team: Lessons from Industry for Design Education [2]. The subsequent work presented in this paper applies the findings to mixed design and engineering team based learning, building on the insight gained through a number of industrial process case studies carried out in current design practice. Developments in delivery also aligning the CDIO principles of learning through doing into a practice based, collaborative learning experience and include elements of the TRIZ creative problem solving technique [3]. The paper will outline case studies involving a number of mixed engineering and design student projects that highlight the CDIO principles, combined with an external industrial design brief. It will compare and contrast the learning experience with that of a KTP derived student project, to examine an industry based model for student projects. In addition key areas of best practice will be presented, and student work from each mode will be discussed at the conference.

Challenges for expatriate managers:an exploration of cross-cultural management, adjustment, and training issues faced by Anglo-American managers in Hong Kong

This field work study furthers understanding about expatriate management, in particular, the nature of cross-cultural management in Hong Kong involving Anglo-American expatriate and Chinese host national managers, the important features of adjustment for expatriates living and working there, and the type of training which will assist them to adjust and to work successfully in this Asian environment. Qualitative and quantitative data on each issue was gathered during in-depth interviews in Hong Kong, using structured interview schedules, with 39 expatriate and 31 host national managers drawn from a cross-section of functional areas and organizations. Despite the adoption of Western technology and the influence of Western business practices, micro-level management in Hong Kong retains a cultural specificity which is consistent with the norms and values of Chinese culture. There are differences in how expatriates and host nationals define their social roles, and Hong Kong's recent colonial history appears to influence cross-cultural interpersonal interactions. The inability of the spouse and/or family to adapt to Hong Kong is identified as a major reason for expatriate assignments to fail, though the causes have less to do with living away from family and friends, than with Hong Kong's highly urbanized environment and the heavy demands of work. Culture shock is not identified as a major problem, but in Hong Kong micro-level social factors require greater adjustment than macro-level societal factors. The adjustment of expatriate managers is facilitated by a strong orientation towards career development and hard work, possession of technical/professional expertise, and a willingness to engage in a process of continuous 'active learning' with respect to the host national society and culture. A four-part model of manager training suitable for Hong Kong is derived from the study data. It consists of a pre-departure briefing, post-arrival cross-cultural training, language training in basic Cantonese and in how to communicate more effectively in English with non-native speakers, and the assignment of a mentor to newly arrived expatriate managers.

Specialist business skills of international students

This paper follows on from that presented at the last BEST conference in Edinburgh (Higson & Hamilton-Jones(2004)). At that stage, the authors outlined their initial research work with students studying on the yearlong International Foundation programmes. at three local FE Colleges allied to Aston University. The research (funded by the University's Teaching Quality Enhancement Funds (TQEF) involved questionnaires and interviews with staff and students (the latter all from overseas). it aimed to identify ways to improve the learning experience of students on the International Foundation programmes, to aid their smooth transition to full degree programmes in Business and Management and to improve the progression rates of such students while studying at Aston. The initial research findings were used to design a module for those students' progress to degree programmes in Aston Business School. This paper discusses how the module was designed, its content and the assessment methods used to help determine whether students are achieving the learning outcomes. The basic principle was to identify areas of study where the International Foundation Programme students needed help in order to improve their learning styles to assist them with the requirements of other modules that they would be studying during their time at Aston. Particular emphasis was put on the need to develop active learners who were not disadvantaged by their lack of awareness of UK culture and society and who were as comfortable performing written work under examination conditions or presenting orally as their UK counterparts. An additional aim was to prepare these students for the placement year which was a compulsory part of their degree. The module, therefore, comprises a range of inputs for a number of staff, a company visit, weekly reflective learning leading to Personal Development Plan (PDP) work, formal examinations, presentations, group work •and individual case studies. This paper also reports on the initial reaction of the students and tutors to the new learning experience with currently 30 participants undertaking the module. Provisional findings suggest that the International Foundation programme has prepared the students well for degree-level work and that as a group of international students they are much more analytical and, after studying the module interactive than their counterparts who have come directly onto Aston degrees. It has shown them still to be quite passive learners, comfortable with facts and lecture-style learning environments, but less comfortable when asked to use their own initiatives. Continuing progress needs to be made in terms of encouraging them to develop a reflective approach to learning with the students taking some time to feel comfortable with an analytical approach to learning. In addition, im account of the students' reactions to having to work through a formal (PDP) and the results of their first assessments will be provided. At Aston, this work is being used as a pilot to recognise good practice with regards to work with further groups of international students. it is hoped that this would have widespread application across the sector.

Educating the iPod generation:undergraduate attitudes, experiences and knowledge of vodcast and podcast use

There is an increasing pressure on university staff to provide ever more information and resources to students. This study investigated student opinions on (audio) podcasts and (video) vodcasts and how well they met requirements and aided learning processes. Two experiments within the Aston University looked at student opinion on, and usage of, podcasts and vodcasts for a selection of their psychology lectures. Recordings were produced first using a hand-held camcorder, and then using the in-house media department. WebCT was used to distribute the podcasts and vodcasts, attitude questionnaires were then circulated at two time points. Overall students indicated that podcasts and vodcasts were a beneficial addition resource for learning, particularly when used in conjunction with lecturers’ slides and as a tool for revision/assessment. The online material translated into students having increased understanding of the material, which supplemented and enhanced their learning without being a substitute for traditional lectures. There is scope for the provision of portable media files to become standard practice within higher education; integrating distance and online learning with traditional approaches to improve teaching and learning.

Sizing energy storage on the 11kV distribution network

The cost and limited flexibility of traditional approaches to 11kV network reinforcement threatens to constrain the uptake of low carbon technologies. Ofgem has released £500m of funding for DNOs to trial innovative techniques and share the learning with the rest of the industry. One of the techniques under study is the addition of Energy Storage at key substations to the network to help with peak load lopping. This paper looks in detail at the sizing algorithm for use in the assessment of alternatives to traditional reinforcement and investigates a method of sizing a battery for use on a Network taking into account load growth, capacity fade and battery lifecycle issues. A further complication to the analysis is the method of operation of the battery system and how this affects the Depth of Discharge (DoD). The proposed method is being trialled on an area of 11kV network in Milton Keynes Central area and the simulation results are presented in this paper.