Fast Learning by Bounding Likelihoods in Sigmoid Type Belief Networks

Sigmoid type belief networks, a class of probabilistic neural networks, provide a natural framework for compactly representing probabilistic information in a variety of unsupervised and supervised learning problems. Often the parameters used in these networks need to be learned from examples. Unfortunately, estimating the parameters via exact probabilistic calculations (i.e, the EM-algorithm) is intractable even for networks with fairly small numbers of hidden units. We propose to avoid the infeasibility of the E step by bounding likelihoods instead of computing them exactly. We introduce extended and complementary representations for these networks and show that the estimation of the network parameters can be made fast (reduced to quadratic optimization) by performing the estimation in either of the alternative domains. The complementary networks can be used for continuous density estimation as well.

The Unsupervised Acquisition of a Lexicon from Continuous Speech

We present an unsupervised learning algorithm that acquires a natural-language lexicon from raw speech. The algorithm is based on the optimal encoding of symbol sequences in an MDL framework, and uses a hierarchical representation of language that overcomes many of the problems that have stymied previous grammar-induction procedures. The forward mapping from symbol sequences to the speech stream is modeled using features based on articulatory gestures. We present results on the acquisition of lexicons and language models from raw speech, text, and phonetic transcripts, and demonstrate that our algorithm compares very favorably to other reported results with respect to segmentation performance and statistical efficiency.

Attention, memory and verbal learning and their relation to schizotypal traits in unaffected parents of schizophrenic patients

The main objective of this ex post facto study is to compare the differences in cognitive functions and their relation to schizotypal personality traits between a group of unaffected parents of schizophrenic patients and a control group. A total of 52 unaffected biological parents of schizophrenic patients and 52 unaffected parents of unaffected subjects were assessed in measures of attention (Continuous Performance Test- Identical Pairs Version, CPT-IP), memory and verbal learning (California Verbal Learning Test, CVLT) as well as schizotypal personality traits (Oxford-Liverpool Inventory of Feelings and Experiences, O-LIFE). The parents of the patients with schizophrenia differ from the parents of the control group in omission errors on the Continuous Performance Test- Identical Pairs, on a measure of recall and on two contrast measures of the California Verbal Learning Test. The associations between neuropsychological variables and schizotpyal traits are of a low magnitude. There is no defined pattern of the relationship between cognitive measures and schizotypal traits

Hybrid coordination of reinforcement learning-based behaviors for AUV control

This paper proposes a hybrid coordination method for behavior-based control architectures. The hybrid method takes advantages of the robustness and modularity in competitive approaches as well as optimized trajectories in cooperative ones. This paper shows the feasibility of applying this hybrid method with a 3D-navigation to an autonomous underwater vehicle (AUV). The behaviors are learnt online by means of reinforcement learning. A continuous Q-learning implemented with a feed-forward neural network is employed. Realistic simulations were carried out. The results obtained show the good performance of the hybrid method on behavior coordination as well as the convergence of the behaviors

Efficient learning of reactive robot behaviors with a Neural-Q_learning approach

The purpose of this paper is to propose a Neural-Q_learning approach designed for online learning of simple and reactive robot behaviors. In this approach, the Q_function is generalized by a multi-layer neural network allowing the use of continuous states and actions. The algorithm uses a database of the most recent learning samples to accelerate and guarantee the convergence. Each Neural-Q_learning function represents an independent, reactive and adaptive behavior which maps sensorial states to robot control actions. A group of these behaviors constitutes a reactive control scheme designed to fulfill simple missions. The paper centers on the description of the Neural-Q_learning based behaviors showing their performance with an underwater robot in a target following task. Real experiments demonstrate the convergence and stability of the learning system, pointing out its suitability for online robot learning. Advantages and limitations are discussed

Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

A behavior-based scheme using reinforcement learning for autonomous underwater vehicles

This paper presents a hybrid behavior-based scheme using reinforcement learning for high-level control of autonomous underwater vehicles (AUVs). Two main features of the presented approach are hybrid behavior coordination and semi on-line neural-Q_learning (SONQL). Hybrid behavior coordination takes advantages of robustness and modularity in the competitive approach as well as efficient trajectories in the cooperative approach. SONQL, a new continuous approach of the Q_learning algorithm with a multilayer neural network is used to learn behavior state/action mapping online. Experimental results show the feasibility of the presented approach for AUVs

Autonomous underwater vehicle control using reinforcement learning policy search methods

Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task

The Recognition as a Quality Methodology Proposal in the Learning Process

In the education field, the question for the holistic formation is continuous and controversial. Moreover, with the obvious changes in the global knowledge production, apprehension and transmission, is crucial asking for the role of the education in the changes of the individual toward autonomy and take decisions in relationship with the educational process and the responsibility like a person sharing with knowledge like an issue of social development. In this context, this paper, presents results of an investigation made on 1995, about the recognition value like a methodology proposal of learning quality, for consider their propositions to be in force into an educational structure.

A teaching/learning support tool for introductory programming courses

In This work we present a Web-based tool developed with the aim of reinforcing teaching and learning of introductory programming courses. This tool provides support for teaching and learning. From the teacher's perspective the system introduces important gains with respect to the classical teaching methodology. It reinforces lecture and laboratory sessions, makes it possible to give personalized attention to the student, assesses the degree of participation of the students and most importantly, performs a continuous assessment of the student's progress. From the student's perspective it provides a learning framework, consisting in a help environment and a correction environment, which facilitates their personal work. With this tool students are more motivated to do programming

The School of Museology Celje: regular, continuous, topical, quality form of education

At the School of Museology, a project with ten years of tradition, we carry out module-based programmes to educate and qualify different target audiences working in the filed of cultural heritage. Our development and realization of educational programmes and training courses directed at practical applicability, including life-long learning of adults, topic complementarity with related professional and scientific fields, connection with universities offering undergraduate and postgraduate studies of heritages, promotion of theoretical museological discourses raising awareness of the meaning of cultural heritage, firm placement in an international network of related institutions and promotion of international relations with special emphasis on neighbouring countries. We encourage project partnership and cooperate with different domestic and foreign associates in forming and carrying out programmes.

Learning across business sectors: Knowledge sharing between aerospace and construction

This report addresses the extent that managerial practices can be shared between the aerospace and construction sectors. Current recipes for learning from other industries tend to be oversimplistic and often fail to recognise the embedded and contextual nature of managerial knowledge. Knowledge sharing between business sectors is best understood as an essential source of innovation. The process of comparison challenges assumptions and better equips managers to cope with future change. Comparisons between the aerospace and construction sectors are especially useful because they are so different. The two sectors differ hugely in terms of their institutional context, structure and technological intensity. The aerospace sector has experienced extensive consolidation and is dominated by a small number of global companies. Aerospace companies operate within complex networks of global interdependency such that collaborative working is a commercial imperative. In contrast, the construction sector remains highly fragmented and is characterised by a continued reliance on small firms. The vast majority of construction firms compete within localised markets that are too often characterised by opportunistic behaviour. Comparing construction to aerospace highlights the unique characteristics of both sectors and helps explain how managerial practices are mediated by context. Detailed comparisons between the two sectors are made in a range of areas and guidance is provided for the implementation of knowledge sharing strategies within and across organisations. The commonly accepted notion of ‘best practice’ is exposed as a myth. Indeed, universal models of best practice can be detrimental to performance by deflecting from the need to adapt continuously to changing circumstances. Competitiveness in the construction sector too often rests on efficiency in managing contracts, with a particular emphasis on the allocation of risk. Innovation in construction tends to be problem-driven and is rarely shared from project to project. In aerospace, the dominant model of competitiveness means that firms have little choice other than to invest in continuous innovation, despite difficult trading conditions. Research and development (R&D) expenditure in aerospace continues to rise as a percentage of turnovers. A sustained capacity for innovation within the aerospace sector depends crucially upon stability and continuity of work. In the construction sector, the emergence of the ‘hollowed-out’ firm has undermined the industry’s capacity for innovation. Integrated procurement contexts such as prime contracting in construction potentially provide a more supportive climate for an innovation-based model of competitiveness. However, investment in new ways of working depends upon a shift in thinking not only amongst construction contractors, but also amongst the industry’s major clients.

Learning across business sectors: facets of innovation in aerospace and construction

Innovation is notoriously difficult to define and is invariably intertwined with issues of knowledge creation, continuous improvement and organisational change. An extensive literature classifies numerous types of innovation and militates against any simplistic attempt at definition. It is widely accepted that innovation is at least partly dependent upon the surrounding environment. Industry recipes and institutionally embedded practices shape the environment within which innovation occurs. Recent research directions have addressed the diffusion of innovation and its dependence upon social and institutional structures. In this respect, it is highly pertinent to compare the way that innovation is interpreted and enacted in different industrial sectors. The comparison between UK aerospace and construction is especially revealing because the two sectors are so different and therefore constitute radically different climates for innovation. Empirical research is reported based on semi-structured interviews with practitioners from both sectors. Interpretations of innovation are found to differ dramatically between aerospace and construction. Within the context of an ongoing struggle to define innovation, both industries are striving to become more innovative. The aerospace sector is found to emphasise technical innovation whereas the construction sector emphasises process innovation. An overriding cultural bias in Western economies towards technological innovation results in the common perception that aerospace is much more innovative than construction. The experienced realities of practitioners in the two sectors are much more complex.

eRules: a modular adaptive classification rule learning algorithm for data streams

Advances in hardware and software in the past decade allow to capture, record and process fast data streams at a large scale. The research area of data stream mining has emerged as a consequence from these advances in order to cope with the real time analysis of potentially large and changing data streams. Examples of data streams include Google searches, credit card transactions, telemetric data and data of continuous chemical production processes. In some cases the data can be processed in batches by traditional data mining approaches. However, in some applications it is required to analyse the data in real time as soon as it is being captured. Such cases are for example if the data stream is infinite, fast changing, or simply too large in size to be stored. One of the most important data mining techniques on data streams is classification. This involves training the classifier on the data stream in real time and adapting it to concept drifts. Most data stream classifiers are based on decision trees. However, it is well known in the data mining community that there is no single optimal algorithm. An algorithm may work well on one or several datasets but badly on others. This paper introduces eRules, a new rule based adaptive classifier for data streams, based on an evolving set of Rules. eRules induces a set of rules that is constantly evaluated and adapted to changes in the data stream by adding new and removing old rules. It is different from the more popular decision tree based classifiers as it tends to leave data instances rather unclassified than forcing a classification that could be wrong. The ongoing development of eRules aims to improve its accuracy further through dynamic parameter setting which will also address the problem of changing feature domain values.

'Rules of engagement’: how experiential learning facilitates the formation of a public–private partnership in Russia

Purpose – The purpose of this paper is to investigate to what extent one can apply experiential learning theory (ELT) to the public-private partnership (PPP) setting in Russia and to draw insights regarding the learning cycle ' s nature. Additionally, the paper assesses whether the PPP case confirms Kolb ' s ELT. Design/methodology/approach – The case study draws upon primary data which the authors collected by interviewing informants including a PPP operator ' s managers, lawyers from Russian law firms and an expert from the National PPP Centre. The authors accomplished data source triangulation in order to ensure a high degree of research validity. Findings – Experiential learning has resulted in a successful and a relatively fast PPP project launch without the concessionary framework. The lessons learned include the need for effective stakeholder engagement; avoiding being stuck in bureaucracy such as collaboration with Federal Ministries and anti-trust agency; avoiding application for government funding as the approval process is tangled and lengthy; attracting strategic private investors; shaping positive public perception of a PPP project; and making continuous efforts in order to effectively mitigate the public acceptance risk. Originality/value – The paper contributes to ELT by incorporating the impact of social environment in the learning model. Additionally, the paper tests the applicability of ELT to learning in the complex organisational setting, i.e., a PPP.