Hybrid coordination of reinforcement learning-based behaviors for AUV control

This paper proposes a hybrid coordination method for behavior-based control architectures. The hybrid method takes advantages of the robustness and modularity in competitive approaches as well as optimized trajectories in cooperative ones. This paper shows the feasibility of applying this hybrid method with a 3D-navigation to an autonomous underwater vehicle (AUV). The behaviors are learnt online by means of reinforcement learning. A continuous Q-learning implemented with a feed-forward neural network is employed. Realistic simulations were carried out. The results obtained show the good performance of the hybrid method on behavior coordination as well as the convergence of the behaviors

Policy gradient based Reinforcement Learning for real autonomous underwater cable tracking

This paper proposes a field application of a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot in cable tracking task. The learning system is characterized by using a direct policy search method for learning the internal state/action mapping. Policy only algorithms may suffer from long convergence times when dealing with real robotics. In order to speed up the process, the learning phase has been carried out in a simulated environment and, in a second step, the policy has been transferred and tested successfully on a real robot. Future steps plan to continue the learning process on-line while on the real robot while performing the mentioned task. We demonstrate its feasibility with real experiments on the underwater robot ICTINEU AUV

Designing context-aware adaptive units of learning based on IMS-LD standard

Learning contents adaptation has been a subject of interest in the research area of the adaptive hypermedia systems. Defining which variables and which standards can be considered to model adaptive content delivery processes is one of the main challenges in pedagogical design over e-learning environments. In this paper some specifications, architectures and technologies that can be used in contents adaptation processes considering characteristics of the context are described and a proposal to integrate some of these characteristics in the design of units of learning using adaptation conditions in a structure of IMS-Learning Design (IMS-LD) is presented. The key contribution of this work is the generation of instructional designs considering the context, which can be used in Learning Management Systems (LMSs) and diverse mobile devices

Recommender System Based on Consumer Product Reviews

Consumer reviews, opinions and shared experiences in the use of a product is a powerful source of information about consumer preferences that can be used in recommender systems. Despite the importance and value of such information, there is no comprehensive mechanism that formalizes the opinions selection and retrieval process and the utilization of retrieved opinions due to the difficulty of extracting information from text data. In this paper, a new recommender system that is built on consumer product reviews is proposed. A prioritizing mechanism is developed for the system. The proposed approach is illustrated using the case study of a recommender system for digital cameras

A Negotiation Style Recommender Based on Computational Ecology in Open Negotiation Environments

The system described herein represents the first example of a recommender system in digital ecosystems where agents negotiate services on behalf of small companies. The small companies compete not only with price or quality, but with a wider service-by-service composition by subcontracting with other companies. The final result of these offerings depends on negotiations at the scale of millions of small companies. This scale requires new platforms for supporting digital business ecosystems, as well as related services like open-id, trust management, monitors and recommenders. This is done in the Open Negotiation Environment (ONE), which is an open-source platform that allows agents, on behalf of small companies, to negotiate and use the ecosystem services, and enables the development of new agent technologies. The methods and tools of cyber engineering are necessary to build up Open Negotiation Environments that are stable, a basic condition for predictable business and reliable business environments. Aiming to build stable digital business ecosystems by means of improved collective intelligence, we introduce a model of negotiation style dynamics from the point of view of computational ecology. This model inspires an ecosystem monitor as well as a novel negotiation style recommender. The ecosystem monitor provides hints to the negotiation style recommender to achieve greater stability of an open negotiation environment in a digital business ecosystem. The greater stability provides the small companies with higher predictability, and therefore better business results. The negotiation style recommender is implemented with a simulated annealing algorithm at a constant temperature, and its impact is shown by applying it to a real case of an open negotiation environment populated by Italian companies

Curriculum sequencing for an e-learning system based on learning styles

This work shows the use of adaptation techniques involved in an e-learning system that considers students' learning styles and students' knowledge states. The mentioned e-learning system is built on a multiagent framework designed to examine opportunities to improve the teaching and to motivate the students to learn what they want in a user-friendly and assisted environment

Discovery-Based Learning - Daniel Rowan

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Problem-Based Learning Using CaseMaker - Richard Collier

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

An artificial economy based on reinforcement learning and agent based modeling

In this paper, we employ techniques from artificial intelligence such as reinforcement learning and agent based modeling as building blocks of a computational model for an economy based on conventions. First we model the interaction among firms in the private sector. These firms behave in an information environment based on conventions, meaning that a firm is likely to behave as its neighbors if it observes that their actions lead to a good pay off. On the other hand, we propose the use of reinforcement learning as a computational model for the role of the government in the economy, as the agent that determines the fiscal policy, and whose objective is to maximize the growth of the economy. We present the implementation of a simulator of the proposed model based on SWARM, that employs the SARSA(λ) algorithm combined with a multilayer perceptron as the function approximation for the action value function.

Ventajas del `Problem Based Learning?? como m??todo de aprendizaje del derecho internacional

Resumen tomado de la publicaci??n

Extensión de la especificación IMS Learning Design desde la adaptación e integración de unidades de aprendizaje. `Extension of the IMS Learnin Design specification based on adaptation and integration of units of learning´.

La tesis se centra en el aprendizaje personalizado y en la integración de Unidades de Aprendizaje. El objetivo fundamental es mejorar la expresividad pedagógica de IMS-LD, refinando estructuras de modelado y arquitectura existentes y desarrollando estructuras complementarias que permitan una formalización más precisa, versátil y sencilla de procesos de aprendizaje adaptativo y de mecanismos y procesos de integración con sistemas de aprendizaje y otras especificaciones. En esta tesis se estudia la especificación desde la base, analizando su modelo de información y cómo se construyen Unidades de Aprendizaje. Se analiza la estructura de la especificación, basándose en un estudio teórico y una investigación práctica fruto del modelado de Unidades de Aprendizaje reales y ejecutables que proporcionan una información útil de base. A partir de este estudio, se analiza la integración de Unidades de Aprendizaje con otros sistemas y especificaciones, abarcando desde la integración mínima mediante un enlace directo hasta compartir variables y estados que permiten una comunicación en tiempo real de ambas partes. La conclusión es que IMS-LD necesita una reestructuración y modificación de ciertos elementos, así como la incorporación de otros nuevos, para mejorar una expresividad pedagógica y una capacidad de integración con otros sistemas de aprendizaje y estándares eLearning, si se pretenden alcanzar: la personalización del proceso de aprendizaje y la interoperabilidad real. La implantación de la especificación se vería mejorada si existieran unas herramientas de más alto nivel, preferiblemente con planteamiento visual, que permitieran un modelado sencillo por parte de los usuarios finales reales de este tipo de especificaciones, como son los profesores, los creadores de contenido y los pedagogos-didactas que diseñan la experiencia de aprendizaje.

Dilemma-based learning in the humanities : integrating social, emotional and thinking skills.

Ayuda a entender las formas de aplicación de los dilemas en el marco del aprendizaje de las humanidades en secundaria. Esta técnica introduce instrumentos que ayudan a los estudiantes a practicar y desarrollar habilidades para la reflexión, la investigación y el pensamiento lógico y analítico, que les permiten tomar decisiones sabias en sus vidas. El trabajo con los dilemas, también mejora las aptitudes sociales de los alumnos y su aptitud para trabajar en grupo de manera eficaz; les facilita el desarrollo de otras capacidades como el pensamiento creativo y el razonamiento que pueden utilizar en otras asignaturas y, asimismo, colabora en su desarrollo profesional.

The thinking child resource book : brain-based learning for the early years foundation stage.

Ofrece a los profesores, estudiantes y padres, prácticas y sugerencias para la aplicación del aprendizaje, basado en cómo está configurado el cerebro del niño en sus primeros años de vida. Se enumeran ideas sobre cómo usar técnicas de aprendizaje que incluyen las formas de promover la autoestima y la inteligencia emocional, las ideas para la enseñanza a través del juego, música y movimiento, actividades para la hora de la asamblea, asesoramiento sobre el manejo de la conducta positiva y fomento de las relaciones con padres y cuidadores. Los estudios de casos, tomados de una variedad de entornos, dan una idea de cómo las técnicas basadas en el cerebro pueden ser utilizados para enriquecer la experiencia de aprendizaje de los niños pequeños.

Learning through play : a work-based approach for the early years professional.

Este manual trata sobre los niños que aprenden a través del juego y sobre el papel del adulto en este proceso. Tiene tres objetivos generales: ayudar a los profesionales a ser más hábiles e imaginativos cuando están involucrados en el aprendizaje lúdico; apoyar el desarrollo de contextos efectivos para el aprendizaje a través del juego; ayudar a los profesionales a tener confianza en su papel. Cada capítulo es una unidad independiente que se puede trabajar con la intención de desarrollar un aspecto particular de práctica, conocimiento o comprensión. El manual, en su conjunto, ofrece un programa para desarrollar el pensamiento y el entendimiento poniendo énfasis en la aplicación práctica y la conciencia de sí mismo.