Towards Direct Policy Search Reinforcement Learning for Robot Control

This paper proposes a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot. Although the dominant approach, when using RL, has been to apply value function based algorithms, the system here detailed is characterized by the use of direct policy search methods. Rather than approximating a value function, these methodologies approximate a policy using an independent function approximator with its own parameters, trying to maximize the future expected reward. The policy based algorithm presented in this paper is used for learning the internal state/action mapping of a behavior. In this preliminary work, we demonstrate its feasibility with simulated experiments using the underwater robot GARBI in a target reaching task

Adaptive intelligent agent approach to guide the web navigation on the PLAN-G distance learning platform

Hypermedia systems based on the Web for open distance education are becoming increasinglypopular as tools for user-driven access learning information. Adaptive hypermedia is a new direction in research within the area of user-adaptive systems, to increase its functionality by making it personalized [Eklu 961. This paper sketches a general agents architecture to include navigationaladaptability and user-friendly processes which would guide and accompany the student during hislher learning on the PLAN-G hypermedia system (New Generation Telematics Platform to Support Open and Distance Learning), with the aid of computer networks and specifically WWW technology [Marz 98-1] [Marz 98-2]. The PLAN-G actual prototype is successfully used with some informatics courses (the current version has no agents yet). The propased multi-agent system, contains two different types of adaptive autonomous software agents: Personal Digital Agents {Interface), to interacl directly with the student when necessary; and Information Agents (Intermediaries), to filtrate and discover information to learn and to adapt navigation space to a specific student

A teaching/learning support tool for introductory programming courses

In This work we present a Web-based tool developed with the aim of reinforcing teaching and learning of introductory programming courses. This tool provides support for teaching and learning. From the teacher's perspective the system introduces important gains with respect to the classical teaching methodology. It reinforces lecture and laboratory sessions, makes it possible to give personalized attention to the student, assesses the degree of participation of the students and most importantly, performs a continuous assessment of the student's progress. From the student's perspective it provides a learning framework, consisting in a help environment and a correction environment, which facilitates their personal work. With this tool students are more motivated to do programming

Innovation typology in tourism

Innovation is a research topic with a broad tradition. However, learning processes,from which innovations emerge, and the dynamics of change and development havetraditionally been studied in relation with the manufacturing sector. Moreover, theobjects of study have been usually process and tangible product innovations. Althoughrecently researchers have focused their attention in other sectors, more research onservice innovation should be carried out. Furthermore, regarding innovation intourism, there is a need to adapt generic theories to the tourism sector and tocontribute with new ideas.In order to find out, which are the origins of innovation processes, it is necessary tolook into two fundamental subjects that are inherent to innovation, which are learningand interaction. Both are closely related. The first appears to be an intrinsic conditionof individuals. Moreover, it can also be identified in organizations. Thus, learning allowsindividuals as well as organizations to develop. However, learning and development isnot possible without taking the environment into account. Hence, it is necessary thatinteractions take place between individuals, groups of individuals, organizations, etc.Furthermore, the concept of interaction implies the transfer of knowledge, which isthe basis for innovations.The purposes of this master thesis are to study in detail several of these topics and to develop a conceptual framework for the research on innovation in tourism

Disseny conceptual i anàlisi estructural d’una motxilla - cotxet per a transportar de nens en activitats de lleure muntanya

La idea de realitzar aquest projecte sorgeix d’una necessitat en el mercat de productes relacionats amb els nens i nenes petits, dins d’un rang d’edats entre 2 a 5 anys, per poder realitzar activitats de lleure a la muntanya. En ser un producte no existent s’ha hagut de fer el disseny conceptual de tot el producte buscant la solució final adient per a cada part considerada bàsica. Per assegurar-ne la fiabilitat i la seguretat del nen i del pare s’han fet els càlculs pertinents de les seccions més carregades i s’han descrit els processos de fabricació i muntatge de cada peça. La Motxilla – Carretó servirà per circular per pistes de muntanya i forestals. Tindrà dos usos, el primer per quan el nen estigui cansat de caminar i el terreny es poc accidentat,“funció carretó” i el segon ús, per quan el nen està cansat i el terreny és més accidentat, “funció cadireta”. El producte serà transformable en funció d’aquests dos usos principals

The interactional space in CLIL (Content and Language Integrated Learning) and EFL (English as a Foreign Language) classrooms

Aquest estudi pretén investigar els intercanvis verbals mestre/a – aprenent(s) en dos contextos d'instrucció diferents: classes amb un enfocament AICLE (Aprenentatge Integrat de Continguts Curriculars i Llengua Estrangera) on s’aprenen continguts no lingüístics a través de l’anglès, per una banda, i classes 'tradicionals' d'anglès com a llengua estrangera, on l’anglès és alhora objecte d’estudi i vehicle de comunicació, per una altra banda. Més concretament, les preguntes que formula el/la mestre/a, la producció oral dels aprenents i el 'feedback' del/de la mestre/a en els episodis d’atenció a la forma s’han estudiat a la llum de les principals teories provinents del camp de l’Adquisició de Segones Llengües (SLA) per tal de demostrar el seu paper en l’aprenentatge de l’anglès. El corpus de dades prové de l’enregistrament de 7 sessions AICLE i d'11 sessions EFL enregistrades en format àudio i vídeo en dos centres públics d’Educació Primària (EP) de Catalunya. A cadascuna de les escoles, el/la mateix/a mestre/a és l’encarregat/da dels dos tipus d’instrucció amb el mateix grup d’aprenents (10-11 anys d’edat), fet que permet eliminar variables individuals com l'aptitud dels aprenents o l'estil del/de la mestre/a.Els resultats mostren un cert nombre de similituds discursives entre AICLE i EFL donat que ambdós enfocaments tenen lloc en el context-classe amb unes característiques ben definides. Tal com apunta la recerca realitzada en aquest camp, la instrucció AICLE reuneix un seguit de condicions idònies per un major desenvolupament dels nivells de llengua anglesa més enllà de les classes ‘tradicionals’ d’anglès. Malgrat això, aquest estudi sembla indicar que el potencial d'AICLE pel que fa a facilitar una exposició rica a l’anglès i una producció oral significativa no s’explota degudament. En aquest sentit, els resultats d’aquest estudi poden contribuir a la formació dels futurs professors d'AICLE si es busca l’assoliment d’una complementarietat d’ambdós contextos amb l’objectiu últim de millorar els nivells de domini de la llengua anglesa.

Diseño de una herramienta de e-learning para el área de cirugía traumatológica

Este artículo trata, en primer lugar, de analizar el estado actual de las herramientas de e-learning relacionadas y aplicadas en el área de cirugía traumatológica, presentando las herramientas disponibles en la actualidad como vídeos, audios, simuladores de realidad virtual, pacientes virtuales, LMS, entre otras; para, a continuación, describir el diseño de una herramienta en la que los componentes cumplan con los criterios de integración, interactividad, estandarización y asegure la reutilización. Como conclusión, se valora positivamente el diseño de una herramienta totalmente de código abierto que incorpora componentes de LMCS, repositorios de objetos, pacientes virtuales, simuladores hápticos de realidad virtual y objetos educativos, entre otros. Finalmente se recomienda implementar y comprobar la utilidad de la herramienta propuesta en la formación y entrenamiento de cirujanos traumatólogos.

A genealogical conceptual model using ontologies

Roughly fifteen years ago, the Church of Jesus Christ of Latter-day Saints published a new proposed standard file format. They call it GEDCOM. It was designed to allow different genealogy programs to exchange data.Five years later, in may 2000, appeared the GENTECH Data Modeling Project, with the support of the Federation of Genealogical Societies (FGS) and other American genealogical societies. They attempted to define a genealogical logic data model to facilitate data exchange between different genealogical programs. Although genealogists deal with an enormous variety of data sources, one of the central concepts of this data model was that all genealogical data could be broken down into a series of short, formal genealogical statements. It was something more versatile than only export/import data records on a predefined fields. This project was finally absorbed in 2004 by the National Genealogical Society (NGS).Despite being a genealogical reference in many applications, these models have serious drawbacks to adapt to different cultural and social environments. At the present time we have no formal proposal for a recognized standard to represent the family domain.Here we propose an alternative conceptual model, largely inherited from aforementioned models. The design is intended to overcome their limitations. However, its major innovation lies in applying the ontological paradigm when modeling statements and entities.

Electronic voting system for computer supported collaborative learning

The EVS4CSCL project starts in the context of a Computer Supported Collaborative Learning environment (CSCL). Previous UOC projects created a CSCL generic platform (CLPL) to facilitate the development of CSCL applications. A discussion forum (DF) was the first application developed over the framework. This discussion forum was different from other products on the marketplace because of its focus on the learning process. The DF carried out the specification and elaboration phases from the discussion learning process but there was a lack in the consensus phase. The consensus phase in a learning environment is not something to be achieved but tested. Common tests are done by Electronic Voting System (EVS) tools, but consensus test is not an assessment test. We are not evaluating our students by their answers but by their discussion activity. Our educational EVS would be used as a discussion catalyst proposing a discussion about the results after an initial query or it would be used after a discussion period in order to manifest how the discussion changed the students mind (consensus). It should be also used by the teacher as a quick way to know where the student needs some reinforcement. That is important in a distance-learning environment where there is no direct contact between the teacher and the student and it is difficult to detect the learning lacks. In an educational environment, assessment it is a must and the EVS will provide direct assessment by peer usefulness evaluation, teacher marks on every query created and indirect assessment from statistics regarding the user activity.

Learning about Distributed Systems

This paper presents the "state of the art" about distributed systems and applications and it's focused on teaching about these systems. It presents different platforms where to run distributed applications and describes some development toolkits whose can be used to develop prototypes, practices and distributed applications. It also presents some existing distributed algorithms useful for class practices, and some tools to help managing distributed environments. Finally, the paper presents some teaching experiences with different approaches on how to teach about distributed systems.

An empirical study of machine learning techniques applied to image watermarking

A study of how the machine learning technique, known as gentleboost, could improve different digital watermarking methods such as LSB, DWT, DCT2 and Histogram shifting.

Avaluació de 4 experiències d’e‐learning: formació continuada virtual en el camp de la farmacologia clínica.

Introducció: Les noves tecnologies han donat peu a la creació de propostes docents que es desenvolupen a través d’internet . Objectius: Avaluar quatre cursos de formació virtual realitzats a la Fundació Institut Català de Farmacologia per analitzat-ne l’activitat i la qualitat. Metodologia: S’ha mesurat el registre de participació dels alumnes mitjançant l’accés als materials i activitats proposades, i la qualitat de la formació mitjançant una enquesta de satisfacció. Resultats: La proporció de realització d’activitats ha estat notable i la qualitat dels cursos ben valorada. Conclusió: La bona valoració rebuda mostra la qualitat dels cursos realitzats i avala les nostres propostes pedagògiques.

Attention, memory and verbal learning and their relation to schizotypal traits in unaffected parents of schizophrenic patients

The main objective of this ex post facto study is to compare the differencesin cognitive functions and their relation to schizotypal personality traits between agroup of unaffected parents of schizophrenic patients and a control group. A total of 52unaffected biological parents of schizophrenic patients and 52 unaffected parents ofunaffected subjects were assessed in measures of attention (Continuous PerformanceTest- Identical Pairs Version, CPT-IP), memory and verbal learning (California VerbalLearning Test, CVLT) as well as schizotypal personality traits (Oxford-Liverpool Inventoryof Feelings and Experiences, O-LIFE). The parents of the patients with schizophreniadiffer from the parents of the control group in omission errors on the ContinuousPerformance Test- Identical Pairs, on a measure of recall and on two contrast measuresof the California Verbal Learning Test. The associations between neuropsychologicalvariables and schizotpyal traits are of a low magnitude. There is no defined pattern ofthe relationship between cognitive measures and schizotypal traits

Some conceptual difficulties regarding "net" multipliers

Multipliers are routinely used for impact evaluation of private projects and public policies at the national and subnational levels. Oosterhaven and Stelder (2002) correctly pointed out the misuse of standard 'gross' multipliers and proposed the concept of 'net' multiplier as a solution to this bad practice. We prove their proposal is not well founded. We do so by showing that supporting theorems are faulty in enunciation and demonstration. The proofs are flawed due to an analytical error but the theorems themselves cannot be salvaged as generic, non-curiosum counterexamples demonstrate. We also provide a general analytical framework for multipliers and, using it, we show that standard 'gross' multipliers are all that is needed within the interindustry model since they follow the causal logic of the economic model, are well defined and independent of exogenous shocks, and are interpretable as predictors for change.

Two-sided learning in new keynesian models: dynamics, (lack of) convergence and the value of information

This paper investigates the role of learning by private agents and the central bank (two-sided learning) in a New Keynesian framework in which both sides of the economy have asymmetric and imperfect knowledge about the true data generating process. We assume that all agents employ the data that they observe (which may be distinct for different sets of agents) to form beliefs about unknown aspects of the true model of the economy, use their beliefs to decide on actions, and revise these beliefs through a statistical learning algorithm as new information becomes available. We study the short-run dynamics of our model and derive its policy recommendations, particularly with respect to central bank communications. We demonstrate that two-sided learning can generate substantial increases in volatility and persistence, and alter the behavior of the variables in the model in a signifficant way. Our simulations do not converge to a symmetric rational expectations equilibrium and we highlight one source that invalidates the convergence results of Marcet and Sargent (1989). Finally, we identify a novel aspect of central bank communication in models of learning: communication can be harmful if the central bank's model is substantially mis-specified