Policy gradient based Reinforcement Learning for real autonomous underwater cable tracking

This paper proposes a field application of a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot in cable tracking task. The learning system is characterized by using a direct policy search method for learning the internal state/action mapping. Policy only algorithms may suffer from long convergence times when dealing with real robotics. In order to speed up the process, the learning phase has been carried out in a simulated environment and, in a second step, the policy has been transferred and tested successfully on a real robot. Future steps plan to continue the learning process on-line while on the real robot while performing the mentioned task. We demonstrate its feasibility with real experiments on the underwater robot ICTINEU AUV

Periodic solutions of second-order differential inclusions systems with p-Laplacian

Some existence results are obtained for periodic solutions of nonautonomous second-order differential inclusions systems with p-Laplacian

Periodic solutions for nonautonomous second order differential inclusions systems with p- Laplacian

Using the nonsmooth variant of minimax point theorems, some existence results are obtained for periodic solutions of nonautonomous second-order differential inclusions systems with p-Laplacian.

Sequencing games without initial order

In this note we study uncertainty sequencing situations, i.e., 1-machine sequencing situations in which no initial order is specified. We associate cooperative games with these sequencing situations, study their core, and provide links with the classic sequencing games introduced by Curiel et al. (1989). Moreover, we propose and characterize two simple cost allocation rules for uncertainty sequencing situations with equal processing times.

On moduli of smoothness of fractional order

In this paper we consider the properties of moduli of smoothness of fractional order. The main result of the paper describes the equivalence of the modulus of smoothness and a function from some class.

Limit cycles for cubic systems with a symmetry of order 4 and without in nite critical points

"Vegeu el resum a l'inici del document del fitxer adjunt."

On the upper bound of the number of limit cycles obtained by the second order averaging method I

"Vegeu el resum a l'inici del document del fitxer adjunt."

On the upper bound of the number of limit cycles obtained by the second order averaging method II

"Vegeu el resum a l'inici del document del fitxer adjunt."

The third order Melnikov function of a quadratic center under quadratic perturbation

We study quadratic perturbations of the integrable system (1+x)dH; where H =(x²+y²)=2: We prove that the first three Melnikov functions associated to the perturbed system give rise at most to three limit cycles.

Dynamics of the third order Lyness' difference equation

"Vegeu el resum a l'inici del document del fitxer adjunt"

Clean Development Mechanism and Sustainable Development: a discussion on the link between the CDM and Sustainable Development, an analysis of the current status of the CDM portfolio, and an multicriteria evaluation of the effects of additional incentives in order to foster broad local Sustainable Development dividends from the CDM projects

vegeu resum en el fitxer adjunt a l'inici del treball de recerca

A public-key cryptosystem based on second order linear sequences

Based on Lucas functions, an improved version of the Diffie-Hellman distribution key scheme and to the ElGamal public key cryptosystem scheme are proposed, together with an implementation and computational cost. The security relies on the difficulty of factoring an RSA integer and on the difficulty of computing the discrete logarithm.

Empresa Davantis: seguimiento de personas y vehículos por videovigilancia inteligente

Este proyecto, desarrollado en la empresa Davantis, tiene como objetivo encontrar posibles mejoras a su actual sistema de videovigilancia, el Daview. El proyecto está dedicado al estudio del algoritmo de seguimiento Mean Shift para la elaboración de un sistema de tracking. Para ello se han desarrollado y evaluado tres implementaciones diferentes, mediante las cuales se han encontrado mejoras que complementan al módulo de tracking del Daview. También se ha estudiado la utilidad de un sistema de evaluación manual frente a uno de automático.

A public key encryption based on third order linear sequences

Based on third order linear sequences, an improvement version of the Diffie-Hellman distribution key scheme and the ElGamal public key cryptosystem scheme are proposed, together with an implementation and computational cost. The security relies on the difficulty of factoring an RSA integer and on the difficulty of computing the discrete logarithm.

On the number of higher order Delaunay triangulations

"Vegeu el resum a l'inici del document del fitxer adjunt."