自主机器人的强化学习研究进展

虽然基于行为控制自主机器人具有较高的鲁棒性，但其对于动态环境缺乏必要的自适应能力，强化学习方法使机器人可以通过学习来完成任务，而无需设计者完全预先规定机器人的所有动作，它是将动态规划和监督学习结合的基础上发展起来的一种新颖的学习方法，它通过机器人与环境的试错交互，利用来自成功和失败经验的奖励和惩罚信号不断改进机器人的性能，从而达到目标，并容许滞后评价，由于其解决复杂问题的突出能力，强化学习已成为一种非常有前途的机器人学习方法，本文系统论述了强化学习方法在自主机器人中的研究现状，指出了存在的问题，分析了几种问题解决途径，展望了未来发展趋势。

监控式遥控机器人初探

本文初步探讨了遥控机器人监控的基本概念,得出这样一种认识:监控方式是机器人向智能化发展的一个恰当模式,监控系统是由人的高级智能与机器人的低级智能构成的系统.监控是系统中这两种智能相互作用的过程,人的智能应当能够在机器智能的不同级别上输入,我们研制了一个遥控机器人监控操作器的实验系统,通过实例和实验作了说明.

Génération et reconnaissance de rythmes au moyen de réseaux de neurones à réservoir

Les fichiers sons qui accompagne mon document sont au format midi. Le programme que nous avons développés pour ce travail est en language Python.

Scene Classification Using a Hybrid Generative/Discriminative Approach

We investigate whether dimensionality reduction using a latent generative model is beneficial for the task of weakly supervised scene classification. In detail, we are given a set of labeled images of scenes (for example, coast, forest, city, river, etc.), and our objective is to classify a new image into one of these categories. Our approach consists of first discovering latent ";topics"; using probabilistic Latent Semantic Analysis (pLSA), a generative model from the statistical text literature here applied to a bag of visual words representation for each image, and subsequently, training a multiway classifier on the topic distribution vector for each image. We compare this approach to that of representing each image by a bag of visual words vector directly and training a multiway classifier on these vectors. To this end, we introduce a novel vocabulary using dense color SIFT descriptors and then investigate the classification performance under changes in the size of the visual vocabulary, the number of latent topics learned, and the type of discriminative classifier used (k-nearest neighbor or SVM). We achieve superior classification performance to recent publications that have used a bag of visual word representation, in all cases, using the authors' own data sets and testing protocols. We also investigate the gain in adding spatial information. We show applications to image retrieval with relevance feedback and to scene classification in videos

The Age of Social Machines

Many of the most successful and important systems that impact our lives combine humans, data, and algorithms at Web Scale. These social machines are amalgamations of human and machine intelligence. This seminar will provide an update on SOCIAM, a five year EPSRC Programme Grant that seeks to gain a better understanding of social machines; how they are observed and constituted, how they can be designed and their fate determined. We will review how social machines can be of value to society, organisations and individuals. We will consider the challenges they present to our various disciplines.