Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

QoS online routing and MPLS multilevel protection: a survey

A survey of MPLS protection methods and their utilization in combination with online routing methods is presented in this article. Usually, fault management methods pre-establish backup paths to recover traffic after a failure. In addition, MPLS allows the creation of different backup types, and hence MPLS is a suitable method to support traffic-engineered networks. In this article, an introduction of several label switch path backup types and their pros and cons are pointed out. The creation of an LSP involves a routing phase, which should include QoS aspects. In a similar way, to achieve a reliable network the LSP backups must also be routed by a QoS routing method. When LSP creation requests arrive one by one (a dynamic network scenario), online routing methods are applied. The relationship between MPLS fault management and QoS online routing methods is unavoidable, in particular during the creation of LSP backups. Both aspects are discussed in this article. Several ideas on how these actual technologies could be applied together are presented and compared

Online Robust 3D Mapping Using Structure from Motion Cues

This paper presents a complete solution for creating accurate 3D textured models from monocular video sequences. The methods are developed within the framework of sequential structure from motion, where a 3D model of the environment is maintained and updated as new visual information becomes available. The camera position is recovered by directly associating the 3D scene model with local image observations. Compared to standard structure from motion techniques, this approach decreases the error accumulation while increasing the robustness to scene occlusions and feature association failures. The obtained 3D information is used to generate high quality, composite visual maps of the scene (mosaics). The visual maps are used to create texture-mapped, realistic views of the scene

Systems Design: Use Case Modelling Lab using Visual Paradigm

This lab follows the lecture 'System Design: Using UML Use Cases'http://www.edshare.soton.ac.uk/9619/ It introduces Visual Paradigm as a UML modelling tool. Students work through Visual Paradigm online Tutorials and then create two projects.

Utilidad de los conceptos y estrategias comunitarias en el marketing online para la prevención de la copia ilegal en el mercado musical

Esta investigación se dirige a determinar cuál es la utilidad de los conceptos y estrategias comunitarias en el marketing online para la prevención de la copia ilegal en el mercado musical. Con este proyecto se desea que por medio de una nueva disquera enfocada en el comercio online, y usando los conceptos del mercadeo comunitario y el mercadeo relacional, se pueda desarrollar nuevas estrategias de mercadeo en donde se logre incentivar y promover la compra de música original por medio de la creación de una relación más estrecha entre la compañía y el cliente, en la cual pueda afectar de forma positiva a la comunidad a la que este pertenece. El objetivo general es determinar cuál es la utilidad de los conceptos y estrategias comunitarias en el marketing online para la prevención de la copia ilegal en el mercado musical. Los objetivos específicos son: 1. Mostrar la utilidad de los conceptos y estrategias del marketing comunitario en la prevención de la copia ilegal del mercado musical y 2. Implementar las estrategias logradas en la investigación en un plan de creación de empresa. Se utilizará el método de investigación y análisis de caso, utilizando el plan de empresa en la creación de una empresa del mercado musical, tomando la relación estratégica comunitaria y el marketing dentro del plan de mercadeo como estrategia para la prevención de la copia ilegal. Mediante este proyecto se desea que por medio del marketing relacional y de los conceptos del mercadeo hacia comunidades, enfocado en une- marketing sepuedanestablecerestrategiasparalaprevencióndelacopiailegalydelacomprade estos productos Además, se busca implementar dichos resultados en la empresa que se pretende crear en el sector de la industria musical, puesto que la seguridad que tendrán los productos a la venta, serán la ventaja competitiva de la empresa.

Testing Delivery Systems in Transnational virtual learning: the vocational management training for the european tourism industry (VocMat) case study

This article discusses the lessons learned from developing and delivering the Vocational Management Training for the European Tourism Industry (VocMat) online training programme, which was aimed at providing flexible, online distance learning for the European tourism industry. The programme was designed to address managers ‘need for flexible, senior management level training which they could access at a time and place which fitted in with their working and non-work commitments. The authors present two main approaches to using the Virtual Learning Environment, the feedback from the participants, and the implications of online Technology in extending tourism training opportunities

A design of benchmarking method for assessing performance of e-Government systems

This paper is an initial work towards developing an e-Government benchmarking model that is user-centric. To achieve the goal then, public service delivery is discussed first including the transition to online public service delivery and the need for providing public services using electronic media. Two major e-Government benchmarking methods are critically discussed and the need to develop a standardized benchmarking model that is user-centric is presented. To properly articulate user requirements in service provision, an organizational semiotic method is suggested.

Multi-modal fingerprinting for multimedia assets: optimisation of media security protection in online distribution environments

Since the advent of the internet in every day life in the 1990s, the barriers to producing, distributing and consuming multimedia data such as videos, music, ebooks, etc. have steadily been lowered for most computer users so that almost everyone with internet access can join the online communities who both produce, consume and of course also share media artefacts. Along with this trend, the violation of personal data privacy and copyright has increased with illegal file sharing being rampant across many online communities particularly for certain music genres and amongst the younger age groups. This has had a devastating effect on the traditional media distribution market; in most cases leaving the distribution companies and the content owner with huge financial losses. To prove that a copyright violation has occurred one can deploy fingerprinting mechanisms to uniquely identify the property. However this is currently based on only uni-modal approaches. In this paper we describe some of the design challenges and architectural approaches to multi-modal fingerprinting currently being examined for evaluation studies within a PhD research programme on optimisation of multi-modal fingerprinting architectures. Accordingly we outline the available modalities that are being integrated through this research programme which aims to establish the optimal architecture for multi-modal media security protection over the internet as the online distribution environment for both legal and illegal distribution of media products.

Calibration of closed loop controllers for setting impedances in force-reflecting systems

This paper discusses a new method of impedance control that has been successfully implemented on the master robot of a teleoperation system. The method involves calibrating the robot to quantify the effect of adjustable controller parameters on the impedances along its different axes. The empirical equations relating end-effector impedance to the controller's feedback gains are obtained by performing system identification tests along individual axes of the robot. With these equations, online control of end-effector stiffness and damping is possible without having to monitor joint torques or solving complex algorithms. Hard contact conditions and compliant interfaces have been effectively demonstrated on a telemanipulation test-bed using appropriate combinations of stiffness and damping settings obtained by this method.

Online modeling with tunable RBF network

In this paper, we propose a novel online modeling algorithm for nonlinear and nonstationary systems using a radial basis function (RBF) neural network with a fixed number of hidden nodes. Each of the RBF basis functions has a tunable center vector and an adjustable diagonal covariance matrix. A multi-innovation recursive least square (MRLS) algorithm is applied to update the weights of RBF online, while the modeling performance is monitored. When the modeling residual of the RBF network becomes large in spite of the weight adaptation, a node identified as insignificant is replaced with a new node, for which the tunable center vector and diagonal covariance matrix are optimized using the quantum particle swarm optimization (QPSO) algorithm. The major contribution is to combine the MRLS weight adaptation and QPSO node structure optimization in an innovative way so that it can track well the local characteristic in the nonstationary system with a very sparse model. Simulation results show that the proposed algorithm has significantly better performance than existing approaches.

Measuring student perception and actual usage of online learning management system

Online learning management systems are in use to facilitate the face to face learning process in many universities. There are many variables that shape and influence a student’s perception of an online learning management system. This study investigates whether there is a relationship between the perception of a student regarding the learning management system and their actual usage of such system. It is believed to help better understand the student usage of online learning management system. An online questionnaire was published on a course management system for a selected subject and the student participation was voluntary. Results indicate that no significant relationship between the perception students had about the learning management system and the actual use of the system. Interestingly, a significant relationship was found between having internet access away from university and the student perception about the system. Students who had internet access away from university had better perception about the learning management system even though there was no significant difference in the level of online learning management system usage between the groups.

Writing in a non-standard Greek variety: Romanized Cypriot Greek in online chat

Cypriot Greek, a variety of Greek spoken in the island of Cyprus, is relatively distinct from Standard Greek in all linguistic domains. The regional variety does not have a standard, official orthography and it is rarely used for everyday written purposes. Following technological development and the emergence of Computer-mediated Communication, a Romanized version of written CG is now widely used in online text-based communication, among teenagers and young adults (Themistocleous, C. (2008), The use of Cypriot-Greek in synchronous computer-mediated communication (PhD thesis), University of Manchester). In this study, I present the innovative ways that Greek-Cypriots use Roman characters in an effort to represent features of their spoken language in their online writings. By analysing data obtained from channel #Cyprus of Internet Relay Chat, I demonstrate how the choice of writing in CG affects the ways that Roman characters are used. I argue that this practice is not just a response to technological constrains but it actually has a wider social significance.

Online persuasion for e-commerce websites

The persuasive design of e-commerce websites has been shown to support people with online purchases. Therefore, it is important to understand how persuasive applications are used and assimilated into e-commerce website designs. This paper demonstrates how the PSD model’s persuasive features could be used to build a bridge supporting the extraction and evaluation of persuasive features in such e-commerce websites; thus practically explaining how feature implementation can enhance website persuasiveness. To support a deeper understanding of persuasive e-commerce website design, this research, using the Persuasive Systems Design (PSD) model, identifies the distinct persuasive features currently assimilated in ten successful e-commerce websites. The results revealed extensive use of persuasive features; particularly features related to dialogue support, credibility support, and primary task support; thus highlighting weaknesses in the implementation of social support features. In conclusion we suggest possible ways for enhancing persuasive feature implementation via appropriate contextual examples and explanation.

FORCe: fully online and automated artifact removal for brain-computer interfacing

A fully automated and online artifact removal method for the electroencephalogram (EEG) is developed for use in brain-computer interfacing. The method (FORCe) is based upon a novel combination of wavelet decomposition, independent component analysis, and thresholding. FORCe is able to operate on a small channel set during online EEG acquisition and does not require additional signals (e.g. electrooculogram signals). Evaluation of FORCe is performed offline on EEG recorded from 13 BCI particpants with cerebral palsy (CP) and online with three healthy participants. The method outperforms the state-of the-art automated artifact removal methods Lagged auto-mutual information clustering (LAMIC) and Fully automated statistical thresholding (FASTER), and is able to remove a wide range of artifact types including blink, electromyogram (EMG), and electrooculogram (EOG) artifacts.