Assistive locomotion strategies for active lower limb devices

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)

Vision-based hand Wheel-chair control

Several studies have shown that people with disabilities benefit substantially from access to a means of independent mobility and assistive technology. Researchers are using technology originally developed for mobile robots to create easier to use wheelchairs. With this kind of technology people with disabilities can gain a degree of independence in performing daily life activities. In this work a computer vision system is presented, able to drive a wheelchair with a minimum number of finger commands. The user hand is detected and segmented with the use of a kinect camera, and fingertips are extracted from depth information, and used as wheelchair commands.

Towards human-like bimanual movements in anthropomorphic robots: a nonlinear optimization approach

Previously we have presented a model for generating human-like arm and hand movements on an unimanual anthropomorphic robot involved in human-robot collaboration tasks. The present paper aims to extend our model in order to address the generation of human-like bimanual movement sequences which are challenged by scenarios cluttered with obstacles. Movement planning involves large scale nonlinear constrained optimization problems which are solved using the IPOPT solver. Simulation studies show that the model generates feasible and realistic hand trajectories for action sequences involving the two hands. The computational costs involved in the planning allow for real-time human robot-interaction. A qualitative analysis reveals that the movements of the robot exhibit basic characteristics of human movements.

Review of robotic technology for keyhole transcranial stereotactic neurosurgery

The research of stereotactic apparatus to guide surgical devices began in 1908, yet a major part of today's stereotactic neurosurgeries still rely on stereotactic frames developed almost half a century ago. Robots excel at handling spatial information, and are, thus, obvious candidates in the guidance of instrumentation along precisely planned trajectories. In this review, we introduce the concept of stereotaxy and describe a standard stereotactic neurosurgery. Neurosurgeons' expectations and demands regarding the role of robots as assistive tools are also addressed. We list the most successful robotic systems developed specifically for or capable of executing stereotactic neurosurgery. A critical review is presented for each robotic system, emphasizing the differences between them and detailing positive features and drawbacks. An analysis of the listed robotic system features is also undertaken, in the context of robotic application in stereotactic neurosurgery. Finally, we discuss the current perspective, and future directions of a robotic technology in this field. All robotic systems follow a very similar and structured workflow despite the technical differences that set them apart. No system unequivocally stands out as an absolute best. The trend of technological progress is pointing toward the development of miniaturized cost-effective solutions with more intuitive interfaces.

The potential field method and the nonlinear attractor dynamics approach: what are the differences?

One of the most popular approaches to path planning and control is the potential field method. This method is particularly attractive because it is suitable for on-line feedback control. In this approach the gradient of a potential field is used to generate the robot's trajectory. Thus, the path is generated by the transient solutions of a dynamical system. On the other hand, in the nonlinear attractor dynamic approach the path is generated by a sequence of attractor solutions. This way the transient solutions of the potential field method are replaced by a sequence of attractor solutions (i.e., asymptotically stable states) of a dynamical system. We discuss at a theoretical level some of the main differences of these two approaches.

The human eye as human-machine interface

Eye tracking as an interface to operate a computer is under research for a while and new systems are still being developed nowadays that provide some encouragement to those bound to illnesses that incapacitates them to use any other form of interaction with a computer. Although using computer vision processing and a camera, these systems are usually based on head mount technology being considered a contact type system. This paper describes the implementation of a human-computer interface based on a fully non-contact eye tracking vision system in order to allow people with tetraplegia to interface with a computer. As an assistive technology, a graphical user interface with special features was developed including a virtual keyboard to allow user communication, fast access to pre-stored phrases and multimedia and even internet browsing. This system was developed with the focus on low cost, user friendly functionality and user independency and autonomy.

RoboCup Soccer Leagues

RoboCup was created in 1996 by a group of Japanese, American, and European Artificial Intelligence and Robotics researchers with a formidable, visionary long-term challenge: “By 2050 a team of robot soccer players will beat the human World Cup champion team.” At that time, in the mid 90s, when there were very few effective mobile robots and the Honda P2 humanoid robot was presented to a stunning public for the first time also in 1996, the RoboCup challenge, set as an adversarial game between teams of autonomous robots, was fascinating and exciting. RoboCup enthusiastically and concretely introduced three robot soccer leagues, namely “Simulation,” “Small-Size,” and “Middle-Size,” as we explain below, and organized its first competitions at IJCAI’97 in Nagoya with a surprising number of 100 participants [RC97]. It was the beginning of what became a continously growing research community. RoboCup established itself as a structured organization (the RoboCup Federation www.RoboCup.org). RoboCup fosters annual competition events, where the scientific challenges faced by the researchers are addressed in a setting that is attractive also to the general public. and the RoboCup events are the ones most popular and attended in the research fields of AI and Robotics.RoboCup further includes a technical symposium with contributions relevant to the RoboCup competitions and beyond to the general AI and robotics.

Hand gesture recognition for human computer interaction : a comparative study of different image features

Hand gesture recognition for human computer interaction, being a natural way of human computer interaction, is an area of active research in computer vision and machine learning. This is an area with many different possible applications, giving users a simpler and more natural way to communicate with robots/systems interfaces, without the need for extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them to convey information or for device control. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. In this study we try to identify hand features that, isolated, respond better in various situations in human-computer interaction. The extracted features are used to train a set of classifiers with the help of RapidMiner in order to find the best learner. A dataset with our own gesture vocabulary consisted of 10 gestures, recorded from 20 users was created for later processing. Experimental results show that the radial signature and the centroid distance are the features that when used separately obtain better results, with an accuracy of 91% and 90,1% respectively obtained with a Neural Network classifier. These to methods have also the advantage of being simple in terms of computational complexity, which make them good candidates for real-time hand gesture recognition.

Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

A case study of product usability of a pelvic device used by children with neuromotor impairments

On assistive technology targeted for people with activity limitations and participation, usability issues becomes an essential tool to ensure that the product has the appropriate ergonomics characteristics, in other words, ensure that it fits the specific user´s needs. The aim of this study was to analyze the usability of an adaptive seating device for children with neuromotor impairments, by using kinematic indicators of the reaching movement. The study sample consisted of 13 children with associated neurologic conditions. The tests were developed by using a wooden bench height adjustable, integrated with the adaptive seating device under study, and a system to capture three-dimensional image, called Qualisys Track Manager. The following reaching kinematics variables were measured: maximum reaching velocity, movement duration, index of curvature, and unit movements. It was found that the use of the adaptive seating device had a positive impact on upper limb function in children with neuromotor impairments. It was also noticed an improvement in the reaching movement kinematics, which was statistical significant for the index of curvature and unit movements. As main conclusions, it is possible to point out some positive effects that the product under study seems to have on users' movements, such as the improved movement quality of the upper limb, which could mean a better postural adjustments and higher trunk postural control. By identifying new measures of usability in terms of effectiveness and efficiency for the analyzeddevice, the results obtained may serve also as performance indicators, providing new data that may help to improve the product and eventually modifying it, in order to turn it more compatible with the needs of the considered target population.

Generating timed trajectories foran autonomous robot

Tese de Doutoramento Programa Doutoral em Engenharia Electrónica e Computadores

Tecnologias para a inclusão: centros de recursos virtuais no apoio às necessidades educativas especiais

Tese de Doutoramento em Ciências da Educação (área de especialização em Tecnologia Educativa).

Learning Robotics for youngsters - the RoboParty experience

Series: "Advances in intelligent systems and computing , ISSN 2194-5357, vol. 417"

Promoting independent living and recreation in life through ambient assisted living technology

The increase in life expectancy with a decrease in birth rates is contributing to the ageing of the European population. This phenomenon, coupled with greater awareness of the quality of life, the need to have cost-efficient assistive care, the intention of people to live independently in their homes, and the technological developments in recent decades, have contributed to the emergence of the concept of ambient assisted living (AAL). AAL solutions aim to provide healthy and safe ageing to users through promoting independence in performing daily activities and interacting with technology, taking into consideration the deterioration of the users’ capabilities and the reduced costs of the solutions. In this chapter, AAL developments of monitoring activities of daily living (ADLs) and participation in a virtual community with the selected stakeholders are introduced, their roadmap with the expected technological developments are described, and the expected impact of these solutions on the end users of the developed solutions are discussed. This enables a real user guidance structure that represents the different needs and limitations of each user, presenting a highly structured project based on personas and possible solutions for them. The AAL4ALL Ambient Assisted Living for All (ALL4ALL) project is considered here as a case study to analyze and illustrate the ALL concepts discussed in this chapter.

Off-line simulation inspires insight: a neurodynamics approach to efficient robot task learning

There is currently an increasing demand for robots able to acquire the sequential organization of tasks from social learning interactions with ordinary people. Interactive learning-by-demonstration and communication is a promising research topic in current robotics research. However, the efficient acquisition of generalized task representations that allow the robot to adapt to different users and contexts is a major challenge. In this paper, we present a dynamic neural field (DNF) model that is inspired by the hypothesis that the nervous system uses the off-line re-activation of initial memory traces to incrementally incorporate new information into structured knowledge. To achieve this, the model combines fast activation-based learning to robustly represent sequential information from single task demonstrations with slower, weight-based learning during internal simulations to establish longer-term associations between neural populations representing individual subtasks. The efficiency of the learning process is tested in an assembly paradigm in which the humanoid robot ARoS learns to construct a toy vehicle from its parts. User demonstrations with different serial orders together with the correction of initial prediction errors allow the robot to acquire generalized task knowledge about possible serial orders and the longer term dependencies between subgoals in very few social learning interactions. This success is shown in a joint action scenario in which ARoS uses the newly acquired assembly plan to construct the toy together with a human partner.