Control of Robot by Means of Human Thought

Brain computer interface (BCI) is a kind of human machine interface, which provides a new interaction method between human and computer or other equipment. The most significant characteristic of BCI system is that its control input is brain electrical activities acquired from the brain instead of traditional input such as hands or eyes. BCI technique has rapidly developed during last two decades and it has mainly worked as an auxiliary technique to help the disable people improve their life qualities. With the appearance of low cost novel electrical devices such as EMOTIV, BCI technique has been applied to the general public through many useful applications including video gaming, virtual reality and virtual keyboard. The purpose of this research is to be familiar with EMOTIV EPOC system and make use of it to build an EEG based BCI system for controlling an industrial manipulator by means of human thought. To build a BCI system, an acquisition program based on EMOTIV EPOC system is designed and a MFC based dialog that works as an operation panel is presented. Furthermore, the inverse kinematics of RV-3SB industrial robot was solved. In the last part of this research, the designed BCI system with human thought input is examined and the results indicate that the system is running smoothly and displays clearly the motion type and the incremental displacement of the motion.

Virtuaalinen käyttöönottoympäristö automaatiojärjestelmälle

Valmistavan teollisuuden kiristyvät vaatimukset suunnittelusta markkinoille -ajassa (engl. time-to-market), laadussa, kustannustehokkuudessa ja turvallisuudessa luovat paineita uusien toimintatapojen etsimisessä. Usein laitteiston ohjausalgoritmeja ei ole mahdollista testata todellisen laitteiston kanssa, vaan ainoaksi ennakoivaksi vaihtoehdoksi jää todellisen laitteiston virtuaalinen mallintaminen. Eräs uusista toimintavoista on virtuaalinen käyttöönotto, jossa tuotantolinja tai laitteisto mallinnetaan ja sen käyttäytymistä simuloidaan ohjausalgoritmien parantamista ja todentamista varten. Tämän diplomityön tavoitteena oli toteuttaa virtuaalinen käyttöönottoympäristö, jolla laitteiston 3D-mallinnettua virtuaalista mallia voidaan ohjata reaaliajassa todellisen laitteiston ohjauslaitteistolla. Käyttöönottoympäristön toteuttamisen lopullisena tavoitteena on tutkia, millaisia hyötyjä sillä voidaan saavuttaa Outotec (Finland) Oy:n automaatiojärjestelmien suunnittelussa ja käyttöönotossa kiristyvien vaatimusten täyttämiseksi. Työssä toteutetulla käyttöönottoympäristöllä pystytään simuloimaan 3D-mallinnetun laitteiston osan toimintaa reaaliajassa. Todellisen laitteiston ominaisuuksista määritettyjä vaatimuksia ei kustannussyistä täytetty, sillä ennen sitä haluttiin varmistua valitun alustan ominaisuuksista, toimivuudesta ja soveltuvuudesta. Toteutuksen katsotaan kuitenkin täyttävän pehmeän reaaliaikaisuuden kriteerin noin 40 ms aikatasolla ja 80 ms reaktioajalla. Toteutettu virtuaalinen käyttöönottoympäristö osoittautui toimivaksi ja soveltuvaksi, sekä sen todettiin tuovan potentiaalisia hyötyjä Outotec (Finland) Oy:lle, esimerkiksi kosketusnäyttöjen visualisoinnin parannus, hybridikäyttöönottomahdollisuus sekä automaatio-ohjauksien kehittäminen. Työn perusteella arvioidaan onko Outotec:lla tarvetta jatkaa valitulla alustalla todellisen laitteiston aikavaatimukset täyttävään reaaliaika-toteutukseen, jota työssä esitellään.

Evaluation of Auditory Displays Supporting Aircraft Approach and Landing

Abstract: The paper describes an auditory interface using directional sound as a possible support for pilots during approach in an instrument landing scenario. Several ways of producing directional sounds are illustrated. One using speaker pairs and controlling power distribution between speakers is evaluated experimentally. Results show, that power alone is insufficient for positioning single isolated sound events, although discrimination in the horizontal plane performs better than in the vertical. Additional sound parameters to compensate for this are proposed.

3D path planning with novel multiple 2D layered approach for complex human-robot interaction

Navigating cluttered indoor environments is a difficult problem in indoor service robotics. The Acroboter concept, a novel approach to indoor locomotion, represents unique opportunity to avoid obstacles in indoor environments by navigating the ceiling plane. This mode of locomotion requires the ability to accurately detect obstacles, and plan 3D trajectories through the environment. This paper presents the development of a resilient object tracking system, as well as a novel approach to generating 3D paths suitable for such robot configurations. Distributed human-machine interfacing allowing simulation previewing of actions is also considered in the developed system architecture.

Deception-detection and machine intelligence in practical Turing tests

Deception-detection is the crux of Turing’s experiment to examine machine thinking conveyed through a capacity to respond with sustained and satisfactory answers to unrestricted questions put by a human interrogator. However, in 60 years to the month since the publication of Computing Machinery and Intelligence little agreement exists for a canonical format for Turing’s textual game of imitation, deception and machine intelligence. This research raises from the trapped mine of philosophical claims, counter-claims and rebuttals Turing’s own distinct five minutes question-answer imitation game, which he envisioned practicalised in two different ways: a) A two-participant, interrogator-witness viva voce, b) A three-participant, comparison of a machine with a human both questioned simultaneously by a human interrogator. Using Loebner’s 18th Prize for Artificial Intelligence contest, and Colby et al.’s 1972 transcript analysis paradigm, this research practicalised Turing’s imitation game with over 400 human participants and 13 machines across three original experiments. Results show that, at the current state of technology, a deception rate of 8.33% was achieved by machines in 60 human-machine simultaneous comparison tests. Results also show more than 1 in 3 Reviewers succumbed to hidden interlocutor misidentification after reading transcripts from experiment 2. Deception-detection is essential to uncover the increasing number of malfeasant programmes, such as CyberLover, developed to steal identity and financially defraud users in chatrooms across the Internet. Practicalising Turing’s two tests can assist in understanding natural dialogue and mitigate the risk from cybercrime.

Artificial Intelligence: the basics

Artificial Intelligence: The Basics is a concise and cutting-edge introduction to the fast moving world of AI. The author Kevin Warwick, a pioneer in the field, examines issues of what it means to be man or machine and looks at advances in robotics which have blurred the boundaries. Topics covered include: how intelligence can be defined, whether machines can 'think', sensory input in machine systems, the nature of consciousness, the controversial culturing of human neurons. Exploring issues at the heart of the subject, this book is suitable for anyone interested in AI, and provides an illuminating and accessible introduction to this fascinating subject.

Structures of the noncovalent complexes of human and bovine prothrombin fragment 2 with human PPACK-thrombin

Both human and bovine prothrombin fragment 2 (the second kringle) have been cocrystallized separately with human PPACK (D-Phe-Pro-Arg)-thrombin, and the structures of these noncovalent complexes have been determined and refined (R = 0.155 and 0.157, respectively) at 3.3-Å resolution using X-ray crystallographic methods. The kringles interact with thrombin at a site that has previously been proposed to be the heparin binding region. The latter is a highly electropositive surface near the C-terminal helix of thrombin abundant in arginine and lysine residues. These form salt bridges with acidic side chains of kringle 2. Somewhat unexpectedly, the negative groups of the kringle correspond to an enlarged anionic center of the lysine binding site of lysine binding kringles such as plasminogens K1 and K4 and TPA K2. The anionic motif is DGDEE in prothrombin kringle 2. The corresponding cationic center of the lysine binding site region has an unfavorable Arg70Asp substitution, but Lys35 is conserved. However, the folding of fragment 2 is different from that of prothrombin kringle 1 and other kringles: the second outer loop possesses a distorted two-turn helix, and the hairpin β-turn of the second inner loop pivots at Val64 and Asp70 by 60°. Lys35 is located on a turn of the helix, which causes it to project into solvent space in the fragment 2-thrombin complex, thereby devastating any vestige of the cationic center of the lysine binding site. Since fragment 2 has not been reported to bind lysine, it most likely has a different inherent folding conformation for the second outer loop, as has also been observed to be the case with TPA K2 and the urokinase kringle. The movement of the Val64-Asp70 β-turn is most likely a conformational change accompanying complexation, which reveals a new heretofore unsuspected flexibility in kringles. The fragment 2-thrombin complex is only the second cassette module-catalytic domain structure to be determined for a multidomain blood protein and only the third domain-domain interaction to be described among such proteins, the others being factor Xa without a Gla domain and Ca2+ prothrombin fragment 1 with a Gla domain and a kringle. © 1993 American Chemical Society.

The influence of the flexibility of the chair seat on pressure peak and distribution of the contact area in individuals with cerebral palsy during the execution of a task

This study aimed to determine the influence of flexibility of the chair seat surface on the pressure peak and on the contact area during the execution of a task of handling an object on the seated position by individuals with spastic cerebral palsy. Ten individuals of both genders with diagnosis of spastic cerebral palsy, who had some control to voluntarily move the body and the upper limbs, participated in this study. Quantification of data was carried out in two experimental situations: (1) execution of a task of fitting with upper limbs, and with the individual placed on an adapted canvas seat; (2) execution of a task of fitting with the participant positioned on an adapted wooden seat. Data obtained were submitted to a non-parametric and descriptive statistical analysis using the Wilcoxon test. Results indicated that the use of canvas seat increased the contact area and decreased the pressure peak and the medio-lateral displacement of centre pressure on the seated posture. © 2011 Informa UK, Ltd.

A malware detection system inspired on the human immune system

Malicious programs (malware) can cause severe damage on computer systems and data. The mechanism that the human immune system uses to detect and protect from organisms that threaten the human body is efficient and can be adapted to detect malware attacks. In this paper we propose a system to perform malware distributed collection, analysis and detection, this last inspired by the human immune system. After collecting malware samples from Internet, they are dynamically analyzed so as to provide execution traces at the operating system level and network flows that are used to create a behavioral model and to generate a detection signature. Those signatures serve as input to a malware detector, acting as the antibodies in the antigen detection process. This allows us to understand the malware attack and aids in the infection removal procedures. © 2012 Springer-Verlag.

Deep learning architecture for gesture recognition

Pós-graduação em Engenharia Mecânica - FEG

Avaliação da usabilidade de representações cartográficas em diferentes escalas para sistema de navegação e guia de rota em automóvel

Pós-graduação em Ciências Cartográficas - FCT

Innovative Man Machine Interfaces In Aeronautics

The research activity focused on the study, design and evaluation of innovative human-machine interfaces based on virtual three-dimensional environments. It is based on the brain electrical activities recorded in real time through the electrical impulses emitted by the brain waves of the user. The achieved target is to identify and sort in real time the different brain states and adapt the interface and/or stimuli to the corresponding emotional state of the user. The setup of an experimental facility based on an innovative experimental methodology for “man in the loop" simulation was established. It allowed involving during pilot training in virtually simulated flights, both pilot and flight examiner, in order to compare the subjective evaluations of this latter to the objective measurements of the brain activity of the pilot. This was done recording all the relevant information versus a time-line. Different combinations of emotional intensities obtained, led to an evaluation of the current situational awareness of the user. These results have a great implication in the current training methodology of the pilots, and its use could be extended as a tool that can improve the evaluation of a pilot/crew performance in interacting with the aircraft when performing tasks and procedures, especially in critical situations. This research also resulted in the design of an interface that adapts the control of the machine to the situation awareness of the user. The new concept worked on, aimed at improving the efficiency between a user and the interface, and gaining capacity by reducing the user’s workload and hence improving the system overall safety. This innovative research combining emotions measured through electroencephalography resulted in a human-machine interface that would have three aeronautical related applications: • An evaluation tool during the pilot training; • An input for cockpit environment; • An adaptation tool of the cockpit automation.

Sharing Human-Generated Observations by Integrating HMI and the Semantic Sensor Web

Current “Internet of Things” concepts point to a future where connected objects gather meaningful information about their environment and share it with other objects and people. In particular, objects embedding Human Machine Interaction (HMI), such as mobile devices and, increasingly, connected vehicles, home appliances, urban interactive infrastructures, etc., may not only be conceived as sources of sensor information, but, through interaction with their users, they can also produce highly valuable context-aware human-generated observations. We believe that the great promise offered by combining and sharing all of the different sources of information available can be realized through the integration of HMI and Semantic Sensor Web technologies. This paper presents a technological framework that harmonizes two of the most influential HMI and Sensor Web initiatives: the W3C’s Multimodal Architecture and Interfaces (MMI) and the Open Geospatial Consortium (OGC) Sensor Web Enablement (SWE) with its semantic extension, respectively. Although the proposed framework is general enough to be applied in a variety of connected objects integrating HMI, a particular development is presented for a connected car scenario where drivers’ observations about the traffic or their environment are shared across the Semantic Sensor Web. For implementation and evaluation purposes an on-board OSGi (Open Services Gateway Initiative) architecture was built, integrating several available HMI, Sensor Web and Semantic Web technologies. A technical performance test and a conceptual validation of the scenario with potential users are reported, with results suggesting the approach is sound

Improving Speech Interaction in Vehicles Using Context-Aware Information through A SCXML Framework

Speech Technologies can provide important benefits for the development of more usable and safe in-vehicle human-machine interactive systems (HMIs). However mainly due robustness issues, the use of spoken interaction can entail important distractions to the driver. In this challenging scenario, while speech technologies are evolving, further research is necessary to explore how they can be complemented with both other modalities (multimodality) and information from the increasing number of available sensors (context-awareness). The perceived quality of speech technologies can significantly be increased by implementing such policies, which simply try to make the best use of all the available resources; and the in vehicle scenario is an excellent test-bed for this kind of initiatives. In this contribution we propose an event-based HMI design framework which combines context modelling and multimodal interaction using a W3C XML language known as SCXML. SCXML provides a general process control mechanism that is being considered by W3C to improve both voice interaction (VoiceXML) and multimodal interaction (MMI). In our approach we try to anticipate and extend these initiatives presenting a flexible SCXML-based approach for the design of a wide range of multimodal context-aware HMI in-vehicle interfaces. The proposed framework for HMI design and specification has been implemented in an automotive OSGi service platform, and it is being used and tested in the Spanish research project MARTA for the development of several in-vehicle interactive applications.