A multimodal and adaptive real-time human -computer interface for peoples with severe motor disability

This dissertation introduces the design of a multimodal, adaptive real-time assistive system as an alternate human computer interface that can be used by individuals with severe motor disabilities. The proposed design is based on the integration of a remote eye-gaze tracking system, voice recognition software, and a virtual keyboard. The methodology relies on a user profile that customizes eye gaze tracking using neural networks. The user profiling feature facilitates the notion of universal access to computing resources for a wide range of applications such as web browsing, email, word processing and editing. ^ The study is significant in terms of the integration of key algorithms to yield an adaptable and multimodal interface. The contributions of this dissertation stem from the following accomplishments: (a) establishment of the data transport mechanism between the eye-gaze system and the host computer yielding to a significantly low failure rate of 0.9%; (b) accurate translation of eye data into cursor movement through congregate steps which conclude with calibrated cursor coordinates using an improved conversion function; resulting in an average reduction of 70% of the disparity between the point of gaze and the actual position of the mouse cursor, compared with initial findings; (c) use of both a moving average and a trained neural network in order to minimize the jitter of the mouse cursor, which yield an average jittering reduction of 35%; (d) introduction of a new mathematical methodology to measure the degree of jittering of the mouse trajectory; (e) embedding an onscreen keyboard to facilitate text entry, and a graphical interface that is used to generate user profiles for system adaptability. ^ The adaptability nature of the interface is achieved through the establishment of user profiles, which may contain the jittering and voice characteristics of a particular user as well as a customized list of the most commonly used words ordered according to the user's preferences: in alphabetical or statistical order. This allows the system to successfully provide the capability of interacting with a computer. Every time any of the sub-system is retrained, the accuracy of the interface response improves even more. ^

A Closed Loop Brain-machine Interface for Epilepsy Control Using Dorsal Column Electrical Stimulation

Although electrical neurostimulation has been proposed as an alternative treatment for drug-resistant cases of epilepsy, current procedures such as deep brain stimulation, vagus, and trigeminal nerve stimulation are effective only in a fraction of the patients. Here we demonstrate a closed loop brain-machine interface that delivers electrical stimulation to the dorsal column (DCS) of the spinal cord to suppress epileptic seizures. Rats were implanted with cortical recording microelectrodes and spinal cord stimulating electrodes, and then injected with pentylenetetrazole to induce seizures. Seizures were detected in real time from cortical local field potentials, after which DCS was applied. This method decreased seizure episode frequency by 44% and seizure duration by 38%. We argue that the therapeutic effect of DCS is related to modulation of cortical theta waves, and propose that this closed-loop interface has the potential to become an effective and semi-invasive treatment for refractory epilepsy and other neurological disorders.

Architecture for machining process and production monitoring based in open computer numerical control

This paper proposes an architecture for machining process and production monitoring to be applied in machine tools with open Computer numerical control (CNC). A brief description of the advantages of using open CNC for machining process and production monitoring is presented with an emphasis on the CNC architecture using a personal computer (PC)-based human-machine interface. The proposed architecture uses the CNC data and sensors to gather information about the machining process and production. It allows the development of different levels of monitoring systems with mininium investment, minimum need for sensor installation, and low intrusiveness to the process. Successful examples of the utilization of this architecture in a laboratory environment are briefly described. As a Conclusion, it is shown that a wide range of monitoring solutions can be implemented in production processes using the proposed architecture.

Desenvolvimento de Ferramentas para Pesquisas em Tecnologias Assistivas Baseadas em Sinais Biológicos

Novas ferramentas de Tecnologias Assistivas (TAs) têm aparecido ultimamente. Um exemplo são os Ambientes Virtuais (AVs), os quais são importantes para o desenvolvimento de novas TAs, que podem ser direcionadas para promoverem uma melhor qualidade de vida de pessoas com mobilidade reduzida permanente ou promover a reabilitação de pessoas com deficiência motora temporária. Outras ferramentas, que surgiram há algumas décadas com o desenvolvimento dos computadores, também ajudam no tratamento de pessoas com deficiência motora, que são as Interfaces Humano-Máquina (IHM). Utilizando em conjunto com equipamentos que capturam sinais biológicos, como equipamentos de Eletromiografia (EMG) e Eletroencefalografia (EEG), essas ferramentas se configuram como canais de comunicações entre o ser humano e os computadores, diferentemente das comumente utilizadas. Isso abre uma gama de possibilidades para sua utilização no tratamento e na assistência de pessoas com deficiência motora, onde sinais EMG podem ser utilizados para controlar próteses robóticas; e sinais EEG, quando capturados da região do córtex motor, podem ser utilizados em neuroreabilitação. Por outro lado, quando capturados na região occipital, os sinais de EEG podem ser utilizados para gerar comandos e outras finalidades. Este trabalho apresenta o desenvolvimento de novas ferramentas para auxiliar em pesquisas de TAs envolvendo sinais biológicos. Três diferentes AVs foram desenvolvidos para auxiliar nesse tipo de pesquisa. Além deles, um equipamento EEG comercial foi adaptado para ser utilizado com uma IHM, o qual utiliza dois desses três AVs desenvolvidos. Como resultados, temos a utilização bem sucedida do equipamento EEG obtido com sua utilização com SSVEP e Imaginação motora, além da implementação com sucesso dos três AVs desenvolvidos, que estão disponíveis para download gratuito, e que podem ser utilizados em demais pesquisas envolvendo TAs.

Intelligent SCADA for load control

A supervisory control and data acquisition (SCADA) system is an integrated platform that incorporates several components and it has been applied in the field of power systems and several engineering applications to monitor, operate and control a lot of processes. In the future electrical networks, SCADA systems are essential for an intelligent management of resources like distributed generation and demand response, implemented in the smart grid context. This paper presents a SCADA system for a typical residential house. The application is implemented on MOVICON™11 software. The main objective is to manage the residential consumption, reducing or curtailing loads to keep the power consumption in or below a specified setpoint, imposed by the costumer and the generation availability.

Desenvolvimento do sistema de protecção, monitorização e gestão de baterias de iões de lítio do tipo LiFePO4 para aplicação em veículos eléctricos

A mobilidade é considerada um dos factores chave na sustentabilidade e desenvolvimento de qualquer economia. Em Portugal essa realidade não é diferente. Em 2011 verifica-se que 41% do consumo global de combustíveis pertence ao sector rodoviário [1] o que evidencia a sua relevância na economia do país. No que concerne aos veículos de tracção eléctrica, começaram a surgir nos finais do séc. XIX, e no início do séc. XX nos Estados Unidos da América representavam 38% dos veículos [2]. Diversos factores económicos e tecnológicos conduziram a um crescente desinteresse por parte da indústria em investir na produção deste tipo de veículos. Contudo com a introdução de baterias de iões de lítio em veículos de tracção eléctrica, torna-os viáveis e competitivos. Neste trabalho é proposto o desenvolvimento de um sistema de gestão de baterias de iões de lítio do tipo LiFePO4 para aplicação em veículos eléctricos. O sistema deverá assegurar a protecção das baterias e indicar o estado de carga das mesmas. Este sistema permitirá uma optimização no uso deste género de baterias, proporcionará uma melhor utilização, aumentando a sua vida útil. O sistema irá ser aplicado e testado experimentalmente no veículo eléctrico ecológico (Veeco). No âmbito do projecto Veeco foi projectado e construído um banco de ensaios utilizado na análise do comportamento das baterias, e determinar quais os requisitos necessários para o sistema de gestão desenvolvido. Foi também projectado e realizado um sistema de aquisição e processamento de dados que permite obter informações acerca da bateria, dados que estarão disponíveis no interface Homem-máquina do Veeco.

Estudo e implementação piloto de um sistema SCADA na Swedwood Portugal

A realização desta Tese/Dissertação tem como objectivo o estudo e implementação piloto de um Sistema de Supervisão e Aquisição de dados (SCADA) na Swedwood Portugal, na qual exerço as funções de Engenheiro de Processo nas linhas de montagem de mobiliário. Foi efectuado um estudo das necessidades da empresa relativamente às melhorias dos processos das linhas de montagem, com o intuito de melhorar a montagem do semi-produto, a nível de qualidade das matérias-primas, operação e desempenho de equipamentos. Chegou-se à conclusão que existe uma grande necessidade de controlar a qualidade das matérias-primas utilizadas na construção do semi-produto em tempo real, de modo a que seja possível diminuir a complexidade na recolha atempada de amostras por parte dos elementos de operação e diminuir o atraso da entrega de resultados das amostras por parte do laboratório. A colagem é um elemento crítico na montagem do semi-produto, devido às variações de viscosidade da cola, consequência das variações climatéricas a que foi sujeita, desde a saída do fornecedor até à sua utilização nas linhas de montagem. Para tal concebeu-se uma solução para dar uma resposta mais rápida no controlo de qualidade da cola à base de acetato de polivinil (PVAC), ou seja, a implementação piloto de um sistema SCADA na sala de colas, de modo a que haja um controlo a nível de temperatura e humidade, controlo de viscosidade em tempo real e controlo do nível da cola na cuba, fazendo com que haja só uma supervisão por parte dos elementos de operação. Optou-se por um conjunto de hardware e software da SIMATIC desenvolvido pela Siemens, para elaboração da programação e desenvolvimento da Interface Homem Máquina (HMI).

Evaluation of distinct input methods of an intelligent wheelchair in simulated and real environments: a performance and usability study

This paper focuses on evaluating the usability of an Intelligent Wheelchair (IW) in both real and simulated environments. The wheelchair is controlled at a high-level by a flexible multimodal interface, using voice commands, facial expressions, head movements and joystick as its main inputs. A Quasi-experimental design was applied including a deterministic sample with a questionnaire that enabled to apply the System Usability Scale. The subjects were divided in two independent samples: 46 individuals performing the experiment with an Intelligent Wheelchair in a simulated environment (28 using different commands in a sequential way and 18 with the liberty to choose the command); 12 individuals performing the experiment with a real IW. The main conclusion achieved by this study is that the usability of the Intelligent Wheelchair in a real environment is higher than in the simulated environment. However there were not statistical evidences to affirm that there are differences between the real and simulated wheelchairs in terms of safety and control. Also, most of users considered the multimodal way of driving the wheelchair very practical and satisfactory. Thus, it may be concluded that the multimodal interfaces enables very easy and safe control of the IW both in simulated and real environments.

Automatización máquina colado

Mitjançant el presentprojecte es pretén donar solució a la monitorització,control i automatitzaciód'unamàquina de colat.S'englobadins de la brancad'automàtica i control de processos.En ell a partir d'una estructura de la màquinaja definida i un cicle detreballrequeritpelclient es trienelselements per complirambaquest cicle,incorporant les mesures de seguretatnecessàries per minimitzarels riscos.Per a l'automatització del procés, s'hamuntat un PLC marca Telemecaniqueen un armari de control, acompanyat per les cartesd'entrades isortidesrequerides per a poder controlar totes les variables del procés.Per al monitoratge i control del procés, per part de l'operari, s'hainstal.laten l'armari de control un panell HMI "human machine Interface"acompanyatd'unpanell de comandament.En la pròpiamemòria es dónaexplicació al funcionament del programa delPLC i les pantalles de la consola HMI.En elsannexos es detalla tot elconnexionatrealitzatdelsdiferentselementsesmentats, el programa dissenyatper al PLC i el pressuposteconòmic.

A distributed environment for virtual and/or real experiments for underwater robots

This paper presents the distributed environment for virtual and/or real experiments for underwater robots (DEVRE). This environment is composed of a set of processes running on a local area network composed of three sites: 1) the onboard AUV computer; 2) a surface computer used as human-machine interface (HMI); and 3) a computer used for simulating the vehicle dynamics and representing the virtual world. The HMI can be transparently linked to the real sensors and actuators dealing with a real mission. It can also be linked with virtual sensors and virtual actuators, dealing with a virtual mission. The aim of DEVRE is to assist engineers during the software development and testing in the lab prior to real experiments

Reaaliaikaisen tiedonsiirtolinkin muodostaminen prosessisäädön simulointi- ja valvomo-ohjelmiston välille

Teollisuusautomaatiossa käytetään varta vasten automaatiosovelluksiin tarkoitettuja tietokoneita eli ohjelmoitavia logiikoita (PLC, Programmable Logic Control). Ohjelmoitavan logiikan ja käyttäjän välillä on hyvin useasti jonkin asteinen käyttöliittymä (HMI, Human-Machine Interface). Käyttöliittymä voidaan toteuttaa logiikkaan liitettävien näyttöpäätteiden tai PC-pohjaisten valvomo-ohjelmien avulla. Käyttöliittymän kautta käyttäjä voi valvoa ja ohjata automaatiojärjestelmää. Tämän kandidaatintyön aiheena on reaaliajassa toimivan tiedonsiirtolinkin luominen prosessisäädön simulointiohjelmiston ja valvomo-ohjelmiston välille. Prosessiasäätöä simuloidaan MATLAB:in Simulink-ohjelmistolla ja käyttöliittymä luodaan InTouch valvomo-ohjelmistolla. Simuloitavana prosessina toimii nelitankkiprosessi, jossa kahden tankin pinnankorkeutta säädetään kahdella pumpulla. Prosessista tekee erittäin mielenkiintoisen se, että prosessilla on kolmitieventtiilien asennoista riippuen kaksi eri toimintapistettä: minimivaiheinen ja ei-minimivaiheinen. Myös tankkien ristiinkytköksien johdosta prosessi on normaalia tankkiprosessia mielenkiintoisempi. Tiedonsiirtolinkin muodostaminen prosessisäädön simuloinnin sekä valvomo-ohjelmiston välille mahdollistaa lukuisia erilaisia käyttötarkoituksia. Varsinkin opetuskäytössä tämä on erittäin käyttökelpoinen, koska se ei vaadi todellisen prosessin eikä laitteistojen läsnäoloa. Sen avulla voidaan opettaa valvomo-ohjelmien luomista sekä niiden käyttöä. Myös prosessisäätöä voidaan opettaa erittäin havainnollisesti.

Evaluation of Auditory Displays Supporting Aircraft Approach and Landing

Abstract: The paper describes an auditory interface using directional sound as a possible support for pilots during approach in an instrument landing scenario. Several ways of producing directional sounds are illustrated. One using speaker pairs and controlling power distribution between speakers is evaluated experimentally. Results show, that power alone is insufficient for positioning single isolated sound events, although discrimination in the horizontal plane performs better than in the vertical. Additional sound parameters to compensate for this are proposed.

An Experimental Multimedia Process Control Room

The centralised control rooms of large industrial plants have separated people from the processes they should control. Perception is restricted mainly to the visual sense. Only telephone or radio links provide narrow-band voice communication with maintenance personnel down in the plant. Multimedia equipment can perceptionally bring back the operator into the plant while bodily keeping him the comfortable and safe control room. This involves video and audio transmission from process components as well as sights and sounds artificially generated from measurements. Groupware systems support inter-action between operators, engineers, and managers in different plants. With support from the German government, the state of Hessen, and industrial companies the Laboratory for Systems Engineering and Human-Machine Systems at the University of Kassel establishes an Experimental Multimedia Process Control Room. Core of this set-up are two high-performance graphics workstations linked to one of several process or vehicle simulators. Multimedia periphery includes video and teleconferencing equipment and a vibration and sound generation system.

The DIADEM Software Development Methodology extended to Multimedia Interfaces

DIADEM, created by THOMSON-CSF, is a methodology for specifying and developing user interfaces. It improves productivity of the interface development process as well as quality of the interface. The method provides support to user interface development in three aspects. (1) DIADEM defines roles of people involved and their tasks and organises the sequence of activities. (2) It provides graphical formalisms supporting information exchange between people. (3) It offers a basic set of rules for optimum human-machine interfaces. The use of DIADEM in three areas (process control, sales support, and multimedia presentation) was observed and evaluated by our laboratory in the European project DIAMANTA (ESPRIT P20507). The method provides an open procedure that leaves room for adaptation to a specific application and environment. This paper gives an overview of DIADEM and shows how to extend formalisms for developing multimedia interfaces.

A distributed environment for virtual and/or real experiments for underwater robots

This paper presents the distributed environment for virtual and/or real experiments for underwater robots (DEVRE). This environment is composed of a set of processes running on a local area network composed of three sites: 1) the onboard AUV computer; 2) a surface computer used as human-machine interface (HMI); and 3) a computer used for simulating the vehicle dynamics and representing the virtual world. The HMI can be transparently linked to the real sensors and actuators dealing with a real mission. It can also be linked with virtual sensors and virtual actuators, dealing with a virtual mission. The aim of DEVRE is to assist engineers during the software development and testing in the lab prior to real experiments