Multimodal Man-machine Interface and Virtual Reality for Assistive Medical Systems

The results of research the intelligence multimodal man-machine interface and virtual reality means for assistive medical systems including computers and mechatronic systems (robots) are discussed. The gesture translation for disability peoples, the learning-by-showing technology and virtual operating room with 3D visualization are presented in this report and were announced at International exhibition "Intelligent and Adaptive Robots–2005".

Innovative Man Machine Interfaces In Aeronautics

The research activity focused on the study, design and evaluation of innovative human-machine interfaces based on virtual three-dimensional environments. It is based on the brain electrical activities recorded in real time through the electrical impulses emitted by the brain waves of the user. The achieved target is to identify and sort in real time the different brain states and adapt the interface and/or stimuli to the corresponding emotional state of the user. The setup of an experimental facility based on an innovative experimental methodology for “man in the loop" simulation was established. It allowed involving during pilot training in virtually simulated flights, both pilot and flight examiner, in order to compare the subjective evaluations of this latter to the objective measurements of the brain activity of the pilot. This was done recording all the relevant information versus a time-line. Different combinations of emotional intensities obtained, led to an evaluation of the current situational awareness of the user. These results have a great implication in the current training methodology of the pilots, and its use could be extended as a tool that can improve the evaluation of a pilot/crew performance in interacting with the aircraft when performing tasks and procedures, especially in critical situations. This research also resulted in the design of an interface that adapts the control of the machine to the situation awareness of the user. The new concept worked on, aimed at improving the efficiency between a user and the interface, and gaining capacity by reducing the user’s workload and hence improving the system overall safety. This innovative research combining emotions measured through electroencephalography resulted in a human-machine interface that would have three aeronautical related applications: • An evaluation tool during the pilot training; • An input for cockpit environment; • An adaptation tool of the cockpit automation.

Design and Development of an In-Vehicle Human Machine Interface to Improve Fuel Efficiency & Safety

Road transport plays a significant role in various industries and mobility services around the globe and has a vital impact on our daily lives. However it also has serious impacts on both public health and the environment. In-vehicle feedback systems are a relatively new approach to encouraging driver behaviour change for improving fuel efficiency and safety in automotive environments. While many studies claim that the adoption of eco-driving practices, such as eco-driving training programs and in-vehicle feedback to drivers, has the potential to improve fuel efficiency, limited research has integrated safety and eco-driving. Therefore, this research seeks to use human factors related theories and practices to inform the design and evaluation of an in-vehicle Human Machine Interface (HMI) providing real-time driver feedback with the aim of improving both fuel efficiency and safety.

Bi-directional human machine interface via direct neural connection

This paper presents an application study into the use of a bi-directional link with the human nervous system by means of an implant, positioned through neurosurgery. Various applications are described including the interaction of neural signals with an articulated hand, a group of cooperative autonomous robots and to control the movement of a mobile platform. The microelectrode array implant itself is described in detail. Consideration is given to a wider range of possible robot mechanisms, which could interact with the human nervous system through the same technique.

A novel human-machine interface using subdermal magnetic implants

This paper explores a novel tactile human-machine interface based on the controlled stimulation of mechanoreceptors by a subdermal magnetic implant manipulated through an external electromagnet. The selection of a suitable implant magnet and implant site is discussed and an external interface for manipulating the implant is described. The paper also reports on the basic properties of such an interface, including magnetic field strength sensitivity and frequency sensitivity obtained through experimentation on two participants. Finally, the paper presents two practical application scenarios for the interface.

Adaptive Control and Multi-agent Interface for Infotelecommunication Systems of New Generation

Problems for intellectualisation for man-machine interface and methods of self-organization for network control in multi-agent infotelecommunication systems have been discussed. Architecture and principles for construction of network and neural agents for telecommunication systems of new generation have been suggested. Methods for adaptive and multi-agent routing for information flows by requests of external agents- users of global telecommunication systems and computer networks have been described.

A Closed Loop Brain-machine Interface for Epilepsy Control Using Dorsal Column Electrical Stimulation

Although electrical neurostimulation has been proposed as an alternative treatment for drug-resistant cases of epilepsy, current procedures such as deep brain stimulation, vagus, and trigeminal nerve stimulation are effective only in a fraction of the patients. Here we demonstrate a closed loop brain-machine interface that delivers electrical stimulation to the dorsal column (DCS) of the spinal cord to suppress epileptic seizures. Rats were implanted with cortical recording microelectrodes and spinal cord stimulating electrodes, and then injected with pentylenetetrazole to induce seizures. Seizures were detected in real time from cortical local field potentials, after which DCS was applied. This method decreased seizure episode frequency by 44% and seizure duration by 38%. We argue that the therapeutic effect of DCS is related to modulation of cortical theta waves, and propose that this closed-loop interface has the potential to become an effective and semi-invasive treatment for refractory epilepsy and other neurological disorders.

柔性加工系统中激光参量的数值化控制及界面设计

激光柔性加工是近几年兴起的一种先进制造技术，它结合了激光加工与柔性制造的特点，有很好的应用前景。在本论文中，讨论了与之相关的课题研究，其中包括：（1）激光器的稳定控制。包括激光器通讯方式的研究，底层驱动程序（VxD）的特点和开发应用，并给出了相关程序的解释。（2）激光器控制程序的开发。包括程序的设计思想、主要模块的功能和激光参数数值化控制的实现。（3）激光柔性加工系统控制软件的开发。包括软件的设计目标、主要功能、模块构成和软件易用性设计。（4）激光加工工艺试验。研究了主要的模具材料经过激光表面强化后粗糙度、材料组织、硬度以及耐磨性等主要力学性能的改善。薄板打筛孔主要分析了激光打孔的优势所在。

BDI Agent的人机智能结合方法

在网络遥操作中存在着由于操作者的操作负担过重或长时间操作而引起的误操作问题,提出以著名的BDIAgent模型为基础,通过引入中断机制,将反映操作者智能决策的操作目标、操作意图与BDIAgent推理产生的目标、意图进行结合的方法,为解决Agent智能的局限性和操作者的误操作问题,提供了一种人机接口方法,实现了人机智能结合.给出了中断的引入方法和操作者操作目标、操作意图中断响应原理,用形式化模型描述了人机智能决策选取目标和意图的过程.该人机智能结合方法在网络遥操作RoboCup中型足球机器人系统中得到了应用.

智能机器人分层系统中的人机交互

在非结构环境里工作的智能机器人,人智能的介入有时是必不可少的.本文研究了这类机器人系统人机接口某些问题,提出了人智能输入的分层输入原则,实时性原则和协调性原则,讨论了人机接口的结构和实现问题,给出了人机接口命令的一种格式,并提出了人机操作的实际例子.