Novel approach for region merging and image segmentation for human-computer interaction

For the purpose of human-computer interaction (HCI), a vision-based gesture segmentation approach is proposed. The technique essentially includes skin color detection and gesture segmentation. The skin color detection employs a skin-color artificial neural network (ANN). To merge and segment the region of interest, we propose a novel mountain algorithm. The details of the approach and experiment results are provided. The experimental segmentation accuracy is 96.25%. (C) 2003 Society of Photo-Optical Instrumentation Engineers.

basic research in computer science and software engineering at sklcs

The State Key Laboratory of Computer Science (SKLCS) is committed to basic research in computer science and software engineering. The research topics of the laboratory include: concurrency theory, theory and algorithms for real-time systems, formal specifications based on context-free grammars, semantics of programming languages, model checking, automated reasoning, logic programming, software testing, software process improvement, middleware technology, parallel algorithms and parallel software, computer graphics and human-computer interaction. This paper describes these topics in some detail and summarizes some results obtained in recent years.

使用概率规则文法评估人机界面可用性

提出一种在界面系统设计规约的基础上使用的可用性评估方法.首先使用有限状态自动机抽象界面系统设计,根据概率规则文法对有限状态自动机的状态转换概率进行预测;然后结合用户的熟练程度提出了界面可用性评估算法;最后讨论了一个手机界面的可用性计算实例.文中方法能够在界面系统生命周期的早期使用,以较早地对不同设计方案进行比较,降低开发风险.

虚拟现实人机交互的eGOMS模型研究

采用心理学和计算机技术相交叉的研究方法,对人机交互中人的认知过程的人类视知觉特征和心理加工机制与特点等进行了细致的探讨;结合虚拟环境中人机交互过程的不确定性、连续性和实时反馈性以及交互可用性评价指标的多样性等特点,提出了适用于虚拟现实人机交互的扩展GOMS(eGOMS)模型,克服了传统GOMS模型要求精确的用户操作、交互界面与实际应用相分离及评价指标单一的不足.以eGOMS模型为基础对PIBG交互范式进行了评估,PIBG为VR用户界面提供自然、隐式交互的手段,从而大大降低了用户在虚拟环境下交互的认知负荷.

自然交互研究——笔式简谱编辑器的设计与实现

自然交互是指用户可以用自己熟悉的日常技能与计算机进行交互。中国有大量的音乐爱好者使用简谱,但是针对简谱编辑的编辑软件却相对较少,并且现有软件的交互方式不够自然,降低了用户对软件的使用效率。他们需要一种更自然、更方便使用的简谱编辑软件。该文介绍了一个基于笔式输入的简谱编辑器原型系统的设计和实现。基于对现有软件、简谱特性和可利用的新技术的综合分析,设计并实现了这个原型系统。对此原型系统进行了非正式的用户实验之后,对结果进行了分析,并提出了修改的方案。

construction of feature-matching perception in virtual assembly

An important characteristic of virtual assembly is interaction. Traditional di-rect manipulation in virtual assembly relies on dynamic collision detection, which is very time-consuming and even impossible in desktop virtual assembly environment. Feature-matching isa critical process in harmonious virtual assembly, and is the premise of assembly constraint sens-ing. This paper puts forward an active object-based feature-matching perception mechanism and afeature-matching interactive computing process, both of which make the direct manipulation in vir-tual assembly break away from collision detection. They also help to enhance virtual environmentunderstandability of user intention and promote interaction performance. Experimental resultsshow that this perception mechanism can ensure that users achieve real-time direct manipulationin desktop virtual environment.

Color to Gray: Visual Cue Preservation

Both commercial and scientific applications often need to transform color images into gray-scale images, e. g., to reduce the publication cost in printing color images or to help color blind people see visual cues of color images. However, conventional color to gray algorithms are not ready for practical applications because they encounter the following problems: 1) Visual cues are not well defined so it is unclear how to preserve important cues in the transformed gray-scale images; 2) some algorithms have extremely high time cost for computation; and 3) some require human-computer interactions to have a reasonable transformation. To solve or at least reduce these problems, we propose a new algorithm based on a probabilistic graphical model with the assumption that the image is defined over a Markov random field. Thus, color to gray procedure can be regarded as a labeling process to preserve the newly well-defined visual cues of a color image in the transformed gray-scale image. Visual cues are measurements that can be extracted from a color image by a perceiver. They indicate the state of some properties of the image that the perceiver is interested in perceiving. Different people may perceive different cues from the same color image and three cues are defined in this paper, namely, color spatial consistency, image structure information, and color channel perception priority. We cast color to gray as a visual cue preservation procedure based on a probabilistic graphical model and optimize the model based on an integral minimization problem. We apply the new algorithm to both natural color images and artificial pictures, and demonstrate that the proposed approach outperforms representative conventional algorithms in terms of effectiveness and efficiency. In addition, it requires no human-computer interactions.

Image Ratio Features for Facial Expression Recognition Application

Video-based facial expression recognition is a challenging problem in computer vision and human-computer interaction. To target this problem, texture features have been extracted and widely used, because they can capture image intensity changes raised by skin deformation. However, existing texture features encounter problems with albedo and lighting variations. To solve both problems, we propose a new texture feature called image ratio features. Compared with previously proposed texture features, e. g., high gradient component features, image ratio features are more robust to albedo and lighting variations. In addition, to further improve facial expression recognition accuracy based on image ratio features, we combine image ratio features with facial animation parameters (FAPs), which describe the geometric motions of facial feature points. The performance evaluation is based on the Carnegie Mellon University Cohn-Kanade database, our own database, and the Japanese Female Facial Expression database. Experimental results show that the proposed image ratio feature is more robust to albedo and lighting variations, and the combination of image ratio features and FAPs outperforms each feature alone. In addition, we study asymmetric facial expressions based on our own facial expression database and demonstrate the superior performance of our combined expression recognition system.

A Relay Level Set Method for Automatic Image Segmentation

This paper presents a new image segmentation method that applies an edge-based level set method in a relay fashion. The proposed method segments an image in a series of nested subregions that are automatically created by shrinking the stabilized curves in their previous subregions. The final result is obtained by combining all boundaries detected in these subregions. The proposed method has the following three advantages: 1) It can be automatically executed without human-computer interactions; 2) it applies the edge-based level set method with relay fashion to detect all boundaries; and 3) it automatically obtains a full segmentation without specifying the number of relays in advance. The comparison experiments illustrate that the proposed method performs better than the representative level set methods, and it can obtain similar or better results compared with other popular segmentation algorithms.

基于OMAP的废墟搜救机器人监控终端

针对废墟搜救机器人的实际需要和当前监控终端的不足,设计开发了一种新的监控终端。这种监控终端基于OMAP架构,包含了人机界面、遥控、无线通讯、数据处理等功能,实现了对机器人本体的无线操控,并实现了与指挥中心的远程无线连接。由于在功耗与性能之间取得了平衡,这种监控终端减小了体积,提高了便携性。

排爆作业机器人模拟训练系统研究

介绍了一种排爆机器人模拟训练系统.该系统提供了友好的人机交互界面,使操作人员可以进行各种模拟训练,并提高操作水平.重点介绍了该模拟训练系统的体系结构及关键实现技术,包括排爆机器人及其工作环境的建模方法、机器人运动学和动力学简化模型、碰撞检测和技能评定等.通过实验,证明了该模拟训练系统的可行性和有效性.

Computer simulation of Gd(III) speciation in human interstitial fluid

The speciation and distribution of Gd(III) in human interstitial fluid was studied by computer simulation. The results show that at the background concentration, all the Gd(III) species are soluble and no precipitates appear. However as the total concentration of Gd(III) rises above 2.610 x 10(-9) mol/l the insoluble species become predominant. GdPO4 is formed first as a precipitate and then Gd-2(CO3)(3). Among soluble species, free Gd(III), [Gd(HSA)], [Gd(Ox)] and the ternary complexes of Gd(III) with citrate as the primary ligand are main species when the total concentration of Gd(III) is below 2.074 x 10(-2) mol/l. With the total concentration of Gd(III) further rising, [Gd-3(OH)(4)] begins to appear and gradually becomes a predominant species.

Computer simulation of Zn(II) speciation and effect of Gd(III) on Zn(II) speciation in human blood plasma

The speciation and distribution of Zn(II) and the effect of Gd(III) on Zn(II) speciation in human blood plasma were studied by computer simulation. The results show that, in normal blood plasma, the most predominant species of Zn(II) are [Zn(HSA)] (58.2%), [Zn(IgG)](20.1%), [Zn(Tf)] (10.4%), ternary complexes of [Zn(Cit)(Cys)] (6.6%) and of [Zn(Cys)(His)H] (1.6%), and the binary complex of [Zn(CYS)(2)H] (1.2%). When zinc is deficient, the distribution of Zn(II) species is similar to that in normal blood plasma. Then, the distribution changes with increasing zinc(II) total concentration. Overloading Zn(II) is initially mainly bound to human serum albumin (HSA). As the available amount of HSA is exceeded, phosphate metal and carbonate metal species are established. Gd(III) entering human blood plasma predominantly competes for phosphate and carbonate to form precipitate species. However, Zn(II) complexes with phosphate and carbonate are negligible in normal blood plasma, so Gd(III) only have a little effect on zinc(II) species in human blood plasma at a concentration above 1.0x10(-4) M.

Computer simulation for effect of Pr(III) on Ca(II) speciation in human interstitial fluid

A multiphase model of metal ion speciation in human interstitial fluid was constructed and the effect of Pr(III) on Ca(II) speciation was studied. Results show that free Ca2+, [Ca(HCO3)], and [Ca(Lac)] are the main species of Ca(II). Because of the competition of Pr(III) for ligands with Ca(II), the percentages of free Ca2+, [Ca(Lac)], and [Ca(His)(Thr)H-3] increase gradually and the percentages of CaHPO4(aq) and [Ca(Cit)(His)H-2] decrease gradually with the increase in the total concentration of Pr(III). However, the percentages of [Ca(HCO3)] and CaCO3(aq) first increase and then begin to decrease when the total concentration of Pr(III) exceeds 6.070 x 10(-4) M.