Novel approach for region merging and image segmentation for human-computer interaction

For the purpose of human-computer interaction (HCI), a vision-based gesture segmentation approach is proposed. The technique essentially includes skin color detection and gesture segmentation. The skin color detection employs a skin-color artificial neural network (ANN). To merge and segment the region of interest, we propose a novel mountain algorithm. The details of the approach and experiment results are provided. The experimental segmentation accuracy is 96.25%. (C) 2003 Society of Photo-Optical Instrumentation Engineers.

basic research in computer science and software engineering at sklcs

The State Key Laboratory of Computer Science (SKLCS) is committed to basic research in computer science and software engineering. The research topics of the laboratory include: concurrency theory, theory and algorithms for real-time systems, formal specifications based on context-free grammars, semantics of programming languages, model checking, automated reasoning, logic programming, software testing, software process improvement, middleware technology, parallel algorithms and parallel software, computer graphics and human-computer interaction. This paper describes these topics in some detail and summarizes some results obtained in recent years.

虚拟现实人机交互的eGOMS模型研究

采用心理学和计算机技术相交叉的研究方法,对人机交互中人的认知过程的人类视知觉特征和心理加工机制与特点等进行了细致的探讨;结合虚拟环境中人机交互过程的不确定性、连续性和实时反馈性以及交互可用性评价指标的多样性等特点,提出了适用于虚拟现实人机交互的扩展GOMS(eGOMS)模型,克服了传统GOMS模型要求精确的用户操作、交互界面与实际应用相分离及评价指标单一的不足.以eGOMS模型为基础对PIBG交互范式进行了评估,PIBG为VR用户界面提供自然、隐式交互的手段,从而大大降低了用户在虚拟环境下交互的认知负荷.

construction of feature-matching perception in virtual assembly

An important characteristic of virtual assembly is interaction. Traditional di-rect manipulation in virtual assembly relies on dynamic collision detection, which is very time-consuming and even impossible in desktop virtual assembly environment. Feature-matching isa critical process in harmonious virtual assembly, and is the premise of assembly constraint sens-ing. This paper puts forward an active object-based feature-matching perception mechanism and afeature-matching interactive computing process, both of which make the direct manipulation in vir-tual assembly break away from collision detection. They also help to enhance virtual environmentunderstandability of user intention and promote interaction performance. Experimental resultsshow that this perception mechanism can ensure that users achieve real-time direct manipulationin desktop virtual environment.

Image Ratio Features for Facial Expression Recognition Application

Video-based facial expression recognition is a challenging problem in computer vision and human-computer interaction. To target this problem, texture features have been extracted and widely used, because they can capture image intensity changes raised by skin deformation. However, existing texture features encounter problems with albedo and lighting variations. To solve both problems, we propose a new texture feature called image ratio features. Compared with previously proposed texture features, e. g., high gradient component features, image ratio features are more robust to albedo and lighting variations. In addition, to further improve facial expression recognition accuracy based on image ratio features, we combine image ratio features with facial animation parameters (FAPs), which describe the geometric motions of facial feature points. The performance evaluation is based on the Carnegie Mellon University Cohn-Kanade database, our own database, and the Japanese Female Facial Expression database. Experimental results show that the proposed image ratio feature is more robust to albedo and lighting variations, and the combination of image ratio features and FAPs outperforms each feature alone. In addition, we study asymmetric facial expressions based on our own facial expression database and demonstrate the superior performance of our combined expression recognition system.

Computer simulation on the collision-sticking dynamics of two colloidal particles in an optical trap

Collisions of a particle pair induced by optical tweezers have been employed to study colloidal stability. In order to deepen insights regarding the collision-sticking dynamics of a particle pair in the optical trap that were observed in experimental approaches at the particle level, the authors carry out a Brownian dynamics simulation. In the simulation, various contributing factors, including the Derjaguin-Landau-Verwey-Overbeek interaction of particles, hydrodynamic interactions, optical trapping forces on the two particles, and the Brownian motion, were all taken into account. The simulation reproduces the tendencies of the accumulated sticking probability during the trapping duration for the trapped particle pair described in our previous study and provides an explanation for why the two entangled particles in the trap experience two different statuses. (c) 2007 American Institute of Physics.

Molecular dynamics simulation of interaction of a dislocation array from a crack tip with grain boundaries

The interaction of a dislocation array emitted from a crack tip under mode II loading with asymmetric tilt grain boundaries (GBs) is analysed by the molecular dynamics method. The GBs can generally be described by planar and linear matching zones and unmatching zones. All GBs are observed to emit dislocations. The GBs migrated easily due to their planar and linear matching structure and asymmetrical type. The diffusion induced by stress concentration is found to promote the GB migration. The transmissions of dislocations are either along the matched plane or along another plane depending on tilt angle theta. Alternate processes of stress concentration and stress relaxation take place ahead of the pileup. The stress concentration can be released either by transmission of dislocations, by atom diffusion along GBs, or by migration of GBs by formation of twinning bands. The simulated results also unequivocally demonstrate two processes, i.e. asymmetrical GBs evolving into symmetrical ones and unmatching zones evolving into matching ones during the loading process.

Dynamic interaction of an elastic container with fluid

The vibration analysis of an elastic container with partially filled fluid was investigated in this paper. The container is made of a thin cylinder and two circular plates at the ends. The axis of the cylinder is in the horizontal direction. It is difficult to solve this problem because the complex system is not axially symmetric. The equations of motion for this system were derived. An incompressible and ideal fluid model is used in the present work. Solutions of the equations were obtained by the generalized variational method. The solution was expressed in a series of normalized generalized Fourier's functions. This series converged rapidly, and so its approximate solution was obtained with high precision. The agreement of the calculated values with the experimental result is good. It should be mentioned that with our method, the computer time is less than that with the finite-element method.

Visualization of molecule interaction between antigen and antibody - One of ellipsometric imaging applications

It is to investigate molecule interactions between antigen and antibody with ellipsometric imaging technique and demonstrate some features and possibilities offered by applications of the technique. Molecule interaction is an important interest for molecule biologist and immunologist. They have used some established methods such as immufluorcence, radioimmunoassay and surface plasma resonance, etc, to study the molecule interaction. At the same time, experimentalists hope to use some updated technique with more direct visual results. Ellipsometric imaging is non-destructive and exhibits a high sensitivity to phase transitions with thin layers. It is capable of imaging local variations in the optical properties such as thickness due to the presence of different surface concentration of molecule or different deposited molecules. If a molecular mono-layer (such as antigen) with bio-activity were deposited on a surface to form a sensing surface and then incubated in a solution with other molecules (such as antibody), a variation of the layer thickness when the molecules on the sensing surface reacted with the others in the solution could be observed with ellipsometric imaging. Every point on the surface was measured at the same time with a high sensitivity to distinguish the variation between mono-layer and molecular complexes. Ellipsometric imaging is based on conventional ellipsometry with charge coupled device (CCD) as detector and images are caught with computer with image processing technique. It has advantages of high sensitivity to thickness variation (resolution in the order of angstrom), big field of view (in square centimeter), high sampling speed (a picture taken within one second), and high lateral resolution (in the order of micrometer). Here it has just shown one application in study of antigen-antibody interaction, and it is possible to observe molecule interaction process with an in-situ technique.

simulation and interaction of fluid dynamics

In the fluid simulation, the fluids and their surroundings may greatly change properties such as shape and temperature simultaneously, and different surroundings would characterize different interactions, which would change the shape and motion of the fluids in different ways. On the other hand, interactions among fluid mixtures of different kinds would generate more comprehensive behavior. To investigate the interaction behavior in physically based simulation of fluids, it is of importance to build physically correct models to represent the varying interactions between fluids and the environments, as well as interactions among the mixtures. In this paper, we will make a simple review of the interactions, and focus on those most interesting to us, and model them with various physical solutions. In particular, more detail will be given on the simulation of miscible and immiscible binary mixtures. In some of the methods, it is advantageous to be taken with the graphics processing unit (GPU) to achieve real-time computation for middle-scale simulation.

Computer simulation of miscibility and self-assembly structure for polymer-containing systems with special interactions

The miscibility and structure of A-B copolymer/C homopolymer blends with special interactions were studied by a Monte Carlo simulation in two dimensions. The interaction between segment A and segment C was repulsive, whereas it was attractive between segment B and segment C. In order to study the effect of copolymer chain structure on the morphology and structure of A-B copolymer/C homopolymer blends, the alternating, random and block A-B copolymers were introduced into the blends, respectively. The simulation results indicated that the miscibility of A-B block copolymer/C homopolymer blends depended on the chain structure of the A-B copolymer. Compared with alternating or random copolymer, the block copolymer, especially the diblock copolymer, could lead to a poor miscibility of A-B copolymer/C homopolymer blends. Moreover, for diblock A-B copolymer/C homopolymer blends, obvious self-organized core-shell structure was observed in the segment B composition region from 20% to 60%. However, if diblock copolymer composition in the blends is less than 40%, obvious self-organized core-shell structure could be formed in the B-segment component region from 10 to 90%. Furthermore, computer statistical analysis for the simulation results showed that the core sizes tended to increase continuously and their distribution became wider with decreasing B-segment component.