Smart object for 3D interaction

This paper reports on the creation of an interface for 3D virtual environments, computer-aided design applications or computer games. Standard computer interfaces are bound to 2D surfaces, e.g., computer mouses, keyboards, touch pads or touch screens. The Smart Object is intended to provide the user with a 3D interface by using sensors that register movement (inertial measurement unit), touch (touch screen) and voice (microphone). The design and development process as well as the tests and results are presented in this paper. The Smart Object was developed by a team of four third-year engineering students from diverse scientific backgrounds and nationalities during one semester.

Using Agents for Mining Maintenance Data while interacting in 3D Objectoriented Virtual Environments

This report demonstrates the development of: (a) object-oriented representation to provide 3D interactive environment using data provided by Woods Bagot; (b) establishing basis of agent technology for mining building maintenance data, and (C) 3D interaction in virtual environments using object-oriented representation. Applying data mining over industry maintenance database has been demonstrated in the previous report.

co-creativepen toolkit: a pen-based 3d toolkit for children cooperatly designing virtual environment

Co-CreativePen Toolkit is a pen-based 3D toolkit for children cooperatly designing virtual environment. This toolkit is used to construct different applications involved with distributedpen-based 3D interaction. In this toolkit,sketch method is encapsulated as kinds of interaction techniques. Children can use pen to construct 3D and IBR objects, to navigate in the virtual world, to select and manipulate virtual objects, and to communicate with other children. Children can use pen to select other children in the virtual world, and use pen to write message to children selected The distributed architecture of Co-CreativePen Toolkit is based on the CORBA. A common scene graph is managed in the server with several copies of this graph are managed in every client.Every changes of the scene graph in client will cause the change in the server and other client.

基于场景语义的3D交互体系结构

借鉴真实世界的认知心理学原理,将虚拟场景的可视表达和语义信息结合起来共同服务于用户的交互过程,多种3D交互技术被融合在一个统一的交互框架内,使复杂虚拟环境中的3D用户界面更容易被用户理解和使用.通过增强场景图的语义处理能力,建立支持高层语义的3D用户界面体系结构,3D交互系统不仅在几何层上而且还能在语义层上支持交互任务的执行.最后介绍了一个应用实例.

Recorte volumétrico usando técnicas de interação 2D e 3D

A visualização de conjuntos de dados volumétricos é comum em diversas áreas de aplicação e há já alguns anos os diversos aspectos envolvidos nessas técnicas vêm sendo pesquisados. No entanto, apesar dos avanços das técnicas de visualização de volumes, a interação com grandes volumes de dados ainda apresenta desafios devido a questões de percepção (ou isolamento) de estruturas internas e desempenho computacional. O suporte do hardware gráfico para visualização baseada em texturas permite o desenvolvimento de técnicas eficientes de rendering que podem ser combinadas com ferramentas de recorte interativas para possibilitar a inspeção de conjuntos de dados tridimensionais. Muitos estudos abordam a otimização do desempenho de ferramentas de recorte, mas muito poucos tratam das metáforas de interação utilizadas por essas ferramentas. O objetivo deste trabalho é desenvolver ferramentas interativas, intuitivas e fáceis de usar para o recorte de imagens volumétricas. Inicialmente, é apresentado um estudo sobre as principais técnicas de visualização direta de volumes e como é feita a exploração desses volumes utilizando-se recorte volumétrico. Nesse estudo é identificada a solução que melhor se enquadra no presente trabalho para garantir a interatividade necessária. Após, são apresentadas diversas técnicas de interação existentes, suas metáforas e taxonomias, para determinar as possíveis técnicas de interação mais fáceis de serem utilizadas por ferramentas de recorte. A partir desse embasamento, este trabalho apresenta o desenvolvimento de três ferramentas de recorte genéricas implementadas usando-se duas metáforas de interação distintas que são freqüentemente utilizadas por usuários de aplicativos 3D: apontador virtual e mão virtual. A taxa de interação dessas ferramentas é obtida através de programas de fragmentos especiais executados diretamente no hardware gráfico. Estes programas especificam regiões dentro do volume a serem descartadas durante o rendering, com base em predicados geométricos. Primeiramente, o desempenho, precisão e preferência (por parte dos usuários) das ferramentas de recorte volumétrico são avaliados para comparar as metáforas de interação empregadas. Após, é avaliada a interação utilizando-se diferentes dispositivos de entrada para a manipulação do volume e ferramentas. A utilização das duas mãos ao mesmo tempo para essa manipulação também é testada. Os resultados destes experimentos de avaliação são apresentados e discutidos.

Interação com objetos digitais 3D em estúdios virtuais

Pós-graduação em Televisão Digital: Informação e Conhecimento - FAAC

Comparison of 2D and 3D GUI Widgets for Stereoscopic Multitouch Setups

Recent developments in the area of interactive entertainment have suggested to combine stereoscopic visualization with multi-touch displays, which has the potential to open up new vistas for natural interaction with interactive three-dimensional (3D) applications. However, the question arises how the user interfaces for system control in such 3D setups should be designed in order to provide an effective user experience. In this article we introduce 3D GUI widgets for interaction with stereoscopic touch displays. The design of the widgets was inspired to skeuomorphism and affordances in such a way that the user should be able to operate the virtual objects in the same way as their real-world equivalents. We evaluate the developed widgets and compared them with their 2D counterparts in the scope of an example application in order to analyze the usability of and user behavior with the widgets. The results reveal differences in user behavior with and without stereoscopic display during touch interaction, and show that the developed 2D as well as 3D GUI widgets can be used effectively in different applications.

Influence of Comfort on 3D Selection Task Performance in Immersive Desktop Setups

Immersive virtual environments (IVEs) have the potential to afford natural interaction in the three-dimensional (3D) space around a user. However, interaction performance in 3D mid-air is often reduced and depends on a variety of ergonomics factors, the user's endurance, muscular strength, as well as fitness. In particular, in contrast to traditional desktop-based setups, users often cannot rest their arms in a comfortable pose during the interaction. In this article we analyze the impact of comfort on 3D selection tasks in an immersive desktop setup. First, in a pre-study we identified how comfortable or uncomfortable specific interaction positions and poses are for users who are standing upright. Then, we investigated differences in 3D selection task performance when users interact with their hands in a comfortable or uncomfortable body pose, while sitting on a chair in front of a table while the VE was displayed on a headmounted display (HMD). We conducted a Fitts' Law experiment to evaluate selection performance in different poses. The results suggest that users achieve a significantly higher performance in a comfortable pose when they rest their elbow on the table.

Human protein Sam68 relocalization and interaction with poliovirus RNA polymerase in infected cells.

A HeLa cDNA expression library was screened for human polypeptides that interacted with the poliovirus RNA-dependent RNA polymerase, 3D, using the two-hybrid system in the yeast Saccharomyces cerevisiae. Sam68 (Src-associated in mitosis, 68 kDa) emerged as the human cDNA that, when fused to a transcriptional activation domain, gave the strongest 3D interaction signal with a LexA-3D hybrid protein. 3D polymerase and Sam68 coimmunoprecipitated from infected human cell lysates with antibodies that recognized either protein. Upon poliovirus infection, Sam68 relocalized from the nucleus to the cytoplasm, where poliovirus replication occurs. Sam68 was isolated from infected cell lysates with an antibody that recognizes poliovirus protein 2C, suggesting that it is found on poliovirus-induced membranes upon which viral RNA synthesis occurs. These data, in combination with the known RNA- and protein-binding properties of Sam68, make Sam68 a strong candidate for a host protein with a functional role in poliovirus replication.

RGBD Human-Hand recognition for the Interaction with Robot-Hand

New low cost sensors and the new open free libraries for 3D image processing are permitting to achieve important advances for robot vision applications such as tridimensional object recognition, semantic mapping, navigation and localization of robots, human detection and/or gesture recognition for human-machine interaction. In this paper, a method to recognize the human hand and to track the fingers is proposed. This new method is based on point clouds from range images, RGBD. It does not require visual marks, camera calibration, environment knowledge and complex expensive acquisition systems. Furthermore, this method has been implemented to create a human interface in order to move a robot hand. The human hand is recognized and the movement of the fingers is analyzed. Afterwards, it is imitated from a Barret hand, using communication events programmed from ROS.

虚拟环境下基于语义的三维交互技术

自然、高效的三维交互技术是虚拟现实系统成功应用的关键．现有的交互技术主要是从几何层次上考虑如何有效实现交互任务，而对面向高层应用的交互任务的支持还不够．借鉴人类在真实世界中的认知原理，虚拟环境中的交互对象不仅具有外观意义上的几何属性，而且包含了与交互有关的规则、约束和供给等语义属性，这些虚拟对象称为语义对象．在系统导航、对象选择／操作等交互任务的执行中，通过语义对象可以实现高层交互语义的封装和解析．从应用角度提高交互技术的效率和可用性，为用户提供“直接操纵”之上的面向高层语义的交互隐喻．屏蔽交互技术的底层实现细节，使用户专注于应用领域相关的高层交互控制。

面向虚拟装配的三维交互平台

针对当前装配领域的特点 ,提出一个面向虚拟装配的三维交互平台 (Virtual Assem bly Toolkit,VAT) .VAT中包含了新的三维交互思想 ,定义了装配领域中常用的三维交互原语 ,设计和实现了交互原语的捕获、解释和处理框架 .同时 ,VAT封装了三维图形构造、零件间的约束和碰撞检测等功能 .VAT可以大大简化虚拟装配应用的构造 ,便于应用的快速生成

Redefinición de las TIC en el museo: del discurso invasivo al inclusivo

Las TIC son inseparables de la museografía in situ e imprescindibles en la museografía en red fija y móvil. En demasiados casos se han instalado prótesis tecnológicas para barnizar de modernidad el espacio cultural, olvidando que la tecnología debe estar al servicio de los contenidos de manera que resulte invisible y perfectamente imbricada con la museografía tradicional. Las interfaces móviles pueden fusionar museo in situ y en red y acompañar a las personas más allá del espacio físico. Esa fusión debe partir de una base de datos narrativa y abierta a obras materiales e inmateriales de otros museos de manera que no se trasladen las limitaciones del museo físico al virtual. En el museo in situ tienen sentido las instalaciones hipermedia inmersivas que faciliten experiencias culturales innovadoras. La interactividad (relaciones virtuales) debe convivir con la interacción (relaciones físicas y personales) y estar al servicio de todas las personas, partiendo de que todas, todos tenemos limitaciones. Trabajar interdisciplinarmente ayuda a comprender mejor el museo para ponerlo al servicio de las personas.

Calculation of Coulomb interaction strengths for 3d transition metals and actinides

Coulomb interaction strengths (Udd and Uff) have been calculated from Hartree-Fock-Slater atomic calculations for 3d transition and 5f actinide elements, respectively. By decomposing the different contributions to the response (screening) to the 3d charge fluctuation, we show that a substantial reduction in Udd arises due to the relaxation of the 3d charge distribution itself. This, combined with the screening due to the response of the 4s charge density, is shown to provide a very compact screening charge comparable to the metallic case, explaining the success of the atomic calculations for estimating U even in the metals. A pronounced dependence of Udd (or Uff) on the number of electrons nd (nf) or the electronic configuration is also shown here.

Evidence for 3D isotropic long range spin-spin interaction near the ferromagnetic transition in bulk and thin film SrRuO3

In the case of metallic ferromagnets there has always been a controversy, i.e. whether the magnetic interaction is itinerant or localized. For example SrRuO3 is known to be an itinerant ferromagnet where the spin-spin interaction is expected to be mean field in nature. However, it is reported to behave like Ising, Heisenberg or mean field by different groups. Despite several theoretical and experimental studies and the importance of strongly correlated systems, the experimental conclusion regarding the type of spin-spin interaction in SrRuO3 is lacking. To resolve this issue, we have investigated the critical behaviour in the vicinity of the paramagnetic-ferromagnetic phase transition using various techniques on polycrystalline as well as (001) oriented SrRuO3 films. Our analysis reveals that the application of a scaling law in the field-cooled magnetization data extracts the value of the critical exponent only when it is measured at H -> 0. To substantiate the actual nature without any ambiguity, the critical behavior is studied across the phase transition using the modified Arrott plot, Kouvel-Fisher plot and M-H isotherms. The critical analysis yields self-consistent beta, gamma and delta values and the spin interaction follows the long-range mean field model. Further the directional dependence of the critical exponent is studied in thin films and it reveals the isotropic nature. It is elucidated that the different experimental protocols followed by different groups are the reason for the ambiguity in determining the critical exponents in SrRuO3.