Interpercepção: uma arquitetura de software para compartilhamento de ambientes virtuais com interfaces gráficas distintas

In this work, we propose the Interperception paradigm, a new approach that includes a set of rules and a software architecture for merge users from different interfaces in the same virtual environment. The system detects the user resources and provide transformations on the data in order to allow its visualization in 3D, 2D and textual (1D) interfaces. This allows any user to connect, access information, and exchange information with other users in a feasible way, without needs of changing hardware or software. As results are presented two virtual environments builded acording this paradigm

3D semantic models for dental education

This paper explores the benefits of using immersive and interactive virtual reality environments to teach Dentistry. We present a tool for educators to manipulate and edit virtual models. One of the main contributions is that multimedia information can be semantically associated with parts of the model, through an ontology, enriching the experience; for example, videos can be linked to each tooth demonstrating how to extract them. The use of semantic information gives a greater flexibility to the models, since filters can be applied to create temporary models that show subsets of the original data in a human friendly way. We also explain how the software was written to run in arbitrary multi-projection environments. © 2011 Springer-Verlag.

A method for calculating the compliance of bonded-interfaces under shrinkage: Validation for Class I cavities

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Interação com objetos digitais 3D em estúdios virtuais

Pós-graduação em Televisão Digital: Informação e Conhecimento - FAAC

3D-electron microscopy of different conformations of cephalopod hemocyanins

Die Hämocyanine der Cephalopoden Nautilus pompilius und Sepia officinalis sorgen für den Sauerstofftransport zwischen den Kiemen und den Geweben. Sie bestehen aus einem zylindrischen Dekamer mit interner Kragenstruktur. Während eine Untereinheit (also eine Polypeptidkette) bei NpH aus sieben paralogen funktionellen Domänen (FU-a bis FU-g) besteht, führte ein Genduplikationsereignis der FU-d zu acht FUs in SoH (a, b, c, d, d´, e, f, g). In allen Mollusken Hämocyaninen bilden sechs dieser FUs den äußeren Ring und die restlichen die interne Kragenstruktur. rnrnIn dieser Arbeit wurde ein dreidimensionales Modell des Hämocyanins von Sepia officinalis (SoH) erstellt. Die Rekonstruktion, mit einer Auflösung von 8,8Å (FSC=0,5), erlaubt das Einpassen von Homolologiemodellen und somit das Erstellen eines molekularen Modells mit pseudo atomarer Auflösung. Des Weiteren wurden zwei Rekonstruktionen des Hämocyanins von Nautilus pompilius (NpH) in verschiedenen Oxygenierungszuständen erstellt. Die auf 10 und 8,1Å aufgelösten Modelle zeigen zwei verschiedene Konformationen des Proteins. Daraus ließ sich eine Modellvorstellung über die allosterische Funktionsweise ableiten. Die hier erreichte Auflösung von 8Å ist die momentan höchste eines Molluskenhämocyanins. rnAuf Grundlage des molekularen Modells von SoH konnte die Topologie des Proteins aufgeklärt werden. Es wurde gezeigt, dass die zusätzliche FU-d´ in den Kragen integriert ist und somit die prinzipielle Wandarchitektur aller Mollusken Hämocyanine identisch ist. Wie die Analyse des erstellten molekularen Modells zeigt werden sind die beiden Isoformen (SoH1 und SoH2) in den Bereichen der Interfaces nahezu identisch; auch der Vergleich mit NpH zeigt grosse Übereinstimmungen. Des weiteren konnte eine Fülle von Informationen bezüglich der allosterischen Signalübertragung innerhalb des Moleküls gewonnen werden. rnDer Versuch, NpH in verschiedenen Oxygenierungszuständen zu zeigen, war erfolgreich. Die Datensätze, die unter zwei atmosphärischen Bedingungen präpariert wurden, führten reproduzierbar zu zwei unterschiedlichen Rekonstruktionen. Dies zeigt, daß der hier entwickelte experimentelle Ansatz funktioniert. Er kann nun routinemäßig auf andere Proteine angewandt werden. Wie der strukturelle Vergleich zeigte, verändert sich die Orientierung der FUs durch die Oxygenierung leicht. Dies wiederum beeinflusst die Anordnung innerhalb der Interfaces sowie die Abstände zwischen den beteiligten Aminosäuren. Aus dieser Analyse konnte eine Modellvorstellung zum allosterischen Signaltransfer innerhalb des Moleküls abgeleitet werden, die auf einer Umordnung von Salzbrücken basiert.

3D-Strukturanalyse von Molluskenhämocyaninen aus elektronenmikroskopischen Bildern

Diese Arbeit präsentiert die bislang höchst aufgelösten KryoEM-Strukturen für ein Cephalopoden hämocyanin Dekamer (Nautilus pompilus Hämocyanin, NpH) und ein Gastropoden Hämocyanin Didekamer (keyhole limpet hemocyanin isoform 1). Durch die Methoden des “molecular modelling” und “rigid-body-fiting” wurde auch eine detaillierte Beschreibung beider Strukturen auf atomarem Niveau erstmalig möglich. Hämocyanine sind kupferhaltige Sauerstoff-Transportproteine die frei gelöst in Blut zahlreicher Arthropoden und Mollusken vorkommen. Allgemein sind Molluskenhämocyanine als Dekamere (Hohlzylinder aus 5 Untereinheiten-dimere) oder Didecamere (Zusammenlagerung von zwei Dekameren) zu finden. Durch Anlagerung weiterer Dekamere bilden sich teilweise tubuläre Multidekamere. Hämocyanine der Cephalopoden bestehen ausschließlich aus solitären Decameren. In Octopus und Nautilus bestehen die 10 Untereinheiten aus 7 funktionellen Einheiten(FU-a bis FU-g), wobei jede FU ein Sauerstoffmolekül binden kann. FUs a-f bilden die Wand des ringförmigen Moleküls und 10 Kopien der FU-g bilden einen sogenannten „inneren Kragenkomplex“. Das im Rahmen dieser Arbeit erstelltes molekulares Modell von NpH klärt die Struktur des Dekamers vollständig auf. Wir waren zum ersten Mal in der Lage das Untereinheiten-dimer, den Verlauf der Polypeptidkette und 15 unterschiedliche Kontaktstellen zwischen FUs zu identifizieren. Viele der inter-FU-Kontakte weisen Aminosäurenkonstellationen auf, die die Basis für die Übertragung allosterischer Wechselwirkungen zwischen FUs darstellen könnten und Hinweise für den Aufbau der allosterische Einheit geben. Potentielle Bindungsstellen für N-glykosidische Zucker und bivalente Kationen wurden auch identifiziert. Im Gegensatz zu NpH, kommen Gastropoden Hämocyanine (inkl. KLH) hauptsächlich als Didekamere vor und der Kragenkomplex wird in diesem Fall aus 2 FUs gebildet (Fu-g und FU-h). Die zusätzliche C'-terminale FU-h zeichnet sich durch eine spezielle Verlängerung von ~ 100 Aminosäuren aus. KLH stammt aus der kalifornische Schnecke Megathura crenulata und kommt seit mehreren Jahrzehnten als Immunostimulator in der immunologischen Grundlagenforschung und klinischen Anwendung zum Einsatz. KLH weist zwei Isoformen auf, KLH1 und KLH2. Das vorliegende Modell von KLH1 erlaubt die komplexe Architektur dieses riesigen Proteins in allen Details zu verstehen, sowie einen Vergleich zum dem NpH Dekamer auf atomare Ebene. Es wurde gefunden, dass das Untereinheitensegment a-b-c-d-e-f-g, sowie die equivalenten Kontaktstellen zwichen FUs stark konserviert sind. Dies deutet darauf hin, dass in Bezug auf die Übertragung allosterische Signale zwischen benachbarten FUs, grundlegende Mechanismen in beiden Molekülen beibehalten wurden. Weiterhin, konnten die Verbindungen zwischen den zwei Dekameren ertsmalig identifiziert werden. Schließlich, wurde die Topologie der N-glycosidischen Zucker, welche für die immunologische Eigenschaften von KLH1 von großer Bedeutung sind, auch aufgeklärt. Somit leistet die vorliegende Arbeit einen wesentlichen Schritt zum Verständnis der Quartärstruktur und Funktion der Molluskenhämocyanine.rn

Comparison of 2D and 3D GUI Widgets for Stereoscopic Multitouch Setups

Recent developments in the area of interactive entertainment have suggested to combine stereoscopic visualization with multi-touch displays, which has the potential to open up new vistas for natural interaction with interactive three-dimensional (3D) applications. However, the question arises how the user interfaces for system control in such 3D setups should be designed in order to provide an effective user experience. In this article we introduce 3D GUI widgets for interaction with stereoscopic touch displays. The design of the widgets was inspired to skeuomorphism and affordances in such a way that the user should be able to operate the virtual objects in the same way as their real-world equivalents. We evaluate the developed widgets and compared them with their 2D counterparts in the scope of an example application in order to analyze the usability of and user behavior with the widgets. The results reveal differences in user behavior with and without stereoscopic display during touch interaction, and show that the developed 2D as well as 3D GUI widgets can be used effectively in different applications.

A multimodal tablet-based interface for designing and reviewing 3D engineering models

The ability to view and interact with 3D models has been happening for a long time. However, vision-based 3D modeling has only seen limited success in applications, as it faces many technical challenges. Hand-held mobile devices have changed the way we interact with virtual reality environments. Their high mobility and technical features, such as inertial sensors, cameras and fast processors, are especially attractive for advancing the state of the art in virtual reality systems. Also, their ubiquity and fast Internet connection open a path to distributed and collaborative development. However, such path has not been fully explored in many domains. VR systems for real world engineering contexts are still difficult to use, especially when geographically dispersed engineering teams need to collaboratively visualize and review 3D CAD models. Another challenge is the ability to rendering these environments at the required interactive rates and with high fidelity. In this document it is presented a virtual reality system mobile for visualization, navigation and reviewing large scale 3D CAD models, held under the CEDAR (Collaborative Engineering Design and Review) project. It’s focused on interaction using different navigation modes. The system uses the mobile device's inertial sensors and camera to allow users to navigate through large scale models. IT professionals, architects, civil engineers and oil industry experts were involved in a qualitative assessment of the CEDAR system, in the form of direct user interaction with the prototypes and audio-recorded interviews about the prototypes. The lessons learned are valuable and are presented on this document. Subsequently it was prepared a quantitative study on the different navigation modes to analyze the best mode to use it in a given situation.

IDT-3D: Identification and tracking in controlled environments using a 3D unified user interface

Identification and tracking of objects in specific environments such as harbors or security areas is a matter of great importance nowadays. With this purpose, numerous systems based on different technologies have been developed, resulting in a great amount of gathered data displayed through a variety of interfaces. Such amount of information has to be evaluated by human operators in order to take the correct decisions, sometimes under highly critical situations demanding both speed and accuracy. In order to face this problem we describe IDT-3D, a platform for identification and tracking of vessels in a harbour environment able to represent fused information in real time using a Virtual Reality application. The effectiveness of using IDT-3D as an integrated surveillance system is currently under evaluation. Preliminary results point to a significant decrease in the times of reaction and decision making of operators facing up a critical situation. Although the current application focus of IDT-3D is quite specific, the results of this research could be extended to the identification and tracking of targets in other controlled environments of interest as coastlines, borders or even urban areas.

A multimodal tablet-based interface for designing and reviewing 3D engineering models

The ability to view and interact with 3D models has been happening for a long time. However, vision-based 3D modeling has only seen limited success in applications, as it faces many technical challenges. Hand-held mobile devices have changed the way we interact with virtual reality environments. Their high mobility and technical features, such as inertial sensors, cameras and fast processors, are especially attractive for advancing the state of the art in virtual reality systems. Also, their ubiquity and fast Internet connection open a path to distributed and collaborative development. However, such path has not been fully explored in many domains. VR systems for real world engineering contexts are still difficult to use, especially when geographically dispersed engineering teams need to collaboratively visualize and review 3D CAD models. Another challenge is the ability to rendering these environments at the required interactive rates and with high fidelity. In this document it is presented a virtual reality system mobile for visualization, navigation and reviewing large scale 3D CAD models, held under the CEDAR (Collaborative Engineering Design and Review) project. It’s focused on interaction using different navigation modes. The system uses the mobile device's inertial sensors and camera to allow users to navigate through large scale models. IT professionals, architects, civil engineers and oil industry experts were involved in a qualitative assessment of the CEDAR system, in the form of direct user interaction with the prototypes and audio-recorded interviews about the prototypes. The lessons learned are valuable and are presented on this document. Subsequently it was prepared a quantitative study on the different navigation modes to analyze the best mode to use it in a given situation.

3D navigation with six degrees-of-freedom using a multi-touch display

With the introduction of new input devices, such as multi-touch surface displays, the Nintendo WiiMote, the Microsoft Kinect, and the Leap Motion sensor, among others, the field of Human-Computer Interaction (HCI) finds itself at an important crossroads that requires solving new challenges. Given the amount of three-dimensional (3D) data available today, 3D navigation plays an important role in 3D User Interfaces (3DUI). This dissertation deals with multi-touch, 3D navigation, and how users can explore 3D virtual worlds using a multi-touch, non-stereo, desktop display. ^ The contributions of this dissertation include a feature-extraction algorithm for multi-touch displays (FETOUCH), a multi-touch and gyroscope interaction technique (GyroTouch), a theoretical model for multi-touch interaction using high-level Petri Nets (PeNTa), an algorithm to resolve ambiguities in the multi-touch gesture classification process (Yield), a proposed technique for navigational experiments (FaNS), a proposed gesture (Hold-and-Roll), and an experiment prototype for 3D navigation (3DNav). The verification experiment for 3DNav was conducted with 30 human-subjects of both genders. The experiment used the 3DNav prototype to present a pseudo-universe, where each user was required to find five objects using the multi-touch display and five objects using a game controller (GamePad). For the multi-touch display, 3DNav used a commercial library called GestureWorks in conjunction with Yield to resolve the ambiguity posed by the multiplicity of gestures reported by the initial classification. The experiment compared both devices. The task completion time with multi-touch was slightly shorter, but the difference was not statistically significant. The design of experiment also included an equation that determined the level of video game console expertise of the subjects, which was used to break down users into two groups: casual users and experienced users. The study found that experienced gamers performed significantly faster with the GamePad than casual users. When looking at the groups separately, casual gamers performed significantly better using the multi-touch display, compared to the GamePad. Additional results are found in this dissertation.^

3D Navigation with Six Degrees-of-Freedom using a Multi-Touch Display

With the introduction of new input devices, such as multi-touch surface displays, the Nintendo WiiMote, the Microsoft Kinect, and the Leap Motion sensor, among others, the field of Human-Computer Interaction (HCI) finds itself at an important crossroads that requires solving new challenges. Given the amount of three-dimensional (3D) data available today, 3D navigation plays an important role in 3D User Interfaces (3DUI). This dissertation deals with multi-touch, 3D navigation, and how users can explore 3D virtual worlds using a multi-touch, non-stereo, desktop display. The contributions of this dissertation include a feature-extraction algorithm for multi-touch displays (FETOUCH), a multi-touch and gyroscope interaction technique (GyroTouch), a theoretical model for multi-touch interaction using high-level Petri Nets (PeNTa), an algorithm to resolve ambiguities in the multi-touch gesture classification process (Yield), a proposed technique for navigational experiments (FaNS), a proposed gesture (Hold-and-Roll), and an experiment prototype for 3D navigation (3DNav). The verification experiment for 3DNav was conducted with 30 human-subjects of both genders. The experiment used the 3DNav prototype to present a pseudo-universe, where each user was required to find five objects using the multi-touch display and five objects using a game controller (GamePad). For the multi-touch display, 3DNav used a commercial library called GestureWorks in conjunction with Yield to resolve the ambiguity posed by the multiplicity of gestures reported by the initial classification. The experiment compared both devices. The task completion time with multi-touch was slightly shorter, but the difference was not statistically significant. The design of experiment also included an equation that determined the level of video game console expertise of the subjects, which was used to break down users into two groups: casual users and experienced users. The study found that experienced gamers performed significantly faster with the GamePad than casual users. When looking at the groups separately, casual gamers performed significantly better using the multi-touch display, compared to the GamePad. Additional results are found in this dissertation.

3D-grafiikan selaintekniikat, erikoistapauksena karttasovellukset

Harava on karttapohjainen kyselypalvelu, jonka avulla voidaan kerätä tietoa erilaisista kyselykohteista. Harava-kyselypalvelussa kyselyihin voidaan vastata muun muassa tekstikentillä, monivalinnoilla ja merkitsemällä alueita ja pisteitä karttapohjaan. Tutkielman tavoitteena oli löytää Harava-kyselypalvelun 2D-karttojen rinnalle 3D-karttavaihtoehto. Aluksi tutkittiin, mitä eri vaihtoehtoja löytyy 3D-komponenttien esittämiseen selaimessa. Tutkituista vaihtoehdoista parhaimmaksi tähän tarkoitukseen osoittautui WebGL-kirjasto. WebGL-kirjaston käyttö suoraan osoittautui vaikeaksi, joten etsittiin rajapintaa, jonka avulla WebGL-kirjaston käyttö helpottuisi. Käsittelyyn otettiin karttapalveluita sekä 3D-mallien esittämiseen tarkoitettuja JavaScript-kirjastoja, jotka käyttävät WebGL-kirjastoa rajapinnan kautta. Näistä sopivimmaksi osoittautui Cesium. Cesium on JavaScript-kirjasto, jonka avulla voidaan toteuttaa 2D-kartta ja 3D-karttapallo sekä upottaa karttapohjaan 3D-elementtejä.

Nanomechanical characterization of soft bioelectronic interfaces via modeling-informed atomic force microscopy

The field of bioelectronics involves the use of electrodes to exchange electrical signals with biological systems for diagnostic and therapeutic purposes in biomedical devices and healthcare applications. However, the mechanical compatibility of implantable devices with the human body has been a challenge, particularly with long-term implantation into target organs. Current rigid bioelectronics can trigger inflammatory responses and cause unstable device functions due to the mechanical mismatch with the surrounding soft tissue. Recent advances in flexible and stretchable electronics have shown promise in making bioelectronic interfaces more biocompatible. To fully achieve this goal, material science and engineering of soft electronic devices must be combined with quantitative characterization and modeling tools to understand the mechanical issues at the interface between electronic technology and biological tissue. Local mechanical characterization is crucial to understand the activation of failure mechanisms and optimizing the devices. Experimental techniques for testing mechanical properties at the nanoscale are emerging, and the Atomic Force Microscope (AFM) is a good candidate for in situ local mechanical characterization of soft bioelectronic interfaces. In this work, in situ experimental techniques with solely AFM supported by interpretive models for the characterization of planar and three-dimensional devices suitable for in vivo and in vitro biomedical experimentations are reported. The combination of the proposed models and experimental techniques provides access to the local mechanical properties of soft bioelectronic interfaces. The study investigates the nanomechanics of hard thin gold films on soft polymeric substrates (Poly(dimethylsiloxane) PDMS) and 3D inkjet-printed micropillars under different deformation states. The proposed characterization methods provide a rapid and precise determination of mechanical properties, thus giving the possibility to parametrize the microfabrication steps and investigate their impact on the final device.

Bipolar Tribocharging Signal During Friction Force Fluctuations At Metal-insulator Interfaces.

Friction and triboelectrification of materials show a strong correlation during sliding contacts. Friction force fluctuations are always accompanied by two tribocharging events at metal-insulator [e.g., polytetrafluoroethylene (PTFE)] interfaces: injection of charged species from the metal into PTFE followed by the flow of charges from PTFE to the metal surface. Adhesion maps that were obtained by atomic force microscopy (AFM) show that the region of contact increases the pull-off force from 10 to 150 nN, reflecting on a resilient electrostatic adhesion between PTFE and the metallic surface. The reported results suggest that friction and triboelectrification have a common origin that must be associated with the occurrence of strong electrostatic interactions at the interface.