Head Tracking Based Avatar Control for Virtual Environment Teamwork Training

Virtual environments (VE) are gaining in popularity and are increasingly used for teamwork training purposes, e.g., for medical teams. One shortcoming of modern VEs is that nonverbal communication channels, essential for teamwork, are not supported well. We address this issue by using an inexpensive webcam to track the user's head. This tracking information is used to control the head movement of the user's avatar, thereby conveying head gestures and adding a nonverbal communication channel. We conducted a user study investigating the influence of head tracking based avatar control on the perceived realism of the VE and on the performance of a surgical teamwork training scenario. Our results show that head tracking positively influences the perceived realism of the VE and the communication, but has no major influence on the training outcome.

FiFi – Steuerung eines FTF durch Gesten- und Personenerkennung

Um den manuellen Transport in der Intralogistik zu erleichtern, wurde ein Fahrerloses Transportfahrzeug (FTF) entwickelt, das berührungslos vom Bediener gesteuert wird. Die Steuerung erfolgt durch Gesten- und Personenerkennung basierend auf 3D-Daten der Umgebung. Das Paper beschreibt sowohl Zielsetzung, Betriebsarten und Anwendungsmöglichkeiten als auch das Steuerungskonzept der berührungslosen Steuerung und die technische Umsetzung der Plattform. Erste Experimente bestätigen, dass ein Roboter basierend auf 3D-Daten gesteuert werden kann. Verbesserungsmöglichkeiten in der Robustheit werden aufgezeigt.

Impact Study of Nonverbal Facial Cues on Spontaneous Chatting with Virtual Humans

Non-verbal communication (NVC) is considered to represent more than 90 percent of everyday communication. In virtual world, this important aspect of interaction between virtual humans (VH) is strongly neglected. This paper presents a user-test study to demonstrate the impact of automatically generated graphics-based NVC expression on the dialog quality: first, we wanted to compare impassive and emotion facial expression simulation for impact on the chatting. Second, we wanted to see whether people like chatting within a 3D graphical environment. Our model only proposes facial expressions and head movements induced from spontaneous chatting between VHs. Only subtle facial expressions are being used as nonverbal cues - i.e. related to the emotional model. Motion capture animations related to hand gestures, such as cleaning glasses, were randomly used to make the virtual human lively. After briefly introducing the technical architecture of the 3D-chatting system, we focus on two aspects of chatting through VHs. First, what is the influence of facial expressions that are induced from text dialog? For this purpose, we exploited an emotion engine extracting an emotional content from a text and depicting it into a virtual character developed previously [GAS11]. Second, as our goal was not addressing automatic generation of text, we compared the impact of nonverbal cues in conversation with a chatbot or with a human operator with a wizard of oz approach. Among main results, the within group study -involving 40 subjects- suggests that subtle facial expressions impact significantly not only on the quality of experience but also on dialog understanding.

Hands-Free Navigation in Immersive Environments for the Evaluation of the Effectiveness of Indoor Navigation Systems

While navigation systems for cars are in widespread use, only recently, indoor navigation systems based on smartphone apps became technically feasible. Hence tools in order to plan and evaluate particular designs of information provision are needed. Since tests in real infrastructures are costly and environmental conditions cannot be held constant, one must resort to virtual infrastructures. This paper presents the development of an environment for the support of the design of indoor navigation systems whose center piece consists in a hands-free navigation method using the Microsoft Kinect in the four-sided Definitely Affordable Virtual Environment (DAVE). Navigation controls using the user's gestures and postures as the input to the controls are designed and implemented. The installation of expensive and bulky hardware like treadmills is avoided while still giving the user a good impression of the distance she has traveled in virtual space. An advantage in comparison to approaches using a head mounted display is that the DAVE allows the users to interact with their smartphone. Thus the effects of different indoor navigation systems can be evaluated already in the planning phase using the resulting system

Estimating Gesture Accuracy in Motion-Based Health Games

This manuscript details a technique for estimating gesture accuracy within the context of motion-based health video games using the MICROSOFT KINECT. We created a physical therapy game that requires players to imitate clinically significant reference gestures. Player performance is represented by the degree of similarity between the performed and reference gestures and is quantified by collecting the Euler angles of the player's gestures, converting them to a three-dimensional vector, and comparing the magnitude between the vectors. Lower difference values represent greater gestural correspondence and therefore greater player performance. A group of thirty-one subjects was tested. Subjects achieved gestural correspondence sufficient to complete the game's objectives while also improving their ability to perform reference gestures accurately.

FiFi – Robuste Personenerkennung gestengesteuerter Fahrzeuge in der Intralogistik

Die Steuerung des Fahrerlosen Transportfahrzeuges „FiFi“ erfolgt berührungslos durch Gesten- und Personenerkennung basierend auf 3D-Daten der Umgebung. Die genutzten Verfahren zur Personenerkennung führen in einigen Fällen zur Falsch-Erkennung von Personen in Objekten. Das Paper beschreibt die Ursachen der Fehlerkennung und stellt die umgesetzten Lösungsansätze zur Vermeidung vor. Experimente bestätigen, dass die entwickelten Verfahren die Robustheit des Systems erhöhen.

Impaired gesture performance in schizophrenia: particular vulnerability of meaningless pantomimes

Schizophrenia patients frequently present with subtle motor impairments, including higher order motor function such as hand gesture performance. Using cut off scores from a standardized gesture test, we previously reported gesture deficits in 40% of schizophrenia patients irrespective of the gesture content. However, these findings were based on normative data from an older control group. Hence, we now aimed at determining cut-off scores in an age and gender matched control group. Furthermore, we wanted to explore whether gesture categories are differentially affected in Schizophrenia. Gesture performance data of 30 schizophrenia patients and data from 30 matched controls were compared. Categories included meaningless, intransitive (communicative) and transitive (object related) hand gestures, which were either imitated or pantomimed, i.e. produced on verbal command. Cut-off scores of the age matched control group were higher than the previous cut-off scores in an older control group. An ANOVA tested effects of group, domain (imitation or pantomime), and semantic category (meaningless, transitive or intransitive), as well as their interaction. According to the new cut-off scores, 67% of the schizophrenia patients demonstrated gestural deficits. Patients performed worse in all gesture categories, however meaningless gestures on verbal command were particularly impaired (p = 0.008). This category correlated with poor frontal lobe function (p < 0.001). In conclusion, gestural deficits in schizophrenia are even more frequent than previously reported. Gesture categories that pose higher demands on planning and selection such as pantomime of meaningless gestures are predominantly affected and associated with the well-known frontal lobe dysfunction.

Left posterior parietal theta burst stimulation affects gestural imitation regardless of semantic content.

OBJECTIVE Neuro-imaging studies have suggested that the ability to imitate meaningless and meaningful gestures may differentially depend on superior (SPL) and inferior (IPL) parietal lobule. Therefore, we hypothesized that imaging-guided neuro-navigated continuous theta burst stimulation (cTBS) over left SPL mainly affects meaningless and over left IPL predominantly meaningful gestures. METHODS Twelve healthy subjects participated in this study. High resolution structural MRI was used for imaging guided neuro-navigation cTBS. Participants were targeted with one train of cTBS in three experimental sessions: sham stimulation over vertex and real cTBS over left SPL and IPL, respectively. An imitation task, including 24 meaningless and 24 meaningful gestures, was performed 'offline'. RESULTS cTBS over both left IPL and SPL significantly interfered with gestural imitation. There was no differential effect of SPL and IPL cTBS on gesture type (meaningless versus meaningful). CONCLUSIONS Our findings confirm that left posterior parietal cortex plays a predominant role in gestural imitation. However, the hypothesis based on the dual route model suggesting a differential role of SPL and IPL in the processing of meaningless and meaningful gestures could not be confirmed. SIGNIFICANCE Left SPL and IPL play a common role within the posterior-parietal network in gestural imitation regardless of semantic content.

Disorganization and timing of motor behavior : insight from gesture impairments and movement patterns in schizophrenia

Background: Motor symptoms are frequent phenomena across the entire course of schizophrenia1. Some have argued that disorganized behavior was associated with aberrant motor behavior. We have studied the association of motor disturbances and disorganization in two projects focusing on the timing of movements. Method: In two studies, we assessed motor behavior and psychopathology. The first study applied a validated test of upper limb apraxia in 30 schizophrenia patients2,3. We used standardized video assessments of hand gestures by a blinded rater. The second study tested the stability of movement patterns using time series analysis in actigraphy data of 100 schizophrenia patients4. Both stability of movement patterns and the overall amount of movement were calculated from data of two hours with high degrees of social interaction comparable across the 100 subjects. Results: In total, 67% of the patients had gesture performance deficits3. Most frequently, they made spatial, temporal and body-part-as-object errors. Gesture performance relied on frontal lobe function2. Poor gesture performance was associated with increased disorganization scores. In the second study, we found disorganization to be predicted only by more irregular movement patterns irrespective of the overall amount of movement4. Conclusion : Both studies provide evidence for a link between aberrant timing of motor behavior and disorganization. Disturbed movement control seems critical for disorganized behavior in schizophrenia.

Vision-based Proximity Detection in Retinal Surgery

In retinal surgery, surgeons face difficulties such as indirect visualization of surgical targets, physiological tremor, and lack of tactile feedback, which increase the risk of retinal damage caused by incorrect surgical gestures. In this context, intraocular proximity sensing has the potential to overcome current technical limitations and increase surgical safety. In this paper, we present a system for detecting unintentional collisions between surgical tools and the retina using the visual feedback provided by the opthalmic stereo microscope. Using stereo images, proximity between surgical tools and the retinal surface can be detected when their relative stereo disparity is small. For this purpose, we developed a system comprised of two modules. The first is a module for tracking the surgical tool position on both stereo images. The second is a disparity tracking module for estimating a stereo disparity map of the retinal surface. Both modules were specially tailored for coping with the challenging visualization conditions in retinal surgery. The potential clinical value of the proposed method is demonstrated by extensive testing using a silicon phantom eye and recorded rabbit in vivo data.

Structural brain correlates of defective gesture performance in schizophrenia

INTRODUCTION The neural correlates of impaired performance of gestures are currently unclear. Lesion studies showed variable involvement of the ventro-dorsal stream particularly left inferior frontal gyrus (IFG) in gesture performance on command. However, findings cannot be easily generalized as lesions may be biased by the architecture of vascular supply and involve brain areas beyond the critical region. The neuropsychiatric syndrome of schizophrenia shares apraxic-like errors and altered brain structure without macroanatomic lesions. Schizophrenia may therefore qualify as a model disorder to test neural correlates of gesture impairments. METHODS We included 45 schizophrenia patients and 44 healthy controls in the study to investigate the structural brain correlates of defective gesturing in schizophrenia using voxel based morphometry. Gestures were tested in two domains: meaningful gestures (transitive and intransitive) on verbal command and imitation of meaningless gestures. Cut-off scores were used to separate patients with deficits, patients without deficits and controls. Group differences in gray matter (GM) volume were explored in an ANCOVA. RESULTS Patients performed poorer than controls in each gesture category (p < .001). Patients with deficits in producing meaningful gestures on command had reduced GM predominantly in left IFG, with additional involvement of right insula and anterior cingulate cortex. Patients with deficits differed from patients without deficits in right insula, inferior parietal lobe (IPL) and superior temporal gyrus. CONCLUSIONS Impaired performance of meaningful gestures on command was linked to volume loss predominantly in the praxis network in schizophrenia. Thus, the behavioral similarities between apraxia and schizophrenia are paralleled by structural alterations. However, few associations between behavioral impairment and structural brain alterations appear specific to schizophrenia.

Poéticas de la hipérbole : Las obras de Angélica Gorodischer y Tununa Mercado

La tesis se propone, mediante eI despliegue de una argumentación desde distintos enfoques teórico-metodológicos y núcleos de sentido dar cuenta del modo como las políticas de Angélica Gorodischer tanto como la de Tununa Mercado [ambas escritoras argentinas contemporáneas aun en ejercicio] plantean la similitud de la figura de la hipérbole, como figura retórica que refine sus gestos escriturarios, en una par aumento, en la otra par disminución. De este modo, se verifica que lo que en apariencia resalta como una forma de abigarramiento y profusión y otra, en cambio, escueta y lacónica, responden en definitiva a un mismo énfasis retórico de sus respectivas ficciones

Quiero detenerme en la palabra... A propósito del hueso duro de Gauguin

El artículo aborda una lectura e interpretación del campo literario puertorriqueño actual, a través de la relación establecida entre los autores más jóvenes y sus modelos literarios, especialmente a través del vínculo establecido, a modo de ejemplo, entre Juan Carlos Quiñones y Luis Rafael Sánchez. El concepto de influencia según la propuesta de Harold Bloom se complejiza en términos de lectura y escritura, puesto que los jóvenes se distancian y desmarcan de los mandatos programáticos en torno a la ambivalente identidad nacional puertorriqueña, pero a su vez reconocen gestos filiativos de aproximación respecto de sus mayores.

Gestualidad en el Cantar de Mio Cid : Gestos públicos y modestia

El presente trabajo se abocará al problema de la gestualidad en el CMC desde dos perspectivas complementarias: la característica fundamental de mesura que la crítica cidiana ha visto siempre en el héroe, y la descripción del uso de ciertos objetos e indumentaria. La cuestión de la gestualidad en la cultura medieval cuenta ya con largos años de investigación literaria e histórica. La combinación de indumentaria y gestualidad en el CMC está en función de la "espectacularidad", de forma tal que provoca, a través de un cierto "signo" corporal, la actitud de admiración. Por otro lado, se pueden establecer ciertos paralelismos con las prescripciones monásticas acerca del comportamiento gestual, las cuales son, según Schmitt, índice de la mentalidad de toda la sociedad a partir del siglo XII. La oposición modestia / gesticulatio, identificable en el CMC, puede ser asimilada en gran medida a la de mesura/ desmesura, con respecto a la cual se ordenan los personajes positivos y negativos en la obra.