A multi-point haptic platform for grasping and manipulating virtual objects

This work presents a multi-point haptic platform that employs two Phantom Omni haptic devices. A gripper attachment connects to both devices and enables multi-point haptic grasping in virtual environments. In contrast to more complex approaches, this setup benefits from low-cost, reliability, and ease of programming while being capable of independently rendering forces to each of the user’s fingertips. The ability to grasp with multiple points potentially lends itself to applications such as virtual training, telesurgery and telemanipulation.

Integrating kinect and haptics for interactive STEM education in local and distributed environments

Skill shortage is a realistic social problem that Australia is currently facing, especially in the fields of Science, Technology, Engineering and Mathematics (STEM). Various approaches have been proposed to soften this issue. By now the most successful approach is to attract pre-university youth and university freshmen into those fields before they make a decision on future subjects by introducing them with interactive, modifiable and inspiring virtual environments, which incorporates most essential knowledge of STEM. We propose to design a comprehensive virtual reality platform with immersive interactions, pluggable components and flexible configurations. It also involves haptics, motion capture and gesture recognition, and could be deployed in both local and distributed environments. The platform utilizes off the shelf low cost haptics and motion capture products, however the fidelity can be maintained at a good level. The proposed platform has been implemented with different configurations and has been tested on a group of users. Preliminary test results show that the interactivity, flexibility and fidelity of the platform are highly appreciated by users. User surveys also indicate that the proposed platform could help pre-university students and university freshmen build an overview of various aspects of STEM education. Besides, users are also positive on the fact that the platform enabled them to identify the challenges for higher education in STEM by providing them opportunities to interactively modify system configurations and instantly experience the corresponding results both visually and haptically.

Multitasking: multiple, domain-specific cognitive functions in a virtual environment

Multitasking among three or more different tasks is a ubiquitous requirement of everyday cognition, yet rarely is it addressed in research on healthy adults who have had no specific training in multitasking skills. Participants completed a set of diverse subtasks within a simulated shopping mall and office environment, the Edinburgh Virtual Errands Test (EVET). The aim was to investigate how different cognitive functions, such as planning, retrospective and prospective memory, and visuospatial and verbal working memory, contribute to everyday multitasking. Subtasks were chosen to be diverse, and predictions were derived from a statistical model of everyday multitasking impairments associated with frontal-lobe lesions (Burgess, Veitch, de Lacy Costello, & Shallice, 2000b). Multiple regression indicated significant independent contributions from measures of retrospective memory, visuospatial working memory, and online planning, but not from independent measures of prospective memory or verbal working memory. Structural equation modelling showed that the best fit to the data arose from three underlying constructs, with Memory and Planning having a weak link, but with both having a strong directional pathway to an Intent construct that reflected implementation of intentions. Participants who followed their preprepared plan achieved higher scores than those who altered their plan during multitask performance. This was true regardless of whether the plan was efficient or poor. These results substantially develop and extend the Burgess et al. (2000b) model to healthy adults and yield new insight into the poorly understood area of everyday multitasking. The findings also point to the utility of using virtual environments for investigating this form of complex human cognition.

Rapid prototyping of ubiquitous computing environments

Ubiquitous computing raises new usability challenges that cut across design and development. We are particularly interested in environments enhanced with sensors, public displays and personal devices. How can prototypes be used to explore the users' mobility and interaction, both explicitly and implicitly, to access services within these environments? Because of the potential cost of development and design failure, these systems must be explored using early assessment techniques and versions of the systems that could disrupt if deployed in the target environment. These techniques are required to evaluate alternative solutions before making the decision to deploy the system on location. This is crucial for a successful development, that anticipates potential user problems, and reduces the cost of redesign. This thesis reports on the development of a framework for the rapid prototyping and analysis of ubiquitous computing environments that facilitates the evaluation of design alternatives. It describes APEX, a framework that brings together an existing 3D Application Server with a modelling tool. APEX-based prototypes enable users to navigate a virtual world simulation of the envisaged ubiquitous environment. By this means users can experience many of the features of the proposed design. Prototypes and their simulations are generated in the framework to help the developer understand how the user might experience the system. These are supported through three different layers: a simulation layer (using a 3D Application Server); a modelling layer (using a modelling tool) and a physical layer (using external devices and real users). APEX allows the developer to move between these layers to evaluate different features. It supports exploration of user experience through observation of how users might behave with the system as well as enabling exhaustive analysis based on models. The models support checking of properties based on patterns. These patterns are based on ones that have been used successfully in interactive system analysis in other contexts. They help the analyst to generate and verify relevant properties. Where these properties fail then scenarios suggested by the failure provide an important aid to redesign.

O ambiente virtual na formação inicial de professores de alemão como apoio para o ensino e a aprendizagem da língua e a reflexão sobre ações docentes

Estudiosos dos campos da Educação, da Linguística Aplicada e da Formação de Professores de Línguas insistem hoje na grande importância da inclusão de Tecnologias de Informação e Comunicação (TICs) na formação inicial, bem como na necessidade de promover o desenvolvimento do pensamento crítico-reflexivo dos futuros professores. Tomando como pressupostos teóricos estudos acerca das características da sociedade de informação, dos ambientes virtuais e da formação de professores, este trabalho tem como objetivo discutir possibilidades oferecidas pela plataforma Moodle de aprendizagem na formação inicial de professores de alemão. Para tanto, apresentaremos diferentes formas de uso de ambientes virtuais e de ferramentas neles disponíveis, que demonstraram ser de grande valor no processo de formação de licenciandos, tanto em língua alemã, quanto durante suas práticas iniciais. As experiências apontam para um valor inestimável de ambientes virtuais no acompanhamento de licenciandos no processo de aprendizagem da língua e nas primeiras experiências com a docência.

Fatores a serem levados em consideração para o desenvolvimento de testes de proficiência oral em contexto virtual

Novos contextos de aprendizagem virtual de línguas estrangeiras vêm surgindo com o desenvolvimento das novas tecnologias. Há a necessidade agora de se pensar em como a competência linguística poderá ser também avaliada em meio virtual. Este artigo traz uma retrospectiva da origem e desenvolvimento das provas de proficiência oral para falantes de línguas estrangeiras, buscando também levantar e discutir os aspectos a serem levados em consideração para a formulação deste tipo de teste em ambiente virtual.

Library in virtual reality: An innovative way for accessing, disseminating, and sharing information

This paper focuses on Virtual Reality (VR) as a very powerful technology that can be applied to the libraries, aiming at contributing to the activities of accessing, disseminating, and sharing information. The paper presents the VR concept and describes some libraries in virtual reality under utilization in different countries. In the final considerations, it is pointed out the use of virtual reality to develop libraries as collaborative virtual environments.

A realidade virtual na intervenção motora em crianças com transtorno do desenvolvimento da coordenação

Pós-graduação em Desenvolvimento Humano e Tecnologias - IBRC

SIMPLARCOM: simulador para planejamento de redes de comunicação sem fio utilizando realidade virtual e modelos de propagação

Este simulador é formado pela junção de técnicas de Realidade Virtual com modelos de propagação, desenvolvidos através dos estudos de rádio enlace, que descrevem a perda que o sinal transmitido sofre ao longo do percurso no ambiente. O simulador possui dois módulos. O primeiro permite a criação do ambiente virtual com o posicionamento, sobre um terreno, de prédios, árvores, carros, antenas e outras primitivas que permitem a construção de um ambiente tridimensional customizável. O segundo módulo permite a configuração dos parâmetros relacionados a propagação de sinal de antenas como a potência, a frequência, o ganho, etc., e também selecionar o modelo de propagação para a execução da simulação. Dentro deste segundo módulo, existe um submódulo responsável pelo estudo do planejamento da área de cobertura composta pelas antenas, em outras palavras, este submódulo simula a distância que cada antena no cenário consegue atingir e gera a respectiva área de cobertura. Para demonstrar a eficiência do simulador foram criados dois ambientes virtuais para testes. Um cenário representando um ambiente urbano onde empregou-se um modelo de propagação clássico, Okumura-Hata para cidades pequenas e médias, e um ambiente tridimensional arborizado utilizando um modelo especifico para simulação de propagação para regiões densamente arborizadas, desenvolvido na Universidade Federal do Pará chamado de Lyra-Castro-UFPA.

A multiple intelligences theory-based 3D virtual lab environment for digital systems teaching.

This paper describes a 3D virtual lab environment that was developed using OpenSim software integrated into Moodle. Virtuald software tool was used to provide pedagogical support to the lab by enabling to create online texts and delivering them to the students. The courses taught in this virtual lab are methodologically in conformity to theory of multiple intelligences. Some results are presented.

A robotic system to train activities of daily living in a virtual environment

In the past decade, several arm rehabilitation robots have been developed to assist neurological patients during therapy. Early devices were limited in their number of degrees of freedom and range of motion, whereas newer robots such as the ARMin robot can support the entire arm. Often, these devices are combined with virtual environments to integrate motivating game-like scenarios. Several studies have shown a positive effect of game-playing on therapy outcome by increasing motivation. In addition, we assume that practicing highly functional movements can further enhance therapy outcome by facilitating the transfer of motor abilities acquired in therapy to daily life. Therefore, we present a rehabilitation system that enables the training of activities of daily living (ADL) with the support of an assistive robot. Important ADL tasks have been identified and implemented in a virtual environment. A patient-cooperative control strategy with adaptable freedom in timing and space was developed to assist the patient during the task. The technical feasibility and usability of the system was evaluated with seven healthy subjects and three chronic stroke patients.

XSAMPL3D: An Action Description Language for the Animation of Virtual Characters

In this paper we present XSAMPL3D, a novel language for the high-level representation of actions performed on objects by (virtual) humans. XSAMPL3D was designed to serve as action representation language in an imitation-based approach to character animation: First, a human demonstrates a sequence of object manipulations in an immersive Virtual Reality (VR) environment. From this demonstration, an XSAMPL3D description is automatically derived that represents the actions in terms of high-level action types and involved objects. The XSAMPL3D action description can then be used for the synthesis of animations where virtual humans of different body sizes and proportions reproduce the demonstrated action. Actions are encoded in a compact and human-readable XML-format. Thus, XSAMPL3D describtions are also amenable to manual authoring, e.g. for rapid prototyping of animations when no immersive VR environment is at the animator's disposal. However, when XSAMPL3D descriptions are derived from VR interactions, they can accomodate many details of the demonstrated action, such as motion trajectiories,hand shapes and other hand-object relations during grasping. Such detail would be hard to specify with manual motion authoring techniques only. Through the inclusion of language features that allow the representation of all relevant aspects of demonstrated object manipulations, XSAMPL3D is a suitable action representation language for the imitation-based approach to character animation.