Knowledge-based Virtual Reconstruction of Museum Artifacts

Within the framework of heritage preservation, 3D scanning and modeling for heritage documentation has increased significantly in recent years, mainly due to the evolution of laser and image-based techniques, modeling software, powerful computers and virtual reality. 3D laser acquisition constitutes a real development opportunity for 3D modeling based previously on theoretical data. The representation of the object information rely on the knowledge of its historic and theoretical frame to reconstitute a posteriori its previous states. This project proposes an approach dealing with data extraction based on architectural knowledge and Laser statement informing measurements, the whole leading to 3D reconstruction. The experimented Khmer objects are exposed at Guimet museum in Paris. The purpose of this digital modeling meets the need of exploitable models for simulation projects, prototyping, exhibitions, promoting cultural tourism and particularly for archiving against any likely disaster and as an aided tool for the formulation of virtual museum concept.

Atividade eletroencefalográfica de pacientes com acidente vascular cerebral na aprendizagem motora de um jogo baseado em realidade virtual

Stroke is the leading cause of long-term disability among adults and motor relearning is essential in motor sequelae recovery. Therefore, various techniques have been proposed to achieve this end, among them Virtual Reality. The aim of the study was to evaluate electroencephalographic activity of stroke patients in motor learning of a virtual reality-based game. The study included 10 patients with chronic stroke, right-hande; 5 with left brain injury (LP), mean age 48.8 years (± 4.76) and 5 with injury to the right (RP), mean age 52 years (± 10.93). Participants were evaluated for electroencephalographic (EEG) activity and performance while performing 15 repetitions of darts game in XBOX Kinect and also through the NIHSS, MMSE, Fugl-Meyer and the modified Ashworth scale. Patients underwent a trainning with 45 repetitions of virtual darts game, 12 sessions in four weeks. After training, patients underwent reassessment of EEG activity and performance in virtual game of darts (retention). Data were analyzed using ANOVA for repeated measures. According to the results, there were differences between the groups (PD and PE) in frequencies Low Alpha (p = 0.0001), High Alpha (p = 0.0001) and Beta (p = 0.0001). There was an increase in alpha activation powers and a decrease in beta in the phase retention of RP group. In LP group was observed increased alpha activation potency, but without decrease in beta activation. Considering the asymmetry score, RP group increased brain activation in the left hemisphere with the practice in the frontal areas, however, LP group had increased activation of the right hemisphere in fronto-central areas, temporal and parietal. As for performance, it was observed a decrease in absolute error in the game for RP group between assessment and retention (p = 0.015), but this difference was not observed for LP group (p = 0.135). It follows then that the right brain injury patients benefited more from darts game training in the virtual environment with respect to the motor learning process, reducing neural effort in ipsilesionais areas and errors with the practice of the task. In contrast, patients with lesions in left hemisphere decrease neural effort in contralesionais areas important for motor learning and showed no performance improvements with practice of 12 sessions of virtual dart game. Thus, the RV can be used in rehabilitation of stroke patients upper limb, but the laterality of the injury should be considered in programming the motor learning protocol.

Instrumento de avaliação de processos cognitivos para a aprendizagem de subestações de energia em ambientes 2D e realidade virtual

This study describes the development of a prototype to evaluate the potential of environments based on two-dimensional modeling and virtual reality as power substations learning objects into training environments from a central operation and control of power utility Cemig. Initially, there was an identification modeling features and cognitive processes in 2D and RV, from which it was possible to create frames that serve to guide the preparation of a checklist with assigning a metric weight for measuring cognitive potential learning in the study sites. From these contents twenty-four questions were prepared and each was assigned a weight that was used in the calculation of the metric; the questions were grouped into skill sets and similar cognitive processes called categories. Were then developed two distinct environments: the first, the prototype features an interactive checklist and your individual results. And, second, a system of data management environment for the configuration and editing of the prototype, and the observation and analysis of the survey results. For prototype validation, were invited to access the virtual checklist and answer it, five professionals linked to Cemig's training area. The results confirmed the validity of this instrument application to assess the possible potential of modeling in 2D and RV as learning objects in power substations, as well as provide feedback to developers of virtual environments to improve the system.

Uma estratégia para otimizar a geração de arranjos em subestações virtuais de energia elétrica

The Virtual Reality techniques applied in Electricity Environments provide a new supervisory control paradigm. The fact of existing a virtual environment (VE), geometrically similar to a real substation, reduces the difference of mental models built by field operators compared with those built by system center operation improving the communication. Beside this, those systems can be used as visualization interfaces for electricity system simulators, training systems for professors and undergraduate students, field operators and maintenance professionals. However, the development process of these systems is quite complex, combining several activities such as implementation, 3D modeling, virtual sceneries construction, usability assessment and management project techniques. In this context, this work present a GUI strategy to build field arrangements based on scene graphs, to reduce time in Virtual Electricity Substations Arrangement development. Through this, mistakes during the VE building can be avoided making this process more reliable. As an concept proof, all toolkits developed in this work were applied in the virtualization of the substations from a Brazilian power concessionary named CEMIG.

Simulations in 3D research : Can Unity3D be used to simulate a 3D display system?

Mid Sweden University is currently researching how to capture more of a scene with a camera and how to create 3D images that does not require extra equipment for the viewer. In the process of this research they have started looking into simulating some of the tests that they wish to conduct. The goal of this project is to research whether the 3D graphics engine Unity3D could be used to simulate these tests, and to what degree. To test this a simulation was designed and implemented. The simulation used a split display system where each camera is directly connected to a part of the screen and using the position of the viewer the correct part of the camera feed is shown. Some literary studies were also done into how current 3D technology works. The simulation was successfully implemented and shows that simple simulation can be done in Unity3D, however, some problems were encountered in the process. The conclusion of the project show that there is much work left before simulation is viable but that there is potential in the technology and that the research team should continue to investigate it.

Multi-physics modelling - A vital component of virtual manufacturing

One of the core tasks of the virtual-manufacturing environment is to characterise the transformation of the state of material during each of the unit processes. This transformation in shape, material properties, etc. can only be reliably achieved through the use of models in a simulation context. Unfortunately, many manufacturing processes involve the material being treated in both the liquid and solid state, the trans-formation of which may be achieved by heat transfer and/or electro-magnetic fields. The computational modelling of such processes, involving the interactions amongst various interacting phenomena, is a consider-able challenge. However, it must be addressed effectively if Virtual Manufacturing Environments are to become a reality! This contribution focuses upon one attempt to develop such a multi-physics computational toolkit. The approach uses a single discretisation procedure and provides for direct interaction amongst the component phenomena. The need to exploit parallel high performance hardware is addressed so that simulation elapsed times can be brought within the realms of practicality. Examples of Multiphysics modelling in relation to shape casting, and solder joint formation reinforce the motivation for this work.

Design of Streaming Media Panoramic Video System Based on WebGL

2016 is the outbreak year of the virtual reality industry. In the field of virtual reality, 3D surveying plays an important role. Nowadays, 3D surveying technology has received increasing attention. This project aims to establish and optimize a WebGL three-dimensional broadcast platform combined with streaming media technology. It takes streaming media server and panoramic video broadcast in browser as the application background. Simultaneously, it discusses about the architecture from streaming media server to panoramic media player and analyzing relevant theory problem. This paper focuses on the debugging of streaming media platform, the structure of WebGL player environment, different types of ball model analysis, and the 3D mapping technology. The main work contains the following points: Initially, relay on Easy Darwin open source streaming media server, built a streaming service platform. It can realize the transmission from RTSP stream to streaming media server, and forwards HLS slice video to clients; Then, wrote a WebGL panoramic video player based on Three.js lib with JQuery browser playback controls. Set up a HTML5 panoramic video player; Next, analyzed the latitude and longitude sphere model which from Three.js library according to WebGL rendering method. Pointed out the drawbacks of this model and the breakthrough point of improvement; After that, on the basis of Schneider transform principle, established the Schneider sphere projection model, and converted the output OBJ file to JS file for media player reading. Finally implemented real time panoramic video high precision playing without plugin; At last, I summarized the whole project. Put forward the direction of future optimization and extensible market.

Virtual Learning Factory on VR-Supported Factory Planning

Part 13: Virtual Reality and Simulation

Sistema integrado de generación de mapas de profundidad para videoconferencia 3D en tiempo real

This paper presents the implementation of a high quality real-time 3D video system intended for 3D videoconferencing -- Basically, the system is able to extract depth information from a pair of images coming from a short-baseline camera setup -- The system is based on the use of a variant of the adaptive support-weight algorithm to be applied on GPU-based architectures -- The reason to do it is to get real-time results without compromising accuracy and also to reduce costs by using commodity hardware -- The complete system runs over the GStreamer multimedia software platform to make it even more flexible -- Moreover, an autoestereoscopic display has been used as the end-up terminal for 3D content visualization

Developing a methodology for co-creation using extended reality technologies.

Amid the remarkable growth of innovative technologies, particularly immersive technologies like Extended Reality (XR) (comprising of Virtual Reality (VR), Augmented Reality (AR) & Mixed Reality (MR)), a transformation is unfolding in the way we collaborate and interact. The current research takes the initiative to explore XR’s potential for co-creation activities and proposes XR as a future co-creation platform. It strives to develop a XR-based co-creation system, actively engage stakeholders in the co-creation process, with the goal of enhancing their creative businesses. The research leverages XR tools to investigate how they can enhance digital co-creation methods and determine if the system facilitates efficient and effective value creation during XR-based co-creation sessions. In specific terms, the research probes into whether the XR-based co-creation method and environment enhances the quality and novelty of ideas, reduce communication challenges by providing better understanding of the product, problem or process and optimize the process in terms of reduction in time and costs. The research introduces a multi-user, multi-sensory collaborative and interactive XR platform that adapts to various use-case scenarios. This thesis also presents the user testing performed to collect both qualitative and quantitative data, which serves to substantiate the hypothesis. What sets this XR system apart is its incorporation of fully functional prototypes into a mixed reality environment, providing users with a unique dimension within an immersive digital landscape. The outcomes derived from the experimental studies demonstrate that XR-based co-creation surpasses conventional desktop co-creation methods and remarkably, the results are even comparable to a full mock-up test. In conclusion, the research underscores that the utilization of XR as a tool for co-creation generates substantial value. It serves as a method that enhances the process, an environment that fosters interaction and collaboration, and a platform that equips stakeholders with the means to engage effectively.

Augmented Reality for Airport Control Tower: Analysis and Implementation of Safety Nets

With the development of new technologies, Air Traffic Control, in the nearby of the airport, switched from a purely visual control to the use of radar, sensors and so on. As the industry is switching to the so-called Industry 4.0, also in this frame, it would be possible to implement some of the new tools that can facilitate the work of Air Traffic Controllers. The European Union proposed an innovative project to help the digitalization of the European Sky by means of the Single European Sky ATM Research (SESAR) program, which is the foundation on which the Single European Sky (SES) is based, in order to improve the already existing technologies to transform Air Traffic Management in Europe. Within this frame, the Resilient Synthetic Vision for Advanced Control Tower Air Navigation Service Provision (RETINA) project, which saw the light in 2016, studied the possibility to apply new tools within the conventional control tower to reduce the air traffic controller workload, thanks to the improvements in the augmented reality technologies. After the validation of RETINA, the Digital Technologies for Tower (DTT) project was established and the solution proposed by the University of Bologna aimed, among other things, to introduce Safety Nets in a Head-Up visualization. The aim of this thesis is to analyze the Safety Nets in use within the control tower and, by developing a working concept, implement them in a Head-Up view to be tested by Air Traffic Control Operators (ATCOs). The results, coming from the technical test, show that this concept is working and it could be leading to a future implementation in a real environment, as it improves the air traffic controller working conditions also when low visibility conditions apply.

O ambiente virtual de aprendizagem e sua incorporação na Unicamp

The text describes a study about the adoption of virtual learning environments and its consequences to the learning process of undergraduate students at the State University of Campinas - Unicamp. These environments can be incorporated in various ways into the academic daily life of students and teachers. One efficient way to promote the adoption of these environments, as observed by the Distance Learning support team, is to train teachers and students in their use. Two training alternatives are described in this text to instruct the academic community in the use of TelEduc, a freeware developed and coordinated by the NIED - Núcleo de Informática Aplicada à Educação (Center for Information Technology Applied to Education), and officially adopted by Unicamp. Training courses are offered in two ways - presence or distance learning - to suit each teacher's preferences. This article compares the two modes of training, showing their strong and weak points. The adoption of TelEduc and its direct consequences to the learning process are described in a study carried out with some engineering undergraduates at Unicamp. The authors' questions and the general views of teachers and students regarding the effectiveness of the use of TelEduc as a supporting tool to presence teaching are presented. This investigation revealed the importance of training teachers in the effective use of these environments.

A laparoscopic surgery training interface

Laparoscopy is a surgical procedure on which operations in the abdomen are performed through small incisions using several specialized instruments. The laparoscopic surgery success greatly depends on surgeon skills and training. To achieve these technical high-standards, different apprenticeship methods have been developed, many based on in vivo training, an approach that involves high costs and complex setup procedures. This paper explores Virtual Reality (VR) simulation as an alternative for novice surgeons training. Even though several simulators are available on the market claiming successful training experiences, their use is extremely limited due to the economic costs involved. In this work, we present a low-cost laparoscopy simulator able to monitor and assist the trainee’s surgical movements. The developed prototype consists of a set of inexpensive sensors, namely an accelerometer, a gyroscope, a magnetometer and a flex sensor, attached to specific laparoscopic instruments. Our approach allows repeated assisted training of an exercise, without time constraints or additional costs, since no human artificial model is needed. A case study of our simulator applied to instrument manipulation practice (hand-eye coordination) is also presented.

Effects of emotional valence and three-dimensionality of visual stimuli on brain activation: an fMRI study

BACKGROUND: Examining changes in brain activation linked with emotion-inducing stimuli is essential to the study of emotions. Due to the ecological potential of techniques such as virtual reality (VR), inspection of whether brain activation in response to emotional stimuli can be modulated by the three-dimensional (3D) properties of the images is important. OBJECTIVE: The current study sought to test whether the activation of brain areas involved in the emotional processing of scenarios of different valences can be modulated by 3D. Therefore, the focus was made on the interaction effect between emotion-inducing stimuli of different emotional valences (pleasant, unpleasant and neutral valences) and visualization types (2D, 3D). However, main effects were also analyzed.METHODS: The effect of emotional valence and visualization types and their interaction were analyzed through a 3x2 repeated measures ANOVA. Post-hoc t-tests were performed under a ROI-analysis approach. RESULTS: The results show increased brain activation for the 3D affective-inducing stimuli in comparison with the same stimuli in 2D scenarios, mostly in cortical and subcortical regions that are related to emotional processing, in addition to visual processing regions. CONCLUSIONS: This study has the potential of clarify brain mechanisms involved in the processing of emotional stimuli (scenarios’ valence) and their interaction with three-dimensionality.