Utilizing Depth Information for Emerging 3D Applications

Thesis (Ph.D.)--University of Washington, 2016-06

A First Order Predicate Logic Formulation of the 3D Reconstruction Problem and its Solution Space

This paper defines the 3D reconstruction problem as the process of reconstructing a 3D scene from numerous 2D visual images of that scene. It is well known that this problem is ill-posed, and numerous constraints and assumptions are used in 3D reconstruction algorithms in order to reduce the solution space. Unfortunately, most constraints only work in a certain range of situations and often constraints are built into the most fundamental methods (e.g. Area Based Matching assumes that all the pixels in the window belong to the same object). This paper presents a novel formulation of the 3D reconstruction problem, using a voxel framework and first order logic equations, which does not contain any additional constraints or assumptions. Solving this formulation for a set of input images gives all the possible solutions for that set, rather than picking a solution that is deemed most likely. Using this formulation, this paper studies the problem of uniqueness in 3D reconstruction and how the solution space changes for different configurations of input images. It is found that it is not possible to guarantee a unique solution, no matter how many images are taken of the scene, their orientation or even how much color variation is in the scene itself. Results of using the formulation to reconstruct a few small voxel spaces are also presented. They show that the number of solutions is extremely large for even very small voxel spaces (5 x 5 voxel space gives 10 to 10(7) solutions). This shows the need for constraints to reduce the solution space to a reasonable size. Finally, it is noted that because of the discrete nature of the formulation, the solution space size can be easily calculated, making the formulation a useful tool to numerically evaluate the usefulness of any constraints that are added.

Virtual training environments to improve train driver's crisis decision making

This paper reports on a current research project in which virtual reality simulators are being investigated as a means of simulating hazardous Rail work conditions in order to allow train drivers to practice decision-making under stress. When working under high stress conditions train drivers need to move beyond procedural responses into a response activated through their own problem-solving and decision-making skills. This study focuses on the use of stress inoculation training which aims to build driver’s confidence in the use of new decision-making skills by being repeatedly required to respond to hazardous driving conditions. In particular, the study makes use of a train cab driving simulator to reproduce potentially stress inducing real-world scenarios. Initial pilot research has been undertaken in which drivers have experienced the training simulation and subsequently completed surveys on the level of immersion experienced. Concurrently drivers have also participated in a velocity perception experiment designed to objectively measure the fidelity of the virtual training environment. Baseline data, against which decision-making skills post training will be measured, is being gathered via cognitive task analysis designed to identify primary decision requirements for specific rail events. While considerable efforts have been invested in improving Virtual Reality technology, little is known about how to best use this technology for training personnel to respond to workplace conditions in the Rail Industry. To enable the best use of simulators for training in the Rail context the project aims to identify those factors within virtual reality that support required learning outcomes and use this information to design training simulations that reliably and safely train staff in required workplace accident response skills.

Enhancing experiential learning via virtual environments

Research indicates Virtual Reality (VR) is delivering on it's promised potential to provide enhanced training and education outcomes. A significant research project, at the University of Queensland, has constructed a number of virtual contexts in which the phenomena experienced by patients who have psychosis are reproduced for use in psychiatry education. Symptoms of psychosis reproduced include delusions, hallucinations and thought disorder. The new software enables psychiatry students to experience the inner world of a patient with psychosis. Lecturers in psychiatry report VR has the potential to enhance student's abilities to actually 'feel' the types of emotions and physiological reactions a hallucination precipitates in a patient. The current work of the project and stages of software development will be demonstrated. The virtual environments provide a new method of delivering experiential learning opportunities to higher education classrooms.

Multimodal Man-machine Interface and Virtual Reality for Assistive Medical Systems

The results of research the intelligence multimodal man-machine interface and virtual reality means for assistive medical systems including computers and mechatronic systems (robots) are discussed. The gesture translation for disability peoples, the learning-by-showing technology and virtual operating room with 3D visualization are presented in this report and were announced at International exhibition "Intelligent and Adaptive Robots–2005".

3D Laser Scanning for Digital Preservation and Dissemination of Cultural Heritage Main scanned objects - Four Temples of Different Religions in Sofia

The project demonstrates the use of modern technologies for preservation and presentation of the cultural and historical heritage. The idea is a database of cultural and historical heritage sites to be created applying three dimensional laser scanning technology and a combination of geodetic and photogrammetric methods and shooting techniques. For the purposes of carrying out this project, we have focused on some heritage sites in the central part of Sofia. We decided to include these particular buildings because of the fact that there is hardly another city in the world where within a radius of 400 m are located four temples of different religions - Jewish, Muslim, Orthodox and Catholic. In the recent years, preservation of cultural heritage has been increasingly linked to objectives of sustainable development. Today, it has become clear that cultural heritage is also an economic resource that should be used for further economic development (through compulsory preservation of its authentic cultural values). There has been a more active public debate on the role of cultural heritage, regarding the following topics: improving the quality of life through development of cultural tourism, leading to an increase of the employment rate, constantly improving the business climate, etc. Cultural heritage preservation is becoming one of the priority objectives of the urban development policy. The focus has been shifted to new ways of preservation, mainly combinations of sophisticated technological solutions and their application for the purposes of preservation and dissemination of the cultural heritage.

Moving Boundary: A Virtual Museum of the Ethnic Groups

The virtual museum of ethnic groups “Moving boundary” is a proposition for dialogue on an important topic in today's world – ethnic coexistence. The project's goal is to make various resources (photos, documents, etc.) available for use by teachers, professors and students, thus forming and strengthening connections between educational institutions.

Knowledge-based Virtual Reconstruction of Museum Artifacts

Within the framework of heritage preservation, 3D scanning and modeling for heritage documentation has increased significantly in recent years, mainly due to the evolution of laser and image-based techniques, modeling software, powerful computers and virtual reality. 3D laser acquisition constitutes a real development opportunity for 3D modeling based previously on theoretical data. The representation of the object information rely on the knowledge of its historic and theoretical frame to reconstitute a posteriori its previous states. This project proposes an approach dealing with data extraction based on architectural knowledge and Laser statement informing measurements, the whole leading to 3D reconstruction. The experimented Khmer objects are exposed at Guimet museum in Paris. The purpose of this digital modeling meets the need of exploitable models for simulation projects, prototyping, exhibitions, promoting cultural tourism and particularly for archiving against any likely disaster and as an aided tool for the formulation of virtual museum concept.

Digitization and 3D Scanning of Historical Artifacts

Protection and preservation of our cultural and literary historical and documentary heritage are particularly relevant today. The paper presents methods for creating digital resources of historical artifacts related to the Balkan war. Special attention is paid to the process of 3D scanning of objects. The methodology will be used in building an electronic archive and Virtual Museum.

The Architecture of 3D Administration

The objective of this article is to introduce the main blocks in building virtual front and back offices of public administration. Virtual administration is probably kind of an ultimate or top stage of ICT platforms of e-government. First a justification is given why 3D government fits in the recent EU directives of e-government development. The relevant scholarship contains a brief description of the visualized e-government, and then a fully illustrated, step by step survey reveals the itinerary to construct virtual government which is the main result of the study. The article concludes with a discussion on the practical benefit of such a research if there is one.

Coral Gables Virtual History

Florida International University has partnered with the City of Coral Gables to create a geospatially-enabled Virtual Historic City. With this tool, users may navigate to any point in the city at a selected time period (e.g. the Biltmore Hotel from the 1920s to 1940s) and experience the city as it was, through a wide variety of cultural artifacts and textual materials. A virtual walking tour of Coral Gables was also created, which includes an audio narration and 3D simulations providing the façades of historic buildings and landscape. Students, educators, historians, public policy administrators, architects, sociologists, environmental analysts, urban planners, and the general public can explore over 8,000 historical documents, photographs, oral histories, and maps that have been spatially registered to their relevant locations and time.

Entorno de realidad virtual controlado en tiempo real por señales motoras para la rehabilitación del miembro superior en pacientes con daño cerebral

Este trabajo tiene como meta el desarrollo de un sistema de neurorrehabilitación mediante realidad virtual para pacientes con problemas motores en las extremidades superiores provocados por un daño cerebral. Para entender y enfrentarse de manera correcta al problema, se han revisado todos los aspectos concernientes al daño cerebral y déficits motores derivados así como las terapias empleadas para su rehabilitación, como las que utilizan tecnologías asistidas como la realidad virtual. Se han expuesto las ventajas que han llevado a utilizar esta terapia en el proyecto y se han mencionado algunos estudios de investigación previos y con resultados favorables. Por último, se ha hecho hincapié en las novedades (embodiment y neuronas espejo) que aporta este proyecto con las que se podría acelerar la rehabilitación de los pacientes incidiendo en la plasticidad cerebral. En lo que se refiere al desarrollo del entorno, se ha utilizado el motor de videojuegos Unity 3D, con el que se ha integrado el dispositivo Myo Armband, para capturar el movimiento, y las gafas de realidad virtual Oculus Rift DK2. Durante la terapia, el paciente tiene que superar una serie de niveles definidos por el terapeuta y, para ello, debe realizar un alcance y tocar un botón un número de veces por cada nivel. En cada nivel, el esfuerzo que tiene que realizar el paciente es distinto, dependiendo de la distancia a la que se encuentre el botón (relativa al calibrado previo del paciente) e igualmente, está definido por el terapeuta. También se lleva a cabo un registro de las aceleraciones y del porcentaje de acierto del paciente en un fichero, para llevar un control de su progreso. Como conclusión, cabe mencionar que el entorno desarrollado es adaptable a las posibilidades de cada paciente, permitiendo una recuperación óptima. Se trata de un sistema de bajo coste, intuitivo y que lleva a cabo un registro de datos de la actividad del paciente, lo que posibilita, como trabajo futuro, el control de forma remota por parte del terapeuta. Todos estos aspectos dejan abierta la posibilidad de que el paciente lo utilice a domicilio, con las ventajas que conlleva. Del mismo modo, el sistema se podría adaptar fácilmente para la rehabilitación de las extremidades inferiores. Tras su análisis, los investigadores expertos en la materia del Consejo Superior de Investigaciones Científicas afirman que el sistema satisface con creces su propósito. Con todo esto, se concluye que este entorno tiene un excelente presente y un futuro muy prometedor.

Sistemas de cálculo, análise e operação virtual: interferências de campos elétricos e magnéticos produzidas por estações radio base de acesso múltiplo por divisão de código em banda larga - WCDMA

In this work it was developed mathematical resolutions taking as parameter maximum intensity values for the interference analysis of electric and magnetic fields and was given two virtual computer system that supports families of CDMA and WCDMA technologies. The first family were developed computational resources to solve electric and magnetic field calculations and power densities in Radio Base stations , with the use of CDMA technology in the 800 MHz band , taking into account the permissible values referenced by the Commission International Protection on non-Ionizing Radiation . The first family is divided into two segments of calculation carried out in virtual operation. In the first segment to compute the interference field radiated by the base station with input information such as radio channel power; Gain antenna; Radio channel number; Operating frequency; Losses in the cable; Attenuation of direction; Minimum Distance; Reflections. Said computing system allows to quickly and without the need of implementing instruments for measurements, meet the following calculated values: Effective Radiated Power; Sector Power Density; Electric field in the sector; Magnetic field in the sector; Magnetic flux density; point of maximum permissible exposure of electric field and power density. The results are shown in charts for clarity of view of power density in the industry, as well as the coverage area definition. The computer module also includes folders specifications antennas, cables and towers used in cellular telephony, the following manufacturers: RFS World, Andrew, Karthein and BRASILSAT. Many are presented "links" network access "Internet" to supplement the cable specifications, antennas, etc. . In the second segment of the first family work with more variables , seeking to perform calculations quickly and safely assisting in obtaining results of radio signal loss produced by ERB . This module displays screens representing propagation systems denominated "A" and "B". By propagating "A" are obtained radio signal attenuation calculations in areas of urban models , dense urban , suburban , and rural open . In reflection calculations are present the reflection coefficients , the standing wave ratio , return loss , the reflected power ratio , as well as the loss of the signal by mismatch impedance. With the spread " B" seek radio signal losses in the survey line and not targeted , the effective area , the power density , the received power , the coverage radius , the conversion levels and the gain conversion systems radiant . The second family of virtual computing system consists of 7 modules of which 5 are geared towards the design of WCDMA and 2 technology for calculation of telephone traffic serving CDMA and WCDMA . It includes a portfolio of radiant systems used on the site. In the virtual operation of the module 1 is compute-: distance frequency reuse, channel capacity with noise and without noise, Doppler frequency, modulation rate and channel efficiency; Module 2 includes computes the cell area, thermal noise, noise power (dB), noise figure, signal to noise ratio, bit of power (dBm); with the module 3 reaches the calculation: breakpoint, processing gain (dB) loss in the space of BTS, noise power (w), chip period and frequency reuse factor. Module 4 scales effective radiated power, sectorization gain, voice activity and load effect. The module 5 performs the calculation processing gain (Hz / bps) bit time, bit energy (Ws). Module 6 deals with the telephone traffic and scales 1: traffic volume, occupancy intensity, average time of occupancy, traffic intensity, calls completed, congestion. Module 7 deals with two telephone traffic and allows calculating call completion and not completed in HMM. Tests were performed on the mobile network performance field for the calculation of data relating to: CINP , CPI , RSRP , RSRQ , EARFCN , Drop Call , Block Call , Pilot , Data Bler , RSCP , Short Call, Long Call and Data Call ; ECIO - Short Call and Long Call , Data Call Troughput . As survey were conducted surveys of electric and magnetic field in an ERB , trying to observe the degree of exposure to non-ionizing radiation they are exposed to the general public and occupational element. The results were compared to permissible values for health endorsed by the ICNIRP and the CENELEC .