Exploring the World's Visual History

Thesis (Ph.D.)--University of Washington, 2016-08

Applying Augmented Reality to Outdoors Industrial Use

Augmented Reality (AR) is currently gaining popularity in multiple different fields. However, the technology for AR still requires development in both hardware and software when considering industrial use. In order to create immersive AR applications, more accurate pose estimation techniques to define virtual camera location are required. The algorithms for pose estimation often require a lot of processing power, which makes robust pose estimation a difficult task when using mobile devices or designated AR tools. The difficulties are even larger in outdoor scenarios where the environment can vary a lot and is often unprepared for AR. This thesis aims to research different possibilities for creating AR applications for outdoor environments. Both hardware and software solutions are considered, but the focus is more on software. The majority of the thesis focuses on different visual pose estimation and tracking techniques for natural features. During the thesis, multiple different solutions were tested for outdoor AR. One commercial AR SDK was tested, and three different custom software solutions were developed for an Android tablet. The custom software solutions were an algorithm for combining data from magnetometer and a gyroscope, a natural feature tracker and a tracker based on panorama images. The tracker based on panorama images was implemented based on an existing scientific publication, and the presented tracker was further developed by integrating it to Unity 3D and adding a possibility for augmenting content. This thesis concludes that AR is very close to becoming a usable tool for professional use. The commercial solutions currently available are not yet ready for creating tools for professional use, but especially for different visualization tasks some custom solutions are capable of achieving a required robustness. The panorama tracker implemented in this thesis seems like a promising tool for robust pose estimation in unprepared outdoor environments.

Comando e Controlo na Artilharia Antiaérea

O presente trabalho, subordinado à temática “Comando e Controlo na Artilharia Antiaérea”, pretende problematizar algumas das questões mais recentes relativas a matérias de segurança e defesa, fruto dos mais recentes acontecimentos. Por exemplo, refira-se o abate do voo comercial na Ucrânia, entre outros inúmeros casos que se constituem como fatores que levam a questionar a capacidade de defesa dos Estados face ao fácil acesso e baixo custo destes meios, à mercê de pessoas/organizações criminosas e terroristas. Assim, é premente a necessidade de aquisição, por parte dos Estados, nomeadamente de Portugal, de uma Artilharia mais robusta e com um sistema de Comando e Controlo automático capaz de combater as potenciais e prováveis ameaças aéreas. Esta investigação pretende, então, analisar o atual sistema de Comando e Controlo da Artilharia Antiaérea nacional, por forma a identificar as suas capacidades e, em paralelo, as suas vulnerabilidades. Concomitantemente pretende-se analisar o sistema perante as ameaças aéreas e as operações que deverá executar no âmbito dos compromissos internacionais, com o objetivo fulcral de identificar prováveis potencialidades que deverão integrar o referido sistema. Pretende-se, deste modo, propor uma revisão do atual sistema no sentido de colmatar as suas prováveis lacunas e capacitando-o para uma resposta eficaz e efetiva perante eventuais ameaças, na esteira dos compromissos internacionais. No início apresentamos uma ‘revisão de literatura’ para que o leitor se familiarize com os conceitos e nomenclatura em uso nesta reflexão. Subsequentemente, expõe-se a metodologia empregue e são abordados os sistemas de Defesa Aérea e de Artilharia Antiaérea e, posteriormente, o Comando e Controlo. De seguida, apresenta-se uma análise possível dos dados provenientes das entrevistas executadas. Baseando-nos na investigação realizada, conclui-se que a Artilharia Antiaérea corre o risco sério de não dispor de capacidade de defesa, a baixa e muito baixa altitude, se não forem adquiridos rapidamente os materiais imprescindíveis para que os sistemas possam cabalmente atuar.

Development of a semi-automatic self learning pattern recognition system for the control of electronic boards

This project was funded under the Applied Research Grants Scheme administered by Enterprise Ireland. The project was a partnership between Galway - Mayo Institute of Technology and an industrial company, Tyco/Mallinckrodt Galway. The project aimed to develop a semi - automatic, self - learning pattern recognition system capable of detecting defects on the printed circuits boards such as component vacancy, component misalignment, component orientation, component error, and component weld. The research was conducted in three directions: image acquisition, image filtering/recognition and software development. Image acquisition studied the process of forming and digitizing images and some fundamental aspects regarding the human visual perception. The importance of choosing the right camera and illumination system for a certain type of problem has been highlighted. Probably the most important step towards image recognition is image filtering, The filters are used to correct and enhance images in order to prepare them for recognition. Convolution, histogram equalisation, filters based on Boolean mathematics, noise reduction, edge detection, geometrical filters, cross-correlation filters and image compression are some examples of the filters that have been studied and successfully implemented in the software application. The software application developed during the research is customized in order to meet the requirements of the industrial partner. The application is able to analyze pictures, perform the filtering, build libraries, process images and generate log files. It incorporates most of the filters studied and together with the illumination system and the camera it provides a fully integrated framework able to analyze defects on printed circuit boards.

Complex Adaptive On-line Learning System “Theory of Automatic Control"

The controlled from distance teaching (DT) in the system of technical education has a row of features: complication of informative content, necessity of development of simulation models and trainers for conducting of practical and laboratory employments, conducting of knowledge diagnostics on the basis of mathematical-based algorithms, organization of execution collective projects of the applied setting. For development of the process of teaching bases of fundamental discipline control system Theory of automatic control (TAC) the combined approach of optimum combination of existent programmatic instruments of support was chosen DT and own developments. The system DT TAC included: controlled from distance course (DC) of TAC, site of virtual laboratory practical works in LAB.TAC and students knowledge remote diagnostic system d-tester.

Does Training Laparoscopic Skills in a Virtual Reality Simulator Improve Surgical Performance?

Background and Purpose: Several different methods of teaching laparoscopic skills have been advocated, with virtual reality surgical simulation (VRSS) being the most popular. Its effectiveness in improving surgical performance is not a consensus yet, however. The purpose of this study was to determine whether practicing surgical skills in a virtual reality simulator results in improved surgical performance. Materials and Methods: Fifteen medical students recruited for the study were divided into three groups. Group I (control) did not receive any VRSS training. For 10 weeks, group II trained basic laparoscopic skills (camera handling, cutting skill, peg transfer skill, and clipping skill) in a VRSS laparoscopic skills simulator. Group III practiced the same skills and, in addition, performed a simulated cholecystectomy. All students then performed a cholecystectomy in a swine model. Their performance was reviewed by two experienced surgeons. The following parameters were evaluated: Gallbladder pedicle dissection time, clipping time, time for cutting the pedicle, gallbladder removal time, total procedure time, and blood loss. Results: With practice, there was improvement in most of the evaluated parameters by each of the individuals. There were no statistical differences in any of evaluated parameters between those who did and did not undergo VRSS training, however. Conclusion: VRSS training is assumed to be an effective tool for learning and practicing laparoscopic skills. In this study, we could not demonstrate that VRSS training resulted in improved surgical performance. It may be useful, however, in familiarizing surgeons with laparoscopic surgery. More effective methods of teaching laparoscopic skills should be evaluated to help in improving surgical performance.

An approach of optimal sensitivity applied in the tertiary loop of the automatic generation control

This paper proposes an approach of optimal sensitivity applied in the tertiary loop of the automatic generation control. The approach is based on the theorem of non-linear perturbation. From an optimal operation point obtained by an optimal power flow a new optimal operation point is directly determined after a perturbation, i.e., without the necessity of an iterative process. This new optimal operation point satisfies the constraints of the problem for small perturbation in the loads. The participation factors and the voltage set point of the automatic voltage regulators (AVR) of the generators are determined by the technique of optimal sensitivity, considering the effects of the active power losses minimization and the network constraints. The participation factors and voltage set point of the generators are supplied directly to a computational program of dynamic simulation of the automatic generation control, named by power sensitivity mode. Test results are presented to show the good performance of this approach. (C) 2008 Elsevier B.V. All rights reserved.

New Shop Floor Control Approaches for Virtual Enterprises

The virtual enterprise paradigm seems a fit response to face market instability and the volatile nature of business opportunities increasing enterprise’s interest in similar forms of networked organisations. The dynamic environment of a virtual enterprise requires that partners in the consortium own reconfigurable shop floors. This paper presents new approaches to shop floor control that meet the requirements of the new industrial paradigms and argues on work re-organization at shop floor level.

Desarrollo y aplicación de estrategias de control avanzado en procesos biológicos de tratamiento de efluentes contaminados

En este proyecto se ha desarrollado estrategias de control avanzadas para plantas de depuración de aguas residuales urbanas que eliminan conjuntamente materia orgánica, nitrógeno y fósforo. Las estrategias se han basado en el estudio multivariable del comportamiento del sistema, que ha producido subsidios para la utilización de lazos de control feedforward, de control predictivo y de un control de costes que automáticamente enviaba las consignas más adecuadas para los controladores de proceso. Para el desarrollo de las estrategias, se ha creado un sistema virtual de simulación (simulador) de plantas de depuradoras, basado en datos de literatura. Para el caso de una planta real, se ha desarrollado un simulador de la planta de Manresa (Catalunya). Sin embargo, el sistema de Manresa se ha utilizado exclusivamente para auxiliar los ingenieros de la planta en la tomada de decisiones de cambio de configuración para que la eliminación de fósforo se dé por la ruta biológica y no por la ruta química. La implementación de los simuladores ha permitido hacer muchas pruebas que en una planta real demandarían mucho tiempo y consumirían muchos recursos energéticos y financieros. Las estrategias de control más elaboradas han podido ahorrar hasta 150.000,00 Euros por año en relación a la operación de la planta sin el control automático. Cuanto a los estudios del modelo de la planta real, se concluyó que la eliminación biológica de fósforo puede sustituir el actual proceso químico de eliminación de fósforo, bajando los costes operacionales (costes del agente precipitante).

Integración del archivo de imágenes de un telescopio robótico al observatorio virtual

S’ha implementat un servei VO (Virtual Observatori) a les instal lacions del Telescopi TFRM, que permet distribuir les imatges preses amb el telescopi de manera remota i automàtica a qualsevol usuari del servei. El servei està format per un arxiu d’imatges, una aplicació que integra les imatges a l'arxiu y una aplicació que es comunica amb els clients d’VO, rebent peticions i responen segons s’especifica al protocol SIAP (Simple Image Access Protocol).

Using the optical flow to implement a relative virtual mouse controlled by head movements

The following paper introduces the work conducted to create a relative virtual mouse based on the interpretation of head movements and face gesture through a low cost camera and the optical flow of the images. This virtual device is designed specifically as an alternative non-contact pointer for people with mobility impairments in the upper extremities and reduced head control. The proposed virtual device was compared with a conventional mouse, a touchpad and a digital joystick. Validation results show performances close to a digital joystick but far away from a conventional mouse.

An embedded real-time red peach detection system based on an OV7670 camera, ARM Cortex-M4 processor and 3D Look-Up Tables

This work proposes the development of an embedded real-time fruit detection system for future automatic fruit harvesting. The proposed embedded system is based on an ARM Cortex-M4 (STM32F407VGT6) processor and an Omnivision OV7670 color camera. The future goal of this embedded vision system will be to control a robotized arm to automatically select and pick some fruit directly from the tree. The complete embedded system has been designed to be placed directly in the gripper tool of the future robotized harvesting arm. The embedded system will be able to perform real-time fruit detection and tracking by using a three-dimensional look-up-table (LUT) defined in the RGB color space and optimized for fruit picking. Additionally, two different methodologies for creating optimized 3D LUTs based on existing linear color models and fruit histograms were implemented in this work and compared for the case of red peaches. The resulting system is able to acquire general and zoomed orchard images and to update the relative tracking information of a red peach in the tree ten times per second.

Differential effects of two virtual reality interventions: distraction versus pain control

There is evidence that virtual reality (VR) pain distraction is effective at improving pain-related outcomes. However, more research is needed to investigate VR environments with other pain-related goals. The main aim of this study was to compare the differential effects of two VR environments on a set of pain-related and cognitive variables during a cold pressor experiment. One of these environments aimed to distract attention away from pain (VRD), whereas the other was designed to enhance pain control (VRC). Participants were 77 psychology students, who were randomly assigned to one of the following three conditions during the cold pressor experiment: (a) VRD, (b) VRC, or (c) Non-VR (control condition). Data were collected regarding both pain-related variables (intensity, tolerance, threshold, time perception, and pain sensitivity range) and cognitive variables (self-efficacy and catastrophizing). Results showed that in comparison with the control condition, the VRC intervention significantly increased pain tolerance, the pain sensitivity range, and the degree of time underestimation. It also increased self-efficacy in tolerating pain and led to a reduction in reported helplessness. The VRD intervention significantly increased the pain threshold and pain tolerance in comparison with the control condition, but it did not affect any of the cognitive variables. Overall, the intervention designed to enhance control seems to have a greater effect on the cognitive variables assessed. Although these results need to be replicated in further studies, the findings suggest that the VRC intervention has considerable potential in terms of increasing self-efficacy and modifying the negative thoughts that commonly accompany pain problems.

Automatic and manual spray bar sections control

The use of precision farming tools in pesticide application technology can improve the techniques effectiveness during the spraying. Thus, this study aimed to compare automatic and manual systems to interrupt the syrup flow in the spray bar sections when applied in overlapped areas. The sprayings were carried out in eight places in completely randomized design. It was compared the spray consumption and the sprayed area in relation to the total area. The results indicated that in sprays performed with the automatic system there was an average savings of 17.2% of the sprayed volume. The sprayed area using the bar section's automatic control was an average 6.1% lower than the sprayed area with manual control.

Virtual technology and haptic interface solutions for design and control of mobile working machines

Commercially available haptic interfaces are usable for many purposes. However, as generic devices they are not the most suitable for the control of heavy duty mobile working machines like mining machines, container handling equipment and excavators. Alternative mechanical constructions for a haptic controller are presented and analysed. A virtual reality environment (VRE) was built to test the proposed haptic controller mechanisms. Verification of an electric motor emulating a hydraulic pump in the electro-hydraulic system of a mobile working machine is carried out. A real-time simulator using multi-body-dynamics based software with hardware-in-loop (HIL) setup was used for the tests. Recommendations for further development of a haptic controller and emulator electric motor are given.