Online calibration of stereo rigs for long-term autonomy

Stereo-based visual odometry algorithms are heavily dependent on an accurate calibration of the rigidly fixed stereo pair. Even small shifts in the rigid transform between the cameras can impact on feature matching and 3D scene triangulation, adversely affecting pose estimates and applications dependent on long-term autonomy. In many field-based scenarios where vibration, knocks and pressure change affect a robotic vehicle, maintaining an accurate stereo calibration cannot be guaranteed over long periods. This paper presents a novel method of recalibrating overlapping stereo camera rigs from online visual data while simultaneously providing an up-to-date and up-to-scale pose estimate. The proposed technique implements a novel form of partitioned bundle adjustment that explicitly includes the homogeneous transform between a stereo camera pair to generate an optimal calibration. Pose estimates are computed in parallel to the calibration, providing online recalibration which seamlessly integrates into a stereo visual odometry framework. We present results demonstrating accurate performance of the algorithm on both simulated scenarios and real data gathered from a wide-baseline stereo pair on a ground vehicle traversing urban roads.

High altitude stereo visual odometry

Stereo visual odometry has received little investigation in high altitude applications due to the generally poor performance of rigid stereo rigs at extremely small baseline-to-depth ratios. Without additional sensing, metric scale is considered lost and odometry is seen as effective only for monocular perspectives. This paper presents a novel modification to stereo based visual odometry that allows accurate, metric pose estimation from high altitudes, even in the presence of poor calibration and without additional sensor inputs. By relaxing the (typically fixed) stereo transform during bundle adjustment and reducing the dependence on the fixed geometry for triangulation, metrically scaled visual odometry can be obtained in situations where high altitude and structural deformation from vibration would cause traditional algorithms to fail. This is achieved through the use of a novel constrained bundle adjustment routine and accurately scaled pose initializer. We present visual odometry results demonstrating the technique on a short-baseline stereo pair inside a fixed-wing UAV flying at significant height (~30-100m).

Robust scale initialization for long-range stereo visual odometry

Achieving a robust, accurately scaled pose estimate in long-range stereo presents significant challenges. For large scene depths, triangulation from a single stereo pair is inadequate and noisy. Additionally, vibration and flexible rigs in airborne applications mean accurate calibrations are often compromised. This paper presents a technique for accurately initializing a long-range stereo VO algorithm at large scene depth, with accurate scale, without explicitly computing structure from rigidly fixed camera pairs. By performing a monocular pose estimate over a window of frames from a single camera, followed by adding the secondary camera frames in a modified bundle adjustment, an accurate, metrically scaled pose estimate can be found. To achieve this the scale of the stereo pair is included in the optimization as an additional parameter. Results are presented both on simulated and field gathered data from a fixed-wing UAV flying at significant altitude, where the epipolar geometry is inaccurate due to structural deformation and triangulation from a single pair is insufficient. Comparisons are made with more conventional VO techniques where the scale is not explicitly optimized, and demonstrated over repeated trials to indicate robustness.

A 3D virtual medical imaging suite : bridging the academic-clinical training boundary

Aims The Medical Imaging Training Immersive Environment (MITIE) system is a recently developed virtual reality (VR) platform that allows students to practice a range of medical imaging techniques. The aim of this pilot study was to harvest user feedback about the educational value of the application and inform future pedagogical development. This presentation explores the use of this technology for skills training and blurring the boundaries between academic learning and clinical skills training. Background MITIE is a 3D VR environment that allows students to manipulate a patient and radiographic equipment in order to produce a VR-generated image for comparison with a gold standard. As with VR initiatives in other health disciplines (1-6) the software mimics clinical practice as much as possible and uses 3D technology to enhance immersion and realism. The software was developed by the Medical Imaging Course Team at a provider University with funding from a Health Workforce Australia “Simulated Learning Environments” grant. Methods Over 80 students undertaking the Bachelor of Medical Imaging Course were randomised to receive practical experience with either MITIE or radiographic equipment in the medical radiation laboratory. Student feedback about the educational value of the software was collected and performance with an assessed setup was measured for both groups for comparison. Ethical approval for the project was provided by the university ethics panel. Results This presentation provides qualitative analysis of student perceptions relating to satisfaction, usability and educational value as well as comparative quantitative performance data. Students reported high levels of satisfaction and both feedback and assessment results confirmed the application’s significance as a pre-clinical training tool. There was a clear emerging theme that MITIE could be a useful learning tool that students could access to consolidate their clinical learning, either during their academic timetables or their clinical placement. Conclusion Student feedback and performance data indicate that MITIE has a valuable role to play in the clinical skills training for medical imaging students both in the academic and the clinical environment. Future work will establish a framework for an appropriate supporting pedagogy that can cross the boundary between the two environments. This project was possible due to funding made available by Health Workforce Australia.

An accuracy assessment of ASTER stereo images-derived digital elevation model by using rational polynomial coefficient model

The along-track stereo images of Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) sensor with 15 m resolution were used to generate Digital Elevation Model (DEM) on an area with low and near Mean Sea Level (MSL) elevation in Johor, Malaysia. The absolute DEM was generated by using the Rational Polynomial Coefficient (RPC) model which was run on ENVI 4.8 software. In order to generate the absolute DEM, 60 Ground Control Pointes (GCPs) with almost vertical accuracy less than 10 meter extracted from topographic map of the study area. The assessment was carried out on uncorrected and corrected DEM by utilizing dozens of Independent Check Points (ICPs). Consequently, the uncorrected DEM showed the RMSEz of ± 26.43 meter which was decreased to the RMSEz of ± 16.49 meter for the corrected DEM after post-processing. Overall, the corrected DEM of ASTER stereo images met the expectations.

Echolocation call intensity in the aerial hawking bat Eptesicus bottae (Vespertilionidae) studied using stereo videogrammetry

Aerial hawking bats use intense echolocation calls to search for insect prey. Their calls have evolved into the most intense airborne animal vocalisations. Yet our knowledge about call intensities in the field is restricted to a small number of species. We describe a novel stereo videogrammetry method used to study flight and echolocation behaviour, and to measure call source levels of the aerial hawking bat Eptesicus bottae (Vespertilionidae). Bats flew close to their predicted minimum power speed. Source level increased with call duration; the loudest call of E. bottae was at 133 dB peSPL. The calculated maximum detection distance for large flying objects (e.g. large prey, conspecifics) was up to 21 m. The corresponding maximum echo delay is almost exactly the duration of one wing beat in E. bottae and this also is its preferred pulse interval. These results, obtained by using videogrammetry to track bats in the field, corroborate earlier findings from other species from acoustic tracking methods.

Long-range stereo visual odometry for unmanned aerial vehicles

This thesis explored the utility of long-range stereo visual odometry for application on Unmanned Aerial Vehicles. Novel parameterisations and initialisation routines were developed for the long-range case of stereo visual odometry and new optimisation techniques were implemented to improve the robustness of visual odometry in this difficult scenario. In doing so, the applications of stereo visual odometry were expanded and shown to perform adequately in situations that were previously unworkable.

Simultaneous underwater visibility assessment, enhancement and improved stereo

Vision-based underwater navigation and obstacle avoidance demands robust computer vision algorithms, particularly for operation in turbid water with reduced visibility. This paper describes a novel method for the simultaneous underwater image quality assessment, visibility enhancement and disparity computation to increase stereo range resolution under dynamic, natural lighting and turbid conditions. The technique estimates the visibility properties from a sparse 3D map of the original degraded image using a physical underwater light attenuation model. Firstly, an iterated distance-adaptive image contrast enhancement enables a dense disparity computation and visibility estimation. Secondly, using a light attenuation model for ocean water, a color corrected stereo underwater image is obtained along with a visibility distance estimate. Experimental results in shallow, naturally lit, high-turbidity coastal environments show the proposed technique improves range estimation over the original images as well as image quality and color for habitat classification. Furthermore, the recursiveness and robustness of the technique allows implementation onboard an Autonomous Underwater Vehicle for improving navigation and obstacle avoidance performance.

MITIE C-Arm - Advanced innovation in education

Aim: In 2013 QUT introduced the Medical Imaging Training Immersive Environment (MITIE) as a virtual reality (VR) platform that allowed students to practice general radiography. The system software has been expanded to now include C-Arm. The aim of this project was to investigate the use of this technology in the pedagogy of undergraduate medical imaging students who have limited to no experience in the use of the C-Arm clinically. Method: The Medical Imaging Training Immersive Environment (MITIE) application provides students with realistic and fully interactive 3D models of C-Arm equipment. As with VR initiatives in other health disciplines (1–2) the software mimics clinical practice as much as possible and uses 3D technology to enhance 3D spatial awareness and realism. The application allows students to set up and expose a virtual patient in a 3D environment as well as creating the resultant “image” for comparison with a gold standard. Automated feedback highlights ways for the student to improve their patient positioning, equipment setup or exposure factors. The students' equipment knowledge was tested using an on line assessment quiz and surveys provided information on the students' pre-clinical confidence scale, with post-clinical data comparisons. Ethical approval for the project was provided by the university ethics panel. Results: This study is currently under way and this paper will present analysis of initial student feedback relating to the perceived value of the application for confidence in a high risk environment (i.e. operating theatre) and related clinical skills development. Further in-depth evaluation is ongoing with full results to be presented. Conclusion: MITIE C-Arm has a development role to play in the pre-clinical skills training for Medical Radiation Science students. It will augment their theoretical understanding prior to their clinical experience. References 1. Bridge P, Appleyard R, Ward J, Phillips R, Beavis A. The development and evaluation of a virtual radiotherapy treatment machine using an immersive visualisation environment. Computers and Education 2007; 49(2): 481–494. 2. Gunn T, Berry C, Bridge P et al. 3D Virtual Radiography: Development and Initial Feedback. Paper presented at the 10th Annual Scientific Meeting of Medical Imaging and Radiation Therapy, March 2013 Hobart, Tasmania.

A three dimensional virtual medical imaging computed tomography suite: Innovation in education

Aims: The Medical Imaging Training Immersive Environment(MITIE) Computed Tomography(CT) system is an innovative virtual reality (VR) platform that allows students to practice a range of CT techniques. The aim of this pilot study was to harvest user feedback about the educational value of teh application and inform future pedagogical development. This presentation explores the use of this technology for skills training. Background: MITIE CT is a 3D VR environment that allows students to position a patient,and set CT technical parameters including IV contrast dose and dose rate. As with VR initiatives in other health disciplines the software mimics clinical practice as much as possible and uses 3D technology to enhance immersion and realism. The software is new and was developed by the Medical Imaging Course Team at a provider University with funding from a Health Workforce Australia 'Simulated Learning Environments' grant Methods: Current third year medical imaging students were provided with additional 1 hour MITIE laboratory tutorials and studnet feedback was collated with regard to educational value and performance. Ethical approval for the project was provided by the university ethics panel Results: This presentation provides qualitative analysis of student perceptions relating to satisfaction, usability and educational value. Students reported high levels of satisfaction and both feedback and assessment results confirmed the application's significance as a pre-clinical tool. There was a clear emerging theme that MITIE could be a useful learning tool that students could access to consolidate their clinical learning, either on campus or during their clinical placement. Conclusion: Student feedback indicates that MITIE CT has a valuable role to play in the clinial skills training for medical imaging students both in the academic and clinical environment. Future work will establish a framework for an appropriate supprting pedagogy that can cross the boundary between the two environments

Note on stereo-diagrams of molecules

The paper elucidates a simple way ooJ'dcriving the coordinates for &awing sfereo-&gram of molecules. This method is an alternative, but not a substitute, to the 'ORTEP (suggested by C. K. Johnsori) which, is extensively used in the literature. Illustrations are given using a progrunz which was written based on the method mentioned here. The program is also given in an appendix for practical help.

Design a simulated multimedia enriched immersive learning environment (SMILE) for nursing care of dementia patient

This thesis is to establish a framework to guide the development of a simulated, multimedia-enriched, immersive, learning environment (SMILE) framework. This framework models essential media components used to describe a scenario applied in healthcare (in a dementia context), demonstrates interactions between the components, and enables scalability of simulation implementation. The thesis outcomes also include a simulation system developed in accordance with the guidance framework and a preliminary evaluation through a user study involving ten nursing students and practicioners. The results show that the proposed framework is feasible and effective for designing a simulation system in dementia healthcare training.

Medieberättelser om den politiska retoriken om invandring - Hur konstrueras vår bild av invandring genom nyhetsrapportering?

I min pro gradu-avhandling undersöker jag hur media bidrar till att konstruera bilden av invandring till Finland. Mitt material består av tre nationella tidningar, varav Helsingin Sanomat och Huvudstadsbladet representerar dagstidningar och Iltalehti kvällspressen. Bakgrunden för undersökningen är en tre månaders period under vintern 2008-2009, då invandring låg högt på den politiska agendan. Under denna period skärptes den politiska retoriken mot invandring. Detta tillskrivs främst sannfinländarnas valframgång i kommunalvalet hösten 2008. Materialet består av s.k. hårda nyheter om invandring från tidningarnas inrikessidor samt åsiktsjournalistik i form av ledare och kolumner. Tidigare forskning i medierapportering om invandring och den finländska politiska debatten om invandring utgör den teoretiska bakgrunden för avhandlingen. Långvariga kartläggningsprojekt av medierapporteringen om invandring har utförts av Centret för forskning om etniska relationer och nationalism, gällande finlandssvenska tidningar (se Haavisto 2007) och av Journalismin tutkimuskeskus, gällande finskspråkiga tidningar (se Raittila & Vehmas 2005). Dessa utgör bakgrundskunskap som jag bygger vidare på. Andra viktiga källor är Kaarina Horstis (2005) avhandling, som handlar om medierapporteringen om asylsökande och mångkulturalism och Outi Lepolas (2008) avhandling gällande riksdagsdebatter om invandring och mångkulturalism på 1990-talet. I analysen använder jag kritisk diskursanalys, men tar inslag ur ramanalys och retorikanalys. Ett centralt begrepp i min avhandling är nyhetsgenre och jag undersöker hur nyhetens konventioner påverkar sättet på vilket frågor om invandring presenteras. Media bygger upp olika tolkningar av den sociala verkligheten genom att beskriva berättelser. Jag analyserar rapporteringen av den politiska debatten ur detta perspektiv och ser på vilka talarpositioner ges åt de olika politiska aktörerna i debatten. I rapporteringen om invandrargruppers ankomst till Finland var en krisinramning dominerande. Genom negativa metaforer konstrueras invandring som ett hot mot det finska samhället. Frågan om asylsökande, framom andra invandrargrupper, får mycket utrymme i tidningarna och bidrar till att rama in diskussionen om invandring i stort. I rapporteringen om den politiska debatten från perioden förekommer tillspetsad retorik mot invandring också från politiker ur de stora partierna. Genom denna retorik konstruerar man invandring som ett hot. Denna retorik tillhör den invandrarkritiska diskursen. Andra diskurser genom vilka man behandlar invandring i materialet är den arbetsrelaterade diskursen och den mångkulturella diskursen. Argument som stödjer sig mot dessa diskurser är dock mycket färre och hamnar i skymundan av den invandrarkritiska diskursen.