Liveness detection based on 3D face shape analysis

In recent years face recognition systems have been applied in various useful applications, such as surveillance, access control, criminal investigations, law enforcement, and others. However face biometric systems can be highly vulnerable to spoofing attacks where an impostor tries to bypass the face recognition system using a photo or video sequence. In this paper a novel liveness detection method, based on the 3D structure of the face, is proposed. Processing the 3D curvature of the acquired data, the proposed approach allows a biometric system to distinguish a real face from a photo, increasing the overall performance of the system and reducing its vulnerability. In order to test the real capability of the methodology a 3D face database has been collected simulating spoofing attacks, therefore using photographs instead of real faces. The experimental results show the effectiveness of the proposed approach.

Emplacement of pyroclastic deposits offshore Montserrat : insights from 3D seismic data

During the current (1995-present) eruptive phase of the Soufrière Hills volcano on Montserrat, voluminous pyroclastic flows entered the sea off the eastern flank of the island, resulting in the deposition of well-defined submarine pyroclastic lobes. Previously reported bathymetric surveys documented the sequential construction of these deposits, but could not image their internal structure, the morphology or extent of their base, or interaction with the underlying sediments. We show, by combining these bathymetric data with new high-resolution three dimensional (3D) seismic data, that the sequence of previously detected pyroclastic deposits from different phases of the ongoing eruptive activity is still well preserved. A detailed interpretation of the 3D seismic data reveals the absence of significant (> 3. m) basal erosion in the distal extent of submarine pyroclastic deposits. We also identify a previously unrecognized seismic unit directly beneath the stack of recent lobes. We propose three hypotheses for the origin of this seismic unit, but prefer an interpretation that the deposit is the result of the subaerial flank collapse that formed the English's Crater scarp on the Soufrière Hills volcano. The 1995-recent volcanic activity on Montserrat accounts for a significant portion of the sediments on the southeast slope of Montserrat, in places forming deposits that are more than 60. m thick, which implies that the potential for pyroclastic flows to build volcanic island edifices is significant.

Matrix metalloproteinase localisation by in situ-RT-PCR in archival human breast biopsy material

Utilising archival human breast cancer biopsy material we examined the stromal/epithelial interactions of several matrix metalloproteinases (MMPs) using in situ-RT-PCR (IS-RT-PCR). In breast cancer, the stromal/epithelial interactions that occur, and the site of production of these proteases, are central to understanding their role in invasive and metastatic processes. We examined MT1-MMP (MMP-14, membrane type-1-MMP), MMP-1 (interstitial collagenase) and MMP-3 (stromelysin-1) for their localisation profile in progressive breast cancer biopsy material (poorly differentiated invasive breast carcinoma (PDIBC), invasive breast carcinomas (IBC) and lymph node metastases (LNM)). Expression of MT1-MMP, MMP-1 and MMP-3 was observed in both the tumour epithelial and surrounding stromal cells in most tissue sections examined. MT1-MMP expression was predominantly localised to the tumour component in the pre-invasive lesions. MMP-1 gene expression was relatively well distributed between both tissue compartments, while MMP-3 demonstrated highest expression levels in the stromal tissue surrounding the epithelial tumour cells. The results demonstrate the ability to distinguish compartmental gene expression profiles using IS-RT-PCR. Further, we suggest a role for MT1-MMP in early tumour progression, expression of MMP-1 during metastasis and focal expression pattern of MMP-3 in areas of expansion. These expression profiles may provide markers for early breast cancer diagnoses and present potential therapeutic targets.

In vitro and in vivo MMP gene expression localisation by In Situ-RT-PCR in cell culture and paraffin embedded human breast cancer cell line xenografts

Background Members of the matrix metalloproteinase (MMP) family of proteases are required for the degradation of the basement membrane and extracellular matrix in both normal and pathological conditions. In vitro, MT1-MMP (MMP-14, membrane type-1-MMP) expression is higher in more invasive human breast cancer (HBC) cell lines, whilst in vivo its expression has been associated with the stroma surrounding breast tumours. MMP-1 (interstitial collagenase) has been associated with MDA-MB-231 invasion in vitro, while MMP-3 (stromelysin-1) has been localised around invasive cells of breast tumours in vivo. As MMPs are not stored intracellularly, the ability to localise their expression to their cells of origin is difficult. Methods We utilised the unique in situ-reverse transcription-polymerase chain reaction (IS-RT-PCR) methodology to localise the in vitro and in vivo gene expression of MT1-MMP, MMP-1 and MMP-3 in human breast cancer. In vitro, MMP induction was examined in the MDA-MB-231 and MCF-7 HBC cell lines following exposure to Concanavalin A (Con A). In vivo, we examined their expression in archival paraffin embedded xenografts derived from a range of HBC cell lines of varied invasive and metastatic potential. Mouse xenografts are heterogenous, containing neoplastic human parenchyma with mouse stroma and vasculature and provide a reproducible in vivo model system correlated to the human disease state. Results In vitro, exposure to Con A increased MT1-MMP gene expression in MDA-MB-231 cells and decreased MT1-MMP gene expression in MCF-7 cells. MMP-1 and MMP-3 gene expression remained unchanged in both cell lines. In vivo, stromal cells recruited into each xenograft demonstrated differences in localised levels of MMP gene expression. Specifically, MDA-MB-231, MDA-MB-435 and Hs578T HBC cell lines are able to influence MMP gene expression in the surrounding stroma. Conclusion We have demonstrated the applicability and sensitivity of IS-RT-PCR for the examination of MMP gene expression both in vitro and in vivo. Induction of MMP gene expression in both the epithelial tumour cells and surrounding stromal cells is associated with increased metastatic potential. Our data demonstrate the contribution of the stroma to epithelial MMP gene expression, and highlight the complexity of the role of MMPs in the stromal-epithelial interactions within breast carcinoma.

Continuous appearance-based localisation and mapping

This thesis presents a novel approach to mobile robot navigation using visual information towards the goal of long-term autonomy. A novel concept of a continuous appearance-based trajectory is proposed in order to solve the limitations of previous robot navigation systems, and two new algorithms for mobile robots, CAT-SLAM and CAT-Graph, are presented and evaluated. These algorithms yield performance exceeding state-of-the-art methods on public benchmark datasets and large-scale real-world environments, and will help enable widespread use of mobile robots in everyday applications.

Dealing with shadows : capturing intrinsic scene appearance for image-based outdoor localisation

In outdoor environments shadows are common. These typically strong visual features cause considerable change in the appearance of a place, and therefore confound vision-based localisation approaches. In this paper we describe how to convert a colour image of the scene to a greyscale invariant image where pixel values are a function of underlying material property not lighting. We summarise the theory of shadow invariant images and discuss the modelling and calibration issues which are important for non-ideal off-the-shelf colour cameras. We evaluate the technique with a commonly used robotic camera and an autonomous car operating in an outdoor environment, and show that it can outperform the use of ordinary greyscale images for the task of visual localisation.

A bioengineered 3D ovarian cancer model for the assessment of peptidase-mediated enhancement of spheroid growth and intraperitoneal spread

Cancer-associated proteases promote peritoneal dissemination and chemoresistance in malignant progression. In this study, kallikrein-related peptidases 4, 5, 6, and 7 (KLK4-7)-cotransfected OV-MZ-6 ovarian cancer cells were embedded in a bioengineered three-dimensional (3D) microenvironment that contains RGD motifs for integrin engagement to analyze their spheroid growth and survival after chemotreatment. KLK4-7-cotransfected cells formed larger spheroids and proliferated more than controls in 3D, particularly within RGD-functionalized matrices, which was reduced upon integrin inhibition. In contrast, KLK4-7-expressing cell monolayers proliferated less than controls, emphasizing the relevance of the 3D microenvironment and integrin engagement. In a spheroid-based animal model, KLK4-7-overexpression induced tumor growth after 4 weeks and intraperitoneal spread after 8 weeks. Upon paclitaxel administration, KLK4-7-expressing tumors declined in size by 91% (controls: 87%) and showed 90% less metastatic outgrowth (controls: 33%, P<0.001). KLK4-7-expressing spheroids showed 53% survival upon paclitaxel treatment (controls: 51%), accompanied by enhanced chemoresistance-related factors, and their survival was further reduced by combination treatment of paclitaxel with KLK4/5/7 (22%, P=0.007) or MAPK (6%, P=0.006) inhibition. The concomitant presence of KLK4-7 in ovarian cancer cells together with integrin activation drives spheroid formation and proliferation. Combinatorial approaches of paclitaxel and KLK/MAPK inhibition may be more efficient for late-stage disease than chemotherapeutics alone as these inhibitory regimens reduced cancer spheroid growth to a greater extent than paclitaxel alone.

Advantages of exploiting projection structure for segmenting dense 3D point clouds

Timely and comprehensive scene segmentation is often a critical step for many high level mobile robotic tasks. This paper examines a projected area based neighbourhood lookup approach with the motivation towards faster unsupervised segmentation of dense 3D point clouds. The proposed algorithm exploits the projection geometry of a depth camera to find nearest neighbours which is time independent of the input data size. Points near depth discontinuations are also detected to reinforce object boundaries in the clustering process. The search method presented is evaluated using both indoor and outdoor dense depth images and demonstrates significant improvements in speed and precision compared to the commonly used Fast library for approximate nearest neighbour (FLANN) [Muja and Lowe, 2009].

Low cost localisation for agricultural robotics

This paper presents a pose estimation approach that is resilient to typical sensor failure and suitable for low cost agricultural robots. Guiding large agricultural machinery with highly accurate GPS/INS systems has become standard practice, however these systems are inappropriate for smaller, lower-cost robots. Our positioning system estimates pose by fusing data from a low-cost global positioning sensor, low-cost inertial sensors and a new technique for vision-based row tracking. The results first demonstrate that our positioning system will accurately guide a robot to perform a coverage task across a 6 hectare field. The results then demonstrate that our vision-based row tracking algorithm improves the performance of the positioning system despite long periods of precision correction signal dropout and intermittent dropouts of the entire GPS sensor.

Real-time mobile 3D temperature mapping

The ability to measure surface temperature and represent it on a metrically accurate 3D model has proven applications in many areas such as medical imaging, building energy auditing, and search and rescue. A system is proposed that enables this task to be performed with a handheld sensor, and for the first time with results able to be visualized and analyzed in real-time. A device comprising a thermal-infrared camera and range sensor is calibrated geometrically and used for data capture. The device is localized using a combination of ICP and video-based pose estimation from the thermal-infrared video footage which is shown to reduce the occurrence of failure modes. Furthermore, the problem of misregistration which can introduce severe distortions in assigned surface temperatures is avoided through the use of a risk-averse neighborhood weighting mechanism. Results demonstrate that the system is more stable and accurate than previous approaches, and can be used to accurately model complex objects and environments for practical tasks.

Constructing a frame of cube : connecting 3D shapes with direction, location and movement

With the advancement of new technologies, this author has in 2010 started to engineer an online learning environment for investigating the nature and development of spatial abilities, and the teaching and learning of geometry. This paper documents how this new digital learning environment can afford the opportunity to integrate the learning about 3D shapes with direction, location and movement, and how young children can mentally and visually construct virtual 3D shapes using movements in both egocentric and fixed frames of reference (FOR). Findings suggest that year 4 (aged 9) children can develop the capacity to construct a cube using egocentric FOR only, fixed FOR only or a combination of both FOR. However, these young participants were unable to articulate the effect of individual or combined FOR movements. Directions for future research are proposed.

A 3D virtual medical imaging suite : bridging the academic-clinical training boundary

Aims The Medical Imaging Training Immersive Environment (MITIE) system is a recently developed virtual reality (VR) platform that allows students to practice a range of medical imaging techniques. The aim of this pilot study was to harvest user feedback about the educational value of the application and inform future pedagogical development. This presentation explores the use of this technology for skills training and blurring the boundaries between academic learning and clinical skills training. Background MITIE is a 3D VR environment that allows students to manipulate a patient and radiographic equipment in order to produce a VR-generated image for comparison with a gold standard. As with VR initiatives in other health disciplines (1-6) the software mimics clinical practice as much as possible and uses 3D technology to enhance immersion and realism. The software was developed by the Medical Imaging Course Team at a provider University with funding from a Health Workforce Australia “Simulated Learning Environments” grant. Methods Over 80 students undertaking the Bachelor of Medical Imaging Course were randomised to receive practical experience with either MITIE or radiographic equipment in the medical radiation laboratory. Student feedback about the educational value of the software was collected and performance with an assessed setup was measured for both groups for comparison. Ethical approval for the project was provided by the university ethics panel. Results This presentation provides qualitative analysis of student perceptions relating to satisfaction, usability and educational value as well as comparative quantitative performance data. Students reported high levels of satisfaction and both feedback and assessment results confirmed the application’s significance as a pre-clinical training tool. There was a clear emerging theme that MITIE could be a useful learning tool that students could access to consolidate their clinical learning, either during their academic timetables or their clinical placement. Conclusion Student feedback and performance data indicate that MITIE has a valuable role to play in the clinical skills training for medical imaging students both in the academic and the clinical environment. Future work will establish a framework for an appropriate supporting pedagogy that can cross the boundary between the two environments. This project was possible due to funding made available by Health Workforce Australia.

Combining multiple sensor modalities for a localisation robust to smoke

This paper proposes an approach to obtain a localisation that is robust to smoke by exploiting multiple sensing modalities: visual and infrared (IR) cameras. This localisation is based on a state-of-the-art visual SLAM algorithm. First, we show that a reasonably accurate localisation can be obtained in the presence of smoke by using only an IR camera, a sensor that is hardly affected by smoke, contrary to a visual camera (operating in the visible spectrum). Second, we demonstrate that improved results can be obtained by combining the information from the two sensor modalities (visual and IR cameras). Third, we show that by detecting the impact of smoke on the visual images using a data quality metric, we can anticipate and mitigate the degradation in performance of the localisation by discarding the most affected data. The experimental validation presents multiple trajectories estimated by the various methods considered, all thoroughly compared to an accurate dGPS/INS reference.

HeatWave : a handheld 3D thermography system for energy auditing

Energy auditing is an effective but costly approach for reducing the long-term energy consumption of buildings. When well-executed, energy loss can be quickly identified in the building structure and its subsystems. This then presents opportunities for improving energy efficiency. We present a low-cost, portable technology called "HeatWave" which allows non-experts to generate detailed 3D surface temperature models for energy auditing. This handheld 3D thermography system consists of two commercially available imaging sensors and a set of software algorithms which can be run on a laptop. The 3D model can be visualized in real-time by the operator so that they can monitor their degree of coverage as the sensors are used to capture data. In addition, results can be analyzed offline using the proposed "Spectra" multispectral visualization toolbox. The presence of surface temperature data in the generated 3D model enables the operator to easily identify and measure thermal irregularities such as thermal bridges, insulation leaks, moisture build-up and HVAC faults. Moreover, 3D models generated from subsequent audits of the same environment can be automatically compared to detect temporal changes in conditions and energy use over time.

Towards quantitative 3D broadband ultrasound characterisation of breast lesions

This thesis describes the development and scientific validation of a real-time quantitative 3D flat-bed ultrasound scanner. Novel short-time Fourier transform software facilitated broadband ultrasound attenuation maps of a breast phantom, enabling detection and identification of both cystic and solid lesions.