Automating marine mammal detection in aerial images captured during wildlife surveys: A deep learning approach

Aerial surveys conducted using manned or unmanned aircraft with customized camera payloads can generate a large number of images. Manual review of these images to extract data is prohibitive in terms of time and financial resources, thus providing strong incentive to automate this process using computer vision systems. There are potential applications for these automated systems in areas such as surveillance and monitoring, precision agriculture, law enforcement, asset inspection, and wildlife assessment. In this paper, we present an efficient machine learning system for automating the detection of marine species in aerial imagery. The effectiveness of our approach can be credited to the combination of a well-suited region proposal method and the use of Deep Convolutional Neural Networks (DCNNs). In comparison to previous algorithms designed for the same purpose, we have been able to dramatically improve recall to more than 80% and improve precision to 27% by using DCNNs as the core approach.

Circulating tumor cell detection in high-risk non-metastatic prostate cancer

Purpose The detection of circulating tumor cells (CTCs) provides important prognostic information in men with metastatic prostate cancer. We aim to determine the rate of detection of CTCs in patients with high-risk non-metastatic prostate cancer using the CellSearch® method. Method Samples of peripheral blood (7.5 mL) were drawn from 36 men with newly diagnosed high-risk non-metastatic prostate cancer, prior to any initiation of therapy and analyzed for CTCs using the CellSearch® method. Results The median age was 70 years, median PSA was 14.1, and the median Gleason score was 9. The median 5-year risk of progression of disease using a validated nomogram was 39 %. Five out of 36 patients (14 %, 95 % CI 5–30 %) had CTCs detected in their circulation. Four patients had only 1 CTC per 7.5 mL of blood detected. One patient had 3 CTCs per 7.5 mL of blood detected, which included a circulating tumor microemboli. Both on univariate analysis and multivariate analysis, there were no correlations found between CTC positivity and the classic prognostic factors including PSA, Gleason score, T-stage and age. Conclusion This study demonstrates that patients with high-risk, non-metastatic prostate cancer present infrequently with small number of CTCs in peripheral blood. This finding is consistent with the limited literature available in this setting. Other CTC isolation and detection technologies with improved sensitivity and specificity may enable detection of CTCs with mesenchymal phenotypes, although none as yet have been validated for clinical use. Newer assays are emerging for detection of new putative biomarkers for prostate cancer. Correlation of disease control outcomes with CTC detection will be important.

Detection of anuran calling activity in long field recordings for bio-acoustic monitoring

This paper presents a system to analyze long field recordings with low signal-to-noise ratio (SNR) for bio-acoustic monitoring. A method based on spectral peak track, Shannon entropy, harmonic structure and oscillation structure is proposed to automatically detect anuran (frog) calling activity. Gaussian mixture model (GMM) is introduced for modelling those features. Four anuran species widespread in Queensland, Australia, are selected to evaluate the proposed system. A visualization method based on extracted indices is employed for detection of anuran calling activity which achieves high accuracy.

Early detection of melanoma metastases using microRNAs as novel biomarkers

Early detection of melanoma skin cancer, prior to metastatic spread, is critical to improve survival outcomes in patients. This study identified a melanoma-related panel of blood markers that can detect the presence of melanoma with high sensitivity and accuracy which is superior to currently used markers for melanoma progression, recurrence, and survival. Overall, the findings discussed in this thesis may lead to more precise measurement of disease progression allowing for better treatments and an increase in overall survival.

Improving spoken term detection using complementary information

This research has made contributions to the area of spoken term detection (STD), defined as the process of finding all occurrences of a specified search term in a large collection of speech segments. The use of visual information in the form of lip movements of the speaker in addition to audio and the use of topic of the speech segments, and the expected frequency of words in the target speech domain, are proposed. By using these complementary information, improvement in the performance of STD has been achieved which enables efficient search of key words in large collection of multimedia documents.

A Bayesian Framework for the Assessment of Vision-based Weed and Fruit Detection and Classification Algorithms

This paper proposes new metrics and a performance-assessment framework for vision-based weed and fruit detection and classification algorithms. In order to compare algorithms, and make a decision on which one to use fora particular application, it is necessary to take into account that the performance obtained in a series of tests is subject to uncertainty. Such characterisation of uncertainty seems not to be captured by the performance metrics currently reported in the literature. Therefore, we pose the problem as a general problem of scientific inference, which arises out of incomplete information, and propose as a metric of performance the(posterior) predictive probabilities that the algorithms will provide a correct outcome for target and background detection. We detail the framework through which these predicted probabilities can be obtained, which is Bayesian in nature. As an illustration example, we apply the framework to the assessment of performance of four algorithms that could potentially be used in the detection of capsicums (peppers).

On Visual Detection of Highly-occluded Objects for Harvesting Automation in Horticulture

Developing accurate and reliable crop detection algorithms is an important step for harvesting automation in horticulture. This paper presents a novel approach to visual detection of highly-occluded fruits. We use a conditional random field (CRF) on multi-spectral image data (colour and Near-Infrared Reflectance, NIR) to model two classes: crop and background. To describe these two classes, we explore a range of visual-texture features including local binary pattern, histogram of oriented gradients, and learn auto-encoder features. The pro-posed methods are evaluated using hand-labelled images from a dataset captured on a commercial capsicum farm. Experimental results are presented, and performance is evaluated in terms of the Area Under the Curve (AUC) of the precision-recall curves.Our current results achieve a maximum performance of 0.81AUC when combining all of the texture features in conjunction with colour information.

Nonparametric rank regression for analyzing water quality concentration data with multiple detection limits

Environmental data usually include measurements, such as water quality data, which fall below detection limits, because of limitations of the instruments or of certain analytical methods used. The fact that some responses are not detected needs to be properly taken into account in statistical analysis of such data. However, it is well-known that it is challenging to analyze a data set with detection limits, and we often have to rely on the traditional parametric methods or simple imputation methods. Distributional assumptions can lead to biased inference and justification of distributions is often not possible when the data are correlated and there is a large proportion of data below detection limits. The extent of bias is usually unknown. To draw valid conclusions and hence provide useful advice for environmental management authorities, it is essential to develop and apply an appropriate statistical methodology. This paper proposes rank-based procedures for analyzing non-normally distributed data collected at different sites over a period of time in the presence of multiple detection limits. To take account of temporal correlations within each site, we propose an optimal linear combination of estimating functions and apply the induced smoothing method to reduce the computational burden. Finally, we apply the proposed method to the water quality data collected at Susquehanna River Basin in United States of America, which dearly demonstrates the advantages of the rank regression models.

Statistical power calculation and sample size determination for environmental studies with data below detection limits

Power calculation and sample size determination are critical in designing environmental monitoring programs. The traditional approach based on comparing the mean values may become statistically inappropriate and even invalid when substantial proportions of the response values are below the detection limits or censored because strong distributional assumptions have to be made on the censored observations when implementing the traditional procedures. In this paper, we propose a quantile methodology that is robust to outliers and can also handle data with a substantial proportion of below-detection-limit observations without the need of imputing the censored values. As a demonstration, we applied the methods to a nutrient monitoring project, which is a part of the Perth Long-Term Ocean Outlet Monitoring Program. In this example, the sample size required by our quantile methodology is, in fact, smaller than that by the traditional t-test, illustrating the merit of our method.

Learning Temporal Alignment Uncertainty for Efficient Event Detection

In this paper we tackle the problem of efficient video event detection. We argue that linear detection functions should be preferred in this regard due to their scalability and efficiency during estimation and evaluation. A popular approach in this regard is to represent a sequence using a bag of words (BOW) representation due to its: (i) fixed dimensionality irrespective of the sequence length, and (ii) its ability to compactly model the statistics in the sequence. A drawback to the BOW representation, however, is the intrinsic destruction of the temporal ordering information. In this paper we propose a new representation that leverages the uncertainty in relative temporal alignments between pairs of sequences while not destroying temporal ordering. Our representation, like BOW, is of a fixed dimensionality making it easily integrated with a linear detection function. Extensive experiments on CK+, 6DMG, and UvA-NEMO databases show significant performance improvements across both isolated and continuous event detection tasks.

Rapid isolation and detection of erythropoietin in blood plasma by magnetic core gold nanoparticles and portable Raman spectroscopy

Isolating, purifying, and identifying proteins in complex biological matrices is often difficult, time consuming, and unreliable. Herein we describe a rapid screening technique for proteins in biological matrices that combines selective protein isolation with direct surface enhanced Raman spectroscopy (SERS) detection. Magnetic core gold nanoparticles were synthesised, characterised, and subsequently functionalized with recombinant human erythropoietin (rHuEPO)-specific antibody. The functionalized nanoparticles were used to capture rHuEPO from horse blood plasma within 15 minutes. The selective binding between the protein and the functionalized nanoparticles was monitored by SERS. The purified protein was then released from the nanoparticles’ surface and directly spectroscopically identified on a commercial nanopillar SERS substrate. ELISA independently confirmed the SERS identification and quantified the released rHuEPO. Finally, the direct SERS detection of the extracted protein was successfully demonstrated for in-field screening by a handheld Raman spectrometer within 1 minute sample measurement time.

Teledermatology: Its use in the detection and management of actinic keratosis

Teledermatology can profoundly improve access to medical services for those who may have limited access to dermatology due to workforce shortages, distance to providers, or limitations in their mobility. Two common ways of teledermatology are differentiated: life synchronous, where patient and doctor communicate directly, or store and forward asynchronous methods, where the patient and doctor provide and assess the medical information independently. Teledermatology has been tested for its safety, feasibility and accuracy for a number of dermatological conditions, including the early detection of skin cancer and is usually safe, feasible and accurate. Studies reported somewhat better results for synchronous than asynchronous methods, possibly because of loss of information if no direct patient doctor contact is feasible. However asynchronous methods are easier to organize, require less sophisticated technology and are more widely accessible, and are more convenient for both patients and doctors. No study to date focused solely on teledermatology of actinic keratosis, but such lesions are typically found during teledermatology examinations for other main target lesions. In studies where such results were reported, actinic keratoses seemed to be readily identifiable for teledermatologists and adequate management and treatment can be suggested within remote consultations.

Autonomous UAVs wildlife detection using thermal imaging, predictive navigation and computer vision

There is an increased interest on the use of Unmanned Aerial Vehicles (UAVs) for wildlife and feral animal monitoring around the world. This paper describes a novel system which uses a predictive dynamic application that places the UAV ahead of a user, with a low cost thermal camera, a small onboard computer that identifies heat signatures of a target animal from a predetermined altitude and transmits that target’s GPS coordinates. A map is generated and various data sets and graphs are displayed using a GUI designed for easy use. The paper describes the hardware and software architecture and the probabilistic model for downward facing camera for the detection of an animal. Behavioral dynamics of target movement for the design of a Kalman filter and Markov model based prediction algorithm are used to place the UAV ahead of the user. Geometrical concepts and Haversine formula are applied to the maximum likelihood case in order to make a prediction regarding a future state of the user, thus delivering a new way point for autonomous navigation. Results show that the system is capable of autonomously locating animals from a predetermined height and generate a map showing the location of the animals ahead of the user.

MPC controlled multirotor with suspended slung load: System architecture and visual load detection

There is an increased interest in the use of Unmanned Aerial Vehicles for load transportation from environmental remote sensing to construction and parcel delivery. One of the main challenges is accurate control of the load position and trajectory. This paper presents an assessment of real flight trials for the control of an autonomous multi-rotor with a suspended slung load using only visual feedback to determine the load position. This method uses an onboard camera to take advantage of a common visual marker detection algorithm to robustly detect the load location. The load position is calculated using an onboard processor, and transmitted over a wireless network to a ground station integrating MATLAB/SIMULINK and Robotic Operating System (ROS) and a Model Predictive Controller (MPC) to control both the load and the UAV. To evaluate the system performance, the position of the load determined by the visual detection system in real flight is compared with data received by a motion tracking system. The multi-rotor position tracking performance is also analyzed by conducting flight trials using perfect load position data and data obtained only from the visual system. Results show very accurate estimation of the load position (~5% Offset) using only the visual system and demonstrate that the need for an external motion tracking system is not needed for this task.