Real-time power line extraction from unmanned aerial system video images

In this paper a real-time vision based power line extraction solution is investigated for active UAV guidance. The line extraction algorithm starts from ridge points detected by steerable filters. A collinear line segments fitting algorithm is followed up by considering global and local information together with multiple collinear measurements. GPU boosted algorithm implementation is also investigated in the experiment. The experimental result shows that the proposed algorithm outperforms two baseline line detection algorithms and is able to fitting long collinear line segments. The low computational cost of the algorithm make suitable for real-time applications.

Próba zastosowania lotniczych termowizyjnych obrazów wideo do wykrywania miejsc nielegalnego składowania odpadów zwierzęcych

Access to the remote sensing data was increasing in Poland since 1989. This procccess had stimulating impact on scientific research in the scope of changes in the environment. Special attention should be given to the thermal imagery methods because of its information potential. Presented paper discusses the possibilities of using information from thermal images for detecting of places of illegal dumping of animal waste in the ground. On the basis of earlier survey and gathered data draft fl ight plan was created, covering the sorroundings of Śmiłowo (around 30 sq km). Theoretical thesis for the subject was an assumption that all disturbances of the ground and soil structure should give visible representation in both thermal and visible images. Moreover the process of decay of animal tissues should be the source of heat, which can be observed through thermal sensor. Several places of potential dumping of animal waste were selected. For detailed ground verifi cation eight of them were chosen. In these location geological drillings were performed and than analysis of the samples. Thermovision is a method with great potential for the monitoing of the environment, but its effectiveness depends on the access to another sources of geoinformation.

PhotoLin: a program to identify and analyze linear structures in aerial photographs, satellite images and maps

A computer program, PhotoLin, written for an IBM-PC-compatible microcomputer is described which detects linear features in aerial photographs, satellite images and topographic maps. The program accepts images saved to PCX files as input and applies noise correction and smoothing filters and thinning routines. The output consists of a skeleton containing the median lines of linear features which can be represented on a map. The branches of the skeleton can be broken into sections of constant length for which the mean orientations are obtained for the preparation of rose diagrams. (C) 2001 Elsevier B.V. Ltd. All rights reserved.

Digital monitoring of broiler breeder behavior for assessment of thermal welfare

The assessment of welfare issues has been a challenge for poultry producers, and lately welfare standards needs to be reached in order to agree with international market demand. This research proposes the use of continuous behavior monitoring in order to contribute for assessing welfare. A software was developed using the language Clarium. The software managed the recording of data as well as the data searching in the database Firebird. Both software and the observational methodology were tested in a trial conducted inside an environmental chamber, using three genetics of broiler breeders. Behavioral pattern was recorded and correlated to ambient thermal and aerial variation. Monitoring video cameras were placed on the roof facing the used for registering the bird's behavior. From video camera images were recorded during the total period when the ambient was bright, and for analyzing the video images a sample of 15min observation in the morning and 15 min in the afternoon was used, adding up to 30 min daily observation. A specific model so-called behavior was developed inside the software for counting specific behavior and its frequency of occurrence, as well as its duration. Electronic identification was recorded for 24h period. Behavioral video recording images was related to the data recorded using electronic identification.. Statistical analysis of data allowed to identify behavioral differences related to the change in thermal environment, and ultimately indicating thermal stress and departure from welfare conditions.

Unmanned Aerial Vehicles (UAVs) and artificial intelligence revolutionizing wildlife monitoring and conservation

Surveying threatened and invasive species to obtain accurate population estimates is an important but challenging task that requires a considerable investment in time and resources. Estimates using existing ground-based monitoring techniques, such as camera traps and surveys performed on foot, are known to be resource intensive, potentially inaccurate and imprecise, and difficult to validate. Recent developments in unmanned aerial vehicles (UAV), artificial intelligence and miniaturized thermal imaging systems represent a new opportunity for wildlife experts to inexpensively survey relatively large areas. The system presented in this paper includes thermal image acquisition as well as a video processing pipeline to perform object detection, classification and tracking of wildlife in forest or open areas. The system is tested on thermal video data from ground based and test flight footage, and is found to be able to detect all the target wildlife located in the surveyed area. The system is flexible in that the user can readily define the types of objects to classify and the object characteristics that should be considered during classification.

Image analysis for assessing broiler breeder behavior response to thermal environment

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Multi-modal object tracking using dynamic performance metrics

Intelligent surveillance systems typically use a single visual spectrum modality for their input. These systems work well in controlled conditions, but often fail when lighting is poor, or environmental effects such as shadows, dust or smoke are present. Thermal spectrum imagery is not as susceptible to environmental effects, however thermal imaging sensors are more sensitive to noise and they are only gray scale, making distinguishing between objects difficult. Several approaches to combining the visual and thermal modalities have been proposed, however they are limited by assuming that both modalities are perfuming equally well. When one modality fails, existing approaches are unable to detect the drop in performance and disregard the under performing modality. In this paper, a novel middle fusion approach for combining visual and thermal spectrum images for object tracking is proposed. Motion and object detection is performed on each modality and the object detection results for each modality are fused base on the current performance of each modality. Modality performance is determined by comparing the number of objects tracked by the system with the number detected by each mode, with a small allowance made for objects entering and exiting the scene. The tracking performance of the proposed fusion scheme is compared with performance of the visual and thermal modes individually, and a baseline middle fusion scheme. Improvement in tracking performance using the proposed fusion approach is demonstrated. The proposed approach is also shown to be able to detect the failure of an individual modality and disregard its results, ensuring performance is not degraded in such situations.

An exploration of feature detector performance in the thermal-infrared modality

Thermal-infrared images have superior statistical properties compared with visible-spectrum images in many low-light or no-light scenarios. However, a detailed understanding of feature detector performance in the thermal modality lags behind that of the visible modality. To address this, the first comprehensive study on feature detector performance on thermal-infrared images is conducted. A dataset is presented which explores a total of ten different environments with a range of statistical properties. An investigation is conducted into the effects of several digital and physical image transformations on detector repeatability in these environments. The effect of non-uniformity noise, unique to the thermal modality, is analyzed. The accumulation of sensor non-uniformities beyond the minimum possible level was found to have only a small negative effect. A limiting of feature counts was found to improve the repeatability performance of several detectors. Most other image transformations had predictable effects on feature stability. The best-performing detector varied considerably depending on the nature of the scene and the test.

Applications of finite element computer modelling and thermal infrared remote sensing to the study of geothermal anomalies

Buried heat sources can be investigated by examining thermal infrared images and comparing these with the results of theoretical models which predict the thermal anomaly a given heat source may generate. Key factors influencing surface temperature include the geometry and temperature of the heat source, the surface meteorological environment, and the thermal conductivity and anisotropy of the rock. In general, a geothermal heat flux of greater than 2% of solar insolation is required to produce a detectable thermal anomaly in a thermal infrared image. A heat source of, for example, 2-300K greater than the average surface temperature must be a t depth shallower than 50m for the detection of the anomaly in a thermal infrared image, for typical terrestrial conditions. Atmospheric factors are of critical importance. While the mean atmospheric temperature has little significance, the convection is a dominant factor, and can act to swamp the thermal signature entirely. Given a steady state heat source that produces a detectable thermal anomaly, it is possible to loosely constrain the physical properties of the heat source and surrounding rock, using the surface thermal anomaly as a basis. The success of this technique is highly dependent on the degree to which the physical properties of the host rock are known. Important parameters include the surface thermal properties and thermal conductivity of the rock. Modelling of transient thermal situations was carried out, to assess the effect of time dependant thermal fluxes. One-dimensional finite element models can be readily and accurately applied to the investigation of diurnal heat flow, as with thermal inertia models. Diurnal thermal models of environments on Earth, the Moon and Mars were carried out using finite elements and found to be consistent with published measurements. The heat flow from an injection of hot lava into a near surface lava tube was considered. While this approach was useful for study, and long term monitoring in inhospitable areas, it was found to have little hazard warning utility, as the time taken for the thermal energy to propagate to the surface in dry rock (several months) in very long. The resolution of the thermal infrared imaging system is an important factor. Presently available satellite based systems such as Landsat (resolution of 120m) are inadequate for detailed study of geothermal anomalies. Airborne systems, such as TIMS (variable resolution of 3-6m) are much more useful for discriminating small buried heat sources. Planned improvements in the resolution of satellite based systems will broaden the potential for application of the techniques developed in this thesis. It is important to note, however, that adequate spatial resolution is a necessary but not sufficient condition for successful application of these techniques.

Temporal changes in benthic megafaunal abundance and composition across the West Antarctic Peninsula shelf: Results from video surveys

The West Antarctic Peninsula (WAP) shelf experiences intense seasonal and interannual variability in phytoplankton production and particulate-organic-carbon flux to the seafloor. To explore the response of the megabenthic community to this production variability, we conducted video surveys of epibenthic megafauna at three stations on the WAP shelf in Nov-Dec 1999, Mar 2000, Jun 2000, Oct-Nov 2000, and Feb-Mar 2001. The epibenthic megafauna was dominated (>90%) by elasipod holothurians, irregular urchins and anthozoans, with total abundances ranging from 19 to 152 ind. 1 00 m(-2). The abundance of three of the dominant taxa (Protelpidia murrayi, Peniagone vignomi, and Amphipneustes spp.) varied significantly across seasons (p <0.05), although variations were not tightly correlated with the summer bloom cycle. The irregular urchins in the genus Amphipneustes varied 5-fold in abundance at single stations, with maximum densities (an average of 10.1 ind. 100 m(-2)) attained in Jun 2000. Abundances of the elasipod holothurians P. murrayi (1-121 ind. 100 m(-2)) and P. vignoni (0.7-27.5 ind. 100 m(-2)) fell within the range for elasipod holothurians from other bathyal regions measured using image analysis. The abundance of P. murrayi increased up to 6-fold from a single Jun-Oct recruitment pulse, while changes in the abundance of P. vignoni (over 2-fold higher in Feb-Mar 2001) apparently resulted from immigration during the presence of a 1-2 cm thick carpet of fresh phytocletritus. Based on the ratio of the number of fecal casts per individual, elasipod holothurians increased surface-deposit feeding rates by >= 2-fold while phytocletritus was present at the seafloor. Nonetheless, these surface-deposit feeders appeared to feed and egest sediments throughout the winter, which is consistent with year-round persistence of a labile food bank in surficial sediments on the deep WAP shelf.

Robust thermal face recognition using region classifiers

This paper presents a robust approach for recognition of thermal face images based on decision level fusion of 34 different region classifiers. The region classifiers concentrate on local variations. They use singular value decomposition (SVD) for feature extraction. Fusion of decisions of the region classifier is done by using majority voting technique. The algorithm is tolerant against false exclusion of thermal information produced by the presence of inconsistent distribution of temperature statistics which generally make the identification process difficult. The algorithm is extensively evaluated on UGC-JU thermal face database, and Terravic facial infrared database and the recognition performance are found to be 95.83% and 100%, respectively. A comparative study has also been made with the existing works in the literature.

Thermal imaging as a biometrics approach to facial signature authentication

This dissertation develops an image processing framework with unique feature extraction and similarity measurements for human face recognition in the thermal mid-wave infrared portion of the electromagnetic spectrum. The goals of this research is to design specialized algorithms that would extract facial vasculature information, create a thermal facial signature and identify the individual. The objective is to use such findings in support of a biometrics system for human identification with a high degree of accuracy and a high degree of reliability. This last assertion is due to the minimal to no risk for potential alteration of the intrinsic physiological characteristics seen through thermal infrared imaging. The proposed thermal facial signature recognition is fully integrated and consolidates the main and critical steps of feature extraction, registration, matching through similarity measures, and validation through testing our algorithm on a database, referred to as C-X1, provided by the Computer Vision Research Laboratory at the University of Notre Dame. Feature extraction was accomplished by first registering the infrared images to a reference image using the functional MRI of the Brain’s (FMRIB’s) Linear Image Registration Tool (FLIRT) modified to suit thermal infrared images. This was followed by segmentation of the facial region using an advanced localized contouring algorithm applied on anisotropically diffused thermal images. Thermal feature extraction from facial images was attained by performing morphological operations such as opening and top-hat segmentation to yield thermal signatures for each subject. Four thermal images taken over a period of six months were used to generate thermal signatures and a thermal template for each subject, the thermal template contains only the most prevalent and consistent features. Finally a similarity measure technique was used to match signatures to templates and the Principal Component Analysis (PCA) was used to validate the results of the matching process. Thirteen subjects were used for testing the developed technique on an in-house thermal imaging system. The matching using an Euclidean-based similarity measure showed 88% accuracy in the case of skeletonized signatures and templates, we obtained 90% accuracy for anisotropically diffused signatures and templates. We also employed the Manhattan-based similarity measure and obtained an accuracy of 90.39% for skeletonized and diffused templates and signatures. It was found that an average 18.9% improvement in the similarity measure was obtained when using diffused templates. The Euclidean- and Manhattan-based similarity measure was also applied to skeletonized signatures and templates of 25 subjects in the C-X1 database. The highly accurate results obtained in the matching process along with the generalized design process clearly demonstrate the ability of the thermal infrared system to be used on other thermal imaging based systems and related databases. A novel user-initialization registration of thermal facial images has been successfully implemented. Furthermore, the novel approach at developing a thermal signature template using four images taken at various times ensured that unforeseen changes in the vasculature did not affect the biometric matching process as it relied on consistent thermal features.

One night stand : only you

Technical: This looped video work is made up from a number of still images animated in a sequence, not intended to be a smooth action, but syncopated. The gaps in real time suggest blinking, lapses in technology, warps in time and distance. The still images have been manipulated in photoshop and imported into an animation software program, showing subtle emphasis on various aspects of the features of the face and location from the screen shots. Content: Obsession is one of the most constant expressions of love, whether it is a negative attribute, such as stalking, or the need to see or stroke the beloved, or telling and re-telling the story of first meeting. “like the beat, beat, beat of the tom tom when the jungle shadows fall like the tick, tick, tock of the stately clock as it stands against the wall like the drip, drip drip of the rain drops when the summer shower’s through a voice within me keeps repeating you, you, you… only you...” (Cole Porter, Night and Day) My desire to immerse myself in my newly-met adult daughter as a reality is as obsessive as any new parent. The primary means of contact is video cam, which has become a kind of surveillance for me. I stare at her mouth as it moves, her ear as she moves her head, her smile, her grimaces, her high cheekbones, her eyes that are like mine, the shape of her head, her teeth that are like her father’s… hundreds of candid pictures screen shot over a year and a half were the source of the video images.

Did you see that? Dissociating advanced visual information and ball flight constrains perception and action processes during one-handed catching

The integration of separate, yet complimentary, cortical pathways appears to play a role in visual perception and action when intercepting objects. The ventral system is responsible for object recognition and identification, while the dorsal system facilitates continuous regulation of action. This dual-system model implies that empirically manipulating different visual information sources during performance of an interceptive action might lead to the emergence of distinct gaze and movement pattern profiles. To test this idea, we recorded hand kinematics and eye movements of participants as they attempted to catch balls projected from a novel apparatus that synchronised or de-synchronised accompanying video images of a throwing action and ball trajectory. Results revealed that ball catching performance was less successful when patterns of hand movements and gaze behaviours were constrained by the absence of advanced perceptual information from the thrower's actions. Under these task constraints, participants began tracking the ball later, followed less of its trajectory, and adapted their actions by initiating movements later and moving the hand faster. There were no performance differences when the throwing action image and ball speed were synchronised or de-synchronised since hand movements were closely linked to information from ball trajectory. Results are interpreted relative to the two-visual system hypothesis, demonstrating that accurate interception requires integration of advanced visual information from kinematics of the throwing action and from ball flight trajectory.