OMNIWORKS: Omnidirectional vision for human-UAV co-working

The OMNIWORKS project objective is to develop an autonomous and modular aerial inspection system for an off-shore meteorological mast up to 90m in length. The UAV was equipped with an omni-directional camera and vertical take-off/landing capabilities that should be simple enough to operate as to not need the interventions of a professional pilot under challenging situations. Therefore the tests included different aspects used to evaluate both the technical performance of the UAV behavior as well as the operators? point of view.

MACHINE VISION FOR AUTOMATICVISUAL INSPECTION OF WOODENRAILWAY SLEEPERS USING UNSUPERVISED NEURAL NETWORKS

The motivation for this thesis work is the need for improving reliability of equipment and quality of service to railway passengers as well as a requirement for cost-effective and efficient condition maintenance management for rail transportation. This thesis work develops a fusion of various machine vision analysis methods to achieve high performance in automation of wooden rail track inspection.The condition monitoring in rail transport is done manually by a human operator where people rely on inference systems and assumptions to develop conclusions. The use of conditional monitoring allows maintenance to be scheduled, or other actions to be taken to avoid the consequences of failure, before the failure occurs. Manual or automated condition monitoring of materials in fields of public transportation like railway, aerial navigation, traffic safety, etc, where safety is of prior importance needs non-destructive testing (NDT).In general, wooden railway sleeper inspection is done manually by a human operator, by moving along the rail sleeper and gathering information by visual and sound analysis for examining the presence of cracks. Human inspectors working on lines visually inspect wooden rails to judge the quality of rail sleeper. In this project work the machine vision system is developed based on the manual visual analysis system, which uses digital cameras and image processing software to perform similar manual inspections. As the manual inspection requires much effort and is expected to be error prone sometimes and also appears difficult to discriminate even for a human operator by the frequent changes in inspected material. The machine vision system developed classifies the condition of material by examining individual pixels of images, processing them and attempting to develop conclusions with the assistance of knowledge bases and features.A pattern recognition approach is developed based on the methodological knowledge from manual procedure. The pattern recognition approach for this thesis work was developed and achieved by a non destructive testing method to identify the flaws in manually done condition monitoring of sleepers.In this method, a test vehicle is designed to capture sleeper images similar to visual inspection by human operator and the raw data for pattern recognition approach is provided from the captured images of the wooden sleepers. The data from the NDT method were further processed and appropriate features were extracted.The collection of data by the NDT method is to achieve high accuracy in reliable classification results. A key idea is to use the non supervised classifier based on the features extracted from the method to discriminate the condition of wooden sleepers in to either good or bad. Self organising map is used as classifier for the wooden sleeper classification.In order to achieve greater integration, the data collected by the machine vision system was made to interface with one another by a strategy called fusion. Data fusion was looked in at two different levels namely sensor-level fusion, feature- level fusion. As the goal was to reduce the accuracy of the human error on the rail sleeper classification as good or bad the results obtained by the feature-level fusion compared to that of the results of actual classification were satisfactory.

Visual Tracking, Pose Estimation, and Control for Aerial Vehicles

El principal objetivo de esta tesis es dotar a los vehículos aéreos no tripulados (UAVs, por sus siglas en inglés) de una fuente de información adicional basada en visión. Esta fuente de información proviene de cámaras ubicadas a bordo de los vehículos o en el suelo. Con ella se busca que los UAVs realicen tareas de aterrizaje o inspección guiados por visión, especialmente en aquellas situaciones en las que no haya disponibilidad de estimar la posición del vehículo con base en GPS, cuando las estimaciones de GPS no tengan la suficiente precisión requerida por las tareas a realizar, o cuando restricciones de carga de pago impidan añadir sensores a bordo de los vehículos. Esta tesis trata con tres de las principales áreas de la visión por computador: seguimiento visual y estimación visual de la pose (posición y orientación), que a su vez constituyen la base de la tercera, denominada control servo visual, que en nuestra aplicación se enfoca en el empleo de información visual para controlar los UAVs. Al respecto, esta tesis se ocupa de presentar propuestas novedosas que permitan solucionar problemas relativos al seguimiento de objetos mediante cámaras ubicadas a bordo de los UAVs, se ocupa de la estimación de la pose de los UAVs basada en información visual obtenida por cámaras ubicadas en el suelo o a bordo, y también se ocupa de la aplicación de las técnicas propuestas para solucionar diferentes problemas, como aquellos concernientes al seguimiento visual para tareas de reabastecimiento autónomo en vuelo o al aterrizaje basado en visión, entre otros. Las diversas técnicas de visión por computador presentadas en esta tesis se proponen con el fin de solucionar dificultades que suelen presentarse cuando se realizan tareas basadas en visión con UAVs, como las relativas a la obtención, en tiempo real, de estimaciones robustas, o como problemas generados por vibraciones. Los algoritmos propuestos en esta tesis han sido probados con información de imágenes reales obtenidas realizando pruebas on-line y off-line. Diversos mecanismos de evaluación han sido empleados con el propósito de analizar el desempeño de los algoritmos propuestos, entre los que se incluyen datos simulados, imágenes de vuelos reales, estimaciones precisas de posición empleando el sistema VICON y comparaciones con algoritmos del estado del arte. Los resultados obtenidos indican que los algoritmos de visión por computador propuestos tienen un desempeño que es comparable e incluso mejor al de algoritmos que se encuentran en el estado del arte. Los algoritmos propuestos permiten la obtención de estimaciones robustas en tiempo real, lo cual permite su uso en tareas de control visual. El desempeño de estos algoritmos es apropiado para las exigencias de las distintas aplicaciones examinadas: reabastecimiento autónomo en vuelo, aterrizaje y estimación del estado del UAV. Abstract The main objective of this thesis is to provide Unmanned Aerial Vehicles (UAVs) with an additional vision-based source of information extracted by cameras located either on-board or on the ground, in order to allow UAVs to develop visually guided tasks, such as landing or inspection, especially in situations where GPS information is not available, where GPS-based position estimation is not accurate enough for the task to develop, or where payload restrictions do not allow the incorporation of additional sensors on-board. This thesis covers three of the main computer vision areas: visual tracking and visual pose estimation, which are the bases the third one called visual servoing, which, in this work, focuses on using visual information to control UAVs. In this sense, the thesis focuses on presenting novel solutions for solving the tracking problem of objects when using cameras on-board UAVs, on estimating the pose of the UAVs based on the visual information collected by cameras located either on the ground or on-board, and also focuses on applying these proposed techniques for solving different problems, such as visual tracking for aerial refuelling or vision-based landing, among others. The different computer vision techniques presented in this thesis are proposed to solve some of the frequently problems found when addressing vision-based tasks in UAVs, such as obtaining robust vision-based estimations at real-time frame rates, and problems caused by vibrations, or 3D motion. All the proposed algorithms have been tested with real-image data in on-line and off-line tests. Different evaluation mechanisms have been used to analyze the performance of the proposed algorithms, such as simulated data, images from real-flight tests, publicly available datasets, manually generated ground truth data, accurate position estimations using a VICON system and a robotic cell, and comparison with state of the art algorithms. Results show that the proposed computer vision algorithms obtain performances that are comparable to, or even better than, state of the art algorithms, obtaining robust estimations at real-time frame rates. This proves that the proposed techniques are fast enough for vision-based control tasks. Therefore, the performance of the proposed vision algorithms has shown to be of a standard appropriate to the different explored applications: aerial refuelling and landing, and state estimation. It is noteworthy that they have low computational overheads for vision systems.

Nondestructive inspection of plastic deformation in commercial carbon steels using magnetic Barkhausen noise

The present work shows measurements of the Magnetic Barkhausen Noise (MBN) in commercial AISI/SAE 1045 and ASTM 36 steel deformed samples. The correlation between the MBN root mean square, Barkhausen signal profile and MBN power spectrum with the plastic deformation is established. The results show that the power spectral density of the Barkhausen signal is more effective as nondestructive evaluator than root mean square of Barkhausen signal. The Outcomes also suggest the presence of unbalanced tensions between the surface and the bulk of sample due to the presence of plastic deformation.

Analyses of the Headspace Volatile Constituents of Aerial Parts (leaves and stems), Flowers and Fruits of Bidens gardneri Bak. and Bidens sulphurea (Cav.) Sch.Bip. Using Solid-Phase Microextraction

The present study describes the volatile composition of aerial parts (leaves and stems), flowers and fruits from Bidens gardneri and Bidens sulphurea. The first species is widely distributed in Pantanal (Brazil) and is a traditional medicinal plant, while the second species is widely distributed throughout Brazil. In all analyses, observed were constituents like bicycloelemene, alpha-copaene, beta-caryophyllene, germacrene D, bicyclogermacrene and others. However, some compounds were identified only in one part of the plants analyzed. These results indicated sonic differences in the composition of the plants studied and they were in agreement with data of literature.

Spatial and temporal variation in distribution of mangroves in Moreton Bay, subtropical Australia: a comparison of pattern metrics and change detection analyses based on aerial photographs

An assessment of the changes in the distribution and extent of mangroves within Moreton Bay, southeast Queensland, Australia, was carried out. Two assessment methods were evaluated: spatial and temporal pattern metrics analysis, and change detection analysis. Currently, about 15,000 ha of mangroves are present in Moreton Bay. These mangroves are important ecosystems, but are subject to disturbance from a number of sources. Over the past 25 years, there has been a loss of more than 3800 ha, as a result of natural losses and mangrove clearing (e.g. for urban and industrial development, agriculture and aquaculture). However, areas of new mangroves have become established over the same time period, offsetting these losses to create a net loss of about 200 ha. These new mangroves have mainly appeared in the southern bay region and the bay islands, particularly on the landward edge of existing mangroves. In addition, spatial patterns and species composition of mangrove patches have changed. The pattern metrics analysis provided an overview of mangrove distribution and change in the form of single metric values, while the change detection analysis gave a more detailed and spatially explicit description of change. An analysis of the effects of spatial scales on the pattern metrics indicated that they were relatively insensitive to scale at spatial resolutions less than 50 m, but that most metrics became sensitive at coarser resolutions, a finding which has implications for mapping of mangroves based on remotely sensed data. (C) 2003 Elsevier Science B.V. All rights reserved.

An ergonomic approach to reorganize parking inspection agents` work productivity, health and safety in Sao Paulo, Brazil

Objective: The Traffic Engineering Company of the City of Sao Paulo (Brazil) observed a decrease in productivity, and an increase in sick leave, accidents and psychological distress among their parking inspection agents. To document this situation, qualitative research was undertaken to obtain an in-depth comprehension of work activity. Participants: Workers, managers and health and safety professionals contributed to the documentation of the problem and to the proposal of possible solutions. Methods: Ergonomic work analysis focusing on real work activity, as well as interviews with individual or groups of stakeholders, were conducted. Results: This research revealed that political-economic factors gradually contributed to: 1) an increasing work load; 2) growing fatigue throughout the day, increasing the workers` vulnerability to incidents and accidents and their tendency to react inappropriately to violence experienced on the street; and 3) excessive individual responsibility to manage dangerous situations. Conclusions: Recommendations to ameliorate the situation are proposed. These suggestions are discussed in terms of feasibility given the impact of macro social factors upon micro work activity, and the associated potential expansion of the ergonomist`s role.

Evaluation of anti-inflammatory activity of derivatives from aerial parts of Baccharis uncinella

Context: Species of Baccharis exhibit antibiotic, antiseptic, and wound-healing properties, and have been used in the traditional medicine of South America for the treatment of inflammation, headaches, diabetes, and hepatobiliary disorders. Objective: To investigate the anti-inflammatory activity of organic phases from EtOH extract of the aerial parts of Baccharis uncinella DC (Asteraceae). Materials and methods: The crude EtOH extract from the aerial parts of B. uncinella was subjected to partition procedures and the corresponding CH(2)Cl(2) and EtOAc phases were subjected to several chromatographic separation procedures. Thus, these phases and their purified compounds were assayed for evaluation of anti-inflammatory activity. Results: The CH(2)Cl(2) phase from EtOH extract from B. uncinella contained two triterpenoids (oleanolic and ursolic acids) and one flavonoid (pectolinaringenin), whereas the respective EtOAc phase showed to be composed mainly by two phenylpropanoid derivatives (caffeic and ferulic acids). The CH(2)Cl(2) and EtOAc phases as well as their isolated compounds exhibited anti-inflammatory effects against inflammatory reactions induced by phospholipase A2 (from Crotalus durissus terrificus venom) and by carrageenan. Discussion and conclusion: The results suggested that the components obtained from partition phases of EtOH extract of B. uncinella could represent lead molecules for the development of anti-inflammatory agents. Additionally, the results confirmed the use of Baccharis genus in the traditional medicine of South America for the treatment of inflammation and other heath disorders. To date, the present work describes for the first time the anti-inflammatory effects of compounds isolated from B. uncinella.

Anti-leishmanial effects of purified compounds from aerial parts of Baccharis uncinella C. DC. (Asteraceae)

Species of Baccharis exhibit antibiotic, antiseptic, wound-healing, and anti-protozoal properties, and have been used in the traditional medicine of South America for the treatment of several diseases. In the present work, the fractionation of EtOH extract from aerial parts of Baccharis uncinella indicated that the isolated compounds caffeic acid and pectolinaringenin showed inhibitory activity against Leishmania (L.) amazonensis and Leishmania (V.) braziliensis promastigotes, respectively. Moreover, amastigote forms of both species were highly sensible to the fraction composed by oleanolic + ursolic acids and pectolinaringenin. Caffeic acid also inhibited amastigote forms of L. (L.) amazonensis, but this effect was weak in L. (V.) braziliensis amastigotes. The treatment of infected macrophages with these compounds did not alter the levels of nitrates, indicating a direct effect of the compounds on amastigote stages. The results presented herein suggest that the active components from B. uncinella can be important to the design of new drugs against American tegumentar leishmaniases.

Accuracy of direct digital radiography for detecting occlusal caries in primary teeth compared with conventional radiography and visual inspection: an in vitro study

Objectives: The diagnosis of caries lesions is still a matter of concern in dentistry. The diagnosis of dental caries by digital radiography has a number of advantages over conventional radiography; however, this method has not been explored fully in the field of paediatric dentistry. This in vitro research evaluated the accuracy of direct digital radiography compared with visual inspection and conventional radiography in the diagnosis of occlusal caries lesions in primary molars. Methods: 50 molars were selected and evaluated under standardized conditions by 2 previously calibrated examiners according to 3 diagnostic methods (visual inspection, conventional radiography and direct digital radiography). Direct digital radiographs were obtained with the Dixi3 system (Planmeca, Helsinki, Finland) and the conventional radiographs with InSight film (Kodak Eastman Co., Rochester, NY). The images were scored and a reference standard was obtained histologically. The interexaminer reliability was calculated using Cohen`s kappa test and the specificity, sensitivity and accuracy of the methods were calculated. Results: Examiner reliability was good. For lesions limited to the enamel, visual inspection showed significantly higher sensitivity and accuracy than both radiographic methods, but no significant difference was found in specificity. For teeth with dentinal caries, no significant differences were found for any parameter when comparing visual and radiographic evaluation. Conclusions: Although less accurate than the visual method for detecting caries lesions confined to the enamel, the direct digital radiographic method is as effective as conventional radiographic examination and visual inspection of primary teeth with occlusal caries when the dentine is involved. Dentomaxillofacial Radiology (2010) 39, 362-367. doi: 10.1259/dmfr/22865872

Comparison of visual inspection, radiographic examination, laser fluorescence and their combinations on treatment decisions for occlusal surfaces

Purpose: To compare visual inspection (VI), radiographic examination (RX) and the laser fluorescence device DIAGNOdent (L), as well as their combinations in vitro regarding treatment decisions for occlusal surfaces. Methods: 72 extracted human permanent teeth (molars and premolars) were used. Treatment decisions were recorded by three calibrated examiners, and the options available were fissure sealant and conservative restoration. For validation of treatment decisions, the teeth were sectioned and examined in a stereomicroscope. Thereafter, dental slices were scanned and the images were edited to facilitate classification of existing carious lesions. Intra and inter-examiner reproducibility for the determination of treatment plans were calculated using Cohen`s kappa test (95%-CI). Sensitivity, specificity, positive and negative predictive values, and the area under the ROC curve were also calculated. Results: VI and L provided on average the greatest intra- and inter-examiner reproducibility, respectively. Although the combination of diagnostic methods may decrease both intra- and inter examiners reproducibility, combination of VI, L and RX resulted in the greatest sensitivity, being statistically superior to RX and L. There was more inter-examiner agreement for the option of restorative treatment, while the use of sealants as a treatment option yielded the lowest values. Negative predictive values were numerically inferior to positive predictive values, indicating that the examiners preferred not to restore a carious tooth than to proceed operatively in an intact tooth. The combination of the three methods studied showed the best results in determining treatment plans for occlusal surfaces, when compared to the other types of exams. On the other hand, radiographic examination and laser fluorescence were less efficient when used alone.

On the heritability of inspection time and its covariance with IQ: A twin study

Using the classical twin design, this study investigates the influence of genetic factors on the large phenotypic variance in inspection time (IT), and whether the well established IT-IQ association can be explained by a common genetic factor. Three hundred ninety pairs of twins (184 monozygotic, MZ; 206 dizygotic, DZ) with a mean age of 16 years participated, and 49 pairs returned approximately 3 months, later for retesting. As in many IT studies, the pi figure stimulus was used and IT was estimated from the cumulative normal ogive. IT ranged from 39.4 to 774.1 ms (159 +/- 110.1 ms) with faster ITs (by an average of 26.9 ms) found in the retest session from which a reliability of .69 was estimated. Full-scale IQ (FIQ) was assessed by the Multidimensional Aptitude Battery (MAB) and ranged from 79 to 145 (111 +/- 13). The phenotypic association between IT and FIQ was confirmed (- .35) and bivariate results showed that a common genetic factor accounted for 36% of the variance in IT and 32% of the variance in FIQ. The maximum likelihood estimate of the genetic correlation was - .63. When performance and verbal IQ (PIQ & VIQ) were analysed with IT, a stronger phenotypic and genetic relationship was found between PIQ and IT than with VIQ. A large part of the IT variance (64%) was accounted for by a unique environmental factor. Further genetic factors were needed to explain the remaining variance in IQ with a small component of unique environmental variance present. The separability of a shared genetic factor influencing IT and IQ from the total genetic variance in IQ suggests that IT affects a specific subcomponent of intelligence rather than a generalised efficiency. (C) 2001 Elsevier Science Inc. All rights reserved.