On precise three-dimensional environment modeling via UAV-based photogrammetric systems

Abstract : Images acquired from unmanned aerial vehicles (UAVs) can provide data with unprecedented spatial and temporal resolution for three-dimensional (3D) modeling. Solutions developed for this purpose are mainly operating based on photogrammetry concepts, namely UAV-Photogrammetry Systems (UAV-PS). Such systems are used in applications where both geospatial and visual information of the environment is required. These applications include, but are not limited to, natural resource management such as precision agriculture, military and police-related services such as traffic-law enforcement, precision engineering such as infrastructure inspection, and health services such as epidemic emergency management. UAV-photogrammetry systems can be differentiated based on their spatial characteristics in terms of accuracy and resolution. That is some applications, such as precision engineering, require high-resolution and high-accuracy information of the environment (e.g. 3D modeling with less than one centimeter accuracy and resolution). In other applications, lower levels of accuracy might be sufficient, (e.g. wildlife management needing few decimeters of resolution). However, even in those applications, the specific characteristics of UAV-PSs should be well considered in the steps of both system development and application in order to yield satisfying results. In this regard, this thesis presents a comprehensive review of the applications of unmanned aerial imagery, where the objective was to determine the challenges that remote-sensing applications of UAV systems currently face. This review also allowed recognizing the specific characteristics and requirements of UAV-PSs, which are mostly ignored or not thoroughly assessed in recent studies. Accordingly, the focus of the first part of this thesis is on exploring the methodological and experimental aspects of implementing a UAV-PS. The developed system was extensively evaluated for precise modeling of an open-pit gravel mine and performing volumetric-change measurements. This application was selected for two main reasons. Firstly, this case study provided a challenging environment for 3D modeling, in terms of scale changes, terrain relief variations as well as structure and texture diversities. Secondly, open-pit-mine monitoring demands high levels of accuracy, which justifies our efforts to improve the developed UAV-PS to its maximum capacities. The hardware of the system consisted of an electric-powered helicopter, a high-resolution digital camera, and an inertial navigation system. The software of the system included the in-house programs specifically designed for camera calibration, platform calibration, system integration, onboard data acquisition, flight planning and ground control point (GCP) detection. The detailed features of the system are discussed in the thesis, and solutions are proposed in order to enhance the system and its photogrammetric outputs. The accuracy of the results was evaluated under various mapping conditions, including direct georeferencing and indirect georeferencing with different numbers, distributions and types of ground control points. Additionally, the effects of imaging configuration and network stability on modeling accuracy were assessed. The second part of this thesis concentrates on improving the techniques of sparse and dense reconstruction. The proposed solutions are alternatives to traditional aerial photogrammetry techniques, properly adapted to specific characteristics of unmanned, low-altitude imagery. Firstly, a method was developed for robust sparse matching and epipolar-geometry estimation. The main achievement of this method was its capacity to handle a very high percentage of outliers (errors among corresponding points) with remarkable computational efficiency (compared to the state-of-the-art techniques). Secondly, a block bundle adjustment (BBA) strategy was proposed based on the integration of intrinsic camera calibration parameters as pseudo-observations to Gauss-Helmert model. The principal advantage of this strategy was controlling the adverse effect of unstable imaging networks and noisy image observations on the accuracy of self-calibration. The sparse implementation of this strategy was also performed, which allowed its application to data sets containing a lot of tie points. Finally, the concepts of intrinsic curves were revisited for dense stereo matching. The proposed technique could achieve a high level of accuracy and efficiency by searching only through a small fraction of the whole disparity search space as well as internally handling occlusions and matching ambiguities. These photogrammetric solutions were extensively tested using synthetic data, close-range images and the images acquired from the gravel-pit mine. Achieving absolute 3D mapping accuracy of 11±7 mm illustrated the success of this system for high-precision modeling of the environment.

Dynamic Workload Parallelization and System Calibration on Single-Chip Cloud Computer

Many-core systems are emerging from the need of more computational power and power efficiency. However there are many issues which still revolve around the many-core systems. These systems need specialized software before they can be fully utilized and the hardware itself may differ from the conventional computational systems. To gain efficiency from many-core system, programs need to be parallelized. In many-core systems the cores are small and less powerful than cores used in traditional computing, so running a conventional program is not an efficient option. Also in Network-on-Chip based processors the network might get congested and the cores might work at different speeds. In this thesis is, a dynamic load balancing method is proposed and tested on Intel 48-core Single-Chip Cloud Computer by parallelizing a fault simulator. The maximum speedup is difficult to obtain due to severe bottlenecks in the system. In order to exploit all the available parallelism of the Single-Chip Cloud Computer, a runtime approach capable of dynamically balancing the load during the fault simulation process is used. The proposed dynamic fault simulation approach on the Single-Chip Cloud Computer shows up to 45X speedup compared to a serial fault simulation approach. Many-core systems can draw enormous amounts of power, and if this power is not controlled properly, the system might get damaged. One way to manage power is to set power budget for the system. But if this power is drawn by just few cores of the many, these few cores get extremely hot and might get damaged. Due to increase in power density multiple thermal sensors are deployed on the chip area to provide realtime temperature feedback for thermal management techniques. Thermal sensor accuracy is extremely prone to intra-die process variation and aging phenomena. These factors lead to a situation where thermal sensor values drift from the nominal values. This necessitates efficient calibration techniques to be applied before the sensor values are used. In addition, in modern many-core systems cores have support for dynamic voltage and frequency scaling. Thermal sensors located on cores are sensitive to the core's current voltage level, meaning that dedicated calibration is needed for each voltage level. In this thesis a general-purpose software-based auto-calibration approach is also proposed for thermal sensors to calibrate thermal sensors on different range of voltages.

Separation of longitudinal and flexural wave in a cylindrical structure based on sensor arrangement for non-destructive evaluation

Low strain integrity testing is commonly used to assess the in situ condition of the poles or piles. For poles, it is important to calculate the embedment length and location of damage which is highly influenced by the accurate determination of the wave velocity. In general, depending on impact location and orientation, both longitudinal and bending waves may generate inside the pole, and these two waves have very distinct characteristics and wave velocity. These differences are even more prominent in the low frequency which is usually induced in the low strain non-destructive testing. Consequently, it will be useful if these two waves can be separated for the condition assessment of the poles. In this paper, a numerical analysis is performed on a pole considering that both waves are generated, and a method is proposed to differentiate these two waves based on an appropriate sensor arrangement that includes the location and the orientation of the sensors. Continuous wavelet transform is applied on the numerical signal to calculate the phase velocity of the waves and compared with analytical phase velocity curves. From the results, it can be seen that appropriate location and orientation of the sensors can separate the longitudinal and flexural waves as they match significantly well with the corresponding analytical phase velocity curves of these two waves.

Geospatial estimation-based auto drift correction in wireless sensor networks

Wireless sensor networks are often deployed in large numbers, over a large geographical region, in order to monitor the phenomena of interest. Sensors used in the sensor networks often suffer from random or systematic errors such as drift and bias. Even if they are calibrated at the time of deployment, they tend to drift as time progresses. Consequently, the progressive manual calibration of such a large-scale sensor network becomes impossible in practice. In this article, we address this challenge by proposing a collaborative framework to automatically detect and correct the drift in order to keep the data collected from these networks reliable. We propose a novel scheme that uses geospatial estimation-based interpolation techniques on measurements from neighboring sensors to collaboratively predict the value of phenomenon being observed. The predicted values are then used iteratively to correct the sensor drift by means of a Kalman filter. Our scheme can be implemented in a centralized as well as distributed manner to detect and correct the drift generated in the sensors. For centralized implementation of our scheme, we compare several krigingand nonkriging-based geospatial estimation techniques in combination with the Kalman filter, and show the superiority of the kriging-based methods in detecting and correcting the drift. To demonstrate the applicability of our distributed approach on a real world application scenario, we implement our algorithm on a network consisting of Wireless Sensor Network (WSN) hardware. We further evaluate single as well as multiple drifting sensor scenarios to show the effectiveness of our algorithm for detecting and correcting drift. Further, we address the issue of high power usage for data transmission among neighboring nodes leading to low network lifetime for the distributed approach by proposing two power saving schemes. Moreover, we compare our algorithm with a blind calibration scheme in the literature and demonstrate its superiority in detecting both linear and nonlinear drifts.

Human bio-kinematic parameter estimation using inertial sensors.

This thesis focuses on accurately capturing bio-kinematic parameters for physical tele-rehabilitation using measurements from inertial sensors. Contributions are: accurately capturing human kinematics despite intrinsic uncertainties omnipresent with human movements, improving the tracking accuracy by correcting the sensor misalignment and assessing rehabilitation exercises for evaluating the progress of people with disabilities.

Eulerian-Lagrangian definition of coarse bed-load transport: Theory and verification with low-cost inertial measurement units

Fluvial sediment transport is controlled by hydraulics, sediment properties and arrangement, and flow history across a range of time scales. This physical complexity has led to ambiguous definition of the reference frame (Lagrangian or Eulerian) in which sediment transport is analysed. A general Eulerian-Lagrangian approach accounts for inertial characteristics of particles in a Lagrangian (particle fixed) frame, and for the hydrodynamics in an independent Eulerian frame. The necessary Eulerian-Lagrangian transformations are simplified under the assumption of an ideal Inertial Measurement Unit (IMU), rigidly attached at the centre of the mass of a sediment particle. Real, commercially available IMU sensors can provide high frequency data on accelerations and angular velocities (hence forces and energy) experienced by grains during entrainment and motion, if adequately customized. IMUs are subjected to significant error accu- mulation but they can be used for statistical parametrisation of an Eulerian-Lagrangian model, for coarse sediment particles and over the temporal scale of individual entrainment events. In this thesis an Eulerian-Lagrangian model is introduced and evaluated experimentally. Absolute inertial accelerations were recorded at a 4 Hz frequency from a spherical instrumented particle (111 mm diameter and 2383 kg/m3 density) in a series of entrainment threshold experiments on a fixed idealised bed. The grain-top inertial acceleration entrainment threshold was approximated at 44 and 51 mg for slopes 0.026 and 0.037 respectively. The saddle inertial acceleration entrainment threshold was at 32 and 25 mg for slopes 0.044 and 0.057 respectively. For the evaluation of the complete Eulerian-Lagrangian model two prototype sensors are presented: an idealised (spherical) with a diameter of 90 mm and an ellipsoidal with axes 100, 70 and 30 mm. Both are instrumented with a complete IMU, capable of sampling 3D inertial accelerations and 3D angular velocities at 50 Hz. After signal analysis, the results can be used to parametrize sediment movement but they do not contain positional information. The two sensors (spherical and ellipsoidal) were tested in a series of entrainment experiments, similar to the evaluation of the 111 mm prototype, for a slope of 0.02. The spherical sensor entrained at discharges of 24.8 ± 1.8 l/s while the same threshold for the ellipsoidal sensor was 45.2 ± 2.2 l/s. Kinetic energy calculations were used to quantify the particle-bed energy exchange under fluvial (discharge at 30 l/s) and non-fluvial conditions. All the experiments suggest that the effect of the inertial characteristics of coarse sediments on their motion is comparable to the effect hydrodynamic forces. The coupling of IMU sensors with advanced telemetric systems can lead to the tracking of Lagrangian particle trajectories, at a frequency and accuracy that will permit the testing of diffusion/dispersion models across the range of particle diameters.

Monitoring pasture variability: optical OptRx® crop sensor versus Grassmaster II capacitance probe

Estimation of pasture productivity is an important step for the farmer in terms of planning animal stocking, organizing animal lots, and determining supplementary feeding needs throughout the year. The main objective of this work was to evaluate technologies which have potential for monitoring aspects related to spatial and temporal variability of pasture green and dry matter yield (respectively, GM and DM, in kg/ha) and support to decision making for the farmer. Two types of sensors were evaluated: an active optical sensor(OptRx®, which measures the NDVI, Normalized Difference Vegetation Index) and a capacitance probe (GrassMaster II which estimates plant mass). The results showed the potential of NDVI for monitoring the evolution of spatial and temporal patterns of vegetative growth of biodiverse pasture. Higher NDVI values were registered as pasture approached its greatest vegetative vigor, with a significant fall in the measured NDVI at the end of Spring, when the pasture began to dry due to the combination of higher temperatures and lower soil moisture content. This index was also effective for identifying different plant species (grasses/legumes) and variability in pasture yield. Furthermore, it was possible to develop calibration equations between the capacitance and the NDVI (R2 = 0.757; p < 0.01), between capacitance and GM (R2 = 0.799; p<0.01), between capacitance and DM (R2 = 0.630; p<0.01), between NDVI and GM (R2=0.745; p < 0.01), and between capacitance and DM (R2=0.524; p<0.01). Finally, a direct relationship was obtained between NDVI and pasture moisture content (PMC, in %) and between capacitance and PMC (respectively, R2 = 0.615; p<0.01 and R2=0.561; p <0.01) in Alentejo dryland farming systems.

Effects of the orientation of the mountainside, altitude and varieties on the quality of the coffee beverage from the "Matas de Minas" region, brazilian Southeast.

Based upon qualitative parameters experiments, this study aims to investigate how the elements of the environment, where the coffee is produced, contribute to the final quality of the product. For the analyses, it was used approximately one kilogram of coffee cherry samples collected in 14municipalities previously chosen on the East side of the Minas Gerais State, Brazil. The coffee cherry samples were collected and analyzed for each of the two varieties in four levels of altitude for each exposure side of the mountain in relation to the Sun. The quality of the coffee was evaluated through the analysis of its physical characteristics and sensory analysis, popularly known as "Test of drink or Cupping" carried out by three tasters that belonging to the group of Q -Graders, according to the rules of national and international competitions of the Brazilian Association of Special Coffees (BSCA). Were performed analysis by means descriptive statistics, analysis of variance and multivariate analysis, all of them aiming to study the individual sensor y characteristics of quality of the coffee beverage from the ?Matas de Minas? region. Path coefficient analysis also was carried out for the partition of the phenotypic correlation coefficients into measures of direct and indirect effects, in order to determine the individual sensory characteristics that playeda major role in the beverage final score. The results demonstrat e that it is not possible to concl usively establish the differences among coffees evaluated with basis on varieties and environmental factors previously cited. It can be concluded that it is not recommended to associate the quality of coffee only to a specific factor whether from the environment or being it a specific of the culture of coffee. However, the cafes that were evaluated had intrinsic quality, which were derived from the specific characteristics of the ?Matas de Minas? region where they were grown.

The Impact of Internal Market Orientation on Staff Service Behaviours

The impact of service direction, service training and staff behaviours on perceptions of service delivery are examined. The impact of managerial behaviour in the form of internal market orientation (IMO) on the attitudes of frontline staff towards the firm and its consequent influence on their customer oriented behaviours is also examined. Frontline service staff working in the consumer transport industry were surveyed to provide subjective data about the constructs of interest in this study, and the data were analysed using structural equations modelling employing partial least squares estimation. The data indicate significant relationships between internal market orientation (IMO), the attitudes of the employees to the firm and their consequent behaviour towards customers. Customer orientation, service direction and service training are all identified as antecedents to high levels of service delivery. The study contributes to marketing theory by providing quantitative evidence to support assumptions that internal marketing has an impact on services success. For marketing practitioners, the research findings offer additional information about the management, training and motivation of service staff towards service excellence.