Modeling and control of a 3500 tonne mining robot

Draglines are extremely large machines that are widely used in open-cut coal mines for overburden stripping. Since 1994 we have been working toward the development of a computer control system capable of automatically driving a dragline for a large portion of its operating cycle. This has necessitated the development and experimental evaluation of sensor systems, machines models, closed-loop control controllers, and an operator interface. This paper describes our steps toward the goal through scale-model and full-scale field experimentation.

A robot application to marine vessel inspection

Seagoing vessels have to undergo regular inspections, which are currently performed manually by ship surveyors. The main cost factor in a ship inspection is to provide access to the different areas of the ship, since the surveyor has to be close to the inspected parts, usually within arm's reach, either to perform a visual analysis or to take thickness measurements. The access to the structural elements in cargo holds, e.g., bulkheads, is normally provided by staging or by 'cherry-picking' cranes. To make ship inspections safer and more cost-efficient, we have introduced new inspection methods, tools, and systems, which have been evaluated in field trials, particularly focusing on cargo holds. More precisely, two magnetic climbing robots and a micro-aerial vehicle, which are able to assist the surveyor during the inspection, are introduced. Since localization of inspection data is mandatory for the surveyor, we also introduce an external localization system that has been verified in field trials, using a climbing inspection robot. Furthermore, the inspection data collected by the robotic systems are organized and handled by a spatial content management system that enables us to compare the inspection data of one survey with those from another, as well as to document the ship inspection when the robot team is used. Image-based defect detection is addressed by proposing an integrated solution for detecting corrosion and cracks. The systems' performance is reported, as well as conclusions on their usability, all in accordance with the output of field trials performed onboard two different vessels under real inspection conditions.

Adaptive compliance control of a multi‐legged stair‐climbing robot based on proprioceptive data

Purpose – The purpose of this paper is to describe an innovative compliance control architecture for hybrid multi‐legged robots. The approach was verified on the hybrid legged‐wheeled robot ASGUARD, which was inspired by quadruped animals. The adaptive compliance controller allows the system to cope with a variety of stairs, very rough terrain, and is also able to move with high velocity on flat ground without changing the control parameters. Design/methodology/approach – The paper shows how this adaptivity results in a versatile controller for hybrid legged‐wheeled robots. For the locomotion control we use an adaptive model of motion pattern generators. The control approach takes into account the proprioceptive information of the torques, which are applied on the legs. The controller itself is embedded on a FPGA‐based, custom designed motor control board. An additional proprioceptive inclination feedback is used to make the same controller more robust in terms of stair‐climbing capabilities. Findings – The robot is well suited for disaster mitigation as well as for urban search and rescue missions, where it is often necessary to place sensors or cameras into dangerous or inaccessible areas to get a better situation awareness for the rescue personnel, before they enter a possibly dangerous area. A rugged, waterproof and dust‐proof corpus and the ability to swim are additional features of the robot. Originality/value – Contrary to existing approaches, a pre‐defined walking pattern for stair‐climbing was not used, but an adaptive approach based only on internal sensor information. In contrast to many other walking pattern based robots, the direct proprioceptive feedback was used in order to modify the internal control loop, thus adapting the compliance of each leg on‐line.

Towards the development of a low cost airborne sensing system to monitor dust particles after blasting at open-pit mine sites

Blasting is an integral part of large-scale open cut mining that often occurs in close proximity to population centers and often results in the emission of particulate material and gases potentially hazardous to health. Current air quality monitoring methods rely on limited numbers of fixed sampling locations to validate a complex fluid environment and collect sufficient data to confirm model effectiveness. This paper describes the development of a methodology to address the need of a more precise approach that is capable of characterizing blasting plumes in near-real time. The integration of the system required the modification and integration of an opto-electrical dust sensor, SHARP GP2Y10, into a small fixed-wing and multi-rotor copter, resulting in the collection of data streamed during flight. The paper also describes the calibration of the optical sensor with an industry grade dust-monitoring device, Dusttrak 8520, demonstrating a high correlation between them, with correlation coefficients (R2) greater than 0.9. The laboratory and field tests demonstrate the feasibility of coupling the sensor with the UAVs. However, further work must be done in the areas of sensor selection and calibration as well as flight planning.

A critical evaluation of literature on robot path planning in dynamic environment

Robot Path Planning (RPP) in dynamic environments is a search problem based on the examination of collision-free paths in the presence of dynamic and static obstacles. Many techniques have been developed to solve this problem. Trapping in a local minima and maintaining a Real-Time performance are known as the two most important challenges that these techniques face to solve such problem. This study presents a comprehensive survey of the various techniques that have been proposed in this domain. As part of this survey, we include a classification of the approaches and identify their methods.

External signal-activated liposomal drug delivery systems

Modern drug discovery gives rise to a great number of potential new therapeutic agents, but in some cases the efficient treatment of patient may not be achieved because the delivery of active compounds to the target site is insufficient. Thus, drug delivery is one of the major challenges in current pharmaceutical research. Numerous nanoparticle-based drug carriers, e.g. liposomes, have been developed for enhanced drug delivery and targeting. Drug targeting may enhance the efficiency of the treatment and, importantly, reduce unwanted side effects by decreasing drug distribution to non-target tissues. Liposomes are biocompatible lipid-based carriers that have been studied for drug delivery during the last 40 years. They can be functionalized with targeting ligands and sensing materials for triggered activation. In this study, various external signal-assisted liposomal delivery systems were developed. Signals can be used to modulate drug permeation or release from the liposome formulation, and they provide accurate control of time, place and rate of activation. The study involved three types of signals that were used to trigger drug permeation and release: electricity, heat and light. Electrical stimulus was utilized to enhance the permeation of liposomal DNA across the skin. Liposome/DNA complex-mediated transfections were performed in tight rat epidermal cell model. Various transfection media and current intensities were tested, and transfection efficiency was evaluated non-invasively by monitoring the concentration of secreted reporter protein in cell culture medium. Liposome/DNA complexes produced gene expression, but electrical stimulus did not enhance the transfection efficiency significantly. Heat-sensitive liposomal drug delivery system was developed by coating liposomes with biodegradable and thermosensitive poly(N-(2-hydroxypropyl) methacrylamide-mono/dilactate polymer. Temperature-triggered liposome aggregation and contents release from liposomes were evaluated. The cloud point temperature (CP) of the polymer was set to 42 °C. Polymer-coated liposome aggregation and contents release were observed above CP of the polymer, while non-coated liposomes remained intact. Polymer precipitates above its CP and interacts with liposomal bilayers. It is likely that this induces permeabilization of the liposomal membrane and contents release. Light-sensitivity was introduced to liposomes by incorporation of small (< 5 nm) gold nanoparticles. Hydrophobic and hydrophilic gold nanoparticles were embedded in thermosensitive liposomes, and contents release was investigated upon UV light exposure. UV light-induced lipid phase transitions were examined with small angle X-ray scattering, and light-triggered contents release was shown also in human retinal pigment epithelial cell line. Gold nanoparticles absorb light energy and transfer it into heat, which induces phase transitions in liposomes and triggers the contents release. In conclusion, external signal-activated liposomes offer an advanced platform for numerous applications in drug delivery, particularly in the localized drug delivery. Drug release may be localized to the target site with triggering stimulus that results in better therapeutic response and less adverse effects. Triggering signal and mechanism of activation can be selected according to a specific application.

Spectral and thermal sensing for nitrogen and water status in rainfed and irrigated wheat environments

Variable-rate technologies and site-specific crop nutrient management require real-time spatial information about the potential for response to in-season crop management interventions. Thermal and spectral properties of canopies can provide relevant information for non-destructive measurement of crop water and nitrogen stresses. In previous studies, foliage temperature was successfully estimated from canopy-scale (mixed foliage and soil) temperatures and the multispectral Canopy Chlorophyll Content Index (CCCI) was effective in measuring canopy-scale N status in rainfed wheat (Triticum aestivum L.) systems in Horsham, Victoria, Australia. In the present study, results showed that under irrigated wheat systems in Maricopa, Arizona, USA, the theoretical derivation of foliage temperature unmixing produced relationships similar to those in Horsham. Derivation of the CCCI led to an r2 relationship with chlorophyll a of 0.53 after Zadoks stage 43. This was later than the relationship (r2 = 0.68) developed for Horsham after Zadoks stage 33 but early enough to be used for potential mid-season N fertilizer recommendations. Additionally, ground-based hyperspectral data estimated plant N (g kg)1) in Horsham with an r2 = 0.86 but was confounded by water supply and N interactions. By combining canopy thermal and spectral properties, varying water and N status can potentially be identified eventually permitting targeted N applications to those parts of a field where N can be used most efficiently by the crop.

Remote sensing of nitrogen and water stress in wheat

Nitrogen (N) is the largest agricultural input in many Australian cropping systems and applying the right amount of N in the right place at the right physiological stage is a significant challenge for wheat growers. Optimizing N uptake could reduce input costs and minimize potential off-site movement. Since N uptake is dependent on soil and plant water status, ideally, N should be applied only to areas within paddocks with sufficient plant available water. To quantify N and water stress, spectral and thermal crop stress detection methods were explored using hyperspectral, multispectral and thermal remote sensing data collected at a research field site in Victoria, Australia. Wheat was grown over two seasons with two levels of water inputs (rainfall/irrigation) and either four levels (in 2004; 0, 17, 39 and 163 kg/ha) or two levels (in 2005; 0 and 39 kg/ha N) of nitrogen. The Canopy Chlorophyll Content Index (CCCI) and modified Spectral Ratio planar index (mSRpi), two indices designed to measure canopy-level N, were calculated from canopy-level hyperspectral data in 2005. They accounted for 76% and 74% of the variability of crop N status, respectively, just prior to stem elongation (Zadoks 24). The Normalised Difference Red Edge (NDRE) index and CCCI, calculated from airborne multispectral imagery, accounted for 41% and 37% of variability in crop N status, respectively. Greater scatter in the airborne data was attributable to the difference in scale of the ground and aerial measurements (i.e., small area plant samples against whole-plot means from imagery). Nevertheless, the analysis demonstrated that canopy-level theory can be transferred to airborne data, which could ultimately be of more use to growers. Thermal imagery showed that mean plot temperatures of rainfed treatments were 2.7 °C warmer than irrigated treatments (P < 0.001) at full cover. For partially vegetated fields, the two-Dimensional Crop Water Stress Index (2D CWSI) was calculated using the Vegetation Index-Temperature (VIT) trapezoid method to reduce the contribution of soil background to image temperature. Results showed rainfed plots were consistently more stressed than irrigated plots. Future work is needed to improve the ability of the CCCI and VIT methods to detect N and water stress and apply both indices simultaneously at the paddock scale to test whether N can be targeted based on water status. Use of these technologies has significant potential for maximising the spatial and temporal efficiency of N applications for wheat growers. ‘Ground–breaking Stuff’- Proceedings of the 13th Australian Society of Agronomy Conference, 10-14 September 2006, Perth, Western Australia.

Affective sensing + wearable imaging: Vision impairment and implications for spatial enquiry

Recent interest in affect and the body have mobilized a contemporary review of aesthetics and phenomenology within architecture to unpack how environments affect spatial experience. Emerging spatial studies within the neuro-sciences, and their implications for architectural research as raised by architectural theorists Juhani Pallasmaa (2014) and Harry Mallgrave (2013) has been well supported by a raft of scientists and institutions including the prestigious Salk Institute. Although there has been some headway in spatial studies of the vision impaired (Cattaneo et al, 2011) to understand the role of their non-visual systems in assisting navigation and location, little is discussed in terms of their other abilities in sensing particular qualities of space which impinge upon emotion. This paper reviews a collection of studies exploring face vision and echo-location, amongst others, which provide insight into what might be termed affective perception of the vision impaired, and how further interplay between this research and the architectural field can contribute new knowledge regarding space and affect. By engaging with themes from the Aesthetics, Phenomenology and indeed Neuro-science fields, the paper provides background of current and potential cross disciplinary research, and highlights the role wearable technologies can play in enhancing knowledge of affective spatial experience.

Spectral Sensing for Cognitive Radio: Estimation of Adaptive Frequency Hopping Signal

The issue of dynamic spectrum scene analysis in any cognitive radio network becomes extremely complex when low probability of intercept, spread spectrum systems are present in environment. The detection and estimation become more complex if frequency hopping spread spectrum is adaptive in nature. In this paper, we propose two phase approach for detection and estimation of frequency hoping signals. Polyphase filter bank has been proposed as the architecture of choice for detection phase to efficiently detect the presence of frequency hopping signal. Based on the modeling of frequency hopping signal it can be shown that parametric methods of line spectral analysis are well suited for estimation of frequency hopping signals if the issues of order estimation and time localization are resolved. An algorithm using line spectra parameter estimation and wavelet based transient detection has been proposed which resolves above issues in computationally efficient manner suitable for implementation in cognitive radio. The simulations show promising results proving that adaptive frequency hopping signals can be detected and demodulated in a non cooperative context, even at a very low signal to noise ratio in real time.

Design and Simulation of a Solar Powered UAV for Remote Sensing Tasks Technical Report

This research deals with the development of a Solar-Powered UAV designed for remote sensing, in particular to the development of the autopilot sub-system and path planning. The design of the Solar-Powered UAS followed a systems engineering methodology, by first defining system architecture, and selecting each subsystem. Validation tests and integration of autopilot is performed, in order to evaluate the performances of each subsystem and to obtain a global operational system for data collection missions. The flight tests planning and simulation results are also explored in order to verify the mission capabilities using an autopilot on a UAS. The important aspect of this research is to develop a Solar-Powered UAS for the purpose of data collection and video monitoring, especially data and images from the ground; transmit to the GS (Ground Station), segment the collected data, and afterwards analyze it with a Matlab code.

Sensing Shape Recovery Using Conductivity Noise in Thin Films of NiTi Shape Memory Alloys

Low frequency fluctuations in the electrical resistivity, or noise, have been used as a sensitive tool to probe into the temperature driven martensite transition in dc magnetron sputtered thin films of nickel titanium shape-memory alloys. Even in the equilibrium or static case, the noise magnitude was more than nine orders of magnitude larger than conventional metallic thin films and had a characteristic dependence on temperature. We observe that the noise while the temperature is being ramped is far larger as compared to the equilibrium noise indicating the sensitivity of electrical resistivity to the nucleation and propagation of domains during the shape recovery. Further, the higher order statistics suggests the existence of long range correlations during the transition. This new characterization is based on the kinetics of disorder in the system and separate from existing techniques and can be integrated to many device applications of shape memory alloys for in-situ shape recovery sensing.

Automatic Lameness Detection in a Milking Robot : Instrumentation, measurement software, algorithms for data analysis and a neural network model

The aim of this thesis is to develop a fully automatic lameness detection system that operates in a milking robot. The instrumentation, measurement software, algorithms for data analysis and a neural network model for lameness detection were developed. Automatic milking has become a common practice in dairy husbandry, and in the year 2006 about 4000 farms worldwide used over 6000 milking robots. There is a worldwide movement with the objective of fully automating every process from feeding to milking. Increase in automation is a consequence of increasing farm sizes, the demand for more efficient production and the growth of labour costs. As the level of automation increases, the time that the cattle keeper uses for monitoring animals often decreases. This has created a need for systems for automatically monitoring the health of farm animals. The popularity of milking robots also offers a new and unique possibility to monitor animals in a single confined space up to four times daily. Lameness is a crucial welfare issue in the modern dairy industry. Limb disorders cause serious welfare, health and economic problems especially in loose housing of cattle. Lameness causes losses in milk production and leads to early culling of animals. These costs could be reduced with early identification and treatment. At present, only a few methods for automatically detecting lameness have been developed, and the most common methods used for lameness detection and assessment are various visual locomotion scoring systems. The problem with locomotion scoring is that it needs experience to be conducted properly, it is labour intensive as an on-farm method and the results are subjective. A four balance system for measuring the leg load distribution of dairy cows during milking in order to detect lameness was developed and set up in the University of Helsinki Research farm Suitia. The leg weights of 73 cows were successfully recorded during almost 10,000 robotic milkings over a period of 5 months. The cows were locomotion scored weekly, and the lame cows were inspected clinically for hoof lesions. Unsuccessful measurements, caused by cows standing outside the balances, were removed from the data with a special algorithm, and the mean leg loads and the number of kicks during milking was calculated. In order to develop an expert system to automatically detect lameness cases, a model was needed. A probabilistic neural network (PNN) classifier model was chosen for the task. The data was divided in two parts and 5,074 measurements from 37 cows were used to train the model. The operation of the model was evaluated for its ability to detect lameness in the validating dataset, which had 4,868 measurements from 36 cows. The model was able to classify 96% of the measurements correctly as sound or lame cows, and 100% of the lameness cases in the validation data were identified. The number of measurements causing false alarms was 1.1%. The developed model has the potential to be used for on-farm decision support and can be used in a real-time lameness monitoring system.

Affective Sensing: Vision Impairment and Implications for Spatial Enquiry

Recent interest in affect and the body have mobilised a contemporary review of aesthetics and phenomenology within architecture to unpack how environments affect spatial experience. Emerging spatial studies within the neurosciences, and their implications for architectural research as raised by architectural theorists has been well supported by a raft of scientists and institutions. Although there has been some headway in spatial studies of the vision impaired (Cattaneo et al., 2011) to understand the role of their non-visual systems in assisting navigation and location, little is discussed in terms of their other abilities in sensing particular qualities of space which impinge upon emotion and wellbeing. This research explores, through published studies and constructed spatial interviews, the affective perception of the vision impaired and how further interplay between this research and the architectural field can contribute new knowledge regarding space and affect. The research aims to provide background of current and potential cross disciplinary research and highlight the role wearable technologies can play in enhancing knowledge of affective spatial experience.

Geospatial environmental data modelling applications using remote sensing, GIS and spatial statistics

This thesis presents novel modelling applications for environmental geospatial data using remote sensing, GIS and statistical modelling techniques. The studied themes can be classified into four main themes: (i) to develop advanced geospatial databases. Paper (I) demonstrates the creation of a geospatial database for the Glanville fritillary butterfly (Melitaea cinxia) in the Åland Islands, south-western Finland; (ii) to analyse species diversity and distribution using GIS techniques. Paper (II) presents a diversity and geographical distribution analysis for Scopulini moths at a world-wide scale; (iii) to study spatiotemporal forest cover change. Paper (III) presents a study of exotic and indigenous tree cover change detection in Taita Hills Kenya using airborne imagery and GIS analysis techniques; (iv) to explore predictive modelling techniques using geospatial data. In Paper (IV) human population occurrence and abundance in the Taita Hills highlands was predicted using the generalized additive modelling (GAM) technique. Paper (V) presents techniques to enhance fire prediction and burned area estimation at a regional scale in East Caprivi Namibia. Paper (VI) compares eight state-of-the-art predictive modelling methods to improve fire prediction, burned area estimation and fire risk mapping in East Caprivi Namibia. The results in Paper (I) showed that geospatial data can be managed effectively using advanced relational database management systems. Metapopulation data for Melitaea cinxia butterfly was successfully combined with GPS-delimited habitat patch information and climatic data. Using the geospatial database, spatial analyses were successfully conducted at habitat patch level or at more coarse analysis scales. Moreover, this study showed it appears evident that at a large-scale spatially correlated weather conditions are one of the primary causes of spatially correlated changes in Melitaea cinxia population sizes. In Paper (II) spatiotemporal characteristics of Socupulini moths description, diversity and distribution were analysed at a world-wide scale and for the first time GIS techniques were used for Scopulini moth geographical distribution analysis. This study revealed that Scopulini moths have a cosmopolitan distribution. The majority of the species have been described from the low latitudes, sub-Saharan Africa being the hot spot of species diversity. However, the taxonomical effort has been uneven among biogeographical regions. Paper III showed that forest cover change can be analysed in great detail using modern airborne imagery techniques and historical aerial photographs. However, when spatiotemporal forest cover change is studied care has to be taken in co-registration and image interpretation when historical black and white aerial photography is used. In Paper (IV) human population distribution and abundance could be modelled with fairly good results using geospatial predictors and non-Gaussian predictive modelling techniques. Moreover, land cover layer is not necessary needed as a predictor because first and second-order image texture measurements derived from satellite imagery had more power to explain the variation in dwelling unit occurrence and abundance. Paper V showed that generalized linear model (GLM) is a suitable technique for fire occurrence prediction and for burned area estimation. GLM based burned area estimations were found to be more superior than the existing MODIS burned area product (MCD45A1). However, spatial autocorrelation of fires has to be taken into account when using the GLM technique for fire occurrence prediction. Paper VI showed that novel statistical predictive modelling techniques can be used to improve fire prediction, burned area estimation and fire risk mapping at a regional scale. However, some noticeable variation between different predictive modelling techniques for fire occurrence prediction and burned area estimation existed.