Modeling object identification and tracking errors on image-based safety assessment of earthmoving operations

Object identification and tracking have become critical for automated on-site construction safety assessment. The primary objective of this paper is to present the development of a testbed to analyze the impact of object identification and tracking errors caused by data collection devices and algorithms used for safety assessment. The testbed models workspaces for earthmoving operations and simulates safety-related violations, including speed limit violations, access violations to dangerous areas, and close proximity violations between heavy machinery. Three different cases were analyzed based on actual earthmoving operations conducted at a limestone quarry. Using the testbed, the impacts of device and algorithm errors were investigated for safety planning purposes.

Dynamic Performance Measures for Object Tracking Systems

Performance evaluation of object tracking systems is typically performed after the data has been processed, by comparing tracking results to ground truth. Whilst this approach is fine when performing offline testing, it does not allow for real-time analysis of the systems performance, which may be of use for live systems to either automatically tune the system or report reliability. In this paper, we propose three metrics that can be used to dynamically asses the performance of an object tracking system. Outputs and results from various stages in the tracking system are used to obtain measures that indicate the performance of motion segmentation, object detection and object matching. The proposed dynamic metrics are shown to accurately indicate tracking errors when visually comparing metric results to tracking output, and are shown to display similar trends to the ETISEO metrics when comparing different tracking configurations.

Robust finite-time tracking control of nonholonomic mobile robots without velocity measurements

The problem of robust finite-time trajectory tracking of nonholonomic mobile robots with unmeasurable velocities is studied. The contributions of the paper are that: first, in the case that the angular velocity of the mobile robot is unmeasurable, a composite controller including the observer-based partial state feedback control and the disturbance feed-forward compensation is designed, which guarantees that the tracking errors converge to zero in finite time. Second, if the linear velocity as well as the angular velocity of mobile robot is unmeasurable, with a stronger constraint, the finite-time trajectory tracking control of nonholonomic mobile robot is also addressed. Finally, the effectiveness of the proposed control laws is demonstrated by simulation.

Energy-efficient self -organization of wireless acoustic sensor networks for ground target tracking

With the developments in computing and communication technologies, wireless sensor networks have become popular in wide range of application areas such as health, military, environment and habitant monitoring. Moreover, wireless acoustic sensor networks have been widely used for target tracking applications due to their passive nature, reliability and low cost. Traditionally, acoustic sensor arrays built in linear, circular or other regular shapes are used for tracking acoustic sources. The maintaining of relative geometry of the acoustic sensors in the array is vital for accurate target tracking, which greatly reduces the flexibility of the sensor network. To overcome this limitation, we propose using only a single acoustic sensor at each sensor node. This design greatly improves the flexibility of the sensor network and makes it possible to deploy the sensor network in remote or hostile regions through air-drop or other stealth approaches. Acoustic arrays are capable of performing the target localization or generating the bearing estimations on their own. However, with only a single acoustic sensor, the sensor nodes will not be able to generate such measurements. Thus, self-organization of sensor nodes into virtual arrays to perform the target localization is essential. We developed an energy-efficient and distributed self-organization algorithm for target tracking using wireless acoustic sensor networks. The major error sources of the localization process were studied, and an energy-aware node selection criterion was developed to minimize the target localization errors. Using this node selection criterion, the self-organization algorithm selects a near-optimal localization sensor group to minimize the target tracking errors. In addition, a message passing protocol was developed to implement the self-organization algorithm in a distributed manner. In order to achieve extended sensor network lifetime, energy conservation was incorporated into the self-organization algorithm by incorporating a sleep-wakeup management mechanism with a novel cross layer adaptive wakeup probability adjustment scheme. The simulation results confirm that the developed self-organization algorithm provides satisfactory target tracking performance. Moreover, the energy saving analysis confirms the effectiveness of the cross layer power management scheme in achieving extended sensor network lifetime without degrading the target tracking performance.

Energy-Efficient Self-Organization of Wireless Acoustic Sensor Networks for Ground Target Tracking

With the developments in computing and communication technologies, wireless sensor networks have become popular in wide range of application areas such as health, military, environment and habitant monitoring. Moreover, wireless acoustic sensor networks have been widely used for target tracking applications due to their passive nature, reliability and low cost. Traditionally, acoustic sensor arrays built in linear, circular or other regular shapes are used for tracking acoustic sources. The maintaining of relative geometry of the acoustic sensors in the array is vital for accurate target tracking, which greatly reduces the flexibility of the sensor network. To overcome this limitation, we propose using only a single acoustic sensor at each sensor node. This design greatly improves the flexibility of the sensor network and makes it possible to deploy the sensor network in remote or hostile regions through air-drop or other stealth approaches. Acoustic arrays are capable of performing the target localization or generating the bearing estimations on their own. However, with only a single acoustic sensor, the sensor nodes will not be able to generate such measurements. Thus, self-organization of sensor nodes into virtual arrays to perform the target localization is essential. We developed an energy-efficient and distributed self-organization algorithm for target tracking using wireless acoustic sensor networks. The major error sources of the localization process were studied, and an energy-aware node selection criterion was developed to minimize the target localization errors. Using this node selection criterion, the self-organization algorithm selects a near-optimal localization sensor group to minimize the target tracking errors. In addition, a message passing protocol was developed to implement the self-organization algorithm in a distributed manner. In order to achieve extended sensor network lifetime, energy conservation was incorporated into the self-organization algorithm by incorporating a sleep-wakeup management mechanism with a novel cross layer adaptive wakeup probability adjustment scheme. The simulation results confirm that the developed self-organization algorithm provides satisfactory target tracking performance. Moreover, the energy saving analysis confirms the effectiveness of the cross layer power management scheme in achieving extended sensor network lifetime without degrading the target tracking performance.

Design of a preliminary error impact analysis model for spatial safety assessment of earthmoving operations

Regardless of technology benefits, safety planners still face difficulties explaining errors related to the use of different technologies and evaluating how the errors impact the performance of safety decision making. This paper presents a preliminary error impact analysis testbed to model object identification and tracking errors caused by image-based devices and algorithms and to analyze the impact of the errors for spatial safety assessment of earthmoving and surface mining activities. More specifically, this research designed a testbed to model workspaces for earthmoving operations, to simulate safety-related violations, and to apply different object identification and tracking errors on the data collected and processed for spatial safety assessment. Three different cases were analyzed based on actual earthmoving operations conducted at a limestone quarry. Using the testbed, the impacts of the errors were investigated for the safety planning purpose.

Decision strategies for automated visual collision avoidance

This paper provides a preliminary analysis of an autonomous uncooperative collision avoidance strategy for unmanned aircraft using image-based visual control. Assuming target detection, the approach consists of three parts. First, a novel decision strategy is used to determine appropriate reference image features to track for safe avoidance. This is achieved by considering the current rules of the air (regulations), the properties of spiral motion and the expected visual tracking errors. Second, a spherical visual predictive control (VPC) scheme is used to guide the aircraft along a safe spiral-like trajectory about the object. Lastly, a stopping decision based on thresholding a cost function is used to determine when to stop the avoidance behaviour. The approach does not require estimation of range or time to collision, and instead relies on tuning two mutually exclusive decision thresholds to ensure satisfactory performance.

Thermal energy minimisation in papermaking via MD control approach

This paper reports the application of Advanced Process Control (APC) techniques for improving the thermal energy efficiency of a paperboard-making process by regulating the Machine Direction (MD) profile of the basis weight and moisture content of the paper-board. A Model Predictive Controller (MPC) is designed so that the sheet moisture and basis weight tracking errors along with variations of the sheet moisture and basis weight are reduced. Also, the drainage is maximised through improved wet-end stability which can facilitate driving the sheet moisture set-point closer to its upper specification limit over time. It is shown that the proposed strategy can result in reducing steam usage by 8-10%. A simulation study based on a UK board machine is presented to show the effectiveness of the proposed technique. © 2011 Intl Journal of Adv Mechatr.

柔性机械臂基于观测的逆动力学轨迹跟踪控制

本文探讨了稳定逆动力学与基于观测的状态误差反馈镇定器集成实现柔性机械臂末端轨迹跟踪的控制策略．基于观测器可以充分利用由稳定逆动力学生成的理想状态轨迹信息，实现全状态误差的反馈镇定以消除末端轨迹跟踪的扰动误差。

机器人机械手的鲁棒性稳定跟踪控制

为工业机器人机械手提出了一种稳定跟踪控制法．这种控制方法由前馈控制器、反馈控制器组成．前馈控制根据期望轨线用计算力矩法得到；反馈控制由线性ＰＩＤ控制项和非线性ＰＤ控制项组成，这种控制方法能使跟踪误差逐渐趋近于零．最后，给出了ＰＵＭＡ５６０机器人的计算机仿真实验验证此控制方法的有效性

Teleoperation of ABB industrial robots

Purpose - The purpose of this paper is to analyse teleoperation of an ABB industrial robot with an ABB IRC5 controller. A method to improve motion smoothness and decrease latency using the existing ABB IRC5 robot controller without access to any low-level interface is proposed. Design/methodology/ approach - The proposed control algorithm includes a high-level proportional-integral-derivative controller (PID) controller used to dynamically generate reference velocities for different travel ranges of the tool centre point (TCP) of the robot. Communication with the ABB IRC5 controller was performed utilising the ABB PC software development kit. The multitasking feature of the IRC5 controller was used to enhance the communication frequency between the controller and the remote application. Trajectory tracking experiments of a pre-defined three-dimensional trajectory were carried out and the benefits of the proposed algorithm were demonstrated. The robot was intentionally installed on a wobbly table and its vibrations were recorded using a six-degrees-of-freedom force/torque sensor fitted to the tool mounting interface of the robot. The robot vibrations were used as a measure of the smoothness of the tracking movements. Findings - A communication rate of up to 250 Hz between the computer and the controller was established using C#.Net. Experimental results demonstrating the robot TCP, tracking errors and robot vibrations for different control approaches were provided and analysed. It was demonstrated that the proposed approach results in the smoothest motion with tracking errors of < 0.2 mm. Research limitations/implications - The proposed approach may be employed to produce smooth motion for a remotely operated ABB industrial robot with the existing ABB IRC5 controller. However, to achieve high-bandwidth path following, the inherent latency of the controller must be overcome, for example by utilising a low-level interface. It is particularly useful for applications including a large number of short manipulation segments, which is typical in teleoperation applications. Social implications - Using the proposed technique, off-the-shelf industrial robots can be used for research and industrial applications where remote control is required. Originality/value - Although low-level control interface for industrial robots seems to be the ideal long-term solution for teleoperation applications, the proposed remote control technique allows out-of-the-box ABB industrial robots with IRC5 controllers to achieve high efficiency and manipulation smoothness without requirements of any low-level programming interface. © Copyright - 2014 Emerald Group Publishing Limited. All rights reserved.

Improvements in teleoperation of industrial robots without low-level access

 This paper proposes a method to improve motion smoothness and decrease latency using existing ABB IRC5 robot controllers without access to any low level interface. The proposed control algorithm includes a high-level PID controller used to dynamically generate reference velocities for different travel ranges of the tool centre point (TCP) of the robot. Communication with the ABB IRC5 controller was performed utilising the ABB PC software development kit (SDK). The multitasking feature of the IRC5 controller was used in order to enhance the communication frequency between the controller and the remote application. Trajectory tracking experiments of a predefined 3D trajectory were carried out and the benefits of the proposed algorithm was demonstrated. The robot was intentionally installed on a wobbly table and its vibrations were recorded using a six degrees of freedom (DOF) force/torque sensor fitted to the tool mounting interface of the robot. The robot vibrations were used as a measure of the smoothness of the tracking movements. Experimental results demonstrating the robot tool centre point (TCP), tracking errors, and robot vibrations for different control approaches were provided and analysed. It was demonstrated that the proposed approach results in the smoothest motion with less than 0.2 mm tracking errors.

Modelagem e controle de um microveículo aéreo: uma aplicação de estabilidade robusta com a técnica backstepping em uma estrutura hexarrotor

In this Thesis, the development of the dynamic model of multirotor unmanned aerial vehicle with vertical takeoff and landing characteristics, considering input nonlinearities and a full state robust backstepping controller are presented. The dynamic model is expressed using the Newton-Euler laws, aiming to obtain a better mathematical representation of the mechanical system for system analysis and control design, not only when it is hovering, but also when it is taking-off, or landing, or flying to perform a task. The input nonlinearities are the deadzone and saturation, where the gravitational effect and the inherent physical constrains of the rotors are related and addressed. The experimental multirotor aerial vehicle is equipped with an inertial measurement unit and a sonar sensor, which appropriately provides measurements of attitude and altitude. A real-time attitude estimation scheme based on the extended Kalman filter using quaternions was developed. Then, for robustness analysis, sensors were modeled as the ideal value with addition of an unknown bias and unknown white noise. The bounded robust attitude/altitude controller were derived based on globally uniformly practically asymptotically stable for real systems, that remains globally uniformly asymptotically stable if and only if their solutions are globally uniformly bounded, dealing with convergence and stability into a ball of the state space with non-null radius, under some assumptions. The Lyapunov analysis technique was used to prove the stability of the closed-loop system, compute bounds on control gains and guaranteeing desired bounds on attitude dynamics tracking errors in the presence of measurement disturbances. The controller laws were tested in numerical simulations and in an experimental hexarotor, developed at the UFRN Robotics Laboratory

Improving the GNSS positioning stochastic model in the presence of ionospheric scintillation

Ionospheric scintillations are caused by time-varying electron density irregularities in the ionosphere, occurring more often at equatorial and high latitudes. This paper focuses exclusively on experiments undertaken in Europe, at geographic latitudes between similar to 50 degrees N and similar to 80 degrees N, where a network of GPS receivers capable of monitoring Total Electron Content and ionospheric scintillation parameters was deployed. The widely used ionospheric scintillation indices S4 and sigma(phi) represent a practical measure of the intensity of amplitude and phase scintillation affecting GNSS receivers. However, they do not provide sufficient information regarding the actual tracking errors that degrade GNSS receiver performance. Suitable receiver tracking models, sensitive to ionospheric scintillation, allow the computation of the variance of the output error of the receiver PLL (Phase Locked Loop) and DLL (Delay Locked Loop), which expresses the quality of the range measurements used by the receiver to calculate user position. The ability of such models of incorporating phase and amplitude scintillation effects into the variance of these tracking errors underpins our proposed method of applying relative weights to measurements from different satellites. That gives the least squares stochastic model used for position computation a more realistic representation, vis-a-vis the otherwise 'equal weights' model. For pseudorange processing, relative weights were computed, so that a 'scintillation-mitigated' solution could be performed and compared to the (non-mitigated) 'equal weights' solution. An improvement between 17 and 38% in height accuracy was achieved when an epoch by epoch differential solution was computed over baselines ranging from 1 to 750 km. The method was then compared with alternative approaches that can be used to improve the least squares stochastic model such as weighting according to satellite elevation angle and by the inverse of the square of the standard deviation of the code/carrier divergence (sigma CCDiv). The influence of multipath effects on the proposed mitigation approach is also discussed. With the use of high rate scintillation data in addition to the scintillation indices a carrier phase based mitigated solution was also implemented and compared with the conventional solution. During a period of occurrence of high phase scintillation it was observed that problems related to ambiguity resolution can be reduced by the use of the proposed mitigated solution.

Dynamic analysis of a new piezoelectric flextensional actuator using the J1-J4 optical interferometric method

Piezoelectric actuators are widely used in positioning systems which demand high resolution such as scanning microscopy, fast mirror scanners, vibration cancellation, cell manipulation, etc. In this work a piezoelectric flextensional actuator (PFA), designed with the topology optimization method, is experimentally characterized by the measurement of its nanometric displacements using a Michelson interferometer. Because this detection process is non-linear, adequate techniques must be applied to obtain a linear relationship between an output electrical signal and the induced optical phase shift. Ideally, the bias phase shift in the interferometer should remain constant, but in practice it suffers from fading. The J1-J4 spectral analysis method provides a linear and direct measurement of dynamic phase shift in a no-feedback and no-phase bias optical homodyne interferometer. PFA application such as micromanipulation in biotechnology demands fast and precise movements. So, in order to operate with arbitrary control signals the PFA must have frequency bandwidth of several kHz. However as the natural frequencies of the PFA are low, unwanted dynamics of the structure are often a problem, especially for scanning motion, but also if trajectories have to be followed with high velocities, because of the tracking error phenomenon. So the PFA must be designed in such a manner that the first mechanical resonance occurs far beyond this band. Thus it is important to know all the PFA resonance frequencies. In this work the linearity and frequency response of the PFA are evaluated up to 50 kHz using optical interferometry and the J1-J4 method.