Recognition of Planar Segments in Point Cloud Based on Wavelet Transform

© 2005-2012 IEEE.Within industrial automation systems, three-dimensional (3-D) vision provides very useful feedback information in autonomous operation of various manufacturing equipment (e.g., industrial robots, material handling devices, assembly systems, and machine tools). The hardware performance in contemporary 3-D scanning devices is suitable for online utilization. However, the bottleneck is the lack of real-time algorithms for recognition of geometric primitives (e.g., planes and natural quadrics) from a scanned point cloud. One of the most important and the most frequent geometric primitive in various engineering tasks is plane. In this paper, we propose a new fast one-pass algorithm for recognition (segmentation and fitting) of planar segments from a point cloud. To effectively segment planar regions, we exploit the orthonormality of certain wavelets to polynomial function, as well as their sensitivity to abrupt changes. After segmentation of planar regions, we estimate the parameters of corresponding planes using standard fitting procedures. For point cloud structuring, a z-buffer algorithm with mesh triangles representation in barycentric coordinates is employed. The proposed recognition method is tested and experimentally validated in several real-world case studies.

Sensor Planning for Bayesian Nonparametric Target Modeling

Bayesian nonparametric models, such as the Gaussian process and the Dirichlet process, have been extensively applied for target kinematics modeling in various applications including environmental monitoring, traffic planning, endangered species tracking, dynamic scene analysis, autonomous robot navigation, and human motion modeling. As shown by these successful applications, Bayesian nonparametric models are able to adjust their complexities adaptively from data as necessary, and are resistant to overfitting or underfitting. However, most existing works assume that the sensor measurements used to learn the Bayesian nonparametric target kinematics models are obtained a priori or that the target kinematics can be measured by the sensor at any given time throughout the task. Little work has been done for controlling the sensor with bounded field of view to obtain measurements of mobile targets that are most informative for reducing the uncertainty of the Bayesian nonparametric models. To present the systematic sensor planning approach to leaning Bayesian nonparametric models, the Gaussian process target kinematics model is introduced at first, which is capable of describing time-invariant spatial phenomena, such as ocean currents, temperature distributions and wind velocity fields. The Dirichlet process-Gaussian process target kinematics model is subsequently discussed for modeling mixture of mobile targets, such as pedestrian motion patterns.

Novel information theoretic functions are developed for these introduced Bayesian nonparametric target kinematics models to represent the expected utility of measurements as a function of sensor control inputs and random environmental variables. A Gaussian process expected Kullback Leibler divergence is developed as the expectation of the KL divergence between the current (prior) and posterior Gaussian process target kinematics models with respect to the future measurements. Then, this approach is extended to develop a new information value function that can be used to estimate target kinematics described by a Dirichlet process-Gaussian process mixture model. A theorem is proposed that shows the novel information theoretic functions are bounded. Based on this theorem, efficient estimators of the new information theoretic functions are designed, which are proved to be unbiased with the variance of the resultant approximation error decreasing linearly as the number of samples increases. Computational complexities for optimizing the novel information theoretic functions under sensor dynamics constraints are studied, and are proved to be NP-hard. A cumulative lower bound is then proposed to reduce the computational complexity to polynomial time.

Three sensor planning algorithms are developed according to the assumptions on the target kinematics and the sensor dynamics. For problems where the control space of the sensor is discrete, a greedy algorithm is proposed. The efficiency of the greedy algorithm is demonstrated by a numerical experiment with data of ocean currents obtained by moored buoys. A sweep line algorithm is developed for applications where the sensor control space is continuous and unconstrained. Synthetic simulations as well as physical experiments with ground robots and a surveillance camera are conducted to evaluate the performance of the sweep line algorithm. Moreover, a lexicographic algorithm is designed based on the cumulative lower bound of the novel information theoretic functions, for the scenario where the sensor dynamics are constrained. Numerical experiments with real data collected from indoor pedestrians by a commercial pan-tilt camera are performed to examine the lexicographic algorithm. Results from both the numerical simulations and the physical experiments show that the three sensor planning algorithms proposed in this dissertation based on the novel information theoretic functions are superior at learning the target kinematics with

little or no prior knowledge

Mechanochemistry for Active Materials and Devices

The coupling of mechanical stress fields in polymers to covalent chemistry (polymer mechanochemistry) has provided access to previously unattainable chemical reactions and polymer transformations. In the bulk, mechanochemical activation has been used as the basis for new classes of stress-responsive polymers that demonstrate stress/strain sensing, shear-induced intermolecular reactivity for molecular level remodeling and self-strengthening, and the release of acids and other small molecules that are potentially capable of triggering further chemical response. The potential utility of polymer mechanochemistry in functional materials is limited, however, by the fact that to date, all reported covalent activation in the bulk occurs in concert with plastic yield and deformation, so that the structure of the activated object is vastly different from its nascent form. Mechanochemically activated materials have thus been limited to “single use” demonstrations, rather than as multi-functional materials for structural and/or device applications. Here, we report that filled polydimethylsiloxane (PDMS) elastomers provide a robust elastic substrate into which mechanophores can be embedded and activated under conditions from which the sample regains its original shape and properties. Fabrication is straightforward and easily accessible, providing access for the first time to objects and devices that either release or reversibly activate chemical functionality over hundreds of loading cycles.

While the mechanically accelerated ring-opening reaction of spiropyran to merocyanine and associated color change provides a useful method by which to image the molecular scale stress/strain distribution within a polymer, the magnitude of the forces necessary for activation had yet to be quantified. Here, we report single molecule force spectroscopy studies of two spiropyran isomers. Ring opening on the timescale of tens of milliseconds is found to require forces of ~240 pN, well below that of previously characterized covalent mechanophores. The lower threshold force is a combination of a low force-free activation energy and the fact that the change in rate with force (activation length) of each isomer is greater than that inferred in other systems. Importantly, quantifying the magnitude of forces required to activate individual spiropyran-based force-probes enables the probe behave as a “scout” of molecular forces in materials; the observed behavior of which can be extrapolated to predict the reactivity of potential mechanophores within a given material and deformation.

We subsequently translated the design platform to existing dynamic soft technologies to fabricate the first mechanochemically responsive devices; first, by remotely inducing dielectric patterning of an elastic substrate to produce assorted fluorescent patterns in concert with topological changes; and second, by adopting a soft robotic platform to produce a color change from the strains inherent to pneumatically actuated robotic motion. Shown herein, covalent polymer mechanochemistry provides a viable mechanism to convert the same mechanical potential energy used for actuation into value-added, constructive covalent chemical responses. The color change associated with actuation suggests opportunities for not only new color changing or camouflaging strategies, but also the possibility for simultaneous activation of latent chemistry (e.g., release of small molecules, change in mechanical properties, activation of catalysts, etc.) in soft robots. In addition, mechanochromic stress mapping in a functional actuating device might provide a useful design and optimization tool, revealing spatial and temporal force evolution within the actuator in a way that might also be coupled to feedback loops that allow autonomous, self-regulation of activity.

In the future, both the specific material and the general approach should be useful in enriching the responsive functionality of soft elastomeric materials and devices. We anticipate the development of new mechanophores that, like the materials, are reversibly and repeatedly activated, expanding the capabilities of soft, active devices and further permitting dynamic control over chemical reactivity that is otherwise inaccessible, each in response to a single remote signal.