Learning and Exploiting Camera Geometry for Computer Vision

This work explores the use of statistical methods in describing and estimating camera poses, as well as the information feedback loop between camera pose and object detection. Surging development in robotics and computer vision has pushed the need for algorithms that infer, understand, and utilize information about the position and orientation of the sensor platforms when observing and/or interacting with their environment.

The first contribution of this thesis is the development of a set of statistical tools for representing and estimating the uncertainty in object poses. A distribution for representing the joint uncertainty over multiple object positions and orientations is described, called the mirrored normal-Bingham distribution. This distribution generalizes both the normal distribution in Euclidean space, and the Bingham distribution on the unit hypersphere. It is shown to inherit many of the convenient properties of these special cases: it is the maximum-entropy distribution with fixed second moment, and there is a generalized Laplace approximation whose result is the mirrored normal-Bingham distribution. This distribution and approximation method are demonstrated by deriving the analytical approximation to the wrapped-normal distribution. Further, it is shown how these tools can be used to represent the uncertainty in the result of a bundle adjustment problem.

Another application of these methods is illustrated as part of a novel camera pose estimation algorithm based on object detections. The autocalibration task is formulated as a bundle adjustment problem using prior distributions over the 3D points to enforce the objects' structure and their relationship with the scene geometry. This framework is very flexible and enables the use of off-the-shelf computational tools to solve specialized autocalibration problems. Its performance is evaluated using a pedestrian detector to provide head and foot location observations, and it proves much faster and potentially more accurate than existing methods.

Finally, the information feedback loop between object detection and camera pose estimation is closed by utilizing camera pose information to improve object detection in scenarios with significant perspective warping. Methods are presented that allow the inverse perspective mapping traditionally applied to images to be applied instead to features computed from those images. For the special case of HOG-like features, which are used by many modern object detection systems, these methods are shown to provide substantial performance benefits over unadapted detectors while achieving real-time frame rates, orders of magnitude faster than comparable image warping methods.

The statistical tools and algorithms presented here are especially promising for mobile cameras, providing the ability to autocalibrate and adapt to the camera pose in real time. In addition, these methods have wide-ranging potential applications in diverse areas of computer vision, robotics, and imaging.

Advanced Applications of 3D Dosimetry and 3D Printing in Radiation Therapy

As complex radiotherapy techniques become more readily-practiced, comprehensive 3D dosimetry is a growing necessity for advanced quality assurance. However, clinical implementation has been impeded by a wide variety of factors, including the expense of dedicated optical dosimeter readout tools, high operational costs, and the overall difficulty of use. To address these issues, a novel dry-tank optical CT scanner was designed for PRESAGE 3D dosimeter readout, relying on 3D printed components and omitting costly parts from preceding optical scanners. This work details the design, prototyping, and basic commissioning of the Duke Integrated-lens Optical Scanner (DIOS).

The convex scanning geometry was designed in ScanSim, an in-house Monte Carlo optical ray-tracing simulation. ScanSim parameters were used to build a 3D rendering of a convex ‘solid tank’ for optical-CT, which is capable of collimating a point light source into telecentric geometry without significant quantities of refractive-index matched fluid. The model was 3D printed, processed, and converted into a negative mold via rubber casting to produce a transparent polyurethane scanning tank. The DIOS was assembled with the solid tank, a 3W red LED light source, a computer-controlled rotation stage, and a 12-bit CCD camera. Initial optical phantom studies show negligible spatial inaccuracies in 2D projection images and 3D tomographic reconstructions. A PRESAGE 3D dose measurement for a 4-field box treatment plan from Eclipse shows 95% of voxels passing gamma analysis at 3%/3mm criteria. Gamma analysis between tomographic images of the same dosimeter in the DIOS and DLOS systems show 93.1% agreement at 5%/1mm criteria. From this initial study, the DIOS has demonstrated promise as an economically-viable optical-CT scanner. However, further improvements will be necessary to fully develop this system into an accurate and reliable tool for advanced QA.

Pre-clinical animal studies are used as a conventional means of translational research, as a midpoint between in-vitro cell studies and clinical implementation. However, modern small animal radiotherapy platforms are primitive in comparison with conventional linear accelerators. This work also investigates a series of 3D printed tools to expand the treatment capabilities of the X-RAD 225Cx orthovoltage irradiator, and applies them to a feasibility study of hippocampal avoidance in rodent whole-brain radiotherapy.

As an alternative material to lead, a novel 3D-printable tungsten-composite ABS plastic, GMASS, was tested to create precisely-shaped blocks. Film studies show virtually all primary radiation at 225 kVp can be attenuated by GMASS blocks of 0.5cm thickness. A state-of-the-art software, BlockGen, was used to create custom hippocampus-shaped blocks from medical image data, for any possible axial treatment field arrangement. A custom 3D printed bite block was developed to immobilize and position a supine rat for optimal hippocampal conformity. An immobilized rat CT with digitally-inserted blocks was imported into the SmART-Plan Monte-Carlo simulation software to determine the optimal beam arrangement. Protocols with 4 and 7 equally-spaced fields were considered as viable treatment options, featuring improved hippocampal conformity and whole-brain coverage when compared to prior lateral-opposed protocols. Custom rodent-morphic PRESAGE dosimeters were developed to accurately reflect these treatment scenarios, and a 3D dosimetry study was performed to confirm the SmART-Plan simulations. Measured doses indicate significant hippocampal sparing and moderate whole-brain coverage.

A cardiovascular occlusion method based on the use of a smart hydrogel

Smart hydrogels for biomedical applications are highly researched materials. However, integrating them into a device for implantation is difficult. This paper investigates an integrated delivery device designed to deliver an electro-responsive hydrogel to a target location inside a blood vessel with the purpose of creating an occlusion. The paper describes the synthesis and characterization of a Pluronic/methacrylic acid sodium salt electro-responsive hydrogel. Application of an electrical bias decelerates the expansion of the hydrogel. An integrated delivery system was manufactured to deliver the hydrogel to the target location in the body. Ex vivo and in vivo experiments in the carotid artery of sheep were used to validate the concept. The hydrogel was able to completely occlude the blood vessel reducing the blood flow from 245 to 0 ml/min after implantation. Ex vivo experiments showed that the hydrogel was able to withstand physiological blood pressures of > 270 mm·Hg without dislodgement. The results showed that the electro-responsive hydrogel used in this paper can be used to create a long-term occlusion in a blood vessel without any apparent side effects. The delivery system developed is a promising device for the delivery of electro-responsive hydrogels.

DEMOCRACY ISN'T THAT SMART (BUT WE CAN MAKE IT SMARTER): ON LANDEMORE'S DEMOCRATIC REASON

Copyright © Cambridge University Press 2016In her recent book, Democratic Reason, Hélène Landemore argues that, when evaluated epistemically, “a democratic decision procedure is likely to be a better decision procedure than any non-democratic decision procedures, such as a council of experts or a benevolent dictator” (p. 3). Landemore's argument rests heavily on studies of collective intelligence done by Lu Hong and Scott Page. These studies purport to show that cognitive diversity – differences in how people solve problems – is actually more important to overall group performance than average individual ability – how smart the individual members are. Landemore's argument aims to extrapolate from these results to the conclusion that democracy is epistemically better than any non-democratic rival. I argue here that Hong and Page's results actually undermine, rather than support, this conclusion. More specifically, I argue that the results do not show that democracy is better than any non-democratic alternative, and that in fact, they suggest the opposite – that at least some non-democratic alternatives are likely to epistemically outperform democracy.

Occupant location prediction in smart buildings using association rule mining

Heating, ventilation, air conditioning (HVAC) systems are significant consumers of energy, however building management systems do not typically operate them in accordance with occupant movements. Due to the delayed response of HVAC systems, prediction of occupant locations is necessary to maximize energy efficiency. We present an approach to occupant location prediction based on association rule mining, allowing prediction based on historical occupant locations. Association rule mining is a machine learning technique designed to find any correlations which exist in a given dataset. Occupant location datasets have a number of properties which differentiate them from the market basket datasets that association rule mining was originally designed for. This thesis adapts the approach to suit such datasets, focusing the rule mining process on patterns which are useful for location prediction. This approach, named OccApriori, allows for the prediction of occupants’ next locations as well as their locations further in the future, and can take into account any available data, for example the day of the week, the recent movements of the occupant, and timetable data. By integrating an existing extension of association rule mining into the approach, it is able to make predictions based on general classes of locations as well as specific locations.

Two devices, each of which measure water velocity; on the right is an acoustic device that is permanently maintained at Gumbo Limbo by PI Rene Price; on the left is a 3D camera with a long fiberoptic lens, deployed for testing purposes by collaborator Evan Variano.

http://digitalcommons.fiu.edu/fce_lter_photos/1303/thumbnail.jpg

Automatic Identification of Large Fragments in a Pile of Broken Rock Using a Time-of-Flight Camera

This paper presents a solution to part of the problem of making robotic or semi-robotic digging equipment less dependant on human supervision. A method is described for identifying rocks of a certain size that may affect digging efficiency or require special handling. The process involves three main steps. First, by using range and intensity data from a time-of-flight (TOF) camera, a feature descriptor is used to rank points and separate regions surrounding high scoring points. This allows a wide range of rocks to be recognized because features can represent a whole or just part of a rock. Second, these points are filtered to extract only points thought to belong to the large object. Finally, a check is carried out to verify that the resultant point cloud actually represents a rock. Results are presented from field testing on piles of fragmented rock. Note to Practitioners—This paper presents an algorithm to identify large boulders in a pile of broken rock as a step towards an autonomous mining dig planner. In mining, piles of broken rock can contain large fragments that may need to be specially handled. To assess rock piles for excavation, we make use of a TOF camera that does not rely on external lighting to generate a point cloud of the rock pile. We then segment large boulders from its surface by using a novel feature descriptor and distinguish between real and false boulder candidates. Preliminary field experiments show promising results with the algorithm performing nearly as well as human test subjects.

Evaluation of a ToF Camera for Remote Surveying of Underground Cavities Excavated by Jet Boring

Cigar Lake is a high-grade uranium deposit, located in northern Saskatchewan, Canada. In order to extract the uranium ore remotely, thus ensuring minimal radiation dose to workers and also to access the ore from stable ground, the Jet Boring System (JBS) was developed by Cameco Corporation. This system uses a high-powered water jet to remotely excavate cavities. Survey data is required to determine the final shape, volume, and location of the cavity for mine planning purposes and construction. This paper provides an overview of the challenges involved in remotely surveying a JBS-mined cavity and studies the potential use of a time-of-flight (ToF) camera for remote cavity surveying. It reports on data collected and analyzed from inside an experimental environment as well as on real data acquired on site from the Cigar Lake and Rabbit Lake mines.

The Open Data Smart City: A Case Study of Smart City Progress through Open Data Initiatives

Smart cities, cities that are supported by an extensive digital infrastructure of sensors, databases and intelligent applications, have become a major area of academic, governmental and public interest. Simultaneously, there has been a growing interest in open data, the unrestricted use of organizational data for public viewing and use. Drawing on Science and Technology Studies (STS), Urban Studies and Political Economy, this thesis examines how digital processes, open data and the physical world can be combined in smart city development, through the qualitative interview-based case study of a Southern Ontario Municipality, Anytown. The thesis asks what are the challenges associated with smart city development and open data proliferation, is open data complimentary to smart urban development; and how is expertise constructed in these fields? The thesis concludes that smart city development in Anytown is a complex process, involving a variety of visions, programs and components. Although smart city and open data initiatives exist in Anytown, and some are even overlapping and complementary, smart city development is in its infancy. However, expert informants remained optimistic, faithful to a technologically sublime vision of what a smart city would bring. The thesis also questions the notion of expertise within the context of smart city and open data projects, concluding that assertions of expertise need to be treated with caution and scepticism when considering how knowledge is received, generated, interpreted and circulates, within organizations.

Análisis de la información y documentación científica española sobre el fenómeno de las smart cities, el hábitat de los nativos digitales

Estudiosos de todo el mundo se están centrando en el estudio del fenómeno de las ciudades inteligentes. La producción bibliográfica española sobre este tema ha crecido exponencialmente en los últimos años. Las nuevas ciudades inteligentes se fundamentan en nuevas visiones de desarrollo urbano que integran múltiples soluciones tecnológicas ligadas al mundo de la información y de la comunicación, todas ellas actuales y al servicio de las necesidades de la ciudad. La literatura en español sobre este tema proviene de campos tan diferentes como la Arquitectura, la Ingeniería, las Ciencias Políticas y el Derecho o las Ciencias Empresariales. La finalidad de las ciudades inteligentes es la mejora de la vida de sus ciudadanos a través de la implementación de tecnologías de la información y de la comunicación que resuelvan las necesidades de sus habitantes, por lo que los investigadores del campo de las Ciencias de la Comunicación y de la Información tienen mucho que decir. Este trabajo analiza un total de 120 textos y concluye que el fenómeno de las ciudades inteligentes será uno de los ejes centrales de la investigación multidisciplinar en los próximos años en nuestro país.

Smart inks as photocatalytic activity indicators of self-cleaning paints

Smart inks as a redox indicators of photocatalytic activity were applied on several paints with acrylic and silicate binder exposed to accelerated weathering test. The results show, that self-cleaning paints need some weathering to develop full photocatalytic activity. On the other side weathering may negatively influence the durability of the paint as shown for a silicate based exterior paint, which was significantly degraded after 350 h of weathering test. Smart inks proved to be suitable and rapid indicators of paint photoactivity. Resazurin ink is convenient only for unexposed paint with low photocatalytic activity while an Acid Violet 7 ink was appropriate for most of the paints, especially those that were weathered

Intrinsically flexible electronic materials for smart device applications

A novel method to fabricate chemically linked conducting polymer–biopolymer composites that are intrinsically flexible and conducting for functional electrode applications is presented. Polypyrrole was synthesised in situ during the cellulose regeneration process using the 1-butyl-3-methylimidazolium chloride ionic liquid as a solvent medium. The obtained polypyrrole–cellulose composite was chemically blended and showed flexible polymer properties while retaining the electronic properties of a conducting polymer. Addition of an ionic liquid such as trihexyl(tetradecyl)phosphonium bis(trifluoromethylsulfonyl)imide, enhanced the flexibility of the composite. The functional application of these materials in the electrochemically controlled release of a model drug has been demonstrated. This strategy opens up a new design for a wide spectrum of materials for smart electronic device applications wherein the functionality of doping and de-doping of conducting polymers is retained and their processability issue is addressed by exploiting an ionic liquid route.