POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.

Molecular interaction between perthiolated [beta]-cyclodextrin (CD) and the guests molecules adamantaneacetic acid (AD) and ferroceneacetic acid (FC); and the effect of the interaction on the electron transition of CD anchored particles

The molecular interactions between the host molecule, perthiolated beta-cyclodextrin (CD), and the guest molecules, adamantaneacetic acid (AD) and ferroceneacetic acid (FC), have been inestigated theoretically in both the gas and aqueous phases. The major computations have been carried out at the theoretical levels, RHF/6-31G and B3LYP/6- 31G. MP2 electronic energies were also computed based at the geometries optimized by both the RHF and B3LYP methods in the gas phase to establish a better estimate of the correlation effect. The solvent phase computations were completed at the RHF/6-31G and B3LYP/6-31G levels using the PCM model. The most stable structures optimized in gas phase by both the RHF and B3LYP methods were used for the computations in solution. A method to systematically manipulate the relative position and orientation between the interacting molecules is proposed. In the gas phase, six trials with different host-guest relative positions and orientations were completed successfully with the B3LYP method for both the CD-AD and CD-FC complexes. Only four trials were completed with RHF method. In the gas phase, the best results from the RHF method gives for the association Gibbs free energy (ΔG°) values equal to -32.21kj/mol for CD-AD and -25.73kj/mol for CD-FC. And the best results from the B3LYP method have ΔG° equal to -47.57kj/mol for CD-AD and -41.09kj/mol for CD-FC. The MP2 correction significantly lowers ΔG° based on the geometries from both methods. For the RHF structure, the MP2 computations lowered ΔG° to -60.64kj/mol for CD-AD and -54.10 for CD-FC. For the structure from the B3LYP method, it was reduced to -59.87 kj/mol for CD-AD and -54.84 kj/mol for CDFC. The RHF solvent phase calculations yielded following results: ΔG°(aq) equals 107.2kj/mol for CD-AD and 111.4kj/mol for CD-FC. Compared with the results from the RHF method, the B3LYP method provided clearly better solvent phase results with ΔG° (aq) equal to 38.64kj/mol for CD-AD and 39.61kj/mol for CD-FC. These results qualitatively explain the experimental observations. However quantitatively they are in poor agreement with the experimental values available in the literature and those recently published by Liu et al. And the reason is believed to be omission of hydrophobic contribution to the association. Determining the global geometrical minima for these very large systems was very difficult and computationally time consuming, but after a very thorough search, these were identified. A relevant result of this search is that when the complexes, CD-AD and CD-FC, are formed, the AD and FC molecules are only partially embedded inside the CD cavity. The totally embedded complexes were found to have significantly higher energies. The semiempirical method, ZINDO, was employed to investigate the effect of complexation on the first electronic excitation of CD anchored to a metal nano-particle. The computational results revealed that after complexation to FC, the transition intensity declines to about 25% of the original value, and after complexation with AD, the intensity drops almost 50%. The tighter binding and transition intensity of CD-AD qualitatively agrees with the experimental result that the addition of AD to a solution of CD and FC restores the fluorescence of CD that was quenched by the addition of FC. A method to evaluate the “hydrophobic force” effect is proposed for future work.