POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.

SVPWM SWITCHING PATTERN FOR Z-SOURCE INVERTER, SIMULATION AND APPLICATION

The voltage source inverter (VSI) and current voltage source inverter (CSI) are widely used in industrial application. But the traditional VSIs and CSIs have one common problem: can’t boost or buck the voltage come from battery, which make them impossible to be used alone in Hybrid Electric Vehicle (HEV/EV) motor drive application, other issue is the traditional inverter need to add the dead-band time into the control sequence, but it will cause the output waveform distortion. This report presents an impedance source (Z-source network) topology to overcome these problems, it can use one stage instead of two stages (VSI or CSI + boost converter) to buck/boost the voltage come from battery in inverter system. Therefore, the Z-source topology hardware design can reduce switching element, entire system size and weight, minimize the system cost and increase the system efficiency. Also, a modified space vector pulse-width modulation (SVPWM) control method has been selected with the Z-source network together to achieve the best efficiency and lower total harmonic distortion (THD) at different modulation indexes. Finally, the Z-source inverter controlling will modulate under two control sequences: sinusoidal pulse width modulation (SPWM) and SVPWM, and their output voltage, ripple and THD will be compared.

MULTI-WAVELENGTH SPECKLE REDUCTION FOR LASER PICO-PROJECTORS USING DIFFRACTIVE OPTICS

Personal electronic devices, such as cell phones and tablets, continue to decrease in size while the number of features and add-ons keep increasing. One particular feature of great interest is an integrated projector system. Laser pico-projectors have been considered, but the technology has not been developed enough to warrant integration. With new advancements in diode technology and MEMS devices, laser-based projection is currently being advanced for pico-projectors. A primary problem encountered when using a pico-projector is coherent interference known as speckle. Laser speckle can lead to eye irritation and headaches after prolonged viewing. Diffractive optical elements known as diffusers have been examined as a means to lower speckle contrast. Diffusers are often rotated to achieve temporal averaging of the spatial phase pattern provided by diffuser surface. While diffusers are unable to completely eliminate speckle, they can be utilized to decrease the resultant contrast to provide a more visually acceptable image. This dissertation measures the reduction in speckle contrast achievable through the use of diffractive diffusers. A theoretical Fourier optics model is used to provide the diffuser’s stationary and in-motion performance in terms of the resultant contrast level. Contrast measurements of two diffractive diffusers are calculated theoretically and compared with experimental results. In addition, a novel binary diffuser design based on Hadamard matrices will be presented. Using two static in-line Hadamard diffusers eliminates the need for rotation or vibration of the diffuser for temporal averaging. Two Hadamard diffusers were fabricated and contrast values were subsequently measured, showing good agreement with theory and simulated values. Monochromatic speckle contrast values of 0.40 were achieved using the Hadamard diffusers. Finally, color laser projection devices require the use of red, green, and blue laser sources; therefore, using a monochromatic diffractive diffuser may not optimal for color speckle contrast reduction. A simulation of the Hadamard diffusers is conducted to determine the optimum spacing between the two diffusers for polychromatic speckle reduction. Experimental measured results are presented using the optimal spacing of Hadamard diffusers for RGB color speckle reduction, showing 60% reduction in contrast.

THE EFFECT OF ANNEALING ON AMORPHOUS SILICON BASED SOLAR PHOTOVOLTAIC THERMAL SYSTEM (PV/T) AND APPROPRIATE GLOBAL DISPATCH STRATEGIES

Previous work has shown that high-temperature short-term spike thermal annealing of hydrogenated amorphous silicon (a-Si:H) photovoltaic thermal (PVT) systems results in higher electrical energy output. The relationship between temperature and performance of a-Si:H PVT is not simple as high temperatures during thermal annealing improves the immediate electrical performance following an anneal, but during the anneal it creates a marked drop in electrical performance. In addition, the power generation of a-Si:H PVT depends on both the environmental conditions and the Staebler-Wronski Effect kinetics. In order to improve the performance of a-Si:H PVT systems further, this paper reports on the effect of various dispatch strategies on system electrical performance. Utilizing experimental results from thermal annealing, an annealing model simulation for a-Si:Hbased PVT was developed and applied to different cities in the U.S. to investigate potential geographic effects on the dispatch optimization of the overall electrical PVT systems performance and annual electrical yield. The results showed that spike thermal annealing once per day maximized the improved electrical energy generation. In the outdoor operating condition this ideal behavior deteriorates and optimization rules are required to be implemented.

DATA DRIVEN INTELLIGENT AGENT NETWORKS FOR ADAPTIVE MONITORING AND CONTROL

To analyze the characteristics and predict the dynamic behaviors of complex systems over time, comprehensive research to enable the development of systems that can intelligently adapt to the evolving conditions and infer new knowledge with algorithms that are not predesigned is crucially needed. This dissertation research studies the integration of the techniques and methodologies resulted from the fields of pattern recognition, intelligent agents, artificial immune systems, and distributed computing platforms, to create technologies that can more accurately describe and control the dynamics of real-world complex systems. The need for such technologies is emerging in manufacturing, transportation, hazard mitigation, weather and climate prediction, homeland security, and emergency response. Motivated by the ability of mobile agents to dynamically incorporate additional computational and control algorithms into executing applications, mobile agent technology is employed in this research for the adaptive sensing and monitoring in a wireless sensor network. Mobile agents are software components that can travel from one computing platform to another in a network and carry programs and data states that are needed for performing the assigned tasks. To support the generation, migration, communication, and management of mobile monitoring agents, an embeddable mobile agent system (Mobile-C) is integrated with sensor nodes. Mobile monitoring agents visit distributed sensor nodes, read real-time sensor data, and perform anomaly detection using the equipped pattern recognition algorithms. The optimal control of agents is achieved by mimicking the adaptive immune response and the application of multi-objective optimization algorithms. The mobile agent approach provides potential to reduce the communication load and energy consumption in monitoring networks. The major research work of this dissertation project includes: (1) studying effective feature extraction methods for time series measurement data; (2) investigating the impact of the feature extraction methods and dissimilarity measures on the performance of pattern recognition; (3) researching the effects of environmental factors on the performance of pattern recognition; (4) integrating an embeddable mobile agent system with wireless sensor nodes; (5) optimizing agent generation and distribution using artificial immune system concept and multi-objective algorithms; (6) applying mobile agent technology and pattern recognition algorithms for adaptive structural health monitoring and driving cycle pattern recognition; (7) developing a web-based monitoring network to enable the visualization and analysis of real-time sensor data remotely. Techniques and algorithms developed in this dissertation project will contribute to research advances in networked distributed systems operating under changing environments.

Strategic Optimization Techniques For FRTU Deployment and Chip Physical Design

Combinatorial optimization is a complex engineering subject. Although formulation often depends on the nature of problems that differs from their setup, design, constraints, and implications, establishing a unifying framework is essential. This dissertation investigates the unique features of three important optimization problems that can span from small-scale design automation to large-scale power system planning: (1) Feeder remote terminal unit (FRTU) planning strategy by considering the cybersecurity of secondary distribution network in electrical distribution grid, (2) physical-level synthesis for microfluidic lab-on-a-chip, and (3) discrete gate sizing in very-large-scale integration (VLSI) circuit. First, an optimization technique by cross entropy is proposed to handle FRTU deployment in primary network considering cybersecurity of secondary distribution network. While it is constrained by monetary budget on the number of deployed FRTUs, the proposed algorithm identi?es pivotal locations of a distribution feeder to install the FRTUs in different time horizons. Then, multi-scale optimization techniques are proposed for digital micro?uidic lab-on-a-chip physical level synthesis. The proposed techniques handle the variation-aware lab-on-a-chip placement and routing co-design while satisfying all constraints, and considering contamination and defect. Last, the first fully polynomial time approximation scheme (FPTAS) is proposed for the delay driven discrete gate sizing problem, which explores the theoretical view since the existing works are heuristics with no performance guarantee. The intellectual contribution of the proposed methods establishes a novel paradigm bridging the gaps between professional communities.

Optimization of Wireless Power Transfer via Magnetic Resonance in Different Media

A wide range of non-destructive testing (NDT) methods for the monitoring the health of concrete structure has been studied for several years. The recent rapid evolution of wireless sensor network (WSN) technologies has resulted in the development of sensing elements that can be embedded in concrete, to monitor the health of infrastructure, collect and report valuable related data. The monitoring system can potentially decrease the high installation time and reduce maintenance cost associated with wired monitoring systems. The monitoring sensors need to operate for a long period of time, but sensors batteries have a finite life span. Hence, novel wireless powering methods must be devised. The optimization of wireless power transfer via Strongly Coupled Magnetic Resonance (SCMR) to sensors embedded in concrete is studied here. First, we analytically derive the optimal geometric parameters for transmission of power in the air. This specifically leads to the identification of the local and global optimization parameters and conditions, it was validated through electromagnetic simulations. Second, the optimum conditions were employed in the model for propagation of energy through plain and reinforced concrete at different humidity conditions, and frequencies with extended Debye's model. This analysis leads to the conclusion that SCMR can be used to efficiently power sensors in plain and reinforced concrete at different humidity levels and depth, also validated through electromagnetic simulations. The optimization of wireless power transmission via SMCR to Wearable and Implantable Medical Device (WIMD) are also explored. The optimum conditions from the analytics were used in the model for propagation of energy through different human tissues. This analysis shows that SCMR can be used to efficiently transfer power to sensors in human tissue without overheating through electromagnetic simulations, as excessive power might result in overheating of the tissue. Standard SCMR is sensitive to misalignment; both 2-loops and 3-loops SCMR with misalignment-insensitive performances are presented. The power transfer efficiencies above 50% was achieved over the complete misalignment range of 0°-90° and dramatically better than typical SCMR with efficiencies less than 10% in extreme misalignment topologies.

Detection and Grading of Prostate Cancer in Temporal Enhanced Ultrasound using Convolutional Neural Networks

Prostate cancer is the most common non-dermatological cancer amongst men in the developed world. The current definitive diagnosis is core needle biopsy guided by transrectal ultrasound. However, this method suffers from low sensitivity and specificity in detecting cancer. Recently, a new ultrasound based tissue typing approach has been proposed, known as temporal enhanced ultrasound (TeUS). In this approach, a set of temporal ultrasound frames is collected from a stationary tissue location without any intentional mechanical excitation. The main aim of this thesis is to implement a deep learning-based solution for prostate cancer detection and grading using TeUS data. In the proposed solution, convolutional neural networks are trained to extract high-level features from time domain TeUS data in temporally and spatially adjacent frames in nine in vivo prostatectomy cases. This approach avoids information loss due to feature extraction and also improves cancer detection rate. The output likelihoods of two TeUS arrangements are then combined to form our novel decision support system. This deep learning-based approach results in the area under the receiver operating characteristic curve (AUC) of 0.80 and 0.73 for prostate cancer detection and grading, respectively, in leave-one-patient-out cross-validation. Recently, multi-parametric magnetic resonance imaging (mp-MRI) has been utilized to improve detection rate of aggressive prostate cancer. In this thesis, for the first time, we present the fusion of mp-MRI and TeUS for characterization of prostate cancer to compensates the deficiencies of each image modalities and improve cancer detection rate. The results obtained using TeUS are fused with those attained using consolidated mp-MRI maps from multiple MR modalities and cancer delineations on those by multiple clinicians. The proposed fusion approach yields the AUC of 0.86 in prostate cancer detection. The outcomes of this thesis emphasize the viable potential of TeUS as a tissue typing method. Employing this ultrasound-based intervention, which is non-invasive and inexpensive, can be a valuable and practical addition to enhance the current prostate cancer detection.

An Islanding Detection Method based on Impedance Estimation and Grid Identification for Grid-Tie Distributed Power Generation Systems

Power system policies are broadly on track to escalate the use of renewable energy resources in electric power generation. Integration of dispersed generation to the utility network not only intensifies the benefits of renewable generation but also introduces further advantages such as power quality enhancement and freedom of power generation for the consumers. However, issues arise from the integration of distributed generators to the existing utility grid are as significant as its benefits. The issues are aggravated as the number of grid-connected distributed generators increases. Therefore, power quality demands become stricter to ensure a safe and proper advancement towards the emerging smart grid. In this regard, system protection is the area that is highly affected as the grid-connected distributed generation share in electricity generation increases. Islanding detection, amongst all protection issues, is the most important concern for a power system with high penetration of distributed sources. Islanding occurs when a portion of the distribution network which includes one or more distributed generation units and local loads is disconnected from the remaining portion of the grid. Upon formation of a power island, it remains energized due to the presence of one or more distributed sources. This thesis introduces a new islanding detection technique based on an enhanced multi-layer scheme that shows superior performance over the existing techniques. It provides improved solutions for safety and protection of power systems and distributed sources that are capable of operating in grid-connected mode. The proposed active method offers negligible non-detection zone. It is applicable to micro-grids with a number of distributed generation sources without sacrificing the dynamic response of the system. In addition, the information obtained from the proposed scheme allows for smooth transition to stand-alone operation if required. The proposed technique paves the path towards a comprehensive protection solution for future power networks. The proposed method is converter-resident and all power conversion systems that are operating based on power electronics converters can benefit from this method. The theoretical analysis is presented, and extensive simulation results confirm the validity of the analytical work.

Optimal control of non-linear systems through hybrid cell-mapping/artificial-neural-networks techniques

In this paper, a real-time optimal control technique for non-linear plants is proposed. The control system makes use of the cell-mapping (CM) techniques, widely used for the global analysis of highly non-linear systems. The CM framework is employed for designing approximate optimal controllers via a control variable discretization. Furthermore, CM-based designs can be improved by the use of supervised feedforward artificial neural networks (ANNs), which have proved to be universal and efficient tools for function approximation, providing also very fast responses. The quantitative nature of the approximate CM solutions fits very well with ANNs characteristics. Here, we propose several control architectures which combine, in a different manner, supervised neural networks and CM control algorithms. On the one hand, different CM control laws computed for various target objectives can be employed for training a neural network, explicitly including the target information in the input vectors. This way, tracking problems, in addition to regulation ones, can be addressed in a fast and unified manner, obtaining smooth, averaged and global feedback control laws. On the other hand, adjoining CM and ANNs are also combined into a hybrid architecture to address problems where accuracy and real-time response are critical. Finally, some optimal control problems are solved with the proposed CM, neural and hybrid techniques, illustrating their good performance.

Manipulating the structural and electronic properties of epitaxial NaNbO3 films via strain and stoichiometry

Due to their intriguing dielectric, pyroelectric, elasto-electric, or opto-electric properties, oxide ferroelectrics are vital candidates for the fabrication of most electronics. However, these extraordinary properties exist mainly in the temperature regime around the ferroelectric phase transition, which is usually several hundreds of K away from room temperature. Therefore, the manipulation of oxide ferroelectrics, especially moving the ferroelectric transition towards room temperature, is of great interest for application and also basic research. In this thesis, we demonstrate this using examples of NaNbO3 films. We show that the transition temperature of these films can be modified via plastic strain caused by epitaxial film growth on a structurally mismatched substrate, and this strain can be fixed by controlling the stoichiometry. The structural and electronic properties of Na1+xNbO3+δ thin films are carefully examined by among others XRD (e.g. RSM) and TEM and cryoelectronic measurements. Especially the electronic features are carefully analyzed via specially developed interdigitated electrodes in combination with integrated temperature sensor and heater. The electronic data are interpreted using existing as well as novel theories and models, they are proved to be closely correlated to the structural characteristics. The major results are: -Na1+xNbO3+δ thin films can be grown epitaxially on (110)NdGaO3 with a thickness up to 140 nm (thicker films have not been studied). Plastic relaxation of the compressive strain sets in when the thickness of the film exceeds approximately 10 – 15 nm. Films with excess Na are mainly composed of NaNbO3 with minor contribution of Na3NbO4. The latter phase seems to form nanoprecipitates that are homogeneously distributed in the NaNbO3 film which helps to stabilize the film and reduce the relaxation of the strain. -For the nominally stoichiometric films, the compressive strain leads to a broad and frequency-dispersive phase transition at lower temperature (125 – 147 K). This could be either a new transition or a shift in temperature of a known transition. Considering the broadness and frequency dispersion of the transition, this is actually a transition from the dielectric state at high temperature to a relaxor-type ferroelectric state at low temperature. The latter is based on the formation of polar nano-regions (PNRs). Using the electric field dependence of the freezing temperature, allows a direct estimation of the volume (70 to 270 nm3) and diameter (5.2 to 8 nm, spherical approximation) of the PNRs. The values confirm with literature values which were measured by other technologies. -In case of the off-stoichiometric samples, we observe again the classical ferroelectric behavior. However, the thermally hysteretic phase transition which is observed around 620 – 660 K for unstrained material is shifted to room temperature due to the compressive strain. Beside to the temperature shift, the temperature dependence of the permittivity is nearly identical for strained and unstrained materials. -The last but not least, in all cases, a significant anisotropy in the electronic and structural properties is observed which arises automatically from the anisotropic strain caused by the orthorhombic structure of the substrate. However, this anisotropy cannot be explained by the classical model which tries to fit an orthorhombic film onto an orthorhombic substrate. A novel “square lattice” model in which the films adapt a “square” shaped lattice in the plane of the film during the epitaxial growth at elevated temperature (~1000 K) nicely explains the experimental results. In this thesis we sketch a way to manipulate the ferroelectricity of NaNbO3 films via strain and stoichiometry. The results indicate that compressive strain which is generated by the epitaxial growth of the film on mismatched substrate is able to reduce the ferroelectric transition temperature or induce a phase transition at low temperature. Moreover, by adding Na in the NaNbO3 film a secondary phase Na3NbO4 is formed which seems to stabilize the main phase NaNbO3 and the strain and, thus, is able to engineer the ferroelectric behavior from the expected classical ferroelectric for perfect stoichiometry to relaxor-type ferroelectric for slightly off-stoichiometry, back to classical ferroelectric for larger off-stoichiometry. Both strain and stoichiometry are proven as perfect methods to optimize the ferroelectric properties of oxide films.

Utilizing Electronic Signatures and Electronic Form Filling to Streamline Document Approval Process

This CPM project focuses on the document approval process that the Division of State Human Resources consulting team utilizes as it relates to classification and compensation requests, e.g. job reclassifications, PD update requests, and salary requests. The ultimate goal is to become more efficient by utilizing electronic signatures and electronic form filling to streamline the current process of document approvals.

Study of the Electromagnetic Interference Generated by Wireless Power Transfer Systems

This paper presents a study related with measuring of radio frequency emissions. The purpose is to determine the level of interference generated by wireless power transfer equipment in a specific frequency range, and to compare those levels to the existing standards. The technology of wireless power transfer, especially for electric vehicles batteries charging, is rapidly developing in the recent years. An increasing use of this technology in industrial and consumer electronic products has raised concerns about the possible unfavorable health-effects onto the human being. Another concern is raised from the high intensity fields produced by wireless power transfer systems which will generate highly undesired influence on other electrical and electronic equipment. As a protection against the potential health effects, the governments imposed limits on the occupational and general public exposure to the radio frequencies. These limitations are set out in national and international safety guidelines, standards and regulations. The measurement and evaluation of the human exposure to electromagnetic fields are essential to guarantee occupational and general public safety.

Nanofibrous-structured polymers and their engineering applications

Monolithic materials cannot always satisfy the demands of today’s advanced requirements. Only by combining several materials at different length-scales, as nature does, the requested performances can be met. Polymer nanocomposites are intended to overcome the common drawbacks of pristine polymers, with a multidisciplinary collaboration of material science with chemistry, engineering, and nanotechnology. These materials are an active combination of polymers and nanomaterials, where at least one phase lies in the nanometer range. By mimicking nature’s materials is possible to develop new nanocomposites for structural applications demanding combinations of strength and toughness. In this perspective, nanofibers obtained by electrospinning have been increasingly adopted in the last decade to improve the fracture toughness of Fiber Reinforced Plastic (FRP) laminates. Although nanofibers have already found applications in various fields, their widespread introduction in the industrial context is still a long way to go. This thesis aims to develop methodologies and models able to predict the behaviour of nanofibrous-reinforced polymers, paving the way for their practical engineering applications. It consists of two main parts. The first one investigates the mechanisms that act at the nanoscale, systematically evaluating the mechanical properties of both the nanofibrous reinforcement phase (Chapter 1) and hosting polymeric matrix (Chapter 2). The second part deals with the implementation of different types of nanofibers for novel pioneering applications, trying to combine the well-known fracture toughness enhancement in composite laminates with improving other mechanical properties or including novel functionalities. Chapter 3 reports the development of novel adhesive carriers made of nylon 6,6 nanofibrous mats to increase the fracture toughness of epoxy-bonded joints. In Chapter 4, recently developed rubbery nanofibers are used to enhance the damping properties of unidirectional carbon fiber laminates. Lastly, in Chapter 5, a novel self-sensing composite laminate capable of detecting impacts on its surface using PVDF-TrFE piezoelectric nanofibers is presented.

Genetic and process engineering approaches for improving lipid productivity in the non-conventional oleaginous yeast Cutaneotrichosporon oleaginosus

Gli oli microbici stanno ricevendo sempre più attenzioni come possibile alternativa agli oli vegetali, nel processo di sostituzione dei combustibili fossili. Tuttavia, diversi aspetti necessitano di essere ottimizzati al fine di ottenere oli economicamente competitivi e con caratteristiche chimico-fisiche desiderate. In questa ricerca, sono stati utilizzati due differenti approcci per poter realizzare l’obiettivo preposto. Il primo, si è basato sull’ingegnerizzazione genetica del lievito C. oleaginous, al fine di incrementare la produttività di lipidi e modificare la composizione dei trigliceridi (TAG) sintetizzati. Un protocollo basato su una trasformazione genetica mediata da Agrobacterium è stato utilizzato per sovraesprimere la diacilglicerol trasnferasi (DGA1), l’enzima responsabile dell’ultimo step della sintesi dei TAG, e la Δ9-desaturasi, l’enzima che catalizza la conversione dell’acido stearico (C18:0) in acido oleico (C18:1). La selezione di colonie positive e l’analisi dei mutanti ottenuti ha confermato la buona riuscita della trasformazione. Il secondo approccio ha mirato a studiare l’influenza sulla crescita e sul profilo di lipidi accumulati da C. oleaginous da parte di diversi acidi grassi volatili (VFAs), una materia prima ottenibile da trattamenti di scarti industriali. A questo proposito, sono state utilizzate fermentazioni fed-batch su scala da 1-L basate su glucosio e miscele sintetiche di acido acetico e di VFAs come fonte di carbonio. L’utilizzo simultaneo di acido acetico e acidi secondari ha mostrato come sia possibile stimolare il metabolismo microbico al fine di incrementare l'accumulo di oli e ottenere una composizione chimica lipidica desiderata.