A touchless passive Infrared gesture sensor.

A sensing device for a touchless, hand gesture, user interface based on an inexpensive passive infrared pyroelectric detector array is presented. The 2 x 2 element sensor responds to changing infrared radiation generated by hand movement over the array. The sensing range is from a few millimetres to tens of centimetres. The low power consumption (< 50 μW) enables the sensor’s use in mobile devices and in low energy applications. Detection rates of 77% have been demonstrated using a prototype system that differentiates the four main hand motion trajectories – up, down, left and right. This device allows greater non-contact control capability without an increase in size, cost or power consumption over existing on/off devices.

Image-Guided Precision Manipulation of Cells and Nanoparticles in Microfluidics

Manipulation of single cells and particles is important to biology and nanotechnology. Our electrokinetic (EK) tweezers manipulate objects in simple microfluidic devices using gentle fluid and electric forces under vision-based feedback control. In this dissertation, I detail a user-friendly implementation of EK tweezers that allows users to select, position, and assemble cells and nanoparticles. This EK system was used to measure attachment forces between living breast cancer cells, trap single quantum dots with 45 nm accuracy, build nanophotonic circuits, and scan optical properties of nanowires. With a novel multi-layer microfluidic device, EK was also used to guide single microspheres along complex 3D trajectories. The schemes, software, and methods developed here can be used in many settings to precisely manipulate most visible objects, assemble objects into useful structures, and improve the function of lab-on-a-chip microfluidic systems.

A User Interaction Bug Analyzer Based on Image

Context: Mobile applications support a set of user-interaction features that are independent of the application logic. Rotating the device, scrolling, or zooming are examples of such features. Some bugs in mobile applications can be attributed to user-interaction features. Objective: This paper proposes and evaluates a bug analyzer based on user-interaction features that uses digital image processing to find bugs. Method: Our bug analyzer detects bugs by comparing the similarity between images taken before and after a user-interaction. SURF, an interest point detector and descriptor, is used to compare the images. To evaluate the bug analyzer, we conducted a case study with 15 randomly selected mobile applications. First, we identified user-interaction bugs by manually testing the applications. Images were captured before and after applying each user-interaction feature. Then, image pairs were processed with SURF to obtain interest points, from which a similarity percentage was computed, to finally decide whether there was a bug. Results: We performed a total of 49 user-interaction feature tests. When manually testing the applications, 17 bugs were found, whereas when using image processing, 15 bugs were detected. Conclusions: 8 out of 15 mobile applications tested had bugs associated to user-interaction features. Our bug analyzer based on image processing was able to detect 88% (15 out of 17) of the user-interaction bugs found with manual testing.

An 8x8 thermopile based uncooled infrared sensor

International audience

Solid-liquid interactions in microscale structures and devices

Liquid-solid interactions become important as dimensions approach mciro/nano-scale. This dissertation focuses on liquid-solid interactions in two distinct applications: capillary driven self-assembly of thin foils into 3D structures, and droplet wetting of hydrophobic micropatterned surfaces. The phenomenon of self-assembly of complex structures is common in biological systems. Examples include self-assembly of proteins into macromolecular structures and self-assembly of lipid bilayer membranes. The principles governing this phenomenon have been applied to induce self-assembly of millimeter scale Si thin films into spherical and other 3D structures, which are then integrated into light-trapping photovoltaic (PV) devices. Motivated by this application, we present a generalized analytical study of the self-folding of thin plates into deterministic 3D shapes, through fluid-solid interactions, to be used as PV devices. This study consists of developing a model using beam theory, which incorporates the two competing components — a capillary force that promotes folding and the bending rigidity of the foil that resists folding into a 3D structure. Through an equivalence argument of thin foils of different geometry, an effective folding parameter, which uniquely characterizes the driving force for folding, has been identified. A criterion for spontaneous folding of an arbitrarily shaped 2D foil, based on the effective folding parameter, is thus established. Measurements from experiments using different materials and predictions from the model match well, validating the assumptions used in the analysis. As an alternative to the mechanics model approach, the minimization of the total free energy is employed to investigate the interactions between a fluid droplet and a flexible thin film. A 2D energy functional is proposed, comprising the surface energy of the fluid, bending energy of the thin film and gravitational energy of the fluid. Through simulations with Surface Evolver, the shapes of the droplet and the thin film at equilibrium are obtained. A critical thin film length necessary for complete enclosure of the fluid droplet, and hence successful self-assembly into a PV device, is determined and compared with the experimental results and mechanics model predictions. The results from the modeling and energy approaches and the experiments are all consistent. Superhydrophobic surfaces, which have unique properties including self-cleaning and water repelling are desired in many applications. One excellent example in nature is the lotus leaf. To fabricate these surfaces, well designed micro/nano- surface structures are often employed. In this research, we fabricate superhydrophobic micropatterned Polydimethylsiloxane (PDMS) surfaces composed of micropillars of various sizes and arrangements by means of soft lithography. Both anisotropic surfaces, consisting of parallel grooves and cylindrical pillars in rectangular lattices, and isotropic surfaces, consisting of cylindrical pillars in square and hexagonal lattices, are considered. A novel technique is proposed to image the contact line (CL) of the droplet on the hydrophobic surface. This technique provides a new approach to distinguish between partial and complete wetting. The contact area between droplet and microtextured surface is then measured for a droplet in the Cassie state, which is a state of partial wetting. The results show that although the droplet is in the Cassie state, the contact area does not necessarily follow Cassie model predictions. Moreover, the CL is not circular, and is affected by the micropatterns, in both isotropic and anisotropic cases. Thus, it is suggested that along with the contact angle — the typical parameter reported in literature quantifying wetting, the size and shape of the contact area should also be presented. This technique is employed to investigate the evolution of the CL on a hydrophobic micropatterned surface in the cases of: a single droplet impacting the micropatterned surface, two droplets coalescing on micropillars, and a receding droplet resting on the micropatterned surface. Another parameter which quantifies hydrophobicity is the contact angle hysteresis (CAH), which indicates the resistance of the surface to the sliding of a droplet with a given volume. The conventional methods of using advancing and receding angles or tilting stage to measure the resistance of the micropatterned surface are indirect, without mentioning the inaccuracy due to the discrete and stepwise motion of the CL on micropillars. A micronewton force sensor is utilized to directly measure the resisting force by dragging a droplet on a microtextured surface. Together with the proposed imaging technique, the evolution of the CL during sliding is also explored. It is found that, at the onset of sliding, the CL behaves as a linear elastic solid with a constant stiffness. Afterwards, the force first increases and then decreases and reaches a steady state, accompanied with periodic oscillations due to regular pinning and depinning of the CL. Both the maximum and steady state forces are primarily dependent on area fractions of the micropatterned surfaces in our experiment. The resisting force is found to be proportional to the number of pillars which pin the CL at the trailing edge, validating the assumption that the resistance mainly arises from the CL pinning at the trailing edge. In each pinning-and-depinning cycle during the steady state, the CL also shows linear elastic behavior but with a lower stiffness. The force variation and energy dissipation involved can also be determined. This novel method of measuring the resistance of the micropatterned surface elucidates the dependence on CL pinning and provides more insight into the mechanisms of CAH.

Análise histométrica do desenvolvimento testicular de cutias (Dasyprocta aguti) criadas em cativeiros

Foi estudado, por meio da histometria, o desenvolvimento testicular em 31 cutias da espécie Dasyprocta aguti desde o nascimento até 14 meses de idade. O diâmetro e a área, médios, foram obtidos a partir de 30 secções transversais de cordões e/ou túbulos seminíferos, em cada testículo, utilizando-se sistema de computadorizado de analises de imagem e uma ocular micrométrica Zeiss CPL 10X, acoplada a uma objetiva de 40X. As proporções volumétricas do testículo foram obtidas com o método estereométrico, segundo Elias, Henning e Schwartz¹. O diâmetro tubular médio apresentou crescimento lento desde o nascimento até os oito meses de idade, nas duas metodologias empregadas. Quando foi usada a ocular micrométrica observou-se que, a partir de nove meses, o diâmetro tubular teve um crescimento acelerado, chegando a duplicar o seu valor, se comparado com grupo etário que o antecedia. A proporção volumétrica dos cordões testiculares e túbulos seminíferos cresceu gradualmente, atingindo, aos nove meses, seu valor máximo (86,50%). As células de Leydig apresentaram proporção volumétrica decrescente, e seus maiores valores foram expressivos do nascimento até quatro meses de idade (7,00 ± 1,77% a 9,55 ± 0,64%) e mínimos a partir de nove meses, tendendo ainda a uma estabilização. O estroma diminuiu com a evolução da idade caindo bruscamente a partir da puberdade. Conclui-se que o diâmetro dos cordões testiculares e túbulos seminíferos apresentou maior crescimento, coincidindo com o início da puberdade e a proporção volumétrica das células de Leydig encontrou-se, respectivamente, mais alta e mais baixa no mesmo período.

Mechanism of pH-dependent activation of the sodium-proton antiporter NhaA

Data files to accompany the article in Nature Communications, in press.

Application of an online-biomass sensor in an optical multisensory platform prototype for growth monitoring of biotechnical relevant microorganism and cell lines in single-use shake flasks

In the context of this work we evaluated a multisensory, noninvasive prototype platform for shake flask cultivations by monitoring three basic parameters (pH, pO2 and biomass). The focus lies on the evaluation of the biomass sensor based on backward light scattering. The application spectrum was expanded to four new organisms in addition to E. coli K12 and S. cerevisiae [1]. It could be shown that the sensor is appropriate for a wide range of standard microorganisms, e.g., L. zeae, K. pastoris, A. niger and CHO-K1. The biomass sensor signal could successfully be correlated and calibrated with well-known measurement methods like OD600, cell dry weight (CDW) and cell concentration. Logarithmic and Bleasdale-Nelder derived functions were adequate for data fitting. Measurements at low cell concentrations proved to be critical in terms of a high signal to noise ratio, but the integration of a custom made light shade in the shake flask improved these measurements significantly. This sensor based measurement method has a high potential to initiate a new generation of online bioprocess monitoring. Metabolic studies will particularly benefit from the multisensory data acquisition. The sensor is already used in labscale experiments for shake flask cultivations.

the plenoptic sensor

In this thesis, we will introduce the innovative concept of a plenoptic sensor that can determine the phase and amplitude distortion in a coherent beam, for example a laser beam that has propagated through the turbulent atmosphere.. The plenoptic sensor can be applied to situations involving strong or deep atmospheric turbulence. This can improve free space optical communications by maintaining optical links more intelligently and efficiently. Also, in directed energy applications, the plenoptic sensor and its fast reconstruction algorithm can give instantaneous instructions to an adaptive optics (AO) system to create intelligent corrections in directing a beam through atmospheric turbulence. The hardware structure of the plenoptic sensor uses an objective lens and a microlens array (MLA) to form a mini “Keplerian” telescope array that shares the common objective lens. In principle, the objective lens helps to detect the phase gradient of the distorted laser beam and the microlens array (MLA) helps to retrieve the geometry of the distorted beam in various gradient segments. The software layer of the plenoptic sensor is developed based on different applications. Intuitively, since the device maximizes the observation of the light field in front of the sensor, different algorithms can be developed, such as detecting the atmospheric turbulence effects as well as retrieving undistorted images of distant objects. Efficient 3D simulations on atmospheric turbulence based on geometric optics have been established to help us perform optimization on system design and verify the correctness of our algorithms. A number of experimental platforms have been built to implement the plenoptic sensor in various application concepts and show its improvements when compared with traditional wavefront sensors. As a result, the plenoptic sensor brings a revolution to the study of atmospheric turbulence and generates new approaches to handle turbulence effect better.

Endoscopic optical coherence tomography : design and application

This thesis presents an investigation on endoscopic optical coherence tomography (OCT). As a noninvasive imaging modality, OCT emerges as an increasingly important diagnostic tool for many clinical applications. Despite of many of its merits, such as high resolution and depth resolvability, a major limitation is the relatively shallow penetration depth in tissue (about 2∼3 mm). This is mainly due to tissue scattering and absorption. To overcome this limitation, people have been developing many different endoscopic OCT systems. By utilizing a minimally invasive endoscope, the OCT probing beam can be brought to the close vicinity of the tissue of interest and bypass the scattering of intervening tissues so that it can collect the reflected light signal from desired depth and provide a clear image representing the physiological structure of the region, which can not be disclosed by traditional OCT. In this thesis, three endoscope designs have been studied. While they rely on vastly different principles, they all converge to solve this long-standing problem.

A hand-held endoscope with manual scanning is first explored. When a user is holding a hand- held endoscope to examine samples, the movement of the device provides a natural scanning. We proposed and implemented an optical tracking system to estimate and record the trajectory of the device. By registering the OCT axial scan with the spatial information obtained from the tracking system, one can use this system to simply ‘paint’ a desired volume and get any arbitrary scanning pattern by manually waving the endoscope over the region of interest. The accuracy of the tracking system was measured to be about 10 microns, which is comparable to the lateral resolution of most OCT system. Targeted phantom sample and biological samples were manually scanned and the reconstructed images verified the method.

Next, we investigated a mechanical way to steer the beam in an OCT endoscope, which is termed as Paired-angle-rotation scanning (PARS). This concept was proposed by my colleague and we further developed this technology by enhancing the longevity of the device, reducing the diameter of the probe, and shrinking down the form factor of the hand-piece. Several families of probes have been designed and fabricated with various optical performances. They have been applied to different applications, including the collector channel examination for glaucoma stent implantation, and vitreous remnant detection during live animal vitrectomy.

Lastly a novel non-moving scanning method has been devised. This approach is based on the EO effect of a KTN crystal. With Ohmic contact of the electrodes, the KTN crystal can exhibit a special mode of EO effect, termed as space-charge-controlled electro-optic effect, where the carrier electron will be injected into the material via the Ohmic contact. By applying a high voltage across the material, a linear phase profile can be built under this mode, which in turn deflects the light beam passing through. We constructed a relay telescope to adapt the KTN deflector into a bench top OCT scanning system. One of major technical challenges for this system is the strong chromatic dispersion of KTN crystal within the wavelength band of OCT system. We investigated its impact on the acquired OCT images and proposed a new approach to estimate and compensate the actual dispersion. Comparing with traditional methods, the new method is more computational efficient and accurate. Some biological samples were scanned by this KTN based system. The acquired images justified the feasibility of the usage of this system into a endoscopy setting. My research above all aims to provide solutions to implement an OCT endoscope. As technology evolves from manual, to mechanical, and to electrical approaches, different solutions are presented. Since all have their own advantages and disadvantages, one has to determine the actual requirements and select the best fit for a specific application.

MEMS SENSOR PLATFORMS FOR IN SITU CHARACTERIZATION OF LI-ION BATTERY ELECTRODES

Lithium-ion batteries provide high energy density while being compact and light-weight and are the most pervasive energy storage technology powering portable electronic devices such as smartphones, laptops, and tablet PCs. Considerable efforts have been made to develop new electrode materials with ever higher capacity, while being able to maintain long cycle life. A key challenge in those efforts has been characterizing and understanding these materials during battery operation. While it is generally accepted that the repeated strain/stress cycles play a role in long-term battery degradation, the detailed mechanisms creating these mechanical effects and the damage they create still remain unclear. Therefore, development of techniques which are capable of capturing in real time the microstructural changes and the associated stress during operation are crucial for unravelling lithium-ion battery degradation mechanisms and further improving lithium-ion battery performance. This dissertation presents the development of two microelectromechanical systems sensor platforms for in situ characterization of stress and microstructural changes in thin film lithium-ion battery electrodes, which can be leveraged as a characterization platform for advancing battery performance. First, a Fabry-Perot microelectromechanical systems sensor based in situ characterization platform is developed which allows simultaneous measurement of microstructural changes using Raman spectroscopy in parallel with qualitative stress changes via optical interferometry. Evolutions in the microstructure creating a Raman shift from 145 cm−1 to 154 cm−1 and stress in the various crystal phases in the LixV2O5 system are observed, including both reversible and irreversible phase transitions. Also, a unique way of controlling electrochemically-driven stress and stress gradient in lithium-ion battery electrodes is demonstrated using the Fabry-Perot microelectromechanical systems sensor integrated with an optical measurement setup. By stacking alternately stressed layers, the average stress in the stacked electrode is greatly reduced by 75% compared to an unmodified electrode. After 2,000 discharge-charge cycles, the stacked electrodes retain only 83% of their maximum capacity while unmodified electrodes retain 91%, illuminating the importance of the stress gradient within the electrode. Second, a buckled membrane microelectromechanical systems sensor is developed to enable in situ characterization of quantitative stress and microstructure evolutions in a V2O5 lithium-ion battery cathode by integrating atomic force microscopy and Raman spectroscopy. Using dual-mode measurements in the voltage range of the voltage range of 2.8V – 3.5V, both the induced stress (~ 40 MPa) and Raman intensity changes due to lithium cycling are observed. Upon lithium insertion, tensile stress in the V2O5 increases gradually until the α- to ε-phase and ε- to δ-phase transitions occur. The Raman intensity change at 148 cm−1 shows that the level of disorder increases during lithium insertion and progressively recovers the V2O5 lattice during lithium extraction. Results are in good agreement with the expected mechanical behavior and disorder change in V2O5, highlighting the potential of microelectromechanical systems as enabling tools for advanced scientific investigations. The work presented here will be eventually utilized for optimization of thin film battery electrode performance by achieving fundamental understanding of how stress and microstructural changes are correlated, which will also provide valuable insight into a battery performance degradation mechanism.

Mesoscale Optoelectronic Design of Wire-Based Photovoltaic and Photoelectrochemical Devices

The overarching theme of this thesis is mesoscale optical and optoelectronic design of photovoltaic and photoelectrochemical devices. In a photovoltaic device, light absorption and charge carrier transport are coupled together on the mesoscale, and in a photoelectrochemical device, light absorption, charge carrier transport, catalysis, and solution species transport are all coupled together on the mesoscale. The work discussed herein demonstrates that simulation-based mesoscale optical and optoelectronic modeling can lead to detailed understanding of the operation and performance of these complex mesostructured devices, serve as a powerful tool for device optimization, and efficiently guide device design and experimental fabrication efforts. In-depth studies of two mesoscale wire-based device designs illustrate these principles—(i) an optoelectronic study of a tandem Si|WO3 microwire photoelectrochemical device, and (ii) an optical study of III-V nanowire arrays.

The study of the monolithic, tandem, Si|WO3 microwire photoelectrochemical device begins with development and validation of an optoelectronic model with experiment. This study capitalizes on synergy between experiment and simulation to demonstrate the model’s predictive power for extractable device voltage and light-limited current density. The developed model is then used to understand the limiting factors of the device and optimize its optoelectronic performance. The results of this work reveal that high fidelity modeling can facilitate unequivocal identification of limiting phenomena, such as parasitic absorption via excitation of a surface plasmon-polariton mode, and quick design optimization, achieving over a 300% enhancement in optoelectronic performance over a nominal design for this device architecture, which would be time-consuming and challenging to do via experiment.

The work on III-V nanowire arrays also starts as a collaboration of experiment and simulation aimed at gaining understanding of unprecedented, experimentally observed absorption enhancements in sparse arrays of vertically-oriented GaAs nanowires. To explain this resonant absorption in periodic arrays of high index semiconductor nanowires, a unified framework that combines a leaky waveguide theory perspective and that of photonic crystals supporting Bloch modes is developed in the context of silicon, using both analytic theory and electromagnetic simulations. This detailed theoretical understanding is then applied to a simulation-based optimization of light absorption in sparse arrays of GaAs nanowires. Near-unity absorption in sparse, 5% fill fraction arrays is demonstrated via tapering of nanowires and multiple wire radii in a single array. Finally, experimental efforts are presented towards fabrication of the optimized array geometries. A hybrid self-catalyzed and selective area MOCVD growth method is used to establish morphology control of GaP nanowire arrays. Similarly, morphology and pattern control of nanowires is demonstrated with ICP-RIE of InP. Optical characterization of the InP nanowire arrays gives proof of principle that tapering and multiple wire radii can lead to near-unity absorption in sparse arrays of InP nanowires.

Charge transport in poly(3-methylthiophene) schottky barrier diodes

Schottky-barrier devices were formed from electropolymerised films of poly (3-methylthiophene) (PMeT). Thermal annealing of a partially undoped film led to diodes with rectification ratios as high as 5900 at 1 V and 50,000 at 2.5 V and ideality factors slightly above 2. The temperature dependence of ac loss tangent and forward currents are identical suggesting that bulk effects dominate device behaviour event at very low forward voltages. Below 250 K forward currents are essentially independent of temperature. Preliminary TSC measurements show the presence of at least two trapping levels in the devices. © 1993.

Charge transport in poly(3-methylthiophene) schottky barrier diodes

Schottky-barrier devices were formed from electropolymerised films of poly (3-methylthiophene) (PMeT). Thermal annealing of a partially undoped film led to diodes with rectification ratios as high as 5900 at 1 V and 50,000 at 2.5 V and ideality factors slightly above 2. The temperature dependence of ac loss tangent and forward currents are identical suggesting that bulk effects dominate device behaviour event at very low forward voltages. Below 250 K forward currents are essentially independent of temperature. Preliminary TSC measurements show the presence of at least two trapping levels in the devices. © 1993.

POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.