Robust optical flow estimation

[EN] In this work, we describe an implementation of the variational method proposed by Brox et al. in 2004, which yields accurate optical flows with low running times. It has several benefits with respect to the method of Horn and Schunck: it is more robust to the presence of outliers, produces piecewise-smooth flow fields and can cope with constant brightness changes. This method relies on the brightness and gradient constancy assumptions, using the information of the image intensities and the image gradients to find correspondences. It also generalizes the use of continuous L1 functionals, which help mitigate the efect of outliers and create a Total Variation (TV) regularization. Additionally, it introduces a simple temporal regularization scheme that enforces a continuous temporal coherence of the flow fields.

A scale-space aproach to nonlocal optical flow calculations

[EN] This paper presents an interpretation of a classic optical flow method by Nagel and Enkelmann as a tensor-driven anisotropic diffusion approach in digital image analysis. We introduce an improvement into the model formulation, and we establish well-posedness results for the resulting system of parabolic partial differential equations. Our method avoids linearizations in the optical flow constraint, and it can recover displacement fields which are far beyond the typical one-pixel limits that are characteristic for many differential methods for optical flow recovery. A robust numerical scheme is presented in detail. We avoid convergence to irrelevant local minima by embedding our method into a linear scale-space framework and using a focusing strategy from coarse to fine scales. The high accuracy of the proposed method is demonstrated by means of a synthetic and a real-world image sequence.

Implementation of a robust optical flow method for color images

We analyse the influence of colour information in optical flow methods. Typically, most of these techniques compute their solutions using grayscale intensities due to its simplicity and faster processing, ignoring the colour features. However, the current processing systems have minimized their computational cost and, on the other hand, it is reasonable to assume that a colour image offers more details from the scene which should facilitate finding better flow fields. The aim of this work is to determine if a multi-channel approach supposes a quite enough improvement to justify its use. In order to address this evaluation, we use a multi-channel implementation of a well-known TV-L1 method. Furthermore, we review the state-of-the-art in colour optical flow methods. In the experiments, we study various solutions using grayscale and RGB images from recent evaluation datasets to verify the colour benefits in motion estimation.

Regularization strategies for discontinuity-preserving optical flow methods

[EN]The aim of this work is to study several strategies for the preservation of flow discontinuities in variational optical flow methods. We analyze the combination of robust functionals and diffusion tensors in the smoothness assumption. Our study includes the use of tensors based on decreasing functions, which has shown to provide good results. However, it presents several limitations and usually does not perform better than other basic approaches. It typically introduces instabilities in the computed motion fields in the form of independent \textit{blobs} of vectors with large magnitude...

Analytical challenges in the fields of Nanobioscience and Nanobiotecnology: integrated methods for separation and characterization

Nano(bio)science and nano(bio)technology play a growing and tremendous interest both on academic and industrial aspects. They are undergoing rapid developments on many fronts such as genomics, proteomics, system biology, and medical applications. However, the lack of characterization tools for nano(bio)systems is currently considered as a major limiting factor to the final establishment of nano(bio)technologies. Flow Field-Flow Fractionation (FlFFF) is a separation technique that is definitely emerging in the bioanalytical field, and the number of applications on nano(bio)analytes such as high molar-mass proteins and protein complexes, sub-cellular units, viruses, and functionalized nanoparticles is constantly increasing. This can be ascribed to the intrinsic advantages of FlFFF for the separation of nano(bio)analytes. FlFFF is ideally suited to separate particles over a broad size range (1 nm-1 μm) according to their hydrodynamic radius (rh). The fractionation is carried out in an empty channel by a flow stream of a mobile phase of any composition. For these reasons, fractionation is developed without surface interaction of the analyte with packing or gel media, and there is no stationary phase able to induce mechanical or shear stress on nanosized analytes, which are for these reasons kept in their native state. Characterization of nano(bio)analytes is made possible after fractionation by interfacing the FlFFF system with detection techniques for morphological, optical or mass characterization. For instance, FlFFF coupling with multi-angle light scattering (MALS) detection allows for absolute molecular weight and size determination, and mass spectrometry has made FlFFF enter the field of proteomics. Potentialities of FlFFF couplings with multi-detection systems are discussed in the first section of this dissertation. The second and the third sections are dedicated to new methods that have been developed for the analysis and characterization of different samples of interest in the fields of diagnostics, pharmaceutics, and nanomedicine. The second section focuses on biological samples such as protein complexes and protein aggregates. In particular it focuses on FlFFF methods developed to give new insights into: a) chemical composition and morphological features of blood serum lipoprotein classes, b) time-dependent aggregation pattern of the amyloid protein Aβ1-42, and c) aggregation state of antibody therapeutics in their formulation buffers. The third section is dedicated to the analysis and characterization of structured nanoparticles designed for nanomedicine applications. The discussed results indicate that FlFFF with on-line MALS and fluorescence detection (FD) may become the unparallel methodology for the analysis and characterization of new, structured, fluorescent nanomaterials.

New platforms for optical biosensing

Physicochemical experimental techniques combined with the specificity of a biological recognition system have resulted in a variety of new analytical devices known as biosensors. Biosensors are under intensive development worldwide because they have many potential applications, e.g. in the fields of clinical diagnostics, food analysis, and environmental monitoring. Much effort is spent on the development of highly sensitive sensor platforms to study interactions on the molecular scale. In the first part, this thesis focuses on exploiting the biosensing application of nanoporous gold (NPG) membranes. NPG with randomly distributed nanopores (pore sizes less than 50 nm) will be discussed here. The NPG membrane shows unique plasmonic features, i.e. it supports both propagating and localized surface plasmon resonance modes (p SPR and l-SPR, respectively), both offering sensitive probing of the local refractive index variation on/in NPG. Surface refractive index sensors have an inherent advantage over fluorescence optical biosensors that require a chromophoric group or other luminescence label to transduce the binding event. In the second part, gold/silica composite inverse opals with macroporous structures were investigated with bio- or chemical sensing applications in mind. These samples combined the advantages of a larger available gold surface area with a regular and highly ordered grating structure. The signal of the plasmon was less noisy in these ordered substrate structures compared to the random pore structures of the NPG samples. In the third part of the thesis, surface plasmon resonance (SPR) spectroscopy was applied to probe the protein-protein interaction of the calcium binding protein centrin with the heterotrimeric G-protein transducin on a newly designed sensor platform. SPR spectroscopy was intended to elucidate how the binding of centrin to transducin is regulated towards understanding centrin functions in photoreceptor cells.

New biosensor applications of surface plasmon and hydrogel optical waveguide spectroscopy

Rapid and sensitive detection of chemical and biological analytes becomes increasingly important in areas such as medical diagnostics, food control and environmental monitoring. Optical biosensors based on surface plasmon resonance (SPR) and optical waveguide spectroscopy have been extensively pushed forward in these fields. In this study, we combine SPR, surface plasmon-enhanced fluorescence spectroscopy (SPFS) and optical waveguide spectroscopy with hydrogel thin film for highly sensitive detection of molecular analytes.rnrnA novel biosensor based on SPFS which was advanced through the excitation of long range surface plasmons (LRSPs) is reported in this study. LRSPs are special surface plasmon waves propagating along thin metal films with orders of magnitude higher electromagnetic field intensity and lower damping than conventional SPs. Therefore, their excitation on the sensor surface provides further increased fluorescence signal. An inhibition immunoassay based on LRSP-enhanced fluorescence spectroscopy (LRSP-FS) was developed for the detection of aflatoxin M1 (AFM1) in milk. The biosensor allowed for the detection of AFM1 in milk at concentrations as low as 0.6 pg mL-1, which is about two orders of magnitude lower than the maximum AFM1 residue level in milk stipulated by the European Commission legislation.rnrnIn addition, LRSPs probe the medium adjacent to the metallic surface with more extended evanescent field than regular SPs. Therefore, three-dimensional binding matrices with up to micrometer thickness have been proposed for the immobilization of biomolecular recognition elements with large surface density that allows to exploit the whole evanescent field of LRSP. A photocrosslinkable carboxymethyl dextran (PCDM) hydrogel thin film is used as a binding matrix, and it is applied for the detection of free prostate specific antigen (f-PSA) based on the LRSP-FS and sandwich immunoassay. We show that this approach allows for the detection of f-PSA at low femto-molar range, which is approximately four orders of magnitude lower than that for direct detection of f-PSA based on the monitoring of binding-induced refractive index changes.rnrnHowever, a three dimensional hydrogel binding matrix with micrometer thickness can also serve as an optical waveguide. Based on the measurement of binding-induced refractive index changes, a hydrogel optical waveguide spectroscopy (HOWS) is reported for a label-free biosensor. This biosensor is implemented by using a SPR optical setup in which a carboxylated poly(N-isoproprylacrylamide) (PNIPAAm) hydrogel film is attached on a metallic surface and modified by protein catcher molecules. Compared to regular SPR biosensor with thiol self-assembled monolayer (SAM), HOWS provides an order of magnitude improved resolution in the refractive index measurements and enlarged binding capacity owing to its low damping and large swelling ratio, respectively. A model immunoassay experiment revealed that HOWS allowed detection of IgG molecules with a 10 pM limit of detection (LOD) that was five-fold lower than that achieved for SPR with thiol SAM. For the high capacity hydrogel matrix, the affinity binding was mass transport limited.rnrnThe mass transport of target molecules to the sensor surface can play as critical a role as the chemical reaction itself. In order to overcome the diffusion-limited mass transfer, magnetic iron oxide nanoparticles were employed. The magnetic nanoparticles (MNPs) can serve both as labels providing enhancement of the refractive index changes, and “vehicles” for rapidly delivering the analytes from sample solution to an SPR sensor surface with a gradient magnetic field. A model sandwich assay for the detection of β human chorionic gonadotropin (βhCG) has been utilized on a gold sensor surface with metallic diffraction grating structure supporting the excitation of SPs. Various detection formats including a) direct detection, b) sandwich assay, c) MNPs immunoassay without and d) with applied magnetic field were compared. The results show that the highly-sensitive MNPs immunoassay improves the LOD on the detection of βhCG by a factor of 5 orders of magnitude with respect to the direct detection.rn

Bottle microresonators for applications in quantum optics and all-optical signal processing

This thesis reports on the experimental realization, characterization and application of a novel microresonator design. The so-called “bottle microresonator” sustains whispering-gallery modes in which light fields are confined near the surface of the micron-sized silica structure by continuous total internal reflection. While whispering-gallery mode resonators in general exhibit outstanding properties in terms of both temporal and spatial confinement of light fields, their monolithic design makes tuning of their resonance frequency difficult. This impedes their use, e.g., in cavity quantum electrodynamics (CQED) experiments, which investigate the interaction of single quantum mechanical emitters of predetermined resonance frequency with a cavity mode. In contrast, the highly prolate shape of the bottle microresonators gives rise to a customizable mode structure, enabling full tunability. The thesis is organized as follows: In chapter I, I give a brief overview of different types of optical microresonators. Important quantities, such as the quality factor Q and the mode volume V, which characterize the temporal and spatial confinement of the light field are introduced. In chapter II, a wave equation calculation of the modes of a bottle microresonator is presented. The intensity distribution of different bottle modes is derived and their mode volume is calculated. A brief description of light propagation in ultra-thin optical fibers, which are used to couple light into and out of bottle modes, is given as well. The chapter concludes with a presentation of the fabrication techniques of both structures. Chapter III presents experimental results on highly efficient, nearly lossless coupling of light into bottle modes as well as their spatial and spectral characterization. Ultra-high intrinsic quality factors exceeding 360 million as well as full tunability are demonstrated. In chapter IV, the bottle microresonator in add-drop configuration, i.e., with two ultra-thin fibers coupled to one bottle mode, is discussed. The highly efficient, nearly lossless coupling characteristics of each fiber combined with the resonator's high intrinsic quality factor, enable resonant power transfers between both fibers with efficiencies exceeding 90%. Moreover, the favorable ratio of absorption and the nonlinear refractive index of silica yields optical Kerr bistability at record low powers on the order of 50 µW. Combined with the add-drop configuration, this allows one to route optical signals between the outputs of both ultra-thin fibers, simply by varying the input power, thereby enabling applications in all-optical signal processing. Finally, in chapter V, I discuss the potential of the bottle microresonator for CQED experiments with single atoms. Its Q/V-ratio, which determines the ratio of the atom-cavity coupling rate to the dissipative rates of the subsystems, aligns with the values obtained for state-of-the-art CQED microresonators. In combination with its full tunability and the possibility of highly efficient light transfer to and from the bottle mode, this makes the bottle microresonator a unique tool for quantum optics applications.

Optical interface based on a nanofiber atom-trap

In this thesis, I present the realization of a fiber-optical interface using optically trapped cesium atoms, which is an efficient tool for coupling light and atoms. The basic principle of the presented scheme relies on the trapping of neutral cesium atoms in a two-color evanescent field surrounding a nanofiber. The strong confinement of the fiber guided light, which also protrudes outside the nanofiber, provides strong confinement of the atoms as well as efficient coupling to near-resonant light propagating through the fiber. In chapter 1, the necessary physical and mathematical background describing the propagation of light in an optical fiber is presented. The exact solution of Maxwell’s equations allows us to model fiber-guided light fields which give rise to the trapping potentials and the atom-light coupling in the close vicinity of a nanofiber. Chapter 2 gives the theoretical background of light-atom interaction. A quantum mechanical model of the light-induced shifts of the relevant atomic levels is reviewed, which allows us to quantify the perturbation of the atomic states due to the presence of the trapping light-fields. The experimental realization of the fiber-based atom trap is the focus of chapter 3. Here, I analyze the properties of the fiber-based trap in terms of the confinement of the atoms and the impact of several heating mechanisms. Furthermore, I demonstrate the transportation of the trapped atoms, as a first step towards a deterministic delivery of individual atoms. In chapter 4, I present the successful interfacing of the trapped atomic ensemble and fiber-guided light. Three different approaches are discussed, i.e., those involving the measurement of either near-resonant scattering in absorption or the emission into the guided mode of the nanofiber. In the analysis of the spectroscopic properties of the trapped ensemble we find good agreement with the prediction of theoretical model discussed in chapter 2. In addition, I introduce a non-destructive scheme for the interrogation of the atoms states, which is sensitive to phase shifts of far-detuned fiber-guided light interacting with the trapped atoms. The inherent birefringence in our system, induced by the atoms, changes the state of polarization of the probe light and can be thus detected via a Stokes vector measurement.

Interacting Bose-Fermi mixtures in optical lattices

In this thesis, we investigate mixtures of quantum degenerate Bose and Fermi gases of neutral atoms in threedimensional optical lattices. Feshbach resonances allow to control interspecies interactions in these systems precisely, by preparing suitable combinations of internal atomic states and applying external magnetic fields. This way, the system behaviour can be tuned continuously from mutual transparency to strongly interacting correlated phases, up to the stability boundary.rnThe starting point for these investigations is the spin-polarized fermionic band insulator. The properties of this non-interacting system are fully determined by the Pauli exclusion principle for the occupation of states in the lattice. A striking demonstration of the latter can be found in the antibunching of the density-density correlation of atoms released from the lattice. If bosonic atoms are added to this system, isolated heteronuclear molecules can be formed on the lattice sites via radio-frequency stimulation. The efficiency of this process hints at a modification of the atom number distribution over the lattice caused by interspecies interaction.rnIn the following, we investigate systems with tunable interspecies interaction. To this end, a method is developed which allows to assess the various contributions to the system Hamiltonian both qualitatively and quantitatively by following the quantum phase diffusion of the bosonic matter wave.rnBesides a modification of occupation number statistics, these measurements show a significant renormalization of the bosonic Hubbard parameters. The final part of the thesis considers the implications of this renormalization effect on the many particle physics in the mixture. Here, we demonstrate how the quantum phase transition from a bosonic superfluid to a Mott insulator state is shifted towards considerably shallower lattices due to renormalization.

Four-window technique for measuring optical-phase-space-time-frequency tomography

A new approach, the four-window technique, was developed to measure optical phase-space-time-frequency tomography (OPSTFT). The four-window technique is based on balanced heterodyne detection with two local oscillator (LO) fields. This technique can provide independent control of position, momentum, time and frequency resolution. The OPSTFT is a Wigner distribution function of two independent Fourier transform pairs, phase-space and time-frequency. The OPSTFT can be applied for early disease detection.

Calibration of a surgical microscope with automated zoom lenses using an active optical tracker

BACKGROUND: In this paper, we present a new method for the calibration of a microscope and its registration using an active optical tracker. METHODS: Practically, both operations are done simultaneously by moving an active optical marker within the field of view of the two devices. The IR LEDs composing the marker are first segmented from the microscope images. By knowing their corresponding three-dimensional (3D) position in the optical tracker reference system, it is possible to find the transformation matrix between the referential of the two devices. Registration and calibration parameters can be extracted directly from that transformation. In addition, since the zoom and focus can be modified by the surgeon during the operation, we propose a spline based method to update the camera model to the new setup. RESULTS: The proposed technique is currently being used in an augmented reality system for image-guided surgery in the fields of ear, nose and throat (ENT) and craniomaxillofacial surgeries. CONCLUSIONS: The results have proved to be accurate and the technique is a fast, dynamic and reliable way to calibrate and register the two devices in an OR environment.

Quantum dot / optical protein bio-nano hybrid system biosensing

The integration of novel nanomaterials with highly-functional biological molecules has advanced multiple fields including electronics, sensing, imaging, and energy harvesting. This work focuses on the creation of a new type of bio-nano hybrid substrate for military biosensing applications. Specifically it is shown that the nano-scale interactions of the optical protein bacteriorhodopsin and colloidal semiconductor quantum dots can be utilized as a generic sensing substrate. This work spans from the basic creation of the protein to its application in a novel biosensing system. The functionality of this sensor design originates from the unique interactions between the quantum dot and bacteriorhodopsin molecule when in nanoscale proximity. A direct energy transfer relationship has been established between coreshell quantum dots and the optical protein bacteriorhodopsin that substantially enhances the protein’s native photovoltaic capabilities. This energy transfer phenomena is largely distance dependent, in the sub-10nm realm, and is characterized experimentally at multiple separation distances. Experimental results on the energy transfer efficiency in this hybrid system correlate closely to theoretical predictions. Deposition of the hybrid system with nano-scale control has allowed for the utilization of this energy transfer phenomena as a modulation point for a functional biosensor prototype. This work reveals that quantum dots have the ability to activate the bacteriorhodopsin photocycle through both photonic and non-photonic energy transfer mechanisms. By altering the energy transferred to the bacteriorhodopsin molecule from the quantum dot, the electrical output of the protein can be modulated. A biosensing prototype was created in which the energy transfer relationship is altered upon target binding, demonstrating the applicability of a quantum dot/bacteriorhodopsin hybrid system for sensor applications. The electrical nature of this sensing substrate will allow for its efficient integration into a nanoelectronics array form, potentially leading to a small-low power sensing platform for remote toxin detection applications.

A new method to monitor visual field defects caused by photoreceptor degeneration by quantitative optical coherence tomography

PURPOSE: To correlate the dimension of the visual field (VF) tested by Goldman kinetic perimetry with the extent of visibility of the highly reflective layer between inner and outer segments of photoreceptors (IOS) seen in optical coherence tomography (OCT) images in patients with retinitis pigmentosa (RP). METHODS: In a retrospectively designed cross-sectional study, 18 eyes of 18 patients with RP were examined with OCT and Goldmann perimetry using test target I4e and compared with 18 eyes of 18 control subjects. A-scans of raw scan data of Stratus OCT images (Carl Zeiss Meditec, AG, Oberkochen, Germany) were quantitatively analyzed for the presence of the signal generated by the highly reflective layer between the IOS in OCT images. Starting in the fovea, the distance to which this signal was detectable was measured. Visual fields were analyzed by measuring the distance from the center point to isopter I4e. OCT and visual field data were analyzed in a clockwise fashion every 30 degrees , and corresponding measures were correlated. RESULTS: In corresponding alignments, the distance from the center point to isopter I4e and the distance to which the highly reflective signal from the IOS can be detected correlate significantly (r = 0.75, P < 0.0001). The greater the distance in VF, the greater the distance measured in OCT. CONCLUSIONS: The authors hypothesize that the retinal structure from which the highly reflective layer between the IOS emanates is of critical importance for visual and photoreceptor function. Further research is warranted to determine whether this may be useful as an objective marker of progression of retinal degeneration in patients with RP.

An Optical Survey for Space Debris on Highly Eccentric MEO Orbits

Optical surveys for space debris in high-altitude orbits have been conducted since more than ten years. Originally these efforts concentrated mainly on the geostationary ring (GEO). Corresponding observation strategies, processing techniques and cataloguing approaches have been developed and successfully applied. The ESA GEO surveys, e.g., resulted in the detection of a significant population of small-size debris and later in the discovery of high area-to-mass ratio objects in GEO-like orbits. The observation scenarios were successively adapted to survey the geostationary transfer orbit (GTO) region; and recently surveys to search for debris in the medium Earth orbit (MEO) region of the global navigation satellite constellations were successfully conducted. Comparably less experience (both, in terms of practical observation and strategy definition) is available for eccentric orbits that (at least partly) are in the MEO region, in particular for the Molniya-type orbits. Several breakup events and deliberate fragmentations are known to have taken place in such orbits. Different survey and follow-up strategies for searching space debris objects in highly-eccentric MEO orbits, and to acquire orbits which are sufficiently accurate to catalogue such objects and to maintain their orbits over longer time spans were developed. Simulations were performed to compare the performance of different survey and cataloguing strategies. Eventually, optical observations were conducted in the framework of an ESA study using ESA’s Space Debris Telescope (ESASDT) the 1-m Zeiss telescope located at the Optical Ground Station (OGS) at the Teide Observatory at Tenerife, Spain. A first series of surveys of Molnjya-type orbits was performed between January and April 2013. During these four months survey observations were performed during nine nights. A basic survey consisted of observing a single geocentric field for 10 minutes. If a faint object was found, follow-up observations were performed during the same night to ensure a save rediscovery of the object during the next nights. Additional follow-up observations to maintain the orbits of these newly discovered faint objects were also acquired with AIUB ́s 1m ZIMLAT telescope in Zimmerwald, Switzerland. Eventually 195 basic surveys were performed during these nine nights corresponding to about 32.5 hours of observations. In total 24 uncorrelated faint objects were discovered and all known catalogue objects in the survey fields were detected. On average one uncorrelated object was found every 80 minutes. Some of these objects show a considerable brightness variation and have a high area-to-mass ratio as determined in the orbit estimation process.