Interactive free viewpoint video streaming using prioritized network coding

In free viewpoint applications, the images are captured by an array of cameras that acquire a scene of interest from different perspectives. Any intermediate viewpoint not included in the camera array can be virtually synthesized by the decoder, at a quality that depends on the distance between the virtual view and the camera views available at decoder. Hence, it is beneficial for any user to receive camera views that are close to each other for synthesis. This is however not always feasible in bandwidth-limited overlay networks, where every node may ask for different camera views. In this work, we propose an optimized delivery strategy for free viewpoint streaming over overlay networks. We introduce the concept of layered quality-of-experience (QoE), which describes the level of interactivity offered to clients. Based on these levels of QoE, camera views are organized into layered subsets. These subsets are then delivered to clients through a prioritized network coding streaming scheme, which accommodates for the network and clients heterogeneity and effectively exploit the resources of the overlay network. Simulation results show that, in a scenario with limited bandwidth or channel reliability, the proposed method outperforms baseline network coding approaches, where the different levels of QoE are not taken into account in the delivery strategy optimization.

Coded Aperture Flow

Real cameras have a limited depth of field. The resulting defocus blur is a valuable cue for estimating the depth structure of a scene. Using coded apertures, depth can be estimated from a single frame. For optical flow estimation between frames, however, the depth dependent degradation can introduce errors. These errors are most prominent when objects move relative to the focal plane of the camera. We incorporate coded aperture defocus blur into optical flow estimation and allow for piecewise smooth 3D motion of objects. With coded aperture flow, we can establish dense correspondences between pixels in succeeding coded aperture frames. We compare several approaches to compute accurate correspondences for coded aperture images showing objects with arbitrary 3D motion.

Anamorphic pixels for multi-channel superresolution

Superresolution from plenoptic cameras or camera arrays is usually treated similarly to superresolution from video streams. However, the transformation between the low-resolution views can be determined precisely from camera geometry and parallax. Furthermore, as each low-resolution image originates from a unique physical camera, its sampling properties can also be unique. We exploit this option with a custom design of either the optics or the sensor pixels. This design makes sure that the sampling matrix of the complete system is always well-formed, enabling robust and high-resolution image reconstruction. We show that simply changing the pixel aspect ratio from square to anamorphic is sufficient to achieve that goal, as long as each camera has a unique aspect ratio. We support this claim with theoretical analysis and image reconstruction of real images. We derive the optimal aspect ratios for sets of 2 or 4 cameras. Finally, we verify our solution with a camera system using an anamorphic lens.

Tracking individual membrane proteins and their biochemistry: The power of direct observation

The advent of single molecule fluorescence microscopy has allowed experimental molecular biophysics and biochemistry to transcend traditional ensemble measurements, where the behavior of individual proteins could not be precisely sampled. The recent explosion in popularity of new super-resolution and super-localization techniques coupled with technical advances in optical designs and fast highly sensitive cameras with single photon sensitivity and millisecond time resolution have made it possible to track key motions, reactions, and interactions of individual proteins with high temporal resolution and spatial resolution well beyond the diffraction limit. Within the purview of membrane proteins and ligand gated ion channels (LGICs), these outstanding advances in single molecule microscopy allow for the direct observation of discrete biochemical states and their fluctuation dynamics. Such observations are fundamentally important for understanding molecular-level mechanisms governing these systems. Examples reviewed here include the effects of allostery on the stoichiometry of ligand binding in the presence of fluorescent ligands; the observation of subdomain partitioning of membrane proteins due to microenvironment effects; and the use of single particle tracking experiments to elucidate characteristics of membrane protein diffusion and the direct measurement of thermodynamic properties, which govern the free energy landscape of protein dimerization. The review of such characteristic topics represents a snapshot of efforts to push the boundaries of fluorescence microscopy of membrane proteins to the absolute limit.

3D documentation and visualization of external injury findings by integration of simple photography in CT/MRI data sets (IprojeCT).

This study evaluated the feasibility of documenting patterned injury using three dimensions and true colour photography without complex 3D surface documentation methods. This method is based on a generated 3D surface model using radiologic slice images (CT) while the colour information is derived from photographs taken with commercially available cameras. The external patterned injuries were documented in 16 cases using digital photography as well as highly precise photogrammetry-supported 3D structured light scanning. The internal findings of these deceased were recorded using CT and MRI. For registration of the internal with the external data, two different types of radiographic markers were used and compared. The 3D surface model generated from CT slice images was linked with the photographs, and thereby digital true-colour 3D models of the patterned injuries could be created (Image projection onto CT/IprojeCT). In addition, these external models were merged with the models of the somatic interior. We demonstrated that 3D documentation and visualization of external injury findings by integration of digital photography in CT/MRI data sets is suitable for the 3D documentation of individual patterned injuries to a body. Nevertheless, this documentation method is not a substitution for photogrammetry and surface scanning, especially when the entire bodily surface is to be recorded in three dimensions including all external findings, and when precise data is required for comparing highly detailed injury features with the injury-inflicting tool.

The Kosice meteorite fall: Recovery and strewn field

We provide the circumstances and details of the fireball observation, search expeditions, recovery, strewn field, and physical characteristics of the Kosice meteorite that fell in Slovakia on February 28, 2010. The meteorite was only the 15th case of an observed bolide with a recovered mass and subsequent orbit determination. Despite multiple eyewitness reports of the bolide, only three videos from security cameras in Hungary were used for the strewn field determination and orbit computation. Multiple expeditions of professionals and individual searchers found 218 fragments with total weight of 11.3 kg. The strewn field with the size of 593 km is characterized with respect to the space distribution of the fragments, their mass and size-frequency distribution. This work describes a catalog of 78 fragments, mass, size, volume, fusion crust, names of discoverers, geographic location, and time of discovery, which represents the most complex study of a fresh meteorite fall. From the analytical results, we classified the Kosice meteorite as an ordinary H5 chondrite.

Tomographic PIV behind a prosthetic heart valve

The instantaneous three-dimensional velocity field past a bioprosthetic heart valve was measured using tomographic particle image velocimetry (PIV). Two digital cameras were used together with a mirror setup to record PIV images from four different angles. Measurements were conducted in a transparent silicone phantom with a simplified geometry of the aortic root. The refraction indices of the silicone phantom and the working fluid were matched to minimize optical distortion from the flow field to the cameras. The silicone phantom of the aorta was integrated in a flow loop driven by a piston pump. Measurements were conducted for steady and pulsatile flow conditions. Results of the instantaneous, ensemble and phase averaged flow field are presented. The three-dimensional velocity field reveals a flow topology, which can be related to features of the aortic valve prosthesis.

Temporal morphological changes in the Imhotep region of comet 67P/Churyumov-Gerasimenko

Aims. We report on the first major temporal morphological changes observed on the surface of the nucleus of comet 67P/Churyumov-Gerasimenko in the smooth terrains of the Imhotep region. Methods. We used images of the OSIRIS cameras onboard Rosetta to follow the temporal changes from 24 May 2015 to 11 July 2015. Results. The morphological changes observed on the surface are visible in the form of roundish features that are growing in size from a given location in a preferential direction at a rate of 5.6-8.1 x 10(-5) m s(-1) during the observational period. The location where the changes started and the contours of the expanding features are bluer than the surroundings, which suggests that ices (H2O and/or CO2) are exposed on the surface. However, sublimation of ices alone is not sufficient to explain the observed expanding features. No significant variations in the dust activity pattern are observed during the period of changes.

The SCITEAS experiment: Optical characterizations of sublimating icy planetary analogues

We have designed and built a laboratory facility to investigate the spectro-photometric and morphologic properties of different types of ice-bearing planetary surface analogs and follow their evolution upon exposure to a low pressure and low temperature environment. The results obtained with this experiment are used to verify and improve our interpretations of current optical remote-sensing datasets. They also provide valuable information for the development and operation of future optical instruments. The Simulation Chamber for Imaging the Temporal Evolution of Analogue Samples (SCITEAS) is a small thermal vacuum chamber equipped with a variety of ports and feedthroughs that permit both in-situ and remote characterizations as well as interacting with the sample. A large quartz window located directly above the sample is used to observe its surface from outside with a set of visible and near-infrared cameras. The sample holder can be easily and quickly inserted and removed from the chamber and is compatible with the other measurement facilities of the Laboratory for Outflow Studies of Sublimating Materials (LOSSy) at the University of Bern. We report here on the results of two of the first experiments performed in the SCITEAS chamber. In the first experiment, fine-grained water ice mixed with dark organic and mineral matter was left to sublime in vacuum and at low temperature, simulating the evolution of the surface of a comet nucleus approaching the Sun. We observed and characterized the formation and evolution of a crust of refractory organic and mineral matter at the surface of the sample and linked the evolution of its structure and texture to its spectro-photometric properties. In the second experiment, a frozen soil was prepared by freezing a mixture of smectite mineral and water. The sample was then left to sublime for 6 h to simulate the loss of volatiles from icy soil at high latitudes on Mars. Colour images were produced using the definitions of the filters foreseen for the CaSSIS imager of the Exomars/TGO mission in order to prepare future science operations.

Comet 67P/Churyumov-Gerasimenko: Constraints on its origin from OSIRIS observations

Context. One of the main aims of the ESA Rosetta mission is to study the origin of the solar system by exploring comet 67P/Churyumov-Gerasimenko at close range. Aims. In this paper we discuss the origin and evolution of comet 67P/Churyumov-Gerasimenko in relation to that of comets in general and in the framework of current solar system formation models. Methods. We use data from the OSIRIS scientific cameras as basic constraints. In particular, we discuss the overall bi-lobate shape and the presence of key geological features, such as layers and fractures. We also treat the problem of collisional evolution of comet nuclei by a particle-in-a-box calculation for an estimate of the probability of survival for 67P/Churyumov-Gerasimenko during the early epochs of the solar system. Results. We argue that the two lobes of the 67P/Churyumov-Gerasimenko nucleus are derived from two distinct objects that have formed a contact binary via a gentle merger. The lobes are separate bodies, though sufficiently similar to have formed in the same environment. An estimate of the collisional rate in the primordial, trans-planetary disk shows that most comets of similar size to 67P/Churyumov-Gerasimenko are likely collisional fragments, although survival of primordial planetesimals cannot be excluded. Conclusions. A collisional origin of the contact binary is suggested, and the low bulk density of the aggregate and abundance of volatile species show that a very gentle merger must have occurred. We thus consider two main scenarios: the primordial accretion of planetesimals, and the re-accretion of fragments after an energetic impact onto a larger parent body. We point to the primordial signatures exhibited by 67P/Churyumov-Gerasimenko and other comet nuclei as critical tests of the collisional evolution.

Rotating dust particles in the coma of comet 67P/Churyumov-Gerasimenko

Context. During September and October 2014, the OSIRIS cameras onboard the ESA Rosetta mission detected millions of single particles. Many of these dust particles appear as long tracks (due to both the dust proper motion and the spacecraft motion during the exposure time) with a clear brightness periodicity. Aims. We interpret the observed periodic features as a rotational and translational motion of aspherical dust grains. Methods. By counting the peaks of each track, we obtained statistics of a rotation frequency. We compared these results with the rotational frequency predicted by a model of aspherical dust grain dynamics in a model gas flow. By testing many possible sets of physical conditions and grain characteristics, we constrained the rotational properties of dust grains. Results. We analyzed on the motion of rotating aspherical dust grains with different cross sections in flow conditions corresponding to the coma of 67P/Churyumov-Gerasimenko qualitatively and quantitatively. Based on the OSIRIS observations, we constrain the possible physical parameters of the grains.