Automatic and adaptable registration of live RGBD video streams sharing partially overlapping views

In this thesis, we introduce DeReEs-4v, an algorithm for unsupervised and automatic registration of two video frames captured depth-sensing cameras. DeReEs-4V receives two RGBD video streams from two depth-sensing cameras arbitrary located in an indoor space that share a minimum amount of 25% overlap between their captured scenes. The motivation of this research is to employ multiple depth-sensing cameras to enlarge the field of view and acquire a more complete and accurate 3D information of the environment. A typical way to combine multiple views from different cameras is through manual calibration. However, this process is time-consuming and may require some technical knowledge. Moreover, calibration has to be repeated when the location or position of the cameras change. In this research, we demonstrate how DeReEs-4V registration can be used to find the transformation of the view of one camera with respect to the other at interactive rates. Our algorithm automatically finds the 3D transformation to match the views from two cameras, requires no human interference, and is robust to camera movements while capturing. To validate this approach, a thorough examination of the system performance under different scenarios is presented. The system presented here supports any application that might benefit from the wider field-of-view provided by the combined scene from both cameras, including applications in 3D telepresence, gaming, people tracking, videoconferencing and computer vision.

Sea-floor images during POLARSTERN cruise ANT-XIII/3 to the Weddell Sea, Antarctica

Transects of a Remotely Operated Vehicle (ROV) providing sea-bed videos and photographs were carried out during POLARSTERN expedition ANT-XIII/3 focussing on the ecology of benthic assemblages on the Antarctic shelf in the South-Eastern Weddell Sea. The ROV-system sprint 103 was equiped with two video- and one still camera, lights, flash-lights, compass, and parallel lasers providing a scale in the images, a tether-management system (TMS), a winch, and the board units. All cameras used the same main lense and could be tilted. Videos were recorded in Betacam-format and (film-)slides were made by decision of the scientific pilot. The latter were mainly made under the aspect to improve the identification of organisms depicted in the videos because the still photographs have a much higher optical resolution than the videos. In the photographs species larger than 3 mm, in the videos larger than 1 cm are recognisable and countable. Under optimum conditions the transects were strait; the speed and direction of the ROV were determined by the drift of the ship in the coastal current, since both, the ship and the ROV were used as a drifting system; the option to operate the vehicle actively was only used to avoide obstacles and to reach at best a distance of only approximately 30 cm to the sea-floor. As a consequence the width of the photographs in the foreground is approximately 50 cm. Deviations from this strategy resulted mainly from difficult ice- and weather conditions but also from high current velocity and local up-welling close to the sea-bed. The sea-bed images provide insights into the general composition of key species, higher systematic groups and ecological guilds. Within interdisciplinary approaches distributions of assemblages can be attributed to environmental conditions such as bathymetry, sediment characteristics, water masses and current regimes. The images also contain valuable information on how benthic species are associated to each other. Along the transects, small- to intermediate-scaled disturbances, e.g. by grounding icebergs were analysed and further impact to the entire benthic system by local succession of recolonisation was studied. This information can be used for models predicting the impact of climate change to benthic life in the Southern Ocean. All these approaches contribute to a better understanding of the fiunctioning of the benthic system and related components of the entire Antarctic marine ecosystem. Despite their scientific value the imaging methods meet concerns about the protection of sensitive Antarctic benthic systems since they are non-invasive and they also provide valuable material for education and outreach purposes.

Sea-floor images from ROV transects during POLARSTERN cruise ANT-XVII/3 (EASIZ III) to the Weddell Sea, Antarctica

Transects of a Remotely Operated Vehicle (ROV) providing sea-bed videos and photographs were carried out during POLARSTERN expedition ANT-XVII/3 focussing on the ecology of benthic assemblages on the Antarctic shelf in the South-Eastern Weddell Sea. The ROV-system sprint 103 was equiped with two video- and one still camera, lights, flash-lights, compass, and parallel lasers providing a scale in the images, a tether-management system (TMS), a winch, and the board units. All cameras used the same main lense and could be tilted. Videos were recorded in Betacam-format and (film-)slides were made by decision of the scientific pilot. The latter were mainly made under the aspect to improve the identification of organisms depicted in the videos because the still photographs have a much higher optical resolution than the videos. In the photographs species larger than 3 mm, in the videos larger than 1 cm are recognisable and countable. Under optimum conditions the transects were strait; the speed and direction of the ROV were determined by the drift of the ship in the coastal current, since both, the ship and the ROV were used as a drifting system; the option to operate the vehicle actively was only used to avoide obstacles and to reach at best a distance of only approximately 30 cm to the sea-floor. As a consequence the width of the photographs in the foreground is approximately 50 cm. Deviations from this strategy resulted mainly from difficult ice- and weather conditions but also from high current velocity and local up-welling close to the sea-bed. The sea-bed images provide insights into the general composition of key species, higher systematic groups and ecological guilds. Within interdisciplinary approaches distributions of assemblages can be attributed to environmental conditions such as bathymetry, sediment characteristics, water masses and current regimes. The images also contain valuable information on how benthic species are associated to each other. Along the transects, small- to intermediate-scaled disturbances, e.g. by grounding icebergs were analysed and further impact to the entire benthic system by local succession of recolonisation was studied. This information can be used for models predicting the impact of climate change to benthic life in the Southern Ocean. All these approaches contribute to a better understanding of the fiunctioning of the benthic system and related components of the entire Antarctic marine ecosystem. Despite their scientific value the imaging methods meet concerns about the protection of sensitive Antarctic benthic systems since they are non-invasive and they also provide valuable material for education and outreach purposes.

Seabed photographs taken along OFOS profiles during POLARSTERN cruise PS96 (ANT-XXXI/2 FROSN)

Within the context of the overall ecological working programme Dynamics of Antarctic Marine Shelf Ecosystems (DynAMo) of the PS96 (ANT-XXXI/2) cruise of RV "Polarstern" to the Weddell Sea (Dec 2015 to Feb 2016), seabed imaging surveys were carried out along drift profiles by means of the Ocean Floor Observation System (OFOS) of the Alfred Wegener Institute, Helmholtz Centre for Polar and Marine Research (AWI) Bremerhaven. The setup and mode of deployment of the OFOS was similar to that described by Bergmann and Klages (2012, doi:10.1016/j.marpolbul.2012.09.018). OFOS is a surface-powered gear equipped with two downward-looking cameras installed side-by-side: one high-resolution, wide-angle still camera (CANON® EOS 5D Mark III; lens: Canon EF 24 f/1.4L II, f stop: 13, exposure time: 1/125 sec; in-air view angles: 74° (horizontal), 53° (vertical), 84° (diagonal); image size: 5760 x 3840 px = 21 MPix; front of pressure resistant camera housing consisting of plexiglass dome port) and one high-definition color video camera (SONY® FCB-H11). The system was vertically lowered over the stern of the ship with a broadband fibre-optic cable, until it hovers approximately 1.5 m above the seabed. It was then towed after the slowly sailing ship at a speed of approximately 0.5 kn (0.25 m/s). The ship's Global Acoustic Positioning System (GAPS), combining Ultra Short Base Line (USBL), Inertial Navigation System (INS) and satellite-based Global Positioning System (GPS) technologies, was used to gain highly precise underwater position data of the OFOS. During the profile, OFOS was kept hanging at the preferred height above the seafloor by means of the live video feed and occasional minor cable-length adjustments with the winch to compensate small-scale bathymetric variations in seabed morphology. Information on water depth and height above the seafloor were continuously recorded by means of OFOS-mounted sensors (GAPS transponder, Tritech altimeter). Three lasers, which are placed beside the still camera, emit parallel beams and project red light points, arranged as an equilateral triangle with a side length of 50 cm, in each photo, thus providing a scale that can be used to calculate the seabed area depicted in each image and/or measure the size of organisms or seabed features visible in the image. In addition, the seabed area depicted was estimated using altimeter-derived height above seafloor and optical characteristics of the OFOS still camera. In automatic mode, a seabed photo, depicting an area of approximately 3.45 m**2 (= 2.3 m x 1.5 m; with variations depending on the actual height above ground), was taken every 30 seconds to obtain series of "TIMER" stills distributed at regular distances along the profiles that vary in length depending on duration of the cast. At a ship speed of 0.5 kn, the average distance between seabed images was approximately 5 m. Additional "HOTKEY" photos were taken from interesting objects (organisms, seabed features, such as putative iceberg scours) when they appeared in the live video feed (which was also recorded, in addition to the stills, for documentation and possible later analysis). If any image from this collection is used, please cite the reference as given above.

Dual self-image technique for beam collimation

We propose an accurate technique for obtaining highly collimated beams, which also allows testing the collimation degree of a beam. It is based on comparing the period of two different self-images produced by a single diffraction grating. In this way, variations in the period of the diffraction grating do not affect to the measuring procedure. Self-images are acquired by two CMOS cameras and their periods are determined by fitting the variogram function of the self-images to a cosine function with polynomial envelopes. This way, loss of accuracy caused by imperfections of the measured self-images is avoided. As usual, collimation is obtained by displacing the collimation element with respect to the source along the optical axis. When the period of both self-images coincides, collimation is achieved. With this method neither a strict control of the period of the diffraction grating nor a transverse displacement, required in other techniques, are necessary. As an example, a LED considering paraxial approximation and point source illumination is collimated resulting a resolution in the divergence of the beam of σ φ = ± μrad.

Camerawoman at NOW conference, Philadelphia

General note: Title and date provided by Bettye Lane.

March for NOW conference in Philadelphia

General note: Title and date provided by Bettye Lane.

72-year-old freelance photojournalist from Kansas City Lottie Jacoby at the Democratic National Convention

General note: Title and date provided by Bettye Lane.

News film crew at NOW conference, Houston

General note: Title and date provided by Bettye Lane.

A camerawoman at NOW conference, Houston

General note: Title and date provided by Bettye Lane.

TV camerawoman at Anti-Castro demonstration

General note: Title and date provided by Bettye Lane.

TV studio trainee for Channel 5

General note: Title and date provided by Bettye Lane.

Japanese camerawoman at Christopher Street march

General note: Title and date provided by Bettye Lane.

Camera woman and sound technician at NOW conference in Houston

General note: Title and date provided by Bettye Lane.

Alicia Weber NBC-TV camerawoman

General note: Title and date provided by Bettye Lane.