Foreground Object Segmentation from Binocular Stereo Video

Moving cameras are needed for a wide range of applications in robotics, vehicle systems, surveillance, etc. However, many foreground object segmentation methods reported in the literature are unsuitable for such settings; these methods assume that the camera is fixed and the background changes slowly, and are inadequate for segmenting objects in video if there is significant motion of the camera or background. To address this shortcoming, a new method for segmenting foreground objects is proposed that utilizes binocular video. The method is demonstrated in the application of tracking and segmenting people in video who are approximately facing the binocular camera rig. Given a stereo image pair, the system first tries to find faces. Starting at each face, the region containing the person is grown by merging regions from an over-segmented color image. The disparity map is used to guide this merging process. The system has been implemented on a consumer-grade PC, and tested on video sequences of people indoors obtained from a moving camera rig. As can be expected, the proposed method works well in situations where other foreground-background segmentation methods typically fail. We believe that this superior performance is partly due to the use of object detection to guide region merging in disparity/color foreground segmentation, and partly due to the use of disparity information available with a binocular rig, in contrast with most previous methods that assumed monocular sequences.

The psychology of immersion and development of a quantitative measure of immersive response in games

This study sets out to investigate the psychology of immersion and the immersive response of individuals in relation to video and computer games. Initially, an exhaustive review of literature is presented, including research into games, player demographics, personality and identity. Play in traditional psychology is also reviewed, as well as previous research into immersion and attempts to define and measure this construct. An online qualitative study was carried out (N=38), and data was analysed using content analysis. A definition of immersion emerged, as well as a classification of two separate types of immersion, namely, vicarious immersion and visceral immersion. A survey study (N=217) verified the discrete nature of these categories and rejected the null hypothesis that there was no difference between individuals' interpretations of vicarious and visceral immersion. The primary aim of this research was to create a quantitative instrument which measures the immersive response as experienced by the player in a single game session. The IMX Questionnaire was developed using data from the initial qualitative study and quantitative survey. Exploratory Factor Analysis was carried out on data from 300 participants for the IMX Version 1, and Confirmatory Factor Analysis was conducted on data from 380 participants on the IMX Version 2. IMX Version 3 was developed from the results of these analyses. This questionnaire was found to have high internal consistency reliability and validity.

Regio- and stereo-selective dioxygenase-catalysed cis-dihydroxylation of fjord-region polycyclic arenes

Bacterial dioxygenase-catalysed cis-dihydroxylation of the tetracyclic arenes benzo[c]phenanthrene 2, and the isosteric compounds benzo[b]naphtho[1,2-d]furan 8, and benzo[b]naphtho[1,2-d]thiophene 9, has been found to occur exclusively at fjord-region bonds. The resulting cis-dihydrodiols 7, 10 and 11 were found to be enantiopure and of similar absolute configuration. cis-Dihydroxylation was also observed in the pseudo-fjord region of the 8,9,10,11-tetrahydro-precursors (12 and 13) of benzo[b]naphtho[1,2-d]furan 8, and benzo[b]naphtho[1,2-d]thiophene 9, to yield the corresponding enantiopure hexahydro cis-diols 14 and 15. A novel tandem cis-dihydroxylation and bis-desaturation of the tetrahydro-substrate, tetrahydrobenzo[b]naphtho[1,2-d]thiophene 13, catalysed by biphenyl dioxygenase, was found to yield the fjord-region cis-dihydrodiol 17 of benzo[b]naphtho[1,2-d]thiophene 9.

Perceiving and acting upon spaces in a VR rugby task: Expertise effects in affordance detection and task achievement

This study used a virtual simulated 3vs3 rugby task to investigate whether gaps opening in particular running channels promote different actions by the ball-carrier player and whether an effect of rugby expertise is verified. We manipulated emergent gaps in three different locations: gap1 in the participant’s own running channel, gap 2 in the 1st receiver's running channel, and gap3 in the 2nd receiver's running channel. Recreational, intermediate, professional and non-rugby players performed the task. They could i) run with the ball, ii) make a short pass, or iii) make a long pass. All actions were digitally recorded. Results revealed that the emergence of gaps in the defensive line with respect to the participant’s own position significantly influenced action selection. Namely, ‘run’ was most often the action performed in gap 1, ‘short pass’ in gap 2, and ‘long pass’ in gap 3 trials. Furthermore, a strong positive relationship between expertise and task achievement was found.

Bioinformatics inspired algorithm for stereo correspondence

In this paper, we exploit the analogy between protein sequence alignment and image pair correspondence to design a bioinformatics-inspired framework for stereo matching based on dynamic programming. This approach also led to the creation of a meaningfulness graph, which helps to predict matching validity according to image overlap and pixel similarity. Finally, we propose an automatic procedure to estimate automatically all matching parameters. This work is evaluated qualitatively and quantitatively using a standard benchmarking dataset and by conducting stereo matching experiments between images captured at different resolutions. Results confirm the validity of the computer vision/bioinformatics analogy to develop a versatile and accurate low complexity stereo matching algorithm.

An optimized stereo vision implementation for embedded systems: application to RGB and Infra-Red images

The aim of this paper is to demonstrate the applicability and the effectiveness of a computationally demanding stereo matching algorithm in different lowcost and low-complexity embedded devices, by focusing on the analysis of timing and image quality performances. Various optimizations have been implemented to allow its deployment on specific hardware architectures while decreasing memory and processing time requirements: (1) reduction of color channel information and resolution for input images, (2) low-level software optimizations such as parallel computation, replacement of function calls or loop unrolling, (3) reduction of redundant data structures and internal data representation. The feasibility of a stereovision system on a low cost platform is evaluated by using standard datasets and images taken from Infra-Red (IR) cameras. Analysis of the resulting disparity map accuracy with respect to a full-size dataset is performed as well as the testing of suboptimal solutions

Reactions of nitrogen nucleophiles with enantiopure cyclohexenyl electrophiles:a stereo- and regio- selective study

The reactions of enantiopure cyclohexene epoxides and trans-1,2-bromoacetates, derived from the corresponding substituted benzene cis-dihydrodiol metabolites, with nitrogen nucleophiles, were examined and possible mechanisms proposed. An initial objective was the synthesis of new 1,2-aminoalcohol enantiomers as potential chiral ligands and synthetic scaffolds for library generation. These apparently simple substitution reactions proved to be more complex than initially anticipated and were found to involve a combination of different reaction mechanisms. Allylic trans-1,2-azidohydrins were prepared by Lewis acid-catalysed ring-opening of cyclic vinyl epoxides with sodium azide via an S(N)2 mechanism. On heating, these trans-1,2-azidohydrins isomerized to the corresponding trans-1,4-azidohydrins via a suprafacial allyl azide [3,3]-sigmatropic rearrangement mechanism. Conversion of a 1,2-azidohydrin to a 1,2-azidoacetate moved the equilibrium position in favour of the 1,4-substitution product. Allylic trans-1,2-bromoacetates reacted with sodium azide at room temperature to give C-2 and C-4 substituted products. A clean inversion of configuration at C-2 was found, as expected, from a concerted S(N)2-pathway. However, substitution at C-4 was not stereoselective and resulted in mixtures of 1,4-cis and 1,4-trans products. This observation can be rationalized in terms of competitive S(N)2 and S(N)2 reactions allied to a [3,3]-sigmatropic rearrangement. cis-1,2-Azidohydrins and cis-1,2-azidoacetates were much more prone to rearrange than the corresponding trans-isomers. Reaction of the softer tosamide nucleophile with trans-1,2-bromoacetates resulted, predominantly, in C-4 substitution via a syn-S(N)2 mechanism. One application of the reaction of secondary amines with allylic cyclohexene epoxides, to give trans-1,2-aminoalcohols, is in the synthesis of the anticholinergic drug vesamicol, via an S(N)2 mechanism. Copyright (c) 2013 John Wiley & Sons, Ltd.