Automated Placement of Cameras in a Floorplan to Satisfy Task-Specific Constraints

In many multi-camera vision systems the effect of camera locations on the task-specific quality of service is ignored. Researchers in Computational Geometry have proposed elegant solutions for some sensor location problem classes. Unfortunately, these solutions utilize unrealistic assumptions about the cameras' capabilities that make these algorithms unsuitable for many real-world computer vision applications: unlimited field of view, infinite depth of field, and/or infinite servo precision and speed. In this paper, the general camera placement problem is first defined with assumptions that are more consistent with the capabilities of real-world cameras. The region to be observed by cameras may be volumetric, static or dynamic, and may include holes that are caused, for instance, by columns or furniture in a room that can occlude potential camera views. A subclass of this general problem can be formulated in terms of planar regions that are typical of building floorplans. Given a floorplan to be observed, the problem is then to efficiently compute a camera layout such that certain task-specific constraints are met. A solution to this problem is obtained via binary optimization over a discrete problem space. In preliminary experiments the performance of the resulting system is demonstrated with different real floorplans.

Estimating 3D Body Pose Using Uncalibrated Cameras

An approach for estimating 3D body pose from multiple, uncalibrated views is proposed. First, a mapping from image features to 2D body joint locations is computed using a statistical framework that yields a set of several body pose hypotheses. The concept of a "virtual camera" is introduced that makes this mapping invariant to translation, image-plane rotation, and scaling of the input. As a consequence, the calibration matrices (intrinsics) of the virtual cameras can be considered completely known, and their poses are known up to a single angular displacement parameter. Given pose hypotheses obtained in the multiple virtual camera views, the recovery of 3D body pose and camera relative orientations is formulated as a stochastic optimization problem. An Expectation-Maximization algorithm is derived that can obtain the locally most likely (self-consistent) combination of body pose hypotheses. Performance of the approach is evaluated with synthetic sequences as well as real video sequences of human motion.

Real Time Eye Tracking and Blink Detection with USB Cameras

A human-computer interface (HCI) system designed for use by people with severe disabilities is presented. People that are severely paralyzed or afflicted with diseases such as ALS (Lou Gehrig's disease) or multiple sclerosis are unable to move or control any parts of their bodies except for their eyes. The system presented here detects the user's eye blinks and analyzes the pattern and duration of the blinks, using them to provide input to the computer in the form of a mouse click. After the automatic initialization of the system occurs from the processing of the user's involuntary eye blinks in the first few seconds of use, the eye is tracked in real time using correlation with an online template. If the user's depth changes significantly or rapid head movement occurs, the system is automatically reinitialized. There are no lighting requirements nor offline templates needed for the proper functioning of the system. The system works with inexpensive USB cameras and runs at a frame rate of 30 frames per second. Extensive experiments were conducted to determine both the system's accuracy in classifying voluntary and involuntary blinks, as well as the system's fitness in varying environment conditions, such as alternative camera placements and different lighting conditions. These experiments on eight test subjects yielded an overall detection accuracy of 95.3%.

Comparative performance of multiview stereoscopic and mammographic display modalities for breast lesion detection.

PURPOSE: Mammography is known to be one of the most difficult radiographic exams to interpret. Mammography has important limitations, including the superposition of normal tissue that can obscure a mass, chance alignment of normal tissue to mimic a true lesion and the inability to derive volumetric information. It has been shown that stereomammography can overcome these deficiencies by showing that layers of normal tissue lay at different depths. If standard stereomammography (i.e., a single stereoscopic pair consisting of two projection images) can significantly improve lesion detection, how will multiview stereoscopy (MVS), where many projection images are used, compare to mammography? The aim of this study was to assess the relative performance of MVS compared to mammography for breast mass detection. METHODS: The MVS image sets consisted of the 25 raw projection images acquired over an arc of approximately 45 degrees using a Siemens prototype breast tomosynthesis system. The mammograms were acquired using a commercial Siemens FFDM system. The raw data were taken from both of these systems for 27 cases and realistic simulated mass lesions were added to duplicates of the 27 images at the same local contrast. The images with lesions (27 mammography and 27 MVS) and the images without lesions (27 mammography and 27 MVS) were then postprocessed to provide comparable and representative image appearance across the two modalities. All 108 image sets were shown to five full-time breast imaging radiologists in random order on a state-of-the-art stereoscopic display. The observers were asked to give a confidence rating for each image (0 for lesion definitely not present, 100 for lesion definitely present). The ratings were then compiled and processed using ROC and variance analysis. RESULTS: The mean AUC for the five observers was 0.614 +/- 0.055 for mammography and 0.778 +/- 0.052 for multiview stereoscopy. The difference of 0.164 +/- 0.065 was statistically significant with a p-value of 0.0148. CONCLUSIONS: The differences in the AUCs and the p-value suggest that multiview stereoscopy has a statistically significant advantage over mammography in the detection of simulated breast masses. This highlights the dominance of anatomical noise compared to quantum noise for breast mass detection. It also shows that significant lesion detection can be achieved with MVS without any of the artifacts associated with tomosynthesis.

A Bird’s Eye View of Discard Reforms: Bird-Borne Cameras Reveal Seabird/Fishery Interactions

Commercial capture fisheries produce huge quantities of offal, as well as undersized and unwanted catch in the form of discards. Declines in global catches and legislation to ban discarding will significantly reduce discards, but this subsidy supports a large scavenger community. Understanding the potential impact of declining discards for scavengers should feature in an eco-system based approach to fisheries management, but requires greater knowledge of scavenger/fishery interactions. Here we use bird-borne cameras, in tandem with GPS loggers, to provide a unique view of seabird/fishery interactions. 20,643 digital images (one min 21) from ten bird-borne cameras deployed on central place northern gannets Morus bassanus revealed that all birds photographed fishing vessels. These were large (>15 m) boats, with no small-scale vessels. Virtually all vessels were trawlers, and gannets were almost always accompanied by other scavenging birds. All individuals exhibited an Area-Restricted Search (ARS) during foraging, but only 42% of ARS were associated with fishing vessels, indicating much 'natural' foraging. The proportion of ARS behaviours associated with fishing boats were higher for males (81%) than females (30%), although the reasons for this are currently unclear. Our study illustrates that fisheries form a very important component of the prey-landscape for foraging gannets and that a discard ban, such as that proposed under reforms of the EU Common Fisheries Policy, may have a significant impact on gannet behaviour, particularly males. However, a continued reliance on 'natural' foraging suggests the ability to switch away from scavenging, but only if there is sufficient food to meet their needs in the absence of a discard subsidy.

The WASP Project and the SuperWASP Cameras

The SuperWASP cameras are wide-field imaging systems at the Observatorio del Roque de los Muchachos on the island of La Palma in the Canary Islands, and at the Sutherland Station of the South African Astronomical Observatory. Each instrument has a field of view of some 482 deg2 with an angular scale of 13.7" pixel-1, and is capable of delivering photometry with accuracy better than 1% for objects having V~7.0-11.5. Lower quality data for objects brighter than V~15.0 are stored in the project archive. The systems, while designed to monitor fields with high cadence, are capable of surveying the entire visible sky every 40 minutes. Depending on the observational strategy, the data rate can be up to 100 Gbytes per night. We have produced a robust, largely automatic reduction pipeline and advanced archive, which are used to serve the data products to the consortium members. The main science aim of these systems is to search for bright transiting exoplanet systems suitable for spectroscopic follow-up observations. The first 6 month season of SuperWASP-North observations produced light curves of ~6.7 million objects with 12.9 billion data points.

A comparison of real catching with catching using stereoscopic visual displays

To date, the usefulness of stereoscopic visual displays in research on manual interceptive actions has never been examined. In this study, we compared the catching movements of 8 right-handed participants (6 men, 2 women) in a real environment (with suspended balls swinging past the participant, requiring lateral hand movements for interception) with those in a situation in which similar virtual ball trajectories were displayed stereoscopically in a virtual reality system (Cave Automated Virtual Environment [CAVE]; Cruz-Neira, Sandin, DeFranti, Kenyon, & Hart, 1992) with the head fixated. Catching the virtual ball involved grasping a lightweight ball attached to the palm of the hand. The results showed that, compared to real catching, hand movements in the CAVE were (a) initiated later, (b) less accurate, (c) smoother, and (d) aimed more directly at the interception point. Although the latter 3 observations might be attributable to the delayed movement initiation observed in the CAVE, this delayed initiation might have resulted from the use of visual displays. This suggests that stereoscopic visual displays such as present in many virtual reality systems should be used circumspectly in the experimental study of catching and should be used only to address research questions requiring no detailed analysis of the information-based online control of the catching movements.

Clinical agreement among glaucoma experts in the detection of glaucomatous changes of the optic disk using simultaneous stereoscopic photographs

PURPOSE: To evaluate the clinical agreement in the detection of optic disk changes in patients with glaucoma using simultaneous stereophotographs. DESIGN: Masked-observer variability study. METHODS: Ten glaucoma specialists examined pairs of simultaneous stereophotographs of glaucomatous and control optic disks to determine whether there were changes compatible with progression of glaucomatous damage. RESULTS: Intraobserver agreement had a kappa value ranging from 0.55 to 0.78. Interobserver agreement among the glaucoma specialists had a kappa value ranging from 0.34 to 0.68. CONCLUSION: Clinical examination of stereophotographs to detect optic disk changes in glaucoma patients has limitations associated with suboptimal reproducibility. © 2003 by Elsevier Inc. All rights reserved.

Development of high-resolution gamma cameras based on silicon photosensors

The development of a compact gamma camera with high spatial resolution is of great interest in Nuclear Medicine as a means to increase the sensitivity of scintigraphy exams and thus allow the early detection of small tumours. Following the introduction of the wavelength-shifting fibre (WSF) gamma camera by Soares et al. and evolution of photodiodes into highly sensitive silicon photomultipliers (SiPMs), this thesis explores the development of a WSF gamma camera using SiPMs to obtain the position information of scintillation events in a continuous CsI(Na) crystal. The design is highly flexible, allowing the coverage of different areas and the development of compact cameras, with very small dead areas at the edges. After initial studies which confirmed the feasibility of applying SiPMs, a prototype with 5 5 cm2 was assembled and tested at room temperature, in an active field-of-view of 10 10 mm2. Calibration and characterisation of intrinsic properties of this prototype were done using 57Co, while extrinsic measurements were performed using a high-resolution parallel-hole collimator and 99mTc. In addition, a small mouse injected with a radiopharmaceutical was imaged with the developed prototype. Results confirm the great potential of SiPMs when applied in a WSF gamma camera, achieving spatial resolution performance superior to the traditional Anger camera. Furthermore, performance can be improved by an optimisation of experimental conditions, in order to minimise and control the undesirable effects of thermal noise and non-uniformity of response of multiple SiPMs. The development and partial characterisation of a larger SiPM WSF gamma camera with 10 10 cm2 for clinical application are also presented.

Reconstruction of the surface of the Sun from stereoscopic images

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal