Design of multimedia surveillance systems

This article addresses the problem of how to select the optimal combination of sensors and how to determine their optimal placement in a surveillance region in order to meet the given performance requirements at a minimal cost for a multimedia surveillance system. We propose to solve this problem by obtaining a performance vector, with its elements representing the performances of subtasks, for a given input combination of sensors and their placement. Then we show that the optimal sensor selection problem can be converted into the form of Integer Linear Programming problem (ILP) by using a linear model for computing the optimal performance vector corresponding to a sensor combination. Optimal performance vector corresponding to a sensor combination refers to the performance vector corresponding to the optimal placement of a sensor combination. To demonstrate the utility of our technique, we design and build a surveillance system consisting of PTZ (Pan-Tilt-Zoom) cameras and active motion sensors for capturing faces. Finally, we show experimentally that optimal placement of sensors based on the design maximizes the system performance.

Who really ate the fruit? A novel approach to camera trapping for quantifying frugivory by ruminants

Tropical forest ruminants disperse several plants; yet, their effectiveness as seed dispersers is not systematically quantified. Information on frequency and extent of frugivory by ruminants is lacking. Techniques such as tree watches or fruit traps adapted from avian frugivore studies are not suitable to study terrestrial frugivores, and conventional camera traps provide little quantitative information. We used a novel time-delay camera-trap technique to assess the effectiveness of ruminants as seed dispersers for Phyllanthus emblica at Mudumalai, southern India. After being triggered by animal movement, cameras were programmed to take pictures every 2 min for the next 6 min, yielding a sequence of four pictures. Actual frugivores were differentiated from mere visitors, who did not consume fruit, by comparing the number of fruit remaining across the time-delay photograph sequence. During a 2-year study using this technique, we found that six terrestrial mammals consumed fallen P. emblica fruit. Additionally, seven mammals and one bird species visited fruiting trees but did not consume fallen fruit. Two ruminants, the Indian chevrotain Moschiola indica and chital Axis axis, were P. emblica's most frequent frugivores and they accounted for over 95% of fruit removal, while murid rodents accounted for less than 1%. Plants like P. emblica that are dispersed mainly by large mammalian frugivores are likely to have limited ability to migrate across fragmented landscapes in response to rapidly changing climates. We hope that more quantitative information on ruminant frugivory will become available with a wider application of our time-delay camera-trap technique.

Spectroscopic Observation of Oscillations in the Corona During the Total Solar Eclipse of 22 July 2009

We performed high resolution spectroscopy of the solar corona during the total solar eclipse of 22 July 2009 in two emission lines: the green line at 5303 due to Fe xiv and the red line at 6374 due to Fe x, simultaneously from Anji (latitude 30A degrees 28.1' N; longitude 119A degrees 35.4' E; elevation 890 m), China. A two-mirror coelostat with 100 cm focal length lens produced a 9.2 mm image of the Sun. The spectrograph using 140 cm focal length lens in Littrow mode and a grating with 600 lines per millimeter blazed at 2 mu m provided a dispersion of 30 m and 43 m per pixel in the fourth order around the green line and third order around the red line, respectively. Two Peltier cooled 1k x 1k CCD cameras, with a pixel size of 13 mu m square and 14-bit readout at 10 MHz operated in frame transfer mode, were used to obtain the time sequence spectra in two emission lines simultaneously. The duration of totality was 341 s, but we could get spectra for 270 s after a trial exposure at an interval of 5 s. We report here on the detection of intensity, velocity, and line width oscillations with periodicity in the range of 25 -50 s. These oscillations can be interpreted in terms of the presence of fast magnetoacoustic waves or torsional Alfv,n waves. The intensity ratios of green to red emission lines indicate the temperature of the corona to be 1.65 MK in the equatorial region and 1.40 MK in the polar region, relatively higher than the expected temperature during the low activity period. The width variation of the emission lines in different coronal structures suggests different physical conditions in different structures.

A Flexure-based Deployable Stereo Vision Mechanism and Temperature and Force Sensors for Laparoscopic Tools

This paper presents concepts, designs, and working prototypes of enhanced laparoscopic surgical tools. The enhancements are in equipping the tool with force and temperature sensing as well as image acquisition for stereo vision. Just as the pupils of our eyes are adequately spaced out and the distance between them is adjustable, two minute cameras mounted on a mechanism in our design can be moved closer or farther apart inside the inflated abdomen during the surgery. The cameras are fitted to a deployable mechanism consisting of flexural joints so that they can be inserted through a small incision and then deployed and moved as needed.A temperature sensor and a force sensor are mounted on either of the gripping faces of the surgical grasping tool to measure the temperature and gripping force, which need to be controlled for safe laparoscopic surgery. The sensors are small enough and hence they do not cause interference during surgery and insertion.Prototyping and working of the enhanced laparoscopic tool are presented with details

Exploring Transfer Learning Approaches for Head Pose Classification from Multi-view Surveillance Images

Head pose classification from surveillance images acquired with distant, large field-of-view cameras is difficult as faces are captured at low-resolution and have a blurred appearance. Domain adaptation approaches are useful for transferring knowledge from the training (source) to the test (target) data when they have different attributes, minimizing target data labeling efforts in the process. This paper examines the use of transfer learning for efficient multi-view head pose classification with minimal target training data under three challenging situations: (i) where the range of head poses in the source and target images is different, (ii) where source images capture a stationary person while target images capture a moving person whose facial appearance varies under motion due to changing perspective, scale and (iii) a combination of (i) and (ii). On the whole, the presented methods represent novel transfer learning solutions employed in the context of multi-view head pose classification. We demonstrate that the proposed solutions considerably outperform the state-of-the-art through extensive experimental validation. Finally, the DPOSE dataset compiled for benchmarking head pose classification performance with moving persons, and to aid behavioral understanding applications is presented in this work.

VIRTUAL VIEW SYNTHESIS BY NON-LOCAL MEANS FILTERING USING TEMPORAL DATA

A novel algorithm for Virtual View Synthesis based on Non-Local Means Filtering is presented in this paper. Apart from using the video frames from the nearby cameras and the corresponding per-pixel depth map, this algorithm also makes use of the previously synthesized frame. Simple and efficient, the algorithm can synthesize video at any given virtual viewpoint at a faster rate. In the process, the quality of the synthesized frame is not compromised. Experimental results prove the above mentioned claim. The subjective and objective quality of the synthesized frames are comparable to the existing algorithms.

Activity Recognition in Egocentric Life-Logging Videos

With the increasing availability of wearable cameras, research on first-person view videos (egocentric videos) has received much attention recently. While some effort has been devoted to collecting various egocentric video datasets, there has not been a focused effort in assembling one that could capture the diversity and complexity of activities related to life-logging, which is expected to be an important application for egocentric videos. In this work, we first conduct a comprehensive survey of existing egocentric video datasets. We observe that existing datasets do not emphasize activities relevant to the life-logging scenario. We build an egocentric video dataset dubbed LENA (Life-logging EgoceNtric Activities) (http://people.sutd.edu.sg/similar to 1000892/dataset) which includes egocentric videos of 13 fine-grained activity categories, recorded under diverse situations and environments using the Google Glass. Activities in LENA can also be grouped into 5 top-level categories to meet various needs and multiple demands for activities analysis research. We evaluate state-of-the-art activity recognition using LENA in detail and also analyze the performance of popular descriptors in egocentric activity recognition.

High-throughput miniaturized microfluidic microscopy with radially parallelized channel geometry

In this article, we present a novel approach to throughput enhancement in miniaturized microfluidic microscopy systems. Using the presented approach, we demonstrate an inexpensive yet high-throughput analytical instrument. Using the high-throughput analytical instrument, we have been able to achieve about 125,880 cells per minute (more than one hundred and twenty five thousand cells per minute), even while employing cost-effective low frame rate cameras (120 fps). The throughput achieved here is a notable progression in the field of diagnostics as it enables rapid quantitative testing and analysis. We demonstrate the applicability of the instrument to point-of-care diagnostics, by performing blood cell counting. We report a comparative analysis between the counts (in cells per mu l) obtained from our instrument, with that of a commercially available hematology analyzer.