Benchmark datasets for detection and tracking

There is a rising demand for the quantitative performance evaluation of automated video surveillance. To advance research in this area, it is essential that comparisons in detection and tracking approaches may be drawn and improvements in existing methods can be measured. There are a number of challenges related to the proper evaluation of motion segmentation, tracking, event recognition, and other components of a video surveillance system that are unique to the video surveillance community. These include the volume of data that must be evaluated, the difficulty in obtaining ground truth data, the definition of appropriate metrics, and achieving meaningful comparison of diverse systems. This chapter provides descriptions of useful benchmark datasets and their availability to the computer vision community. It outlines some ground truth and evaluation techniques, and provides links to useful resources. It concludes by discussing the future direction for benchmark datasets and their associated processes.

Beyond words: Visual metaphors that can demonstrate comprehension of KM as a paradoxical activity system

Following criticism that, in business and management, metaphor is largely verbal and primarily used to convey similarity, this paper explores how visual metaphors can communicate the anomalous and the paradoxical aspects of KM more concisely than words, whilst simultaneously presenting more tacit associations to stimulate creative thinking. It considers a series of 30 assessed posters that aimed to re-present six basic KM paradoxes through imagery that captures both the analogous and the anomalous. We found six categories of radial metaphors able to convey paradoxical complexity in a concise way. This has implications for organizations thinking about how to engage people with both the familiar and the strange. Copyright © 2011 John Wiley & Sons, Ltd.

Human red blood cells at work: identification and visualization of erythrocytic eNOS activity in health and disease

A nitric oxide synthase (NOS)-like activity has been demonstrated in human red blood cells (RBCs), but doubts about its functional significance, isoform identity and disease relevance remain. Using flow cytometry in combination with the NO-imaging probe DAF-FM we find that all blood cells form NO intracellularly, with a rank order of monocytes > neutrophils > lymphocytes > RBCs > platelets. The observation of a NO-related fluorescence within RBCs was unexpected given the abundance of the NO-scavenger oxyhemoglobin. Constitutive normoxic NO formation was abolished by NOS inhibition and intracellular NO scavenging, confirmed by laser-scanning microscopy and unequivocally validated by detection of the DAF-FM reaction product with NO using HPLC and LC-MS/MS. Employing immunoprecipitation, ESI-MS/MS-based peptide sequencing and enzymatic assay we further demonstrate that human RBCs contain an endothelial NOS (eNOS) that converts L-3H-Arginine to L-3H-Citrulline in a Ca2+/Calmodulin-dependent fashion. Moreover, in patients with coronary artery disease, red cell eNOS expression and activity are both lower than in age-matched healthy individuals and correlate with the degree of endothelial dysfunction. Thus, human RBCs constitutively produce NO under normoxic conditions via an active eNOS isoform the activity of which is compromised in patients with coronary artery disease.

Localization of calcitonin receptor-like receptor (CLR) and receptor activity-modifying protein 1 (RAMP1) in human gastrointestinal tract

Calcitonin gene-related peptide (CGRP) exerts its diverse effects on vasodilation, nociception, secretion, and motor function through a heterodimeric receptor comprising of calcitonin receptor-like receptor (CLR) and receptor activity-modifying protein 1 (RAMP1). Despite the importance of CLR.RAMP1 in human disease, little is known about its distribution in the human gastrointestinal (GI) tract, where it participates in inflammation and pain. In this study, we determined that CLR and RAMP1 mRNAs are expressed in normal human stomach, ileum and colon by RT-PCR. We next characterized antibodies that we generated to rat CLR and RAMP1 in transfected HEK cells. Having characterized these antibodies in vitro, we then localized CLR-, RAMP1-, CGRP- and intermedin-immunoreactivity (IMD-IR) in various human GI segments. In the stomach, nerve bundles in the myenteric plexus and nerve fibers throughout the circular and longitudinal muscle had prominent CLR-IR. In the proximal colon and ileum, CLR was found in nerve varicosities of the myenteric plexus and surrounding submucosal neurons. Interestingly, CGRP expressing fibers did not co-localize, but were in close proximity to CLR. However, CLR and RAMP1, the two subunits of a functional CGRP receptor were clearly localized in myenteric plexus, where they may form functional cell-surface receptors. IMD, another member of calcitonin peptide family was also found in close proximity to CLR, and like CGRP, did not co-localize with either CLR or RAMP1 receptors. Thus, CGRP and IMD appear to be released locally, where they can mediate their effect on their receptors regulating diverse functions such as inflammation, pain and motility.

In vitro fermentation of potential prebiotic flours from natural sources: impact on the human colonic microbiota and metabolome

Scope: Fibers and prebiotics represent a useful dietary approach for modulating the human gut microbiome. Therefore, aim of the present study was to investigate the impact of four flours (wholegrain rye, wholegrain wheat, chickpeas and lentils 50:50, and barley milled grains), characterized by a naturally high content in dietary fibers, on the intestinal microbiota composition and metabolomic output. Methods and results: A validated three-stage continuous fermentative system simulating the human colon was used to resemble the complexity and diversity of the intestinal microbiota. Fluorescence in situ hybridization was used to evaluate the impact of the flours on the composition of the microbiota, while small-molecule metabolome was assessed by NMR analysis followed by multivariate pattern recognition techniques. HT29 cell-growth curve assay was used to evaluate the modulatory properties of the bacterial metabolites on the growth of intestinal epithelial cells. All the four flours showed positive modulations of the microbiota composition and metabolic activity. Furthermore, none of the flours influenced the growth-modulatory potential of the metabolites toward HT29 cells. Conclusion: Our findings support the utilization of the tested ingredients in the development of a variety of potentially prebiotic food products aimed at improving gastrointestinal health.

Intermittently-visual tracking experiments reveal the roles of error-correction and predictive mechanisms in the human visual-motor control system

Prediction mechanism is necessary for human visual motion to compensate a delay of sensory-motor system. In a previous study, “proactive control” was discussed as one example of predictive function of human beings, in which motion of hands preceded the virtual moving target in visual tracking experiments. To study the roles of the positional-error correction mechanism and the prediction mechanism, we carried out an intermittently-visual tracking experiment where a circular orbit is segmented into the target-visible regions and the target-invisible regions. Main results found in this research were following. A rhythmic component appeared in the tracer velocity when the target velocity was relatively high. The period of the rhythm in the brain obtained from environmental stimuli is shortened more than 10%. The shortening of the period of rhythm in the brain accelerates the hand motion as soon as the visual information is cut-off, and causes the precedence of hand motion to the target motion. Although the precedence of the hand in the blind region is reset by the environmental information when the target enters the visible region, the hand motion precedes the target in average when the predictive mechanism dominates the error-corrective mechanism.

Associating spontaneous with evoked activity in a neural mass model of cat visual cortex

Spontaneous activity of the brain at rest frequently has been considered a mere backdrop to the salient activity evoked by external stimuli or tasks. However, the resting state of the brain consumes most of its energy budget, which suggests a far more important role. An intriguing hint comes from experimental observations of spontaneous activity patterns, which closely resemble those evoked by visual stimulation with oriented gratings, except that cortex appeared to cycle between different orientation maps. Moreover, patterns similar to those evoked by the behaviorally most relevant horizontal and vertical orientations occurred more often than those corresponding to oblique angles. We hypothesize that this kind of spontaneous activity develops at least to some degree autonomously, providing a dynamical reservoir of cortical states, which are then associated with visual stimuli through learning. To test this hypothesis, we use a biologically inspired neural mass model to simulate a patch of cat visual cortex. Spontaneous transitions between orientation states were induced by modest modifications of the neural connectivity, establishing a stable heteroclinic channel. Significantly, the experimentally observed greater frequency of states representing the behaviorally important horizontal and vertical orientations emerged spontaneously from these simulations. We then applied bar-shaped inputs to the model cortex and used Hebbian learning rules to modify the corresponding synaptic strengths. After unsupervised learning, different bar inputs reliably and exclusively evoked their associated orientation state; whereas in the absence of input, the model cortex resumed its spontaneous cycling. We conclude that the experimentally observed similarities between spontaneous and evoked activity in visual cortex can be explained as the outcome of a learning process that associates external stimuli with a preexisting reservoir of autonomous neural activity states. Our findings hence demonstrate how cortical connectivity can link the maintenance of spontaneous activity in the brain mechanistically to its core cognitive functions.

The future of video analytics for surveillance and its ethical implications

The current state of the art and direction of research in computer vision aimed at automating the analysis of CCTV images is presented. This includes low level identification of objects within the field of view of cameras, following those objects over time and between cameras, and the interpretation of those objects’ appearance and movements with respect to models of behaviour (and therefore intentions inferred). The potential ethical problems (and some potential opportunities) such developments may pose if and when deployed in the real world are presented, and suggestions made as to the necessary new regulations which will be needed if such systems are not to further enhance the power of the surveillers against the surveilled.

Video surveillance : past, present, and now the future

Video surveillance is a part of our daily life, even though we may not necessarily realize it. We might be monitored on the street, on highways, at ATMs, in public transportation vehicles, inside private and public buildings, in the elevators, in front of our television screens, next to our baby?s cribs, and any spot one can set a camera.

Modelling human visual navigation using multi-view scene reconstruction

It is often assumed that humans generate a 3D reconstruction of the environment, either in egocentric or world-based coordinates, but the steps involved are unknown. Here, we propose two reconstruction-based models, evaluated using data from two tasks in immersive virtual reality. We model the observer’s prediction of landmark location based on standard photogrammetric methods and then combine location predictions to compute likelihood maps of navigation behaviour. In one model, each scene point is treated independently in the reconstruction; in the other, the pertinent variable is the spatial relationship between pairs of points. Participants viewed a simple environment from one location, were transported (virtually) to another part of the scene and were asked to navigate back. Error distributions varied substantially with changes in scene layout; we compared these directly with the likelihood maps to quantify the success of the models. We also measured error distributions when participants manipulated the location of a landmark to match the preceding interval, providing a direct test of the landmark-location stage of the navigation models. Models such as this, which start with scenes and end with a probabilistic prediction of behaviour, are likely to be increasingly useful for understanding 3D vision.

Exposure to parabens at the concentration of maximal proliferative response increases migratory and invasive activity of human breast cancer cells in vitro

Alkyl esters of p–hydroxybenzoic acid (parabens) are widely used as preservatives in personal care products, foods and pharmaceuticals. Their oestrogenic activity, their measurement in human breast tissue and their ability to drive proliferation of oestrogen-responsive human breast cancer cells has opened a debate on their potential to influence breast cancer development. Since proliferation is not the only hallmark of cancer cells, we have investigated the effects of exposure to parabens at concentrations of maximal proliferative response on migratory and invasive properties using three oestrogen-responsive human breast cancer cell lines (MCF-7, T-47-D, ZR-75-1). Cells were maintained short-term (1 week) or long-term (20±2 weeks) in phenol-red-free medium containing 5% charcoal-stripped serum with no addition, 10-8M 17-oestradiol, 1-5x10-4M methylparaben, 10-5M n-propylparaben or 10-5M n-butylparaben. Long-term exposure (20±2 weeks) of MCF-7 cells to methylparaben, n-propylparaben or n-butylparaben increased migration as measured using a scratch assay, time-lapse microscopy and xCELLigence technology: invasive properties were found to increase in matrix degradation assays and migration through matrigel on xCELLigence. Western immunoblotting showed an associated downregulation of E-cadherin and -catenin in the long-term paraben-exposed cells which could be consistent with a mechanism involving epithelial to mesenchymal transition. Increased migratory activity was demonstrated also in long-term paraben-exposed T-47-D and ZR-75-1 cells using a scratch assay and time-lapse microscopy. This is the first report that in vitro, parabens can influence not only proliferation but also migratory and invasive properties of human breast cancer cells.

Effect of instructive visual stimuli on neurofeedback training for motor imagery-based braincomputer interface

Event-related desynchronization (ERD) of the electroencephalogram (EEG) from the motor cortex is associated with execution, observation, and mental imagery of motor tasks. Generation of ERD by motor imagery (MI) has been widely used for brain-computer interfaces (BCIs) linked to neuroprosthetics and other motor assistance devices. Control of MI-based BCIs can be acquired by neurofeedback training to reliably induce MI-associated ERD. To develop more effective training conditions, we investigated the effect of static and dynamic visual representations of target movements (a picture of forearms or a video clip of hand grasping movements) during the BCI training. After 4 consecutive training days, the group that performed MI while viewing the video showed significant improvement in generating MI-associated ERD compared with the group that viewed the static image. This result suggests that passively observing the target movement during MI would improve the associated mental imagery and enhance MI-based BCIs skills.

An annotation-free method for evaluating privacy protection techniques in videos

While several privacy protection techniques are pre- sented in the literature, they are not complemented with an established objective evaluation method for their assess- ment and comparison. This paper proposes an annotation- free evaluation method that assesses the two key aspects of privacy protection that are privacy and utility. Unlike some existing methods, the proposed method does not rely on the use of subjective judgements and does not assume a spe- cific target type in the image data. The privacy aspect is quantified as an appearance similarity and the utility aspect is measured as a structural similarity between the original raw image data and the privacy-protected image data. We performed an extensive experimentation using six challeng- ing datasets (including two new ones) to demonstrate the effectiveness of the evaluation method by providing a per- formance comparison of four state-of-the-art privacy pro- tection techniques.

Vehicle subtype, make and model classification from side profile video

This paper addresses the challenging domain of vehicle classification from pole-mounted roadway cameras, specifically from side-profile views. A new public vehicle dataset is made available consisting of over 10000 side profile images (86 make/model and 9 sub-type classes). 5 state-of-the-art classifiers are applied to the dataset, with the best achieving high classification rates of 98.7% for sub-type and 99.7- 99.9% for make and model recognition, confirming the assertion made that single vehicle side profile images can be used for robust classification.