Does linear separability really matter? Complex visual search is explained by simple search

Visual search in real life involves complex displays with a target among multiple types of distracters, but in the laboratory, it is often tested using simple displays with identical distracters. Can complex search be understood in terms of simple searches? This link may not be straightforward if complex search has emergent properties. One such property is linear separability, whereby search is hard when a target cannot be separated from its distracters using a single linear boundary. However, evidence in favor of linear separability is based on testing stimulus configurations in an external parametric space that need not be related to their true perceptual representation. We therefore set out to assess whether linear separability influences complex search at all. Our null hypothesis was that complex search performance depends only on classical factors such as target-distracter similarity and distracter homogeneity, which we measured using simple searches. Across three experiments involving a variety of artificial and natural objects, differences between linearly separable and nonseparable searches were explained using target-distracter similarity and distracter heterogeneity. Further, simple searches accurately predicted complex search regardless of linear separability (r = 0.91). Our results show that complex search is explained by simple search, refuting the widely held belief that linear separability influences visual search.

Nestmate discrimination in the social wasp Ropalidia marginata: chemical cues and chemosensory mechanism

Nestmate discrimination plays an important role in preserving the integrity of social insect colonies. It is known to occur in the primitively eusocial wasp Ropalidia marginata in which non-nestmate conspecifics are not allowed to come near a nest. However, newly eclosed females are accepted in foreign colonies, suggesting that such individuals may not express the cues that permit differentiation between nestmates and non-nestmates. As cuticular hydrocarbons (CHCs) have been implicated as chemosensory cues used in nestmate recognition in other species, we investigated, using bioassays and chemical analyses, whether CHCs can play a role in nestmate recognition in R. marginata. We found that individuals can be differentiated according to colony membership using their CHC profiles, suggesting a role of CHCs in nestmate discrimination. Non-nestmate CHCs of adult females received more aggression than nestmate CHCs, thereby showing that CHCs are used as cues for nestmate recognition. Contrarily, and as expected, CHCs of newly eclosed females were not discriminated against when presented to a foreign colony. Behavioural sequence analysis revealed the behavioural mechanism involved in sensing nestmate recognition cues. We also found that newly eclosed females had a different CHC profile from that of adult females, thereby providing an explanation for why young females are accepted in foreign colonies. (C) 2013 The Association for the Study of Animal Behaviour. Published by Elsevier Ltd. All rights reserved.

Features in visual search combine linearly

Single features such as line orientation and length are known to guide visual search, but relatively little is known about how multiple features combine in search. To address this question, we investigated how search for targets differing in multiple features ( intensity, length, orientation) from the distracters is related to searches for targets differing in each of the individual features. We tested race models (based on reaction times) and coactivation models ( based on reciprocal of reaction times) for their ability to predict multiple feature searches. Multiple feature searches were best accounted for by a co-activation model in which feature information combined linearly (r = 0.95). This result agrees with the classic finding that these features are separable i.e., subjective dissimilarity ratings sum linearly. We then replicated the classical finding that the length and width of a rectangle are integral features-in other words, they combine nonlinearly in visual search. However, to our surprise, upon including aspect ratio as an additional feature, length and width combined linearly and this model outperformed all other models. Thus, length and width of a rectangle became separable when considered together with aspect ratio. This finding predicts that searches involving shapes with identical aspect ratio should be more difficult than searches where shapes differ in aspect ratio. We confirmed this prediction on a variety of shapes. We conclude that features in visual search co-activate linearly and demonstrate for the first time that aspect ratio is a novel feature that guides visual search.

Online Estimation of Evolving Human Visual Interest

Regions in video streams attracting human interest contribute significantly to human understanding of the video. Being able to predict salient and informative Regions of Interest (ROIs) through a sequence of eye movements is a challenging problem. Applications such as content-aware retargeting of videos to different aspect ratios while preserving informative regions and smart insertion of dialog (closed-caption text) into the video stream can significantly be improved using the predicted ROIs. We propose an interactive human-in-the-loop framework to model eye movements and predict visual saliency into yet-unseen frames. Eye tracking and video content are used to model visual attention in a manner that accounts for important eye-gaze characteristics such as temporal discontinuities due to sudden eye movements, noise, and behavioral artifacts. A novel statistical-and algorithm-based method gaze buffering is proposed for eye-gaze analysis and its fusion with content-based features. Our robust saliency prediction is instantiated for two challenging and exciting applications. The first application alters video aspect ratios on-the-fly using content-aware video retargeting, thus making them suitable for a variety of display sizes. The second application dynamically localizes active speakers and places dialog captions on-the-fly in the video stream. Our method ensures that dialogs are faithful to active speaker locations and do not interfere with salient content in the video stream. Our framework naturally accommodates personalisation of the application to suit biases and preferences of individual users.

VISUAL OBJECT TRACKING VIA RANDOM FERNS BASED CLASSIFICATION

Designing a robust algorithm for visual object tracking has been a challenging task since many years. There are trackers in the literature that are reasonably accurate for many tracking scenarios but most of them are computationally expensive. This narrows down their applicability as many tracking applications demand real time response. In this paper, we present a tracker based on random ferns. Tracking is posed as a classification problem and classification is done using ferns. We used ferns as they rely on binary features and are extremely fast at both training and classification as compared to other classification algorithms. Our experiments show that the proposed tracker performs well on some of the most challenging tracking datasets and executes much faster than one of the state-of-the-art trackers, without much difference in tracking accuracy.

Males and females of the social wasp Ropalidia marginata do not differ in their cuticular hydrocarbon profiles and do not seem to use any long-distance volatile mate attraction cues

Sex pheromones are vital in communication between individuals belonging to opposite sexes and form an integral part of the reproductive biology of various species. Among insects, sexual dimorphism in CHCs has been reported from diverse taxa spanning seven different orders, and thereby CHCs have been implicated as sex pheromones. Because males and females of the primitively eusocial wasp Ropalidia marginata touch each other with their antennae during mating, before engaging in sperm transfer, a sex pheromone that is perceived via contact chemosensation through the antennae can possibly exist in this species. Since CHCs have been implied as sex pheromones in various insects (including hymenopterans), and since sexual dimorphism of CHCs should be an obligatory prerequisite for them to act as sex pheromones, we investigated whether males and females of R. marginata differ in their CHC profiles. We found only nonvolatile CHCs, and our results show absence of sexual dimorphism in CHCs, suggesting that CHCs do not function as sex pheromone in this species. A behavioral assay failed to show presence of mate attraction at a distance, thereby showing the absence of volatile long-distance mate attraction cues (that may originate from sources other than and in addition to CHCs).

Object attributes combine additively in visual search

We perceive objects as containing a variety of attributes: local features, relations between features, internal details, and global properties. But we know little about how they combine. Here, we report a remarkably simple additive rule that governs how these diverse object attributes combine in vision. The perceived dissimilarity between two objects was accurately explained as a sum of (a) spatially tuned local contour-matching processes modulated by part decomposition; (b) differences in internal details, such as texture; (c) differences in emergent attributes, such as symmetry; and (d) differences in global properties, such as orientation or overall configuration of parts. Our results elucidate an enduring question in object vision by showing that the whole object is not a sum of its parts but a sum of its many attributes.