Enhancing human action recognition with region proposals

Deep convolutional network models have dominated recent work in human action recognition as well as image classification. However, these methods are often unduly influenced by the image background, learning and exploiting the presence of cues in typical computer vision datasets. For unbiased robotics applications, the degree of variation and novelty in action backgrounds is far greater than in computer vision datasets. To address this challenge, we propose an “action region proposal” method that, informed by optical flow, extracts image regions likely to contain actions for input into the network both during training and testing. In a range of experiments, we demonstrate that manually segmenting the background is not enough; but through active action region proposals during training and testing, state-of-the-art or better performance can be achieved on individual spatial and temporal video components. Finally, we show by focusing attention through action region proposals, we can further improve upon the existing state-of-the-art in spatio-temporally fused action recognition performance.

Feature integration in human vision

The earliest stages of human cortical visual processing can be conceived as extraction of local stimulus features. However, more complex visual functions, such as object recognition, require integration of multiple features. Recently, neural processes underlying feature integration in the visual system have been under intensive study. A specialized mid-level stage preceding the object recognition stage has been proposed to account for the processing of contours, surfaces and shapes as well as configuration. This thesis consists of four experimental, psychophysical studies on human visual feature integration. In two studies, classification image a recently developed psychophysical reverse correlation method was used. In this method visual noise is added to near-threshold stimuli. By investigating the relationship between random features in the noise and observer s perceptual decision in each trial, it is possible to estimate what features of the stimuli are critical for the task. The method allows visualizing the critical features that are used in a psychophysical task directly as a spatial correlation map, yielding an effective "behavioral receptive field". Visual context is known to modulate the perception of stimulus features. Some of these interactions are quite complex, and it is not known whether they reflect early or late stages of perceptual processing. The first study investigated the mechanisms of collinear facilitation, where nearby collinear Gabor flankers increase the detectability of a central Gabor. The behavioral receptive field of the mechanism mediating the detection of the central Gabor stimulus was measured by the classification image method. The results show that collinear flankers increase the extent of the behavioral receptive field for the central Gabor, in the direction of the flankers. The increased sensitivity at the ends of the receptive field suggests a low-level explanation for the facilitation. The second study investigated how visual features are integrated into percepts of surface brightness. A novel variant of the classification image method with brightness matching task was used. Many theories assume that perceived brightness is based on the analysis of luminance border features. Here, for the first time this assumption was directly tested. The classification images show that the perceived brightness of both an illusory Craik-O Brien-Cornsweet stimulus and a real uniform step stimulus depends solely on the border. Moreover, the spatial tuning of the features remains almost constant when the stimulus size is changed, suggesting that brightness perception is based on the output of a single spatial frequency channel. The third and fourth studies investigated global form integration in random-dot Glass patterns. In these patterns, a global form can be immediately perceived, if even a small proportion of random dots are paired to dipoles according to a geometrical rule. In the third study the discrimination of orientation structure in highly coherent concentric and Cartesian (straight) Glass patterns was measured. The results showed that the global form was more efficiently discriminated in concentric patterns. The fourth study investigated how form detectability depends on the global regularity of the Glass pattern. The local structure was either Cartesian or curved. It was shown that randomizing the local orientation deteriorated the performance only with the curved pattern. The results give support for the idea that curved and Cartesian patterns are processed in at least partially separate neural systems.

Alfven surface waves along a cylindrical plasma column surrounded by neutral gas

The dispersion characteristics of Alfven surface waves along a cylindrical plasma column insulated by a neutral gas are discussed. There is no qualitative change in the characteristic curves below the critical magnetic field, given by vA approximately=s, as compared to the propagation of surface waves along the plasma-plasma interface. For magnetic fields above this critical value, there exists a cut-off wave number kc, which depends upon the azimuthal wave number, the radius of the cylinder, the strength of the magnetic field above the critical value and the gas pressure, such that surface waves do not exist for ksurface waves, which exist only in the presence of magnetic fields with a strength greater than the critical value, will therefore have restricted wavelength range 0< lambda < lambda c, when propagating along a cylindrical plasma column.

Studies on friction and formation of transfer layer when Al-4Mg alloy pins slid at various numbers of cycles on steel plates of different surface texture

In the present investigation, various kinds of textures, namely, unidirectional, 8-ground, and random were attained on the die surfaces. Roughness of the textures was varied using different grits of emery papers or polishing powders. Then pins made of Al-4Mg alloys were slid against steel plates at various numbers of cycles, namely 1, 2, 6, 10 and 20 under both dry and lubricated conditions using an inclined pin-on-plate sliding tester. The morphologies of the worn surfaces of the pins and the formation of transfer layer on the counter surfaces were observed using a scanning electron microscope. Surface roughness parameters of the plate were measured using an optical profilometer. It was observed that the coefficient of friction and formation of transfer layer during the first few cycles depend on the die surface textures under both dry and lubricated conditions. It was also observed that under lubricated condition, the coefficient of friction decreases with number of cycles for all kinds of textures. However, under dry condition, it ecreases for unidirectional and 8-ground surfaces while for random surfaces it increases with number of cycles

X-ray photoelectron spectroscopic studies of surface oxidation of metallic glasses

Surface oxidation of the metallic glass Fe40Ni38Mo4B18 has been studied by X-ray photoelectron spectroscopy. The oxidation behaviour of the metallic glass has been compared with a crystallized sample of the same composition. A similar study has been carried out on the metallic glass Ni76Si12B12,which shows the importance of chemical composition in determining the surface oxidation behaviour of these alloys.

A note on the existence of Alfvén surface waves

The Alfvén surface waves can arise due to the discontinuity in the Alfvén speed across the interface along which these waves propagate. This note studies the relationship between v A1 and v A2 which is required for the existence of Alfvén surface waves in low-beta.