Evaluation of a Passive Millimeter Wave (PMMW) imager for wire detection in degraded visual conditions

Ground vehicle tests have been performed to evaluate the performance of a Passive Millimeter Wave (PMMW) imager in reduced visibility conditions and in particular, the ability to detect power lines and cables. A PMMW imager was
compared with Long Wave Infrared (LWIR) and visible imaging cameras. The three sensors were mounted on a Land Rover, together with GPS and digital recording system. All three sensors plus the GPS data were recorded simultaneously in order to provide direct comparisons. The vehicle collected imagery from a number of sites in the vicinity of Malvern, UK, in January, 2008. Imagery was collected both while the vehicle was stationary at specific sites
and while it was moving. Weather conditions during the data collection included clear, drizzle, rain and fog. Imagery was collected during the day, at night, and during dusk/dawn transition periods. The PMMW imager was a prototype which operated at 94 GHz and was based on a conically scanned folded Schmidt camera and the LWIR and visible sensors were commercial off the shelf items.

Virtual Thrower Versus Real Goalkeeper: The Influence of Different Visual Conditions on Performance

In order to use virtual reality as a sport analysis tool, we need to be sure that an immersed athlete reacts realistically in a virtual environment. This has been validated for a real handball goalkeeper facing a virtual thrower. However, we currently ignore which visual variables induce a realistic motor behavior of the immersed handball goalkeeper. In this study, we used virtual reality to dissociate the visual information related to the movements of the player from the visual information related to the trajectory of the ball. Thus, the aim is to evaluate the relative influence of these different visual information sources on the goalkeeper's motor behavior. We tested 10 handball goalkeepers who had to predict the final position of the virtual ball in the goal when facing the following: only the throwing action of the attacking player (TA condition), only the resulting ball trajectory (BA condition), and both the throwing action of the attacking player and the resulting ball trajectory (TB condition). Here we show that performance was better in the BA and TB conditions, but contrary to expectations, performance was substantially worse in the TA condition. A significant effect of ball landing zone does, however, suggest that the relative importance between visual information from the player and the ball depends on the targeted zone in the goal. In some cases, body-based cues embedded in the throwing actions may have a minor influence on the ball trajectory and vice versa. Kinematics analysis was then combined with these results to determine why such differences occur depending on the ball landing zone and consequently how it can clarify the role of different sources of visual information on the motor behavior of an athlete immersed in a virtual environment.

Robust Audio-Visual Speech Recognition under Noisy Audio-Video Conditions

This paper presents the maximum weighted stream posterior (MWSP) model as a robust and efficient stream integration method for audio-visual speech recognition in environments, where the audio or video streams may be subjected to unknown and time-varying corruption. A significant advantage of MWSP is that it does not require any specific measurements of the signal in either stream to calculate appropriate stream weights during recognition, and as such it is modality-independent. This also means that MWSP complements and can be used alongside many of the other approaches that have been proposed in the literature for this problem. For evaluation we used the large XM2VTS database for speaker-independent audio-visual speech recognition. The extensive tests include both clean and corrupted utterances with corruption added in either/both the video and audio streams using a variety of types (e.g., MPEG-4 video compression) and levels of noise. The experiments show that this approach gives excellent performance in comparison to another well-known dynamic stream weighting approach and also compared to any fixed-weighted integration approach in both clean conditions or when noise is added to either stream. Furthermore, our experiments show that the MWSP approach dynamically selects suitable integration weights on a frame-by-frame basis according to the level of noise in the streams and also according to the naturally fluctuating relative reliability of the modalities even in clean conditions. The MWSP approach is shown to maintain robust recognition performance in all tested conditions, while requiring no prior knowledge about the type or level of noise.

Comparison of Image Transform-Based Features for Visual Speech Recognition in Clean and Corrupted Videos

We present results of a study into the performance of a variety of different image transform-based feature types for speaker-independent visual speech recognition of isolated digits. This includes the first reported use of features extracted using a discrete curvelet transform. The study will show a comparison of some methods for selecting features of each feature type and show the relative benefits of both static and dynamic visual features. The performance of the features will be tested on both clean video data and also video data corrupted in a variety of ways to assess each feature type's robustness to potential real-world conditions. One of the test conditions involves a novel form of video corruption we call jitter which simulates camera and/or head movement during recording.

AVEC 2011–The First International Audio/Visual Emotion Challenge

The Audio/Visual Emotion Challenge and Workshop (AVEC 2011) is the first competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and audiovisual emotion analysis, with all participants competing under strictly the same conditions. This paper first describes the challenge participation conditions. Next follows the data used – the SEMAINE corpus – and its partitioning into train, development, and test partitions for the challenge with labelling in four dimensions, namely activity, expectation, power, and valence. Further, audio and video baseline features are introduced as well as baseline results that use these features for the three sub-challenges of audio, video, and audiovisual emotion recognition.

Adaptations of lateral hand movements to early and late visual occlusion in catching

Recent studies suggested that the control of hand movements in catching involves continuous vision-based adjustments. More insight into these adjustments may be gained by examining the effects of occluding different parts of the ball trajectory. Here, we examined the effects of such occlusion on lateral hand movements when catching balls approaching from different directions, with the occlusion conditions presented in blocks or in randomized order. The analyses showed that late occlusion only had an effect during the blocked presentation, and early occlusion only during the randomized presentation. During the randomized presentation movement biases were more leftward if the preceding trial was an early occlusion trial. The effect of early occlusion during the randomized presentation suggests that the observed leftward movement bias relates to the rightward visual acceleration inherent to the ball trajectories used, while its absence during the blocked presentation seems to reflect trial-by-trial adaptations in the visuomotor gain, reminiscent of dynamic gain control in the smooth pursuit system. The movement biases during the late occlusion block were interpreted in terms of an incomplete motion extrapolation--a reduction of the velocity gain--caused by the fact that participants never saw the to-be-extrapolated part of the ball trajectory. These results underscore that continuous movement adjustments for catching do not only depend on visual information, but also on visuomotor adaptations based on non-visual information.

Farmer perception of suitable conditions for slurry application compared with decision support system recommendations

The application of slurry nutrients to land can be associated with unintended losses to the environment depending on soil and weather conditions. Correct timing of slurry application, however, can increase plant nutrient uptake and reduce losses. A decision support system (DSS), which predicts optimum conditions for slurry spreading based on the Hybrid Soil Moisture Deficit (HSMD) model, was investigated for use as a policy tool. The DSS recommendations were compared to farmer perception of suitable conditions for slurry spreading for three soil drainage classes (well, moderate and poorly drained) to better understand on farm slurry management practices and to identify potential conflict with farmer opinion. Six farmers participated in a survey over two and a half years, during which they completed a daily diary, and their responses were compared to Soil Moisture Deficit (SMD) calculations and weather data recorded by on farm meteorological stations. The perception of land drainage quality differed between farmers and was related to their local knowledge and experience. It was found that the allocation of grass fields to HSMD drainage classes using a visual assessment method aligned farmer perception of drainage at the national scale. Farmer opinion corresponded to the theoretical understanding that slurry should not be applied when the soil is wetter than field capacity, i.e. when drainage can occur. While weather and soil conditions (especially trafficability) were the principal reasons given by farmers not to spread slurry, farm management practices (grazing and silage) and current Nitrates Directive policies (closed winter period for spreading) combined with limited storage capacities were obstacles to utilisation of slurry nutrients. Despite the slightly more restrictive advice of the DSS regarding the number of suitable spreading opportunities, the system has potential to address an information deficit that would help farmers to reduce nutrient losses and optimise plant nutrient uptake by improved slurry management. The DSS advice was in general agreement with the farmers and, therefore, they should not be resistant to adopting the tool for day to day management.

Wounded Spaces: When Planning Degraded Cairo’s Urban Memory

This paper examines the position of planning practices operated under precise guidelines for displaying modernity. Cultivating the spatial qualities of Cairo since the 1970s has unveiled centralised ideologies and systems of governance and economic incentives. I present a discussion of the wounds that result from the inadequate upgrading ventures in Cairo, which I argue, created scars as enduring evidence of unattainable planning methods and processes that undermined its locales. In this process, the paper focuses on the consequences of eviction rather than the planning methods in one of the city’s traditional districts. Empirical work is based on interdisciplinary research, public media reports and archival maps that document actions and procedures put in place to alter the visual, urban, and demographic characteristics of Cairo’s older neighbourhoods against a backdrop of decay to shift towards a global spectacular. The paper builds a conversation about the power and fate these spaces were subject to during hostile transformations that ended with their being disused. Their existence became associated with sores on the souls of its ex-inhabitants, as outward signs of inward scars showcasing a lack of equality and social justice in a context where it was much needed.