Grounding action in visuo-haptic space using experience networks

Traditional approaches to the use of machine learning algorithms do not provide a method to learn multiple tasks in one-shot on an embodied robot. It is proposed that grounding actions within the sensory space leads to the development of action-state relationships which can be re-used despite a change in task. A novel approach called an Experience Network is developed and assessed on a real-world robot required to perform three separate tasks. After grounded representations were developed in the initial task, only minimal further learning was required to perform the second and third task.

Elaborating a tactile-proprioceptive illusion : the kinaesthetic fusion effect

This study investigated the Kinaesthetic Fusion Effect (KFE) first described by Craske and Kenny in 1981. In Experiment 1 the study did not replicate these findings following a change in the reporting method used by participants. Participants did not perceive any reduction in the sagittal separation of a button pressed by the index finger of one arm and a probe touching the other, following repeated exposure to the tactile stimuli present on both unseen arms. This study’s failure to replicate the widely-cited KFE as described by Craske et al. (1984) suggests that it may be contingent on several aspects of visual information, especially the availability of a specific visual reference, the role of instructions regarding gaze direction, and the potential use of a line of sight strategy when referring felt positions to an interposed surface. In addition, a foreshortening effect was found; this may result from a line-of-sight judgment and represent a feature of the reporting method used. Finally, this research will benefit future studies that require participants to report the perceived locations of the unseen limbs. Experiment 2 investigated the KFE when the visual reference was removed and participants made reports of touched position, blindfolded. A number of interesting outcomes arose from this change and may provide clarification to the phenomena.

Tactile abstractions [Exhibition Catalogue Essay]

Among the many meanings of abstraction is the focus on images that are at a distance from their origins. This understanding of abstraction is central to Savanhdary Vongpoothorn’s layered, textured and sensuous canvas Crossing (2003). The references in this painting to Laotian textile design and creation endows it with the sense of a fabric-like nature, gives it the feel of cloth wrapped around bodies and of threads woven into complex symmetrical patterns. Here, the distance from origins is expressed as a separation from the material forms of Lao culture. At the same time the work is a visual reference to the stretching or bending of forms, the breaking up of shapes in the natural or constructed environment, all of which create an expressive effect through the warm rose grid and visual illusions of movement and travel. This visual play suggests the sense that migration or movement is a means through which cultural forms get recoded and translated. The making of Crossing like many of Savanhdary’s works involved manipulation of the canvas through pricking and poking, and then the application of layers and dots of paint. The overall effect is one of a synthesis of different cultural motifs and the addition of new dimensions to familiar forms. This highlights the centrality of the idea of 'reassemblage’ in abstraction, the processes of remaking of self, of the natural world and of cultural artefacts. Savanhdary constructs intricate laced knots of colour and texture in work which expresses the possibilities presented by travel, migration and the subsequent remixture that emerges upon crossing through different cultural worlds.

Hearing loss and a supportive tactile signal in a navigation system : effects on driving behavior and eye movements

An on-road study was conducted to evaluate a complementary tactile navigation signal on driving behaviour and eye movements for drivers with hearing loss (HL) compared to drivers with normal hearing (NH). 32 participants (16 HL and 16 NH) performed two preprogrammed navigation tasks. In one, participants received only visual information, while the other also included a vibration in the seat to guide them in the correct direction. SMI glasses were used for eye tracking, recording the point of gaze within the scene. Analysis was performed on predefined regions. A questionnaire examined participant's experience of the navigation systems. Hearing loss was associated with lower speed, higher satisfaction with the tactile signal and more glances in the rear view mirror. Additionally, tactile support led to less time spent viewing the navigation display.

Integrating visual and tactile information in the perirhinal cortex

By virtue of its widespread afferent projections, perirhinal cortex is thought to bind polymodal information into abstract object-level representations. Consistent with this proposal, deficits in cross-modal integration have been reported after perirhinal lesions in nonhuman primates. It is therefore surprising that imaging studies of humans have not observed perirhinal activation during visual-tactile object matching. Critically, however, these studies did not differentiate between congruent and incongruent trials. This is important because successful integration can only occur when polymodal information indicates a single object (congruent) rather than different objects (incongruent). We scanned neurologically intact individuals using functional magnetic resonance imaging (fMRI) while they matched shapes. We found higher perirhinal activation bilaterally for cross-modal (visual-tactile) than unimodal (visual-visual or tactile-tactile) matching, but only when visual and tactile attributes were congruent. Our results demonstrate that the human perirhinal cortex is involved in cross-modal, visual-tactile, integration and, thus, indicate a functional homology between human and monkey perirhinal cortices.