The impact of interface modality on police officers' visual behaviour when using an in-vehicle system

Background Standard operating procedures state that police officers should not drive while interacting with their mobile data terminal (MDT) which provides in-vehicle information essential to police work. Such interactions do however occur in practice and represent a potential source of driver distraction. The MDT comprises visual output with manual input via touch screen and keyboard. This study investigated the potential for alternative input and output methods to mitigate driver distraction with specific focus on eye movements. Method Nineteen experienced drivers of police vehicles (one female) from the NSW Police Force completed four simulated urban drives. Three drives included a concurrent secondary task: imitation licence plate search using an emulated MDT. Three different interface methods were examined: Visual-Manual, Visual-Voice, and Audio-Voice (“Visual” and “Audio” = output modality; “Manual” and “Voice” = input modality). During each drive, eye movements were recorded using FaceLAB™ (Seeing Machines Ltd, Canberra, ACT). Gaze direction and glances on the MDT were assessed. Results The Visual-Voice and Visual-Manual interfaces resulted in a significantly greater number of glances towards the MDT than Audio-Voice or Baseline. The Visual-Manual and Visual-Voice interfaces resulted in significantly more glances to the display than Audio-Voice or Baseline. For longer duration glances (>2s and 1-2s) the Visual-Manual interface resulted in significantly more fixations than Baseline or Audio-Voice. The short duration glances (<1s) were significantly greater for both Visual-Voice and Visual-Manual compared with Baseline and Audio-Voice. There were no significant differences between Baseline and Audio-Voice. Conclusion An Audio-Voice interface has the greatest potential to decrease visual distraction to police drivers. However, it is acknowledged that an audio output may have limitations for information presentation compared with visual output. The Visual-Voice interface offers an environment where the capacity to present information is sustained, whilst distraction to the driver is reduced (compared to Visual-Manual) by enabling adaptation of fixation behaviour.

Literacy Theories for the Digital Age: Social, Critical, Multimodal, Spatial, Material and Sensory Lenses

Literacy Theories for the Digital Age insightfully brings together six essential approaches to literacy research and educational practice. The book provides powerful and accessible theories for readers, including Socio-cultural, Critical, Multimodal, Socio-spatial, Socio-material and Sensory Literacies. The brand new Sensory Literacies approach is an original and visionary contribution to the field, coupled with a provocative foreword from leading sensory anthropologist David Howes. This dynamic collection explores a legacy of literacy research while showing the relationships between each paradigm, highlighting their complementarity and distinctions. This highly relevant compendium will inspire readers to explore new frontiers of thought and practice in times of diversity and technological change.

Effect of recovery modality on 4-hour repeated treadmill running performance and changes in physiological variables

The purpose of this study was to compare the effectiveness of three different recovery modalities - active (ACT), passive (PAS) and contrast temperature water immersion (CTW) - on the performance of repeated treadmill running, lactate concentration and pH. Fourteen males performed two pairs of treadmill runs to exhaustion at 120% and 90% of peak running speed (PRS) over a 4-hour period. ACT, PAS or CTW was performed for 15-min after the first pair of treadmill runs. ACT consisted of running at 40% PRS, PAS consisted of standing stationary and CTW consisted of alternating between 60-s cold (10°C) and 120-s hot (42°C) water immersion. Run times were converted to time to cover set distance using critical power. Type of recovery modality did not have a significant effect on change in time to cover 400 m (Mean±SD; ACT 2.7±3.6 s, PAS 2.9±4.2 s, CTW 4.2±6.9 s), 1000 m (ACT 2.2±4.0 s, PAS 4.8±8.6 s, CTW 2.1±7.2 s) or 5000 m (ACT 1.4±29.0 s, PAS 16.7±58.5 s, CTW 11.7±33.0 s). Post exercise blood lactate concentration was lower in ACT and CTW compared with PAS. Participants reported an increased perception of recovery in the CTW compared with ACT and PAS. Blood pH was not significantly influenced by recovery modality. Data suggest both ACT and CTW reduce lactate accumulation after high intensity running, but high intensity treadmill running performance is returned to baseline 4-hours after the initial exercise bout regardless of the recovery strategy employed.

Resilient Navigation through Probabilistic Modality Reconfiguration

This paper proposes an approach to achieve resilient navigation for indoor mobile robots. Resilient navigation seeks to mitigate the impact of control, localisation, or map errors on the safety of the platform while enforcing the robot’s ability to achieve its goal. We show that resilience to unpredictable errors can be achieved by combining the benefits of independent and complementary algorithmic approaches to navigation, or modalities, each tuned to a particular type of environment or situation. In this paper, the modalities comprise a path planning method and a reactive motion strategy. While the robot navigates, a Hidden Markov Model continually estimates the most appropriate modality based on two types of information: context (information known a priori) and monitoring (evaluating unpredictable aspects of the current situation). The robot then uses the recommended modality, switching between one and another dynamically. Experimental validation with a SegwayRMP- based platform in an office environment shows that our approach enables failure mitigation while maintaining the safety of the platform. The robot is shown to reach its goal in the presence of: 1) unpredicted control errors, 2) unexpected map errors and 3) a large injected localisation fault.

Structures of μOconotoxins from Conusmarmoreus. Inhibitors of tetrodotoxin (TTX)-sensitive and TTX-resistant sodium channels in mammalian sensory neurons

The μO-conotoxins are an intriguing class of conotoxins targeting various voltage-dependent sodium channels and molluscan calcium channels. In the current study, we have shown MrVIA and MrVIB to be the first known peptidic inhibitors of the transient tetrodotoxin-resistant (TTX-R) Na+ current in rat dorsal root ganglion neurons, in addition to inhibiting tetrodotoxin-sensitive Na+ currents. Human TTX-R sodium channels are a therapeutic target for indications such as pain, highlighting the importance of the μO-conotoxins as potential leads for drug development. Furthermore, we have used NMR spectroscopy to provide the first structural information on this class of conotoxins. MrVIA and MrVIB are hydrophobic peptides that aggregate in aqueous solution but were solubilized in 50% acetonitrile/water. The three-dimensional structure of MrVIB consists of a small β-sheet and a cystine knot arrangement of the three-disulfide bonds. It contains four backbone “loops” between successive cysteine residues that are exposed to the solvent to varying degrees. The largest of these, loop 2, is the most disordered part of the molecule, most likely due to flexibility in solution. This disorder is the most striking difference between the structures of MrVIB and the known δ- and ω-conotoxins, which along with the μO-conotoxins are members of the O superfamily. Loop 2 of ω-conotoxins has previously been shown to contain residues critical for binding to voltage-gated calcium channels, and it is interesting to speculate that the flexibility observed in MrVIB may accommodate binding to both sodium and molluscan calcium channels.

Quantitative sensory measures distinguish office workers with varying levels of neck pain and disability

This study was undertaken to investigate any relationship between sensory features and neck pain in female office workers using quantitative sensory measures to better understand neck pain in this group. Office workers who used a visual display monitor for more than four hours per day with varying levels of neck pain and disability were eligible for inclusion. There were 85 participants categorized according to their scores on the neck disability index (NDI): 33 with no pain (NDI < 8); 38 with mild levels of pain and disability (NDI 9–29); 14 with moderate levels of pain (NDI ⩾ 30). A fourth group of women without neck pain (n = 22) who did not work formed the control group. Measures included: thermal pain thresholds over the posterior cervical spine; pressure pain thresholds over the posterior neck, trapezius, levator scapulae and tibialis anterior muscles, and the median nerve trunk; sensitivity to vibrotactile stimulus over areas of the hand innervated by the median, ulnar and radial nerves; sympathetic vasoconstrictor response. All tests were conducted bilaterally. ANCOVA models were used to determine group differences between the means for each sensory measure. Office workers with greater self-reported neck pain demonstrated hyperalgesia to thermal stimuli over the neck, hyperalgesia to pressure stimulation over several sites tested; hypoaesthesia to vibration stimulation but no changes in the sympathetic vasoconstrictor response. There is evidence of multiple peripheral nerve dysfunction with widespread sensitivity most likely due to altered central nociceptive processing initiated and sustained by nociceptive input from the periphery.

Efficiency of lexical access in children with autism spectrum disorders : does modality matter?

The provision of visual support to individuals with an autism spectrum disorder (ASD) is widely recommended. We explored one mechanism underlying the use of visual supports: efficiency of language processing. Two groups of children, one with and one without an ASD, participated. The groups had comparable oral and written language skills and nonverbal cognitive abilities. In two semantic priming experiments, prime modality and prime–target relatedness were manipulated. Response time and accuracy of lexical decisions on the spoken word targets were measured. In the first uni-modal experiment, both groups demonstrated significant priming effects. In the second experiment which was cross-modal, no effect for relatedness or group was found. This result is considered in the light of the attentional capacity required for access to the lexicon via written stimuli within the developing semantic system. These preliminary findings are also considered with respect to the use of visual support for children with ASD.

Cortical organization of environmental sounds by attribute

Semantic knowledge is supported by a widely distributed neuronal network, with differential patterns of activation depending upon experimental stimulus or task demands. Despite a wide body of knowledge on semantic object processing from the visual modality, the response of this semantic network to environmental sounds remains relatively unknown. Here, we used fMRI to investigate how access to different conceptual attributes from environmental sound input modulates this semantic network. Using a range of living and manmade sounds, we scanned participants whilst they carried out an object attribute verification task. Specifically, we tested visual perceptual, encyclopedic, and categorical attributes about living and manmade objects relative to a high-level auditory perceptual baseline to investigate the differential patterns of response to these contrasting types of object-related attributes, whilst keeping stimulus input constant across conditions. Within the bilateral distributed network engaged for processing environmental sounds across all conditions, we report here a highly significant dissociation within the left hemisphere between the processing of visual perceptual and encyclopedic attributes of objects.

Robust multiple-sensing-modality data fusion using Gaussian Process Implicit Surfaces

The ability to build high-fidelity 3D representations of the environment from sensor data is critical for autonomous robots. Multi-sensor data fusion allows for more complete and accurate representations. Furthermore, using distinct sensing modalities (i.e. sensors using a different physical process and/or operating at different electromagnetic frequencies) usually leads to more reliable perception, especially in challenging environments, as modalities may complement each other. However, they may react differently to certain materials or environmental conditions, leading to catastrophic fusion. In this paper, we propose a new method to reliably fuse data from multiple sensing modalities, including in situations where they detect different targets. We first compute distinct continuous surface representations for each sensing modality, with uncertainty, using Gaussian Process Implicit Surfaces (GPIS). Second, we perform a local consistency test between these representations, to separate consistent data (i.e. data corresponding to the detection of the same target by the sensors) from inconsistent data. The consistent data can then be fused together, using another GPIS process, and the rest of the data can be combined as appropriate. The approach is first validated using synthetic data. We then demonstrate its benefit using a mobile robot, equipped with a laser scanner and a radar, which operates in an outdoor environment in the presence of large clouds of airborne dust and smoke.

Design after design to bridge between people living with cognitive or sensory impairments, their friends and proxies

A carer or teacher often plays the role of proxy or spokesperson for a person living with an intellectual disability or form of cognitive or sensory impairment. Our research undertook co-design with people living with cognitive and sensory impairments and their proxies in order to explore new ways of facilitating communication. We developed simple functioning interactive prototypes to support people with a diverse range of competencies to communicate and explore their use. Deployment of the prototypes enabled use, appropriation and design after design by our two participant groups; adults living with cognitive or sensory impairments and children identified with language delays and autism spectrum disorder. The prototypes supported concrete expression of likes, dislikes, capabilities, emotional wants and needs and forms of expression that hitherto had not been fostered, further informing design. Carers and designers were surprised at the ways in which the technology was used and how it fostered new forms of social interaction and expression. We elaborate on how design after design can be an effective approach for engaging people living with intellectual disabilities, giving them greater capacity for expression and power in design and offering the potential to expand and deepen their social relationships.

Biologically inspired SLAM using Wi-Fi

Wi-Fi is a commonly available source of localization information in urban environments but is challenging to integrate into conventional mapping architectures. Current state of the art probabilistic Wi-Fi SLAM algorithms are limited by spatial resolution and an inability to remove the accumulation of rotational error, inherent limitations of the Wi-Fi architecture. In this paper we leverage the low quality sensory requirements and coarse metric properties of RatSLAM to localize using Wi-Fi fingerprints. To further improve performance, we present a novel sensor fusion technique that integrates camera and Wi-Fi to improve localization specificity, and use compass sensor data to remove orientation drift. We evaluate the algorithms in diverse real world indoor and outdoor environments, including an office floor, university campus and a visually aliased circular building loop. The algorithms produce topologically correct maps that are superior to those produced using only a single sensor modality.

Disrupted sensory gating in pathological gambling

Background Some neurochemical evidence as well as recent studies on molecular genetics suggest that pathologic gambling may be related to dysregulated dopamine neurotransmission. Methods The current study examined sensory (motor) gating in pathologic gamblers as a putative measure of endogenous brain dopamine activity with prepulse inhibition of the acoustic startle eye-blink response and the auditory P300 event-related potential. Seventeen pathologic gamblers and 21 age- and gender-matched healthy control subjects were assessed. Both prepulse inhibition measures were recorded under passive listening and two-tone prepulse discrimination conditions. Results Compared to the control group, pathologic gamblers exhibited disrupted sensory (motor) gating on all measures of prepulse inhibition. Sensory motor gating deficits of eye-blink responses were most profound at 120-millisecond prepulse lead intervals in the passive listening task and at 240-millisecond prepulse lead intervals in the two-tone prepulse discrimination task. Sensory gating of P300 was also impaired in pathologic gamblers, particularly at 500-millisecond lead intervals, when performing the discrimination task on the prepulse. Conclusions In the context of preclinical studies on the disruptive effects of dopamine agonists on prepulse inhibition, our findings suggest increased endogenous brain dopamine activity in pathologic gambling in line with previous neurobiological findings.

Automated sensory data alignment for environmental and epidermal change monitoring

In this paper we present research adapting a state of the art condition-invariant robotic place recognition algorithm to the role of automated inter- and intra-image alignment of sensor observations of environmental and skin change over time. The approach involves inverting the typical criteria placed upon navigation algorithms in robotics; we exploit rather than attempt to fix the limited camera viewpoint invariance of such algorithms, showing that approximate viewpoint repetition is realistic in a wide range of environments and medical applications. We demonstrate the algorithms automatically aligning challenging visual data from a range of real-world applications: ecological monitoring of environmental change, aerial observation of natural disasters including flooding, tsunamis and bushfires and tracking wound recovery and sun damage over time and present a prototype active guidance system for enforcing viewpoint repetition. We hope to provide an interesting case study for how traditional research criteria in robotics can be inverted to provide useful outcomes in applied situations.

Non-parametric consistency test for multiple-sensing-modality data fusion

Fusing data from multiple sensing modalities, e.g. laser and radar, is a promising approach to achieve resilient perception in challenging environmental conditions. However, this may lead to \emph{catastrophic fusion} in the presence of inconsistent data, i.e. when the sensors do not detect the same target due to distinct attenuation properties. It is often difficult to discriminate consistent from inconsistent data across sensing modalities using local spatial information alone. In this paper we present a novel consistency test based on the log marginal likelihood of a Gaussian process model that evaluates data from range sensors in a relative manner. A new data point is deemed to be consistent if the model statistically improves as a result of its fusion. This approach avoids the need for absolute spatial distance threshold parameters as required by previous work. We report results from object reconstruction with both synthetic and experimental data that demonstrate an improvement in reconstruction quality, particularly in cases where data points are inconsistent yet spatially proximal.