Defining user perception of distributed multimedia quality

This article presents the results of a study that explored the human side of the multimedia experience. We propose a model that assesses quality variation from three distinct levels: the network, the media and the content levels; and from two views: the technical and the user perspective. By facilitating parameter variation at each of the quality levels and from each of the perspectives, we were able to examine their impact on user quality perception. Results show that a significant reduction in frame rate does not proportionally reduce the user's understanding of the presentation independent of technical parameters, that multimedia content type significantly impacts user information assimilation, user level of enjoyment, and user perception of quality, and that the device display type impacts user information assimilation and user perception of quality. Finally, to ensure the transfer of information, low-level abstraction (network-level) parameters, such as delay and jitter, should be adapted; to maintain the user's level of enjoyment, high-level abstraction quality parameters (content-level), such as the appropriate use of display screens, should be adapted.

How level and type of deafness affects user perception of multimedia video clips

Our research investigates the impact that hearing has on the perception of digital video clips, with and without captions, by discussing how hearing loss, captions and deafness type affects user QoP (Quality of Perception). QoP encompasses not only a user's satisfaction with the quality of a multimedia presentation, but also their ability to analyse, synthesise and assimilate informational content of multimedia . Results show that hearing has a significant effect on participants’ ability to assimilate information, independent of video type and use of captions. It is shown that captions do not necessarily provide deaf users with a ‘greater level of information’ from video, but cause a change in user QoP, depending on deafness type, which provides a ‘greater level of context of the video’. It is also shown that post-lingual mild and moderately deaf participants predict less accurately their level of information assimilation than post-lingual profoundly deaf participants, despite residual hearing. A positive correlation was identified between level of enjoyment (LOE) and self-predicted level of information assimilation (PIA), independent of hearing level or hearing type. When this is considered in a QoP quality framework, it puts into question how the user perceives certain factors, such as ‘informative’ and ‘quality’.

Perception and haptics

For people with motion impairments, access to and independent control of a computer can be essential. Symptoms such as tremor and spasm, however, can make the typical keyboard and mouse arrangement for computer interaction difficult or even impossible to use. This paper describes three approaches to improving computer input effectivness for people with motion impairments. The three approaches are: (1) to increase the number of interaction channels, (2) to enhance commonly existing interaction channels, and (3) to make more effective use of all the available information in an existing input channel. Experiments in multimodal input, haptic feedback, user modelling, and cursor control are discussed in the context of the three approaches. A haptically enhanced keyboard emulator with perceptive capability is proposed, combining approaches in a way that improves computer access for motion impaired users.

Climate change, extreme weather events and issues of human perception

The central proposition of Toby Pillatt is that in developing an understanding of past human affairs weather is as important as, or more so than, climate. Climate may be simply defined as average weather, whilst weather is the day-to-day occurrence of atmospheric phenomena which impact in perceptible ways on people's lives. The general proposition is sound enough; the challenges come in implementing these ideas in ways which advance our understanding of past people–environment relationships.

Variation in the autism candidate gene GABRB3 modulates tactile sensitivity in typically developing children

Background: Autism spectrum conditions have a strong genetic component. Atypical sensory sensitivities are one of the core but neglected features of autism spectrum conditions. GABRB3 is a well-characterised candidate gene for autism spectrum conditions. In mice, heterozygous Gabrb3 deletion is associated with increased tactile sensitivity. However, no study has examined if tactile sensitivity is associated with GABRB3 genetic variation in humans. To test this, we conducted two pilot genetic association studies in the general population, analysing two phenotypic measures of tactile sensitivity (a parent-report and a behavioural measure) for association with 43 SNPs in GABRB3. Findings: Across both tactile sensitivity measures, three SNPs (rs11636966, rs8023959 and rs2162241) were nominally associated with both phenotypes, providing a measure of internal validation. Parent-report scores were nominally associated with six SNPs (P <0.05). Behaviourally measured tactile sensitivity was nominally associated with 10 SNPs (three after Bonferroni correction). Conclusions: This is the first human study to show an association between GABRB3 variation and tactile sensitivity. This provides support for the evidence from animal models implicating the role of GABRB3 variation in the atypical sensory sensitivity in autism spectrum conditions. Future research is underway to directly test this association in cases of autism spectrum conditions.

Top down influence on visuo-tactile interaction modulates neural oscillatory responses

Multisensory integration involves bottom-up as well as top-down processes. We investigated the influences of top-down control on the neural responses to multisensory stimulation using EEG recording and time-frequency analyses. Participants were stimulated at the index or thumb of the left hand, using tactile vibrators mounted on a foam cube. Simultaneously they received a visual distractor from a light emitting diode adjacent to the active vibrator (spatially congruent trial) or adjacent to the inactive vibrator (spatially incongruent trial). The task was to respond to the elevation of the tactile stimulus (upper or lower), while ignoring the simultaneous visual distractor. To manipulate top-down control on this multisensory stimulation, the proportion of spatially congruent (vs. incongruent) trials was changed across blocks. Our results reveal that the behavioral cost of responding to incongruent than congruent trials (i.e., the crossmodal congruency effect) was modulated by the proportion of congruent trials. Most importantly, the EEG gamma band response and the gamma-theta coupling were also affected by this modulation of top-down control, whereas the late theta band response related to the congruency effect was not. These findings suggest that gamma band response is more than a marker of multisensory binding, being also sensitive to the correspondence between expected and actual multisensory stimulation. By contrast, theta band response was affected by congruency but appears to be largely immune to stimulation expectancy.

Facilitating and disrupting speech perception in word deafness

Background: Word deafness is a rare condition where pathologically degraded speech perception results in impaired repetition and comprehension but otherwise intact linguistic skills. Although impaired linguistic systems in aphasias resulting from damage to the neural language system (here termed central impairments), have been consistently shown to be amenable to external influences such as linguistic or contextual information (e.g. cueing effects in naming), it is not known whether similar influences can be shown for aphasia arising from damage to a perceptual system (here termed peripheral impairments). Aims: This study aimed to investigate the extent to which pathologically degraded speech perception could be facilitated or disrupted by providing visual as well as auditory information. Methods and Procedures: In three word repetition tasks, the participant with word deafness (AB) repeated words under different conditions: words were repeated in the context of a pictorial or written target, a distractor (semantic, unrelated, rhyme or phonological neighbour) or a blank page (nothing). Accuracy and error types were analysed. Results: AB was impaired at repetition in the blank condition, confirming her degraded speech perception. Repetition was significantly facilitated when accompanied by a picture or written example of the word and significantly impaired by the presence of a written rhyme. Errors in the blank condition were primarily formal whereas errors in the rhyme condition were primarily miscues (saying the distractor word rather than the target). Conclusions: Cross-modal input can both facilitate and further disrupt repetition in word deafness. The cognitive mechanisms behind these findings are discussed. Both top-down influence from the lexical layer on perceptual processes as well as intra-lexical competition within the lexical layer may play a role.  

Fundamental deficits of auditory perception in Wernicke’s aphasia

Objective: This work investigates the nature of the comprehension impairment in Wernicke’s aphasia, by examining the relationship between deficits in auditory processing of fundamental, non-verbal acoustic stimuli and auditory comprehension. Wernicke’s aphasia, a condition resulting in severely disrupted auditory comprehension, primarily occurs following a cerebrovascular accident (CVA) to the left temporo-parietal cortex. Whilst damage to posterior superior temporal areas is associated with auditory linguistic comprehension impairments, functional imaging indicates that these areas may not be specific to speech processing but part of a network for generic auditory analysis. Methods: We examined analysis of basic acoustic stimuli in Wernicke’s aphasia participants (n = 10) using auditory stimuli reflective of theories of cortical auditory processing and of speech cues. Auditory spectral, temporal and spectro-temporal analysis was assessed using pure tone frequency discrimination, frequency modulation (FM) detection and the detection of dynamic modulation (DM) in “moving ripple” stimuli. All tasks used criterion-free, adaptive measures of threshold to ensure reliable results at the individual level. Results: Participants with Wernicke’s aphasia showed normal frequency discrimination but significant impairments in FM and DM detection, relative to age- and hearing-matched controls at the group level (n = 10). At the individual level, there was considerable variation in performance, and thresholds for both frequency and dynamic modulation detection correlated significantly with auditory comprehension abilities in the Wernicke’s aphasia participants. Conclusion: These results demonstrate the co-occurrence of a deficit in fundamental auditory processing of temporal and spectrotemporal nonverbal stimuli in Wernicke’s aphasia, which may have a causal contribution to the auditory language comprehension impairment Results are discussed in the context of traditional neuropsychology and current models of cortical auditory processing.

‘NSC 68 and the Soviet Threat: A New Perspective on Western Threat Perception and Policy Making’

It has been argued that the US strategy paper NSC 68 of 1950 which ushered in the great Cold War rearmament process first in the US and then in NATO was a vast overreaction. This paper argues, by contrast, that given the intelligence about the Soviet Union's and its satellites' military buildup and the role of China in that period, this was a reasonable strategy to embrace.

Impact of captions on deaf and hearing perception of multimedia video clips

We investigate the impact of captions on deaf and hearing perception of multimedia video clips. We measure perception using a parameter called Quality of Perception (QoP), which encompasses not only a user's satisfaction with multimedia clips, but also his/her ability to perceive, synthesise and analyse the informational content of such presentations. By studying perceptual diversity, it is our aim to identify trends that will help future implementation of adaptive multimedia technologies. Results show that although hearing level has a significant affect on information assimilation, the effect of captions is not significant on the objective level of information assimilated. Deaf participants predict that captions significantly improve their level of information assimilation, although no significant objective improvement was measured. The level of enjoyment is unaffected by a participant’s level of hearing or use of captions.

Perception of thickness, mouth-coating and mouth-drying of dairy beverages by younger and older volunteer

Sensory perception has been found to change during ageing. The perception of mouth feel by older adults, and the role of ageing on the sensory perception of texture attributes is uncertain. . This study investigated perception of the textural attributes of thickness, mouth-coating and mouth-drying, in the context of dairy beverages, by older and younger adults. Just noticeable differences (JND) of a starch thickener and for cream concentration within milk were established for thickness and mouth-coating perception, finding no age-related differences between participant groups. Mouth-drying was assessed through the directional paired comparison of a mouth-drying milk beverage to a skimmed milk sample. The older adults were found to be more sensitive to mouth-drying (p=0.03) than the younger adults. This study found no age-related decline in texture perception with older adults finding perception of some attributes such as mouth-drying enhanced by ageing.

Maximising umami taste in meat using natural ingredients: effects on chemistry, sensory perception and hedonic liking in young and old consumers

BACKGROUND: Umami taste in foods is elicited predominantly by the presence of glutamic acid and 5’-ribonucleotides, which act synergistically. This study aimed to use natural ingredients to maximise umami taste of a meat formulation and determine effects on liking of older consumers. METHODS: Cooked meat products with added natural ingredients (yeast extract, mycoscent, shiitake extract, tomato puree, soy sauce and soy bean paste) or monosodium glutamate (MSG) were prepared and compared to a control sample analytically (umami compounds), sensorially (sensory profile) and hedonically (liking by younger and older volunteers). Taste detection thresholds of sodium chloride and MSG of volunteers were collected. RESULTS: Four of the seven cooked meat products developed had a significantly higher content of umami-contributing compounds compared to the control. All products, except those containing MSG or tomato puree, were scored (by trained sensory panel) perceptually significantly higher in umami and / or salty taste compared to the control. Consumer tests showed a correlation of liking by the older cohort with perceived saltiness (ρ=0.76). CONCLUSION: The addition of natural umami-containing ingredients during the cooking of meat can provide enhanced umami and salty taste characteristics, this can lead to increased liking by some consumers, particularly those with raised taste detection thresholds.

The European Flood Alert System and the communication, perception, and use of ensemble predictions for operational flood risk management

Although ensemble prediction systems (EPS) are increasingly promoted as the scientific state-of-the-art for operational flood forecasting, the communication, perception, and use of the resulting alerts have received much less attention. Using a variety of qualitative research methods, including direct user feedback at training workshops, participant observation during site visits to 25 forecasting centres across Europe, and in-depth interviews with 69 forecasters, civil protection officials, and policy makers involved in operational flood risk management in 17 European countries, this article discusses the perception, communication, and use of European Flood Alert System (EFAS) alerts in operational flood management. In particular, this article describes how the design of EFAS alerts has evolved in response to user feedback and desires for a hydrographic-like way of visualizing EFAS outputs. It also documents a variety of forecaster perceptions about the value and skill of EFAS forecasts and the best way of using them to inform operational decision making. EFAS flood alerts were generally welcomed by flood forecasters as a sort of ‘pre-alert’ to spur greater internal vigilance. In most cases, however, they did not lead, by themselves, to further preparatory action or to earlier warnings to the public or emergency services. Their hesitancy to act in response to medium-term, probabilistic alerts highlights some wider institutional obstacles to the hopes in the research community that EPS will be readily embraced by operational forecasters and lead to immediate improvements in flood incident management. The EFAS experience offers lessons for other hydrological services seeking to implement EPS operationally for flood forecasting and warning. Copyright © 2012 John Wiley & Sons, Ltd.

Quantifying user perception of foodstuffs using THz spectrometry

We discuss the potential of using THz spectrometry for the direct observation of phase transitions in foodstuffs, with the aim of quantifying consumer perception. Experimental results from phase transitions using a continuous wave dispersive Fourier transform spectrometer and a cyclotron enhanced liquid helium cooled bolometric detector are reported.