Stars in their eyes: what eye-tracking reveal about multimedia perceptual quality

Perceptual multimedia quality is of paramount importance to the continued take-up and proliferation of multimedia applications: users will not use and pay for applications if they are perceived to be of low quality. Whilst traditionally distributed multimedia quality has been characterised by Quality of Service (QoS) parameters, these neglect the user perspective of the issue of quality. In order to redress this shortcoming, we characterise the user multimedia perspective using the Quality of Perception (QoP) metric, which encompasses not only a user’s satisfaction with the quality of a multimedia presentation, but also his/her ability to analyse, synthesise and assimilate informational content of multimedia. In recognition of the fact that monitoring eye movements offers insights into visual perception, as well as the associated attention mechanisms and cognitive processes, this paper reports on the results of a study investigating the impact of differing multimedia presentation frame rates on user QoP and eye path data. Our results show that provision of higher frame rates, usually assumed to provide better multimedia presentation quality, do not significantly impact upon the median coordinate value of eye path data. Moreover, higher frame rates do not significantly increase level of participant information assimilation, although they do significantly improve overall user enjoyment and quality perception of the multimedia content being shown.

Infotainment across access devices: the perceptual impact of multimedia QoS

The introduction of multimedia on pervasive and mobile communication devices raises a number of perceptual quality issues. However, limited work has been done examining the 3-way interaction between use of equipment, user perceptual quality and quality of service. Our work measures user perceptual quality with the quality of perception (QoP) metrics which comprises levels of informational transfer (objective) and user satisfaction (subjective) when users are presented with multimedia video clips at three different frame rates, using four different display devices. Finally, our results will show that variation in frame-rate does not impact a user’s level of information assimilation (IA), however, does impact a users’ perception of multimedia video ‘quality’.

Perceptual shift in bilingualism: brain potentials reveal plasticity in pre-attentive colour perception

The validity of the linguistic relativity principle continues to stimulate vigorous debate and research. The debate has recently shifted from the behavioural investigation arena to a more biologically grounded field, in which tangible physiological evidence for language effects on perception can be obtained. Using brain potentials in a colour oddball detection task with Greek and English speakers, a recent study suggests that language effects may exist at early stages of perceptual integration [Thierry, G., Athanasopoulos, P., Wiggett, A., Dering, B., & Kuipers, J. (2009). Unconscious effects of language-specific terminology on pre-attentive colour perception. Proceedings of the National Academy of Sciences, 106, 4567–4570]. In this paper, we test whether in Greek speakers exposure to a new cultural environment (UK) with contrasting colour terminology from their native language affects early perceptual processing as indexed by an electrophysiological correlate of visual detection of colour luminance. We also report semantic mapping of native colour terms and colour similarity judgements. Results reveal convergence of linguistic descriptions, cognitive processing, and early perception of colour in bilinguals. This result demonstrates for the first time substantial plasticity in early, pre-attentive colour perception and has important implications for the mechanisms that are involved in perceptual changes during the processes of language learning and acculturation.

Differential interference effects of negative emotional states on subsequent semantic and perceptual processing

Past studies have revealed that encountering negative events interferes with cognitive processing of subsequent stimuli. The present study investigates whether negative events affect semantic and perceptual processing differently. Presentation of negative pictures produced slower reaction times than neutral or positive pictures in tasks that require semantic processing, such as natural or man-made judgments about drawings of objects, commonness judgments about objects, and categorical judgments about pairs of words. In contrast, negative picture presentation did not slow down judgments in subsequent perceptual processing (e.g., color judgments about words, size judgments about objects). The subjective arousal level of negative pictures did not modulate the interference effects on semantic or perceptual processing. These findings indicate that encountering negative emotional events interferes with semantic processing of subsequent stimuli more strongly than perceptual processing, and that not all types of subsequent cognitive processing are impaired by negative events.

Can perceptual differences account for managerial success?: the case of Japanese aid workers

Purpose – There is a wealth of studies which suggest that managers' positive perceptions/expectations can considerably influence the organisational performance; unfortunately, little empirical evidence has been obtained from development studies. This research aims to focus on the perceptual and behavioural trait differences of successful and unsuccessful aid workers, and their relationship with organisational performance. Design/methodology/approach – Through web-based survey, 244 valid responses were obtained from the Japan International Cooperation Agency (JICA)-aid managers worldwide. Five perception related factors were extracted and used for cluster analysis to group the respondents. Each cluster's perception/behaviour-related factors and organisational performance variables were compared by ANOVA. Findings – It was discovered that Japanese's positive perception/expectation about work and their local colleagues was related to higher organisational performance, and conversely, the negative perception on their part was generally associated with negative behaviour and lower organisational performance. Moreover, in a development context, lower work-related stress and feelings of resignation toward work were strongly associated with the acceptability of cross-cultural work environment. Practical implications – The differences in perceptual tendencies suggest that cautious consideration is advised since these findings may mainly apply to Japanese aid managers. However, as human nature is universal, positive perception and behaviour would bring out positive output in most organisations. Originality/value – This study extended the contextualised “Pygmalion effect” and has clarified the influence of perception/expectation on counter-part behaviour and organisational performance in development aid context, where people-related issues have often been ignored. This first-time research provides imperial data on the significant role of positive perception on the incumbent role holder.

Faces and awareness: low-level, not emotional factors determine perceptual dominance

Threat-relevant stimuli such as fear faces are prioritized by the human visual system. Recent research suggests that this prioritization begins during unconscious processing: A specialized (possibly subcortical) pathway evaluates the threat relevance of visual input, resulting in preferential access to awareness for threat stimuli. Our data challenge this claim. We used a continuous flash suppression (CFS) paradigm to present emotional face stimuli outside of awareness. It has been shown using CFS that salient (e.g., high contrast) and recognizable stimuli (faces, words) become visible more quickly than less salient or less recognizable stimuli. We found that although fearful faces emerge from suppression faster than other faces, this was wholly explained by their low-level visual properties, rather than their emotional content. We conclude that, in the competition for visual awareness, the visual system prefers and promotes unconscious stimuli that are more “face-like,” but the emotional content of a face has no effect on stimulus salience.

Evaluating perceptual separation in a pilot system for affective composition

Research evaluating perceptual responses to music has identified many structural features as correlates that might be incorporated in computer music systems for affectively charged algorithmic composition and/or expressive music performance. In order to investigate the possible integration of isolated musical features to such a system, a discrete feature known to correlate some with emotional responses – rhythmic density – was selected from a literature review and incorporated into a prototype system. This system produces variation in rhythm density via a transformative process. A stimulus set created using this system was then subjected to a perceptual evaluation. Pairwise comparisons were used to scale differences between 48 stimuli. Listener responses were analysed with Multidimensional scaling (MDS). The 2-Dimensional solution was then rotated to place the stimuli with the largest range of variation across the horizontal plane. Stimuli with variation in rhythmic density were placed further from the source material than stimuli that were generated by random permutation. This, combined with the striking similarity between the MDS scaling and that of the 2-dimensional emotional model used by some affective algorithmic composition systems, suggests that isolated musical feature manipulation can now be used to parametrically control affectively charged automated composition in a larger system.

Sensory enhancement, a pilot perceptual study of subdermal magnetic implants

Subdermal magnetic implants originated as an art form in the world of body modification. To date an in depth scientific analysis of the benefits of this implant has yet to be established. This research explores the concept of sensory extension of the tactile sense utilising this form of implantation. This relatively simple procedure enables the tactile sense to respond to static and alternating magnetic fields. This is not to say that the underlying biology of the system has changed; i.e. the concept does not increase our tactile frequency response range or sensitivity to pressure, but now does invoke a perceptual response to a stimulus that is not innately available to humans. Within this research two social surveys have been conducted in order to ascertain one, the social acceptance of the general notion of human enhancement, and two the perceptual experiences of individuals with the magnetic implants themselves. In terms of acceptance to the notion of sensory improvement (via implantation) ~39% of the general population questioned responded positively with a further ~25% of the respondents answering with the indecisive response. Thus with careful dissemination a large proportion of individuals may adopt this technology much like this if it were to become available for consumers. Interestingly of the responses collected from the magnetic implants survey ~60% of the respondents actually underwent the implant for magnetic vision purposes. The main contribution of this research however comes from a series of psychophysical testing. In which 7 subjects with subdermal magnetic implants, were cross compared with 7 subjects that had similar magnets superficially attached to their dermis. The experimentation examined multiple psychometric thresholds of the candidates including intensity, frequency and temporal. Whilst relatively simple, the experimental setup for the perceptual experimentation conducted was novel in that custom hardware and protocols were created in order to determine the subjective thresholds of the individuals. Abstract iv The overall purpose of this research is to utilise this concept in high stress scenarios, such as driving or piloting; whereby alerts and warnings could be relayed to an operator without intruding upon their other (typically overloaded) exterior senses (i.e. the auditory and visual senses). Hence each of the thresholding experiments were designed with the intention of utilising the results in the design of signals for information transfer. The findings from the study show that the implanted group of subjects significantly outperformed the superficial group in the absolute intensity threshold experiment, i.e. the implanted group required significantly less force than the superficial group in order to perceive the stimulus. The results for the frequency difference threshold showed no significant difference in the two groups tested. Interestingly however at low frequencies, i.e. 20 and 50 Hz, the ability of the subjects tested to discriminate frequencies significantly increased with more complex waveforms i.e. square and sawtooth, when compared against the typically used sinewave. Furthermore a novel protocol for establishing the temporal gap detection threshold during a temporal numerosity study has been established in this thesis. This experiment measured the subjects’ capability to correctly determine the number of concatenated signals presented to them whilst the time between the signals, referred to as pulses, tended to zero. A significant finding was that when altering the length of, the frequency of, and the number of cycles of the pulses, the time between pulses for correct recognition altered. This finding will ultimately aid in the design of the tactile alerts for this method of information transfer. Preliminary development work for the use of this method of input to the body, in an automotive scenario, is also presented within this thesis in the form of a driving simulation. The overall goal of which is to present warning alerts to a driver, such as rear-to-end collision, or excessive speeds on roads, in order to prevent incidents and penalties from occurring. Discussion on the broader utility of this implant has been presented, reflecting on its potential use as a basis for vibrotactile, and sensory substitution, devices. This discussion furthers with postulations on its use as a human machine interface, as well as how a similar implant could be used within the ear as a hearing aid device.

The relative perceptual weight of two Swedish prosodic contrasts

Abstract. In addition to 9 vowel and 18 consonant phonemes, Swedish has three prosodic phonemic contrasts: word stress, quantity and tonal word accent. There are also examples of distinctive phrase or sentence stress, where a verb can be followed by either an unstressed preposition or a stressed particle. This study focuses on word level and more specifically on word stress and tonal word accent in disyllabic words. When making curriculums for second language learners, teachers are helped by knowing which phonetic or phonological features are more or less crucial for the intelligibility of speech and there are some structural and anecdotal evidence that word stress should play a more important role for intelligibility of Swedish, than the tonal word accent. The Swedish word stress is about prominence contrasts between syllables, mainly signaled by syllable duration, while the tonal word accent is signaled mainly by pitch contour. The word stress contrast, as in armen [´arːmən] ‘the arm’ - armén [ar´meːn] ‘the army’, the first word trochaic and the second iambic, is present in all regional varieties of Swedish, and realized with roughly the same acoustic cues, while the tonal word accent, as in anden [´anːdən] ‘the duck’ - anden [`anːdən] ‘the spirit’ is absent in some dialects (as well as in singing), and also signaled with a variety of tonal patterns depending on region. The present study aims at comparing the respective perceptual weight of the two mentioned contrasts. Two lexical decision tests were carried out where in total 34 native Swedish listeners should decide whether a stimulus was a real word or a non-word. Real words of all mentioned categories were mixed with nonsense words and words that were mispronounced with opposite stress pattern or opposite tonal word accent category. The results show that distorted word stress caused more non-word judgments and more loss, than distorted word accent. Our conclusion is that intelligibility of Swedish is more sensitive to distorted word stress pattern than to distorted tonal word accent pattern. This is in compliance with the structural arguments presented above, and also with our own intuition.

Mapa perceptual dos compradores de apartamentos em Porto Alegre

A indústria da construção civil é extremamente importante para a economia brasileira, particularmente no momento em que o Brasil apresenta elevados índices de desemprego. O setor utiliza mão-de-obra intensiva, possui baixa dependência de insumos importados e representa 19,26% do Produto Interno Bruto do Brasil. Entretanto, juros elevados, baixo ritmo de crescimento da economia, escassez de crédito e baixo poder aquisitivo da população contribuem para a falta de investimentos no setor e o acirramento da competição entre as empresas construtoras. Para sobreviver e prosperar neste ambiente as empresas devem buscar a diferenciação através da geração de valor para o cliente, oferecendo- lhe produtos cujos atributos sejam por ele valorizados. O objetivo desta pesquisa é o de mapear os atributos valorizados pelos compradores de apartamentos em Porto Alegre na faixa de preço em torno de R$90.000,00 a R$165.000,00 e identificar os segmentos (clusters) de consumidores contidos na amostra. Inicialmente foi feita uma pesquisa de atributos encontrados na literatura, os quais foram validados por expertos e compradores, resultando em uma lista com 60 atributos. A partir dela foi elaborado um questionário estruturado, contendo questões para avaliar o grau de importância atribuído pelos compradores aos atributos, bem como questões sobre sua situação sócio-econômica. Realizaram-se trezentas entrevistas por telefone com uma amostra não probabilística, obtida por conveniência e acessibilidade. Diversas técnicas estatísticas foram aplicadas aos dados, possibilitando a execução de um mapa perceptual. Primeiramente, através de uma análise fatorial, os sessenta atributos foram reduzidos a vinte e um fatores. A seguir, por meio de uma análise de clusters, foram identificados cinco segmentos (clusters). Por último, uma análise discriminante identificou catorze fatores discriminantes entre os segmentos. A análise discriminante também forneceu as correlações entre as funções discriminantes e os fatores discriminantes, bem como os centróides dos segmentos. Os segmentos e os fatores discriminantes foram dispostos no mapa perceptual na forma de pontos e vetores, respectivamente. A análise do mapa permite identificar quais fatores são comparativamente mais ou menos valorizados por determinado segmento. O detalhamento e riqueza das informações obtidas na análise do mapa perceptual, somadas à sensibilidade e à criatividade dos profissionais responsáveis pelo desenvolvimento dos produtos imobiliários podem ser um passo decisivo em direção ao sucesso dos empreendimentos.

Perceptual aspects of the use of faucets (taps)

This paper presents an assessment with simulated activities with the aim of analyzing the perception of ease/difficulty of the use of faucets (taps) handles by 180 Brazilian adults. Five different handles faucets were activated for subsequent collection of perceptual data. The procedures were based on main recommendations for biomedical ethics and human research. The results indicate that handles with levers are significantly (p <= 0.05) easier to use. The most difficult are characterized by not having support points for the rotation (levers) or more points of pressure concentration in the hand.

Desempenho perceptual-auditivo e ortográfico de consoantes fricativas na aquisição da escrita

OBJETIVO: Verificar os desempenhos perceptual-auditivo e ortográfico de escolares no que se refere à identificação de contrastes entre as fricativas do Português Brasileiro, e investigar em que medida esses dois tipos de desempenhos se relacionam. MÉTODOS: Foram analisados dados de desempenho perceptual-auditivo e de desempenho ortográfico extraídos de 20 crianças das duas primeiras séries do ensino fundamental de uma escola pública do município de Mallet (PR). A coleta de dados de percepção auditiva foi feita com base no Instrumento de Avaliação da Percepção de Fala (PERCEFAL), com o uso do software Perceval. Já a coleta de dados de ortografia foi feita por meio de um ditado das mesmas palavras que compõem o instrumento PERCEFAL. RESULTADOS: Foram observadas: maior acurácia perceptual-auditiva do que ortográfica; tendência de menor tempo de resposta e de menor variabilidade nos acertos perceptuais-auditivos do que nos erros; não correspondência de erros de percepção-auditiva e ortografia, já que, na percepção, o maior percentual de erros envolveu o ponto de articulação das fricativas, enquanto que, na ortografia, o maior percentual envolveu o vozeamento. CONCLUSÃO: Embora se mostrem relacionados, os desempenhos perceptual-auditivo e ortográfico não apresentam correspondência termo a termo. Portanto, na prática clínica, a atenção deve-se voltar não apenas para os aspectos que aproximam esses dois desempenhos, mas, também, para os aspectos que os diferenciam.

Acoustic and perceptual analyses of Brazilian male actors' and nonactors' voices: Long-term average spectrum and the Actor's Formant

This study investigates the possible differences between actors' and nonactors' vocal projection strategies using acoustic and perceptual analyses. A total of 11 male actors and 10 male nonactors volunteered as subjects, reading an extended text sample in habitual, moderate, and loud levels. The samples were analyzed for sound pressure level (SPL), alpha ratio (difference between the average SPL of the 1-5 kHz region and the average SPL of the 50 Hz-1 kHz region), fundamental frequency (F0), and long-term average spectrum (LTAS). Through LTAS, the mean frequency of the first formant (171) range, the mean frequency of the actor's formant, the level differences between the F1 frequency region and the F0 region (L1-L0), and the level differences between the strongest peak at 0-1 kHz and that at 3-4 kHz were measured. Eight voice specialists evaluated perceptually the degree of projection, loudness, and tension in the samples. The actors had a greater alpha ratio, stronger level of the actor's formant range, and a higher degree of perceived projection and loudness in all loudness levels. SPL, however, did not differ significantly between the actors and nonactors, and no differences were found in the mean formant frequencies ranges. The alpha ratio and the relative level of the actor's formant range seemed to be related to the degree of perceived loudness. From the physiological point of view, a more favorable glottal setting' providing a higher glottal closing speed, may be characteristic of these actors' projected voices. So, the projected voices, in this group of actors, were more related to the glottic source than to the resonance of the vocal tract.

On the role of synchrony for neuron-astrocyte interactions and perceptual conscious processing

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)