Human brain networks of auditory attention and working memory

This thesis examines brain networks involved in auditory attention and auditory working memory using measures of task performance, brain activity, and neuroanatomical connectivity. Auditory orienting and maintenance of attention were compared with visual orienting and maintenance of attention, and top-down controlled attention was compared to bottom-up triggered attention in audition. Moreover, the effects of cognitive load on performance and brain activity were studied using an auditory working memory task. Corbetta and Shulman s (2002) model of visual attention suggests that what is known as the dorsal attention system (intraparietal sulcus/superior parietal lobule, IPS/SPL and frontal eye field, FEF) is involved in the control of top-down controlled attention, whereas what is known as the ventral attention system (temporo-parietal junction, TPJ and areas of the inferior/middle frontal gyrus, IFG/MFG) is involved in bottom-up triggered attention. The present results show that top-down controlled auditory attention also activates IPS/SPL and FEF. Furthermore, in audition, TPJ and IFG/MFG were activated not only by bottom-up triggered attention, but also by top-down controlled attention. In addition, the posterior cerebellum and thalamus were activated by top-down controlled attention shifts and the ventromedial prefrontal cortex (VMPFC) was activated by to-be-ignored, but attention-catching salient changes in auditory input streams. VMPFC may be involved in the evaluation of environmental events causing the bottom-up triggered engagement of attention. Auditory working memory activated a brain network that largely overlapped with the one activated by top-down controlled attention. The present results also provide further evidence of the role of the cerebellum in cognitive processing: During auditory working memory tasks, both activity in the posterior cerebellum (the crus I/II) and reaction speed increased when the cognitive load increased. Based on the present results and earlier theories on the role of the cerebellum in cognitive processing, the function of the posterior cerebellum in cognitive tasks may be related to the optimization of response speed.

A conceptualização de bandido em expressões bandido de x: uma perspectiva cognitivista

Com vistas à conceptualização do conceito de BANDIDO em 32 expressões com a estrutura bandido de x, descrevemos, nesta dissertação, os modelos cognitivos idealizados subjacentes à construção de sentido de tais expressões, postulando-lhes um caráter de modelo cognitivo complexo, nos termos de Lakoff (1987), produtivo na língua. Constituem ainda o arcabouço teórico deste estudo a Teoria da Mesclagem Conceptual (FAUCONNIER e TURNER, 2002) e a Teoria da Metáfora Conceptual (LAKOFF e JOHNSON, 1980). A análise das construções bandido de x foi realizada a partir de 137 comentários retirados da internet e definições elaboradas por 15 alunos do ensino fundamental; 18 do ensino médio e 20 alunos do ensino superior. Os alunos que colaboraram com a pesquisa definiram 24 expressões bandido de x. A pesquisa obedeceu ao procedimento qualitativo de análise dos dados, no qual observamos as diferentes interpretações dadas para as expressões, fundamentando-as a partir dos processos cognitivos envolvidos no sentido das mesmas. Assim com base na análise dos comentários de internautas e nas definições de alunos, propomos quatro processos de conceptualização para as expressões bandido de x: (a) conceptualização com base em modelos cognitivos proposicionais, em que x é um locativo interpretado como lugar de origem ou de atuação do bandido bandido de morro, bandido de rua, bandido de cadeia ; (b) conceptualização com base em modelos esquemático-imagéticos, em que observamos a atribuição de uma espécie de escala ao sentido atribuído à construção, culminando em diferentes status para a categoria BANDIDO DE X, subjacente a expressões bandido de primeira/segunda/quinta categoria/linha; (c) conceptualização de BANDIDO DE X com base em modelos metonímicos, em que x é uma peça do vestuário/calçado/acessório, de modo a interpretar o BANDIDO como pertencendo a uma categoria que costuma utilizar determinada peça de roupa, acessório ou calçado bandido de colarinho branco, bandidos de farda, bandido de chinelo ; (d) conceptualização de BANDIDO DE X com base em modelos metafóricos, em que x é um conceito abstrato que pode ser entendido como um objeto possuído pelo bandido, de forma a caracterizá-lo pela maneira de agir ou expertise bandido de conceito, bandido de atitude, bandido de fé. Acreditamos, assim, na possibilidade de descrição de padrões que regem a conceptualização de BANDIDO DE X, cujos sentidos alcançados por meio de modificadores revelam a produtividade e complexidade do modelo cognitivo BANDIDO

A philosophical stance on developing industrially relevant strategic technology management toolkits

When considering the potential uptake and utilization of technology management tools by industry, it must be recognized that companies face the difficult challenges of selecting, adopting and integrating individual tools into a toolkit that must be implemented within their current organizational processes and systems. This situation is compounded by the lack of sound advice on integrating well-founded individual tools into a robust toolkit that has the necessary degree of flexibility such that they can be tailored for application to specific problems faced by individual organizations. As an initial stepping stone to offering a toolkit with empirically proven utility, this paper provides a conceptual foundation to the development of toolkits by outlining an underlying philosophical position based on observations from multiple research and commercial collaborations with industry. This stance is underpinned by a set of operationalized principles that can offer guidance to organizations when deciding upon the appropriate form, functions and features that should be embodied by any potential tool/toolkit. For example, a key objective of any tool is to aid decision-making and a core set of powerful, flexible, scaleable and modular tools should be sufficient to allow users to generate, explore, shape and implement possible solutions across a wide array of strategic issues. From our philosophical stance, the preferred mode of engagement is facilitated workshops with a participatory process that enables multiple perspectives and structures the conversation through visual representations in order to manage the cognitive load in the collaborative environment. The generic form of the tools should be configurable for the given context and utilized in a lightweight manner based on the premise of start small and iterate fast. © 2011 IEEE.

Key principles for developing industrially relevant strategic technology management toolkits

When considering the potential uptake and utilization of technology management tools by industry, it must be recognized that companies face the difficult challenges of selecting, adopting and integrating individual tools into a toolkit that must be implemented within their current organizational processes and systems. This situation is compounded by the lack of sound advice on integrating well-founded individual tools into a robust toolkit that has the necessary degree of flexibility such that they can be tailored for application to specific problems faced by individual organizations. As an initial stepping stone to offering a toolkit with empirically proven utility, this paper provides a conceptual foundation to the development of toolkits by outlining an underlying philosophical position based on observations from multiple research and commercial collaborations with industry. This stance is underpinned by a set of operationalized principles that can offer guidance to organizations when deciding upon the appropriate form, functions and features that should be embodied by any potential tool/toolkit. For example, a key objective of any tool is to aid decision-making and a core set of powerful, flexible, scaleable and modular tools should be sufficient to allow users to generate, explore, shape and implement possible solutions across a wide array of strategic issues. From our philosophical stance, the preferred mode of engagement is facilitated workshops with a participatory process that enables multiple perspectives and structures the conversation through visual representations in order to manage the cognitive load in the collaborative environment. The generic form of the tools should be configurable for the given context and utilized in a lightweight manner based on the premise of 'start small and iterate fast'. © 2012 Elsevier Inc.

视觉搜索中注意捕获的控制机制

Theories of Visual search generally differentiate between bottom-up control and top-down control. Bottom-up control occurs when visual selection is determined by the stimulus properties in the search field. Top-down control takes place when observers are able to select those stimuli that are in line with their attentional sets. Pure stimulus-driven capture and contingent capture are two main theories on attentional capture by now, in which, theory of pure capture more emphasize bottom-up control, while theory of contingent capture more emphasize top-down control. Besides those two theories, Perceptual load theory of attention provides completely new perspective to explain attentional capture. The aim of this study is to investigate the mechanism of attentional capture in visual search on the basis of the existing theory of attentional capture and Perceptual load theory of attention. Three aspects of questions were explored in this study, which includes: the modulation role of perceptual load on attentional capture; the influence of search mode on attentional capture; and the influence of stimuli’s spatial and temporal characteristics on attentional capture. The results showed that: (1) Attentional capture was modulated by perceptual load in both conditions in which perceptual load manipulated either by amount of stimuli or similarity of stimuli. (2) Search mode did influence attentional capture, but more important, which was also modulated by perceptual load. (3) The spatial characteristics of congruent and incongruent distractor did influence attentional capture, specifically, the further the distractor from the target, the more interference effect the distractor had on visual search. (4) The temporal characteristics of distractor did influence attentional capture, specifically, the pattern of results from the study in which distractor were presented after the search display, were similar to those from the study in which distractors were presented before the search display. In sum, the results indicated that attentional capture are controlled not only by bottom-up factors, top-down factors but also modulated by available attention resources. These findings contribute to resolve the controversy for mechanism of attentional capture. And the potential application of this research was discussed.

手持通信设备的多通道文本输入研究

Recently，Handheld Communication Devices is developing very fast, extending in users and spreading in application fields, and has an promising future. This study investigated the acceptance of the multimodal text entry method and the behavioral characteristics when using it. Based on the general information process model of a bimodal system and the human factor studies about the multimodal map system, the present study mainly focused on the hand-speech bimodal text entry method. For acceptance, the study investigated the subjective perception of the accuracy of speech recognition by Wizard of Oz (WOz) experiment and a questionnaire. Results showed that there was a linear relationship between the speech recognition accuracy and the subjective accuracy. Furthermore, as the familiarity increasing, the difference between the acceptable accuracy and the subjective accuracy gradually decreased. In addition, the similarity of meaning between the outcome of speech recognition and the correct sentences was an important referential criterion. The second study investigated three aspects of the bimodal text entry method, including input, error recovery and modal shifts. The first experiment aimed to find the behavioral characteristics of user when doing error recovery task. Results indicated that participants preferred to correct the error by handwriting, which had no relationship with the input modality. The second experiment aimed to discover the behavioral characteristics of users when doing text entry in various types of text. Results showed that users preferred to speech input in both words and sentences conditions, which was highly consistent among individuals, while no significant difference was found between handwriting and speech input in the character condition. Participants used more direct strategy than jumping strategy to deal with mixed text, especially for the Chinese-English mixed type. The third experiment examined the cognitive load in the different modal shifts, results suggesting that there were significant differences between different shifts. Moreover, relevant little time was needed in the Shift from speech input to hand input. Based on the main findings, implications were discussed as follows: Firstly, when evaluating a speech recognition system, attention should be paid to the fact that the speech recognition accuracy was not equal to the subjective accuracy. Secondly, in order to make a speech input system more acceptable, a good method is to train and supply the feedback for the accuracy in training, which improving the familiarity and sensitivity to the system. Thirdly, both the universal and individual behavioral patterns were taken into consideration to improve the error recovery method. Fourthly, easing the study and the use of speech input, the operations of speech input should be simpler. Fifthly, more convenient text input method for non-Chinese text entry should be provided. Finally, the shifting time between hand input and speech input provides an important parameter for the design of automatic-evoked speech recognition system.

学前儿童朴素生物学“理论”的发展——对“生长”认知的实验研究

There is a debate in cognitive development theory on whether cognitive development is general or specific. More and more researchers think that cognitive development is domain specific. People start to investigate preschoolers' native theory of human being's basic knowledge systems. Naive biology is one of the core domains. But there is argument whether there is separate native biological concepts among preschoolers. The research examined preschoolers' cognitive development of naive biological theory on two levels which is "growth" and "aliveness", and it also examined individual difference and factors that lead to the difference. Three studies were designed. Study 1 was to study preschoolers' cognition on growth, which is a basic trait of living things, and whether children can distinguish living and non-living things with the trait and understanding the causality. Study 2 was to investigate preschoolers' distinction between living things and non-living things from an integrated level. Study 3 was to investigate how children make inferences to unfamiliar things with their domain specific knowledge. The results showed the following: 1. Preschoolers gradually developed naive theory of biology on growth level, but their naive theory on integrated level has not developed. 2 Preschoolers' naive theory of biology is not "all or none", 4- and 5-year-old children showed some distinction between living and non-living things to some extent, they use non-intentional reason to explain the cause of growth and their explanation showed coherence. But growth has not been a criteria of ontological distinction of living and non-living things for 4- and 5-year-old children, most 6-year-old children can distinguish between living and non-living things, and these show the developing process of biological cognition. 3. Preschoolers' biological inference is influenced by their domain-specific knowledge, whether they can make inference to new trait of living things depends on whether they have specific knowledge. In the deductive task, children use their knowledge to make inference to unfamiliar things. 4-year-olds use concrete knowledge more often while the 6-year-old use generalized knowledge more frequency. 4. Preschoolers' knowledge grow with age, but individuals' cognitive development speed at different period. Urban and rural educational background affect cognitive performance. As time goes by, the urban-rural knowledge difference to distinguish living and nonliving things reduces. And preschoolers' are at the same developmental stage because the three age groups have similar causal explanation both in quantity and quality. 5. There is intra-individual difference on preschoolers' naive biological cognition. They show different performance on different tasks and domains, and their cognitive development is sequential, they understand growth earlier than they understand "alive", which is an integrated concept. The intra-individual differences decrease with age.

I'll have what she's having: Effects of social influence and body type on the food choices of others

This research examines how the body type of consumers affects the food consumption of other consumers around them. We find that consumers anchor on the quantities others around them select but that these portions are adjusted according to the body type of the other consumer. We find that people choose a larger portion following another consumer who first selects a large quantity but that this portion is significantly smaller if the other is obese than if she is thin. We also find that the adjustment is more pronounced for consumers who are low in appearance self-esteem and that it is attenuated under cognitive load. © 2009 by Journal of Consumer Research, Inc.

We want to touch IT. Are hybrid laptops just new fancy gadgets or a new revolution?

While the number of traditional laptops and computers sold has dipped slightly year over year, manufacturers have developed new hybrid laptops with touch screens to build on the tactile trend. This market is moving quickly to make touch the rule rather than the exception and the sales of these devices have tripled since the launch of Windows 8 in 2012, to reach more than sixty million units sold in 2015. Unlike tablets, that benefit from easy-to-use applications specially designed for tactile interactions, hybrid laptops are intended to be used with regular user-interfaces. Hence, one could ask whether tactile interactions are suited for every task and activity performed with such interfaces. Since hybrid laptops are increasingly used in educational situations, this study focuses on information search tasks which are commonly performed for learning purposes. It is hypothesized that tasks that require complex and/or less common gestures will increase user's cognitive load and impair task performance in terms of efficacy and efficiency. A study was carried out in a usability laboratory with 30 participants for whom prior experience with tactile devices has been controlled. They were asked to perform information search tasks on an online encyclopaedia by using only the touch screen of and hybrid laptop. Tasks were selected with respect to their level of cognitive demand (amount of information that had to be maintained in working memory) and the complexity of gestures needed (left and/or right clicks, zoom, text selection and/or input.), and grouped into 4 sets accordingly. Task performance was measured by the number of tasks succeeded (efficacy) and time spent on each task (efficiency). Perceived cognitive load was assessed thanks to a questionnaire given after each set of tasks. An eye tracking device was used to monitor users' attention allocation and to provide objective cognitive load measures based on pupil dilation and the Index of Cognitive Activity. Each experimental run took approximately one hour. The results of this within-subjects design indicate that tasks involving complex gestures led to a lower efficacy, especially when the tasks were cognitively demanding. Regarding efficacy, there is no significant differences between sets of tasks excepted for tasks with low cognitive demand and complex gestures that required more time to be achieved. Surprisingly, users that declared the biggest experience with tactile devices spent more time than less frequent users. Cognitive load measures indicate that participants reported having devoted more mental effort in the interaction when they had to use complex gestures.

Working Memory and Postural Control: Adult Age Differences in Potential for Improvement, Task Priority, and Dual Tasking

We investigate dynamic posture control and working memory (NBack) retest practice in young and older adults, focusing on older adults' potential for improvement in the component tasks but more importantly in dual-task performance. Participants performed the 2 tasks in 11 sessions under single- and dual-task conditions. Posture improvement was observed with retest practice for both groups. Increase in cognitive load after initial practice led to greater dual-task costs in both tasks in older adults and higher costs in memory in young adults. With continued practice, costs were reduced by both groups; however, the 2 groups focused improvement on different tasks: Older adults focused on posture but young adults on cognition. These results emphasize older adults' potential for improvement in dual-task performance and their flexibility to utilize the practice gains in posture to optimize cognitive performance.

The Engine of Thought Is a Hybrid: Roles of Associative and Structured Knowledge in Reasoning

Across a range of domains in psychology different theories assume different mental representations of knowledge. For example, in the literature on category-based inductive reasoning, certain theories (e.g., Rogers & McClelland, 2004; Sloutsky & Fisher, 2008) assume that the knowledge upon which inductive inferences are based is associative, whereas others (e.g., Heit & Rubinstein, 1994; Kemp & Tenenbaum, 2009; Osherson, Smith, Wilkie, López, & Shafir, 1990) assume that knowledge is structured. In this article we investigate whether associative and structured knowledge underlie inductive reasoning to different degrees under different processing conditions. We develop a measure of knowledge about the degree of association between categories and show that it dissociates from measures of structured knowledge. In Experiment 1 participants rated the strength of inductive arguments whose categories were either taxonomically or causally related. A measure of associative strength predicted reasoning when people had to respond fast, whereas causal and taxonomic knowledge explained inference strength when people responded slowly. In Experiment 2, we also manipulated whether the causal link between the categories was predictive or diagnostic. Participants preferred predictive to diagnostic arguments except when they responded under cognitive load. In Experiment 3, using an open-ended induction paradigm, people generated and evaluated their own conclusion categories. Inductive strength was predicted by associative strength under heavy cognitive load, whereas an index of structured knowledge was more predictive of inductive strength under minimal cognitive load. Together these results suggest that associative and structured models of reasoning apply best under different processing conditions and that the application of structured knowledge in reasoning is often effortful.

Padrões de interacção num ambiente de aprendizagem colaborativa a distância : um estudo de caso com conteúdos estruturados segundo a teoria da flexibilidade cognitiva

A Globalização a que assistimos actualmente traz consigo exigências que a Sociedade deve responder de forma efectiva e adequada. O eLearning constitui, assim, uma realidade capaz de congregar esforços no sentido de permitir a construção de comunidades empenhadas em adquirir as competências necessárias para enfrentar os desafios propostos pela Globalização. É nesta perspectiva que apresentamos este estudo que procura, na sua essência, compreender o processo de interacção num ambiente de aprendizagem colaborativo a distância entre alunos de Línguas Clássicas. Cientes da importância de promover uma aprendizagem com significado para os alunos, foram desenvolvidos conteúdos que representaram o conhecimento segundo os pressupostos pedo-didácticos da Teoria da Flexibilidade Cognitiva de forma a serem trabalhados colaborativamente pelos participantes no fórum de discussão online Scaena. O trabalho desenvolvido pelos alunos decorreu ao longo de três sessões e foi integrado na disciplina de Tecnologia Educativa constante do programa curricular do 2º Semestre do 4º Ano da Licenciatura de Português, Latim e Grego, no ano lectivo de 2004-05. De índole qualitativa, a investigação efectuada privilegiou a análise de conteúdo a fim de proceder ao tratamento de dados. Para o efeito foi, ainda, utilizado o software de análise NUD*IST. Os resultados relevaram a ocorrência de padrões de interacção em todas as dimensões de análise, assim como tornaram evidente o processo de construção de conhecimento flexível numa plataforma de ensino online. Por último, os resultados apurados confirmam as mais-valias da utilização das Tecnologias da Informação e Comunicação para os Estudos Clássicos em contexto educativo. São, ainda, apresentadas sugestões para futuros estudos. ABSTRACT: The Globalisation we witness nowadays brings with it demands to which Society has to answer effectivelly and adequatelly. eLearning constitutes, therefore, a reality capable of congregating efforts towards allowing for the construction of communities involved in acquiring the necessary competences to face the challenges proposed by Globalisation. It is against this background that we present this study which aims, in its essence, at understanding the process of interaction in a collaborative distance learning environment between Classical Languages students. Being aware of the importance of promoting learning that is meaningful for the students, contents were developed representing knowledge according to Cognitive Flexibility Theory pedagogical and didactic principles. These would have to be worked on collaboratively by the participants in the study in the online discussion fórum Scaena. The work developed by the students evolved along three sessions and was integrated in the subject Educational Technology, which was part of the curriculum of the Portuguese, Latin and Greek Teacher Education Degree, 2nd Semestre, 4th year, in the academic year of 2004-05. Of a qualitative nature, the study conducted priviledged content analysis of data. For this effect the analysis software NUD*IST was used. Results revealed the occurrence of interaction patterns in all dimensions of analysis as well as the evidence of the process of flexible construction of knowledge in an oline learning platform. Finally the results obtained confirm the added value of the use of Information and Communication Technologies for Classical Studies in the educational context. Suggestions for future studies are put forward.

Compreensão do texto escrito em inglês língua estrangeira: estudo de caso sobre o uso de um hipermédia de flexibilidade cognitiva

O presente estudo, no âmbito da Didática do Inglês, incidiu sobre a compreensão do texto escrito em Inglês, língua estrangeira, num ambiente de aprendizagem hipermédia, o DidaktosOnLine (Moreira et al., 2005). A investigação teve como objetivos avaliar a importância das características do design do hiperdocumento e de características dos participantes no estudo, tais como conhecimentos de língua inglesa, estilos de aprendizagem ou preferências epistémicas, na compreensão dos textos do hiperdocumento Images of Britain and the British. Pretendeu-se ainda avaliar a opinião dos participantes sobre a utilização do DidaktosOnLine para aceder a documentos e estudar um tema do programa. A importância do desenvolvimento da competência de compreensão de textos escritos no âmbito da aprendizagem do Inglês no Ensino Superior e as dificuldades dos alunos na compreensão dos textos mais complexos e nas tarefas que exigem transferência de conhecimentos constituem a justificação para a escolha da problemática deste estudo. A plataforma DidaktosOnLine foi desenvolvida na Universidade de Aveiro, com base nos princípios da Teoria da Flexibilidade Cognitiva (Spiro et al, 1988). É uma ferramenta hipermédia que permite a organização didática de vários tipos de materiais, por exemplo texto, imagem, som e vídeo. A investigação efetuada utilizou uma abordagem de estudo de caso. Duas turmas de alunos do curso de Ciências da Comunicação da Escola Superior de Educação e Comunicação da Universidade do Algarve utilizaram a plataforma em contexto de sala de aula. Da análise dos resultados conclui-se que as características do hiperdocumento são importantes para a compreensão dos textos, com particular destaque para os recursos que integram os minicasos e as sequências que permitem uma leitura cruzada da informação. Quanto às características dos participantes, são relevantes os conhecimentos de língua inglesa, as preferências epistémicas e os estilos de aprendizagem, sobretudo no que diz respeito a algumas subescalas do constructo utilizado. A avaliação da plataforma e do hiperdocumento utilizado é globalmente positiva, tendo os participantes referido que permite uma forma de aprender diferente. A reflexão sobre os resultados do estudo leva-nos a recomendar práticas de ensino da leitura adequadas aos novos modos de ler utilizando os media digitais, que dão ênfase ao papel ativo do leitor na construção de significado, e para as quais o DidaktosOnLine dá um contributo relevante. Apresentam-se sugestões para estudos futuros.

The Lived Experience of Nursing Students With Formative Assessment Formally Embedded in Clinical Courses: A Transcendental Phenomenological Study

The potential of formative assessment (FA) for informing learning in classroom-based nursing courses is clearly established in the literature; however, research on FA in clinical courses remains scarce. This inquiry explored the lived experience of nursing students using transcendental phenomenology and described the phenomenon of being assessed in clinical courses. The research question guiding the study was: How is the phenomenon of assessment experienced by nursing students when FA is formally embedded in clinical courses? Inherent in this question were the following issues: (a) the meaning of clinical experiences for nursing students, (b) the meaning of being assessed through FA, and (c) what it is like to be assessed when FA is formally embedded within clinical experiences. The noematic themes that illuminated the whatness of the participants’ experience were (a) enabled cognitive activity, (b) useful feedback, (c) freedom to be, (d) enhanced focus, (e) stress moderator, and (f) respectful mentorship. The noetic themes associated with how the phenomenon was experienced were related to bodyhood, temporality, spatiality, and relationship to others. The results suggest a fundamental paradigm shift from traditional nursing education to a more pervasive integration of FA in clinical courses so that students have time to learn before being graded on their practice. Furthermore, this inquiry and the literature consulted provide evidence that using cognitive science theory to inform and reform clinical nursing education is a timely option to address the repeated calls from nursing leaders to modernize nursing education. This inquiry contributes to reduce our reliance on assumptions derived from research on FA in nursing classrooms and provides evidence based on the reality of using formative assessment in clinical courses. Recommendations for future research are presented.

Un outil d’évaluation neurocognitive des interactions humain-machine

De plus en plus de recherches sur les Interactions Humain-Machine (IHM) tentent d’effectuer des analyses fines de l’interaction afin de faire ressortir ce qui influence les comportements des utilisateurs. Tant au niveau de l’évaluation de la performance que de l’expérience des utilisateurs, on note qu’une attention particulière est maintenant portée aux réactions émotionnelles et cognitives lors de l’interaction. Les approches qualitatives standards sont limitées, car elles se fondent sur l’observation et des entrevues après l’interaction, limitant ainsi la précision du diagnostic. L’expérience utilisateur et les réactions émotionnelles étant de nature hautement dynamique et contextualisée, les approches d’évaluation doivent l’être de même afin de permettre un diagnostic précis de l’interaction. Cette thèse présente une approche d’évaluation quantitative et dynamique qui permet de contextualiser les réactions des utilisateurs afin d’en identifier les antécédents dans l’interaction avec un système. Pour ce faire, ce travail s’articule autour de trois axes. 1) La reconnaissance automatique des buts et de la structure de tâches de l’utilisateur, à l’aide de mesures oculométriques et d’activité dans l’environnement par apprentissage machine. 2) L’inférence de construits psychologiques (activation, valence émotionnelle et charge cognitive) via l’analyse des signaux physiologiques. 3) Le diagnostic de l‘interaction reposant sur le couplage dynamique des deux précédentes opérations. Les idées et le développement de notre approche sont illustrés par leur application dans deux contextes expérimentaux : le commerce électronique et l’apprentissage par simulation. Nous présentons aussi l’outil informatique complet qui a été implémenté afin de permettre à des professionnels en évaluation (ex. : ergonomes, concepteurs de jeux, formateurs) d’utiliser l’approche proposée pour l’évaluation d’IHM. Celui-ci est conçu de manière à faciliter la triangulation des appareils de mesure impliqués dans ce travail et à s’intégrer aux méthodes classiques d’évaluation de l’interaction (ex. : questionnaires et codage des observations).