Social Cognition: New Insights from Affordance and Simon Effects

The perspective of the present project can be inscribed in the so-called “Social Cognition” framework, that in the last years moved from a focus on the individual mind toward embodied and participatory aspects of social understanding. Among the topics relevant for social cognition, the aim of the thesis was to shed more light on motor resonance and joint action, by using two well-known effects of cognitive psychology: “Affordance” and “Simon”. In the first part of the project, the Affordance effect has been considered, starting from Gibson to some post-Gibsonian theorizations. Particular attention has received the notion of “Micro-affordance”. The theoretical and empirical overview allows to understand how it can be possible to use the affordance effect to investigate the issue of motor resonance. A first study employed a priming paradigm and explored both in adults and school-age children the influence of a micro-affordance that can be defined dangerousness, and how motor resonance develops. The second part of the thesis focused on the Simon effect, starting with the presentation of the “stimulus–response (S–R) compatibility effect” to introduce the “Simon effect”. Particular attention has been dedicated to recent studies on the “joint Simon effect”. The reviewed empirical findings have been discussed in a wider theoretical perspective on joint action. The second study was aimed at investigating whether shared representations, as indexed by the presence of the joint Simon effect, are modulated by minimal ingroup–outgroup distinctions and by experienced interdependence between participants. The third study explored to what extent prior experience could modulate performance in task sharing, combining two paradigms of cognitive psychology, the joint Simon and the joint transfer-of-learning. In a general discussion the results obtained in the three studies have been summarized, emphasizing their original contribution and their importance within the Social Cognition research.

Cognition in context: Evidence on affordances and verbal language

This thesis investigated affordances and verbal language to demonstrate the flexibility of embodied simulation processes. Starting from the assumption that both object/action understanding and language comprehension are tied to the context in which they take place, six studies clarified the factors that modulate simulation. The studies in chapter 4 and 5 investigated affordance activation in complex scenes, revealing the strong influence of the visual context, which included either objects and actions, on compatibility effects. The study in chapter 6 compared the simulation triggered by visual objects and objects names, showing differences depending on the kind of materials processed. The study in chapter 7 tested the predictions of the WAT theory, confirming that the different contexts in which words are acquired lead to the difference typically observed in the literature between concrete and abstract words. The study in chapter 8 on the grounding of abstract concepts tested the mapping of temporal contents on the spatial frame of reference of the mental timeline, showing that metaphoric congruency effects are not automatic, but flexibly mediated by the context determined by the goals of different tasks. The study in chapter 9 investigated the role of iconicity in verbal language, showing sound-to-shape correspondences when every-day object figures, result that validated the reality of sound-symbolism in ecological contexts. On the whole, this evidence favors embodied views of cognition, and supports the hypothesis of a high flexibility of simulation processes. The reported conceptual effects confirm that the context plays a crucial role in affordances emergence, metaphoric mappings activation and language grounding. In conclusion, this thesis highlights that in an embodied perspective cognition is necessarily situated and anchored to a specific context, as it is sustained by the existence of a specific body immersed in a specific environment.

Language, action, and sensoriality: a multimodal analysis of interactions in inclusive sport climbing with visually impaired athletes

In sport climbing, athletes with vision impairments are constantly accompanied by their guides – usually trainers – both during the preparatory inspection of the routes and whilst climbing. Trainers are, so to speak, the climbers’ eyes, in the sense that they systematically put their vision in the service of the climbers’ mobility and sporting performance. The synergy between trainers and athletes is based on peculiar, strictly multimodal interactive practices that are focused on the body and on its constantly evolving sensory engagement with the materiality of routes. In this context, sensory perception and embodied actions required to plan and execute the climb are configured as genuinely interactive accomplishments. Drawing on the theoretical framework of Embodied and Situated Cognition and on the methodology of Conversation Analysis, this thesis engages in the multimodal analysis of trainer-athlete interactions in paraclimbing. The analysis is based on a corpus of video recorded climbing sessions. The major findings of the study can be summarized as follows. 1) Intercorporeality is key to interactions between trainers and athletes with visual impairments. The participants orient to perceiving the climbing space and acting in it as a ‘We’. 2) The grammar, lexicon, prosody, and timing of the trainers’ instructions are finely tuned to the ongoing corporeal experience of the climbers. 3) Climbers with visual impairments build their actions by using sensory resources that are provided by their trainers. This result is of particular importance as it shows that resources and constraints for action are in a fundamental way constituted in interaction with Others and with specific socio-material ecologies, rather than being defined a priori by the organs and functions of individuals’ body and mind. Individual capabilities are thus enhanced and extended in interaction, which encourages a more ecological view of (dis)ability.