Ethics in the flesh: formalizing moral values in embodied cognition

Values are beliefs or principles that are deemed significant or desirable within a specific society or culture, serving as the fundamental underpinnings for ethical and socio-behavioral norms. The objective of this research is to explore the domain encompassing moral, cultural, and individual values. To achieve this, we employ an ontological approach to formally represent the semantic relations within the value domain. The theoretical framework employed adopts Fillmore’s frame semantics, treating values as semantic frames. A value situation is thus characterized by the co-occurrence of specific semantic roles fulfilled within a given event or circumstance. Given the intricate semantics of values as abstract entities with high social capital, our investigation extends to two interconnected domains. The first domain is embodied cognition, specifically image schemas, which are cognitive patterns derived from sensorimotor experiences that shape our conceptualization of entities in the world. The second domain pertains to emotions, which are inherently intertwined with the realm of values. Consequently, our approach endeavors to formalize the semantics of values within an embodied cognition framework, recognizing values as emotional-laden semantic frames. The primary ontologies proposed in this work are: (i) ValueNet, an ontology network dedicated to the domain of values; (ii) ISAAC, the Image Schema Abstraction And Cognition ontology; and (iii) EmoNet, an ontology for theories of emotions. The knowledge formalization adheres to established modeling practices, including the reuse of semantic web resources such as WordNet, VerbNet, FrameNet, DBpedia, and alignment to foundational ontologies like DOLCE, as well as the utilization of Ontology Design Patterns. These ontological resources are operationalized through the development of a fully explainable frame-based detector capable of identifying values, emotions, and image schemas generating knowledge graphs from from natural language, leveraging the semantic dependencies of a sentence, and allowing non trivial higher layer knowledge inferences.

Social Cognition: New Insights from Affordance and Simon Effects

The perspective of the present project can be inscribed in the so-called “Social Cognition” framework, that in the last years moved from a focus on the individual mind toward embodied and participatory aspects of social understanding. Among the topics relevant for social cognition, the aim of the thesis was to shed more light on motor resonance and joint action, by using two well-known effects of cognitive psychology: “Affordance” and “Simon”. In the first part of the project, the Affordance effect has been considered, starting from Gibson to some post-Gibsonian theorizations. Particular attention has received the notion of “Micro-affordance”. The theoretical and empirical overview allows to understand how it can be possible to use the affordance effect to investigate the issue of motor resonance. A first study employed a priming paradigm and explored both in adults and school-age children the influence of a micro-affordance that can be defined dangerousness, and how motor resonance develops. The second part of the thesis focused on the Simon effect, starting with the presentation of the “stimulus–response (S–R) compatibility effect” to introduce the “Simon effect”. Particular attention has been dedicated to recent studies on the “joint Simon effect”. The reviewed empirical findings have been discussed in a wider theoretical perspective on joint action. The second study was aimed at investigating whether shared representations, as indexed by the presence of the joint Simon effect, are modulated by minimal ingroup–outgroup distinctions and by experienced interdependence between participants. The third study explored to what extent prior experience could modulate performance in task sharing, combining two paradigms of cognitive psychology, the joint Simon and the joint transfer-of-learning. In a general discussion the results obtained in the three studies have been summarized, emphasizing their original contribution and their importance within the Social Cognition research.

Cognition in context: Evidence on affordances and verbal language

This thesis investigated affordances and verbal language to demonstrate the flexibility of embodied simulation processes. Starting from the assumption that both object/action understanding and language comprehension are tied to the context in which they take place, six studies clarified the factors that modulate simulation. The studies in chapter 4 and 5 investigated affordance activation in complex scenes, revealing the strong influence of the visual context, which included either objects and actions, on compatibility effects. The study in chapter 6 compared the simulation triggered by visual objects and objects names, showing differences depending on the kind of materials processed. The study in chapter 7 tested the predictions of the WAT theory, confirming that the different contexts in which words are acquired lead to the difference typically observed in the literature between concrete and abstract words. The study in chapter 8 on the grounding of abstract concepts tested the mapping of temporal contents on the spatial frame of reference of the mental timeline, showing that metaphoric congruency effects are not automatic, but flexibly mediated by the context determined by the goals of different tasks. The study in chapter 9 investigated the role of iconicity in verbal language, showing sound-to-shape correspondences when every-day object figures, result that validated the reality of sound-symbolism in ecological contexts. On the whole, this evidence favors embodied views of cognition, and supports the hypothesis of a high flexibility of simulation processes. The reported conceptual effects confirm that the context plays a crucial role in affordances emergence, metaphoric mappings activation and language grounding. In conclusion, this thesis highlights that in an embodied perspective cognition is necessarily situated and anchored to a specific context, as it is sustained by the existence of a specific body immersed in a specific environment.

Negoziare confini: dagli stati di cose ai transiti

Negotiating boundaries: from state of affairs to matter of transit. The research deals with the everyday management of spatial uncertainty, starting with the wider historical question of terrains vagues (a French term for wastelands, dismantled areas and peripheral city voids, or interstitial spaces) and focusing later on a particular case study. The choice intended to privilege a small place (a mouth of a lagoon which crosses a beach), with ordinary features, instead of the esthetical “vague terrains”, often witnessed through artistic media or architectural reflections. This place offered the chance to explore a particular dimension of indeterminacy, mostly related with a certain kind of phenomenal instability of its limits, the hybrid character of its cultural status (neither natural, nor artificial) and its crossover position as a transitional space, between different tendencies and activities. The first theoretical part of the research develops a semiotic of vagueness, by taking under exam the structuralist idea of relation, in order to approach an interpretive notion of continuity and indeterminacy. This exploration highlights the key feature of actantial network distribution, which provides a bridge with the second methodological parts, dedicated to a “tuning” of the tools for the analysis. This section establishes a dialogue with current social sciences (like Actor-Network Theory, Situated action and Distributed Cognition), in order to define some observational methods for the documentation of social practices, which could be comprised in a semiotic ethnography framework. The last part, finally, focuses on the mediation and negotiation by which human actors are interacting with the varying conditions of the chosen environment, looking at people’s movements through space, their embodied dealings with the boundaries and the use of spatial artefacts as framing infrastructure of the site.

Macchine esperienziali: Narrativa, cognizione e atto di lettura

La mia tesi si riallaccia al dibattito teorico-letterario contemporaneo sulla possibilità di un approccio cognitivo alla narrativa e alla letteratura in particolare. Essa si propone di esplorare il rapporto tra narrazione ed esperienza, ridefinendo il concetto di “esperienzialità” della narrativa introdotto da Monika Fludernik nel suo Towards a “Natural” Narratology (1996). A differenza di Fludernik, che ha identificato l’esperienzialità con la rappresentazione dell’esperienza dei personaggi, la mia trattazione assegna un ruolo di primo piano al lettore, cercando di rispondere alla domanda: perché leggere una storia è – o si costituisce come – un’esperienza? L’intuizione dietro tutto ciò è che le teorizzazioni dell’esperienza e della coscienza nella filosofia della mente degli ultimi venti anni possano gettare luce sull’interazione tra lettori e testi narrativi. Il mio punto di riferimento principale è la scienza cognitiva “di seconda generazione”, secondo cui l’esperienza è un relazionarsi attivo e corporeo al mondo. La prima parte del mio studio è dedicata all’intreccio tra la narrativa e quello che chiamo lo “sfondo esperienziale” di ogni lettore, un repertorio di esperienze già note ai lettori attraverso ripetute interazioni con il mondo fisico e socio-culturale. Mi soffermo inoltre sul modo in cui relazionarsi a un testo narrativo può causare cambiamenti e slittamenti in questo sfondo esperienziale, incidendo sulla visione del mondo del lettore. Mi rivolgo poi al coinvolgimento corporeo del lettore, mostrando che la narrativa può attingere allo sfondo esperienziale dei suoi fruitori anche sul piano dell’esperienza di base: le simulazioni corporee della percezione contribuiscono alla nostra comprensione delle storie, incidendo sia sulla ricostruzione dello spazio dell’ambientazione sia sulla relazione intersoggettiva tra lettori e personaggi. Infine, mi occupo del rapporto tra l’esperienza della lettura e la pratica critico-letteraria dell’interpretazione, sostenendo che – lungi dal costituire due modalità opposte di fruizione dei testi – esse sono intimamente connesse.

Language, action, and sensoriality: a multimodal analysis of interactions in inclusive sport climbing with visually impaired athletes

In sport climbing, athletes with vision impairments are constantly accompanied by their guides – usually trainers – both during the preparatory inspection of the routes and whilst climbing. Trainers are, so to speak, the climbers’ eyes, in the sense that they systematically put their vision in the service of the climbers’ mobility and sporting performance. The synergy between trainers and athletes is based on peculiar, strictly multimodal interactive practices that are focused on the body and on its constantly evolving sensory engagement with the materiality of routes. In this context, sensory perception and embodied actions required to plan and execute the climb are configured as genuinely interactive accomplishments. Drawing on the theoretical framework of Embodied and Situated Cognition and on the methodology of Conversation Analysis, this thesis engages in the multimodal analysis of trainer-athlete interactions in paraclimbing. The analysis is based on a corpus of video recorded climbing sessions. The major findings of the study can be summarized as follows. 1) Intercorporeality is key to interactions between trainers and athletes with visual impairments. The participants orient to perceiving the climbing space and acting in it as a ‘We’. 2) The grammar, lexicon, prosody, and timing of the trainers’ instructions are finely tuned to the ongoing corporeal experience of the climbers. 3) Climbers with visual impairments build their actions by using sensory resources that are provided by their trainers. This result is of particular importance as it shows that resources and constraints for action are in a fundamental way constituted in interaction with Others and with specific socio-material ecologies, rather than being defined a priori by the organs and functions of individuals’ body and mind. Individual capabilities are thus enhanced and extended in interaction, which encourages a more ecological view of (dis)ability.

Variety, flexibility, and use of abstract concepts. A multiple grounded perspective.

The nature of concepts is a matter of intense debate in cognitive sciences. While traditional views claim that conceptual knowledge is represented in a unitary symbolic system, recent Embodied and Grounded Cognition theories (EGC) submit the idea that conceptual system is couched in our body and influenced by the environment (Barsalou, 2008). One of the major challenges for EGC is constituted by abstract concepts (ACs), like fantasy. Recently, some EGC proposals addressed this criticism, arguing that the ACs comprise multifaced exemplars that rely on different grounding sources beyond sensorimotor one, including interoception, emotions, language, and sociality (Borghi et al., 2018). However, little is known about how ACs representation varies as a function of life experiences and their use in communication. The theoretical arguments and empirical studies comprised in this dissertation aim to provide evidence on multiple grounding of ACs taking into account their varieties and flexibility. Study I analyzed multiple ratings on a large sample of ACs and identified four distinct subclusters. Study II validated this classification with an interference paradigm involving motor/manual, interoceptive, and linguistic systems during a difficulty rating task. Results confirm that different grounding sources are activated depending on ACs kind. Study III-IV investigate the variability of institutional concepts, showing that the higher the law expertise level, the stronger the concrete/emotional determinants in their representation. Study V introduced a novel interactive task in which abstract and concrete sentences serve as cues to simulate conversation. Analysis of language production revealed that the uncertainty and interactive exchanges increase with abstractness, leading to generating more questions/requests for clarifications with abstract than concrete sentences. Overall, results confirm that ACs are multidimensional, heterogeneous, and flexible constructs and that social and linguistic interactions are crucial to shaping their meanings. Investigating ACs in real-time dialogues may be a promising direction for future research.