Language and Embodiment: sensory-motor and linguistic-social experience. Evidence on sentence comprehension

In this work I address the study of language comprehension in an “embodied” framework. Firstly I show behavioral evidence supporting the idea that language modulates the motor system in a specific way, both at a proximal level (sensibility to the effectors) and at the distal level (sensibility to the goal of the action in which the single motor acts are inserted). I will present two studies in which the method is basically the same: we manipulated the linguistic stimuli (the kind of sentence: hand action vs. foot action vs. mouth action) and the effector by which participants had to respond (hand vs. foot vs. mouth; dominant hand vs. non-dominant hand). Response times analyses showed a specific modulation depending on the kind of sentence: participants were facilitated in the task execution (sentence sensibility judgment) when the effector they had to use to respond was the same to which the sentences referred. Namely, during language comprehension a pre-activation of the motor system seems to take place. This activation is analogous (even if less intense) to the one detectable when we practically execute the action described by the sentence. Beyond this effector specific modulation, we also found an effect of the goal suggested by the sentence. That is, the hand effector was pre-activated not only by hand-action-related sentences, but also by sentences describing mouth actions, consistently with the fact that to execute an action on an object with the mouth we firstly have to bring it to the mouth with the hand. After reviewing the evidence on simulation specificity directly referring to the body (for instance, the kind of the effector activated by the language), I focus on the specific properties of the object to which the words refer, particularly on the weight. In this case the hypothesis to test was if both lifting movement perception and lifting movement execution are modulated by language comprehension. We used behavioral and kinematics methods, and we manipulated the linguistic stimuli (the kind of sentence: the lifting of heavy objects vs. the lifting of light objects). To study the movement perception we measured the correlations between the weight of the objects lifted by an actor (heavy objects vs. light objects) and the esteems provided by the participants. To study the movement execution we measured kinematics parameters variance (velocity, acceleration, time to the first peak of velocity) during the actual lifting of objects (heavy objects vs. light objects). Both kinds of measures revealed that language had a specific effect on the motor system, both at a perceptive and at a motoric level. Finally, I address the issue of the abstract words. Different studies in the “embodied” framework tried to explain the meaning of abstract words The limit of these works is that they account only for subsets of phenomena, so results are difficult to generalize. We tried to circumvent this problem by contrasting transitive verbs (abstract and concrete) and nouns (abstract and concrete) in different combinations. The behavioral study was conducted both with German and Italian participants, as the two languages are syntactically different. We found that response times were faster for both the compatible pairs (concrete verb + concrete noun; abstract verb + abstract noun) than for the mixed ones. Interestingly, for the mixed combinations analyses showed a modulation due to the specific language (German vs. Italian): when the concrete word precedes the abstract one responses were faster, regardless of the word grammatical class. Results are discussed in the framework of current views on abstract words. They highlight the important role of developmental and social aspects of language use, and confirm theories assigning a crucial role to both sensorimotor and linguistic experience for abstract words.

Novel ready-to-eat mango product using gellan gum as gelling agent: physico-chemical, microbial and sensory characteristics

Este trabalho foi efectuado com o apoio da Universidade de Lisboa, Instituto Superior de Agronomia com o Centro de Engenharia dos Biossistemas (CEER

MOLECULAR REORGANIZATION FOLLOWING SENSORY STIMULATION IN THE ADULT MOUSE BARREL CORTEX

Sensory information is an important factor in shaping neuronal circuits during development and adulthood. In the barrel cortex of adult rodents, cells from layer IV are able to adapt their functional state to an increased flow of sensory information from the mystacial whisker follicles. Previous studies in our group have shown that whisker stimulation induces the formation of inhibitory synapses in the corresponding barrel (Knott et al., 2002) and decreases neuronal responses toward the deflection of the stimulated whisker (Quairiaux et al., 2007). Together these observations have turned the barrel cortex into a model to study homeostatic plasticity. At the cellular level, neuronal activity triggers intracellular signaling cascades leading to a transcriptional response. To further characterize the molecular pathways involved in the synaptic changes after whisker stimulation in the adult mouse, a previous doctoral student in our group performed a microarray analysis on laser-dissected barrels in sections through layer IV. This study identified the regulation (up and down) of a series of genes in the stimulated barrels (thesis of Johnston-Wenger, 2010). We here focused on ten genes that presented the highest fold change according to the microarray analysis. Out of these genes, 7 are known as neuronal activity-dependent genes (Tnncl, Nptx2, Sorcs3, Ptgs2, Nr4a2, Npas4 and Adcyapl) whereas three have so far not been related to neuronal plasticity (Scn7a, Pcdhl5 and Cede3). The study aimed at confirming the results of the microarray analysis and localizing molecular modifications in the stimulated barrel column at the cellular level. In situ hybridization for Pcdhl5 after different periods of whisker stimulation (3, 6, 9, 15, 24 hrs) allowed us to confirm that the 1.25 fold change used for the microarray analysis is an appropriate threshold for considering a regulation significant after sensory-stimulation. Moreover, we confirmed with in situ hybridization a significant upregulation of the genes of interest in the stimulated barrels. In situ hybridization and immunohistochemistry allowed us to observe the distribution of the genes of interest and the corresponding protein products at the cellular level. Three observations were made: 1) alterations of the expression was restricted to the stimulated barrels for all genes tested; 2) within a barrel column not all cells responded to whisker stimulation with an altered gene expression; 3) in the stimulated barrels, two different patterns of mRNA and protein expression can be distinguished. We hypothesize that this segregation of the activity-induced gene expression reflects the segregation of the two principal thalamocortical pathways conveying the sensory information to the barrel cortex. Moreover, only neurons reaching the critical threshold will modify their gene expression program resulting in structural as well as physiological modifications that prevent the subsequent propagation of the excess of excitation to the postsynaptic targets. The activity-induced gene expression is therefore adapted in a cell-type-specific manner to induce a homeostatic response to the entire neuronal network involved in the integration of the sensory information. This to our knowledge the first study showing the distinct, but complementary contribution of the two thalamocortical pathways in experience-dependent plasticity in the adult mouse barrel cortex. -- L'information sensorielle nous permet de continuellement façonner nos circuits neuronaux autant durant le développement qu'à l'âge adulte. Chez le rongeur l'information sensorielle perçue par les vibrisses est intégrée au niveau du cortex somatosensoriel primaire (appelé en anglais « barrel cortex ») dont les cellules de la couche IV sont capables d'adapter leur état fonctionnel en réponse à une augmentation d'activité neuronale. Ce modèle expérimental a permis à notre groupe de recherche d'observer des changements rapides du circuit neuronal en fonction de l'activité sensorielle. En effet, la stimulation continue d'une vibrisse d'une souris adulte pendant 24 heures induit non seulement un remaniement synaptique (Knott et al., 2002), mais également des changements physiologiques au niveau des neurones du tonneau correspondant (Quairiaux et al., 2007). Ces observations nous permettent d'affirmer que le « barrel cortex » est un modèle approprié pour y étudier la plasticité synaptique. Au niveau cellulaire, l'activité neuronale déclenche des cascades de signalisation intracellulaire résultant en une réponse transcriptionnelle. Afin de caractériser les voies moléculaires impliquées dans la plasticité synaptique, une puce à ARN nous a permis de comparer l'expression de gènes entre un tonneau correspondant à une vibrisse stimulée et un tonneau d'une vibrisse non-stimulée (Nathalie). Cette analyse a révélé un certain nombre de gènes régulés de manière positive ou négative par l'augmentation de l'activité neuronale. Nous nous sommes concentrés sur 10 gènes dont l'expression est fortement régulée. L'expression de sept d'entre eux a déjà été démontrée comme dépendante de l'activité neuronale (Tnncl, Nptx2, Sorcs3, Ptgs2, Nr4a2, Npas4 otAdcyapl) alors que l'expression des trois autres (Scn7a, Pcdhl5 et Cedei) n'a pour le moment pas encore été liée à la plasticité neuronale. Le but de cette thèse est de confirmer les résultats de la puce à ARN et de déterminer dans quel type cellulaire ces gènes sont exprimés. L'hybridation in situ pour le gène Pcdhl5, après différentes périodes de stimulation des vibrisses (3, 6, 9, 15 et 24 heures), nous a permis de confirmer que le seuil de 1.25x utilisé dans l'analyse de la puce à ARN est approprié pour considérer qu'un gène est régulé de manière significative par la stimulation sensorielle. Nous avons également pu confirmer à l'aide de cette technique que la stimulation sensorielle augmente significativement l'expression de ces dix gènes. L'expression de ces gènes au niveau cellulaire a été observée à l'aide des techniques d'hybridation in situ et d'immunohistochimie. Trois observations ont été faites : 1) la régulation de ces gènes est restreinte aux tonneaux correspondants aux vibrisses stimulées ; 2) au niveau d'une colonne corticale correspondant aux vibrisses stimulées, seules certaines cellules présentent une altération de leur expression génique ; 3) au niveau des tonneaux stimulés, deux profils d'expression d'ARNm et de protéines sont observés. Notre hypothèse est que cette distribution pourrait correspondre à la terminaison ségrégée des deux voies thalamocortical qui amènent l'information sensorielle dans le cortex cérébral. De plus, seul les neurones atteignant le seuil critique d'activation modifient leur expression génique en réponse à la stimulation sensorielle. Ces changements d'expression géniques vont permettre à la cellule de modifier ses propriétés structurales et physiologiques de manière a prevenir la propagation d'un excès d'activité neuronale au niveau de ses cibles postsynaptics. L'activité neuronale agit donc spécifiquement sur certains types cellulaires de maniere a induire une réponse homéostatique au niveau du réseau neuronal impliqué dans l'integration de l'information sensorielle. Nos travaux démontrent pour une première fois que les deux voies sensorielles contribuent d'une manière distincte et complémentaire à la plasticité corticale induite par un changement de l'activité sensorielle chez la souris adulte.

How we experience immersive virtual environments: the concept of presence and its measurement

This paper reviews the concept of presence in immersive virtual environments, the sense of being there signalled by people acting and responding realistically to virtual situations and events. We argue that presence is a unique phenomenon that must be distinguished from the degree of engagement, involvement in the portrayed environment. We argue that there are three necessary conditions for presence: the (a) consistent low latency sensorimotor loop between sensory data and proprioception; (b) statistical plausibility: images must be statistically plausible in relation to the probability distribution of images over natural scenes. A constraint on this plausibility is the level of immersion;(c) behaviour-response correlations: Presence may be enhanced and maintained over time by appropriate correlations between the state and behaviour of participants and responses within the environment, correlations that show appropriate responses to the activity of the participants. We conclude with a discussion of methods for assessing whether presence occurs, and in particular recommend the approach of comparison with ground truth and give some examples of this.

How we experience immersive virtual environments: the concept of presence and its measurement

This paper reviews the concept of presence in immersive virtual environments, the sense of being there signalled by people acting and responding realistically to virtual situations and events. We argue that presence is a unique phenomenon that must be distinguished from the degree of engagement, involvement in the portrayed environment. We argue that there are three necessary conditions for presence: the (a) consistent low latency sensorimotor loop between sensory data and proprioception; (b) statistical plausibility: images must be statistically plausible in relation to the probability distribution of images over natural scenes. A constraint on this plausibility is the level of immersion;(c) behaviour-response correlations: Presence may be enhanced and maintained over time by appropriate correlations between the state and behaviour of participants and responses within the environment, correlations that show appropriate responses to the activity of the participants. We conclude with a discussion of methods for assessing whether presence occurs, and in particular recommend the approach of comparison with ground truth and give some examples of this.

Bubble-included chocolate: relating structure with sensory response

Bubbles impart a very unique texture, chew, and mouth feel to foods. However, little is known about the relationship between structure of such products and consumer response in terms of mouth-feel and eating experience. The objective of this article is to investigate the sensory properties of 4 types of bubble-containing chocolates, produced by using different gases: carbon dioxide, nitrogen, nitrous oxide, and argon. The structure of these chocolates were characterized in terms of (1) gas hold-up values determined by density measurements and (2) bubble size distribution which was measured by undertaking an image analysis of X-ray microtomograph sections. Bubble size distributions were obtained by measuring bubble volumes after reconstructing 3D images from the tomographic sections. A sensory study was undertaken by a nonexpert panel of 20 panelists and their responses were analyzed using qualitative descriptive analysis (QDA). The results show that chocolates made from the 4 gases could be divided into 2 groups on the basis of bubble volume and gas hold-up: the samples produced using carbon dioxide and nitrous oxide had a distinctly higher gas hold-up containing larger bubbles in comparison with those produced using argon and nitrogen. The sensory study also demonstrated that chocolates made with the latter were perceived to be harder, less aerated, slow to melt in the mouth, and having overall flavor intensity. These products were further found to be creamier than the chocolates made by using carbon dioxide and nitrous oxide; the latter sample also showed a higher intensity of cocoa flavor.

Interactive sensory objects for improving access to heritage

In this project we explore how to enhance the experience and understanding of cultural heritage in museums and heritage sites by creating interactive multisensory objects collaboratively with artists, technologists and people with learning disabilities. We focus here on workshops conducted during the first year of a three year project in which people with learning disabilities each constructed a 'sensory box' to represent their experiences of Speke Hall, a heritage site in the UK. The box is developed further in later workshops which explore aspects of physicality and how to appeal to the entire range of senses, making use of Arduino technology and basic sensors to enable an interactive user experience.

Methods of sensory augmentation through electro-tactile stimulation of the tongue

This paper details an investigation into sensory substitution by means of direct electrical stimulation of the tongue for the purpose of information input to the human brain. In particular, a device has been constructed and a series of trials have been performed in order to demonstrate the efficacy and performance of an electro-tactile array mounted onto the tongue surface for the purpose of sensory augmentation. Tests have shown that by using a low resolution array a computer-human feedback loop can be successfully implemented by humans in order to complete tasks such as object tracking, surface shape identification and shape recognition with no training or prior experience with the device. Comparisons of this technique have been made with visual alternatives and these show that the tongue based tactile array can match such methods in convenience and accuracy in performing simple tasks.

TESSA - Toolkit for experimentation with multimodal sensory substitution and augmentation

TESSA is a toolkit for experimenting with sensory augmentation. It includes hardware and software to facilitate rapid prototyping of interfaces that can enhance one sense using information gathered from another sense. The toolkit contains a range of sensors (e.g. ultrasonics, temperature sensors) and actuators (e.g. tactors or stereo sound), designed modularly so that inputs and outputs can be easily swapped in and out and customized using TESSA’s graphical user interface (GUI), with “real time” feedback. The system runs on a Raspberry Pi with a built-in touchscreen, providing a compact and portable form that is amenable for field trials. At CHI Interactivity, the audience will have the opportunity to experience sensory augmentation effects using this system, and design their own sensory augmentation interfaces.

Regulation of Radial Glial Motility by Visual Experience

Radial glia in the developing optic tectum express the key guidance molecules responsible for topographic targeting of retinal axons. However, the extent to which the radial glia are themselves influenced by retinal inputs and visual experience remains unknown. Using multiphoton live imaging of radial glia in the optic tectum of intact Xenopus laevis tadpoles in conjunction with manipulations of neural activity and sensory stimuli, radial glia were observed to exhibit spontaneous calcium transients that were modulated by visual stimulation. Structurally, radial glia extended and retracted many filopodial processes within the tectal neuropil over minutes. These processes interacted with retinotectal synapses and their motility was modulated by nitric oxide (NO) signaling downstream of neuronal NMDA receptor (NMDAR) activation and visual stimulation. These findings provide the first in vivo demonstration that radial glia actively respond both structurally and functionally to neural activity, via NMDAR-dependent NO release during the period of retinal axon ingrowth.

Perception-action coupling in infants with down syndrome: Effects of experience and practice

This study examined the effects of experience and practice on the coupling between visual information and trunk sway in infants with Down syndrome (DS). Five experienced and five novice sitters were exposed to a moving room, which was oscillated at 0.2 and 0.5 Hz. Infants remained in a sitting position and data were collected on the first, fourth, and seventh days. On the first day, experienced sitters were more influenced by room oscillation than were novices. On the following days, however, the influence of room oscillation decreased for experienced but increased for novice sitters. These results suggest that the relationship between sensory information and motor action in infants with DS can be changed with experience and practice.

Analysis of the chronic intake of and withdrawal from diazepam on emotional reactivity and sensory information processing in rats

It has been demonstrated that, on abrupt withdrawal, patients with chronic exposure can experience a number of symptoms indicative of a dependent state. In clinical patients, the earliest to arise and most persistent signal of withdrawal from chronic benzodiazepine (Bzp) treatment is anxiety. In laboratory animals, anxiety-like effects following abrupt interruption of chronic Bzp treatment can also be reproduced. In fact, signs that oscillate from irritability to extreme fear behaviours and seizures have been described already. As anxiety remains one of the most important symptoms of Bzp withdrawal, in this study we evaluated the anxiety levels of rats withdrawn from diazepam. Also studied were the effects on the motor performance and preattentive sensory gating process of rats under diazepam chronic treatment and upon 48-h withdrawal on three animal models of anxiety, the elevated plus-maze (EPM), ultrasonic vocalizations (USV) and startle + prepulse inhibition tests. Data obtained showed an anxiolytic- and anxiogenic-like profile of the chronic intake of and withdrawal from diazepam regimen in the EPM test, 22-KHz USV and startle reflex. Diazepam chronic effects or its withdrawal were ineffective in promoting any alteration in the prepulse inhibition (PPI). However, an increase of PPI was achieved in both sucrose and diazepam pretreated rats on 48-h withdrawal, suggesting a procedural rather than a specific effect of withdrawal on sensory gating processes. It is also possible that the prepulse can function as a conditioned stimulus to informing the delivery of an aversive event, as the auditory startling-eliciting stimulus. All these findings are indicative of a sensitization of the neural substrates of aversion in diazepam withdrawn animals without concomitant changes on the processing of sensory information

Reconstruction of large supra-eyebrow and forehead defects using the hatchet flap principle and sparing sensory nerve branches

To reconstruct a forehead defect, a plastic surgeon must be knowledgeable about the neural, vascular, and muscular anatomy. The position of fixed structures such as eyebrows and hairline should be respected. For the past 5 years, we have used double hatchet flaps for reconstruction of relatively large supra-eyebrow and forehead defects. Because this flap does not appear to be among the techniques used by young plastic surgeons, we thought that it would be valuable to report our experience.

A genetically explicit model of speciation by sensory drive within a continuous population in aquatic environments

BACKGROUND: The sensory drive hypothesis predicts that divergent sensory adaptation in different habitats may lead to premating isolation upon secondary contact of populations. Speciation by sensory drive has traditionally been treated as a special case of speciation as a byproduct of adaptation to divergent environments in geographically isolated populations. However, if habitats are heterogeneous, local adaptation in the sensory systems may cause the emergence of reproductively isolated species from a single unstructured population. In polychromatic fishes, visual sensitivity might become adapted to local ambient light regimes and the sensitivity might influence female preferences for male nuptial color. In this paper, we investigate the possibility of speciation by sensory drive as a byproduct of divergent visual adaptation within a single initially unstructured population. We use models based on explicit genetic mechanisms for color vision and nuptial coloration. RESULTS: We show that in simulations in which the adaptive evolution of visual pigments and color perception are explicitly modeled, sensory drive can promote speciation along a short selection gradient within a continuous habitat and population. We assumed that color perception evolves to adapt to the modal light environment that individuals experience and that females prefer to mate with males whose nuptial color they are most sensitive to. In our simulations color perception depends on the absorption spectra of an individual's visual pigments. Speciation occurred most frequently when the steepness of the environmental light gradient was intermediate and dispersal distance of offspring was relatively small. In addition, our results predict that mutations that cause large shifts in the wavelength of peak absorption promote speciation, whereas we did not observe speciation when peak absorption evolved by stepwise mutations with small effect. CONCLUSION: The results suggest that speciation can occur where environmental gradients create divergent selection on sensory modalities that are used in mate choice. Evidence for such gradients exists from several animal groups, and from freshwater and marine fishes in particular. The probability of speciation in a continuous population under such conditions may then critically depend on the genetic architecture of perceptual adaptation and female mate choice.

On sex-related differences in auditory and visual sensory functioning

The present study was designed to elucidate sex-related differences in two basic auditory and one basic visual aspect of sensory functioning, namely sensory discrimination of pitch, loudness, and brightness. Although these three aspects of sensory functioning are of vital importance in everyday life, little is known about whether men and women differ from each other in these sensory functions. Participants were 100 male and 100 female volunteers ranging in age from 18 to 30 years. Since sensory sensitivity may be positively related to individual levels of intelligence and musical experience, measures of psychometric intelligence and musical background were also obtained. Reliably better performance for men compared to women was found for pitch and loudness, but not for brightness discrimination. Furthermore, performance on loudness discrimination was positively related to psychometric intelligence, while pitch discrimination was positively related to both psychometric intelligence and levels of musical training. Additional regression analyses revealed that each of three predictor variables (sex, psychometric intelligence, and musical training) accounted for a statistically significant portion of unique variance in pitch discrimination. With regard to loudness discrimination, regression analysis yielded a statistically significant portion of unique variance for sex as a predictor variable, whereas psychometric intelligence just failed to reach statistical significance. The potential influence of sex hormones on sex-related differences in sensory functions is discussed.