Naive Physics, Event Perception, Lexical Semantics, and Language Acquisition

This thesis proposes a computational model of how children may come to learn the meanings of words in their native language. The proposed model is divided into two separate components. One component produces semantic descriptions of visually observed events while the other correlates those descriptions with co-occurring descriptions of those events in natural language. The first part of this thesis describes three implementations of the correlation process whereby representations of the meanings of whole utterances can be decomposed into fragments assigned as representations of the meanings of individual words. The second part of this thesis describes an implemented computer program that recognizes the occurrence of simple spatial motion events in simulated video input.

Visible Difference, Stigmatising Language(s) and the Distinctive Construction of Prejudices against Others in Leeds and Warsaw

The chapter argues that language and cultural communication matter in a transnational world and that the transmission of prejudices against minorities has to be closely analysed while contextualising national histories with minorities. Looking at two spatial sites (Leeds and Warsaw) and analysing interview material that was drawn from a larger study, the authors discuss the way local people address difference particularly through the axes of gendered ethnicity (Muslim men) and gendered class (male underclass). It explores how the same categories of difference are discursively produced in Poland and the UK/ England; to what degree they differ or overlap.

An embodied approach to language: the role of bodily feedback in discourse processing

Theories of embodied cognition argue that language processing arises not from amodal symbols that redescribe sensorimotor and affective experiences, but from partial simulations (reenactments) of modality-specific states. Recent findings on processing of words and sentences support such a stance emphasizing that the role of the body in the domain of language comprehension should not be overlooked or dismissed. The present research was conducted to extend prior work in two important ways. First, the role of simulation was tested with connected discourse rather than words or sentences presented in isolation. Second, both “online” and “offline” measures of discourse comprehension were taken. In Experiments 1 and 2 participants’ facial postures were manipulated to show that preparing the body for processing of emotion-congruent information improves discourse comprehension. In Experiment 3 the direction of body posture was manipulated to show that implicit properties of simulations, such as spatial dimension or location, are at least somewhat involved in processing of large language segments such as discourse. Finally, in Experiments 4 and 5 participants’ body movement and body posture were manipulated to show that even understanding of language describing metaphorical actions physically impossible to perform involves constructing a sensorimotor simulation of the described event. The major result was that compatibility between embodiment and language strongly modulated performance effectiveness in experiments on simulation of emotion and metaphorical action. The effect of simulation on comprehension of discourse implying spatial dimension was fragile. These findings support an embodied simulation account of cognition suggesting that sensorimotor and affective states are at least partially implicated in “online” and “offline” discourse comprehension.

Language evolution and recursion : an empirical investigation of human hierarchical processing

Tese de doutoramento, Ciências Biomédicas (Neurociências), Universidade de Lisboa, Faculdade de Medicina, 2014

From syntagmatic to paradigmatic spatial zeroes: the loss of the preposition se in inner Asia Minor Greek

We trace the diachronic development of the preposition se in inner Asia Minor Greek from its use to mark a range of spatial functions to its ultimate loss and replacement by zero. We propose that, before spreading to all syntactic and semantic contexts, zero marking was contextually-dependent on the presence/absence of a prenominal genitive modifying the head noun of Ground-encoding NPs and on the presence/absence of Region-encoding postpositions. We attribute these developments to an informational load relief strategy aimed at producing more economical utterances as well as to language contact with Turkish, which favoured structural convergence on the adpositional level between the two languages.

Generating Relation Algebras for Qualitative Spatial Reasoning

Basic relationships between certain regions of space are formulated in natural language in everyday situations. For example, a customer specifies the outline of his future home to the architect by indicating which rooms should be close to each other. Qualitative spatial reasoning as an area of artificial intelligence tries to develop a theory of space based on similar notions. In formal ontology and in ontological computer science, mereotopology is a first-order theory, embodying mereological and topological concepts, of the relations among wholes, parts, parts of parts, and the boundaries between parts. We shall introduce abstract relation algebras and present their structural properties as well as their connection to algebras of binary relations. This will be followed by details of the expressiveness of algebras of relations for region based models. Mereotopology has been the main basis for most region based theories of space. Since its earliest inception many theories have been proposed for mereotopology in artificial intelligence among which Region Connection Calculus is most prominent. The expressiveness of the region connection calculus in relational logic is far greater than its original eight base relations might suggest. In the thesis we formulate ways to automatically generate representable relation algebras using spatial data based on region connection calculus. The generation of new algebras is a two pronged approach involving splitting of existing relations to form new algebras and refinement of such newly generated algebras. We present an implementation of a system for automating aforementioned steps and provide an effective and convenient interface to define new spatial relations and generate representable relational algebras.

Language in calculation: A core mechanism?

Although there is evidence that exact calculation recruits left hemisphere perisylvian language systems, recent work has shown that exact calculation can be retained despite severe damage to these networks. In this study, we sought to identify a “core” network for calculation and hence to determine the extent to which left hemisphere language areas are part of this network. We examined performance on addition and subtraction problems in two modalities: one using conventional two-digit problems that can be easily encoded into language; the other using novel shape representations. With regard to numerical problems, our results revealed increased left fronto-temporal activity in addition, and increased parietal activity in subtraction, potentially reflecting retrieval of linguistically encoded information during addition. The shape problems elicited activations of occipital, parietal and dorsal temporal regions, reflecting visual reasoning processes. A core activation common to both calculation types involved the superior parietal lobule bilaterally, right temporal sub-gyral area, and left lateralized activations in inferior parietal (BA 40), frontal (BA 6/8/32) and occipital (BA 18) regions. The large bilateral parietal activation could be attributed to visuo-spatial processing in calculation. The inferior parietal region, and particularly the left angular gyrus, was part of the core calculation network. However, given its activation in both shape and number tasks, its role is unlikely to reflect linguistic processing per se. A possibility is that it serves to integrate right hemisphere visuo-spatial and left hemisphere linguistic and executive processing in calculation.

Introductory computer programming as a means for extending spatial and temporal understanding

Should computer programming be taught within schools of architecture?

Incorporating even low-level computer programming within architectural education curricula is a matter of debate but we have found it useful to do so for two reasons: as an introduction or at least a consolidation of the realm of descriptive geometry and in providing an environment for experimenting in morphological time-based change.

Mathematics and descriptive geometry formed a significant proportion of architectural education until the end of the 19th century. This proportion has declined in contemporary curricula, possibly at some cost for despite major advances in automated manufacture, Cartesian measurement is still the principal ‘language’ with which to describe building for construction purposes. When computer programming is used as a platform for instruction in logic and spatial representation, the waning interest in mathematics as a basis for spatial description can be readdressed using a left-field approach. Students gain insights into topology, Cartesian space and morphology through programmatic form finding, as opposed to through direct manipulation.

In this context, it matters to the architect-programmer how the program operates more than what it does. This paper describes an assignment where students are given a figurative conceptual space comprising the three Cartesian axes with a cube at its centre. Six Phileban solids mark the Cartesian axial limits to the space. Any point in this space represents a hybrid of one, two or three transformations from the central cube towards the various Phileban solids. Students are asked to predict the topological and morphological outcomes of the operations. Through programming, they become aware of morphogenesis and hybridisation. Here we articulate the hypothesis above and report on the outcome from a student group, whose work reveals wider learning opportunities for architecture students in computer programming than conventionally assumed.

Envisioning Indochina : the spatial and social ordering and imagining of a French colony

The emergence of Indochina in the French imagination was articulated in both representational and institutional modes. Representation involves the transmission of colonial ideals through more obtuse means; that is, through literary texts, travelogues, exhibitions, film and advertising. However, these textual sites feed from and invest in a material situation, which was the institutional arm of colonialism. Indochina was institutionally articulated in cartographic maps and surveys, in the new social spaces of cities and towns, in architectural and technological forms, through social technologies of discipline and welfare and in cultural and religious organisations. The aim of this thesis is to analyse, across a number of textual sites, the representation and institutionalisation of Otherness through the politics of space in the French colony of Indochina, Indochine in this sense becomes a spatial discourse. The French constructed a mental and physical space for Indochina by blanketing and suffocating the original cultural landscape, which in fact had to be ignored for this process to occur. What actually became manifest as a result of this projection stemmed from the French imagination. Just as the French manipulated space, language also underwent the same process of reduction. The Vietnamese script was latinised to make it more 'useable' and ‘accessible’. Through christening the union of Indochina; initiating a comprehensive writing reform; and renaming the streets in the colonial cities, the French used language us another tool for 'making transparent'. Furthermore, the colonial powers established a communication and transport network throughout the colony in an attempt to materialise their fictive (artificial) vision of a unified French Indochinese space. The accessibility and design of these different modes of transport reflected the gendered, racial and class divisions inherent in the colonial establishment. At the heart of representing and institutionalising Indochina was the desire to control and contain. This characterised French imperial ordering of space in the city and the rural areas. In rural areas land was divided into small parcels and alienated to individuals or worked into precise grids for the rubber plantation. In urban centres the native quarter was clearly demarcated from the European quarter which functioned as its modern, progressive Other. The rationale behind this segregation was premised on European, nineteenth century discourses of race, class, gender and hygiene. Influenced by Darwinian and neo-Lamarkian theories of race, this biological discourse identified the 'working class', 'women' and 'the native' as not only biologically but also culturally inferior. They were perceived as a potential, degenerative threat to the biological, cultural and industrial development of the nation. In the colonial context, space was thus ordered and domesticated to control the native population. Coextensively, the literature which springs from such a structure will be tainted by the same ideas, and thus the spaces it formulates within the readers mind feed on and reinforce this foundation. Examples of gender and indigenous narratives which contest this imaginative, transparent topography are analysed throughout this thesis. They provide instances of struggle and resistance which undermine the ideal/stereotypical level of architectural and planned space and delineate an alternative insight into colonial spatial and social relations. The fictional accounts of European women and indigenous writers both challenge and reaffirm the fixity of some of these idealised colonial boundaries. In various literary, historical, political, architectural and cinematic discourses Indochina has been und continues to be depicted as a modern city and exotic Utopia. Informed by the mood of nostalgia, exotic images of Indochina have resurfaced in contemporary French culture. France's continued desire to create, control and maintain an Indochinese space in the French public imagination reinforces the multi-layered, interconnected and persistent nature of colonial discourse.

After hours schools as core to the spatial politics of in-betweeness

In this article the authors draw on a larger study in which their overall concern is to illustrate how diasporic identifications develop through a range of scales related to self, family, community, nation and beyond. They consider the Melbourne Greek community as an exemplar of diasporic experience and use it as a case study for their investigation, which is aimed at exploring how transcultural literacies relate to spaces which complicate and enrich identifications. In this article they consider the role of 'after hours' schools in the shaping of diasporic identities. These are community-based schools where Greek language and culture is taught. Commonly, classes are held on Saturday morning or in the evenings during the week. Such schools operate in classrooms that are rented from 'real' schools. By existing in spaces that are commonly occupied by mainstream day schools, students who attend 'after hours' schools experience a form of marginalisation that is also a right of passage. Here the authors argue that such 'in-between' spaces assist with the formation of 'in-between' identities that are emblematic of globalization.

Autism blogs: expressed emotion, language styles and concerns in personal and community settings

The Internet has provided an ever increasingly popular platform for individuals to voice their thoughts, and like-minded people to share stories. This unintentionally leaves characteristics of individuals and communities, which are often difficult to be collected in traditional studies. Individuals with autism are such a case, in which the Internet could facilitate even more communication given its social-spatial distance being a characteristic preference for individuals with autism. Previous studies examined the traces left in the posts of online autism communities (Autism) in comparison with other online communities (Control). This work further investigates these online populations through the contents of not only their posts but also their comments. We first compare the Autism and Control blogs based on three features: topics, language styles and affective information. The autism groups are then further examined, based on the same three features, by looking at their personal (Personal) and community (Community) blogs separately. Machine learning and statistical methods are used to discriminate blog contents in both cases. All three features are found to be significantly different between Autism and Control, and between autism Personal and Community. These features also show good indicative power in prediction of autism blogs in both personal and community settings.

Cognition in context: Evidence on affordances and verbal language

This thesis investigated affordances and verbal language to demonstrate the flexibility of embodied simulation processes. Starting from the assumption that both object/action understanding and language comprehension are tied to the context in which they take place, six studies clarified the factors that modulate simulation. The studies in chapter 4 and 5 investigated affordance activation in complex scenes, revealing the strong influence of the visual context, which included either objects and actions, on compatibility effects. The study in chapter 6 compared the simulation triggered by visual objects and objects names, showing differences depending on the kind of materials processed. The study in chapter 7 tested the predictions of the WAT theory, confirming that the different contexts in which words are acquired lead to the difference typically observed in the literature between concrete and abstract words. The study in chapter 8 on the grounding of abstract concepts tested the mapping of temporal contents on the spatial frame of reference of the mental timeline, showing that metaphoric congruency effects are not automatic, but flexibly mediated by the context determined by the goals of different tasks. The study in chapter 9 investigated the role of iconicity in verbal language, showing sound-to-shape correspondences when every-day object figures, result that validated the reality of sound-symbolism in ecological contexts. On the whole, this evidence favors embodied views of cognition, and supports the hypothesis of a high flexibility of simulation processes. The reported conceptual effects confirm that the context plays a crucial role in affordances emergence, metaphoric mappings activation and language grounding. In conclusion, this thesis highlights that in an embodied perspective cognition is necessarily situated and anchored to a specific context, as it is sustained by the existence of a specific body immersed in a specific environment.

Microstates in language-related brain potential maps show noun-verb differences

Brain processing of grammatical word class was studied analyzing event-related potential (ERP) brain fields. Normal subjects observed a randomized sequence of single German nouns and verbs on a computer screen, while 20-channel ERP field map series were recorded separately for both word classes. Spatial microstate analysis was applied, based on the observation that series of ERP maps consist of epochs of quasi-stable map landscapes and based on the rationale that different map landscapes must have been generated by different neural generators and thus suggest different brain functions. Space-oriented segmentation of the mean map series identified nine successive, different functional microstates, i.e., steps of brain information processing characterized by quasi-stable map landscapes. In the microstate from 116 to 172 msec, noun-related maps differed significantly from verb-related maps along the left–right axis. The results indicate that different neural populations represent different grammatical word classes in language processing, in agreement with clinical observations. This word class differentiation as revealed by the spatial–temporal organization of neural activity occurred at a time after word input compatible with speed of reading.

Magnetic resonance spectroscopy investigations of functionally defined language areas in schizophrenia patients with and without auditory hallucinations

Background: Cerebral dysfunction occurring in mental disorders can show metabolic disturbances which are limited to circumscribed brain areas. Auditory hallucinations have been shown to be related to defined cortical areas linked to specific language functions. Here, we investigated if the study of metabolic changes in auditory hallucinations requires a functional rather than an anatomical definition of their location and size to allow a reliable investigation by magnetic resonance spectroscopy (MRS). Methods: Schizophrenia patients with (AH; n = 12) and without hallucinations (NH; n = 8) and healthy controls (HC; n = 11) underwent a verbal fluency task in functional MRI (fMRI) to functionally define Broca's and Wernicke's areas. Left and right Heschl's gyri were defined anatomically. Results: The mean distances in native space between the fMRI-defined regions and a corresponding anatomically defined area were 12.4 ± 6.1 mm (range: 2.7–36.1 mm) for Broca's area and 16.8 ± 6.2 mm (range: 4.5–26.4 mm) for Wernicke's area, respectively. Hence, the spatial variance was of similar extent as the size of the investigated regions. Splitting the investigations into a single voxel examination in the frontal brain and a spectroscopic imaging part for the more homogeneous field areas led to good spectral quality for almost all spectra. In Broca's area, there was a significant group effect (p = 0.03) with lower levels of N-acetyl-aspartate (NAA) in NH compared to HC (p = 0.02). There were positive associations of NAA levels in the left Heschl's gyrus with total (p = 0.03) and negative (p = 0.006) PANSS scores. In Broca's area, there was a negative association of myo-inositol levels with total PANSS scores (p = 0.008). Conclusion: This study supports the neurodegenerative hypothesis of schizophrenia only in a frontal region whereas the results obtained from temporal regions are in contrast to the majority of previous studies. Future research should test the hypothesis raised by this study that a functional definition of language regions is needed if neurochemical imbalances are expected to be restricted to functional foci.

Semantic, perceptual and number space: relations between category width and spatial processing.

Coarse semantic encoding and broad categorization behavior are the hallmarks of the right cerebral hemisphere's contribution to language processing. We correlated 40 healthy subjects' breadth of categorization as assessed with Pettigrew's category width scale with lateral asymmetries in perceptual and representational space. Specifically, we hypothesized broader category width to be associated with larger leftward spatial biases. For the 20 men, but not the 20 women, this hypothesis was confirmed both in a lateralized tachistoscopic task with chimeric faces and a random digit generation task; the higher a male participant's score on category width, the more pronounced were his left-visual field bias in the judgement of chimeric faces and his small-number preference in digit generation ("small" is to the left of "large" in number space). Subjects' category width was unrelated to lateral displacements in a blindfolded tactile-motor rod centering task. These findings indicate that visual-spatial functions of the right hemisphere should not be considered independent of the same hemisphere's contribution to language. Linguistic and spatial cognition may be more tightly interwoven than is currently assumed.