Towards a spatial language for mobile robots

We present a framework and first set of simulations for evolving a language for communicating about space. The framework comprises two components: (1) An established mobile robot platform, RatSLAM, which has a "brain" architecture based on rodent hippocampus with the ability to integrate visual and odometric cues to create internal maps of its environment. (2) A language learning system based on a neural network architecture that has been designed and implemented with the ability to evolve generalizable languages which can be learned by naive learners. A study using visual scenes and internal maps streamed from the simulated world of the robots to evolve languages is presented. This study investigated the structure of the evolved languages showing that with these inputs, expressive languages can effectively categorize the world. Ongoing studies are extending these investigations to evolve languages that use the full power of the robots representations in populations of agents.

Language change in socially structured populations

Language contact is a significant external social factor that impacts on the change in natural languages over time. In some circumstances this corresponds to language competition, in which individuals in a population choose one language over another based on their social interactions. We investigated the dynamics of language change in two initially separate populations of agents that were then mixed with levels of influence determined by the social classes of the two populations, with 16 different combinations tested. As expected, the study found that how the communities interact with each other impacts on the communal language developed. However, it was also found that the acquisition of new words was substantial even with limited interaction between populations and low levels of influence, and that comprehension could be well established across language groups even when production of words from the other language group was low.

Reasoning about natural language phrases for semantic goal driven exploration

This paper presents a symbolic navigation system that uses spatial language descriptions to inform goal-directed exploration in unfamiliar office environments. An abstract map is created from a collection of natural language phrases describing the spatial layout of the environment. The spatial representation in the abstract map is controlled by a constraint based interpretation of each natural language phrase. In goal-directed exploration of an unseen office environment, the robot links the information in the abstract map to observed symbolic information and its grounded world representation. This paper demonstrates the ability of the system, in both simulated and real-world trials, to efficiently find target rooms in environments that it has never been to previously. In three unexplored environments, it is shown that on average the system travels only 8.42% further than the optimal path when using only natural language phrases to complete navigation tasks.

Does spatial locative comprehension predict landmark-based navigation?

In the present study we investigated the role of spatial locative comprehension in learning and retrieving pathways when landmarks were available and when they were absent in a sample of typically developing 6- to 11-year-old children. Our results show that the more proficient children are in understanding spatial locatives the more they are able to learn pathways, retrieve them after a delay and represent them on a map when landmarks are present in the environment. These findings suggest that spatial language is crucial when individuals rely on sequences of landmarks to drive their navigation towards a given goal but that it is not involved when navigational representations based on the geometrical shape of the environment or the coding of body movements are sufficient for memorizing and recalling short pathways.

Preschooler’s Comprehension of Spatial Terms

This study aims to understand individual differences in preschooler’s early comprehension of spatial language. Spatial language is defined as terms describing location, direction, shape, dimension, features, orientation, and quantity (e.g location, shape). Spatial language is considered to be one of the important factors in the development of spatial reasoning in the preschool years (Pruden, Levine, & Huttenlocher, 2011). In recent years, research has shown spatial reasoning is an important predictor of successes in STEM (Science, Technology, Engineering, and Mathematics) fields (e.g. Shea, Lubinski & Benbow, 2001; Wai, Lubinksi &Benbow, 2009). The current study focuses on when children begin to comprehend spatial terms, while previous work has mainly focused on production of spatial language. Identifying when children begin to comprehend spatial terms could lead to a better understanding of how spatial reasoning develops. We use the Intermodal Preferential Looking paradigm (IPLP) to examine three-year-old children’s ability to map spatial terms to visual representations. Fourteen spatial terms were used to test these abilities (e.g. bottom, diamond, longer). For each test trial children were presented with two different stimuli simultaneously on the left and right sides of a television screen. A female voice prompted the child to find the target spatial relation (e.g. “can you find the boy pointing to the bottom of the window”; Figure 1). A Tobii X60 eye-tracker was used to record the child’s eye gaze for each trial. For each child the proportion of looking to the target image divided by their total looking during the trial was calculated; this served as the dependent variable. Proportions above .50 indicated that the child had correctly mapped the spatial term to the target image. Preliminary data shows that the number of words comprehended in the IPLP task is correlated to parental report of the child’s comprehension of spatial terms (r[14]=.500, p<.05).

Preschooler’s Comprehension of Spatial Terms

This study aims to understand individual differences in preschooler’s early comprehension of spatial language. Spatial language is defined as terms describing location, direction, shape, dimension, features, orientation, and quantity (e.g location, shape). Spatial language is considered to be one of the important factors in the development of spatial reasoning in the preschool years (Pruden, Levine, & Huttenlocher, 2011). In recent years, research has shown spatial reasoning is an important predictor of successes in STEM (Science, Technology, Engineering, and Mathematics) fields (e.g. Shea, Lubinski & Benbow, 2001; Wai, Lubinksi &Benbow, 2009). The current study focuses on when children begin to comprehend spatial terms, while previous work has mainly focused on production of spatial language. Identifying when children begin to comprehend spatial terms could lead to a better understanding of how spatial reasoning develops. We use the Intermodal Preferential Looking paradigm (IPLP) to examine three-year-old children’s ability to map spatial terms to visual representations. Fourteen spatial terms were used to test these abilities (e.g. bottom, diamond, longer). For each test trial children were presented with two different stimuli simultaneously on the left and right sides of a television screen. A female voice prompted the child to find the target spatial relation (e.g. “can you find the boy pointing to the bottom of the window”; Figure 1). A Tobii X60 eye-tracker was used to record the child’s eye gaze for each trial. For each child the proportion of looking to the target image divided by their total looking during the trial was calculated; this served as the dependent variable. Proportions above .50 indicated that the child had correctly mapped the spatial term to the target image. Preliminary data shows that the number of words comprehended in the IPLP task is correlated to parental report of the child’s comprehension of spatial terms (r[14]=.500, p<.05).

Beyond here-and-now : extending shared physical experiences to shared conceptual experiences

For robots to use language effectively, they need to refer to combinations of existing concepts, as well as concepts that have been directly experienced. In this paper, we introduce the term generative grounding to refer to the establishment of shared meaning for concepts referred to using relational terms. We investigated a spatial domain, which is both experienced and constructed using mobile robots with cognitive maps. The robots, called Lingodroids, established lexicons for locations, distances, and directions through structured conversations called where-are-we, how-far, what-direction, and where-is-there conversations. Distributed concept construction methods were used to create flexible concepts, based on a data structure called a distributed lexicon table. The lexicon was extended from words for locations, termed toponyms, to words for the relational terms of distances and directions. New toponyms were then learned using these relational operators. Effective grounding was tested by using the new toponyms as targets for go-to games, in which the robots independently navigated to named locations. The studies demonstrate how meanings can be extended from grounding in shared physical experiences to grounding in constructed cognitive experiences, giving the robots a language that refers to their direct experiences, and to constructed worlds that are beyond the here-and-now.

Long summer days : grounded learning of words for the uneven cycles of real world events

Time and space are fundamental to human language and embodied cognition. In our early work we investigated how Lingodroids, robots with the ability to build their own maps, could evolve their own geopersonal spatial language. In subsequent studies we extended the framework developed for learning spatial concepts and words to learning temporal intervals. This paper considers a new aspect of time, the naming of concepts like morning, afternoon, dawn, and dusk, which are events that are part of day-night cycles, but are not defined by specific time points on a clock. Grounding of such terms refers to events and features of the diurnal cycle, such as light levels. We studied event-based time in which robots experienced day-night cycles that varied with the seasons throughout a year. Then we used meet-at tasks to demonstrate that the words learned were grounded, where the times to meet were morning and afternoon, rather than specific clock times. The studies show how words and concepts for a novel aspect of cyclic time can be grounded through experience with events rather than by times as measured by clocks or calendars

Hope in the Most Unlikely Spaces: Thawra and the Contemporary Arabic Novel

In the early to mid-twentieth century, many novelists in the Arab world championed Arab nationalism in their literary reflections on the social and political struggles of their countries, depicting these struggles primarily in terms of spatial binaries that pitted the Arab world against the West, even as they imported Western literary models of progress and modernity into their own work. The intense experience of national awakening that infused their writing often placed these authors at a literary disadvantage, for in their literature, all too often the depth and diversity of Arabic cultures and the complexity of socio-political struggles across the Arab world were undermined by restrictive spatial discourses that tended to focus only on particular versions of Arab history and on a seemingly unifying national predicament. Between the Arab defeat of 1967 and the present day, however, an increasing number of Arab authors have turned to less restrictive forms of spatial discourse in search of a language that might offer alternative narratives of hope beyond the predictable, and seemingly thwarted, trajectories of nationalism. This study traces the ways in which contemporary Arab authors from Egypt and the Sudan have endeavoured to re-think and re-define the Arab identity in ever-changing spaces where elements of the local and the global, the traditional and the modern, interact both competitively and harmoniously. I examine the spatial language and the tropes used in three Arabic novels, viewing them through the lens of thawra (revolution) in both its socio-political and artistic manifestations. Linking the manifestations of thawra in each text to different scenes of revolution in the Arab world today, in Chapter Two, I consider how, at a stage when the Sudan of the sixties was both still dealing with colonial withdrawal and struggling to establish itself as a nation-state, the geographical and textual landscapes of Tayeb Salih‟s Season of Migration to the North depict the ongoing dilemma of the Sudanese identity. In Chapter Three, I examine Alaa iii al-Aswany‟s The Yacoubian Building in the context of a socially diseased and politically corrupt Egypt of the nineties: social, political, modern, historical, local, and global elements intertwine in a dizzyingly complex spatial network of associations that sheds light on the complicated reasons behind today‟s Egyptian thawra. In Chapter Four, the final chapter, Gamal al-Ghitani‟s approach to his Egypt in Pyramid Texts drifts far away from Salih‟s anguished Sudan and al-Aswany‟s chaotic Cairo to a realm where thawra manifests itself artistically in a sophisticated spatial language that challenges all forms of spatial hegemony and, consequently, old and new forms of social, political, and cultural oppression in the Arab world.

Signwriting : um sistema de escrita das línguas gestuais : aplicação à língua gestual portuguesa

A língua gestual (LG) é a língua natural da pessoa surda, sendo utilizada como forma de expressão e comunicação da comunidade surda de um determinado país. Porém, é de todo impossível escrever estas línguas através de um alfabeto comum como o da Língua Portuguesa (LP). Em 1974, na Dinamarca, Valerie Sutton criou o SignWriting (SW), um sistema de escrita das línguas gestuais, contrariando assim a ideia de que as línguas espaço-visuais não poderiam ter uma representação gráfica. Para o surgimento deste sistema foram fundamentais os estudos pioneiros de William Stokoe que reconheceram o estatuto linguístico das línguas gestuais, atribuindo-lhes propriedades inerentes a uma língua, como por exemplo a arbitrariedade e convencionalidade. Neste trabalho apresentamos o SW, sistema de escrita das línguas gestuais já utilizado noutros países, e questionamos se é exequível e profícua a sua adaptação à língua gestual portuguesa (LGP). Nesse sentido, concretizamos a escrita da LGP com base em áreas vocabulares distintas e presentes no programa curricular do ensino da LGP. Por último, efetivamos tal proposta através de um modelo de ação de formação em SW.

O papel do intérprete de libras no ensino fundamental

The Brazilian sign language is a visual-spatial language, manifested through the hands, facial expressions and body, being considered a natural language used by the deaf community in Brazil. Thus, in a school context the knowledge of LIBRAS is fundamental to the interpreter and the deaf student, so, the role of the interpreter in the classroom is to mediate the relationship between teachers and students. The objective of this study is to investigate the importance of the interpreter in the educational process of the deaf child and try to map the possible difficulties found by him in his workspace, under his perspective in the classroom. This is a qualitative study, which had the data collection instrument as an open interview with questionnaire, dealing on issues concerning to the role and practice of the interpreter of Libras in the classroom to support the deaf student in school age. Therefore, participated in the study two interpreters of Libras who works in elementary school classrooms in the city of Jaú. The results shown that the interpreter's role is extremely important for the education of children with hearing impairment, but it's not recognized and many times not accepted by teachers and educational institutions, when its real function is respected

Resolving ambiguous descriptions through visual information

The project “Reference in Discourse” deals with the selection of a specific object from a visual scene in a natural language situation. The goal of this research is to explain this everyday discourse reference task in terms of a concept generation process based on subconceptual visual and verbal information. The system OINC (Object Identification in Natural Communicators) aims at solving this problem in a psychologically adequate way. The system’s difficulties occurring with incomplete and deviant descriptions correspond to the data from experiments with human subjects. The results of these experiments are reported.