Empirical analysis of the effect of dimension reduction and word order on semantic vectors

The aim of this paper is to provide a comparison of various algorithms and parameters to build reduced semantic spaces. The effect of dimension reduction, the stability of the representation and the effect of word order are examined in the context of the five algorithms bearing on semantic vectors: Random projection (RP), singular value decom- position (SVD), non-negative matrix factorization (NMF), permutations and holographic reduced representations (HRR). The quality of semantic representation was tested by means of synonym finding task using the TOEFL test on the TASA corpus. Dimension reduction was found to improve the quality of semantic representation but it is hard to find the optimal parameter settings. Even though dimension reduction by RP was found to be more generally applicable than SVD, the semantic vectors produced by RP are somewhat unstable. The effect of encoding word order into the semantic vector representation via HRR did not lead to any increase in scores over vectors constructed from word co-occurrence in context information. In this regard, very small context windows resulted in better semantic vectors for the TOEFL test.

Degrees of Free Word-Order and Freely Rewriting Restarting Automata

In natural languages with a high degree of word-order freedom syntactic phenomena like dependencies (subordinations) or valencies do not depend on the word-order (or on the individual positions of the individual words). This means that some permutations of sentences of these languages are in some (important) sense syntactically equivalent. Here we study this phenomenon in a formal way. Various types of j-monotonicity for restarting automata can serve as parameters for the degree of word-order freedom and for the complexity of word-order in sentences (languages). Here we combine two types of parameters on computations of restarting automata: 1. the degree of j-monotonicity, and 2. the number of rewrites per cycle. We study these notions formally in order to obtain an adequate tool for modelling and comparing formal descriptions of (natural) languages with different degrees of word-order freedom and word-order complexity.

Word order and tonal shape in the production of focus in short Finnish utterances

This paper presents results from a study on the production of Finnish prosody. The effect of word order and the tonal shape in the production of Finnish prosody was studied as produced by 8 native Finnish speakers. Predictions formulated with regard to results from an earlier study pertaining to the perception of promi- nence were tested. These predictions had to do with the tonal shape of the utterances in the form of a flat hat pattern and the effect of word order on the so called top-line declination within an adver- bial phrase in the utterances. The results from the experiment give support to the following claims: the temporal domain of prosodic focus is the whole utterance, word order reversal from unmarked to marked has an effect on the production of prosody, and the pro- duction of the tonal aspects of focus in Finnish follows a basic flat hat pattern. That is the prominence of a word can be produced by an f 0 rise or a fall, depending on the location of the word in an utterance. The basic accentual shape of a Finnish word is then not a pointed rise/fall hat shape as claimed before since it can vary depending on the syllable structure and the position within an ut- terance.

Word frequency cues word order in adults: cross-linguistic evidence

[EN] One universal feature of human languages is the division between grammatical functors and content words. From a learnability point of view, functors might provide entry points or anchors into the syntactic structure of utterances due to their high frequency. Despite its potentially universal scope, this hypothesis has not yet been tested on typologically different languages and on populations of different ages. Here we report a corpus study and an artificial grammar learning experiment testing the anchoring hypothesis in Basque, Japanese, French, and Italian adults. We show that adults are sensitive to the distribution of functors in their native language and use them when learning new linguistic material. However, compared to infants’ performance on a similar task, adults exhibit a slightly different behavior, matching the frequency distributions of their native language more closely than infants do. This finding bears on the issue of the continuity of language learning mechanism.

A Government-Binding Based Parser for Warlpiri, a Free-Word Order Language

Free-word order languages have long posed significant problems for standard parsing algorithms. This thesis presents an implemented parser, based on Government-Binding (GB) theory, for a particular free-word order language, Warlpiri, an aboriginal language of central Australia. The words in a sentence of a free-word order language may swap about relatively freely with little effect on meaning: the permutations of a sentence mean essentially the same thing. It is assumed that this similarity in meaning is directly reflected in the syntax. The parser presented here properly processes free word order because it assigns the same syntactic structure to the permutations of a single sentence. The parser also handles fixed word order, as well as other phenomena. On the view presented here, there is no such thing as a "configurational" or "non-configurational" language. Rather, there is a spectrum of languages that are more or less ordered. The operation of this parsing system is quite different in character from that of more traditional rule-based parsing systems, e.g., context-free parsers. In this system, parsing is carried out via the construction of two different structures, one encoding precedence information and one encoding hierarchical information. This bipartite representation is the key to handling both free- and fixed-order phenomena. This thesis first presents an overview of the portion of Warlpiri that can be parsed. Following this is a description of the linguistic theory on which the parser is based. The chapter after that describes the representations and algorithms of the parser. In conclusion, the parser is compared to related work. The appendix contains a substantial list of test cases ??th grammatical and ungrammatical ??at the parser has actually processed.

On the typological economy of syntactic transfer: word order and relative clause high/low attachment preference in L3 Brazilian Portuguese

One central question in the formal linguistic study of adult multilingual morphosyntax (i.e., L3/Ln acquisition) involves determining the role(s) the L1 and/or the L2 play(s) at the L3 initial state (e.g., Bardel & Falk, Second Language Research 23: 459–484, 2007; Falk & Bardel, Second Language Research: forthcoming; Flynn et al., The International Journal of Multilingualism 8: 3–16, 2004; Rothman, Second Language Research: forthcoming; Rothman & Cabrelli, On the initial state of L3 (Ln) acquisition: Selective or absolute transfer?: 2007; Rothman & Cabrelli Amaro, Second Language Research 26: 219–289, 2010). The present article adds to this general program, testing Rothman's (Second Language Research: forthcoming) model for L3 initial state transfer, which when relevant in light of specific language pairings, maintains that typological proximity between the languages is the most deterministic variable determining the selection of syntactic transfer. Herein, I present empirical evidence from the later part of the beginning stages of L3 Brazilian Portuguese (BP) by native speakers of English and Spanish, who have attained an advanced level of proficiency in either English or Spanish as an L2. Examining the related domains of syntactic word order and relative clause attachment preference in L3 BP, the data clearly indicate that Spanish is transferred for both experimental groups irrespective of whether it was the L1 or L2. These results are expected by Rothman's (Second Language Research: forthcoming) model, but not necessarily predicted by other current hypotheses of multilingual syntactic transfer; the implications of this are discussed.

A Comparative Study of English Word Order Acquisition by Elementary and Secondary School Pupils - Native Speakers of Serbian and Hungarian

Kitic investigated the phenomenon of English word order acquisition by Serbian and Hungarian speakers, examining both the theoretical and empirical aspects of this phenomenon. She began by looking at language learning and language acquisition, viewing word order acquisition in the context of relevant linguistic and psycholinguistic knowledge. The main hypothesis of her empirical investigation was that the majority of word order mistakes in the language production of Serbian and Hungarian speakers of English is due to mother tongue interference. Three supporting hypotheses were introduced to specify the phenomenon of interference in its correlation to (1) language proficiency, (2) sentence patterns, and (3) optional adverbials. The conclusions were based on error analysis of 9280 sentences of 464 elementary and high school learners. The results showed that a learner's level of proficiency seems to be a relevant factor in mother tongue interference as this decreases with increased proficiency. Word order errors are however fossilised at the highest levels. The causes of interference errors, which increase with the number of sentence elements, are either absent sentence patterns or similar ones. In the case of adverbials, word order errors have two forms: interrelation (with canonical elements) and mixed adverbials.

Agricola and Germania of Tacitus : the Latin text re-arranged to the natural English order, with a careful and exact interlinear translation /

Mode of access: Internet.

Word order in Yiddish narrative discourse

Based on data from spoken narrative discourse in Yiddish, this paper analyses two structures common in Yiddish narrations: The placement of the finite verb in the first position of a declarative sentence, and topicalization.Like German, Yiddish word order is generally centered around a verb-second rule. However, both Yiddish and spoken German show configurations of word order that go against the rule, where the finite verb occupies the first position of the utterance. From a functional-pragmatic point of view, these structures can be said to serve special purposes in the interaction between speaker and listener, sometimes in particular discourse types.Differences and similarities in word order between Yiddish and German enable us to comment on the relationship between these two closely related languages.

Astarloaren sintaxia eta hitz ordena naturala

[EN] This paper examines the syntactic ideas of Pablo Pedro Astarloa (1752-1806) as he explained in his Discursos filosóficos sobre la lengua primitiva (1805), and tries to put them in the context of the debate between rationalists and sensualists, who argued whether there is a «natural order» of words. Astarloa developed a system for accounting the word order in the primitive language of mankind (and hence in the Basque language) founded in three types of «nobleness», and in the principle that the noblest element precedes the less noble one. The first type (nobleza de origen) orders words according to their meaning. The second type (nobleza de ministerio) orders words according to the part of speech they belong to, or the semantic function they have. Finally, the third type (nobleza de mérito or de movilidad) considers the will for communication and, as a result, word order reflects the information structure. Moreover Astarloa ’s three types of nobleness are arranged in a hierarchy of superiority: movilidad > ministerio > origen. So Astarloa ’s syntax appears near to sensualists ’ conceptions on word order because it did not appeal for a fixed natural order of words; instead he proposed a variable word order based mainly on the communicative process.