Analogies between linguistics and information theory

An analogy is established between the syntagm and paradigm from Saussurean linguistics and the message and messages for selection from the information theory initiated by Claude Shannon. The analogy is pursued both as an end itself and for its analytic value in understanding patterns of retrieval from full text systems. The multivalency of individual words when isolated from their syntagm is contrasted with the relative stability of meaning of multi-word sequences, when searching ordinary written discourse. The syntagm is understood as the linear sequence of oral and written language. Saussureâ??s understanding of the word, as a unit which compels recognition by the mind, is endorsed, although not regarded as final. The lesser multivalency of multi-word sequences is understood as the greater determination of signification by the extended syntagm. The paradigm is primarily understood as the network of associations a word acquires when considered apart from the syntagm. The restriction of information theory to expression or signals, and its focus on the combinatorial aspects of the message, is sustained. The message in the model of communication in information theory can include sequences of written language. Shannonâ??s understanding of the written word, as a cohesive group of letters, with strong internal statistical influences, is added to the Saussurean conception. Sequences of more than one word are regarded as weakly correlated concatenations of cohesive units.

Analogies to semantic and syntactic mental labour in the Feist decision

The Supreme Court of the United States in Feist v. Rural (Feist, 1991) specified that compilations or databases, and other works, must have a minimal degree of creativity to be copyrightable. The significance and global diffusion of the decision is only matched by the difficulties it has posed for interpretation. The judgment does not specify what is to be understood by creativity, although it does give a full account of the negative of creativity, as ‘so mechanical or routine as to require no creativity whatsoever’ (Feist, 1991, p.362). The negative of creativity as highly mechanical has particularly diffused globally.

A recent interpretation has correlated ‘so mechanical’ (Feist, 1991) with an automatic mechanical procedure or computational process, using a rigorous exegesis fully to correlate the two uses of mechanical. The negative of creativity is then understood as an automatic computation and as a highly routine process. Creativity is itself is conversely understood as non-computational activity, above a certain level of routinicity (Warner, 2013).

The distinction between the negative of creativity and creativity is strongly analogous to an independently developed distinction between forms of mental labour, between semantic and syntactic labour. Semantic labour is understood as human labour motivated by considerations of meaning and syntactic labour as concerned solely with patterns. Semantic labour is distinctively human while syntactic labour can be directly humanly conducted or delegated to machine, as an automatic computational process (Warner, 2005; 2010, pp.33-41).

The value of the analogy is to greatly increase the intersubjective scope of the distinction between semantic and syntactic mental labour. The global diffusion of the standard for extreme absence of copyrightability embodied in the judgment also indicates the possibility that the distinction fully captures the current transformation in the distribution of mental labour, where syntactic tasks which were previously humanly performed are now increasingly conducted by machine.

The paper has substantive and methodological relevance to the conference themes. Substantively, it is concerned with human creativity, with rationality as not reducible to computation, and has relevance to the language myth, through its indirect endorsement of a non-computable or not mechanical semantics. These themes are supported by the underlying idea of technology as a human construction. Methodologically, it is rooted in the humanities and conducts critical thinking through exegesis and empirically tested theoretical development

References

Feist. (1991). Feist Publications, Inc. v. Rural Tel. Service Co., Inc. 499 U.S. 340.

Warner, J. (2005). Labor in information systems. Annual Review of Information Science and Technology. 39, 2005, pp.551-573.

Warner, J. (2010). Human Information Retrieval (History and Foundations of Information Science Series). Cambridge, MA: MIT Press.

Warner, J. (2013). Creativity for Feist. Journal of the American Society for Information Science and Technology. 64, 6, 2013, pp.1173-1192.

Famine and land in Ireland and India 1845-1880: James Caird and the political economy of hunger

The perception of Ireland and India as ‘zones of famine’ led many nineteenth-century observers to draw analogies between these two troublesome parts of the British empire. This article investigates this parallel through the career of James Caird (1816–92), and specifically his interventions in the latter stages of both the Great Irish Famine of 1845–50, and the Indian famines of 1876–9. Caird is best remembered as the joint author of the controversial dissenting minute in the Indian famine commission report of 1880; this article locates the roots of his stance in his previous engagements with Irish policy. Caird's interventions are used to track the trajectory of an evolving ‘Peelite’ position on famine relief, agricultural reconstruction, and land reform between the 1840s and 1880s. Despite some divergences, strong continuities exist between the two interventions – not least concern for the promotion of agricultural entrepreneurship, for actively assisting economic development in ‘backward’ economies, and an acknowledgement of state responsibility for preserving life as an end in itself. Above all in both cases it involved a critique of a laissez-faire dogmatism – whether manifest in the ‘Trevelyanism’ of 1846–50 or the Lytton–Temple system of 1876–9.

Linguistics and Information Theory: Analytic advantages

The analytic advantages of central concepts from linguistics and information theory, and the analogies demonstrated between them, for understanding patterns of retrieval from full-text indexes to documents are developed. The interaction between the syntagm and the paradigm in computational operations on written language in indexing, searching, and retrieval is used to account for transformations of the signified or meaning between documents and their representation and between queries and documents retrieved. Characteristics of the message, and messages for selection for written language, are brought to explain the relative frequency of occurrence of words and multiple word sequences in documents. The examples given in the companion article are revisited and a fuller example introduced. The signified of the sequence stood for, the term classically used in the definitions of the sign, as something standing for something else, can itself change rapidly according to its syntagm. A greater than ordinary discourse understanding of patterns in retrieval is obtained.

A Cross-modal Approach for Karaoke Artifacts Correction

Karaoke singing is a popular form of entertainment in several parts of the world. Since this genre of performance attracts amateurs, the singing often has artifacts related to scale, tempo, and synchrony. We have developed an approach to correct these artifacts using cross-modal multimedia streams information. We first perform adaptive sampling on the user's rendition and then use the original singer's rendition as well as the video caption highlighting information in order to correct the pitch, tempo and the loudness. A method of analogies has been employed to perform this correction. The basic idea is to manipulate the user's rendition in a manner to make it as similar as possible to the original singing. A pre-processing step of noise removal due to feedback and huffing also helps improve the quality of the user's audio. The results are described in the paper which shows the effectiveness of this multimedia approach.

“Superluminal” transmission via entanglement, superoscillations, and quasi-Dirac distributions

We analyze a system inwhich, due to entanglement between the spin and spatial degrees of freedom, the reduced transmitted state has the shape of the freely propagating pulse translated in the complex coordinate plane. In the case an apparently “superluminal” advancement of the pulse, the delay amplitude distribution is found to be a peculiar approximation to the Dirac d function, and the transmission coefficient exhibits a well-defined superoscillatory window. Analogies with potential tunneling and Wheeler’s delayed choice experiment are highlighted.

Thermal and quantum fluctuations in chains of ultracold polar molecules

Ultracold polar molecules, in highly anisotropic traps and interacting via a repulsive dipolar potential, may form one-dimensional chains at high densities. According to classical theory, at low temperatures there exists a critical value of the density at which a second-order phase transition from a linear to a zigzag chain occurs. We study the effect of thermal and quantum fluctuations on these self-organized structures using classical and quantum Monte Carlo methods, by means of which we evaluate the pair correlation function and the static structure factor. Depending on the parameters, these functions exhibit properties typical of a crystalline or of a liquid system. We compare the thermal and the quantum results, identifying analogies and differences. Finally, we discuss experimental parameter regimes where the effects of quantum fluctuations on the linear-zigzag transition can be observed.

Parallels between machine and brain decoding

We report some existing work, inspired by analogies between human thought and machine computation, showing that the informational state of a digital computer can be decoded in a similar way to brain decoding. We then discuss some proposed work that would leverage this analogy to shed light on the amount of information that may be missed by the technical limitations of current neuroimaging technologies. © 2012 Springer-Verlag.