Linguistics and Information Theory: Analytic advantages

The analytic advantages of central concepts from linguistics and information theory, and the analogies demonstrated between them, for understanding patterns of retrieval from full-text indexes to documents are developed. The interaction between the syntagm and the paradigm in computational operations on written language in indexing, searching, and retrieval is used to account for transformations of the signified or meaning between documents and their representation and between queries and documents retrieved. Characteristics of the message, and messages for selection for written language, are brought to explain the relative frequency of occurrence of words and multiple word sequences in documents. The examples given in the companion article are revisited and a fuller example introduced. The signified of the sequence stood for, the term classically used in the definitions of the sign, as something standing for something else, can itself change rapidly according to its syntagm. A greater than ordinary discourse understanding of patterns in retrieval is obtained.

Analogies between linguistics and information theory

An analogy is established between the syntagm and paradigm from Saussurean linguistics and the message and messages for selection from the information theory initiated by Claude Shannon. The analogy is pursued both as an end itself and for its analytic value in understanding patterns of retrieval from full text systems. The multivalency of individual words when isolated from their syntagm is contrasted with the relative stability of meaning of multi-word sequences, when searching ordinary written discourse. The syntagm is understood as the linear sequence of oral and written language. Saussureâ??s understanding of the word, as a unit which compels recognition by the mind, is endorsed, although not regarded as final. The lesser multivalency of multi-word sequences is understood as the greater determination of signification by the extended syntagm. The paradigm is primarily understood as the network of associations a word acquires when considered apart from the syntagm. The restriction of information theory to expression or signals, and its focus on the combinatorial aspects of the message, is sustained. The message in the model of communication in information theory can include sequences of written language. Shannonâ??s understanding of the written word, as a cohesive group of letters, with strong internal statistical influences, is added to the Saussurean conception. Sequences of more than one word are regarded as weakly correlated concatenations of cohesive units.

Learning Bayesian networks from data: An information-theory based approach

This paper provides algorithms that use an information-theoretic analysis to learn Bayesian network structures from data. Based on our three-phase learning framework, we develop efficient algorithms that can effectively learn Bayesian networks, requiring only polynomial numbers of conditional independence (CI) tests in typical cases. We provide precise conditions that specify when these algorithms are guaranteed to be correct as well as empirical evidence (from real world applications and simulation tests) that demonstrates that these systems work efficiently and reliably in practice.

A decentralized model of information pricing in networks

We propose a recursive method of pricing an information good in a network of holders and demanders of this good. The prices are determined via a unique equilibrium outcome in a sequence of bilateral bargaining games that are played by connected agents. If the information is an homogenous, non-depreciating good without network effects we derive explicit formulae which elucidate the role of the link pattern among the players. Particularly, we find out that the equilibrium price is intimately related to the existence of cycles in the network: It is zero if a cycle covers the trading pair and it is proportional to the direct and indirect utility that the good generates otherwise.

Information processing in the transcriptional regulatory network of yeast: Functional robustness

Background: Gene networks are considered to represent various aspects of molecular biological systems meaningfully because they naturally provide a systems perspective of molecular interactions. In this respect, the functional understanding of the transcriptional regulatory network is considered as key to elucidate the functional organization of an organism.

How position, velocity, and temporal information combine in the prospective control of catching:data and model

The cerebral cortex contains circuitry for continuously computing properties of the environment and one's body, as well as relations among those properties. The success of complex perceptuomotor performances requires integrated, simultaneous use of such relational information. Ball catching is a good example as it involves reaching and grasping of visually pursued objects that move relative to the catcher. Although integrated neural control of catching has received sparse attention in the neuroscience literature, behavioral observations have led to the identification of control principles that may be embodied in the involved neural circuits. Here, we report a catching experiment that refines those principles via a novel manipulation. Visual field motion was used to perturb velocity information about balls traveling on various trajectories relative to a seated catcher, with various initial hand positions. The experiment produced evidence for a continuous, prospective catching strategy, in which hand movements are planned based on gaze-centered ball velocity and ball position information. Such a strategy was implemented in a new neural model, which suggests how position, velocity, and temporal information streams combine to shape catching movements. The model accurately reproduces the main and interaction effects found in the behavioral experiment and provides an interpretation of recently observed target motion-related activity in the motor cortex during interceptive reaching by monkeys. It functionally interprets a broad range of neurobiological and behavioral data, and thus contributes to a unified theory of the neural control of reaching to stationary and moving targets.

Magnetically quantized continuum distorted-wave theory in atomic and molecular collisions

The continuum distorted-wave eikonal initial-state (CDW-EIS) theory of Crothers and McCann (J Phys B 1983, 16, 3229) used to describe ionization in ion-atom collisions is generalized (G) to GCDW-EIS to incorporate the azimuthal angle dependence of each CDW in the final-state wave function. This is accomplished by the analytic continuation of hydrogenic-like wave functions from below to above threshold, using parabolic coordinates and quantum numbers including magnetic quantum numbers, thus providing a more complete set of states. At impact energies lower than 25 keVu(-1), the total ionization cross-section falls off, with decreasing energy, too quickly in comparison with experimental data. The idea behind and motivation for the GCDW-EIS model is to improve the theory with respect to experiment by including contributions from nonzero magnetic quantum numbers. We also therefore incidentally provide a new derivation of the theory of continuum distorted waves for zero magnetic quantum numbers while simultaneously generalizing it. (C) 2004 Wiley Periodicals, Inc.

Information used in detecting upcoming collisions.

In four experiments we examined the nature of the information used in judging whether events would or would not give rise to a collision in the near future. Observers were tested in situations depicting approaches between two objects (lateral approaches) and approaches between an object and the point of observation (head-on approaches), with objects moving according to constant deceleration or sinusoidal deceleration patterns. Judgments were found to be based, to a large extent, on the (in)sufficiency of current deceleration to avoid upcoming collision, as specified optically by tau-dot (tau over dot). However, the information specified, by tau (tau), that is the current (first-order) time remaining until contact, was also found to play a significant role. We deduce that judgment of upcoming collision is based on the detection Of T and its evolution over time, suggesting that observers are sensitive to Deltatau rather than to tau over dot itself.