Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

Event-related potentials in the emotional colour naming stroop task and the emotional counting stroop task

This study compared emotional Stroop interference in the emotional colour naming Stroop and the emotional counting Stroop by measuring reaction times and event-related potentials to positive, negative and neutral words. Twenty participants had ERPs recorded at 61 sites while performing both types of emotional Stroop tasks as well as congruent and incongruent conflict conditions. All participants rated stimulus emotionality retrospectively. A robust reaction time Stroop effect was observed in response latency for the traditional ‘‘conflict’’ conditions (congruent vs. incongruent) for the counting Stroop though not the colour naming Stroop task. There was also no evidence of emotional interference for either of the tasks; however, there was trend for positive interference in the colour naming Stroop. The P5 was identified as the event-related potential associated with emotional processing. For the P5 component, significant emotionality effects were evident in the emotional colour naming Stroop for latency (542 ms). There was a significant interaction between valence and hemisphere. The latency of the P5 in the right hemisphere was later for the positive words than negative and neutral. Comparable effects of valence were evident for the emotional counting Stroop for amplitude but not latency.

Verb and context processing in Parkinson's disease

The aim of the present study was to investigate verb and context processing in 10 individuals with Parkinson's disease (PD) and matched controls. A self-paced stop making sense judgment task was employed where participants read a sentence preceded by a context which made the thematic role of the verb plausible or implausible. Participants were required to indicate whether the sentence ceased to make sense at any point by responding yes/no at each word. PD participants were less accurate than the control participants at detecting sentence anomalies based on verb selection restrictions and previously encountered contextual elements. However, further research is required to determine the precise nature of the grammatical processing disturbance associated with PD. (c) 2005 Elsevier Ltd. All rights reserved.

Content and context of monocular regions determine perceived depth in random dot, unpaired background and phantom stereograms

Perceived depth was measured for three-types of stereograms with the colour/texture of half-occluded (monocular) regions either similar to or dissimilar to that of binocular regions or background. In a two-panel random dot stereogram the monocular region was filled with texture either similar or different to the far panel or left blank. In unpaired background stereograms the monocular region either matched the background or was different in colour or texture and in phantom stereograms the monocular region matched the partially occluded object or was a different colour or texture. In all three cases depth was considerably impaired when the monocular texture did not match either the background or the more distant surface. The content and context of monocular regions as well as their position are important in determining their role as occlusion cues and thus in three-dimensional layout. We compare coincidence and accidental view accounts of these effects. (C) 2002 Elsevier Science Ltd. All rights reserved.

The human organization of time: Temporal realities and experience (Book)

Reviews the book "The Human Organization of Time: Temporal Realities and Experience," by Allen C. Bluedorn.

Estimating economic relationships subject to firm- and time-varying equality and inequality constraints

Applied econometricians often fail to impose economic regularity constraints in the exact form economic theory prescribes. We show how the Singular Value Decomposition (SVD) Theorem and Markov Chain Monte Carlo (MCMC) methods can be used to rigorously impose time- and firm-varying equality and inequality constraints. To illustrate the technique we estimate a system of translog input demand functions subject to all the constraints implied by economic theory, including observation-varying symmetry and concavity constraints. Results are presented in the form of characteristics of the estimated posterior distributions of functions of the parameters. Copyright (C) 2001 John Wiley Sons, Ltd.

Reasoning about real-time repetitions: terminating and nonterminating

It is common for a real-time system to contain a nonterminating process monitoring an input and controlling an output. Hence, a real-time program development method needs to support nonterminating repetitions. In this paper we develop a general proof rule for reasoning about possibly nonterminating repetitions. The rule makes use of a Floyd-Hoare-style loop invariant that is maintained by each iteration of the repetition, a Jones-style relation between the pre- and post-states on each iteration, and a deadline specifying an upper bound on the starting time of each iteration. The general rule is proved correct with respect to a predicative semantics. In the case of a terminating repetition the rule reduces to the standard rule extended to handle real time. Other special cases include repetitions whose bodies are guaranteed to terminate, nonterminating repetitions with the constant true as a guard, and repetitions whose termination is guaranteed by the inclusion of a fixed deadline. (C) 2002 Elsevier Science B.V. All rights reserved.

On learning context-free and context-sensitive languages

The long short-term memory (LSTM) is not the only neural network which learns a context sensitive language. Second-order sequential cascaded networks (SCNs) are able to induce means from a finite fragment of a context-sensitive language for processing strings outside the training set. The dynamical behavior of the SCN is qualitatively distinct from that observed in LSTM networks. Differences in performance and dynamics are discussed.

Morningness-eveningness orientation, optimal time-of-day and attitude change: Evidence for the systematic processing of a persuasive communication

This study investigates the effects of morningness-eveningness orientation and time-of-day on persuasion. In an attitude change paradigm, 120 female participants read a persuasive message that consisted of six counter-attitudinal arguments (anti-voluntary euthanasia) either in the morning (8:30 a.m.) or in the evening (7:00 p.m.). Attitude change was assessed by measuring attitudes towards the target issue before and after exposure to the message. Message processing was assessed by thought-listing and message recall tasks. Self-reported mood and arousal were monitored throughout. Participants were classified into M- and E-types according to their scores on the Horne and Ostberg (1976) MEQ questionnaire. When tested at their respective optimal time-of-day (i.e., morning for M-types/evening for E-types), M- and E-types reported higher energetic arousal, greater agreement with the message, greater message-congruent thinking, and a propensity for superior message recall compared to M- and E-types tested at their nonoptimal time-of-day (i.e., evening for M-types/morning for E-types). The attitude change in those tested at their optimal time-of-day was mediated by the level of message-congruent thinking. Results are interpreted in terms of the Elaboration Likelihood Model of persuasion. (c) 2005 Elsevier Ltd. All rights reserved.