Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

Governing coordination: Behavioural principles and neural correlates

The coordination of movement is governed by a coalition of constraints. The expression of these constraints ranges from the concrete—the restricted range of motion offered by the mechanical configuration of our muscles and joints; to the abstract—the difficulty that we experience in combining simple movements into complex rhythms. We seek to illustrate that the various constraints on coordination are complementary and inclusive, and the means by which their expression and interaction are mediated systematically by the integrative action of the central nervous system (CNS). Beyond identifying the general principles at the behavioural level that govern the mutual interplay of constraints, we attempt to demonstrate that these principles have as their foundation specific functional properties of the cortical motor systems. We propose that regions of the brain upstream of the motor cortex may play a significant role in mediating interactions between the functional representations of muscles engaged in sensorimotor coordination tasks. We also argue that activity in these ldquosupramotorrdquo regions may mediate the stabilising role of augmented sensory feedback.

The sites of neural adaptation induced by resistance training in humans

Although it has long been supposed that resistance training causes adaptive changes in the CNS, the sites and nature of these adaptations have not previously been identified. In order to determine whether the neural adaptations to resistance training occur to a greater extent at cortical or subcortical sites in the CNS, we compared the effects of resistance training on the electromyographic (EMG) responses to transcranial magnetic (TMS) and electrical (TES) stimulation. Motor evoked potentials (MEPs) were recorded from the first dorsal interosseous muscle of 16 individuals before and after 4 weeks of resistance training for the index finger abductors (n = 8), or training involving finger abduction-adduction without external resistance (n = 8). TMS was delivered at rest at intensities from 5 % below the passive threshold to the maximal output of the stimulator. TMS and TES were also delivered at the active threshold intensity while the participants exerted torques ranging from 5 to 60 % of their maximum voluntary contraction (MVC) torque. The average latency of MEPs elicited by TES was significantly shorter than that of TMS MEPs (TES latency = 21.5 ± 1.4 ms; TMS latency = 23.4 ± 1.4 ms; P < 0.05), which indicates that the site of activation differed between the two forms of stimulation. Training resulted in a significant increase in MVC torque for the resistance-training group, but not the control group. There were no statistically significant changes in the corticospinal properties measured at rest for either group. For the active trials involving both TMS and TES, however, the slope of the relationship between MEP size and the torque exerted was significantly lower after training for the resistance-training group (P < 0.05). Thus, for a specific level of muscle activity, the magnitude of the EMG responses to both forms of transcranial stimulation were smaller following resistance training. These results suggest that resistance training changes the functional properties of spinal cord circuitry in humans, but does not substantially affect the organisation of the motor cortex.

A hybrid planning method for transmission networks in a deregulated environment

The reconstruction of power industries has brought fundamental changes to both power system operation and planning. This paper presents a new planning method using multi-objective optimization (MOOP) technique, as well as human knowledge, to expand the transmission network in open access schemes. The method starts with a candidate pool of feasible expansion plans. Consequent selection of the best candidates is carried out through a MOOP approach, of which multiple objectives are tackled simultaneously, aiming at integrating the market operation and planning as one unified process in context of deregulated system. Human knowledge has been applied in both stages to ensure the selection with practical engineering and management concerns. The expansion plan from MOOP is assessed by reliability criteria before it is finalized. The proposed method has been tested with the IEEE 14-bus system and relevant analyses and discussions have been presented.

Development and evaluation of neural network freeway incident detection models using field data

This paper discusses a multi-layer feedforward (MLF) neural network incident detection model that was developed and evaluated using field data. In contrast to published neural network incident detection models which relied on simulated or limited field data for model development and testing, the model described in this paper was trained and tested on a real-world data set of 100 incidents. The model uses speed, flow and occupancy data measured at dual stations, averaged across all lanes and only from time interval t. The off-line performance of the model is reported under both incident and non-incident conditions. The incident detection performance of the model is reported based on a validation-test data set of 40 incidents that were independent of the 60 incidents used for training. The false alarm rates of the model are evaluated based on non-incident data that were collected from a freeway section which was video-taped for a period of 33 days. A comparative evaluation between the neural network model and the incident detection model in operation on Melbourne's freeways is also presented. The results of the comparative performance evaluation clearly demonstrate the substantial improvement in incident detection performance obtained by the neural network model. The paper also presents additional results that demonstrate how improvements in model performance can be achieved using variable decision thresholds. Finally, the model's fault-tolerance under conditions of corrupt or missing data is investigated and the impact of loop detector failure/malfunction on the performance of the trained model is evaluated and discussed. The results presented in this paper provide a comprehensive evaluation of the developed model and confirm that neural network models can provide fast and reliable incident detection on freeways. (C) 1997 Elsevier Science Ltd. All rights reserved.

Measurement and state preparation via ion trap quantum computing

We investigate in detail the effects of a QND vibrational number measurement made on single ions in a recently proposed measurement scheme for the vibrational state of a register of ions in a linear rf trap [C. D'HELON and G. J. MILBURN, Phys Rev. A 54, 5141 (1996)]. The performance of a measurement shows some interesting patterns which are closely related to searching.

Prediction of MHC class II-binding peptides using an evolutionary algorithm and artificial neural network

Motivation: Prediction methods for identifying binding peptides could minimize the number of peptides required to be synthesized and assayed, and thereby facilitate the identification of potential T-cell epitopes. We developed a bioinformatic method for the prediction of peptide binding to MHC class II molecules. Results: Experimental binding data and expert knowledge of anchor positions and binding motifs were combined with an evolutionary algorithm (EA) and an artificial neural network (ANN): binding data extraction --> peptide alignment --> ANN training and classification. This method, termed PERUN, was implemented for the prediction of peptides that bind to HLA-DR4(B1*0401). The respective positive predictive values of PERUN predictions of high-, moderate-, low- and zero-affinity binder-a were assessed as 0.8, 0.7, 0.5 and 0.8 by cross-validation, and 1.0, 0.8, 0.3 and 0.7 by experimental binding. This illustrates the synergy between experimentation and computer modeling, and its application to the identification of potential immunotheraaeutic peptides.

Expokit: A software package for computing matrix exponentials

Expokit provides a set of routines aimed at computing matrix exponentials. More precisely, it computes either a small matrix exponential in full, the action of a large sparse matrix exponential on an operand vector, or the solution of a system of linear ODEs with constant inhomogeneity. The backbone of the sparse routines consists of matrix-free Krylov subspace projection methods (Arnoldi and Lanczos processes), and that is why the toolkit is capable of coping with sparse matrices of large dimension. The software handles real and complex matrices and provides specific routines for symmetric and Hermitian matrices. The computation of matrix exponentials is a numerical issue of critical importance in the area of Markov chains and furthermore, the computed solution is subject to probabilistic constraints. In addition to addressing general matrix exponentials, a distinct attention is assigned to the computation of transient states of Markov chains.

Designs for an asymmetric gradient set and a compact superconducting magnet for neural magnetic resonance imaging

Imaging of the head and neck is the most commonly performed clinical magnetic resonance imaging (MRI) examination [R. G. Evans and J. R. G. Evans, AJR 157, 603 (1991)]. This is usually undertaken in a generalist MRI instrument containing superconducting magnet system capable of imaging all organs. These generalist instruments are large, typically having a bore of 0.9-1.0 m and a length of 1.7-2.5 m and therefore are expensive to site, somewhat claustrophobic to the patient, and offer little access by attending physicians. In this article, we present the design of a compact, superconducting MRI magnet for head and neck imaging that is less than 0.8 m in length and discuss in detail the design of an asymmetric gradient coil set, tailored to the magnet profile. In particular, the introduction of a radio-frequency FM modulation scheme in concert with a gradient sequence allows the epoch of the linear region of the gradient set to be much closer to the end of the gradient structure than was previously possible. Images from a prototype gradient set demonstrate the effectiveness of the designs. (C) 1999 American Institute of Physics. [S0034-6748(99)04910-2].

Altered adhesion, proliferation and death in neural cultures from adults with schizophrenia

The causes of schizophrenia are unknown, but there is evidence linking subtle deviations in neural development with schizophrenia. Embryonic brain development cannot be studied in an adult with schizophrenia, but neurogenesis and early events in neuronal differentiation can be investigated throughout adult life in the human olfactory epithelium. Our past research has demonstrated that neuronal cultures can be derived from biopsy of the human adult olfactory epithelium. In the present study, we examined mechanisms related to neurogenesis and neuronal differentiation in adults with schizophrenia versus well controls. Forty biopsies were collected under local anaesthesia from ten individuals with DSM III-R schizophrenia and ten age- and sex-matched well controls. All patients, except one, were receiving antipsychotic medication at the time of the biopsy, Immunostaining for neuronal markers indicated that neurogenesis occurred in the biopsies from both patients and controls since all contained cells expressing tubulin and/or olfactory marker protein. The major findings of this study are: 1. biopsies from patients with schizophrenia showed a significantly reduced ability to attach to the culture slide: 29.9% of patient biopsies attached compared to 73.5% of control biopsies; 2. biopsies from patients with schizophrenia had a significantly greater proportion of cells undergoing mitosis: 0.69% in the patients compared to 0.29% in the controls; and 3. dopamine (10 mu M) significantly increased the proportion of apoptotic cells in the control cultures but significantly decreased the proportion in patients' cultures. (C) 1999 Elsevier Science B.V. All rights reserved.

An object-oriented neural network approach to short-term traffic forecasting

This paper discusses an object-oriented neural network model that was developed for predicting short-term traffic conditions on a section of the Pacific Highway between Brisbane and the Gold Coast in Queensland, Australia. The feasibility of this approach is demonstrated through a time-lag recurrent network (TLRN) which was developed for predicting speed data up to 15 minutes into the future. The results obtained indicate that the TLRN is capable of predicting speed up to 5 minutes into the future with a high degree of accuracy (90-94%). Similar models, which were developed for predicting freeway travel times on the same facility, were successful in predicting travel times up to 15 minutes into the future with a similar degree of accuracy (93-95%). These results represent substantial improvements on conventional model performance and clearly demonstrate the feasibility of using the object-oriented approach for short-term traffic prediction. (C) 2001 Elsevier Science B.V. All rights reserved.

Inter-subband redundancy prediction using neural network for video coding

High performance video codec is mandatory for multimedia applications such as video-on-demand and video conferencing. Recent research has proposed numerous video coding techniques to meet the requirement in bandwidth, delay, loss and Quality-of-Service (QoS). In this paper, we present our investigations on inter-subband self-similarity within the wavelet-decomposed video frames using neural networks, and study the performance of applying the spatial network model to all video frames over time. The goal of our proposed method is to restore the highest perceptual quality for video transmitted over a highly congested network. Our contributions in this paper are: (1) A new coding model with neural network based, inter-subband redundancy (ISR) prediction for video coding using wavelet (2) The performance of 1D and 2D ISR prediction, including multiple levels of wavelet decompositions. Our result shows a short-term quality enhancement may be obtained using both 1D and 2D ISR prediction.