Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

A twin study of psychometric intelligence and efficiency of information processing

Intelligence (IQ) can be seen as the efficiency of mental processes or cognition, as can basic information processing (IP) tasks like those used in our ongoing Memory, Attention and Problem Solving (MAPS) study. Measures of IQ and IP are correlated and both have a genetic component, so we are studying how the genetic variance in IQ is related to the genetic variance in IP. We measured intelligence with five subscales of the Multidimensional Aptitude Battery (MAB). The IP tasks included four variants of choice reaction time (CRT) and a visual inspection time (IT). The influence of genetic factors on the variances in each of the IQ, IP, and IT tasks was investigated in 250 identical and nonidentical twin pairs aged 16 years. For a subset of 50 pairs we have test–retest data that allow us to estimate the stability of the measures. MX was used for a multivariate genetic analysis that addresses whether the variance in IQ and IP measures is possibly mediated by common genetic factors. Analyses that show the modeled genetic and environmental influences on these measures of cognitive efficiency will be presented and their relevance to ideas on intelligence will be discussed.

Psychophysiological phenotypes of cognition: The P3 and SW components

As part of a large ongoing project, the Memory, Attention and Problem Solving (MAPS) study, we investigated whether genetic variability explains some of the variance in psychophysiological correlates of brain function, namely, the P3 and SW components of event-related potentials (ERPs). These ERP measures are minute time recordings of brain processes and, because they reflect fundamental cognitive processing, provide a unique window on the millisecondto- millisecond transactions that occur at the cognitive level and taking place in the human brain. The extent to which the variance in P3 and SW components is influenced by genetic factors was examined in 350 identical and nonidentical twin pairs aged 16 years. ERPs were recorded from 15 scalp electrodes during the performance of a visuospatial delayed response task that engages working memory. Multivariate genetic analyses using MX were used to estimate genetic and environmental influences on individual differences in brain functioning and to identify putative genetic factors common to the ERP measures and psychometric IQ. For each of the ERP measures, correlation among electrode sites was high, a spatial pattern was evident, and a large part of the genetic variation in the ERPs appeared to be mediated by a common genetic factor. Moderate within-pair concordance in MZ pairs was found for all ERP measures, with higher correlations found for P3 than SW, and the MZ twin pair correlations were approximately twice the DZ correlations, suggesting a genetic influence. Correlations between ERP measures and psychometric IQ were found and, although moderately low, were evident across electrode site. The analyses show that the ERP components, P3 and SW, are promising phenotypes of the neuroelectrical activity of the brain and have the potential to be used in linkage and association analysis in the search for QTLs influencing cognitive function.

The HI Parkes All Sky Survey: southern observations, calibration and robust imaging

The acquisition of HI Parkes All Shy Survey (HIPASS) southern sky data commenced at the Australia Telescope National Facility's Parkes 64-m telescope in 1997 February, and was completed in 2000 March. HIPASS is the deepest HI survey yet of the sky south of declination +2 degrees, and is sensitive to emission out to 170 h(75)(-1) Mpc. The characteristic root mean square noise in the survey images is 13.3 mJy. This paper describes the survey observations, which comprise 23 020 eight-degree scans of 9-min duration, and details the techniques used to calibrate and image the data. The processing algorithms are successfully designed to be statistically robust to the presence of interference signals, and are particular to imaging point (or nearly point) sources. Specifically, a major improvement in image quality is obtained by designing a median-gridding algorithm which uses the median estimator in place of the mean estimator.

Diffusion- and perfusion-weighted MRI response to thrombolysis in stroke

Diffusion- and perfusion-weighted magnetic resonance imaging provides important pathophysiological information in acute bra-in ischemia. We performed a prospective study in 19 sub-6-hour stroke patients using serial diffusion- and perfusion-weighted imaging before intravenous thrombolysis, with repeat studies, both subacutely and at outcome. For comparison of ischemic lesion evolution and clinical outcome, we used a historical control group of 21 sub-6-hour ischemic stroke patients studied serially with diffusion- and perfusion-weighted imaging. The two groups were well matched for the baseline National Institutes of Health Stroke Scale and magnetic resonance parameters. Perfusion-weighted imaging-diffusion-weighted imaging mismatch was present in 16 of 19 patients treated with tissue plasminogen activator, and 16 of 21 controls. Perfusion-weighted imaging-diffusion-weighted imaging mismatch patients treated with tissue plaminogen activator had higher recanalization rates and enhanced reperfusion at day 3 (81% vs 47% in controls), and a greater proportion of severely hypoperfused acute mismatch tissue not progressing to infarction (82% vs -25% in controls). Despite similar baseline diffusion-weighted imaging lesions, infarct expansion was less in the recombinant tissue plaminogen activator group (14cm(3) vs 56cm(3) in controls). The positive effect of thrombolysis on lesion growth in mismatch patients translated into a greater improvement in baseline to outcome National Institutes of Health Stroke Scale in the group treated with recombinant tissue plaminogen activator, and a significantly larger proportion of patients treated with recombinant tissue plaminogen activator having a clinically meaningful improvement in National Institutes of Health Stroke Scale of;2:7 points. The natural evolution of acute perfusion-weighted imaging-diffusion-weighted imaging mismatch tissue may be altered by thrombolysis, with improved stroke outcome. This has implications for the use of diffusion- and perfusion-weighted imaging in selecting and monitoring patients for thrombolytic therapy.