The applicability of recurrent neural networks for biological sequence analysis

Selection of machine learning techniques requires a certain sensitivity to the requirements of the problem. In particular, the problem can be made more tractable by deliberately using algorithms that are biased toward solutions of the requisite kind. In this paper, we argue that recurrent neural networks have a natural bias toward a problem domain of which biological sequence analysis tasks are a subset. We use experiments with synthetic data to illustrate this bias. We then demonstrate that this bias can be exploitable using a data set of protein sequences containing several classes of subcellular localization targeting peptides. The results show that, compared with feed forward, recurrent neural networks will generally perform better on sequence analysis tasks. Furthermore, as the patterns within the sequence become more ambiguous, the choice of specific recurrent architecture becomes more critical.

Distribution, expression, and motif variability of ankyrin domain genes in Wolbachia pipientis

The endosymbiotic bacterium Wolbachia pipientis infects a wide range of arthropods, in which it induces a variety of reproductive phenotypes, including cytoplasmic incompatibility (CI), parthenogenesis, male killing, and reversal of genetic sex determination. The recent sequencing and annotation of the first Wolbachia genome revealed an unusually high number of genes encoding ankyrin domain (ANK) repeats. These ANK genes are likely to be important in mediating the Wolbachia-host interaction. In this work we determined the distribution and expression of the different ANK genes found in the sequenced Wolbachia wMel genome in nine Wolbachia strains that induce different phenotypic effects in their hosts. A comparison of the ANK genes of wMel and the non-CI-inducing wAu Wolbachia strain revealed significant differences between the strains. This was reflected in sequence variability in shared genes that could result in alterations in the encoded proteins, such as motif deletions, amino acid insertions, and in some cases disruptions due to insertion of transposable elements and premature stops. In addition, one wMel ANK gene, which is part of an operon, was absent in the wAu genome. These variations are likely to affect the affinity, function, and cellular location of the predicted proteins encoded by these genes.

Long-term risk of first recurrent stroke in the Perth Community Stroke Study

Background and Purpose-Few community-based studies have examined the long-term risk of recurrent stroke after an acute first-ever stroke. This study aimed to determine the absolute and relative risks of a first recurrent stroke over the first 5 years after a first-ever stroke and the predictors of such recurrence in a population-based series of people with first-ever stroke in Perth, Western Australia. Methods-Between February 1989 and August 1990, all people with a suspected acute stroke or transient ischemic attack of the brain who were resident in a geographically defined region of Perth, Western Australia, with a population of 138 708 people, were registered prospectively and assessed according to standardized diagnostic criteria. Patients were followed up prospectively at 4 months, 12 months, and 5 years after the index event. Results-Three hundred seventy patients with a first-ever stroke were registered, of whom 351 survived >2 days. Data were available for 98% of the cohort at 5 years, by which time 199 patients (58%) had died and 52 (15%) had experienced a recurrent stroke, 12 (23%) of which were fatal within 28 days. The 5-year cumulative risk of first recurrent stroke was 22.5% (95% confidence limits [CL], 16.8%, 28.1%). The risk of recurrent stroke was greatest in the first 6 months after stroke, at 8.8% (95% CL, 5.4%, 12.1%). After adjustment for age and sex, the prognostic factors for recurrent stroke were advanced, but not extreme, age (75 to 84 years) (hazard ratio [HR], 2.6; 95% CL, 1.1, 6.2), hemorrhagic index stroke (HR, 2.1; 95% CL, 0.98, 4.4), and diabetes mellitus (HR, 2.1; 95% CL, 0.95, 4.4). Conclusions-Approximately 1 in 6 survivors (15%) of a first-ever stroke experience a recurrent stroke over the next 5 years, of which 25% are fatal within 28 days. The pathological subtype of the recurrent stroke is the same as that of the index stroke in 88% of cases. The predictors of first recurrent stroke in this study were advanced age, hemorrhagic index stroke, and diabetes mellitus, but numbers of recurrent events were modest. Because the risk of recurrent stroke is highest (8.8%) in the first 6 months after stroke, strategies for secondary prevention should be initiated as soon as possible after the index event.

Plant cyclotides: A unique family of cyclic and knotted proteins that defines the cyclic cystine knot structural motif

Several macrocyclic peptides (similar to 30 amino acids), with diverse biological activities, have been isolated from the Rubiaceae and Violaceae plant families over recent years. We have significantly expanded the range of known macrocyclic peptides with the discovery of 16 novel peptides from extracts of Viola hederaceae, Viola odorata and Oldenlandia affinis. The Viola plants had not previously been examined for these peptides and thus represent novel species in which these unusual macrocyclic peptides are produced. Further, we have determined the three-dimensional struc ture of one of these novel peptides, cycloviolacin O1, using H-1 NMR spectroscopy. The structure consists of a distorted triple-stranded beta-sheet and a cystine-knot arrangement of the disulfide bonds. This structure is similar to kalata B1 and circulin A, the only two macrocyclic peptides for which a structure was available, suggesting that despite the sequence variation throughout the peptides they form a family in which the overall fold is conserved. We refer to these peptides as the cyclotide family and their embedded topology as the cyclic cystine knot (CCK) motif. The unique cyclic and knotted nature of these molecules makes them a fascinating example of topologically complex proteins. Examination of the sequences reveals they can be separated into two subfamilies, one of which tends to contain a larger number of positively charged residues and has a bracelet-like circularization of the backbone. The second subfamily contains a backbone twist due to a cis-Pro peptide bond and may conceptually be regarded as a molecular Moebius strip. Here we define the structural features of the two apparent subfamilies of the CCK peptides which may be significant for the likely defense related role of these peptides within plants. (C) 1999 Academic Press.

'Tetol': a stereo-rigid four-strand motif for alkali and alkaline earth metal ion coordination

The tetraalcohol 2,3,5,6-endo,endo,endo,endo-tetrakis(hydroxymethyl]bicyclo[2.2.1]heptane (tetol, 1) has been prepared and crystallises readily as the lithium(I) complex [Li(1)(2)]Cl, forming an oligomeric multi-chain structure in which pairs of alcohols from two crystallographically independent tetol molecules bind lithium ions tetrahedrally. However, formation of monomeric structures in solution is inferred from electrospray mass spectroscopy, which has also shown evidence of exchange of lithium ion in the complexed species by added alkaline earth ions. (C) 2000 Elsevier Science S.A. All rights reserved.

Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

Mortality and recurrent cardiac events after coronary artery bypass graft: long term outcomes in a population study

Objective: To determine 30 day mortality, long term survival, and recurrent cardiac events after coronary artery bypass graft (CABG) in a population. Design: Follow up study of patients prospectively entered on to a cardiothoracic surgical database. Record linkages were used to obtain data on readmissions and deaths. Patients: 8910 patients undergoing isolated first CABG between 1980 and 1993 in Western Australia. Main outcome measures: 30 day and long term survival, readmission for cardiac event (acute myocardial infarction, unstable angina, percutaneous transluminal coronary angioplasty or reoperative CABG). Results: There were 3072 deaths to mid 1999. 30 day and long term survival were significantly better in patients treated in the first five years than during the following decade. The age of the patients, proportion of female patients, and number of grafts increased over time. An urgent procedure (odds ratio 3.3), older age (9% per year) and female sex (odds ratio 1.5) were associated with increased risk for 30 day mortality, while age (7% per year) and a recent myocardial infarction (odds ratio 1.16) influenced long term survival. Internal mammary artery grafts were followed by better short and long term survival, though there was an obvious selection bias in favour of younger male patients. Conclusions: This study shows worsening crude mortality at 30 days after CABG from the mid 1980s, associated with the inclusion of higher risk patients. Older age, an acute myocardial infarction in the year before surgery, and the use of sephenous vein grafts only were associated with poorer long term survival and greater risk of a recurrent cardiac event. Female sex predicted recurrent events but not long term survival.

Ten-year risk of first recurrent stroke and disability after first-ever stroke in the Perth Community Stroke Study

Background and Purpose-Limited information exists on the long-term prognosis after first-ever stroke. We aimed to determine the absolute frequency of first recurrent stroke and disability and the relative frequency of recurrent stroke over 10 years after first-ever stroke in Perth, Western Australia. Methods-For a 12-month period beginning February 1989, all individuals with suspected acute stroke or transient ischemic attack who lived in a geographically defined and representative region of Perth were registered prospectively. Patients with a definite first-ever stroke were followed up 10 years after the index event. Results-Over 10 years of follow-up, the cumulative risk of a first recurrent stroke was 43% (95% confidence interval [CI], 34 to 51). After the first year after first-ever stroke, the average annual risk of recurrent stroke was approximate to4%. Case fatality at 30 days after first recurrent stroke was 41%, which was significantly greater than the case fatality at 30 days after first-ever stroke (22%) (P=0.003). For 30-day survivors of first-ever stroke, the 10-year cumulative risk of death or new institutionalization was 79% (95% CI, 73 to 85) and of death or new disability was 87% (95% CI, 81 to 92). Conclusions-Over 10 years of follow-up, the risk of first recurrent stroke is 6 times greater than the risk of first-ever stroke in the general population of the same age and sex, almost one half of survivors remain disabled, and one seventh require institutional care. Effective strategies for prevention of stroke need to be implemented early, monitored frequently, and maintained long term after first-ever stroke.

Preventing recurrent events long term after coronary artery bypass graft: Suboptimal use of medications in a population study

Background There are few population-based data on long-term management of patients after coronary artery bypass graft (CABG), despite the high risk for future major vascular events among this group. We assessed the prevalence and correlates of pharmacotherapy for prevention of new cardiac events in a large population-based series. Methods A postal survey was conducted of 2500 randomly selected survivors from a state population of patients 6 to 20 years after first CABG. Results Response was 82% (n = 2061). Use of antiplatelet agents (80%) and statins (64%) declined as age increased. Other independent predictors of antiplatelet use included statin use (odds ratio [OR] 1.6, 95% CI 1.26-2.05) and recurrent angina (OR 1.6, CI 1.17-2.06). Current smokers were less likely to use aspirin (OR 0.59, CI 0.4-0.89). Statin use was associated with reported high cholesterol (OR 24.4, CI 8.4-32.4), management by a cardiologist (OR 2.3, CI 1.8-3.0), and the use of calcium channel-blockers. Patients reporting hypertension or heart failure, in addition to high cholesterol, were less likely to use statins. Angiotensin-converting enzyme inhibitors were the most commonly prescribed agents for management of hypertension (59%) and were more frequently used among patients with diabetes and those with symptoms of heart failure. Overall 42% of patients were on angiotensin-converting enzyme inhibitors and 36% on beta-blockers. Conclusions Gaps exist in the use of-recommended medications after CABG. Lower anti-platelet and statin use was associated with older age, freedom from angina, comorbid heart failure or hypertension, and not regularly visiting a cardiologist. Patients who continue to smoke might be less likely to adhere to prescribed medications.

Trends in five-year survival and risk of recurrent stroke after first-ever stroke in the Perth community stroke study

Background: Few studies provide information on trends in the long-term outcome of stroke. We aimed to determine trends in survival and recurrent stroke, over 5 years after first-ever stroke, for 2 cohorts of patients enrolled in the Perth Community Stroke Study in 1989 90 and 1995-96. Methods: For 12-month periods beginning February 1989 and February 1995, all individuals with an acute stroke who were resident in a geographically-defined and representative region of Perth, Western Australia, were registered and followed-up prospectively 5 years after the index event. Results: The 5-year cumulative risk of death was 59% (95% confidence interval (CI) 53%, 65%) and 58% (95% CI 52%, 65%) for the 1989-90 and 1995-96 cohorts, respectively (p = 0.94). The 5-year cumulative risk of first recurrent stroke was 32% (95% CI 25%, 40%) and 23% (95% CI 16%, 30%) for the 1989-90 and 1995-96 cohorts, respectively (p = 0.07). Conclusions: Although no statistically significant improvement occurred in 5-year survival after first-ever stroke in Perth between 1989-90 and 1995-96, there was a statistically nonsignificant trend towards a smaller cumulative risk of recurrent stroke over 5 years after a first-ever stroke. Serial community-based studies of the incidence and outcome of stroke are an important means of monitoring the translation of proven preventive interventions to improvements in population health. Copyright (C) 2005 S. Karger AG, Basel.

A peptide-binding motif for I-A(g7), the class II major histocompatibility complex (MHC) molecule of NOD and Biozzi AB/H mice

The class II major histocompatibility complex molecule I-A(g7) is strongly linked to the development of spontaneous insulin-dependent diabetes mellitus (IDDM) in non obese diabetic mice and to the induction of experimental allergic encephalomyelitis in Biozzi AB/H mice. Structurally, it resembles the HLA-DQ molecules associated with human IDDM, in having a non-Asp residue at position 57 in its beta chain. To identify the requirements for peptide binding to I-A(g7) and thereby potentially pathogenic T cell epitopes, we analyzed a known I-A(g7)-restricted T cell epitope, hen egg white lysozyme (HEL) amino acids 9-27. NH2- and COOH-terminal truncations demonstrated that the minimal epitope for activation of the T cell hybridoma 2D12.1 was M12-R21 and the minimum sequence for direct binding to purified I-A(g7) M12-Y20/K13-R21. Alanine (A) scanning revealed two primary anchors for binding at relative positions (p) 6 (L) and 9 (Y) in the HEL epitope. The critical role of both anchors was demonstrated by incorporating L and Y in poly(A) backbones at the same relative positions as in the HEL epitope. Well-tolerated, weakly tolerated, and nontolerated residues were identified by analyzing the binding of peptides containing multiple substitutions at individual positions. Optimally, p6 was a large, hydrophobic residue (L, I, V, M), whereas p9 was aromatic and hydrophobic (Y or F) or positively charged (K, R). Specific residues were not tolerated at these and some other positions. A motif for binding to I-A(g7) deduced from analysis of the model HEL epitope was present in 27/30 (90%) of peptides reported to be I-A(g7)-restricted T cell epitopes or eluted from I-A(g7). Scanning a set of overlapping peptides encompassing human proinsulin revealed the motif in 6/6 good binders (sensitivity = 100%) and 4/13 weak or non-binders (specificity = 70%). This motif should facilitate identification of autoantigenic epitopes relevant to the pathogenesis and immunotherapy of IDDM.