Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

Recombinant human growth hormone, but not insulin-like growth factor-I, enhances central fat loss in postmenopausal women undergoing a diet and exercise program

We examined the effect of recombinant human growth hormone (rhGH) and/or recombinant human insulin-like growth factor-I (rhIGF-I) on regional fat loss in postmenopausal women undergoing a weight loss regimen of diet plus exercise. Twenty-seven women aged 59-79 years, 20-40% above ideal body weight, completed a 12-week program consisting of resistance training 2 days/week and walking 3 days/week, while consuming a diet that was 500 kcal/day less than that required for weight maintenance, Participants were randomly assigned in a double-blind fashion to receive rhGH (0.025 mg/kg BW/day: n=7), rhIGF-I (0.015 mg/kg BW/day: n=7), rhGH + rhIGF-I (n = 6), or placebo (PL: n = 7). Regional and whole body fat mass were determined by dual X-ray absorptiometry. Body fat distribution was assessed by the ratios of trunk fat-to-limb fat (TrF/LimbF) and trunk fat-to-total fat (TrF/TotF), Limb and trunk fat decreased in all groups (p < 0.01). For both ratios of fat distribution, the rhGH treated group experienced an enhanced loss of truncal compared to peripheral fat (p less than or equal to 0.01), with no significant change for those administered rhIGF-I or FL. There was no association between change in fat distribution and indices of cardiovascular disease risk as determined by serum lipid/lipoprotein levels and maximal aerobic capacity. These results suggest that administration of rhGH facilitates a decrease in central compared to peripheral fat in older women undertaking a weight loss program that combines exercise and moderate caloric restriction, although no beneficial effects are conferred to lipid/lipoprotein profiles, Further, the effect of rhGH is not enhanced by combining rhCH with rhIGF-I administration. In addition, rhIGF-I does not augment the loss of trunk fat when administered alone.

Paternal age as a risk factor for psychosis and schizophrenia: Findings from Denmark, Sweden and Australia

The offspringof older fathers have an increased risk of various disorders that may be due to the accumulation of DNA mutations during spermatogenesis. Previous studies have suggested increased paternal age may be a risk factor for schizophrenia. The aim of the current study was to examine paternal age as a risk factor for schizophrenia andror psychosis. We used data from three sources: a population-based cohort studyŽDenmark., and two case-control studiesŽSweden and Australia.. In the Danish and Australian studies, we examined both psychosis and schizophrenia. In the Swedish study we examined psychosis only. After controllingfor the effect of maternal age, increased paternal age was significantly associated with increased risk of both psychosis and schizophrenia in the Danish study and of psychosis in the Swedish study. The Australian study found no association between paternal age and risk of psychosis or schizophrenia. In all three studies the relationship between paternal age and risk of disorder in the offspring was AUB-shaped. In addition to an increased risk for the offspringof older father Ž)35 years., there was a non-significant increase for the offspringof fathers aged less than 20 years. The possible role of paternally derived DNA mutations andror other psychosocial factors associated with older paternal age warrants further research. The ‘U’-shaped relationship suggests that factors other than DNA mutations may warrant consideration in this research. The Stanley Foundation supported this project.

Relationship of interleukin-6 and tumor necrosis factor-alpha with muscle mass and muscle strength in elderly men and women: The health ABC study

Background. A decline in muscle mass and muscle strength characterizes normal aging. As clinical and animal studies show it relationship between higher cytokine levels and low muscle mass, the aim of this study was to investigate whether markers, of inflammation are associated with muscle mass and strength in well-functioning elderly persons. Methods. We Used baseline data (1997-1998) of the Health, Aging, and Body Composition (Health ABC) Study on 3075 black and white men and women aged 70-79 years. Midthigh muscle cross-sectional area (computed tomography), appendicular muscle mass (dual-energy x-ray ab absorptiometry). isokinetic knee extensor strength (KinCom). and isometric inip strength were measured. plasma levels of interleukin-6 (IL-6) and tumor necrosis factor-alpha (TNF-alpha) were assessed by enzyme-linked immunosorbent assay (ELISA). Results. Higher cytokine levels were generally associated with lower muscle mass and lower muscle strength. The most consistent relationship across the gender and race groups was observed for IL-6 and grip strength: per SD increase in IL-6, grip strength was 1.1 to 2.4 kg lower (p < .05) after adjustment for age, clinic Site. health status, medications, physical activity. smoking. height. and body fat. Ail overall measure of elevated cytokine level was created by combining the levels of IL-6 and TNF-alpha. With the exception of white men, elderly persons having high levels of IL-6 (> 1.80 pg/ml) as well as high levels of TNF-alpha (> 3.20 pg/ml) had a smaller muscle area, less appendicular mass. a lower knee extensor strength. and a lower grip strength compared to those with low levels of both cytokines. Conclusions. Higher plasma concentrations of IL-6 and TNF-alpha are associated with lower muscle mass and lower muscle strength in well-functioning older men and women. Higher cytokine levels. as often observed in healthy older persons. may contribute to the loss Of muscle mass and strength that accompanies aging.

Cooperation of cytokine signaling with chimeric transcription factors in leukemogenesis: PML-retinoic acid receptor alpha blocks growth factor-mediated differentiation

We utilized a mouse model of acute promyelocytic leukemia (APL) to investigate how aberrant activation of cytokine signaling pathways interacts with chimeric transcription factors to generate acute myeloid leukemia. Expression in mice of the APL-associated fusion, PML-RARA, initially has only modest effects on myelopoiesis. Whereas treatment of control animals with interleukin-3 (IL-3) resulted in expanded myelopoiesis without a block in differentiation, PML-RARA abrogated differentiation that normally characterizes the response to IL-3. Retroviral transduction of bone marrow with an IL-3-expressing retrovirus revealed that IL-3 and promyelocytic leukemia-retinoic acid receptor alpha (PML-RARalpha) combined to generate a lethal leukemia-like syndrome in

Good readers use context-sensitive grapheme-phoneme correspondences

Fifth-grade children were given a series of word reading tasks. First, two sets of 16 disyllabic words with medial VCV spellings, and with a long initial vowel were selected, varying in frequency but with similar word-initial segments. Nonwords were derived from these sets of words by exchanging initial onsets. Children read these nonwords in a first testing session. In a second test session, children were given the Woodcock Word Identification Test and the set of analogue words from which the nonwords were derived. Initial analyses examined only nonwords derived from words that were correctly read. Both sets of nonwords were more likely to be read with a long initial vowel than a short initial vowel, although this tendency was stronger in nonwords derived from high frequency words. Furthennore, Word Identification ability showed a strong relationship with the preference for long initial vowels in this type of disyllabic nonword, both for nonwords derived from known analogues and for nonwords derived from words that children could not read correctly. This preference was also correlated with the preference for context-sensitive grapheme-phoneme correspondences in the reading of ambiguous monosyllabic nonwords.These results have strong implications for current theories of word reading.

Modulation of cytochrome P450 monooxygenase by cadmium chloride in the mouse liver: Involvement of transcription factor Nrf2.

Modulation of the cytochrome P450 (CYP) monooxygenase system and haem oxygenase by cadmium was investigated in male, adult DBA/2J mice treated with a single dose (16 Amol/kg body weight, i.p.) of cadmium chloride (CdCl2), at various time points. Total CYP content of liver microsomes decreased significantly (P < 0.05) at 12, 18, and 24 hours (22%, 47%, and 56%, respectively) after treatment. In contrast, progressive increases of hepatic coumarin 7-hydroxylase (COH) activity (indicative of CYP2A5 activity) were observed at 8 hrs (2-fold), 12 hrs (3-fold), and 7-fold at 18 and 24 hrs. Simultaneously, haem oxygenase activity increased significantly at 4 hours and continued to increase progressively to more than 50-fold compared to control. Liver CYP2A5 mRNA levels increased maximally 12 hours after treatment and decreased to almost half 6 hours later, while western blot analysis showed 2- and 3- fold increase in CYP2A5 apoprotein at 12 and 24 hours. The CYP2A5 mRNA levels in the liver increased after Cd treatment in Nrf2 +/+ but not in Nrf2 / mouse. This study demonstrates that hepatic haem oxygenase and CYP2A5 are upregulated by cadmium. The upregulation of haem oxygenase precedes that of CYP2A5. The strong upregulation of the CYP2A5 both at mRNA and enzyme activity levels, with a simultaneous decrease in the total CYP concentration suggest an unusual mode of regulation of CYP2A5 in response to cadmium exposure, amongst the CYP enzymes. The observed increase in the mRNA but not in protein levels after maximal induction may suggest involvement of post-transcriptional mechanisms in the regulation. Upregulation of CYP2A5 by cadmium in the Nrf2 +/+ mice but not in the Nrf2 / mice indicates a role for this transcription factor in the regulation.

Folate-sensitive fragile site FRA10A is due to an expansion of a CGG repeat in a novel gene, FRA10AC1, encoding a nuclear protein

Fragile sites appear visually as nonstaining gaps on chromosomes that are inducible by specific cell culture conditions. Expansion of CGG/ CCG repeats has been shown to be the molecular basis of all five folate-sensitive fragile sites characterized molecularly so far, i.e., FRAXA, FRAXE, FRAXF, FRA11B, and FRA16A. In the present study we have refined the localization of the FRA10A folate-sensitive fragile site by fluorescence in situ hybridization. Sequence analysis of a BAC clone spanning FRA10A identified a single, imperfect, but polymorphic CGG repeat that is part of a CpG island in the 5'UTR of a novel gene named FRA10ACl. The number of CGG repeats varied in the population from 8 to 13. Expansions exceeding 200 repeat units were methylated in all FRA10A fragile site carriers tested. The FRA10ACl gene consists of 19 exons and is transcribed in the centromeric direction from the FRA10A repeat. The major transcript of similar to 1450 nt is ubiquitously expressed and codes for a highly conserved protein, FRA10ACl, of unknown function. Several splice variants leading to alternative 3' ends were identified (particularly in testis). These give rise to FRA10ACl proteins with altered COOH-termini. Immunofluorescence analysis of full-length, recombinant EGFP-tagged FRA10ACl protein showed that it was present exclusively in the nucleoplasm. We show that the expression of FRA10A, in parallel to the other cloned folate-sensitive fragile sites, is caused by an expansion and subsequent methylation of an unstable CGG trinucleotide repeat. Taking advantage of three cSNPs within the FRA10ACl gene we demonstrate that one allele of the gene is not transcribed in a FRA10A carrier. Our data also suggest that in the heterozygous state FRA10A is likely a benign folate-sensitive fragile site. (C) 2004 Elsevier Inc. All rights reserved.

PETAL LOSS, a trihelix transcription factor gene, regulates perianth architecture in the Arabidopsis flower

Perianth development is specifically disrupted in mutants of the PETAL LOSS (PTL) gene, particularly petal initiation and orientation. We have cloned PTL and show that it encodes a plant-specific trihelix transcription factor, one of a family previously known only as regulators of light-controlled genes. PTL transcripts were detected in the early-developing flower, in four zones between the initiating sepals and in their developing margins. Strong misexpression of PTL in a range of tissues universally results in inhibition of growth, indicating that its normal role is to suppress growth between initiating sepals, ensuring that they remain separate. Consistent with this, sepals are sometimes fused in ptl single mutants, but much more frequently in double mutants with either of the organ boundary genes cup-shaped cotyledon1 or 2. Expression of PTL within the newly arising sepals is apparently prevented by the PINOID auxin-response gene. Surprisingly, PTL expression could not be detected in petals during the early stages of their development, so petal defects associated with PTL loss of function may be indirect, perhaps involving disruption to signalling processes caused by overgrowth in the region. PTL-driven reporter gene expression was also detected at later stages in the margins of expanding sepals, petals and stamens, and in the leaf margins; thus, PTL may redundantly dampen lateral outgrowth of these organs, helping define their final shape.

Serum triglycerides as a risk factor for cardiovascular diseases in the Asia-Pacific Region

Background-The importance of serum triglyceride levels as a risk factor for cardiovascular diseases is uncertain. Methods and Results-We performed an individual participant data meta-analysis of prospective studies conducted in the Asia-Pacific region. Cox models were applied to the combined data from 26 studies to estimate the overall and region-, sex-, and age-specific hazard ratios for major cardiovascular diseases by fifths of triglyceride values. During 796 671 person-years of follow-up among 96 224 individuals, 670 and 667 deaths as a result of coronary heart disease (CHD) and stroke, respectively, were recorded. After adjustment for major cardiovascular risk factors, participants grouped in the highest fifth of triglyceride levels had a 70% (95% CI, 47 to 96) greater risk of CHD death, an 80% (95% CI, 49 to 119) higher risk of fatal or nonfatal CHD, and a 50% (95% CI, 29% to 76%) increased risk of fatal or nonfatal stroke compared with those belonging to the lowest fifth. The association between triglycerides and CHD death was similar across subgroups defined by ethnicity, age, and sex. Conclusions-Serum triglycerides are an important and independent predictor of CHD and stroke risk in the Asia-Pacific region. These results may have clinical implications for cardiovascular risk prediction and the use of lipid-lowering therapy.

Homocysteine-lowering treatment with folic acid, cobalamin, and pyridoxine does not reduce blood markers of inflammation, endothelial dysfunction, or hypercoagulability in patients with previous transient ischemic attack or stroke - a randomized substudy

Background and Purpose - Epidemiological and laboratory studies suggest that increasing concentrations of plasma homocysteine ( total homocysteine [tHcy]) accelerate cardiovascular disease by promoting vascular inflammation, endothelial dysfunction, and hypercoagulability. Methods - We conducted a randomized controlled trial in 285 patients with recent transient ischemic attack or stroke to examine the effect of lowering tHcy with folic acid 2 mg, vitamin B-12 0.5 mg, and vitamin B-6 25 mg compared with placebo on laboratory markers of vascular inflammation, endothelial dysfunction, and hypercoagulability. Results - At 6 months after randomization, there was no significant difference in blood concentrations of markers of vascular inflammation (high-sensitivity C-reactive protein [P = 0.32]; soluble CD40L [ P = 0.33]; IL-6 [P = 0.77]), endothelial dysfunction ( vascular cell adhesion molecule-1 [P = 0.27]; intercellular adhesion molecule-1 [P = 0.08]; von Willebrand factor [P = 0.92]), and hypercoagulability (P-selectin [P = 0.33]; prothrombin fragment 1 and 2 [P = 0.81]; D-dimer [P = 0.88]) among patients assigned vitamin therapy compared with placebo despite a 3.7-mumol/L (95% CI, 2.7 to 4.7) reduction in total homocysteine (tHcy). Conclusions - Lowering tHcy by 3.7 mumol/L with folic acid-based multivitamin therapy does not significantly reduce blood concentrations of the biomarkers of inflammation, endothelial dysfunction, or hypercoagulability measured in our study. The possible explanations for our findings are: ( 1) these biomarkers are not sensitive to the effects of lowering tHcy (eg, multiple risk factor interventions may be required); ( 2) elevated tHcy causes cardiovascular disease by mechanisms other than the biomarkers measured; or ( 3) elevated tHcy is a noncausal marker of increased vascular risk.

Association of tumor necrosis factor-alpha polymorphisms and ozone-induced change in lung function

Ozone is a major air pollutant with adverse health effects which exhibit marked inter-individual variability. In mice, regions of genetic linkage with ozone-induced lung injury include the tumor necrosis factor-alpha (TNF), lymphotoxin-alpha (LTA), Toll-like receptor 4 (TLR4), superoxide dismutase (SOD2), and glutathione peroxidase (GPX1) genes. We genotyped polymorphisms in these genes in 51 individuals who had undergone ozone challenge. Mean change in FEV1 with ozone challenge, as a percentage of baseline, was -3% in TNF -308G/A or A/A individuals, compared with -9% in G/G individuals (p = 0.024). When considering TNF haplotypes, the smallest change in FEV1 with ozone exposure was associated with the TNF haplotype comprising LTA +252G/TNF -1031T/TNF -308A/TNF -238G. This association remained statistically significant after correction for age, sex, disease, and ozone concentration (p = 0.047). SOD2 or GPX1 genotypes were not associated with lung function, and the TLR4 polymorphism was too infrequent to analyze. The results of this study support TNF as a genetic factor for susceptibility to ozone-induced changes in lung function in humans, and has potential implications for stratifying health risks of air pollution.