Using the EM Algorithm to Train Neural Networks: Misconceptions and a New Algorithm for Multiclass Classification

The expectation-maximization (EM) algorithm has been of considerable interest in recent years as the basis for various algorithms in application areas of neural networks such as pattern recognition. However, there exists some misconceptions concerning its application to neural networks. In this paper, we clarify these misconceptions and consider how the EM algorithm can be adopted to train multilayer perceptron (MLP) and mixture of experts (ME) networks in applications to multiclass classification. We identify some situations where the application of the EM algorithm to train MLP networks may be of limited value and discuss some ways of handling the difficulties. For ME networks, it is reported in the literature that networks trained by the EM algorithm using iteratively reweighted least squares (IRLS) algorithm in the inner loop of the M-step, often performed poorly in multiclass classification. However, we found that the convergence of the IRLS algorithm is stable and that the log likelihood is monotonic increasing when a learning rate smaller than one is adopted. Also, we propose the use of an expectation-conditional maximization (ECM) algorithm to train ME networks. Its performance is demonstrated to be superior to the IRLS algorithm on some simulated and real data sets.

Enhanced Endothelium-dependent Relaxation Of Rat Pulmonary Artery Following β-adrenergic Overstimulation: Involvement Of The No/cgmp/vasp Pathway.

The aim of this study was to investigate whether β-adrenoceptor (β-AR) overstimulation induced by in vivo treatment with isoproterenol (ISO) alters vascular reactivity and nitric oxide (NO) production and signaling in pulmonary arteries. Vehicle or ISO (0.3mgkg(-1)day(-1)) was administered daily to male Wistar rats. After 7days, the jugular vein was cannulated to assess right ventricular (RV) systolic pressure (SP) and end diastolic pressure (EDP). The extralobar pulmonary arteries were isolated to evaluate the relaxation responses, protein expression (Western blot), NO production (diaminofluorescein-2 fluorescence), and cyclic guanosine 3',5'-monophosphate (cGMP) levels (enzyme immunoassay kit). ISO treatment induced RV hypertrophy; however, no differences in RV-SP and EDP were observed. The pulmonary arteries from the ISO-treated group showed enhanced relaxation to acetylcholine that was abolished by the NO synthase (NOS) inhibitor N(ω)-nitro-l-arginine methyl ester (l-NAME); whereas relaxation elicited by sodium nitroprusside, ISO, metaproterenol, mirabegron, or KCl was not affected by ISO treatment. ISO-treated rats displayed enhanced endothelial NOS (eNOS) and vasodilator-stimulated phosphoprotein (VASP) expression in the pulmonary arteries, while phosphodiesterase-5 protein expression decreased. ISO treatment increased NO and cGMP levels and did not induce eNOS uncoupling. The present data indicate that β-AR overactivation enhances the endothelium-dependent relaxation of pulmonary arteries. This effect was linked to an increase in eNOS-derived NO production, cGMP formation and VASP content and to a decrease in phosphodiesterase-5 expression. Therefore, elevated NO bioactivity through cGMP/VASP signaling could represent a protective mechanism of β-AR overactivation on pulmonary circulation.

The Biopsychosocial Spiritual Model Applied To The Treatment Of women With Breast Cancer, Through Rime Intervention (relaxation, mental Images, Spirituality).

This postdoctoral study on the application of the RIME intervention in women that had undergone mastectomy and were in treatment, aimed to promote psychospiritual and social transformations to improve the quality of life, self-esteem and hope. A total of 28 women participated and were randomized into two groups. Brief Psychotherapy (PB) (average of six sessions) was administered in the Control Group, and RIME (three sessions) and BP (average of five sessions) were applied in the RIME Group. The quantitative results indicated a significant improvement (38.3%) in the Perception of Quality of Life after RIME according to the WHOQOL, compared both to the BP of the Control Group (12.5%), and the BP of the RIME Group (16.2%). There was a significant improvement in Self-esteem (Rosenberg) after RIME (14.6%) compared to the BP of the Control Group (worsened 35.9%), and the BP of the RIME Group (8.3%). The improvement in well-being, considering the focus worked on (Visual Analog Scale), was significant in the RIME Group (bad to good), as well as in the Control Group (unpleasant to good). The qualitative results indicated that RIME promotes creative transformations in the intrapsychic and interpersonal dimensions, so that new meanings and/or new attitudes emerge into the consciousness. It was observed that RIME has more strength of psychic structure, ego strengthening and provides a faster transformation that BP, therefore it can be indicated for crisis treatment in the hospital environment.

Pharmacological Characterization Of The Relaxation Induced By The Soluble Guanylate Cyclase Activator, Bay 60-2770 In Rabbit Corpus Cavernosum.

To characterize the relaxation induced by the soluble guanylate cyclase (sGC) activator, BAY 60-2770 in rabbit corpus cavernosum. Penis from male New Zealand rabbits were removed and fours strips of corpus cavernosum (CC) were obtained. Concentration-response curves to BAY 60-2770 were carried out in the absence and presence of inhibitors of nitric oxide synthase, L-NAME (100 μM), sGC, ODQ (10 μM) and phosphodiestarase type 5, tadalafil (0.1 μM). The potency (pEC50) and maximal response (Emax) values were determined. Second, electrical-field stimulation (EFS)-induced contraction or relaxation was realized in the absence and presence of BAY 60-2770 (0.1 or 1 μM) alone or in combination of ODQ (10 μM). In the case of EFS-induced relaxation two protocols were realized: 1) ODQ (10 μM) was first incubated for 20 min and then BAY 60-2770 (1 μM) was added for another 20 min (ODQ + BAY 60-2770). In different CC strips, BAY 60-2770 was incubated for 20 min followed by another 20 min with ODQ (BAY 60-2770 + ODQ). The intracellular levels of cyclic guanosine monophosphate (cGMP) were also determined. BAY 60-2770 potently relaxed rabbit CC with pEC50 and Emax values of 7.58 ± 0.19 and 81 ± 4%, respectively. The inhibitors ODQ (n=7) or tadalafil (n=7) produced 4.2- and 6.3-leftward shifts, respectively in BAY 60-2770-induced relaxation without interfering on the Emax values. The intracellular levels of cGMP were augmented after stimulation with BAY 60-2770 (1 μM) alone, whereas its co-incubation with ODQ produced even higher levels of cGMP. The EFS-induced contraction was reduced in the presence of BAY 60-2770 (1 μM) and this inhibition was even greater when BAY 60-2770 was co-incubated with ODQ. The nitrergic stimulation induced CC relaxation, which was abolished in the presence of ODQ. BAY 60-2770 alone increased the amplitude of relaxation. Co-incubation of ODQ and BAY 60-2770 did not alter the relaxation in comparison with ODQ alone. Interestingly, when BAY 60-2770 was incubated prior to ODQ, EFS-induced relaxation was partly restored in comparison with ODQ alone or ODQ + BAY 60-2770. Considering that the relaxation induced by the sGC activator, BAY 60-2770 was increased after sGC oxidation and unaltered in the absence of nitric oxide, these class of substances are advantageous over sGC stimulators or PDE5 inhibitors for the treatment in those patients with erectile dysfunction and high endothelial damage. This article is protected by copyright. All rights reserved.

Sildenafil preserves diastolic relaxation after reduction by L-NAME and increases phosphodiesterase-5 in the intercalated discs of cardiac myocytes and arterioles

OBJECTIVES: We investigated the influence of sildenafil on cardiac contractility and diastolic relaxation and examined the distribution of phosphodiesterase-5 in the hearts of hypertensive rats that were treated with by NG-nitro-L-arginine methyl ester (L-NAME). METHODS: Male Wistar rats were treated with L-NAME and/or sildenafil for eight weeks. The Langendorff method was used to examine the effects of sildenafil on cardiac contractility and diastolic relaxation. The presence and location of phosphodiesterase-5 and phosphodiesterase-3 were assessed by immunohistochemistry, and cGMP plasma levels were measured by ELISA. RESULTS: In isolated hearts, sildenafil prevented the reduction of diastolic relaxation (dP/dt) that was induced by L-NAME. In addition, phosphodiesterase-5 immunoreactivity was localized in the intercalated discs between the myocardial cells. The staining intensity was reduced by L-NAME, and sildenafil treatment abolished this reduction. Consistent with these results, the plasma levels of cGMP were decreased in the L-NAME-treated rats but not in rats that were treated with L-NAME + sildenafil. CONCLUSION: The sildenafil-induced attenuation of the deleterious hemodynamic and cardiac morphological effects of L-NAME in cardiac myocytes is mediated (at least in part) by the inhibition of phosphodiesterase-5.

Vascular relaxation of canine visceral arteries after ischemia by means of supraceliac aortic cross-clamping followed by reperfusion

Background: The supraceliac aortic cross-clamping can be an option to save patients with hipovolemic shock due to abdominal trauma. However, this maneuver is associated with ischemia/reperfusion (I/R) injury strongly related to oxidative stress and reduction of nitric oxide bioavailability. Moreover, several studies demonstrated impairment in relaxation after I/R, but the time course of I/R necessary to induce vascular dysfunction is still controversial. We investigated whether 60 minutes of ischemia followed by 30 minutes of reperfusion do not change the relaxation of visceral arteries nor the plasma and renal levels of malondialdehyde (MDA) and nitrite plus nitrate (NOx). Methods: Male mongrel dogs (n = 27) were randomly allocated in one of the three groups: sham (no clamping, n = 9), ischemia (supraceliac aortic cross-clamping for 60 minutes, n = 9), and I/R (60 minutes of ischemia followed by reperfusion for 30 minutes, n = 9). Relaxation of visceral arteries (celiac trunk, renal and superior mesenteric arteries) was studied in organ chambers. MDA and NOx concentrations were determined using a commercially available kit and an ozone-based chemiluminescence assay, respectively. Results: Both acetylcholine and calcium ionophore caused relaxation in endothelium-intact rings and no statistical differences were observed among the three groups. Sodium nitroprusside promoted relaxation in endothelium-denuded rings, and there were no inter-group statistical differences. Both plasma and renal concentrations of MDA and NOx showed no significant difference among the groups. Conclusion: Supraceliac aortic cross-clamping for 60 minutes alone and followed by 30 minutes of reperfusion did not impair relaxation of canine visceral arteries nor evoke biochemical alterations in plasma or renal tissue.

Matter-wave two-dimensional solitons in crossed linear and nonlinear optical lattices

The existence of multidimensional matter-wave solitons in a crossed optical lattice (OL) with a linear optical lattice (LOL) in the x direction and a nonlinear optical lattice (NOL) in the y direction, where the NOL can be generated by a periodic spatial modulation of the scattering length using an optically induced Feshbach resonance is demonstrated. In particular, we show that such crossed LOLs and NOLs allow for stabilizing two-dimensional solitons against decay or collapse for both attractive and repulsive interactions. The solutions for the soliton stability are investigated analytically, by using a multi-Gaussian variational approach, with the Vakhitov-Kolokolov necessary criterion for stability; and numerically, by using the relaxation method and direct numerical time integrations of the Gross-Pitaevskii equation. Very good agreement of the results corresponding to both treatments is observed.

Hybrid and multi-field variational principles for geometrically exact three-dimensional beams

This paper addresses the development of several alternative novel hybrid/multi-field variational formulations of the geometrically exact three-dimensional elastostatic beam boundary-value problem. In the framework of the complementary energy-based formulations, a Legendre transformation is used to introduce the complementary energy density in the variational statements as a function of stresses only. The corresponding variational principles are shown to feature stationarity within the framework of the boundary-value problem. Both weak and linearized weak forms of the principles are presented. The main features of the principles are highlighted, giving special emphasis to their relationships from both theoretical and computational standpoints. (C) 2010 Elsevier Ltd. All rights reserved.

On Seliger and Whitham`s variational principle for hydrodynamic systems from the point of view of `fictitious particles`

FAPESP, the Sao Paulo State Research Foundation[04/04611-5]

Optimal design of periodic functionally graded composites with prescribed properties

The computational design of a composite where the properties of its constituents change gradually within a unit cell can be successfully achieved by means of a material design method that combines topology optimization with homogenization. This is an iterative numerical method, which leads to changes in the composite material unit cell until desired properties (or performance) are obtained. Such method has been applied to several types of materials in the last few years. In this work, the objective is to extend the material design method to obtain functionally graded material architectures, i.e. materials that are graded at the local level (e.g. microstructural level). Consistent with this goal, a continuum distribution of the design variable inside the finite element domain is considered to represent a fully continuous material variation during the design process. Thus the topology optimization naturally leads to a smoothly graded material system. To illustrate the theoretical and numerical approaches, numerical examples are provided. The homogenization method is verified by considering one-dimensional material gradation profiles for which analytical solutions for the effective elastic properties are available. The verification of the homogenization method is extended to two dimensions considering a trigonometric material gradation, and a material variation with discontinuous derivatives. These are also used as benchmark examples to verify the optimization method for functionally graded material cell design. Finally the influence of material gradation on extreme materials is investigated, which includes materials with near-zero shear modulus, and materials with negative Poisson`s ratio.

Stress relaxation behavior of PMMA/PS polymer blends

In this work, the stress relaxation behavior of PMMA/PS blends, with or without random copolymer addition, submitted to step shear strain experiments in the linear and nonlinear regime was studied. The effect of blend composition (ranging from 10 to 30 wt.% of dispersed phase), viscosity ratio (ranging from 0.1 to 7.5), and random copolymer addition (for concentrations up to 8 wt.% with respect to the dispersed phase) was evaluated and correlated to the evolution of the morphology of the blends. All blends presented three relaxation stages: a first fast relaxation which was attributed to the relaxation of the pure phases, a second one which was characterized by the presence of a plateau, and a third fast one. The relaxation was shown to be faster for less extended and smaller droplets and to be influenced by coalescence for blends with a dispersed phase concentration larger than 20 wt.%. The relaxation of the blend was strongly influenced by the matrix viscosity. The addition of random copolymer resulted in a slower relaxation of the droplets.

The semi-synthetic kaurane ent-16 alpha-methoxykauran-19-oic acid induces vascular relaxation and hypotension in rats

The present work investigates the mechanisms involved in the vasorelaxant effect of ent-16 alpha-methoxykauran-19-oic acid (KA-OCH(3)), a semi-synthetic derivative obtained from the kaurane-type diterpene ent-kaur-16-en-19-oic acid (kaurenoic acid). Vascular reactivity experiments were performed in aortic rings isolated from male Wistar rats using standard muscle bath procedures. The cytosolic calcium concentration ([Ca(2+)]c) was measured by confocal microscopy using the fluorescent probe Fluo-3 AM. Blood pressure measurements were performed in conscious rats. KA-OCH(3) (10,50 and 100 mu mol/l) inhibited phenylephrine-induced contraction in either endothelium-intact or endothelium-denuded rat aortic rings. KA-OCH(3) also reduced CaCl(2)-induced contraction in a Ca(2+)-free solution containing KCl (30 mmol/l) or phenylephrine (0.1 mu mol/l). KA-OCH(3) (0.1-300 mu mol/l) concentration-dependently relaxed endothelium-intact and endothelium-denuded aortas pre-contracted with either phenylephrine or KCl, to a greater extent than kaurenoic acid. Moreover, a Ca(2+) mobilisation study showed that KA-OCH(3) (100 mu mol/l) inhibited the increase in Ca(2+) concentration in smooth muscle and endothelial cells induced by phenylephrine or KCl. Pre-incubation of intact or denuded aortic rings with N(G)-nitro-L-arginine methyl ester (L-NAME, 100 mu mol/l), 7-nitroindazole (100 mu mol/l), wortmannin (0.5 mu mol/l) and 1H-[1,2,4]Oxadiazolo[4,3-a]quinoxalin-1-one (ODQ 1 mu mol/l) produced a rightward displacement of the KA-OCH(3) concentration-response curve. Intravenous administration of KA-OCH(3) (1-10 mg/kg) reduced mean arterial blood pressure in normotensive rats. Collectively, our results show that KA-OCH(3) induces vascular relaxation and hypotension. The mechanisms underlying the cardiovascular actions of KA-OCH(3) involve blockade of Ca(2+) influx and activation of the NO-cGMP pathway. (C) 2011 Elsevier B.V. All rights reserved.

Balloon catheter injury abolishes phenylephrine-induced relaxation in the rat contralateral carotid

BACKGROUND AND PURPOSE The consequences of compensatory responses to balloon catheter injury in rat carotid artery, on phenylephrine-induced relaxation and contraction in the contralateral carotid artery were studied. EXPERIMENTAL APPROACH Relaxation and contraction concentration-response curves for phenylephrine were obtained for contralateral carotid arteries in the presence of indomethacin (COX inhibitor), SC560 (COX-1 inhibitor), SC236 (COX-2 inhibitor) or 4-hydroxytetramethyl-L-piperidine-1-oxyl (tempol; superoxide dismutase mimetic). Reactive oxygen species were measured in carotid artery endothelial cells fluorimetrically with dihydroethidium. KEY RESULTS Phenylephrine-induced relaxation was abolished in contralateral carotid arteries from operated rats (E(max) = 0.01 +/- 0.004 g) in relation to control (E(max) = 0.18 +/- 0.005 g). Phenylephrine-induced contractions were increased in contralateral arteries (E(max) = 0.54 +/- 0.009 g) in relation to control (E(max) = 0.38 +/- 0.014 g). SC236 restored phenylephrine-induced relaxation (E(max) = 0.17 +/- 0.004 g) and contraction (E(max) = 0.34 +/- 0.018 g) in contralateral arteries. Tempol restored phenylephrine-induced relaxation (E(max) = 0.19 +/- 0.012 g) and contraction (E(max) = 0.42 +/- 0.014 g) in contralateral arteries, while apocynin did not alter either relaxation (E(max) = 0.01 +/- 0.004 g) or contraction (E(max) = 0.54 +/- 0.009 g). Dihydroethidium fluorescence was increased in contralateral samples (18 882 +/- 435 U) in relation to control (10 455 +/- 303 U). SC236 reduced the fluorescence in contralateral samples (8250 +/- 365 U). CONCLUSIONS AND IMPLICATIONS Balloon catheter injury abolished phenylephrine-induced relaxation and increased phenylephrine-induced contraction in contralateral carotid arteries, through O(2)(-) derived from COX-2.

Acidosis induces relaxation mediated by nitric oxide and potassium channels in rat thoracic aorta

We investigated the mechanism by which extracellular acidification promotes relaxation in rat thoracic aorta. The relaxation response to HCl-induced extracellular acidification (7.4 to 6.5) was measured in aortic rings pre-contracted with phenylephrine (Phe, 10(-6) M) or KCl (45 mM). The vascular reactivity experiments were performed in endothelium-intact and denuded rings, in the presence or absence of indomethacin (10(-5) M), L-NAME (10(-4) M), apamin (10(-6) M), and glibenclamide (10(-5) M). The effect of extracellular acidosis (pH 7.0 and 6.5) on nitric oxide (NO) production was evaluated in isolated endothelial cells loaded with diaminofluorescein-FM diacetate (DAF-FM DA, 5 mu M). The extracellular acidosis failed to induce any changes in the vascular tone of aortic rings pre-contracted with KCl, however, it caused endothelium-dependent and independent relaxation in rings pre-contracted with Phe. This acidosis induced-relaxation was inhibited by L-NAME, apamin, and glibenclamide, but not by indomethacin. The acidosis (pH 7.0 and 6.5) also promoted a time-dependent increase in the NO production by the isolated endothelial cells. These results suggest that extracellular acidosis promotes vasodilation mediated by NO, K(ATP) and SK(Ca), and maybe other K(+) channels in isolated rat thoracic aorta. (C) 2011 Elsevier B.V. All rights reserved.

A new nitrosyl ruthenium complex nitric oxide donor presents higher efficacy than sodium nitroprusside on relaxation of airway smooth muscle

Nitric oxide (NO) has been demonstrated to be the primary agent in relaxing airways in humans and animals. We investigated the mechanisms involved in the relaxation induced by NO-donors, ruthenium complex [Ru(terpy)(bdq)NO(+)](3+) (TERPY) and sodium nitroprusside (SNP) in isolated trachea of rats contracted with carbachol in an isolated organs chamber. For instance, we verified the contribution of K(+) channels, the importance of sGC/cGMP pathway, the influence of the extra and intracellular Ca(2+) sources and the contribution of the epithelium on the relaxing response. Additionally, we have used confocal microscopy in order to analyze the action of the NO-donors on cytosolic Ca(2+) concentration. The results demonstrated that both compounds led to the relaxation of trachea in a dependent-concentration way. However, the maximum effect (E(max)) of TERPY is higher than the SNP. The relaxation induced by SNP (but not TERPY) was significantly reduced by pretreatment with ODQ (sGC inhibitor). Only TERPY-induced relaxation was reduced by tetraethylammonium (K(+) channels blocker) and by pre-contraction with 75 mM KCl (membrane depolarization). The response to both NO-donors was not altered by the presence of thapsigargin (sarcoplasmic reticulum Ca(2+)-ATPase inhibitor). The epithelium removal has reduced the relaxation only to SNP, and it has no effect on TERPY. The both NO-donors reduced the contraction evoked by Ca(2+) influx, while TERPY have shown a higher inhibitory effect on contraction. Moreover, the TERPY was more effective than SNP in reducing the cytosolic Ca(2+) concentration measured by confocal microscopy. In conclusion, these results show that TERPY induces airway smooth muscle relaxation by cGMP-independent mechanisms, it involves the fluxes of Ca(2+) and K(+) across the membrane, it is more effective in reducing cytosolic Ca(2+) concentration and inducing relaxation in the rat trachea than the standard drug, SNP. (C) 2011 Elsevier B.V. All rights reserved.