28 resultados para Nonlinear activation functions
em Repositório Institucional UNESP - Universidade Estadual Paulista "Julio de Mesquita Filho"
Resumo:
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)
Resumo:
Function approximation is a very important task in environments where computation has to be based on extracting information from data samples in real world processes. Neural networks and wavenets have been recently seen as attractive tools for developing efficient solutions for many real world problems in function approximation. In this paper, it is shown how feedforward neural networks can be built using a different type of activation function referred to as the PPS-wavelet. An algorithm is presented to generate a family of PPS-wavelets that can be used to efficiently construct feedforward networks for function approximation.
Resumo:
Artificial Neural Networks are widely used in various applications in engineering, as such solutions of nonlinear problems. The implementation of this technique in reconfigurable devices is a great challenge to researchers by several factors, such as floating point precision, nonlinear activation function, performance and area used in FPGA. The contribution of this work is the approximation of a nonlinear function used in ANN, the popular hyperbolic tangent activation function. The system architecture is composed of several scenarios that provide a tradeoff of performance, precision and area used in FPGA. The results are compared in different scenarios and with current literature on error analysis, area and system performance. © 2013 IEEE.
Resumo:
The main purpose of this paper is to investigate theoretically and experimentally the use of family of Polynomial Powers of the Sigmoid (PPS) Function Networks applied in speech signal representation and function approximation. This paper carries out practical investigations in terms of approximation fitness (LSE), time consuming (CPU Time), computational complexity (FLOP) and representation power (Number of Activation Function) for different PPS activation functions. We expected that different activation functions can provide performance variations and further investigations will guide us towards a class of mappings associating the best activation function to solve a class of problems under certain criteria.
Resumo:
Wavelet functions have been used as the activation function in feedforward neural networks. An abundance of R&D has been produced on wavelet neural network area. Some successful algorithms and applications in wavelet neural network have been developed and reported in the literature. However, most of the aforementioned reports impose many restrictions in the classical backpropagation algorithm, such as low dimensionality, tensor product of wavelets, parameters initialization, and, in general, the output is one dimensional, etc. In order to remove some of these restrictions, a family of polynomial wavelets generated from powers of sigmoid functions is presented. We described how a multidimensional wavelet neural networks based on these functions can be constructed, trained and applied in pattern recognition tasks. As an example of application for the method proposed, it is studied the exclusive-or (XOR) problem.
Resumo:
In this paper, we described how a multidimensional wavelet neural networks based on Polynomial Powers of Sigmoid (PPS) can be constructed, trained and applied in image processing tasks. In this sense, a novel and uniform framework for face verification is presented. The framework is based on a family of PPS wavelets,generated from linear combination of the sigmoid functions, and can be considered appearance based in that features are extracted from the face image. The feature vectors are then subjected to subspace projection of PPS-wavelet. The design of PPS-wavelet neural networks is also discussed, which is seldom reported in the literature. The Stirling Universitys face database were used to generate the results. Our method has achieved 92 % of correct detection and 5 % of false detection rate on the database.
Resumo:
Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)
Resumo:
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)
Resumo:
Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)
Resumo:
It is well known that glucocorticoids induce peripheral insulin resistance in rodents and humans. Here, we investigated the structural and ultrastructural modifications, as well as the proteins involved in beta-cell function and proliferation, in islets from insulin-resistant rats. Adult male Wistar rats were made insulin resistant by daily administration of dexamethasone (DEX; 1mg/kg, i.p.) for five consecutive days, whilst control (CTL) rats received saline alone. Structure analyses showed a marked hypertrophy of DEX islets with an increase of 1.7-fold in islet mass and of 1.6-fold in islet density compared with CTL islets (P < 0.05). Ultrastructural evaluation of islets revealed an increased amount of secreting organelles, such as endoplasmic reticulum and Golgi apparatus in DEX islets. Mitotic figures were observed in DEX islets at structural and ultrastructural levels. Beta-cell proliferation, evaluated at the immunohistochemical level using anti-PCNA (proliferating cell nuclear antigen), showed an increase in pancreatic beta-cell proliferation of 6.4-fold in DEX islets compared with CTL islets (P < 0.0001). Increases in insulin receptor substrate-2 (IRS-2), phosphorylated-serine-threonine kinase AKT (p-AKT), cyclin D(2) and a decrease in retinoblastoma protein (pRb) levels were observed in DEX islets compared with CTL islets (P < 0.05). Therefore, during the development of insulin resistance, the endocrine pancreas adapts itself increasing beta-cell mass and proliferation, resulting in an amelioration of the functions. The potential mechanisms that underlie these events involve the activation of the IRS-2/AKT pathway and activation of the cell cycle, mediated by cyclin D(2). These adaptations permit the maintenance of glycaemia at near-physiological ranges.
Resumo:
In paracoccidioidomycosis, a systemic mycosis caused by the fungus Paracoccidioides brasiliensis (Pb), studies have focused on the role of neutrophils that are involved in the primary response to the fungus. Neutrophil functions are regulated by pro- and anti-inflammatory cytokines. Molecular mechanisms involved in this process are not fully understood, but there are strong evidences about the involvement of toll-like receptors (TLRs). We aimed at evaluating TLR2 and TLR4 expression on human neutrophils activated by GM-CSF, IL-15, TNF-alpha or IFNgamma and challenged with a virulent strain of P. brasiliensis (Pb18). Moreover, we asked if these receptors have a role on fungicidal activity, H(2)O(2) and IL-6, IL-8, TNFalpha and IL-10 production, by activating and challenging cells. All cytokines increased TLR2 and TLR4 expression. Pb18 also increased TLR2 expression, inducing an additional cytokine effect. on the contrary, it inhibited TLR4 expression. All cytokines increased neutrophil fungicidal activity and H(2)O(2) production; however, this process was not associated with TLR2 or TLR4. Neutrophil activation by GMCSF and TNF-alpha resulted in a significant increase of IL-8 production, while IL-15 and IFN-alpha have no effect. Pb18 also augmented IL-8 expression, inducing an additional effect to that of cytokines. None of the cytokines activated neutrophils by releasing IL-10. This cytokine was only detected after Pb18 challenge. Interestingly, IL-8 and IL-10 production involved TLR2 and mainly TLR4 modulation. The present results suggest that Pb18 interaction with neutrophils through TLR2 and TLR4 with consequent IL-8 and IL-10 production may be considered a pathogenic mechanism in paracoccidioidomycosis.
Resumo:
Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)
Resumo:
Asymptotic behavior of initially large and smooth pulses is investigated at two typical stages of their evolution governed by the defocusing nonlinear Schrodinger equation. At first, wave breaking phenomenon is studied in the limit of small dispersion. A solution of the Whitham modulational equations is found for the case of dissipationless shock wave arising after the wave breaking point. Then, asymptotic soliton trains arising eventually from a large and smooth initial pulse are studied by means of a semiclassical method. The parameter varying along the soliton train is calculated from the generalized Bohr-Sommerfeld quantization rule, so that the distribution of eigenvalues depends on two functions-intensity rho(0)(x) of the initial pulse and its initial chirp v(0)(x). The influence of the initial chirp on the asymptotic state is investigated. Excellent agreement of the numerical solution of the defocusing NLS equation with predictions of the asymptotic theory is found.
Resumo:
Tin dioxide varistors doped with Coo, ZnO, Ta2O5 and Cr2O3 were prepared by the mixed oxide method. Temperature dependent impedance spectroscopy revealed two different activation energies, one at low frequencies and the other at high frequencies. These activation energies were associated with the adsorption and reaction of O-2 species at the grain boundary interface. We show that Cr2O3 improves the varistor properties, generating sites for the adsorption of O' and O at the grain boundary region. The O' and O defects are truly responsible for the barrier formation at the grain boundary interface. (c) 2005 Elsevier Ltd and Techna Group S.r.l. All rights reserved.
Resumo:
Macrófagos são conhecidos por exercerem uma importante função de mecanismo de defesa quando estas células são estimuladas com produtos naturais e produtos bacterianos (dentre outros). Uma variedade de citocinas e compostos químicos são liberados para induzir sistema de defesa fundamental. Entre outros peróxido de hidrogênio (H2O2) tem sido identificado como moléculas tendo multifunções. Entretanto está bem estabelecido que (H2O2) está envolvido em inúmeros processos fisiológicos, como por exemplo, neurotransmissão, relaxamento da musculatura lisa ou regulação imune. Para a determinação de peróxido de hidrogênio (H2O2) em macrófago peritoneal em camundongos, determinou-se a ação imunomodulatória de extratos (etanólico e etanólico 70%) obtidos de quatro espécies do gênero Paepalanthus (Eriocaulaceae) na concentração de 10 mg/mL. Os estratos etanólicos 70 % de capítulos de P. Hilairei, P. robustus, P. vellozioides e P. speciocus apresentaram maior liberação de (H2O2) do que os outros extratos etanólicos.