Diffusion Gradient Temporal Difference for Cooperative Reinforcement Learning with Linear Function Approximation

We introduce a diffusion-based algorithm in which multiple agents cooperate to predict a common and global statevalue function by sharing local estimates and local gradient information among neighbors. Our algorithm is a fully distributed implementation of the gradient temporal difference with linear function approximation, to make it applicable to multiagent settings. Simulations illustrate the benefit of cooperation in learning, as made possible by the proposed algorithm.

Image processing methods for human brain connectivity analysis from in-vivo diffusion MRI

In this PhD Thesis proposal, the principles of diffusion MRI (dMRI) in its application to the human brain mapping of connectivity are reviewed. The background section covers the fundamentals of dMRI, with special focus on those related to the distortions caused by susceptibility inhomogeneity across tissues. Also, a deep survey of available correction methodologies for this common artifact of dMRI is presented. Two methodological approaches to improved correction are introduced. Finally, the PhD proposal describes its objectives, the research plan, and the necessary resources.

Brain tissue segmentation on Diffusion Weighted Magnetic Resonance data

Introduction Diffusion weighted Imaging (DWI) techniques are able to measure, in vivo and non-invasively, the diffusivity of water molecules inside the human brain. DWI has been applied on cerebral ischemia, brain maturation, epilepsy, multiple sclerosis, etc. [1]. Nowadays, there is a very high availability of these images. DWI allows the identification of brain tissues, so its accurate segmentation is a common initial step for the referred applications. Materials and Methods We present a validation study on automated segmentation of DWI based on the Gaussian mixture and hidden Markov random field models. This methodology is widely solved with iterative conditional modes algorithm, but some studies suggest [2] that graph-cuts (GC) algorithms improve the results when initialization is not close to the final solution. We implemented a segmentation tool integrating ITK with a GC algorithm [3], and a validation software using fuzzy overlap measures [4]. Results Segmentation accuracy of each tool is tested against a gold-standard segmentation obtained from a T1 MPRAGE magnetic resonance image of the same subject, registered to the DWI space. The proposed software shows meaningful improvements by using the GC energy minimization approach on DTI and DSI (Diffusion Spectrum Imaging) data. Conclusions The brain tissues segmentation on DWI is a fundamental step on many applications. Accuracy and robustness improvements are achieved with the proposed software, with high impact on the application’s final result.

Simulation-based evaluation of susceptibility distortion correction methods in diffusion MRI for connectivity analysis

Connectivity analysis on diffusion MRI data of the whole-brain suffers from distortions caused by the standard echo-planar imaging acquisition strategies. These images show characteristic geometrical deformations and signal destruction that are an important drawback limiting the success of tractography algorithms. Several retrospective correction techniques are readily available. In this work, we use a digital phantom designed for the evaluation of connectivity pipelines. We subject the phantom to a “theoretically correct” and plausible deformation that resembles the artifact under investigation. We correct data back, with three standard methodologies (namely fieldmap-based, reversed encoding-based, and registration- based). Finally, we rank the methods based on their geometrical accuracy, the dropout compensation, and their impact on the resulting connectivity matrices.

Modelling diffusion of photovoltaic: concepts and applications

Innovation studies have been interest of not only the scholars from various fields such as economics, management and sociology but also industrial practitioners and policy makers. In this vast and fruitful field, the theory of diffusion of innovations, which has been driven by a sociological approach, has played a vital role in our understanding of the mechanisms behind industrial change. In this paper, our aim is to give a state of art review of diffusion of innovation models in a structural and conceptual way with special reference to photovoltaic. We argue firstly, as an underlying background, how diffusion of innovations theory differs from other innovation studies. Secondly we give a brief taxonomical review of modelling methodologies together with comparative discussions. And finally we put the wealth of modelling in the context of photovoltaic diffusion and suggest some future directions.

Diffusion of photovoltaic in Germany: policy vs. consumers

In some countries photovoltaic (PV) technology has already achieved a stage of development at which it can compete with conventional electricity sources. Germany provides a good illustration of this where PV market has reached a mature stage. As a manifest of this, the German government has recently reduced subsidies for households and industry by decreasing the feed in tariff for PV. This development raises fundamental questions: could the PV industry survive? Will consumers be motivated to continue to adopt PV when feed-in tariff diminish? The point of departure for the relevant literature on diffusion of PV has been on the effect of subsidies but little attention has paid to consumer motives when the policy support is scaled down. This paper introduces an in-depth analysis on understanding the consumer motives for adopting photovoltaic applications. Anchored in an extensive exploratory case study on PV consumers and PV system providers, this study aims to provide an encompassing explanation of diffusion of PV by revealing the link between consumer motives and the impact of policy.

MMonCa: An Object Kinetic Monte Carlo simulator for damage irradiation evolution and defect diffusion

In this work, we introduce the Object Kinetic Monte Carlo (OKMC) simulator MMonCa and simulate the defect evolution in three different materials. We start by explaining the theory of OKMC and showing some details of how such theory is implemented by creating generic structures and algorithms in the objects that we want to simulate. Then we successfully reproduce simulated results for defect evolution in iron, silicon and tungsten using our simulator and compare with available experimental data and similar simulations. The comparisons validate MMonCa showing that it is powerful and flexible enough to be customized and used to study the damage evolution of defects in a wide range of solid materials.

Diffusion of Eco-innovations: exploring the literature

In recent years, the importance of the management of eco-innovations has been growing, more in practice than in academia. However, although in the literature there are already some evidences focussed on management of eco-innovations, there is no comprehensive review on the knowledge base of diffusion of eco-innovations. This paper provides a current overview of the existing body of literature, identifying the most active scholars and relevant publications in this field, and deepening in the major disciplines and research streams. Results show that the theory of diffusion of innovations which provided the philosophical underpinnings of how innovations are diffused is not the main knowledge base to explain the diffusion of eco-innovations. Lead market hypothesis, sustainable transitions and the ecological modernization appear as the initial base of the cognitive platform that can contribute to the understanding of diffusion of eco-innovations.

On ergodic least-squares estimators of the generalized diffusion coefficient for fractional Brownian motion

We analyse a class of estimators of the generalized diffusion coefficient for fractional Brownian motion Bt of known Hurst index H, based on weighted functionals of the single time square displacement. We show that for a certain choice of the weight function these functionals possess an ergodic property and thus provide the true, ensemble-averaged, generalized diffusion coefficient to any necessary precision from a single trajectory data, but at expense of a progressively higher experimental resolution. Convergence is fastest around H ? 0.30, a value in the subdiffusive regime.

Lifetime improvement after phosphorous diffusion gettering on upgraded metallurgical grade silicon

Wide experimental evidence of the phosphorus diffusion gettering beneficial effect on solar grade silicon is found by measuring electron effective lifetime and interstitial iron concentration in as-grown and post processed samples from two ingots of upgraded metallurgical grade silicon produced by Ferrosolar. Results after two different P-diffusion processes are compared: P emitter diffusion at 850ºC followed by fast cool-down (called “standard process”) or followed by slow cool-down (called “extended process”). It is shown that final lifetimes of this low cost material are in the range of those obtained with conventional material. The extended process can be beneficial for wafers with specific initial distribution and concentration of iron, e.g. materials with high concentration of big Fe precipitates, while for other cases the standard process is enough efficient. An analysis based on the comparison of measured lifetime and dissolved iron concentration with theoretical calculations helps to infer the initial iron distribution and concentration, and according to that, choose the more effective type of gettering.

Functional characterization of Rhizobium leguminosarum bv. viciae DmeRF, a cation diffusion facilitator system involved in nickel and cobalt resistance

In prokaryotes, nickel is an essential element participating in the structure of enzymes involved in multiple cellular processes. Nickel transport is a challenge for microorganisms since, although essential, high levels of this metal inside the cell are toxic. For this reason, bacteria have developed high-affinity nickel transporters as well as nickel-specific detoxification systems. Ultramafic soils, and soils contaminated with heavy metals are excellent sources of nickel resistant bacteria. Molecular analysis of strains isolated in the habitats has revealed novel genetic systems involved in adaptation to such hostile conditions.

Identification and analysis of a nickel-inducible cation diffusion facilitator-NiCoT combined system in Rhizobium leguminosarum bv. viciae

Nickel, like other transition metals, can be toxic to cells even at moderate concentration (low microM range) by displacing essential metals from their native binding sites or by generating reactive oxygen species that cause oxidative DNA damage. For this reason, cells have evolved mechanisms to deal with excess nickel. Efflux systems include members of the Resistance-Nodulation-cell Division (RND) protein family, P-type ATPases, cation diffusion facilitators (CDF) and other resistance factors. Nickel-specific exporters have been characterized in Cupravidus metallidurans, Helicobacter pylori, Achromobacter xylosoxidans, Serratia marcenses and Escherichia coli.

Influence of Strouhal number on pulsating methane–air coflow jet diffusion flames

Four periodically time-varying methane–air laminar coflow jet diffusion flames, each forced by pulsating the fuel jet's exit velocity Uj sinusoidally with a different modulation frequency wj and with a 50% amplitude variation, have been computed. Combustion of methane has been modeled by using a chemical mechanism with 15 species and 42 reactions, and the solution of the unsteady Navier–Stokes equations has been obtained numerically by using a modified vorticity-velocity formulation in the limit of low Mach number. The effect of wj on temperature and chemistry has been studied in detail. Three different regimes are found depending on the flame's Strouhal number S=awj/Uj, with a denoting the fuel jet radius. For small Strouhal number (S=0.1), the modulation introduces a perturbation that travels very far downstream, and certain variables oscillate at the frequency imposed by the fuel jet modulation. As the Strouhal number grows, the nondimensional frequency approaches the natural frequency of oscillation of the flickering flame (S≃0.2). A coupling with the pulsation frequency enhances the effect of the imposed modulation and a vigorous pinch-off is observed for S=0.25 and S=0.5. Larger values of S confine the oscillation to the jet's near-exit region, and the effects of the pulsation are reduced to small wiggles in the temperature and concentration values. Temperature and species mass fractions change appreciably near the jet centerline, where variations of over 2% for the temperature and 15% and 40% for the CO and OH mass fractions, respectively, are found. Transverse to the jet movement, however, the variations almost disappear at radial distances on the order of the fuel jet radius, indicating a fast damping of the oscillation in the spanwise direction.

Monte Carlo Neutronics and Thermal-hydraulics coupling applied to Fast Reactors

Un escenario habitualmente considerado para el uso sostenible y prolongado de la energía nuclear contempla un parque de reactores rápidos refrigerados por metales líquidos (LMFR) dedicados al reciclado de Pu y la transmutación de actínidos minoritarios (MA). Otra opción es combinar dichos reactores con algunos sistemas subcríticos asistidos por acelerador (ADS), exclusivamente destinados a la eliminación de MA. El diseño y licenciamiento de estos reactores innovadores requiere herramientas computacionales prácticas y precisas, que incorporen el conocimiento obtenido en la investigación experimental de nuevas configuraciones de reactores, materiales y sistemas. A pesar de que se han construido y operado un cierto número de reactores rápidos a nivel mundial, la experiencia operacional es todavía reducida y no todos los transitorios se han podido entender completamente. Por tanto, los análisis de seguridad de nuevos LMFR están basados fundamentalmente en métodos deterministas, al contrario que las aproximaciones modernas para reactores de agua ligera (LWR), que se benefician también de los métodos probabilistas. La aproximación más usada en los estudios de seguridad de LMFR es utilizar una variedad de códigos, desarrollados a base de distintas teorías, en busca de soluciones integrales para los transitorios e incluyendo incertidumbres. En este marco, los nuevos códigos para cálculos de mejor estimación ("best estimate") que no incluyen aproximaciones conservadoras, son de una importancia primordial para analizar estacionarios y transitorios en reactores rápidos. Esta tesis se centra en el desarrollo de un código acoplado para realizar análisis realistas en reactores rápidos críticos aplicando el método de Monte Carlo. Hoy en día, dado el mayor potencial de recursos computacionales, los códigos de transporte neutrónico por Monte Carlo se pueden usar de manera práctica para realizar cálculos detallados de núcleos completos, incluso de elevada heterogeneidad material. Además, los códigos de Monte Carlo se toman normalmente como referencia para los códigos deterministas de difusión en multigrupos en aplicaciones con reactores rápidos, porque usan secciones eficaces punto a punto, un modelo geométrico exacto y tienen en cuenta intrínsecamente la dependencia angular de flujo. En esta tesis se presenta una metodología de acoplamiento entre el conocido código MCNP, que calcula la generación de potencia en el reactor, y el código de termohidráulica de subcanal COBRA-IV, que obtiene las distribuciones de temperatura y densidad en el sistema. COBRA-IV es un código apropiado para aplicaciones en reactores rápidos ya que ha sido validado con resultados experimentales en haces de barras con sodio, incluyendo las correlaciones más apropiadas para metales líquidos. En una primera fase de la tesis, ambos códigos se han acoplado en estado estacionario utilizando un método iterativo con intercambio de archivos externos. El principal problema en el acoplamiento neutrónico y termohidráulico en estacionario con códigos de Monte Carlo es la manipulación de las secciones eficaces para tener en cuenta el ensanchamiento Doppler cuando la temperatura del combustible aumenta. Entre todas las opciones disponibles, en esta tesis se ha escogido la aproximación de pseudo materiales, y se ha comprobado que proporciona resultados aceptables en su aplicación con reactores rápidos. Por otro lado, los cambios geométricos originados por grandes gradientes de temperatura en el núcleo de reactores rápidos resultan importantes para la neutrónica como consecuencia del elevado recorrido libre medio del neutrón en estos sistemas. Por tanto, se ha desarrollado un módulo adicional que simula la geometría del reactor en caliente y permite estimar la reactividad debido a la expansión del núcleo en un transitorio. éste módulo calcula automáticamente la longitud del combustible, el radio de la vaina, la separación de los elementos de combustible y el radio de la placa soporte en función de la temperatura. éste efecto es muy relevante en transitorios sin inserción de bancos de parada. También relacionado con los cambios geométricos, se ha implementado una herramienta que, automatiza el movimiento de las barras de control en busca d la criticidad del reactor, o bien calcula el valor de inserción axial las barras de control. Una segunda fase en la plataforma de cálculo que se ha desarrollado es la simulació dinámica. Puesto que MCNP sólo realiza cálculos estacionarios para sistemas críticos o supercríticos, la solución más directa que se propone sin modificar el código fuente de MCNP es usar la aproximación de factorización de flujo, que resuelve por separado la forma del flujo y la amplitud. En este caso se han estudiado en profundidad dos aproximaciones: adiabática y quasiestática. El método adiabático usa un esquema de acoplamiento que alterna en el tiempo los cálculos neutrónicos y termohidráulicos. MCNP calcula el modo fundamental de la distribución de neutrones y la reactividad al final de cada paso de tiempo, y COBRA-IV calcula las propiedades térmicas en el punto intermedio de los pasos de tiempo. La evolución de la amplitud de flujo se calcula resolviendo las ecuaciones de cinética puntual. Este método calcula la reactividad estática en cada paso de tiempo que, en general, difiere de la reactividad dinámica que se obtendría con la distribución de flujo exacta y dependiente de tiempo. No obstante, para entornos no excesivamente alejados de la criticidad ambas reactividades son similares y el método conduce a resultados prácticos aceptables. Siguiendo esta línea, se ha desarrollado después un método mejorado para intentar tener en cuenta el efecto de la fuente de neutrones retardados en la evolución de la forma del flujo durante el transitorio. El esquema consiste en realizar un cálculo cuasiestacionario por cada paso de tiempo con MCNP. La simulación cuasiestacionaria se basa EN la aproximación de fuente constante de neutrones retardados, y consiste en dar un determinado peso o importancia a cada ciclo computacial del cálculo de criticidad con MCNP para la estimación del flujo final. Ambos métodos se han verificado tomando como referencia los resultados del código de difusión COBAYA3 frente a un ejercicio común y suficientemente significativo. Finalmente, con objeto de demostrar la posibilidad de uso práctico del código, se ha simulado un transitorio en el concepto de reactor crítico en fase de diseño MYRRHA/FASTEF, de 100 MW de potencia térmica y refrigerado por plomo-bismuto. ABSTRACT Long term sustainable nuclear energy scenarios envisage a fleet of Liquid Metal Fast Reactors (LMFR) for the Pu recycling and minor actinides (MAs) transmutation or combined with some accelerator driven systems (ADS) just for MAs elimination. Design and licensing of these innovative reactor concepts require accurate computational tools, implementing the knowledge obtained in experimental research for new reactor configurations, materials and associated systems. Although a number of fast reactor systems have already been built, the operational experience is still reduced, especially for lead reactors, and not all the transients are fully understood. The safety analysis approach for LMFR is therefore based only on deterministic methods, different from modern approach for Light Water Reactors (LWR) which also benefit from probabilistic methods. Usually, the approach adopted in LMFR safety assessments is to employ a variety of codes, somewhat different for the each other, to analyze transients looking for a comprehensive solution and including uncertainties. In this frame, new best estimate simulation codes are of prime importance in order to analyze fast reactors steady state and transients. This thesis is focused on the development of a coupled code system for best estimate analysis in fast critical reactor. Currently due to the increase in the computational resources, Monte Carlo methods for neutrons transport can be used for detailed full core calculations. Furthermore, Monte Carlo codes are usually taken as reference for deterministic diffusion multigroups codes in fast reactors applications because they employ point-wise cross sections in an exact geometry model and intrinsically account for directional dependence of the ux. The coupling methodology presented here uses MCNP to calculate the power deposition within the reactor. The subchannel code COBRA-IV calculates the temperature and density distribution within the reactor. COBRA-IV is suitable for fast reactors applications because it has been validated against experimental results in sodium rod bundles. The proper correlations for liquid metal applications have been added to the thermal-hydraulics program. Both codes are coupled at steady state using an iterative method and external files exchange. The main issue in the Monte Carlo/thermal-hydraulics steady state coupling is the cross section handling to take into account Doppler broadening when temperature rises. Among every available options, the pseudo materials approach has been chosen in this thesis. This approach obtains reasonable results in fast reactor applications. Furthermore, geometrical changes caused by large temperature gradients in the core, are of major importance in fast reactor due to the large neutron mean free path. An additional module has therefore been included in order to simulate the reactor geometry in hot state or to estimate the reactivity due to core expansion in a transient. The module automatically calculates the fuel length, cladding radius, fuel assembly pitch and diagrid radius with the temperature. This effect will be crucial in some unprotected transients. Also related to geometrical changes, an automatic control rod movement feature has been implemented in order to achieve a just critical reactor or to calculate control rod worth. A step forward in the coupling platform is the dynamic simulation. Since MCNP performs only steady state calculations for critical systems, the more straight forward option without modifying MCNP source code, is to use the flux factorization approach solving separately the flux shape and amplitude. In this thesis two options have been studied to tackle time dependent neutronic simulations using a Monte Carlo code: adiabatic and quasistatic methods. The adiabatic methods uses a staggered time coupling scheme for the time advance of neutronics and the thermal-hydraulics calculations. MCNP computes the fundamental mode of the neutron flux distribution and the reactivity at the end of each time step and COBRA-IV the thermal properties at half of the the time steps. To calculate the flux amplitude evolution a solver of the point kinetics equations is used. This method calculates the static reactivity in each time step that in general is different from the dynamic reactivity calculated with the exact flux distribution. Nevertheless, for close to critical situations, both reactivities are similar and the method leads to acceptable practical results. In this line, an improved method as an attempt to take into account the effect of delayed neutron source in the transient flux shape evolutions is developed. The scheme performs a quasistationary calculation per time step with MCNP. This quasistationary simulations is based con the constant delayed source approach, taking into account the importance of each criticality cycle in the final flux estimation. Both adiabatic and quasistatic methods have been verified against the diffusion code COBAYA3, using a theoretical kinetic exercise. Finally, a transient in a critical 100 MWth lead-bismuth-eutectic reactor concept is analyzed using the adiabatic method as an application example in a real system.

On a comparison method to reaction-diffusion systems and its applications to chemotaxis

In this paper we consider a general system of reaction-diffusion equations and introduce a comparison method to obtain qualitative properties of its solutions. The comparison method is applied to study the stability of homogeneous steady states and the asymptotic behavior of the solutions of different systems with a chemotactic term. The theoretical results obtained are slightly modified to be applied to the problems where the systems are coupled in the differentiated terms and / or contain nonlocal terms. We obtain results concerning the global stability of the steady states by comparison with solutions of Ordinary Differential Equations.