THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Evaluation of the buccal vestibule-palatal diffusion of 4% articaine hydrochloride in impacted maxillary third molar extractions

Aims: The aim of this study was to evaluate the vestibular-palatal diffusion of 4% articaine with epinephrine 1: 100,000 and 1: 200,000, in impacted maxillary third molar extractions, without palatal injection. Materials and Method: Two hundred teeth were selected from patients age 15 to 46. Patients were divided into 4 groups: 1A, were anesthetized with 4% articaine 1: 100,000 and the surgery was initiated 5 minutes following anesthesia. 1B, used 4% articaine 1: 100,000 but the surgery was started 10 minutes after anesthesia. 2A, used 4% articaine 1: 200,000 the surgery was started 5 minutes after. 2B, used 4% articaine 1: 200,000 but 10 minutes was allowed for anesthetic diffusion before the initiation of in groups (50 extractions each) only buccal vestibule anesthesia was initially administered (i.e. no palatal injections were used). Results: The rate of sufficient vestibule-palatal diffusion, as determined by the lack of necessity of supplemental palatal anesthesia, was: 1A(84%), 1B(98%), 2A(78%), 2B(82%). Chi-square (X2) and residual analyses showed that a higher vestibule-palatal diffusion was obtained using 4% articaine 1: 100,000 with a period of 10 minutes (p<0.05). Conclusions: Most of the extractions could be performed only with vestibule anesthesia. However, vasoconstrictor concentration and the time interval between administration of the anesthetic and initiation of surgery did influence buccal vestibule-palatal diffusion of 4% articaine in the extraction models used.

Internal and External Time Conflicts in Adolescents: Sleep Characteristics and Interventions

Daytime fatigue and lack of sleep seem to increase throughout adolescent years. Several environmental, psychological, and biological factors have been associated with the development of sleep across adolescence. The aim of the present article is to summarize these factors and to give examples of various outcomes in sleep patterns among adolescents studied in different cultural settings. It is obvious from earlier work that many adolescents have displaced circadian rhythms and lack of adaptation to school hours due to an early school start or additional burdens for work. Several interventions have aimed to help the adaptation process by supporting sleep processes and changing scheduling, in this way promoting classroom alertness. In summary, adolescents worldwide shorten their sleep due to schoolwork hours and additional work, especially by disturbing their sleep due to circadian misalignment.

DIFFUSION OF MAGNETIC FIELD AND REMOVAL OF MAGNETIC FLUX FROM CLOUDS VIA TURBULENT RECONNECTION

The diffusion of astrophysical magnetic fields in conducting fluids in the presence of turbulence depends on whether magnetic fields can change their topology via reconnection in highly conducting media. Recent progress in understanding fast magnetic reconnection in the presence of turbulence reassures that the magnetic field behavior in computer simulations and turbulent astrophysical environments is similar, as far as magnetic reconnection is concerned. This makes it meaningful to perform MHD simulations of turbulent flows in order to understand the diffusion of magnetic field in astrophysical environments. Our studies of magnetic field diffusion in turbulent medium reveal interesting new phenomena. First of all, our three-dimensional MHD simulations initiated with anti-correlating magnetic field and gaseous density exhibit at later times a de-correlation of the magnetic field and density, which corresponds well to the observations of the interstellar media. While earlier studies stressed the role of either ambipolar diffusion or time-dependent turbulent fluctuations for de-correlating magnetic field and density, we get the effect of permanent de-correlation with one fluid code, i.e., without invoking ambipolar diffusion. In addition, in the presence of gravity and turbulence, our three-dimensional simulations show the decrease of the magnetic flux-to-mass ratio as the gaseous density at the center of the gravitational potential increases. We observe this effect both in the situations when we start with equilibrium distributions of gas and magnetic field and when we follow the evolution of collapsing dynamically unstable configurations. Thus, the process of turbulent magnetic field removal should be applicable both to quasi-static subcritical molecular clouds and cores and violently collapsing supercritical entities. The increase of the gravitational potential as well as the magnetization of the gas increases the segregation of the mass and magnetic flux in the saturated final state of the simulations, supporting the notion that the reconnection-enabled diffusivity relaxes the magnetic field + gas system in the gravitational field to its minimal energy state. This effect is expected to play an important role in star formation, from its initial stages of concentrating interstellar gas to the final stages of the accretion to the forming protostar. In addition, we benchmark our codes by studying the heat transfer in magnetized compressible fluids and confirm the high rates of turbulent advection of heat obtained in an earlier study.

The Diffusion Kernel Filter

A particle filter method is presented for the discrete-time filtering problem with nonlinear ItA ` stochastic ordinary differential equations (SODE) with additive noise supposed to be analytically integrable as a function of the underlying vector-Wiener process and time. The Diffusion Kernel Filter is arrived at by a parametrization of small noise-driven state fluctuations within branches of prediction and a local use of this parametrization in the Bootstrap Filter. The method applies for small noise and short prediction steps. With explicit numerical integrators, the operations count in the Diffusion Kernel Filter is shown to be smaller than in the Bootstrap Filter whenever the initial state for the prediction step has sufficiently few moments. The established parametrization is a dual-formula for the analysis of sensitivity to gaussian-initial perturbations and the analysis of sensitivity to noise-perturbations, in deterministic models, showing in particular how the stability of a deterministic dynamics is modeled by noise on short times and how the diffusion matrix of an SODE should be modeled (i.e. defined) for a gaussian-initial deterministic problem to be cast into an SODE problem. From it, a novel definition of prediction may be proposed that coincides with the deterministic path within the branch of prediction whose information entropy at the end of the prediction step is closest to the average information entropy over all branches. Tests are made with the Lorenz-63 equations, showing good results both for the filter and the definition of prediction.

On the continuity of pullback attractors for evolution processes

In this paper we give general results on the continuity of pullback attractors for nonlinear evolution processes. We then revisit results of [D. Li, P.E. Kloeden, Equi-attraction and the continuous dependence of pullback attractors on parameters, Stoch. Dyn. 4 (3) (2004) 373-384] which show that, under certain conditions, continuity is equivalent to uniformity of attraction over a range of parameters (""equi-attraction""): we are able to simplify their proofs and weaken the conditions required for this equivalence to hold. Generalizing a classical autonomous result [A.V. Babin, M.I. Vishik, Attractors of Evolution Equations, North Holland, Amsterdam, 1992] we give bounds on the rate of convergence of attractors when the family is uniformly exponentially attracting. To apply these results in a more concrete situation we show that a non-autonomous regular perturbation of a gradient-like system produces a family of pullback attractors that are uniformly exponentially attracting: these attractors are therefore continuous, and we can give an explicit bound on the distance between members of this family. (C) 2009 Elsevier Ltd. All rights reserved.

A Time Efficient Optical Model for GATE Simulation of a LYSO Scintillation Matrix Used in PET Applications

A time efficient optical model is proposed for GATE simulation of a LYSO scintillation matrix coupled to a photomultiplier. The purpose is to avoid the excessively long computation time when activating the optical processes in GATE. The usefulness of the model is demonstrated by comparing the simulated and experimental energy spectra obtained with the dual planar head equipment for dosimetry with a positron emission tomograph ( DoPET). The procedure to apply the model is divided in two steps. Firstly, a simplified simulation of a single crystal element of DoPET is used to fit an analytic function that models the optical attenuation inside the crystal. In a second step, the model is employed to calculate the influence of this attenuation in the energy registered by the tomograph. The use of the proposed optical model is around three orders of magnitude faster than a GATE simulation with optical processes enabled. A good agreement was found between the experimental and simulated data using the optical model. The results indicate that optical interactions inside the crystal elements play an important role on the energy resolution and induce a considerable degradation of the spectra information acquired by DoPET. Finally, the same approach employed by the proposed optical model could be useful to simulate a scintillation matrix coupled to a photomultiplier using single or dual readout scheme.

Determination of Very Slow Diffusion of Paramagnetic Ions by NMR Spectroscopy

In this paper, we propose a new method of measuring the very slow paramagnetic ion diffusion coefficient using a commercial high-resolution spectrometer. If there are distinct paramagnetic ions influencing the hydrogen nuclear magnetic relaxation time differently, their diffusion coefficients can be measured separately. A cylindrical phantom filled with Fricke xylenol gel solution and irradiated with gamma rays was used to validate the method. The Fricke xylenol gel solution was prepared with 270 Bloom porcine gelatin, the phantom was irradiated with gamma rays originated from a (60)Co source and a high-resolution 200 MHz nuclear magnetic resonance (NMR) spectrometer was used to obtain the phantom (1)H profile in the presence of a linear magnetic field gradient. By observing the temporal evolution of the phantom NMR profile, an apparent ferric ion diffusion coefficient of 0.50 mu m(2)/ms due to ferric ions diffusion was obtained. In any medical process where the ionizing radiation is used, the dose planning and the dose delivery are the key elements for the patient safety and success of treatment. These points become even more important in modern conformal radio therapy techniques, such as stereotactic radiosurgery, where the delivered dose in a single session of treatment can be an order of magnitude higher than the regular doses of radiotherapy. Several methods have been proposed to obtain the three-dimensional (3-D) dose distribution. Recently, we proposed an alternative method for the 3-D radiation dose mapping, where the ionizing radiation modifies the local relative concentration of Fe(2+)/Fe(3+) in a phantom containing Fricke gel and this variation is associated to the MR image intensity. The smearing of the intensity gradient is proportional to the diffusion coefficient of the Fe(3+) and Fe(2+) in the phantom. There are several methods for measurement of the ionic diffusion using NMR, however, they are applicable when the diffusion is not very slow.

Mean Motion in Stochastic Plasmas With a Space-Dependent Diffusion Coefficient

Radial transport in the tokamap, which has been proposed as a simple model for the motion in a stochastic plasma, is investigated. A theory for previous numerical findings is presented. The new results are stimulated by the fact that the radial diffusion coefficients is space-dependent. The space-dependence of the transport coefficient has several interesting effects which have not been elucidated so far. Among the new findings are the analytical predictions for the scaling of the mean radial displacement with time and the relation between the Fokker-Planck diffusion coefficient and the diffusion coefficient from the mean square displacement. The applicability to other systems is also discussed. (c) 2009 WILEY-VCH GmbH & Co. KGaA, Weinheim

Temperature effects on a network of dissipative quantum harmonic oscillators: collective damping and dispersion processes

In this paper we extend the results presented in (de Ponte, Mizrahi and Moussa 2007 Phys. Rev. A 76 032101) to treat quantitatively the effects of reservoirs at finite temperature in a bosonic dissipative network: a chain of coupled harmonic oscillators whatever its topology, i.e., whichever the way the oscillators are coupled together, the strength of their couplings and their natural frequencies. Starting with the case where distinct reservoirs are considered, each one coupled to a corresponding oscillator, we also analyze the case where a common reservoir is assigned to the whole network. Master equations are derived for both situations and both regimes of weak and strong coupling strengths between the network oscillators. Solutions of these master equations are presented through the normal ordered characteristic function. These solutions are shown to be significantly involved when temperature effects are considered, making difficult the analysis of collective decoherence and dispersion in dissipative bosonic networks. To circumvent these difficulties, we turn to the Wigner distribution function which enables us to present a technique to estimate the decoherence time of network states. Our technique proceeds by computing separately the effects of dispersion and the attenuation of the interference terms of the Wigner function. A detailed analysis of the dispersion mechanism is also presented through the evolution of the Wigner function. The interesting collective dispersion effects are discussed and applied to the analysis of decoherence of a class of network states. Finally, the entropy and the entanglement of a pure bipartite system are discussed.

Modeling Adsorption Processes of Poly-p-phenylenevinylene Precursor and Sodium Acid Dodecylbenzenesulfonate onto Layer-by-Layer Films Using a Langmuir-type Metastable Equilibrium Model

The adsorption kinetics curves of poly(xylylidene tetrahydrothiophenium chloride) (PTHT), a poly-p-phenylenevinylene (PPV) precursor, and the sodium salt of dodecylbenzene sulfonic acid (DBS), onto (PTHT/DBS)(n) layer-by-layer (LBL) films were characterized by means of UV-vis spectroscopy. The amount of PTHT/DBS and PTHT adsorbed on each layer was shown to be practically independent of adsorption time. A Langmuir-type metastable equilibrium model was used to adjust the adsorption isotherms data and to estimate adsorption/desorption coefficients ratios, k = k(ads)/k(des), values of 2 x 10(5) and 4 x 10(6) for PTHT and PTHT/DBS layers, respectively. The desorption coefficient has been estimated, using literature values for poly(o-methoxyaniline) desorption coefficient, as was found to be in the range of 10(-9) to 10(-6) s(-1), indicating that quasi equilibrium is rapidly attained.

On exact time averages of a massive Poisson particle

In this work we study, under the Stratonovich definition, the problem of the damped oscillatory massive particle subject to a heterogeneous Poisson noise characterized by a rate of events, lambda(t), and a magnitude, Phi, following an exponential distribution. We tackle the problem by performing exact time averages over the noise in a similar way to previous works analysing the problem of the Brownian particle. From this procedure we obtain the long-term equilibrium distributions of position and velocity as well as analytical asymptotic expressions for the injection and dissipation of energy terms. Considerations on the emergence of stochastic resonance in this type of system are also set forth.

Microgranitic Enclaves as Products of Self-mixing Events: a Study of Open-system Processes in the Maua Granite, Sao Paulo, Brazil, Based on in situ Isotopic and Trace Elements in Plagioclase

Felsic microgranular enclaves with structures indicating that they interacted in a plastic state with their chemically similar host granite are abundant in the Maua Pluton, SE Brazil. Larger plagioclase xenocrysts are in textural disequilibrium with the enclave groundmass and show complex zoning patterns with partially resorbed An-rich cores (locally with patchy textures) surrounded by more sodic rims. In situ laser ablation-(multi-collector) inductively coupled plasma mass spectrometry trace element and Sr isotopic analyses performed on the plagioclase xenocrysts indicate open-system crystallization; however, no evidence of derivation from more primitive basic melts is observed. The An-rich cores have more radiogenic initial Sr isotopic ratios that decrease towards the outermost part of the rims, which are in isotopic equilibrium with the matrix plagioclase. These profiles may have been produced by either (1) diffusional re-equilibration after rim crystallization from the enclave-forming magma, as indicated by relatively short calculated residence times, or (2) episodic contamination with a decrease of the contaminant ratio proportional to the extent to which the country rocks were isolated by the crystallization front. Profiles of trace elements with high diffusion coefficients would require unrealistically long residence times, and can be modeled in terms of fractional crystallization. A combination of trace element and Sr isotope data suggests that the felsic microgranular enclaves from the Maua Pluton are the products of interaction between end-member magmas that had similar compositions, thus recording `self-mixing` events.

RUMOR PROCESSES ON N

We study four discrete-time stochastic systems on N, modeling processes of rumor spreading. The involved individuals can either have an active or a passive role, speaking up or asking for the rumor. The appetite for spreading or hearing the rumor is represented by a set of random variables whose distributions may depend on the individuals. Our goal is to understand-based on the distribution of the random variables-whether the probability of having an infinite set of individuals knowing the rumor is positive or not.