THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Linear minimum mean square filter for discrete-time linear systems with Markov jumps and multiplicative noises

In this paper we obtain the linear minimum mean square estimator (LMMSE) for discrete-time linear systems subject to state and measurement multiplicative noises and Markov jumps on the parameters. It is assumed that the Markov chain is not available. By using geometric arguments we obtain a Kalman type filter conveniently implementable in a recurrence form. The stationary case is also studied and a proof for the convergence of the error covariance matrix of the LMMSE to a stationary value under the assumption of mean square stability of the system and ergodicity of the associated Markov chain is obtained. It is shown that there exists a unique positive semi-definite solution for the stationary Riccati-like filter equation and, moreover, this solution is the limit of the error covariance matrix of the LMMSE. The advantage of this scheme is that it is very easy to implement and all calculations can be performed offline. (c) 2011 Elsevier Ltd. All rights reserved.

The bimolecular sensitization of nitric oxide release from weak interacting ruthenium units

This work reports on the bimolecular sensitization of nitric oxide release from cis-[Ru(bpy)(2)(iso)-NO](PF(6))(3) (1) (iso = isoquinoline and bpy = 2,2`- bipyridine) by irradiating the MLCT transition of the chloro analog cis-[Ru(bpy) 2(iso) Cl] PF6 (2). The compounds displayed peaks in the ESI-MS spectra at m/z 749.1 and m/z 578.1 ascribed, respectively, to ([1(NO(o))-2PF(6)center dot CH(3)OH](2+)) and ([2-PF(6)](+)). In the cyclic voltammograms, the nitrosyl complex presented two redox waves related to the NO ligand at 0.48 and -0.37 V (versus Ag/AgCl, NO(+/0/-1) processes), while the sensitizer showed two reversible waves at 0.79 and -1.46 V (versus Ag/AgCl, Ru(2+/3+) and bpy(0/-1), respectively). The most important feature of this system is that the nitrosyl compound does not have significant absorption in the visible region, while the sensitizer has an intense band centered at 496 nm. The irradiation of an equimolar mixture of the two compounds in an ethanol: water solution (v: v) with light of lambda > 500 nm leads to NO release, as probed by amperometric measurements. The variational method was applied, showing that the two compounds self-assembly in solution with a 1: 1 stoichiometry. Fluorescence spectra acquired at 77 K provided the E(0-0) for the system and, from the thermodynamic cycle it was estimated that the photoinduced electron transfer between the species has a Delta G value of -1.59 eV. (C) 2011 Elsevier B. V. All rights reserved.

Parameter setting and statistical learning

Three main models of parameter setting have been proposed: the Variational model proposed by Yang (2002; 2004), the Structured Acquisition model endorsed by Baker (2001; 2005), and the Very Early Parameter Setting (VEPS) model advanced by Wexler (1998). The VEPS model contends that parameters are set early. The Variational model supposes that children employ statistical learning mechanisms to decide among competing parameter values, so this model anticipates delays in parameter setting when critical input is sparse, and gradual setting of parameters. On the Structured Acquisition model, delays occur because parameters form a hierarchy, with higher-level parameters set before lower-level parameters. Assuming that children freely choose the initial value, children sometimes will miss-set parameters. However when that happens, the input is expected to trigger a precipitous rise in one parameter value and a corresponding decline in the other value. We will point to the kind of child language data that is needed in order to adjudicate among these competing models.

Socio-economic, migrant and geographic differentials in coronary heart disease occurrence in New South Wales

Objective: This study examines the variation in coronary heart disease (CHD) mortality and acute myocardial infarction (AMI) by socio-economic status (SES), country of birth (COB) and geography (urban/rural) in the total population of New South Wales (Australia) in 1991-95. Method: CHD deaths and AMI are from complete enumerations of deaths and hospital admissions, respectively; and population denominators are from census information. Data are examined separately by sex, and comparisons of SES groups (based on municipalities), COB and region are analysed using Poisson regression, after adjustment for age. Results: The study identified higher risk for AMI admissions and CHD mortality in lower SES populations with significant linear trends, for both sexes, adjusted for age, region and COB. According to the population attributable fractions (PAF), 23-41% of the risk of CHD occurrence is due to SES lower than the highest quartile. The higher age-adjusted risk for CHD occurrence in rural and remote populations for both sexes, compared with urban communities, was lessened by adjustment for COB, and all but abolished when also adjusted for SES. COB analysis indicated significantly lower age-adjusted AMI admissions and CHD mortality compared with the Australian-born, Conclusions: Higher risks for CHD in rural populations compared with the capital city (Sydney) are due, in part, to lower SES, lesser migrant composition. Implications: Strategies for reducing CHD differentials should consider demographic factors and the fundamental need to reduce socio-economic inequalities, as well as targeting appropriate prevention measures.

Multidimensional quantum solitons with nondegenerate parametric interactions: Photonic and Bose-Einstein condensate environments

We consider the quantum theory of three fields interacting via parametric and repulsive quartic couplings. This can be applied to treat photonic chi((2)) and chi((3)) interactions, and interactions in atomic Bose-Einstein condensates or quantum Fermi gases, describing coherent molecule formation together with a-wave scattering. The simplest two-particle quantum solitons or bound-state solutions of the idealized Hamiltonian, without a momentum cutoff, are obtained exactly. They have a pointlike structure in two and three dimensions-even though the corresponding classical theory is nonsingular. We show that the solutions can be regularized with a momentum cutoff. The parametric quantum solitons have much more realistic length scales and binding energies than chi((3)) quantum solitons, and the resulting effects could potentially be experimentally tested in highly nonlinear optical parametric media or interacting matter-wave systems. N-particle quantum solitons and the ground state energy are analyzed using a variational approach. Applications to atomic/molecular Bose-Einstein condensates (BEC's) are given, where we predict the possibility of forming coupled BEC solitons in three space dimensions, and analyze superchemistry dynamics.

Occupation, hours worked, and leisure-time physical activity

Background. International research indicates that blue-collar employees typically exhibit lower rates of leisure-time physical activity. While lack of time and work demands are commonly reported barriers to activity, the extent to which time-at-work mediates the relationship between occupation and leisure-time physical activity is unclear. This study investigated the association between occupation, time spent in paid employment, and participation in leisure-time physical activity. Methods. This was a secondary analysis of cross-sectional data from the 1995 Australian Health Survey, focusing on employed persons ages 18-64 years (n = 24,454), Occupation was coded as per the Australian Standard Classification of Occupations and collapsed into three categories (professional, white-collar, blue-collar). Hours worked was categorized into eight levels, ranging from 1-14 to more than 50 h per week. Participation in leisure-time physical activity was categorized as either insufficient or sufficient for health, consistent with recommended levels of energy expenditure (1600 METS-min/fortnight). The relationship between occupation, hours worked, and leisure-time physical activity was examined using logistic regression. Analyses were conducted separately for male and female, and the results are presented as a series of models that successively adjust for a range of potential covariates: age, living arrangement, smoking status, body mass index, and self-reported health. Results. Individuals in blue-collar occupations were approximately 50% more likely to be classified as insufficiently active. This occupational variability in leisure-time physical activity was not explained by hours worked. There was a suggested relationship between hours worked and leisure-time physical activity; however, this differed between men and women, and was difficult to interpret. Conclusions. Occupational variability in leisure-time physical activity cannot be explained by hours worked. Therefore, reports that work constitutes a barrier to participation should be explored further. Identification of the factors contributing to occupational variability in leisure-time physical activity will add to our understanding of why population subgroups differ in their health risk profiles, and assist in the development of health promotion strategies to reduce rates of sedentariness and health inequalities. (C) 2000 American Health Foundation and Academic Press.

A note on the decomposition of the health concentration index

In recent work, the concentration index has been widely used as a measure of income-related health inequality. The purpose of this note is to illustrate two different methods for decomposing the overall health concentration index using data collected from a Short Form (SF-36) survey of the general Australian population conducted in 1995. For simplicity, we focus on the physical functioning scale of the SF-36. Firstly we examine decomposition 'by component' by separating the concentration index for the physical functioning scale into the ten items on which it is based. The results show that the items contribute differently to the overall inequality measure, i.e. two of the items contributed 13% and 5%, respectively, to the overall measure. Second, to illustrate the 'by subgroup' method we decompose the concentration index by employment status. This involves separating the population into two groups: individuals currently in employment; and individuals not currently employed. We find that the inequality between these groups is about five times greater than the inequality within each group. These methods provide insights into the nature of inequality that can be used to inform policy design to reduce income related health inequalities. Copyright (C) 2002 John Wiley Sons, Ltd.

Transport-Regional Equity Issue Revisited

Almeida E. S. de, Haddad E. A. and Hewings G. J. D. Transport-regional equity issue revisited, Regional Studies. The objective of this paper is to analyse the relationship between transport and regional equity in Minas Gerais, Brazil. Furthermore, the existence of a trade-off between economic performance and regional equity is investigated as well. To do so, the paper develops a spatial computable general equilibrium model based on Brocker and Schneider`s approach of 2002 to implement comparative static analysis, explicitly incorporating iceberg transportation costs. Four activities are modelled, namely production, final demand, transportation and exports. Two production factors are assumed: labour and other factors. The model has 12 domestic regions and three external regions. Four counterfactual experiments are developed based on decreases in transportation costs due to a `distance shortening`. The main findings indicate that if the transport infrastructure improvement is focused only among poor regions, the promotion of regional equity is insignificant. If the transport infrastructure improvement links are concentrated among rich regions, there is an increase in regional income inequalities. However, if the improvements are targeted to the roads linking poor regions and rich ones, there is greater promotion of regional equity. The same result will occur when improvements are made to all road links of the state. [image omitted] Almeida E. S. de, Haddad E. A. et Hewings G. J. D. La question du rapport entre le transport et l`equilibre regional vue sous un jour nouveau, Regional Studies. Cet article cherche a analyser le rapport entre le transport et l`equilibre regional en Minas Gerais au Bresil. En outre, on examine la presence d`un echange entre la performance economoique et l`equilibre regional. Pour le faire, on construit un modele geographique de l`equilibre general a utiliser sur ordinateur fonde sur l`approche de Brockner et Schneider en 2002 afin de mettre en oeuvre une analyse statique comparative qui comprend explicitement les frais de transport iceberg. On modelise quatre activites, a savoir, la production, la demande finale, le transport et l`exportation. On fait deux suppositions quant aux facteurs de production: la main-d`oevre et d`autres facteurs. Le modele embrasse douze regions internes et trois regions externes. On fait quatre experiences paradoxales fondees sur la baisse des frais de transport due a une `reduction des distances`. Les principaux resultats indiquent que si l`amelioration de l`equipement de transport ne porte que sur les regions defavorisees, la promotion de l`equilibre regional s`avere negligeable. Si l`amelioration de l`equipement de transport focalise les regions riches, il s`avere un creusement des ecarts des revenus regionaux. Cependant, si les ameliorations ciblent les routes qui relient les regions defavorisees aux regions riches, il s`avere une plus grande promotion de l`equilibre regional. Il en va de meme pour la situation ou on a apporte des amenagements a toutes les liaisons routieres de l`etat. Modele geographique de l`equilibre general a utiliser sur ordinateur Equilibre regional Peformance economique Frais de transport Almeida E. S. de, Haddad E. A. und Hewings G. J. D. Die Wiederaufnahme der Frage von Verkehrswesen im Verhaltnis zu regionaler Fairness, Regional Studies. Dieser Aufsatz beabsichtigt, die Beziehung zwischen Verkehrswesen und regionaler Fairness in Minas Gerais (Brasilien) zu analysieren und zugleich auch das Vorkommen von Einbussen entweder bei wirtschaftlicher Leistung der regionaler Fairness zu untersuchen. Zu diesem Zwecke wird ein auf dem Ansatz von Brocker und Schneider (2002) aufbauendes raumliches komputables allgemeines Gleichgewichtsmodell entwickelt, um vergleichende statistische Analysen durchzufuhren, wobei verborgene `Eisberg`-Transportkosten ausdrucklich berucksichtigt werden. Es werden vier Unternehmenstatigk eiten aufgefuhrt: Herstellung, Nachfrage, Transportwesen und Exporte, und zwei Produktionsfaktoren vorausgesetzt: Arbeitskrafte und andere Faktoren. Das Modell umfasst zwolf Inlandsregionen und drei externe Regionen. Es werden vier gegensatzliche Experimente entwickelt, die auf einer Abnahme der Transportkosten infolge einer `Verkurzung der Entfernungen` beruhen. Die Hauptbefunde weisen darauf hin, dass die Forderung regionaler Fairness unbedeutend bleibt, wenn die Verbesserungen der Transportinfrastruktur sich nur auf minderbemittelte Regionen konzentrieren; werden die Verbesserungen der Verbindungen der Transportinfrastruktur in wohlhabenden Regionen durchgefuhrt, so nehmen regionale Einkommensunterschiede zu. Wenn die Verbesserungen jedoch auf Strassen abzielen, die wohlhabende Regionen mit weniger bemittelten verbinden, wird regionale Fairness starker gefordert. Das gleiche Ergebnis wird sich einstellen, wenn Verbesserungen an allen Strassenverbindungen des Staates vorgenommen werden. Raumliches, komputables, allgemeines Gleichgewichtsmodell Regionale Fairness Wirtschaftsleistung Transportkosten Almeida E. S. de, Haddad E. A. y Hewings G. J. D. Revisando el tema de la igualdad del transporte en las regiones, Regional Studies. El objetivo de este documento es analizar la relacion entre el transporte y la igualdad regional en Minas Gerais, Brasil. Asimismo investigamos la existencia de una compensacion entre el rendimiento economico y la igualdad regional. Para ello desarrollamos un modelo de equilibrio general computable y espacial basado en el enfoque de Brocker y Schneider en 2002 para hacer un analisis estatico y comparativo, explicitamente incorporando los costes ocultos de transporte. Se modelan cuatro actividades: la produccion, la demanda final, el transporte y las exportaciones. Suponemos que existen dos factores de produccion: mano de obra y otros factores. En este modelo, existen doce regiones internas y tres regiones externas. Desarrollamos cuatro experimentos contrafactuales basados en la disminucion de los costes de transporte debido a una `acortamiento de las distancias`. Los principales resultados indican que si la mejora de la infraestructura del transporte se centra solo entre las regiones mas pobres, el fomento de la igualdad regional es insignificante. Si los enlaces de la mejora de la infraestructura del transporte se concentran en las regiones ricas, aumentan las desigualdades de ingresos regionales. Sin embargo, si se mejoran los enlaces de carreteras entre las regiones pobres y ricas, se fomenta mejor la igualdad regional. El mismo resultado ocurre cuando se mejoran los enlaces de todas las carreteras del estado. Modelo de equilibrio general computable y espacial Igualdad regional Rendimiento economico Costes de transporte.

Decline in homicide rates in Sao Paulo, Brasil: a descriptive analysis

Objective. To describe homicide mortality in the municipality of Sao Paulo according to type of weapon, sex, race or skin color, age, and areas of socioeconomic inequalities, between 1996 and 2008. Method. For this ecological time-series study, data about deaths in the municipality of Sao Paulo were collected from the municipal program for improvement of mortality information, using International Classification of Diseases, 10th revision (ICD-10) codes. Homicide mortality rates (HMR) were calculated for the overall population and specifically for each sex, race or skin color, age range, type of weapon, and occurrence in social deprivation/affluence areas. HMR were adjusted for age using the direct method. The percentage age of variation in HMR was calculated for the study period. For areas of socioeconomic inequalities, the relative risk of death from homicide was calculated. Results. HMR fell 73.7% between 2001 and 2008. A reduction in HMR was observed in all groups, especially males (-74.5%), young men between 15 and 24 years of age (-78.0%), and residents in areas of extreme socioeconomic deprivation (-79.3%). The reduction occurred mostly in firearm homicide rates (-74.1%). The relative risk of death from homicide in areas of extreme socioeconomic deprivation, as compared to areas with some degree of socioeconomic deprivation, was 2.77 in 1996, 3.9 in 2001, and 2.13 in 2008. In areas of high socioeconomic deprivation, the relative risk was 2.07 in 1996 and 1.96 in 2008. Conclusions. To understand the reduction in homicide rates in the municipality of Sao Paulo, it is important to take into consideration macrodeterminants that affect the entire municipality and all population subgroups, as well as micro/local determinants that have special impact on homicides committed with firearms and on subgroups such as the young, males, and residents of areas of high socioeconomic deprivation.

Pulmonary Hypertension in Latin America Pulmonary Vascular Disease: The Global Perspective

Latin America is here defined as all of the Americas south of the United States. In the setting of pulmonary hypertension, there are social inequalities and geophysical aspects in this region that account for a high prevalence of certain etiologies. This review aimed to analyze some of these factors. Data were collected from the existing literature. Information also was obtained from local tertiary-care centers to where patients with pulmonary hypertension generally are referred. Further, local experience and expertise was taken into consideration. Three etiologies of pulmonary hypertension were found to be the most prevalent: schistosomiasis (similar to 1 million affected people in Brazil), high altitude (particularly in the Andes), and congenital heart disease (late diagnosis of congenital left-to-right shunts leading to development of pulmonary vasculopathy). The diversity in terms of ancestries and races probably accounts for the differences in phenotype expression of pulmonary hypertension when a given region is considered (eg, schistosomiasis-, high-altitude-, or congenital heart disease-associated pulmonary hypertension). Governmental measures are needed to improve social and economic inequalities with an obvious impact on certain etiologies, such as schistosomiasis and congenital heart disease. Early diagnosis of pulmonary hypertension and access to medication remain important challenges all over Latin America. CHEST 2010; 137(6)(Suppl):78S-84S

Breast cancer five-year survival, by New South Wales regions, 1980 to 1991

Breast cancer five-year relative survival was calculated for 16 urban and rural regions in New South Wales (NSW) for cases incident in 1980-1991. Survival analysis employed cancer registry data linked with the death register, and age- and period-matched regional mortality of NSW women, Proportional hazard regression analysis was used to compare excess mortality in breast cancer cases in each region. The effect of region was significant (P < 0.05) in the analysis, after age and the follow-up variable (and their intel action) were adjusted for, although no region was significantly different from the referent group (chosen because of average relative five-year survival). When degree of spread and its interactions were entered into che model, the effect of region became nonsignificant. A significant linear trend (P < 0.05) in the adjusted relative risk for excess mortality in breast cancer cases was noted when regions were divided into quartiles based on socioeconomic status, with higher relative risk in low-socioeconomic-status groups; this effect also disappeared with adjustment for degree of spread at diagnosis. There was no general effect of rurality versus capital city or other metropolitan centres. This study demonstrates a small effect of region of residence and implied socioeconomic status on breast cancer survival in NSW women, but this becomes nonsignificant when the data are adjusted for degree of spread at diagnosis, This suggests that earlier diagnosis would he of benefit in reducing minor inequalities in breast cancer survival in NSW women.

Spatiotemporal solitons in multidimensional optical media with a quadratic nonlinearity

We consider solutions to the second-harmonic generation equations in two-and three-dimensional dispersive media in the form of solitons localized in space and time. As is known, collapse does not take place in these models, which is why the solitons may be stable. The general solution is obtained in an approximate analytical form by means of a variational approach, which also allows the stability of the solutions to be predicted. Then, we directly simulate the two-dimensional case, taking the initial configuration as suggested by the variational approximation. We thus demonstrate that spatiotemporal solitons indeed exist and are stable. Furthermore, they are not, in the general case, equivalent to the previously known cylindrical spatial solitons. Direct simulations generate solitons with some internal oscillations. However, these oscillations neither grow nor do they exhibit any significant radiative damping. Numerical solutions of the stationary version of the equations produce the same solitons in their unperturbed form, i.e., without internal oscillations. Strictly stable solitons exist only if the system has anomalous dispersion at both the fundamental harmonic and second harmonic (SH), including the case of zero dispersion at SH. Quasistationary solitons, decaying extremely slowly into radiation, are found in the presence of weak normal dispersion at the second-harmonic frequency.