The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

Generation of self-similar Gaussian time series by means of the DWT and DWPT variance maps

Due to the several kinds of services that use the Internet and data networks infra-structures, the present networks are characterized by the diversity of types of traffic that have statistical properties as complex temporal correlation and non-gaussian distribution. The networks complex temporal correlation may be characterized by the Short Range Dependence (SRD) and the Long Range Dependence - (LRD). Models as the fGN (Fractional Gaussian Noise) may capture the LRD but not the SRD. This work presents two methods for traffic generation that synthesize approximate realizations of the self-similar fGN with SRD random process. The first one employs the IDWT (Inverse Discrete Wavelet Transform) and the second the IDWPT (Inverse Discrete Wavelet Packet Transform). It has been developed the variance map concept that allows to associate the LRD and SRD behaviors directly to the wavelet transform coefficients. The developed methods are extremely flexible and allow the generation of Gaussian time series with complex statistical behaviors.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

SELF-SIMILARITY AND LAMPERTI CONVERGENCE FOR FAMILIES OF STOCHASTIC PROCESSES

We define a new type of self-similarity for one-parameter families of stochastic processes, which applies to certain important families of processes that are not self-similar in the conventional sense. This includes Hougaard Levy processes such as the Poisson processes, Brownian motions with drift and the inverse Gaussian processes, and some new fractional Hougaard motions defined as moving averages of Hougaard Levy process. Such families have many properties in common with ordinary self-similar processes, including the form of their covariance functions, and the fact that they appear as limits in a Lamperti-type limit theorem for families of stochastic processes.

Self-Organizing Maps as a New Tool for Classification of Plants at Lower Hierarchical Levels

A chemotaxonomic analysis is described of a database containing various types of compounds from the Heliantheae tribe (Asteraceae) using Self-Organizing Maps (SOM). The numbers of occurrences of 9 chemical classes in different taxa of the tribe were used as variables. The study shows that SOM applied to chemical data can contribute to differentiate genera, subtribes, and groups of subtribes (subtribe branches), as well as to tribal and subtribal classifications of Heliantheae, exhibiting a high hit percentage comparable to that of an expert performance, and in agreement with the previous tribe classification proposed by Stuessy.

Could Cyclophosphamide exert a protective role avoiding esophagic neuron loss in Calomys callosus infected with Trypanosoma cruzi?

The protective role of Cyclophosphamide was studied in this work. Young male Calomys callosus were infected with Trypanosoma cruzi and allowed to age. Cyclophosphamide therapy was administered to animals during acute and late chronic phases of infection. Esophageal neurons were counted, displaying enhanced neuronal loss for the young and treated infected groups. For aged and cyclophosphamide treated animals, a protection was observed through a reduced loss of neurons as compared to the young and infected groups. Enhanced nitric oxide concentrations were observed for young animals as compared to aged counterparts. Splenocyte proliferation was reduced during the acute phase in comparison with those found in the chronic phase. Morphometry of neuronal body displayed a significant reduction concerning the area, perimeter, diameter and volume for aged animals as compared to young groups. These results indicate that the protective effects of cyclophosphamide together with process of neuroplasty of peripheral nervous system could lead to a protection against neuronal loss.

Expression of Human Recombinant Antibody Fragments Capable of Partially Inhibiting the Phospholypase Activity of Crotalus durissus terrificus Venom

Crotoxin is the main toxic component of the South American rattlesnake Crotalus durissus terrificus venom. It is composed of two different subunits: CA, crotapotin, and CB (basic subunit of cortoxin isolated from C. d. terrificus), a weakly toxic phospholipase A(2) with high enzymatic activity. The phospholipases A(2) are abundant in snake venoms and are responsible for disruption of cell membrane integrity via hydrolysis of its phospholipids. However, in addition to their normal digestive action, a wide range of pharmacological activities, such as neurotoxic, myotoxic, oedema-inducing, hypotensive, platelet-aggregating, cardiotoxic, and anticoagulant effects have been attributed to venom phospholipases A(2). In this study, we used a non-immune human single-chain fragment variable library, Griffin.1 (Medical Research Council, Cambridge, UK) for selection of recombinant antibodies against antigens present in C. d. terrificus venom and identification of specific antibodies able to inhibit the phospholipase activity. Two clones were identified as capable of inhibiting partially this activity in vitro. These clones were able to reduce in vivo the myotoxic and oedema-inducing activity of CB and the lethality of C. d. terrificus venom and crotoxin, but had no effect on the in vitro anticoagulant activity of CB. These results demonstrate the potential of using recombinant single-chain fragment variable libraries in the production of antivenoms.

Test–retest repeatability of self-reported environmental exposures in Parkinson’s disease cases and healthy controls

There is substantial disagreement among published epidemiological studies regarding environmental risk factors for Parkinson’s disease (PD). Differences in the quality of measurement of environmental exposures may contribute to this variation. The current study examined the test–retest repeatability of self-report data on risk factors for PD obtained from a series of 32 PD cases recruited from neurology clinics and 29 healthy sex-, age-and residential suburb-matched controls. Exposure data were collected in face-to-face interviews using a structured questionnaire derived from previous epidemiological studies. High repeatability was demonstrated for ‘lifestyle’ exposures, such as smoking and coffee/tea consumption (kappas 0.70–1.00). Environmental exposures that involved some action by the person, such as pesticide application and use of solvents and metals, also showed high repeatability (kappas>0.78). Lower repeatability was seen for rural residency and bore water consumption (kappa 0.39–0.74). In general, we found that case and control participants provided similar rates of incongruent and missing responses for categorical and continuous occupational, domestic, lifestyle and medical exposures.

Effect of multiple transverse modes in self-mixing sensors based on vertical-cavity surface-emitting lasers

We investigate the effect of coexisting transverse modes on the operation of self-mixing sensors based on vertical-cavity surface-emitting lasers (VCSELs). The effect of multiple transverse modes on the measurement of displacement and distance were examined by simulation and in laboratory experiment. The simulation model shows that the periodic change in the shape and magnitude of the self-mixing signal with modulation current can be properly explained by the different frequency-modulation coefficients of the respective transverse modes in VCSELs. The simulation results are in excellent agreement with measurements performed on single-mode and multimode VCSELs and on self-mixing sensors based on these VCSELs.

Emotional Intelligence, emotional Self-Awareness, and Team Effectiveness

An issue at the forefront of recent emotional intelligence debates revolves around whether emotional intelligence can be linked to work performance. Although many authors continue to develop new and improved measures of emotional intelligence (e.g. Mayer, Caruso, & Salovey, 2001) to give us a better understanding of emotional intelligence, the links to performance in work settings, especially in the context of group effectiveness, have received much less attention. In this chapter, we present the results of a study in which we examined the role of emotional self-awareness and emotional intelligence as a predictor of group effectiveness. The study also addresses the utility of self- and peer assessment in measureing emotional self-awareness and emotional intelligence.

Surface Waves and Roughness in Self-Aerated Supercritical Flow

In high-velocity open channel flows, free-surface aeration is commonly observed. The effects of surface waves on the air-water flow properties are tested herein. The study simulates the air-water flow past a fixed-location phase-detection probe by introducing random fluctuations of the flow depth. The present model yields results that are close to experimental observations in terms of void fraction, bubble count rate and bubble/droplet chord size distributions. The results show that the surface waves have relatively little impact on the void fraction profiles, but that the bubble count rate profiles and the distributions of bubble and chord sizes are affected by the presence of surface waves.

Self-Similarity of Air-Water Flows in Skimming Flows on Stepped Spillways

Skimming flows on stepped spillways are characterised by a significant rate of turbulent dissipation on the chute. Herein an advanced signal processing of traditional conductivity probe signals is developed to provide further details on the turbulent time and length scales. The technique is applied to a 22° stepped chute operating with flow Reynolds numbers between 3.8 and 7.1 E+5. The new correlation analyses yielded a characterisation of large eddies advecting the bubbles. The turbulent length scales were related to the characteristic depth Y90. Some self-similar relationships were observed systematically at both macroscopic and microscopic levels. These included the distributions of void fraction, bubble count rate, interfacial velocity and turbulence level, and turbulence time and length scales. The self-similarity results were significant because they provided a picture general enough to be used to characterise the air-water flow field in prototype spillways.