AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs) taking values in a general Borel space and with compact action space depending on the state variable. The control variable acts on the jump rate and transition measure of the PDMP, and the running and boundary costs are assumed to be positive but not necessarily bounded. Our first main result is to obtain an optimality equation for the long run average cost in terms of a discrete-time optimality equation related to the embedded Markov chain given by the postjump location of the PDMP. Our second main result guarantees the existence of a feedback measurable selector for the discrete-time optimality equation by establishing a connection between this equation and an integro-differential equation. Our final main result is to obtain some sufficient conditions for the existence of a solution for a discrete-time optimality inequality and an ordinary optimal feedback control for the long run average cost using the so-called vanishing discount approach. Two examples are presented illustrating the possible applications of the results developed in the paper.

Average control of Markov decision processes with Feller transition probabilities and general action spaces

This paper studies the average control problem of discrete-time Markov Decision Processes (MDPs for short) with general state space, Feller transition probabilities, and possibly non-compact control constraint sets A(x). Two hypotheses are considered: either the cost function c is strictly unbounded or the multifunctions A(r)(x) = {a is an element of A(x) : c(x, a) <= r} are upper-semicontinuous and compact-valued for each real r. For these two cases we provide new results for the existence of a solution to the average-cost optimality equality and inequality using the vanishing discount approach. We also study the convergence of the policy iteration approach under these conditions. It should be pointed out that we do not make any assumptions regarding the convergence and the continuity of the limit function generated by the sequence of relative difference of the alpha-discounted value functions and the Poisson equations as often encountered in the literature. (C) 2012 Elsevier Inc. All rights reserved.

EXISTENCE RESULTS FOR NEUTRAL INTEGRO-DIFFERENTIAL EQUATIONS WITH UNBOUNDED DELAY

In this paper we discuss the existence of mild, strict and classical solutions for a class of abstract integro-differential equations in Banach spaces. Some applications to ordinary and partial integro-differential equations are considered.

Existence Results for Abstract Partial Neutral Integro-differential Equation with Unbounded Delay

In this paper we study the existence and regularity of mild solutions for a class of abstract partial neutral integro-differential equations with unbounded delay.

Random perturbations of stochastic processes with unbounded variable length memory

We consider binary infinite order stochastic chains perturbed by a random noise. This means that at each time step, the value assumed by the chain can be randomly and independently flipped with a small fixed probability. We show that the transition probabilities of the perturbed chain are uniformly close to the corresponding transition probabilities of the original chain. As a consequence, in the case of stochastic chains with unbounded but otherwise finite variable length memory, we show that it is possible to recover the context tree of the original chain, using a suitable version of the algorithm Context, provided that the noise is small enough.

Coordination dynamics and attentional costs of continuous and discontinuous bimanual circle drawing movements

It has been suggested that the temporal control of rhythmic unimianual movements is different between tasks requiring continuous (e.g., circle drawing) and discontinuous movements (e.g., finger tapping). Specifically, for continuous movements temporal regularities are ail emergent property, whereas for tasks that involve discontinuities timing is ail explicit part of the action goal. The present experiment further investigated the control of continuous and discontinuous movements by comparing the coordination dynamics and attentional demands of bimanual continuous circle drawing with bimanual intermittent circle drawing. The intermittent task required participants to insert a 400 ms pause between each cycle while circling. Using dual-task methodology, 15 right-handed participants performed the two circle drawing tasks, while vocally responding to randomly presented auditory probes. The circle drawing tasks were performed in symmetrical and asymmetrical coordination modes and at movement frequencies of 1 Hz and 1.7 Hz. Intermittent circle drawing exhibited superior spatial and temporal accuracy and stability than continuous circle drawing supporting the hypothesis that the two tasks have different underlying control processes. In terms of attentional cost, probe RT was significantly slower during the intermittent circle drawing task than the continuous circle drawing task across both coordination modes and movement frequencies. Of interest was the finding that in the intermittent circling task reaction time (RT) to probes presented during the pause between cycles did not differ from the RT to probes occurring during the circling movement. The differences in attentional demands between the intermittent and continuous circle drawing tasks may reflect the operation of explicit event timing and implicit emergent timing processes, respectively. (C) 2008 Elsevier B.V. All rights reserved.

Hybrid Method to Assess Sensitive Process Interruption Costs Due to Faults in Electric Power Distribution Networks

This paper shows a new hybrid method for risk assessment regarding interruptions in sensitive processes due to faults in electric power distribution systems. This method determines indices related to long duration interruptions and short duration voltage variations (SDVV), such as voltage sags and swells in each customer supplied by the distribution network. Frequency of such occurrences and their impact on customer processes are determined for each bus and classified according to their corresponding magnitude and duration. The method is based on information regarding network configuration, system parameters and protective devices. It randomly generates a number of fault scenarios in order to assess risk areas regarding long duration interruptions and voltage sags and swells in an especially inventive way, including frequency of events according to their magnitude and duration. Based on sensitivity curves, the method determines frequency indices regarding disruption in customer processes that represent equipment malfunction and possible process interruptions due to voltage sags and swells. Such approach allows for the assessment of the annual costs associated with each one of the evaluated power quality indices.

Reconfiguration of distribution networks to minimize loss and disruption costs using genetic algorithms

In this paper a computational implementation of an evolutionary algorithm (EA) is shown in order to tackle the problem of reconfiguring radial distribution systems. The developed module considers power quality indices such as long duration interruptions and customer process disruptions due to voltage sags, by using the Monte Carlo simulation method. Power quality costs are modeled into the mathematical problem formulation, which are added to the cost of network losses. As for the EA codification proposed, a decimal representation is used. The EA operators, namely selection, recombination and mutation, which are considered for the reconfiguration algorithm, are herein analyzed. A number of selection procedures are analyzed, namely tournament, elitism and a mixed technique using both elitism and tournament. The recombination operator was developed by considering a chromosome structure representation that maps the network branches and system radiality, and another structure that takes into account the network topology and feasibility of network operation to exchange genetic material. The topologies regarding the initial population are randomly produced so as radial configurations are produced through the Prim and Kruskal algorithms that rapidly build minimum spanning trees. (C) 2009 Elsevier B.V. All rights reserved.

Are there costs in the repeated mating activities of female Southern stink bugs Nezara viridula?

Mating is an energy demanding process, imposing risks to physical injuries, pathogen infection and predation. Nevertheless, repeated and multiple mating are widespread even in insect species where nuptial gifts are not involved. The effects of repeated mating, by the same male, are examined on the reproductive performance of female Southern green stink bug Nezara viridula (L.). Fecundity is reduced in females mated three or four times, although there is increased longevity. Females mated once or twice produce more egg clusters and concentrate egg-laying activity in the early part of adult life, whereas those mating more often lay eggs throughout the life span, with fewer egg clusters. Although fecundity is negatively affected by the number of matings, egg fertility remains unaffected.

Dissolution of a solid sphere in an unbounded, stagnant liquid

An exact analytical solution is obtained for the transient dissolution of solid spheres in a diffusion-controlled environment. This result provides a useful reference point for drug testing in humans. The dimensionless solution is expressed in terms of a single parameter, which accounts for solubility, bulk flow, and stagnant fluid composition. A simple, explicit and exact expression was found to predict time-to-complete dissolution (TCD). An approximate solution was also found which tracks the exact case for low solubility conditions.

The Y2K Scare: Causes, costs and cures.

The worldwide scare over the 'Y2K bug result in the expenditure of hundreds of billions of dollars on Y2K compliance and conversion policies. Most of this can be seen, in retrospect, to have been unproductive or, at least, misdirected. In this paper, the technological and institutional factors leading to the adoption of these policies are considered, along with suggestions as to how such policy failures could be avoided in future.

The currency of case management: benefits and costs

Case management models evolved as the mental health care system shifted hospital to community settings. The research evidence underscores the efficacy of certain case management models under 'ideal' conditions; what is less clear, is how these models perform in day to day clinical practice. Moreover, the economic perspective adopted by most studies is relatively narrow thus limiting a proper understanding of the costs and benefits of such models. This paper reviews recent work in the field and highlights gaps in both method and application as a focus for future work. Curr Opin Psychiatry 12:195-199, (C) 1999 Lippincott Williams & Wilkins.

Undergraduate student experience in dental service delivery in rural South Australia: An analysis of costs and benefits

Background, Rural experience for dental students can provide valuable clinical education, change attitudes to rural practice, and make a valuable contribution to clinical service provision. The aim of this paper is to assess the costs and benefits of service delivery by students through rural training programmes Methods: Groups of two students worked in the public dental clinics in adjacent rural centres where there had been long-term difficulties in recruiting staff. The costs and benefits of the programme were assessed by the impact on waiting lists, the total cost per patient of, a course of care and by the marginal cost of adding service provision by students to existing arrangements. Results: The total costs of emergency and complete treatment provided by students were greater than the costs of treatment provided by public-sector dentists but less than the costs of private providers treating public patients. However, the value of services were greater when care was provided by students or private providers and the marginal cost of students providing services was 50-70 per cent of the cost of care provided by public dentists. Conclusion: This assessment suggests that the service benefits achieved compliment the primary objective of influencing the attitude of students to rural practice.