SINGULARLY PERTURBED DISCOUNTED MARKOV CONTROL PROCESSES IN A GENERAL STATE SPACE

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

Composition Space Analysis in the Development of Copper Molybdate Hybrids Decorated by a Bifunctional Pyrazolyl/1,2,4-Triazole Ligand

A bitopic ligand, 4-(3,5-dimethylpyrazol-4-yl)-1,2,4-triazole (Hpz-tr) (1), containing two different heterocyclic moieties was employed for the design of copper(II)–molybdate solids under hydrothermal conditions. In the multicomponent CuII/Hpz-tr/MoVI system, a diverse set of coordination hybrids, [Cu(Hpz-tr)2SO4]·3H2O (2), [Cu(Hpz-tr)Mo3O10] (3), [Cu4(OH)4(Hpz-tr)4Mo8O26]·6H2O (4), [Cu(Hpz-tr)2Mo4O13] (5), and [Mo2O6(Hpz-tr)]·H2O (6), was prepared and characterized. A systematic investigation of these systems in the form of a ternary crystallization diagram approach was utilized to show the influence of the molar ratios of starting reagents, the metal (CuII and MoVI) sources, the temperature, etc., on the reaction products outcome. Complexes 2–4 dominate throughout a wide crystallization range of the composition triangle, while the other two compounds 5 and 6 crystallize as minor phases in a narrow concentration range. In the crystal structures of 2–6, the organic ligand behaves as a short [N–N]-triazole linker between metal centers Cu···Cu in 2–4, Cu···Mo in 5, and Mo···Mo in 6, while the pyrazolyl function remains uncoordinated. This is the reason for the exceptional formation of low-dimensional coordination motifs: 1D for 2, 4, and 6 and 2D for 3 and 5. In all cases, the pyrazolyl group is involved in H bonding (H-donor/H-acceptor) and is responsible for π–π stacking, thus connecting the chain and layer structures in more complicated H-bonding architectures. These compounds possess moderate thermal stability up to 250–300 °C. The magnetic measurements were performed for 2–4, revealing in all three cases antiferromagnetic exchange interactions between neighboring CuII centers and long-range order with a net moment below Tc of 13 K for compound 4.

A comparative state policy analysis of the adoption of birth defects surveillance legislation

Birth defects are the leading cause of infant mortality in the United States and are a major cause of lifetime disability. However, efforts to understand their causes have been hampered by a lack of population-specific data. During 1990–2004, 22 state legislatures responded to this need by proposing birth defects surveillance legislation (BDSL). The contrast between these states and those that did not pass BDSL provides an opportunity to better understand conditions associated with US public health policy diffusion. ^ This study identifies key state-specific determinants that predict: (1) the introduction of birth defects surveillance legislation (BDSL) onto states' formal legislative agenda, and (2) the successful adoption of these laws. Secondary aims were to interpret these findings in a theoretically sound framework and to incorporate evidence from three analytical approaches. ^ The study begins with a comparative case study of Texas and Oregon (states with divergent BDSL outcomes), including a review of historical documentation and content analysis of key informant interviews. After selecting and operationalizing explanatory variables suggested by the case study, Qualitative Comparative Analysis (QCA) was applied to publically available data to describe important patterns of variation among 37 states. Results from logistic regression were compared to determine whether the two methods produced consistent findings. ^ Themes emerging from the comparative case study included differing budgetary conditions and the significance of relationships within policy issue networks. However, the QCA and statistical analysis pointed to the importance of political parties and contrasting societal contexts. Notably, state policies that allow greater access to citizen-driven ballot initiatives were consistently associated with lower likelihood of introducing BDSL. ^ Methodologically, these results indicate that a case study approach, while important for eliciting valuable context-specific detail, may fail to detect the influence of overarching, systemic variables, such as party competition. However, QCA and statistical analyses were limited by a lack of existing data to operationalize policy issue networks, and thus may have downplayed the impact of personal interactions. ^ This study contributes to the field of health policy studies in three ways. First, it emphasizes the importance of collegial and consistent relationships among policy issue network members. Second, it calls attention to political party systems in predicting policy outcomes. Finally, a novel approach to interpreting state data in a theoretically significant manner (QCA) has been demonstrated.^

Steady-state thermal analysis of an innovative receiver for linear Fresnel reflectors

The study of the performance of an innovative receiver for linear Fresnel reflectors is carried out in this paper, and the results are analyzed with a physics perspective of the process. The receiver consists of a bundle of tubes parallel to the mirror arrays, resulting on a smaller cross section for the same receiver width as the number of tubes increases, due to the diminution of their diameter. This implies higher heat carrier fluid speeds, and thus, a more effective heat transfer process, although it conveys higher pumping power as well. Mass flow is optimized for different tubes diameters, different impinging radiation intensities and different fluid inlet temperatures. It is found that the best receiver design, namely the tubes diameter that maximizes the exergetic efficiency for given working conditions, is similar for the cases studied. There is a range of tubes diameters that imply similar efficiencies, which can drive to capital cost reduction thanks to the flexibility of design. In addition, the length of the receiver is also optimized, and it is observed that the optimal length is similar for the working conditions considered. As a result of this study, it is found that this innovative receiver provides an optimum design for the whole day, even though impinging radiation intensity varies notably. Thermal features of this type of receiver could be the base of a new generation of concentrated solar power plants with a great potential for cost reduction, because of the simplicity of the system and the lower weigh of the components, plus the flexibility of using the receiver tubes for different streams of the heat carrier fluid.

Estimating the modal parameters from multiple measurement setups using a joint state space model

Computing the modal parameters of structural systems often requires processing data from multiple non-simultaneously recorded setups of sensors. These setups share some sensors in common, the so-called reference sensors, which are fixed for all measurements, while the other sensors change their position from one setup to the next. One possibility is to process the setups separately resulting in different modal parameter estimates for each setup. Then, the reference sensors are used to merge or glue the different parts of the mode shapes to obtain global mode shapes, while the natural frequencies and damping ratios are usually averaged. In this paper we present a new state space model that processes all setups at once. The result is that the global mode shapes are obtained automatically, and only a value for the natural frequency and damping ratio of each mode is estimated. We also investigate the estimation of this model using maximum likelihood and the Expectation Maximization algorithm, and apply this technique to simulated and measured data corresponding to different structures.

Using the EM algorithm to estimate the state space model for OMAX

This paper presents a time-domain stochastic system identification method based on Maximum Likelihood Estimation and the Expectation Maximization algorithm that is applied to the estimation of modal parameters from system input and output data. The effectiveness of this structural identification method is evaluated through numerical simulation. Modal parameters (eigenfrequencies, damping ratios and mode shapes) of the simulated structure are estimated applying the proposed identification method to a set of 100 simulated cases. The numerical results show that the proposed method estimates the modal parameters with precision in the presence of 20% measurement noise even. Finally, advantages and disadvantages of the method have been discussed.

Compulsory medical care and the welfare state; an analysis based on a special study of governmentalized medical care systems on the continent of Europe and in England.

"References by chapters": p. 147-152.

Compulsory medical care and the welfare state, an analysis based on a special study of governmentalized medical care systems on the continent of Europe and in England.

"References by chapters": p. 147-152.

Phase-space analysis of bosonic spontaneous emission

We present phase-space techniques for the modelling of spontaneous emission in two-level bosonic atoms. The positive-P representation is shown to give a full and complete description within the limits of our model. The Wigner representation, even when truncated at second order, is shown to need a doubling of the phase-space to allow for a positive-definite diffusion matrix in the appropriate Fokker-Planck equation and still fails to agree with the full quantum results of the positive-P representation. We show that quantum statistics and correlations between the ground and excited states affect the dynamics of the emission process, so that it is in general non-exponential. (c) 2005 Elsevier B.V. All rights reserved.

Fixed wages and bonuses in agency contracts: the case of a continuous state space

In this paper, we extend the state-contingent production approach to principal–agent problems to the case where the state space is an atomless continuum. The approach is modelled on the treatment of optimal tax problems. The central observation is that, under reasonable conditions, the optimal contract may involve a fixed wage with a bonus for above-normal performance. This is analogous to the phenomenon of "bunching" at the bottom in the optimal tax literature.