The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

Effect of disorder on quantum phase transitions in anisotropic XY spin chains in a transverse field

We present some exact results for the effect of disorder on the critical properties of an anisotropic XY spin chain in a transverse held. The continuum limit of the corresponding fermion model is taken and in various cases results in a Dirac equation with a random mass. Exact analytic techniques can then be used to evaluate the density of states and the localization length. In the presence of disorder the ferromagnetic-paramagnetic or Ising transition of the model is in the same universality class as the random transverse field Ising model solved by Fisher using a real-space renormalization-group decimation technique (RSRGDT). If there is only randomness in the anisotropy of the magnetic exchange then the anisotropy transition (from a ferromagnet in the x direction to a ferromagnet in the y direction) is also in this universality class. However, if there is randomness in the isotropic part of the exchange or in the transverse held then in a nonzero transverse field the anisotropy transition is destroyed by the disorder. We show that in the Griffiths' phase near the Ising transition that the ground-state energy has an essential singularity. The results obtained for the dynamical critical exponent, typical correlation length, and for the temperature dependence of the specific heat near the Ising transition agree with the results of the RSRODT and numerical work. [S0163-1829(99)07125-8].

Variation in length, fecundity and survival of pink wax scale, Ceroplastes rubens Maskell (Hemiptera: Coccidae), on umbrella trees

We investigated some of the factors that may lead to outbreaks of pink wax scale, Ceroplastes rubens Maskell, on umbrella trees, Schefflera actinophylla (Endl.). Estimates of birth and death rates of pink wax scale were high and variable within and among trees; variation in these rates was not related to scale density. Adult fecundity correlated significantly but weakly with adult test length; mean fecundity was 292 eggs per female with a range of 5-1178. Adult test length and its variance decreased weakly with increasing density. Field experiments showed that mortality of C. rubens is greatest during the first 24 hours after hatching when approximately half disappear. The rate of loss decreases over time with 0.3% of initial motile first-instar nymphs surviving to maturity. Rates of loss varied significantly between trees, indicating that some trees are more suitable for scale colonisation and survival.

Dynamic programming for a Markov-switching jump–diffusion

We consider an optimal control problem with a deterministic finite horizon and state variable dynamics given by a Markov-switching jump–diffusion stochastic differential equation. Our main results extend the dynamic programming technique to this larger family of stochastic optimal control problems. More specifically, we provide a detailed proof of Bellman’s optimality principle (or dynamic programming principle) and obtain the corresponding Hamilton–Jacobi–Belman equation, which turns out to be a partial integro-differential equation due to the extra terms arising from the Lévy process and the Markov process. As an application of our results, we study a finite horizon consumption– investment problem for a jump–diffusion financial market consisting of one risk-free asset and one risky asset whose coefficients are assumed to depend on the state of a continuous time finite state Markov process. We provide a detailed study of the optimal strategies for this problem, for the economically relevant families of power utilities and logarithmic utilities.

THE U.S. and European M&A cycles: A Markov switching and state space approach

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Finance from the NOVA – School of Business and Economics

Credit cycle identification: A Markov-switching application

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Finance from the NOVA – School of Business and Economics

Stochastic Search Variable Selection in Vector Error Correction Models with an Application to a Model of the UK Macroeconomy

This paper develops methods for Stochastic Search Variable Selection (currently popular with regression and Vector Autoregressive models) for Vector Error Correction models where there are many possible restrictions on the cointegration space. We show how this allows the researcher to begin with a single unrestricted model and either do model selection or model averaging in an automatic and computationally efficient manner. We apply our methods to a large UK macroeconomic model.

Bayesian Model Averaging in the Instrumental Variable Regression Model

This paper considers the instrumental variable regression model when there is uncertainty about the set of instruments, exogeneity restrictions, the validity of identifying restrictions and the set of exogenous regressors. This uncertainty can result in a huge number of models. To avoid statistical problems associated with standard model selection procedures, we develop a reversible jump Markov chain Monte Carlo algorithm that allows us to do Bayesian model averaging. The algorithm is very exible and can be easily adapted to analyze any of the di¤erent priors that have been proposed in the Bayesian instrumental variables literature. We show how to calculate the probability of any relevant restriction (e.g. the posterior probability that over-identifying restrictions hold) and discuss diagnostic checking using the posterior distribution of discrepancy vectors. We illustrate our methods in a returns-to-schooling application.

Species identification in mammals from mixed biological samples based on mitochondrial DNA control region length polymorphism.

The ability to identify the species origin of an unknown biological sample is relevant in the fields of human and wildlife forensics. However, the detection of several species mixed in the same sample still remains a challenge. We developed and tested a new approach for mammal DNA identification in mixtures of two or three species, based on the analysis of mitochondrial DNA control region interspecific length polymorphism followed by direct sequencing. Contrary to other published methods dealing with species mixtures, our protocol requires a single universal primer pair and is not based on a pre-defined panel of species. Amplicons can be separated either on agarose gels or using CE. The advantages and limitations of the assay are discussed under different conditions, such as variable template concentration, amplicon sizes and size difference among the amplicons present in the mixture. For the first time, this protocol provides a simple, reliable and flexible method for simultaneous identification of multiple mammalian species from mixtures, without any prior knowledge of the species involved.

Prospective universal application of mycobacterial interspersed repetitive-unit-variable-number tandem-repeat genotyping to characterize Mycobacterium tuberculosis isolates for fast identification of clustered and orphan cases.

The use of molecular tools for genotyping Mycobacterium tuberculosis isolates in epidemiological surveys in order to identify clustered and orphan strains requires faster response times than those offered by the reference method, IS6110 restriction fragment length polymorphism (RFLP) genotyping. A method based on PCR, the mycobacterial interspersed repetitive-unit-variable-number tandem-repeat (MIRU-VNTR) genotyping technique, is an option for fast fingerprinting of M. tuberculosis, although precise evaluations of correlation between MIRU-VNTR and RFLP findings in population-based studies in different contexts are required before the methods are switched. In this study, we evaluated MIRU-VNTR genotyping (with a set of 15 loci [MIRU-15]) in parallel to RFLP genotyping in a 39-month universal population-based study in a challenging setting with a high proportion of immigrants. For 81.9% (281/343) of the M. tuberculosis isolates, both RFLP and MIRU-VNTR types were obtained. The percentages of clustered cases were 39.9% (112/281) and 43.1% (121/281) for RFLP and MIRU-15 analyses, and the numbers of clusters identified were 42 and 45, respectively. For 85.4% of the cases, the RFLP and MIRU-15 results were concordant, identifying the same cases as clustered and orphan (kappa, 0.7). However, for the remaining 14.6% of the cases, discrepancies were observed: 16 of the cases clustered by RFLP analysis were identified as orphan by MIRU-15 analysis, and 25 cases identified as orphan by RFLP analysis were clustered by MIRU-15 analysis. When discrepant cases showing subtle genotypic differences were tolerated, the discrepancies fell from 14.6% to 8.6%. Epidemiological links were found for 83.8% of the cases clustered by both RFLP and MIRU-15 analyses, whereas for the cases clustered by RFLP or MIRU-VNTR analysis alone, links were identified for only 30.8% or 38.9% of the cases, respectively. The latter group of cases mainly comprised isolates that could also have been clustered, if subtle genotypic differences had been tolerated. MIRU-15 genotyping seems to be a good alternative to RFLP genotyping for real-time interventional schemes. The correlation between MIRU-15 and IS6110 RFLP findings was reasonable, although some uncertainties as to the assignation of clusters by MIRU-15 analysis were identified.

Characterization of microevolution events in Mycobacterium tuberculosis strains involved in recent transmission clusters.

Under certain circumstances, it is possible to identify clonal variants of Mycobacterium tuberculosis infecting a single patient, probably as a result of subtle genetic rearrangements in part of the bacillary population. We systematically searched for these microevolution events in a different context, namely, recent transmission chains. We studied the clustered cases identified using a population-based universal molecular epidemiology strategy over a 5-year period. Clonal variants of the reference strain defining the cluster were found in 9 (12%) of the 74 clusters identified after the genotyping of 612 M. tuberculosis isolates by IS6110 restriction fragment length polymorphism analysis and mycobacterial interspersed repetitive units-variable-number tandem repeat typing. Clusters with microevolution events were epidemiologically supported and involved 4 to 9 cases diagnosed over a 1- to 5-year period. The IS6110 insertion sites from 16 representative isolates of reference and microevolved variants were mapped by ligation-mediated PCR in order to characterize the genetic background involved in microevolution. Both intragenic and intergenic IS6110 locations resulted from these microevolution events. Among those cases of IS6110 locations in intergenic regions which could have an effect on the regulation of adjacent genes, we identified the overexpression of cytochrome P450 in one microevolved variant using quantitative real-time reverse transcription-PCR. Our results help to define the frequency with which microevolution can be expected in M. tuberculosis transmission chains. They provide a snapshot of the genetic background of these subtle rearrangements and identify an event in which IS6110-mediated microevolution in an isogenic background has functional consequences.

Inactivation of L-type calcium channels is determined by the length of the N terminus of mutant beta(1) subunits.

Voltage-dependent calcium channel (Ca(v)) pores are modulated by cytosolic beta subunits. Four beta-subunit genes and their splice variants offer a wide structural array for tissue- or disease-specific biophysical gating phenotypes. For instance, the length of the N terminus of beta(2) subunits has major effects on activation and inactivation rates. We tested whether a similar mechanism principally operates in a beta(1) subunit. Wild-type beta(1a) subunit (N terminus length 60 aa) and its newly generated N-terminal deletion mutants (51, 27 and 18 aa) were examined within recombinant L-type calcium channel complexes (Ca(v)1.2 and alpha(2)delta2) in HEK293 cells at the whole-cell and single-channel level. Whole-cell currents were enhanced by co-transfection of the full-length beta(1a) subunit and by all truncated constructs. Voltage dependence of steady-state activation and inactivation did not depend on N terminus length, but inactivation rate was diminished by N terminus truncation. This was confirmed at the single-channel level, using ensemble average currents. Additionally, gating properties were estimated by Markov modeling. In confirmation of the descriptive analysis, inactivation rate, but none of the other transition rates, was reduced by shortening of the beta(1a) subunit N terminus. Our study shows that the length-dependent mechanism of modulating inactivation kinetics of beta(2) calcium channel subunits can be confirmed and extended to the beta(1) calcium channel subunit.

Telomere length dynamics in human lymphocyte subpopulations measured by flow cytometry.

To measure the average length of telomere repeats at chromosome ends in individual cells we developed a flow cytometry method using fluorescence in situ hybridization (flow FISH) with labeled peptide nucleic acid (PNA) probes. Results of flow FISH measurements correlated with results of conventional telomere length measurements by Southern blot analysis (R = 0.9). Consistent differences in telomere length in CD8+ T-cell subsets were identified. Naive and memory CD4+ T lymphocytes in normal adults differed by around 2.5 kb in telomere length, in agreement with known replicative shortening of telomeres in lymphocytes in vivo. T-cell clones grown in vitro showed stabilization of telomere length after an initial decline and rare clones capable of growing beyond 100 population doublings showed variable telomere length. These results show that flow FISH can be used to measure specific nucleotide repeat sequences in single cells and indicate that the very large replicative potential of lymphocytes is only indirectly related to telomere length.

Evaluation of Variable Advisory Speed Limits in Work Zones, TPF-5(081), 2013

Variable advisory speed limit (VASL) systems could be effective at both urban and rural work zones, at both uncongested and congested sites. At uncongested urban work zones, the average speeds with VASL were lower than without VASL. But the standard deviation of speeds with VASL was higher. The increase in standard deviation may be due to the advisory nature of VASL. The speed limit compliance with VASL was about eight times greater than without VASL. At the congested sites, the VASL were effective in making drivers slow down gradually as they approached the work zone, reducing any sudden changes in speeds. Mobility-wise the use of VASL resulted in a decrease in average queue length, throughput, number of stops, and an increase in travel time. Several surrogate safety measures also demonstrated the benefits of VASL in congested work zones. VASL deployments in rural work zones resulted in reductions in mean speed, speed variance, and 85th percentile speeds downstream of the VASL sign. The study makes the following recommendations based on the case studies investigated: 1. The use of VASL is recommended for uncongested work zones to achieve better speed compliance and lower speeds. Greater enforcement of regulatory speed limits could help to decrease the standard deviation in speeds; 2. The use of VASL to complement the static speed limits in rural work zones is beneficial even if the VASL is only used to display the static speed limits. It leads to safer traffic conditions by encouraging traffic to slow down gradually and by reminding traffic of the reduced speed limit. A well-designed VASL algorithm, like the P5 algorithm developed in this study, can significantly improve the mobility and safety conditions in congested work zones. The use of simulation is recommended for optimizing the VASL algorithms before field deployment.