SINGULARLY PERTURBED DISCOUNTED MARKOV CONTROL PROCESSES IN A GENERAL STATE SPACE

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

DengueTools: innovative tools and strategies for the surveillance and control of dengue

Dengue fever is a mosquito-borne viral disease estimated to cause about 230 million infections worldwide every year, of which 25,000 are fatal. Global incidence has risen rapidly in recent decades with some 3.6 billion people, over half of the world's population, now at risk, mainly in urban centres of the tropics and subtropics. Demographic and societal changes, in particular urbanization, globalization, and increased international travel, are major contributors to the rise in incidence and geographic expansion of dengue infections. Major research gaps continue to hamper the control of dengue. The European Commission launched a call under the 7th Framework Programme with the title of 'Comprehensive control of Dengue fever under changing climatic conditions'. Fourteen partners from several countries in Europe, Asia, and South America formed a consortium named 'DengueTools' to respond to the call to achieve better diagnosis, surveillance, prevention, and predictive models and improve our understanding of the spread of dengue to previously uninfected regions (including Europe) in the context of globalization and climate change. The consortium comprises 12 work packages to address a set of research questions in three areas: Research area 1: Develop a comprehensive early warning and surveillance system that has predictive capability for epidemic dengue and benefits from novel tools for laboratory diagnosis and vector monitoring. Research area 2: Develop novel strategies to prevent dengue in children. Research area 3: Understand and predict the risk of global spread of dengue, in particular the risk of introduction and establishment in Europe, within the context of parameters of vectorial capacity, global mobility, and climate change. In this paper, we report on the rationale and specific study objectives of 'DengueTools'. DengueTools is funded under the Health theme of the Seventh Framework Programme of the European Community, Grant Agreement Number: 282589 Dengue Tools.

Acaricidal action of destruxins produced by a marine-derived Beauveria felina on the bovine tick Rhipicephalus (Boophilus) microplus

The increasing resistance of Rhipicephalus (Boophilus) microplus tick to commercial insecticides requires alternative methods for the control of this cattle plague. The enthomopathogenic fungus Beauveria feline produces destruxins in culture media, cyclic depsipeptides which display an array of biological activities. The present investigation aimed to evaluate the acaricide action of destruxins isolated from B. felina culture media on R. (B.) microplus engorged females. B. felina was grown in MF medium under 19 different growth conditions. HPLC-PDA analysis of chromatographic fractions obtained from the 19 different growth media extracts indicated the presence of destruxins in all lipophylic fractions. Such fractions were combined and subjected to separation by HPLC. Fractions containing distinct destruxins composition were tested against R. (B.) micro plus. Two fractions, composed of destruxin Ed(1) and pseudodestruxin B and/or pseudodestruxin C (fraction P1) as well as by hydroxyhomodestruxin B and/or destruxin D and/or roseotoxin C (fraction P7), displayed 30% and 28.7% acaricidal efficacy, respectively. This activity profile in such low concentration is adequate to consider destruxins as potential leading compounds to be developed for tick biological control. (C) 2012 Elsevier Inc. All rights reserved.

Post-receptor IGF1 insensitivity restricted to the MAPK pathway in a Silver-Russell syndrome patient with hypomethylation at the imprinting control region on chromosome 11

Background: Hypomethylation of the paternal imprinting center region 1 (ICR1) is the most frequent molecular cause of Silver-Russell syndrome (SRS). Clinical evidence suggests that patients with this epimutation have mild IGF1 insensitivity. Objective: To assess in vitro IGF1 action in fibroblast culture from a patient with SRS and IGF1 insensitivity. Methods: Fibroblast cultures from one patient with SRS due to ICR1 demethylation and controls were established. The SRS patient has severe growth failure, elevated IGF1 level, and poor growth rate during human recombinant GH treatment. IGF1 action was assessed by cell proliferation, AKT, and p42/44-MAPK phosphorylation. Gene expression was determined by real-time PCR. Results: Despite normal IGF1R sequence and expression, fibroblast proliferation induced by IGF1 was 50% lower in SRS fibroblasts in comparison with controls. IGF1 and insulin promoted a p42/44-MAPK activation in SRS fibroblasts 40 and 36%, respectively, lower than that in control fibroblasts. On the other hand, p42/44-MAPK activation induced by EGF stimulation was only slightly reduced (75% in SRS fibroblasts in comparison with control), suggesting a general impairment in MAPK pathway with a greater impairment of the stimulation induced by insulin and IGF1 than by EGF. A PCR array analysis disclosed a defect in MAPK pathway characterized by an increase in DUSP4 and MEF2C gene expressions in patient fibroblasts. Conclusion: A post-receptor IGF1 insensitivity was characterized in one patient with SRS and ICR1 hypomethylation. Although based on one unique severely affected patient, these results raise an intriguing mechanism to explain the postnatal growth impairment observed in SRS patients that needs confirmation in larger cohorts.

Models of passive and active dendrite motoneuron pools and their differences in muscle force control

Motoneuron (MN) dendrites may be changed from a passive to an active state by increasing the levels of spinal cord neuromodulators, which activate persistent inward currents (PICs). These exert a powerful influence on MN behavior and modify the motor control both in normal and pathological conditions. Motoneuronal PICs are believed to induce nonlinear phenomena such as the genesis of extra torque and torque hysteresis in response to percutaneous electrical stimulation or tendon vibration in humans. An existing large-scale neuromuscular simulator was expanded to include MN models that have a capability to change their dynamic behaviors depending on the neuromodulation level. The simulation results indicated that the variability (standard deviation) of a maintained force depended on the level of neuromodulatory activity. A force with lower variability was obtained when the motoneuronal network was under a strong influence of PICs, suggesting a functional role in postural and precision tasks. In an additional set of simulations when PICs were active in the dendrites of the MN models, the results successfully reproduced experimental results reported from humans. Extra torque was evoked by the self-sustained discharge of spinal MNs, whereas differences in recruitment and de-recruitment levels of the MNs were the main reason behind torque and electromyogram (EMG) hysteresis. Finally, simulations were also used to study the influence of inhibitory inputs on a MN pool that was under the effect of PICs. The results showed that inhibition was of great importance in the production of a phasic force, requiring a reduced co-contraction of agonist and antagonist muscles. These results show the richness of functionally relevant behaviors that can arise from a MN pool under the action of PICs.

Pain in photodynamic therapy: mechanism of action and management strategies

Photodynamic therapy involves administration of a photosensitizing drug and its subsequent activation by irradiation with a light source at wavelengths matching the absorption spectrum of the photosensitizer. In many countries around the world, topical photodynamic therapy has been approved for treatment of cutaneous oncologic conditions such as actinic keratosis, Bowen's disease, and superficial basal cell carcinoma. Multicenter, randomized, controlled studies have confirmed its efficacy and superior cosmetic outcomes compared to conventional therapies. Nevertheless, this therapeutic method presents some adverse effects, such as erythema, edema, pigmentation, pustules, and pain. There is no doubt that pain is the most severe of the adverse effects, being sometimes responsible for definitive treatment interruption. The pain mechanism has not yet been fully understood, which makes complete pain control a challenge to be conquered. In spite of that, this literature review presents some useful pain management strategies as well as the most important pain-related factors in photodynamic therapy.

PTTG expression in different experimental and human prolactinomas in relation to dopaminergic control of lactotropes

Abstract Background Pituitary tumor transforming gene (pttg) is a novel oncogene that is expressed at higher level in most of the tumors analyzed to date compared to normal tissues. Nevertheless, its expression in prolactinomas and its relation with the pituitary dopamine receptor 2 (D2R) are not well defined. We sought to determine the pituitary level of pttg in three different experimental models of prolactinomas with altered dopaminergic control of the pituitary: the dopaminergic D2R knockout female mouse, the estrogen-treated rat, and the senescent female rat. These three models shared the characteristics of increased pituitary weight, hyperprolactinemia, lactotrope hyperplasia and reduced or absent dopaminergic action at the pituitary level. We also studied samples from human macroprolactinomas, which were characterized as responsive or resistant to dopamine agonist therapy. Results When compared to female wild-type mice, pituitaries from female D2R knockout mice had decreased PTTG concentration, while no difference in pttg mRNA level was found. In senescent rats no difference in pituitary PTTG protein expression was found when compared to young rats. But, in young female rats treated with a synthetic estrogen (Diethylstylbestrol, 20 mg) PTTG protein expression was enhanced (P = 0.029). Therefore, in the three experimental models of prolactinomas, pituitary size was increased and there was hyperprolactinemia, but PTTG levels followed different patterns. Patients with macroprolactinomas were divided in those in which dopaminergic therapy normalized or failed to normalize prolactin levels (responsive and resistant, respectively). When pituitary pttg mRNA level was analyzed in these macroprolactinomas, no differences were found. We next analyzed estrogen action at the pituitary by measuring pituitary estrogen receptor α levels. The D2R knockout female mice have low estrogen levels and in accordance, pituitary estrogen receptors were increased (P = 0.047). On the other hand, in senescent rats estrogen levels were slightly though not significantly higher, and estrogen receptors were similar between groups. The estrogen-treated rats had high pharmacological levels of the synthetic estrogen, and estrogen receptors were markedly lower than in controls (P < 0.0001). Finally, in patients with dopamine resistant or responsive prolactinomas no significant differences in estrogen receptor α levels were found. Therefore, pituitary PTTG was increased only if estrogen action was increased, which correlated with a decrease in pituitary estrogen receptor level. Conclusion We conclude that PTTG does not correlate with prolactin levels or tumor size in animal models of prolactinoma, and its pituitary content is not related to a decrease in dopaminergic control of the lactotrope, but may be influenced by estrogen action at the pituitary level. Therefore it is increased only in prolactinomas generated by estrogen treatment, and not in prolactinomas arising from deficient dopamine control, or in dopamine resistant compared with dopamine responsive human prolactinomas. These results are important in the search for reliable prognostic indicators for patients with pituitary adenomas which will make tumor-specific therapy possible, and help to elucidate the poorly understood phenomenon of pituitary tumorigenesis.

A possible new mechanism for the control of miRNA expression in neurons

The control of gene expression by miRNAs has been widely investigated in different species and cell types. Following a probabilistic rather than a deterministic regimen, the action of these short nucleotide sequences on specific genes depends on intracellular concentration,which in turn reflects the balance between biosynthesis and degradation. Recent studies have described the involvement of XRN2, an exoribonuclease, in miRNA degradation and PAPD4, an atypical poly(A) polymerase, in miRNA stability. Herein, we examined the expression of XRN2 and PAPD4 in developing and adult rat hippocampi. Combining bioinformatics and real-time PCR,we demonstrated that XRN2 and PAPD4 expression is regulated by the uncorrelated action of transcription factors, resulting in distinct gene expression profiles during development. Analyses of nuclei position and nestin labeling revealed that both proteins progressively accumulated during neuronal differentiation, and that they are weakly expressed in immature neurons and absent in glial and endothelial cells. Despite the differences in subcellular localization, both genes were concurrently identified within identical neuronal subpopulations, including specific inhibitory interneurons. Thus, we cope with a singular circumstance in biology: an almost complete intersected expression of functional-opposed genes, reinforcing that their antagonistically driven actions on miRNAs “make sense” if simultaneously present at the same cells. Considering that the transcriptome in the nervous system is finely tuned to physiological processes, it was remarkable that miRNA stability-related genes were oncurrently identified in neurons that play essential roles in cognitive functions such as memory and learning. In summary, this study reveals a possible new mechanism for the control of miRNA expression.

Biomarkers and Bacterial Pneumonia Risk in Patients with Treated HIV Infection: A Case-Control Study

Background: Despite advances in HIV treatment, bacterial pneumonia continues to cause considerable morbidity and mortality in patients with HIV infection. Studies of biomarker associations with bacterial pneumonia risk in treated HIVinfected patients do not currently exist. Methods: We performed a nested, matched, case-control study among participants randomized to continuous combination antiretroviral therapy (cART) in the Strategies for Management of Antiretroviral Therapy trial. Patients who developed bacterial pneumonia (cases) and patients without bacterial pneumonia (controls) were matched 1:1 on clinical center, smoking status, age, and baseline cART use. Baseline levels of Club Cell Secretory Protein 16 (CC16), Surfactant Protein D (SP-D), C-reactive protein (hsCRP), interleukin-6 (IL-6), and d-dimer were compared between cases and controls. Results: Cases (n = 72) and controls (n = 72) were 25.7% female, 51.4% black, 65.3% current smokers, 9.7% diabetic, 36.1% co-infected with Hepatitis B/C, and 75.0% were on cART at baseline. Median (IQR) age was 45 (41, 51) years with CD4+ count of 553 (436, 690) cells/mm3. Baseline CC16 and SP-D were similar between cases and controls, but hsCRP was significantly higher in cases than controls (2.94 mg/mL in cases vs. 1.93 mg/mL in controls; p = 0.02). IL-6 and d-dimer levels were also higher in cases compared to controls, though differences were not statistically significant (p-value 0.06 and 0.10, respectively). Conclusions: In patients with cART-treated HIV infection, higher levels of systemic inflammatory markers were associated with increased bacterial pneumonia risk, while two pulmonary-specific inflammatory biomarkers, CC16 and SP-D, were not associated with bacterial pneumonia risk.

La Real Hacienda y el control del gasto. La Tesorería General en la España del siglo XVIII

[ES] La evolución historiográfica ocurrida en los últimos años en relación con el mundo de las finanzas en general y las Haciendas reales en particular, ha generado grandes cambios en la percepción del interés por el gasto de los Estados. La potenciación del deseo de observar cómo las Monarquías del Antiguo Régimen gestionan la atención a sus necesidades, conlleva aparejada una creciente atención por el estudio de los organismos encargados de dicha actuación. Entre estas instituciones destaca en la España del siglo XVIII la Tesorería Mayor o Tesorería General. Su estudio permite conocer la evolución política de la Monarquía y de su relación con las finanzas privadas desde una perspectiva diferente. Los estudios centrados en la actuación de este organismo, su composición interna, su estructura territorial, los mecanismos de su ordenación contable y, en definitiva, cualquier tipo de actuación ocurrida dentro del ámbito de su gestión son el objeto del presente estudio.

Biofilms on exposed monumental stones: mechanism of formation and development of new control methods

Within the stone monumental artefacts artistic fountains are extremely favorable to formation of biofilms, giving rise to biodegradation processes related with physical-chemical and visual aspect alterations, because of their particular exposure conditions. Microbial diversity of five fountains (two from Spain and three from Italy) was investigated. It was observed an ample similarity between the biodiversity of monumental stones reported in literature and that one found in studied fountains. Mechanical procedures and toxic chemical products are usually employed to remove such phototrophic patinas. Alternative methods based on natural antifouling substances are recently experimented in the marine sector, due to their very low environmental impact and for the bio settlement prevention on partially immersed structures of ships. In the present work groups of antibiofouling agents (ABAs) were selected from literature for their ability to interfere, at molecular level, with the microbial communication system “quorum sensing”, inhibiting the initial phase of biofilm formation. The efficacy of some natural antibiofoulants agents (ABAs) with terrestrial (Capsaicine - CS, Cinnamaldehyde - CI) and marine origin (Zosteric Acid - ZA, poly-Alkyl Pyridinium Salts – pAPS and Ceramium botryocarpum extract - CBE), incorporated into two commercial coatings (Silres BS OH 100 - S and Wacker Silres BS 290 - W) commonly used in stone conservation procedures were evaluated. The formation of phototrophic biofilms in laboratory conditions (on Carrara marble specimens and Sierra Elvira stone) and on two monumental fountains (Tacca’s Fountain 2 - Florence, Italy and Fountain from Patio de la Lindaraja - Alhambra Palace, Granada, Spain) has been investigated in the presence or absence of these natural antifouling agents. The natural antibiofouling agents, at tested concentrations, demonstrated a certain inhibitory effect. The silane-siloxane based silicone coating (W) mixing with ABAs was more suitable with respect to ethyl silicate coating (S) and proved efficacy against biofilm formation only when incompletely cured. The laboratory results indicated a positive action in inhibiting the patina formation, especially for poly-alkyl pyridinium salts, zosteric acid and cinnamaldehyde, while on site tests revealed a good effect for zosteric acid.

Myc-mediated control of gene transcription in cancer cells

The Myc oncoproteins belong to a family of transcription factors composed by Myc, N-Myc and L-Myc. The most studied components of this family are Myc and N-Myc because their expressions are frequently deregulated in a wide range of cancers. These oncoproteins can act both as activators or repressors of gene transcription. As activators, they heterodimerize with Max (Myc associated X-factor) and the heterodimer recognizes and binds a specific sequence elements (E-Box) onto gene promoters recruiting histone acetylase and inducing transcriptional activation. Myc-mediated transcriptional repression is a quite debated issue. One of the first mechanisms defined for the Myc-mediated transcriptional repression consisted in the interaction of Myc-Max complex Sp1 and/or Miz1 transcription factors already bound to gene promoters. This interaction may interfere with their activation functions by recruiting co-repressors such as Dnmt3 or HDACs. Moreover, in the absence of , Myc may interfere with the Sp1 activation function by direct interaction and subsequent recruitment of HDACs. More recently the Myc/Max complex was also shown to mediate transcriptional repression by direct binding to peculiar E-box. In this study we analyzed the role of Myc overexpression in Osteosarcoma and Neuroblastoma oncogenesis and the mechanisms underling to Myc function. Myc overexpression is known to correlate with chemoresistance in Osteosarcoma cells. We extended this study by demonstrating that c-Myc induces transcription of a panel of ABC drug transporter genes. ABCs are a large family trans-membrane transporter deeply involved in multi drug resistance. Furthermore expression levels of Myc, ABCC1, ABCC4 and ABCF1 were proved to be important prognostic tool to predict conventional therapy failure. N-Myc amplification/overexpression is the most important prognostic factor for Neuroblastoma. Cyclin G2 and Clusterin are two genes often down regulated in neuroblastoma cells. Cyclin G2 is an atypical member of Cyclin family and its expression is associated with terminal differentiation and apoptosis. Moreover it blocks cell cycle progression and induces cell growth arrest. Instead, CLU is a multifunctional protein involved in many physiological and pathological processes. Several lines of evidences support the view that CLU may act as a tumour suppressor in Neuroblastoma. In this thesis I showed that N-Myc represses CCNG2 and CLU transcription by different mechanisms. • N-Myc represses CCNG2 transcription by directly interacting with Sp1 bound in CCNG2 promoter and recruiting HDAC2. Importantly, reactivation of CCNG2 expression through epigenetic drugs partially reduces N-Myc and HDAC2 mediated cell proliferation. • N-Myc/Max complex represses CLU expression by direct binding to a peculiar E-box element on CLU promoter and by recruitment of HDACs and Polycomb Complexes, to the CLU promoter. Overall our findings strongly support the model in which Myc overexpression/amplification may contribute to some aspects of oncogenesis by a dual action: i) transcription activation of genes that confer a multidrug resistant phenotype to cancer cells; ii), transcription repression of genes involved in cell cycle inhibition and cellular differentiation.

Analysis of optimal control problems for the incompressible MHD equations and implementation in a finite element multiphysics code

This thesis deals with the study of optimal control problems for the incompressible Magnetohydrodynamics (MHD) equations. Particular attention to these problems arises from several applications in science and engineering, such as fission nuclear reactors with liquid metal coolant and aluminum casting in metallurgy. In such applications it is of great interest to achieve the control on the fluid state variables through the action of the magnetic Lorentz force. In this thesis we investigate a class of boundary optimal control problems, in which the flow is controlled through the boundary conditions of the magnetic field. Due to their complexity, these problems present various challenges in the definition of an adequate solution approach, both from a theoretical and from a computational point of view. In this thesis we propose a new boundary control approach, based on lifting functions of the boundary conditions, which yields both theoretical and numerical advantages. With the introduction of lifting functions, boundary control problems can be formulated as extended distributed problems. We consider a systematic mathematical formulation of these problems in terms of the minimization of a cost functional constrained by the MHD equations. The existence of a solution to the flow equations and to the optimal control problem are shown. The Lagrange multiplier technique is used to derive an optimality system from which candidate solutions for the control problem can be obtained. In order to achieve the numerical solution of this system, a finite element approximation is considered for the discretization together with an appropriate gradient-type algorithm. A finite element object-oriented library has been developed to obtain a parallel and multigrid computational implementation of the optimality system based on a multiphysics approach. Numerical results of two- and three-dimensional computations show that a possible minimum for the control problem can be computed in a robust and accurate manner.

The posterior parietal cortex: a bridge between vision and action

The present work takes into account three posterior parietal areas, V6, V6A, and PEc, all operating on different subsets of signals (visual, somatic, motor). The work focuses on the study of their functional properties, to better understand their respective contribution in the neuronal circuits that make possible the interactions between subject and external environment. In the caudalmost pole of parietal lobe there is area V6. Functional data suggest that this area is related to the encoding of both objects motion and ego-motion. However, the sensitivity of V6 neurons to optic flow stimulations has been tested only in human fMRI experiments. Here we addressed this issue by applying on monkey the same experimental protocol used in human studies. The visual stimulation obtained with the Flow Fields stimulus was the most effective and powerful to activate area V6 in monkey, further strengthening this homology between the two primates. The neighboring areas, V6A and PEc, show different cytoarchitecture and connectivity profiles, but are both involved in the control of reaches. We studied the sensory responses present in these areas, and directly compared these.. We also studied the motor related discharges of PEc neurons during reaching movements in 3D space comparing also the direction and depth tuning of PEc cells with those of V6A. The results show that area PEc and V6A share several functional properties. Area PEc, unlike V6A, contains a richer and more complex somatosensory input, and a poorer, although complex visual one. Differences emerged also comparing the motor-related properties for reaches in depth: the incidence of depth modulations in PEc and the temporal pattern of modulation for depth and direction allow to delineate a trend among the two parietal visuomotor areas.