Restless bandits, linear programming relaxations and a primal-dual index heuristic

We develop a mathematical programming approach for the classicalPSPACE - hard restless bandit problem in stochastic optimization.We introduce a hierarchy of n (where n is the number of bandits)increasingly stronger linear programming relaxations, the lastof which is exact and corresponds to the (exponential size)formulation of the problem as a Markov decision chain, while theother relaxations provide bounds and are efficiently computed. Wealso propose a priority-index heuristic scheduling policy fromthe solution to the first-order relaxation, where the indices aredefined in terms of optimal dual variables. In this way wepropose a policy and a suboptimality guarantee. We report resultsof computational experiments that suggest that the proposedheuristic policy is nearly optimal. Moreover, the second-orderrelaxation is found to provide strong bounds on the optimalvalue.

On ignoring scientific evidence: The bumpy road to enlightenment

It is well accepted that people resist evidence that contradicts their beliefs.Moreover, despite their training, many scientists reject results that are inconsistent withtheir theories. This phenomenon is discussed in relation to the field of judgment anddecision making by describing four case studies. These concern findings that clinical judgment is less predictive than actuarial models; simple methods have proven superiorto more theoretically correct methods in times series forecasting; equal weighting ofvariables is often more accurate than using differential weights; and decisions cansometimes be improved by discarding relevant information. All findings relate to theapparently difficult-to-accept idea that simple models can predict complex phenomenabetter than complex ones. It is true that there is a scientific market place for ideas.However, like its economic counterpart, it is subject to inefficiencies (e.g., thinness,asymmetric information, and speculative bubbles). Unfortunately, the market is only correct in the long-run. The road to enlightenment is bumpy.

On heuristic and linear models of judgment: Mapping the demand for knowledge

Research on judgment and decision making presents a confusing picture of human abilities. For example, much research has emphasized the dysfunctional aspects of judgmental heuristics, and yet, other findings suggest that these can be highly effective. A further line of research has modeled judgment as resulting from as if linear models. This paper illuminates the distinctions in these approaches by providing a common analytical framework based on the central theoretical premise that understanding human performance requires specifying how characteristics of the decision rules people use interact with the demands of the tasks they face. Our work synthesizes the analytical tools of lens model research with novel methodology developed to specify the effectiveness of heuristics in different environments and allows direct comparisons between the different approaches. We illustrate with both theoretical analyses and simulations. We further link our results to the empirical literature by a meta-analysis of lens model studies and estimate both human andheuristic performance in the same tasks. Our results highlight the trade-off betweenlinear models and heuristics. Whereas the former are cognitively demanding, the latterare simple to use. However, they require knowledge and thus maps of when andwhich heuristic to employ.

O Primal e o Dual na programação Linear

O tema da Programação Linear, com as suas particularizações do Problema dos Transportes e do Problema da Afectação de Recursos, é hoje estudado em cursos diversos onde uma disciplina de Investigação Operacional esteja presente. Trata-se, em última análise, de um problema de cálculo de extremos condicionados, seja de máximo ou de mínimo, que apresenta características muito particulares e de grande elegância simbólica. Também os Problemas dos Transportes e da Afectação de Recursos se podem resolver como problemas de Programação Linear, através do Algoritmo Simplex, embora seja preferível o recurso a algoritmos próprios, de muitíssimo maior simplicidade: o Algoritmo dos Transportes e o Algoritmo Húngaro, respectivamente. De molde a facilitar a compreensão do que realmente está em jogo, consideram-se aqui dois casos de determinação de extremos e de extremos condicionados, mas ao nível do final do ensino secundário.

Comparação entre os métodos da transeção linear e fotográfico na avaliação de cobertura vegetal morta, sob dois métodos de preparo, após a colheita da soja

A eficácia da cobertura vegetal morta no controle da erosão pode ser avaliada através de dois indicadores principais: a porcentagem de cobertura do solo pelos resíduos culturais e sua persistência sobre a superfície ao longo do tempo. O preparo do solo, por sua vez, pode exercer influência significativa sobre esses indicadores. O trabalho foi realizado no campo, no município de Eldorado do Sul, Depressão Central do Rio Grande do Sul. Avaliou-se a persistência da cobertura vegetal morta durante um período de pousio, que foi de maio de 1989 a abril de 1990, em sucessão à cultura da soja. Os resíduos dessa cultura foram manejados sem preparo, por escarificação e por gradagem. A porcentagem de cobertura do solo pelos resíduos culturais foi quantificada pelo método fotográfico e pelo da transeção linear. A cultura da soja produziu cobertura vegetal morta em pequena quantidade e de baixa durabilidade. A distribuição dos resíduos na superfície, sem preparo do solo, foi o tratamento que possibilitou melhor correlação (R²) entre os índices de cobertura obtidos pelos dois métodos testados. Nas áreas sob gradagem ou escarificação do solo, os índices de cobertura obtidos pelo método fotográfico foram superiores aos da transeção linear, enquanto, na área sem preparo do solo, houve similaridade entre os resultados dos dois métodos.

Differential transgene expression profiles in rat brain, using rAAV2/1 vectors with tetracycline-inducible and cytomegalovirus promoters.

The biodistribution of transgene expression in the CNS after localized stereotaxic vector delivery is an important issue for the safety of gene therapy for neurological diseases. The cellular specificity of transgene expression from rAAV2/1 vectors (recombinant adeno-associated viral vectors pseudotyped with viral capsids from serotype 1) using the tetracycline-inducible (TetON) expression cassette in comparison with the cytomegalovirus (CMV) promoter was investigated in the rat nigrostriatal pathway. After intrastriatal injection, although green fluorescent protein (GFP) was expressed mainly in neurons with both vectors, the relative proportions of DARPP-32-positive projection neurons and parvalbumin-positive interneurons were, respectively, 13:1 and 2:1 for the CMV and TetON vectors. DARP32-positive neurons projecting to the globus pallidus were strongly GFP positive with both vectors, whereas those projecting to the substantia nigra pars reticulata (SNpr) were efficiently labeled by the CMV vector but poorly by the TetON vector. Numerous GFP-positive cells were evidenced in the subventricular zone with both vectors. However, in the olfactory bulb (OB), GFP-positive neurons were observed with the CMV vector but not the TetON vector. We conclude that the absence of significant amounts of transgene product in distant regions (SN and OB) constitutes a safety advantage of the AAV2/1-TetON vector for striatal gene therapy. Midbrain injections resulted in selective GFP expression in tyrosine hydroxylase-positive neurons by the TetON vector whereas with the CMV vector, GFP-positive cells covered a widespread area of the midbrain. The biodistribution of GFP protein corresponded to that of the transcripts and not of the viral genomes. We conclude that the rAAV2/1-TetON vector constitutes an interesting tool for specific transgene expression in midbrain dopaminergic neurons.

Positional information by differential endocytosis splits auxin response to drive Arabidopsis root meristem growth.

In the Arabidopsis root meristem, polar auxin transport creates a transcriptional auxin response gradient that peaks at the stem cell niche and gradually decreases as stem cell daughters divide and differentiate [1-3]. The amplitude and extent of this gradient are essential for both stem cell maintenance and root meristem growth [4, 5]. To investigate why expression of some auxin-responsive genes, such as the essential root meristem growth regulator BREVIS RADIX (BRX) [6], deviates from this gradient, we combined experimental and computational approaches. We created cellular-level root meristem models that accurately reproduce distribution of nuclear auxin activity and allow dynamic modeling of regulatory processes to guide experimentation. Expression profiles deviating from the auxin gradient could only be modeled after intersection of auxin activity with the observed differential endocytosis pattern and positive autoregulatory feedback through plasma-membrane-to-nucleus transfer of BRX. Because BRX is required for expression of certain auxin response factor targets, our data suggest a cell-type-specific endocytosis-dependent input into transcriptional auxin perception. This input sustains expression of a subset of auxin-responsive genes across the root meristem's division and transition zones and is essential for meristem growth. Thus, the endocytosis pattern provides specific positional information to modulate auxin response.

Differential vulnerability of neurochemically identified subpopulations of retinal neurons in a monkey model of glaucoma.

The vulnerability of subpopulations of retinal neurons delineated by their content of cytoskeletal or calcium-binding proteins was evaluated in the retinas of cynomolgus monkeys in which glaucoma was produced with an argon laser. We quantitatively compared the number of neurons containing either neurofilament (NF) protein, parvalbumin, calbindin or calretinin immunoreactivity in central and peripheral portions of the nasal and temporal quadrants of the retina from glaucomatous and fellow non-glaucomatous eyes. There was no significant difference between the proportion of amacrine, horizontal and bipolar cells labeled with antibodies to the calcium-binding proteins comparing the two eyes. NF triplet immunoreactivity was present in a subpopulation of retinal ganglion cells, many of which, but not all, likely correspond to large ganglion cells that subserve the magnocellular visual pathway. Loss of NF protein-containing retinal ganglion cells was widespread throughout the central (59-77% loss) and peripheral (96-97%) nasal and temporal quadrants and was associated with the loss of NF-immunoreactive optic nerve fibers in the glaucomatous eyes. Comparison of counts of NF-immunoreactive neurons with total cell loss evaluated by Nissl staining indicated that NF protein-immunoreactive cells represent a large proportion of the cells that degenerate in the glaucomatous eyes, particularly in the peripheral regions of the retina. Such data may be useful in determining the cellular basis for sensitivity to this pathologic process and may also be helpful in the design of diagnostic tests that may be sensitive to the loss of the subset of NF-immunoreactive ganglion cells.

Maximum-likelihood estimation of specific differential phase and attenuation in rain

Precise estimation of propagation parameters inprecipitation media is of interest to improve the performanceof communications systems and in remote sensing applications.In this paper, we present maximum-likelihood estimators ofspecific attenuation and specific differential phase in rain. Themodel used for obtaining the cited estimators assumes coherentpropagation, reflection symmetry of the medium, and Gaussianstatistics of the scattering matrix measurements. No assumptionsabout the microphysical properties of the medium are needed.The performance of the estimators is evaluated through simulateddata. Results show negligible estimators bias and variances closeto Cramer–Rao bounds.

Differential regulation of the expression of two high-affinity sulfate transporters, SULTR1.1 and SULTR1.2, in Arabidopsis

The molecular mechanisms regulating the initial uptake of inorganic sulfate in plants are still largely unknown. The current model for the regulation of sulfate uptake and assimilation attributes positive and negative regulatory roles to O-acetyl-serine (O-acetyl-Ser) and glutathione, respectively. This model seems to suffer from exceptions and it has not yet been clearly validated whether intracellular O-acetyl-Ser and glutathione levels have impacts on regulation. The transcript level of the two high-affinity sulfate transporters SULTR1.1 and SULTR1.2 responsible for sulfate uptake from the soil solution was compared to the intracellular contents of O-acetyl-Ser, glutathione, and sulfate in roots of plants submitted to a wide diversity of experimental conditions. SULTR1.1 and SULTR1.2 were differentially expressed and neither of the genes was regulated in accordance with the current model. The SULTR1.1 transcript level was mainly altered in response to the sulfur-related treatments. Split-root experiments show that the expression of SULTR1.1 is locally regulated in response to sulfate starvation. In contrast, accumulation of SULTR1.2 transcripts appeared to be mainly related to metabolic demand and is controlled by photoperiod. On the basis of the new molecular insights provided in this study, we suggest that the expression of the two transporters depends on different regulatory networks. We hypothesize that interplay between SULTR1.1 and SULTR1.2 transporters could be an important mechanism to regulate sulfate content in the roots

Comparison of C-reactive protein and white blood cell count with differential in neonates at risk for septicaemia.

We prospectively compared the diagnostic value of C-reactive protein (CRP) and white blood cell counts for detection of neonatal septicaemia. Sensitivity and specifity in receiver operating characteristics, and positive and negative predictive value of CRP and white blood cell count were compared in 195 critically ill preterm and term newborns clinically suspected of infection. Blood cultures were positive in 33 cases. During the first 3 days after birth CRP elevation (sensitivity 75%, specifity 86%), leukopenia (67%/90%), neutropenia (78%/80%) and immature to total neutrophil count (I/T) ratio (78%/73%) were good diagnostic parameters, as opposed to band forms with absolute count (84%/66%) or percentage (79%/71%), thrombocytopenia (65%/57%) and toxic granulations (44%/94%). Beyond 3 days of age elevated CRP (88%/87%) was the best parameter. Increased total (84%/66%) or percentage band count (79%/71%) were also useful. Leukocytosis (74%/56%), increased neutrophils (67%/65%), I/T ratio (79%/47%), thrombocytopenia (65%/57%) and toxic granulations had a low specifity. The positive predictive value of CRP was 32% before and 37% after 3 days of age, that of leukopenia was 37% in the first 3 days. CONCLUSION: During the first 3 days of life CRP, leukopenia and neutropenia were comparably good tests while after 3 days of life CRP was the best single test in early detection of neonatal septicaemia. Serial CRP estimations confirm the diagnosis, monitor the course of infection and the efficacy of antibiotic treatment.

Second differential of the entropy as a criterion for the stability in low-dimensional climate models

The second differential of the entropy is used for analysing the stability of a thermodynamic climatic model. A delay time for the heat flux is introduced whereby it becomes an independent variable. Two different expressions for the second differential of the entropy are used: one follows classical irreversible thermodynamics theory; the second is related to the introduction of response time and is due to the extended irreversible thermodynamics theory. the second differential of the classical entropy leads to unstable solutions for high values of delay times. the extended expression always implies stable states for an ice-free earth. When the ice-albedo feedback is included, a discontinuous distribution of stable states is found for high response times. Following the thermodynamic analysis of the model, the maximum rates of entropy production at the steady state are obtained. A latitudinally isothermal earth produces the extremum in global entropy production. the material contribution to entropy production (by which we mean the production of entropy by material transport of heat) is a maximum when the latitudinal distribution of temperatures becomes less homogeneous than present values

Differential ubiquitylation of the mineralocorticoid receptor is regulated by phosphorylation.

Aldosterone stimulation of the mineralocorticoid receptor (MR) is involved in numerous physiological responses, including Na+ homeostasis, blood pressure control, and heart failure. Aldosterone binding to MR promotes different post-translational modifications that regulate MR nuclear translocation, gene expression, and finally receptor degradation. Here, we show that aldosterone stimulates rapid phosphorylation of MR via ERK1/2 in a dose-dependent manner (from 0.1 to 10 nM) in renal epithelial cells. This phosphorylation induces an increase of MR apparent molecular weight, with a maximal upward shift of 30 kDa. Strikingly, these modifications are critical for the regulation of the MR ubiquitylation state. Indeed, we find that MR is monoubiquitylated in its basal state, and this status is sustained by the tumor suppressor gene 101 (Tsg101). Phosphorylation leads to disruption of MR/Tsg101 association and monoubiquitin removal. These events prompt polyubiquitin-dependent destabilization of MR and degradation. Preventing MR phosphorylation by ERK1/2 inhibition or mutation of target serines affects the sequential mechanisms of MR ubiquitylation and inhibits the aldosterone-mediated degradation. Our data provide a novel model of negative feedback of aldosterone signaling, involving sequential phosphorylation, monoubiquitin removal and subsequent polyubiquitylation/degradation of MR.

A comparison of methods for differential expression analysis of RNA-seq data.

BACKGROUND: Finding genes that are differentially expressed between conditions is an integral part of understanding the molecular basis of phenotypic variation. In the past decades, DNA microarrays have been used extensively to quantify the abundance of mRNA corresponding to different genes, and more recently high-throughput sequencing of cDNA (RNA-seq) has emerged as a powerful competitor. As the cost of sequencing decreases, it is conceivable that the use of RNA-seq for differential expression analysis will increase rapidly. To exploit the possibilities and address the challenges posed by this relatively new type of data, a number of software packages have been developed especially for differential expression analysis of RNA-seq data. RESULTS: We conducted an extensive comparison of eleven methods for differential expression analysis of RNA-seq data. All methods are freely available within the R framework and take as input a matrix of counts, i.e. the number of reads mapping to each genomic feature of interest in each of a number of samples. We evaluate the methods based on both simulated data and real RNA-seq data. CONCLUSIONS: Very small sample sizes, which are still common in RNA-seq experiments, impose problems for all evaluated methods and any results obtained under such conditions should be interpreted with caution. For larger sample sizes, the methods combining a variance-stabilizing transformation with the 'limma' method for differential expression analysis perform well under many different conditions, as does the nonparametric SAMseq method.

Correlação linear e espacial entre o rendimento de grãos do feijoeiro e a resistência mecânica à penetração em um Latossolo Vermelho distrófico

A resistência mecânica à penetração apresentada pelo solo exerce grande influência sobre o desenvolvimento vegetal, uma vez que o crescimento das raízes, assim como o rendimento das culturas, varia de forma inversamente proporcional ao seu valor. No ano agrícola de 2001/2002, na Fazenda Experimental de Ensino e Pesquisa da Faculdade de Engenharia/UNESP - Campus de Ilha Solteira, foram analisados o rendimento de grãos do feijoeiro (PG) e a resistência mecânica à penetração (R), de um Latossolo Vermelho distrófico. O objetivo foi apurar diretrizes relacionadas com o aumento da produtividade agrícola em questão, estudando a correlação linear e a espacial entre a PG e a R. Foi instalada uma rede geoestatística para a coleta dos dados do solo e da planta, estabelecida com espaçamentos de 5 x 5 m e 2,5 x 2,5 m, que continham 120 pontos amostrais distribuídos numa área de 1.875 m². A correlação linear entre a PG e a R foi praticamente nula, uma vez que, dependendo das profundidades estudadas do solo, apresentou coeficientes de correlação (r) menores do que 0,20. A análise geoestatística apresentou boa estrutura de dependência espacial, tanto para a PG quanto para a R, quando analisadas isoladamente. Entretanto, a análise espacial conjunta de tais atributos apresentou-se inconsistente. Assim, com o aumento da resistência mecânica à penetração, em determinada região do solo ocorreu ora aumento, ora diminuição do rendimento de grãos do feijoeiro.