Restless bandits, linear programming relaxations and a primal-dual index heuristic

We develop a mathematical programming approach for the classicalPSPACE - hard restless bandit problem in stochastic optimization.We introduce a hierarchy of n (where n is the number of bandits)increasingly stronger linear programming relaxations, the lastof which is exact and corresponds to the (exponential size)formulation of the problem as a Markov decision chain, while theother relaxations provide bounds and are efficiently computed. Wealso propose a priority-index heuristic scheduling policy fromthe solution to the first-order relaxation, where the indices aredefined in terms of optimal dual variables. In this way wepropose a policy and a suboptimality guarantee. We report resultsof computational experiments that suggest that the proposedheuristic policy is nearly optimal. Moreover, the second-orderrelaxation is found to provide strong bounds on the optimalvalue.

Programming and analysing measurement experiments using the PicoCricket system

The aim of this project is to get used to another kind of programming. Since now, I used very complex programming languages to develop applications or even to program microcontrollers, but PicoCricket system is the evidence that we don’t need so complex development tools to get functional devices. PicoCricket system is the clear example of simple programming to make devices work the way we programmed it. There’s an easy but effective way to program small, devices just saying what we want them to do. We cannot do complex algorithms and mathematical operations but we can program them in a short time. Nowadays, the easier and faster we produce, the more we earn. So the tendency is to develop fast, cheap and easy, and PicoCricket system can do it.

Edelfosine-induced metabolic changes in cancer cells that precede the overproduction of reactive oxygen species and apoptosis

Background: Metabolic flux profiling based on the analysis of distribution of stable isotope tracer in metabolites is an important method widely used in cancer research to understand the regulation of cell metabolism and elaborate new therapeutic strategies. Recently, we developed software Isodyn, which extends the methodology of kinetic modeling to the analysis of isotopic isomer distribution for the evaluation of cellular metabolic flux profile under relevant conditions. This tool can be applied to reveal the metabolic effect of proapoptotic drug edelfosine in leukemia Jurkat cell line, uncovering the mechanisms of induction of apoptosis in cancer cells. Results: The study of 13C distribution of Jukat cells exposed to low edelfosine concentration, which induces apoptosis in ¿5% of cells, revealed metabolic changes previous to the development of apoptotic program. Specifically, it was found that low dose of edelfosine stimulates the TCA cycle. These metabolic perturbations were coupled with an increase of nucleic acid synthesis de novo, which indicates acceleration of biosynthetic and reparative processes. The further increase of the TCA cycle fluxes, when higher doses of drug applied, eventually enhance reactive oxygen species (ROS) production and trigger apoptotic program. Conclusion: The application of Isodyn to the analysis of mechanism of edelfosine-induced apoptosis revealed primary drug-induced metabolic changes, which are important for the subsequent initiation of apoptotic program. Initiation of such metabolic changes could be exploited in anticancer therapy.

Bistability of mitochondrial respiration underlies paradoxical reactive oxygen species generation induced by anoxia

Increased production of reactive oxygen species (ROS) in mitochondria underlies major systemic diseases, and this clinical problem stimulates a great scientific interest in the mechanism of ROS generation. However, the mechanism of hypoxia-induced change in ROS production is not fully understood. To mathematically analyze this mechanism in details, taking into consideration all the possible redox states formed in the process of electron transport, even for respiratory complex III, a system of hundreds of differential equations must be constructed. Aimed to facilitate such tasks, we developed a new methodology of modeling, which resides in the automated construction of large sets of differential equations. The detailed modeling of electron transport in mitochondria allowed for the identification of two steady state modes of operation (bistability) of respiratory complex III at the same microenvironmental conditions. Various perturbations could induce the transition of respiratory chain from one steady state to another. While normally complex III is in a low ROS producing mode, temporal anoxia could switch it to a high ROS producing state, which persists after the return to normal oxygen supply. This prediction, which we qualitatively validated experimentally, explains the mechanism of anoxia-induced cell damage. Recognition of bistability of complex III operation may enable novel therapeutic strategies for oxidative stress and our method of modeling could be widely used in systems biology studies.

Inertial effects on reactive particles advected by turbulence

We study the problem of the advection of passive particles with inertia in a two-dimensional, synthetic, and stationary turbulent flow. The asymptotic analytical result and numerical simulations show the importance of inertial bias in collecting the particles preferentially in certain regions of the flow, depending on their density relative to that of the flow. We also study how these aggregates are affected when a simple chemical reaction mechanism is introduced through a Eulerian scheme. We find that inertia can be responsible for maintaining a stationary concentration pattern even under nonfavorable reactive conditions or destroying it under favorable ones.

Inertial effects on reactive particles advected by turbulence

We study the problem of the advection of passive particles with inertia in a two-dimensional, synthetic, and stationary turbulent flow. The asymptotic analytical result and numerical simulations show the importance of inertial bias in collecting the particles preferentially in certain regions of the flow, depending on their density relative to that of the flow. We also study how these aggregates are affected when a simple chemical reaction mechanism is introduced through a Eulerian scheme. We find that inertia can be responsible for maintaining a stationary concentration pattern even under nonfavorable reactive conditions or destroying it under favorable ones.

Nonequilibrium patterns and shape fluctuations in reactive membranes

A simple kinetic model of a two-component deformable and reactive bilayer is presented. The two differently shaped components are interconverted by a nonequilibrium reaction, and a phenomenological coupling between local composition and curvature is proposed. When the two components are not miscible, linear stability analysis predicts, and numerical simulations show, the formation of stationary nonequilibrium composition/curvature patterns whose typical size is determined by the reactive process. For miscible components, a linearization of the dynamic equations is performed in order to evaluate the correlation function for shape fluctuations from which the behavior of these systems in micropipet aspiration experiments can be predicted.

Generation of dynamic structures in nonequilibrium reactive membranes

We present a nonequlibrium approach for the study of a flexible bilayer whose two components induce distinct curvatures. In turn, the two components are interconverted by an externally promoted reaction. Phase separation of the two species in the surface results in the growth of domains characterized by different local composition and curvature modulations. This domain growth is limited by the effective mixing due to the interconversion reaction, leading to a finite characteristic domain size. In addition to these effects, first introduced in our earlier work [ Phys. Rev. E 71 051906 (2005)], the important new feature is the assumption that the reactive process actively affects the local curvature of the bilayer. Specifically, we suggest that a force energetically activated by external sources causes a modification of the shape of the membrane at the reaction site. Our results show the appearance of a rich and robust dynamical phenomenology that includes the generation of traveling and/or oscillatory patterns. Linear stability analysis, amplitude equations, and numerical simulations of the model kinetic equations confirm the occurrence of these spatiotemporal behaviors in nonequilibrium reactive bilayers.

Traveling waves and nonequilibrium stationary patterns in two-component reactive Langmuir monolayers

A simple kinetic model of a two-component phase-separating Langmuir monolayer with a chemical reaction is proposed. Its analysis and numerical simulations show that nonequilibrium periodic stationary structures and patterns of traveling stripes can spontaneously develop. The nonequilibrium phase diagram of this system is constructed and the properties of the patterns are discussed.

Edelfosine-induced metabolic changes in cancer cells that precede the overproduction of reactive oxygen species and apoptosis

Background: Metabolic flux profiling based on the analysis of distribution of stable isotope tracer in metabolites is an important method widely used in cancer research to understand the regulation of cell metabolism and elaborate new therapeutic strategies. Recently, we developed software Isodyn, which extends the methodology of kinetic modeling to the analysis of isotopic isomer distribution for the evaluation of cellular metabolic flux profile under relevant conditions. This tool can be applied to reveal the metabolic effect of proapoptotic drug edelfosine in leukemia Jurkat cell line, uncovering the mechanisms of induction of apoptosis in cancer cells. Results: The study of 13C distribution of Jukat cells exposed to low edelfosine concentration, which induces apoptosis in ¿5% of cells, revealed metabolic changes previous to the development of apoptotic program. Specifically, it was found that low dose of edelfosine stimulates the TCA cycle. These metabolic perturbations were coupled with an increase of nucleic acid synthesis de novo, which indicates acceleration of biosynthetic and reparative processes. The further increase of the TCA cycle fluxes, when higher doses of drug applied, eventually enhance reactive oxygen species (ROS) production and trigger apoptotic program. Conclusion: The application of Isodyn to the analysis of mechanism of edelfosine-induced apoptosis revealed primary drug-induced metabolic changes, which are important for the subsequent initiation of apoptotic program. Initiation of such metabolic changes could be exploited in anticancer therapy.

Contribution of microbial and invertebrate communities to leaf litter colonization in a Mediterranean stream

Leaf litter inputs and retention play an important role in ecosystem functioning in forested streams. We examined colonization of leaves by microbes (bacteria, fungi, and protozoa) and fauna in Fuirosos, an intermittent forested Mediterranean stream. Black poplar (Populus nigra) and plane (Platanus acerifolia) leaf packs were placed in the stream for 4 mo. We measured the biomasses and calculated the densities of bacteria, fungi, protozoa, meiofauna, and macroinvertebrates to determine their dynamics and potential interactions throughout the colonization process. Colonization was strongly correlated with hydrological variability (defined mainly by water temperature and discharge). The 1st week of colonization was characterized by hydrological stability and warm water temperatures, and allocation of C from microbial to invertebrate compartments on the leaf packs was rapid. Clumps of fine particulate organic matter (FPOM) were retained by the leaf packs, and enhanced rapid colonization by microfauna and meiofaunal collector-gatherers (ostracods and copepods). After 2 wk, an autumnal flood caused a 20-fold increase in water flow. Higher discharge and lower water temperature caused FPOM-related fauna to drift away from the packs and modified the subsequent colonization sequence. Fungi showed the highest biomass, with similar values to those recorded at the beginning of the experiment. After 70 d of postflood colonization, fungi decreased to nearly 40% of the total C in the leaf packs, whereas invertebrates became more abundant and accounted for 60% of the C. Natural flood occurrence in Mediterranean streams could be a key factor in the colonization and processing of organic matter.

Effects of riparian vegetation removal on nutrient retention in a Mediterranean stream

We examined the effects of riparian vegetation removal on algal dynamics and stream nutrient retention efficiency by comparing NH4-N and PO4-P uptake lengths from a logged and an unlogged reach in Riera Major, a forested Mediterranean stream in northeastern Spain. From June to September 1995, we executed 6 short-term additions of N (as NH4Cl) and P (as Na2HPO4) in a 200-m section to measure nutrient uptake lengths. The study site included 2 clearly differentiated reaches in terms of canopy cover by riparian trees: the first 100 m were completely logged (i.e., the logged reach) and the remaining 100 m were left intact (i.e., the shaded reach). Trees were removed from the banks of the logged reach in the winter previous to our sampling. In the shaded reach, riparian vegetation was dominated by alders (Alnus glutinosa). The study was conducted during summer and fall months when differences in light availability between the 2 reaches were greatest because of forest canopy conditions. Algal biomass and % of stream surface covered by algae were higher in the logged than in the shaded reach, indicating that logging had a stimulatory effect on algae in the stream. Overall, nutrient retention efficiency was higher (i.e., shorter uptake lengths) in the logged than in the shaded reach, especially for PO4-P. Despite a greater increase in PO4-P retention efficiency relative to that of NH4-N following logging, retention efficiency for NH4-N was higher than for PO4-P in both study reaches. The PO4-P mass-transfer coefficient was correlated with primary production in both study reaches, indicating that algal activity plays an important role in controlling PO4-P dynamics in this stream. In contrast, the NH4-N mass-transfer coefficient showed a positive relation-ship only with % of algal coverage in the logged reach, and was not correlated with any algal-related parameter in the shaded reach. The lack of correlation with algal production suggests that mechanisms other than algal activity (i.e., microbial heterotrophic processes or abiotic mechanisms) may also influence NH4-N retention in this stream. Overall, this study shows that logging disturbances in small shaded streams may alter in-stream ecological features that lead to changes in stream nutrient retention efficiency. Moreover, it emphasizes that alteration of the tight linkage between the stream channel and the adjacent riparian zone may directly and indirectly impact biogeochemical processes with implications for stream ecosystem functioning.