Solving MDPs using two-timescale simulated annealing with multiplicative weights

We develop extensions of the Simulated Annealing with Multiplicative Weights (SAMW) algorithm that proposed a method of solution of Finite-Horizon Markov Decision Processes (FH-MDPs). The extensions developed are in three directions: a) Use of the dynamic programming principle in the policy update step of SAMW b) A two-timescale actor-critic algorithm that uses simulated transitions alone, and c) Extending the algorithm to the infinite-horizon discounted-reward scenario. In particular, a) reduces the storage required from exponential to linear in the number of actions per stage-state pair. On the faster timescale, a 'critic' recursion performs policy evaluation while on the slower timescale an 'actor' recursion performs policy improvement using SAMW. We give a proof outlining convergence w.p. 1 and show experimental results on two settings: semiconductor fabrication and flow control in communication networks.

Analysis of dynamics and mechanism of ligand binding to Artocarpus integrifolia agglutinin. A 13C and 19F NMR study

Binding of 13C-labeled N-acetylgalactosamine (13C-GalNAc) and N-trifluoroacetylgalactosamine (19F-GalNAc) to Artocarpus integrifolia agglutinin has been studied using 13C and 19F nuclear magnetic resonance spectroscopy, respectively. Binding of these saccharides resulted in broadening of the resonances, and no change in chemical shift was observed, suggesting that the alpha- and beta-anomers of 13C-GalNAc and 19F-GalNAc experience a magnetically equivalent environment in the lectin combining site. The alpha- and beta-anomers of 13C-GalNAc and 19F-GalNAc were found to be in slow exchange between free and protein bound states. Binding of 13C-GalNAc was studied as a function of temperature. From the temperature dependence of the line broadening, the thermodynamic and kinetic parameters were evaluated. The association rate constants obtained for the alpha-anomers of 13C-GalNAc and 19F-GalNAc (k+1 = 1.01 x 10(5) M-1.s-1 and 0.698 x 10(5) M-1.s-1, respectively) are in close agreement with those obtained for the corresponding beta-anomers (k+1 = 0.95 x 10(5) M-1.s-1 and 0.65 x 10(5) M-1.s-1, respectively), suggesting that the two anomers bind to the lectin by a similar mechanism. In addition these values are several orders of magnitude slower than those obtained for diffusion controlled processes. The dissociation rate constants obtained are 49.9, 56.9, 42, and 43 s-1, respectively, for the alpha- and beta-anomers of 13C-GalNAc and 19F-GalNAc. A two-step mechanism has been proposed for the interaction of 13C-GalNAc and 19F-GalNAc with A. integrifolia lectin in view of the slow association rates and high activation entropies. The thermodynamic parameters obtained for the association and dissociation reactions suggest that the binding process is entropically favored and that there is a small enthalpic contribution.

Search for Higgs bosons predicted in two-Higgs-doublet models via decays to tau lepton pairs in 1.96 TeV proton-antiproton collisions

We present the results of a search for Higgs bosons predicted in two-Higgs-doublet models, in the case where the Higgs bosons decay to tau lepton pairs, using 1.8 inverse fb of integrated luminosity of proton-antiproton collisions recorded by the CDF II experiment at the Fermilab Tevatron. Studying the observed mass distribution in events where one or both tau leptons decay leptonically, no evidence for a Higgs boson signal is observed. The result is used to infer exclusion limits in the two-dimensional parameter space of tan beta versus m(A).

Search for Higgs bosons predicted in two-Higgs-doublet models via decays to tau lepton pairs in 1.96 TeV proton-antiproton collisions

We present the results of a search for Higgs bosons predicted in two-Higgs-doublet models, in the case where the Higgs bosons decay to tau lepton pairs, using 1.8 inverse fb of integrated luminosity of proton-antiproton collisions recorded by the CDF II experiment at the Fermilab Tevatron. Studying the observed mass distribution in events where one or both tau leptons decay leptonically, no evidence for a Higgs boson signal is observed. The result is used to infer exclusion limits in the two-dimensional parameter space of tan beta versus m(A).

Secondary flow induced by the rotation of two concentric spheres about their common diameter in micropolar fluids

In this paper, we have studied the secondary flow induced in a micropolar fluid by the rotation of two concentric spheres about a fixed diameter. The secondary flow exhibits behaviour commonly observed in visco-elastic fluids. In particular we have obtained the expressions for microrotation vector. Numerical results have been obtained for a number of values of relative rotations of the two spheres for a chosen set of values of fluid parameters. The results are presented graphically and compared with the previous investigations.

Data integration from two microarray platforms identifies bi-allelic genetic inactivation of RIC8A in a breast cancer cell line

Background: Using array comparative genomic hybridization (aCGH), a large number of deleted genomic regions have been identified in human cancers. However, subsequent efforts to identify target genes selected for inactivation in these regions have often been challenging. Methods: We integrated here genome-wide copy number data with gene expression data and non-sense mediated mRNA decay rates in breast cancer cell lines to prioritize gene candidates that are likely to be tumour suppressor genes inactivated by bi-allelic genetic events. The candidates were sequenced to identify potential mutations. Results: This integrated genomic approach led to the identification of RIC8A at 11p15 as a putative candidate target gene for the genomic deletion in the ZR-75-1 breast cancer cell line. We identified a truncating mutation in this cell line, leading to loss of expression and rapid decay of the transcript. We screened 127 breast cancers for RIC8A mutations, but did not find any pathogenic mutations. No promoter hypermethylation in these tumours was detected either. However, analysis of gene expression data from breast tumours identified a small group of aggressive tumours that displayed low levels of RIC8A transcripts. qRT-PCR analysis of 38 breast tumours showed a strong association between low RIC8A expression and the presence of TP53 mutations (P = 0.006). Conclusion: We demonstrate a data integration strategy leading to the identification of RIC8A as a gene undergoing a classical double-hit genetic inactivation in a breast cancer cell line, as well as in vivo evidence of loss of RIC8A expression in a subgroup of aggressive TP53 mutant breast cancers.

Spectroscopy of tissue triglyceride composition : In vitro and in vivo studies

Lipid analysis is commonly performed by gas chromatography (GC) in laboratory conditions. Spectroscopic techniques, however, are non-destructive and can be implemented noninvasively in vivo. Excess fat (triglycerides) in visceral adipose tissue and liver is known predispose to metabolic abnormalities, collectively known as the metabolic syndrome. Insulin resistance is the likely cause with diets high in saturated fat known to impair insulin sensitivity. Tissue triglyceride composition has been used as marker of dietary intake but it can also be influenced by tissue specific handling of fatty acids. Recent studies have shown that adipocyte insulin sensitivity correlates positively with their saturated fat content, contradicting the common view of dietary effects. A better understanding of factors affecting tissue triglyceride composition is needed to provide further insights into tissue function in lipid metabolism. In this thesis two spectroscopic techniques were developed for in vitro and in vivo analysis of tissue triglyceride composition. In vitro studies (Study I) used infrared spectroscopy (FTIR), a fast and cost effective analytical technique well suited for multivariate analysis. Infrared spectra are characterized by peak overlap leading to poorly resolved absorbances and limited analytical performance. In vivo studies (Studies II, III and IV) used proton magnetic resonance spectroscopy (1H-MRS), an established non-invasive clinical method for measuring metabolites in vivo. 1H-MRS has been limited in its ability to analyze triglyceride composition due to poorly resolved resonances. Using an attenuated total reflection accessory, we were able to obtain pure triglyceride infrared spectra from adipose tissue biopsies. Using multivariate curve resolution (MCR), we were able to resolve the overlapping double bond absorbances of monounsaturated fat and polyunsaturated fat. MCR also resolved the isolated trans double bond and conjugated linoleic acids from an overlapping background absorbance. Using oil phantoms to study the effects of different fatty acid compositions on the echo time behaviour of triglycerides, it was concluded that the use of long echo times improved peak separation with T2 weighting having a negligible impact. It was also discovered that the echo time behaviour of the methyl resonance of omega-3 fats differed from other fats due to characteristic J-coupling. This novel insight could be used to detect omega-3 fats in human adipose tissue in vivo at very long echo times (TE = 470 and 540 ms). A comparison of 1H-MRS of adipose tissue in vivo and GC of adipose tissue biopsies in humans showed that long TE spectra resulted in improved peak fitting and better correlations with GC data. The study also showed that calculation of fatty acid fractions from 1H-MRS data is unreliable and should not be used. Omega-3 fatty acid content derived from long TE in vivo spectra (TE = 540 ms) correlated with total omega-3 fatty acid concentration measured by GC. The long TE protocol used for adipose tissue studies was subsequently extended to the analysis of liver fat composition. Respiratory triggering and long TE resulted in spectra with the olefinic and tissue water resonances resolved. Conversion of the derived unsaturation to double bond content per fatty acid showed that the results were in accordance with previously published gas chromatography data on liver fat composition. In patients with metabolic syndrome, liver fat was found to be more saturated than subcutaneous or visceral adipose tissue. The higher saturation observed in liver fat may be a result of a higher rate of de-novo-lipogenesis in liver than in adipose tissue. This thesis has introduced the first non-invasive method for determining adipose tissue omega-3 fatty acid content in humans in vivo. The methods introduced here have also shown that liver fat is more saturated than adipose tissue fat.

Two ex situ fungal technologies to treat contaminated soil

Wood-degrading fungi are able to degrade a large range of recalcitrant pollutants which resemble the lignin biopolymer. This ability is attributed to the production of lignin-modifying enzymes, which are extracellular and non-specific. Despite the potential of fungi in bioremediation, there is still an understanding gap in terms of the technology. In this thesis, the feasibility of two ex situ fungal bioremediation methods to treat contaminated soil was evaluated. Treatment of polycyclic aromatic hydrocarbons (PAHs)-contaminated marsh soil was studied in a stirred slurry-phase reactor. Due to the salt content in marsh soil, fungi were screened for their halotolerance, and the white-rot fungi Lentinus tigrinus, Irpex lacteus and Bjerkandera adusta were selected for further studies. These fungi degraded 40 - 60% of a PAH mixture (phenanthrene, fluoranthene, pyrene and chrysene) in a slurry-phase reactor (100 ml) during 30 days of incubation. Thereafter, B. adusta was selected to scale-up and optimize the process in a 5 L reactor. Maximum degradation of dibenzothiophene (93%), fluoranthene (82%), pyrene (81%) and chrysene (83%) was achieved with the free mycelium inoculum of the highest initial biomass (2.2 g/l). In autoclaved soil, MnP was the most important enzyme involved in PAH degradation. In non-sterile soil, endogenous soil microbes together with B. adusta also degraded the PAHs extensively, suggesting a synergic action between soil microbes and the fungus. A fungal solid-phase cultivation method to pretreat contaminated sawmill soil with high organic matter content was developed to enhance the effectiveness of the subsequent soil combustion. In a preliminary screening of 146 fungal strains, 28 out of 52 fungi, which extensively colonized non-sterile contaminated soil, were litter-decomposing fungi. The 18 strains further selected were characterized by their production of lignin-modifying and hydrolytic enzymes, of which MnP and endo-1,4-β-glucanase were the main enzymes during cultivation on Scots pine (Pinus sylvestris) bark. Of the six fungi selected for further tests, Gymnopilus luteofolius, Phanerochaete velutina, and Stropharia rugosoannulata were the most active soil organic matter degraders. The results showed that a six-month pretreatment of sawmill soil would result in a 3.5 - 9.5% loss of organic matter, depending on the fungus applied. The pretreatment process was scaled-up for a 0.56 m3 reactor, in which perforated plastic tubes filled with S. rugosoannulata growing on pine bark were introduced into the soil. The fungal pretreatment resulted in a soil mass loss of 30.5 kg, which represents 10% of the original soil mass (308 kg). Despite the fact that Scots pine bark contains several antimicrobial compounds, it was a suitable substrate for fungal growth and promoter of the production of oxidative enzymes, as well as an excellent and cheap natural carrier of fungal mycelium. This thesis successfully developed two novel fungal ex situ bioremediation technologies and introduce new insights for their further full-scale application. Ex situ slurry-phase fungal reactors might be applied in cases when the soil has a high water content or when the contaminant bioavailability is low; for example, in wastewater treatment plants to remove pharmaceutical residues. Fungal solid-phase bioremediation is a promising remediation technology to ex situ or in situ treat contaminated soil.

Two-stream instability in plasma

The problem of two-stream instability in plasma is studied by specifying the importance of initial magnetic field associated with the motion of the charged particles and the boundary effects. In Part I the accurate initial steady state is studied when the streams of electrons and ions move with different uniform speeds in plasmas with plane and cylindrical geometry. In Part II, in order to show the effects of finiteness and inhomogeneity of the system, small transverse plasma oscillations are studied in the case of plane plasmas. The role of plasma-sheath oscillations at the boundaries is found to be very important in driving the instabilities associated with the electromagnetic modes. The numerical estimates of the growth rates of the instability are given for the specific case of the physical data in discharge tubes.

Search for a Higgs Boson Decaying to Two W Bosons at CDF

We present a search for a Higgs boson decaying to two W bosons in ppbar collisions at sqrt(s)=1.96 TeV center-of-mass energy. The data sample corresponds to an integrated luminosity of 3.0 fb-1 collected with the CDF II detector. We find no evidence for production of a Higgs boson with mass between 110 and 200 GeV/c^2, and determine upper limits on the production cross section. For the mass of 160 GeV/c^2, where the analysis is most sensitive, the observed (expected) limit is 0.7 pb (0.9 pb) at 95% Bayesian credibility level which is 1.7 (2.2) times the standard model cross section.