Optimistic linear programming gives logarithmic regret for irreducible MDPs

We present an algorithm called Optimistic Linear Programming (OLP) for learning to optimize average reward in an irreducible but otherwise unknown Markov decision process (MDP). OLP uses its experience so far to estimate the MDP. It chooses actions by optimistically maximizing estimated future rewards over a set of next-state transition probabilities that are close to the estimates, a computation that corresponds to solving linear programs. We show that the total expected reward obtained by OLP up to time T is within C(P) log T of the reward obtained by the optimal policy, where C(P) is an explicit, MDP-dependent constant. OLP is closely related to an algorithm proposed by Burnetas and Katehakis with four key differences: OLP is simpler, it does not require knowledge of the supports of transition probabilities, the proof of the regret bound is simpler, but our regret bound is a constant factor larger than the regret of their algorithm. OLP is also similar in flavor to an algorithm recently proposed by Auer and Ortner. But OLP is simpler and its regret bound has a better dependence on the size of the MDP.

High-probability regret bounds for bandit online linear optimization

We present a modification of the algorithm of Dani et al. [8] for the online linear optimization problem in the bandit setting, which with high probability has regret at most O ∗ ( √ T) against an adaptive adversary. This improves on the previous algorithm [8] whose regret is bounded in expectation against an oblivious adversary. We obtain the same dependence on the dimension (n 3/2) as that exhibited by Dani et al. The results of this paper rest firmly on those of [8] and the remarkable technique of Auer et al. [2] for obtaining high probability bounds via optimistic estimates. This paper answers an open question: it eliminates the gap between the high-probability bounds obtained in the full-information vs bandit settings.

Cloning and characterization of a novel human gene related to vascular endothelial growth factor

This paper describes the cloning and characterization of a new member of the vascular endothelial growth factor (VEGF) gene family, which we have designated VRF for VEGF-related-factor. Sequencing of cDNAs from a human fetal brain library and RT-PCR products from normal and tumor tissue cDNA pools indicate two alternatively spliced messages with open reading frames of 621 and 564 bp, respectively. The predicted proteins differ at their carboxyl ends resulting from a shift in the open reading frame. Both isoforms show strong homology to VEGF at their amino termini, but only the shorter isoform maintains homology to VEGF at its carboxyl terminus and conserves all 16 cysteine residues of VEGF165. Similarity comparisons of this isoform revealed overall protein identity of 48% and conservative substitution of 69% with VEGF189. VRF is predicted to contain a signal peptide, suggesting that it may be a secreted factor. The VRF gene maps to the D11S750 locus at chromosome band 11q13, and the protein coding region, spanning approximately 5 kb, is comprised of 8 exons that range in size from 36 to 431 bp. Exons 6 and 7 are contiguous and the two isoforms of VRF arise through alternate splicing of exon 6. VRF appears to be ubiquitously expressed as two transcripts of 2.0 and 5.5 kb; the level of expression is similar among normal and malignant tissues.

Targeting mutant fibroblast growth factor receptors in cancer

Fibroblast growth factor receptors (FGFRs) play diverse roles in the control of cell proliferation, cell differentiation, angiogenesis and development. Activating the mutations of FGFRs in the germline has long been known to cause a variety of skeletal developmental disorders, but it is only recently that a similar spectrum of somatic FGFR mutations has been associated with human cancers. Many of these somatic mutations are gain-of-function and oncogenic and create dependencies in tumor cell lines harboring such mutations. A combination of knockdown studies and pharmaceutical inhibition in preclinical models has further substantiated genomically altered FGFR as a therapeutic target in cancer, and the oncology community is responding with clinical trials evaluating multikinase inhibitors with anti-FGFR activity and a new generation of specific pan-FGFR inhibitors.

Linear models for endocytic transformations from live cell imaging

Endocytosis is the process by which cells internalise molecules including nutrient proteins from the extracellular media. In one form, macropinocytosis, the membrane at the cell surface ruffles and folds over to give rise to an internalised vesicle. Negatively charged phospholipids within the membrane called phosphoinositides then undergo a series of transformations that are critical for the correct trafficking of the vesicle within the cell, and which are often pirated by pathogens such as Salmonella. Advanced fluorescent video microscopy imaging now allows the detailed observation and quantification of these events in live cells over time. Here we use these observations as a basis for building differential equation models of the transformations. An initial investigation of these interactions was modelled with reaction rates proportional to the sum of the concentrations of the individual constituents. A first order linear system for the concentrations results. The structure of the system enables analytical expressions to be obtained and the problem becomes one of determining the reaction rates which generate the observed data plots. We present results with reaction rates which capture the general behaviour of the reactions so that we now have a complete mathematical model of phosphoinositide transformations that fits the experimental observations. Some excellent fits are obtained with modulated exponential functions; however, these are not solutions of the linear system. The question arises as to how the model may be modified to obtain a system whose solution provides a more accurate fit.

Vertical growth and resonator properties of hexagonally shaped zinc oxide nanonails

We synthesized vertically aligned nail-shaped ZnO nanocrystal arrays on silicon substrates via a combination of a carbothermal reduction method and textured ZnO seeding layers that were precoated on silicon substrates by thermally decomposing zinc acetate, and studied their optical properties using cathodoluminescence (CL) and photoluminescence techniques. The ZnO nanonails show a sharp band-gap edge UV emission and a defect-related broad green emission. Monochromatic CL images of an individual ZnO nanonail show variations in spatial distributions of respective CL bands that had different origins. We attribute the spatial variation of CL images to an uneven distribution of luminescent defects and/or a structure-related light out-coupling from hexagonal ZnO nanostructures. The most distinct CL feature from the hexagonal head of an individual ZnO nanonail was the occurrence of a series of distinct resonant peaks within the visible wavelength range. It appeared that the head of a nanonail played the role of a hexagonal cavity so that polarizationdependent whispering gallery modes were stimulated by electron beam excitation.

Catalyst-free growth and optical properties of vertically aligned ZnO Nanorod Arrays on Si substrates covered with thin buffer layers

Vertically aligned ZnO nanorods have been grown on silicon substrates pre-coated with thin, less than 10 nm, textured ZnO seeding layers via a vapor-solid mechanism. The ZnO seeding layers, which were essential for vertical alignment of ZnO nanorods without using any metal catalyst, were prepared by decomposing zinc acetate. The structure and the luminescence properties of the ZnO nanorods synthesized onto ZnO seeding layers were investigated and their morphologies were compared with those of single-crystalline GaN substrates and silicon substrates covered with sputtered ZnO flms. Patterning of ZnO seed layers using photolithography allowed the fabrication of patterned ZnO-nanorod arrays.

Development of a high-level gene expression system for the production of bioplastics in sugarcane

Despite various approaches, the production of biodegradable plastics such as polyhydroxybutyrate (PHB) in transgenic plants has met with limited success due largely to low expression levels. Even in the few instances where high levels of protein expression have been reported, the transgenic plants have been stunted indicating PHB is phytotoxic (Poirier 2002). This PhD describes the application of a novel virus-based gene expression technology, termed InPAct („In Plant Activation.), for the production of PHB in tobacco and sugarcane. InPAct is based on the rolling circle replication mechanism by which circular ssDNA viruses replicate and provides a system for controlled, high-level gene expression. Based on these features, InPAct was thought to represent an ideal system to enable the controlled, high-level expression of the three phb genes (phbA, phbB and phbC) required for PHB production in sugarcane at a preferred stage of plant growth. A Tobacco yellow dwarf virus (TbYDV)-based InPAct-phbA vector, as well as linear vectors constitutively expressing phbB and phbC were constructed and different combinations were used to transform tobacco leaf discs. A total of four, eight, three and three phenotypically normal tobacco lines were generated from discs transformed with InPAct-phbA, InPAct-phbA + p1300-TaBV P-phbB/phbC- 35S T, p1300-35S P-phbA-NOS T + p1300-TaBV P-phbB/phbC-35S T and InPAct-GUS, respectively. To determine whether the InPAct cassette could be activated in the presence of the TbYDV Rep, leaf samples from the eight InPActphbA + p1300-TaBV P-phbB/phbC-35S T plants were agroinfiltrated with p1300- TbYDV-Rep/RepA. Three days later, successful activation was indicated by the detection of episomes using both PCR and Southern analysis. Leaf discs from the eight InPAct-phbA + p1300-TaBV P-phbB/phbC-35S T transgenic plant lines were agroinfiltrated with p1300-TbYDV-Rep/RepA and leaf tissue was collected ten days post-infiltration and examined for the presence of PHB granules. Confocal microscopy and TEM revealed the presence of typical PHB granules in five of the eight lines, thus demonstrating the functionality of InPActbased PHB production in tobacco. However, analysis of leaf extracts by HPLC failed to detect the presence of PHB suggesting only very low level expression levels. Subsequent molecular analysis of three lines revealed low levels of correctly processed mRNA from the catalase intron contained within the InPAct cassette and also the presence of cryptic splice sites within the intron. In an attempt to increase expression levels, new InPAct-phb cassettes were generated in which the castorbean catalase intron was replaced with a synthetic intron (syntron). Further, in an attempt to both increase and better control Rep/RepA-mediated activation of InPAct cassettes, Rep/RepA expression was placed under the control of a stably integrated alc switch. Leaf discs from a transgenic tobacco line (Alc ML) containing 35S P-AlcR-AlcA P-Rep/RepA were supertransformed with InPAct-phbAsyn or InPAct-GUSsyn using Agrobacterium and three plants (lines) were regenerated for each construct. Analysis of the RNA processing of the InPAct-phbAsyn cassette revealed highly efficient and correct splicing of the syntron, thus supporting its inclusion within the InPAct system. To determine the efficiency of the alc switch to activate InPAct, leaf material from the three Alc ML + InPAct-phbAsyn lines was either agroinfiltrated with 35S P-Rep/RepA or treated with ethanol. Unexpectedly, episomes were detected not only in the infiltrated and ethanol treated samples, but also in non-treated samples. Subsequent analysis of transgenic Alc ML + InPAct-GUS lines, confirmed that the alc switch was leaky in tissue culture. Although this was shown to be reversible once plants were removed from the tissue culture environment, it made the regeneration of Alc ML + InPAct-phbsyn plant lines extremely difficult, due to unintentional Rep expression and therefore high levels of phb expression and phytotoxic PHB production. Two Alc ML + InPAct-phbAsyn + p1300-TaBV P-phbB/phbC-35S T transgenic lines were able to be regenerated, and these were acclimatised, alcohol-treated and analysed. Although episome formation was detected as late as 21 days post activation, no PHB was detected in the leaves of any plants using either microscopy or HPLC, suggesting the presence of a corrupt InPAct-phbA cassette in both lines. The final component of this thesis involved the application of both the alc switch and the InPAct systems to sugarcane in an attempt to produce PHB. Initial experiments using transgenic Alc ML + InPAct-GUS lines indicated that the alc system was not functional in sugarcane under the conditions tested. The functionality of the InPAct system, independent of the alc gene switch, was subsequently examined by bombarding the 35S Rep/RepA cassette into leaf and immature leaf whorl cells derived from InPAct-GUS transgenic sugarcane plants. No GUS expression was observed in leaf tissue, whereas weak and irregular GUS expression was observed in immature leaf whorl tissue derived from two InPAct- GUS lines and two InPAct-GUS + 35S P-AlcR-AlcA P-GUS lines. The most plausible reason to explain the inconsistent and low levels of GUS expression in leaf whorls is a combination of low numbers of sugarcane cells in the DNA replication-conducive S-phase and the irregular and random nature of sugarcane cells bombarded with Rep/RepA. This study details the first report to develop a TbYDV-based InPAct system under control of the alc switch to produce PHB in tobacco and sugarcane. Despite the inability to detect quantifiable levels of PHB levels in either tobacco or sugarcane, the findings of this study should nevertheless assist in the further development of both the InPAct system and the alc system, particularly for sugarcane and ultimately lead to an ethanol-inducible InPAct gene expression system for the production of bioplastics and other proteins of commercial value in plants.

Hyaluronic acid : evaluation as a potential delivery vehicle for vitronectin:growth factor complexes in wound healing applications

We have previously reported that novel vitronectin:growth factor (VN:GF) complexes significantly increase re-epithelialization in a porcine deep dermal partial-thickness burn model. However, the potential exists to further enhance the healing response through combination with an appropriate delivery vehicle which facilitates sustained local release and reduced doses of VN:GF complexes. Hyaluronic acid (HA), an abundant constituent of the interstitium, is known to function as a reservoir for growth factors and other bioactive species. The physicochemical properties of HA confer it with an ability to sustain elevated pericellular concentrations of these species. This has been proposed to arise via HA prolonging interactions of the bioactive species with cell surface receptors and/or protecting them from degradation. In view of this, the potential of HA to facilitate the topical delivery of VN:GF complexes was evaluated. Two-dimensional (2D) monolayer cell cultures and 3D de-epidermised dermis (DED) human skin equivalent (HSE) models were used to test skin cell responses to HA and VN:GF complexes. Our 2D studies revealed that VN:GF complexes and HA stimulate the proliferation of human fibroblasts but not keratinocytes. Experiments in our 3D DED-HSE models showed that VN:GF complexes, both alone and in conjunction with HA, led to enhanced development of both the proliferative and differentiating layers in the DED-HSE models. However, there was no significant difference between the thicknesses of the epidermis treated with VN:GF complexes alone and VN:GF complexes together with HA. While the addition of HA did not enhance all the cellular responses to VN:GF complexes examined, it was not inhibitory, and may confer other advantages related to enhanced absorption and transport that could be beneficial in delivery of the VN:GF complexes to wounds.