Prediction with limited advice and multiarmed bandits with paid observations

We study two problems of online learning under restricted information access. In the first problem, prediction with limited advice, we consider a game of prediction with expert advice, where on each round of the game we query the advice of a subset of M out of N experts. We present an algorithm that achieves O(√(N/M)TlnN ) regret on T rounds of this game. The second problem, the multiarmed bandit with paid observations, is a variant of the adversarial N-armed bandit game, where on round t of the game we can observe the reward of any number of arms, but each observation has a cost c. We present an algorithm that achieves O((cNlnN) 1/3 T2/3+√TlnN ) regret on T rounds of this game in the worst case. Furthermore, we present a number of refinements that treat arm- and time-dependent observation costs and achieve lower regret under benign conditions. We present lower bounds that show that, apart from the logarithmic factors, the worst-case regret bounds cannot be improved.

Epidermal growth factor-induced epithelio-mesenchymal transition in human breast carcinoma cells

PMC42-LA cells display an epithelial phenotype: the cells congregate into pavement epithelial sheets in which E-cadherin and β-catenin are localized at cell-cell borders. They abundantly express cytokeratins, although 5% to 10% of the cells also express the mesenchymal marker vimentin. Stimulation of PMC42-LA cells with epidermal growth factor (EGF) leads to epithelio-mesenchymal transition-like changes including up-regulation of vimentin and down-regulation of E-cadherin. Vimentin expression is seen in virtually all cells, and this increase is abrogated by treatment of cells with an EGF receptor antagonist. The expression of the mesenchyme-associated extracellular matrix molecules fibronectin and chondroitin sulfate proteoglycan also increase in the presence of EGF. PMC42-LA cells adhere rapidly to collagen I, collagen IV, and laminin-1 substrates and markedly more slowly to fibronectin and vitronectin. EGF increases the speed of cell adhesion to most of these extracellular matrix molecules without altering the order of adhesive preference. EGF also caused a time-dependent increase in the motility of PMC42-LA cells, commensurate with the degree of vimentin staining. The increase in motility was at least partly chemokinetic, because it was evident both with and without chemoattractive stimuli. Although E-cadherin staining at cell-cell junctions disappeared in response to EGF, β-catenin persisted at the cell periphery. Further analysis revealed that N-cadherin was present at the cell-cell junctions of untreated cells and that expression was increased after EGF treatment. N- and E-cadherin are not usually coexpressed in human carcinoma cell lines but can be coexpressed in embryonic tissues, and this may signify an epithelial cell population prone to epithelio-mesenchymal-like responses.

Characterisation of the micro-architecture of direct writing melt electrospun tissue engineering scaffolds using diffusion tensor and computed tomography microimaging

This article describes the first steps toward comprehensive characterization of molecular transport within scaffolds for tissue engineering. The scaffolds were fabricated using a novel melt electrospinning technique capable of constructing 3D lattices of layered polymer fibers with well - defined internal microarchitectures. The general morphology and structure order was then determined using T 2 - weighted magnetic resonance imaging and X - ray microcomputed tomography. Diffusion tensor microimaging was used to measure the time - dependent diffusivity and diffusion anisotropy within the scaffolds. The measured diffusion tensors were anisotropic and consistent with the cross - hatched geometry of the scaffolds: diffusion was least restricted in the direction perpendicular to the fiber layers. The results demonstrate that the cross - hatched scaffold structure preferentially promotes molecular transport vertically through the layers ( z - axis), with more restricted diffusion in the directions of the fiber layers ( x – y plane). Diffusivity in the x – y plane was observed to be invariant to the fiber thickness. The characteristic pore size of the fiber scaffolds can be probed by sampling the diffusion tensor at multiple diffusion times. Prospective application of diffusion tensor imaging for the real - time monitoring of tissue maturation and nutrient transport pathways within tissue engineering scaffolds is discussed.

A linear-elastic model of anisotropic tumour growth

This paper examines the effect of anisotropic growth on the evolution of mechanical stresses in a linear-elastic model of a growing, avascular tumour. This represents an important improvement on previous linear-elastic models of tissue growth since it has been shown recently that spatially-varying isotropic growth of linear-elastic tissues does not afford the necessary stress-relaxation for a steady-state stress distribution upon reaching a nutrient-regulated equilibrium size. Time-dependent numerical solutions are developed using a Lax-Wendroff scheme, which show the evolution of the tissue stress distributions over a period of growth until a steady-state is reached. These results are compared with the steady-state solutions predicted by the model equations, and key parameters influencing these steady-state distributions are identified. Recommendations for further extensions and applications of this model are proposed.

Control of solar powered micro-grids using electric vehicles

Large scale solar plants are gaining recognition as potential energy sources for future. In this paper, the feasibility of using electric vehicles (EVs) to control a solar powered micro-grid is investigated in detail. The paper presents a PSCAD/EMTDC based model for the solar powered micro-grid with EVs. EVs are expected to have both the vehicle-to-grid (V2G) and grid-to-vehicle (G2V) capability, through which energy can either be injected into or extracted from the solar powered micro-grid to control its energy imbalance. Using the model, the behaviour of the micro-grid is investigated under a given load profile, and the results indicate that a minimum number of EVs are required to meet the energy imbalance and it is time dependent and influenced by various factors such as depth of charge, commuting profiles, reliability etc...

Genome-wide analysis in a murine Dnmt1 knockdown model identifies epigenetically silenced genes in primary human pituitary tumors

DNA methylation at promoter CpG islands (CGI) is an epigenetic modification associated with inappropriate gene silencing in multiple tumor types. In the absence of a human pituitary tumor cell line, small interfering RNA-mediated knockdown of the maintenance methyltransferase DNA methyltransferase (cytosine 5)-1 (Dnmt1) was used in the murine pituitary adenoma cell line AtT-20. Sustained knockdown induced reexpression of the fully methylated and normally imprinted gene neuronatin (Nnat) in a time-dependent manner. Combined bisulfite restriction analysis (COBRA) revealed that reexpression of Nnat was associated with partial CGI demethylation, which was also observed at the H19 differentially methylated region. Subsequent genome-wide microarray analysis identified 91 genes that were significantly differentially expressed in Dnmt1 knockdown cells (10% false discovery rate). The analysis showed that genes associated with the induction of apoptosis, signal transduction, and developmental processes were significantly overrepresented in this list (P < 0.05). Following validation by reverse transcription-PCR and detection of inappropriate CGI methylation by COBRA, four genes (ICAM1, NNAT, RUNX1, and S100A10) were analyzed in primary human pituitary tumors, each displaying significantly reduced mRNA levels relative to normal pituitary (P < 0.05). For two of these genes, NNAT and S100A10, decreased expression was associated with increased promoter CGI methylation. Induced expression of Nnat in stable transfected AtT-20 cells inhibited cell proliferation. To our knowledge, this is the first report of array-based "epigenetic unmasking" in combination with Dnmt1 knockdown and reveals the potential of this strategy toward identifying genes silenced by epigenetic mechanisms across species boundaries.

Modelling of a magnetocaloric system for cooling in the kilowatt range

A numerical time-dependent model of an active magnetic regenerator (AMR) was developed for cooling in the kilowatt range. Earlier numerical models have been mostly developed for cooling power in the 0.4 kW range. In contrast, this paper reports the applicability of magnetic refrigeration to the 50 kW range. A packed bed active magnetic regenerator was modelled and the influence of parameters such as geometry and operating parameters were studied for different geometries. The pressure drop for AMR bed length and particle diameter was also studied. High cooling power and coefficient of performance (COP) were achieved by optimization of the diameter of the magnetocaloric powder particles and operating frequency. The optimum operating conditions of the AMR for a cooling capacity of 50 kW was determined for a temperature span of 15 K. The predicted coefficient of performance (COP) was found to be ∼6, making it an attractive alternative to vapour compression systems.

Determination of urinary thymidine glycol using affinity chromatography, HPLC and post-column reaction detection : a biomarker of oxidative DNA damage upon kidney transplantation

Reactive oxygen species are generated during ischaemia-reperfusion of tissue. Oxidation of thymidine by hydroxyl radicals (HO) leads to the formation of 5,6-dihydroxy-5,6-dihydrothymidine (thymidine glycol). Thymidine glycol is excreted in urine and can be used as biomarker of oxidative DNA damage. Time dependent changes in urinary excretion rates of thymidine glycol were determined in six patients after kidney transplantation and in six healthy controls. A new analytical method was developed involving affinity chromatography and subsequent reverse-phase high-performance liquid chromatography (RP-HPLC) with a post-column chemical reaction detector and endpoint fluorescence detection. The detection limit of this fluorimetric assay was 1.6 ng thymidine glycol per ml urine, which corresponds to about half of the physiological excretion level in healthy control persons. After kidney transplantation the urinary excretion rate of thymidine glycol increased gradually reaching a maximum around 48 h. The excretion rate remained elevated until the end of the observation period of 10 days. Severe proteinuria with an excretion rate of up to 7.2 g of total protein per mmol creatinine was also observed immediately after transplantation and declined within the first 24 h of allograft function (0.35 + 0.26 g/mmol creatinine). The protein excretion pattern, based on separation of urinary proteins on sodium dodecyl sulphate-polyacrylamide gel electrophorosis (SDS-PAGE), as well as excretion of individual biomarker proteins, indicated nonselective glomerular and tubular damage. The increased excretion of thymidine glycol after kidney transplantation may be explained by ischaemia-reperfusion induced oxidative DNA damage of the transplanted kidney.

Accumulation of heme oxygenase-1 (HSP32) in Xenopus laevis A6 kidney epithelial cells treated with sodium arsenite, cadmium chloride or proteasomal inhibitors

The present study examined the effect of sodium arsenite, cadmium chloride, heat shock and the proteasomal inhibitors MG132, withaferin A and celastrol on heme oxygenase-1 (HO-1; also known as HSP32) accumulation in Xenopus laevis A6 kidney epithelial cells. Immunoblot analysis revealed that HO-1 accumulation was not induced by heat shock but was enhanced by sodium arsenite and cadmium chloride in a dose- and time-dependent fashion. Immunocytochemistry revealed that these metals induced HO-1 accumulation in a granular pattern primarily in the cytoplasm. Additionally, in 20% of the cells arsenite induced the formation of large HO-1-containing perinuclear structures. In cells recovering from sodium arsenite or cadmium chloride treatment, HO-1 accumulation initially increased to a maximum at 12h followed by a 50% reduction at 48 h. This initial increase in HO-1 levels was likely the result of new synthesis as it was inhibited by cycloheximide. Interestingly, treatment of cells with a mild heat shock enhanced HO-1 accumulation induced by low concentrations of sodium arsenite and cadmium chloride. Finally, we determined that HO-1 accumulation was induced in A6 cells by the proteasomal inhibitors, MG132, withaferin A and celastrol. An examination of heavy metal and proteasomal inhibitor-induced HO-1 accumulation in amphibians is of importance given the presence of toxic heavy metals in aquatic habitats.

Interventions to control nosocomial infections : study designs and statistical issues

There is a wide range of potential study designs for intervention studies to decrease nosocomial infections in hospitals. The analysis is complex due to competing events, clustering, multiple timescales and time-dependent period and intervention variables. This review considers the popular pre-post quasi-experimental design and compares it with randomized designs. Randomization can be done in several ways: randomization of the cluster [intensive care unit (ICU) or hospital] in a parallel design; randomization of the sequence in a cross-over design; and randomization of the time of intervention in a stepped-wedge design. We introduce each design in the context of nosocomial infections and discuss the designs with respect to the following key points: bias, control for nonintervention factors, and generalizability. Statistical issues are discussed. A pre-post-intervention design is often the only choice that will be informative for a retrospective analysis of an outbreak setting. It can be seen as a pilot study with further, more rigorous designs needed to establish causality. To yield internally valid results, randomization is needed. Generally, the first choice in terms of the internal validity should be a parallel cluster randomized trial. However, generalizability might be stronger in a stepped-wedge design because a wider range of ICU clinicians may be convinced to participate, especially if there are pilot studies with promising results. For analysis, the use of extended competing risk models is recommended.

The prolongation of length of stay because of Clostridium difficile infection

Background Clostridium difficile infection (CDI) possibly extends hospital length of stay (LOS); however, the current evidence does not account for the time-dependent bias, ie, when infection is incorrectly analyzed as a baseline covariate. The aim of this study was to determine whether CDI increases LOS after managing this bias. Methods We examined the estimated extra LOS because of CDI using a multistate model. Data from all persons hospitalized >48 hours over 4 years in a tertiary hospital in Australia were analyzed. Persons with health care-associated CDIs were identified. Cox proportional hazards models were applied together with multistate modeling. Results One hundred fifty-eight of 58,942 admissions examined had CDI. The mean extra LOS because of infection was 0.9 days (95% confidence interval: −1.8 to 3.6 days, P = .51) when a multistate model was applied. The hazard of discharge was lower in persons who had CDI (adjusted hazard ratio, 0.42; P < .001) when a Cox proportional hazard model was applied. Conclusion This study is the first to use multistate models to determine the extra LOS because of CDI. Results suggest CDI does not significantly contribute to hospital LOS, contradicting findings published elsewhere. Conversely, when methods prone to result in time-dependent bias were applied to the data, the hazard of discharge significantly increased. These findings contribute to discussion on methods used to evaluate LOS and health care-associated infections.

A new approach to estimating trends in chlamydia incidence

Objectives Directly measuring disease incidence in a population is difficult and not feasible to do routinely. We describe the development and application of a new method of estimating at a population level the number of incident genital chlamydia infections, and the corresponding incidence rates, by age and sex using routine surveillance data. Methods A Bayesian statistical approach was developed to calibrate the parameters of a decision-pathway tree against national data on numbers of notifications and tests conducted (2001-2013). Independent beta probability density functions were adopted for priors on the time-independent parameters; the shape parameters of these beta distributions were chosen to match prior estimates sourced from peer-reviewed literature or expert opinion. To best facilitate the calibration, multivariate Gaussian priors on (the logistic transforms of) the time-dependent parameters were adopted, using the Matérn covariance function to favour changes over consecutive years and across adjacent age cohorts. The model outcomes were validated by comparing them with other independent empirical epidemiological measures i.e. prevalence and incidence as reported by other studies. Results Model-based estimates suggest that the total number of people acquiring chlamydia per year in Australia has increased by ~120% over 12 years. Nationally, an estimated 356,000 people acquired chlamydia in 2013, which is 4.3 times the number of reported diagnoses. This corresponded to a chlamydia annual incidence estimate of 1.54% in 2013, increased from 0.81% in 2001 (~90% increase). Conclusions We developed a statistical method which uses routine surveillance (notifications and testing) data to produce estimates of the extent and trends in chlamydia incidence.

Facile dearomatisation of porphyrins using palladium-catalysed hydrazination: the 5,15-diiminoporphodimethenes and their redox products

The synthesis, electronic absorption and 1H NMR spectra of a suite of novel porphyrinoids derived from meso-bromoporphyrins by palladium-catalysed aminations using ethyl and tert-butylcarbazates are reported. Instead of the expected carbazate-substituted porphyrins, a facile oxidative dearomatisation of the porphyrin ring occurs in high yield, especially for the nickel(II) complexes, resulting in high yields of 5,15-diiminoporphodimethenes (DIPDs). The analogous zinc(II) and free base DIPDs were also characterised, the former by X-ray crystallography. The oxidation and reduction reactions of DIPDs and their precursor carbazate porphyrins were studied. Density Functional Theory (DFT) was used to calculate the optimised geometries and frontier molecular orbitals of DIPD Ni8c and bis(azocarboxylate) 19c, and Time Dependent DFT calculations allowed the prediction of electronic absorption spectra, whose characteristics corresponded well with those of the observed solution spectra. In the latter case, the calculated low-energy absorptions were unlike those of a typical porphyrin, due to the near-degeneracy of the highest filled frontier orbitals, and the wide energy separation between the unfilled orbitals. This feature was present in the observed spectrum.