Linear programming for large-scale Markov decision problems

We consider the problem of controlling a Markov decision process (MDP) with a large state space, so as to minimize average cost. Since it is intractable to compete with the optimal policy for large scale problems, we pursue the more modest goal of competing with a low-dimensional family of policies. We use the dual linear programming formulation of the MDP average cost problem, in which the variable is a stationary distribution over state-action pairs, and we consider a neighborhood of a low-dimensional subset of the set of stationary distributions (defined in terms of state-action features) as the comparison class. We propose a technique based on stochastic convex optimization and give bounds that show that the performance of our algorithm approaches the best achievable by any policy in the comparison class. Most importantly, this result depends on the size of the comparison class, but not on the size of the state space. Preliminary experiments show the effectiveness of the proposed algorithm in a queuing application.

Evolution of a ~2.7 Ga large igneous province: A volcanological, geochemical and geochronological study of the Agnew Greenstone Belt, and new regional correlations for the Kalgoorlie Terrane (Yilgarn Craton, Western Australia)

The thick package of ~2.7 Ga mafic and ultramafic lavas and intrusions preserved among the Neoarchean of the Kalgoorlie Terrene in Western Australia provides valuable insight into geological processes controlling the most prodigious episode of growth and preservation of juvenile continental crust in Earth’s history. Limited exposure of these rocks results in uncertainty about their age, physical and chemical characteristics, and stratigraphic relationships. This in turn prevents confident correlation of regional occurrences of mafic and ultramafic successions (both intrusive and extrusive) and hinders the interpretation of tectonic setting and magmatic evolution. A recent stratigraphic drilling program of the Neoarchean stratigraphy of the Agnew Greenstone Belt in Western Australia has provided continuous exposures through a c. 7 km thick sequence of mafic and ultramafic units. In this study, we present a volcanological, lithogeochemical and chronological study of the Agnew Greenstone Belt, and provide the first pre-2690 Ma regional correlation across the Kalgoorlie Terrane. The Agnew Greenstone Belt records ~30 m.y. of episodic ultramafic-mafic magmatism that includes two cycles, each defined by a komatiite that is overlain by units that become more evolved and contaminated with time. The sequence is divided into nine conformable packages, each consisting of stacked subaqueous lava flows and comagmatic intrusions, as well as two sills without associated extrusions. Lavas, with the exception of intercalations between two units, form a layer-cake stratigraphy and were likely erupted from a system of fissures tapping the same magma source. The komatiites are not contaminated by continental crust ([La/Sm]PM ~0.7) and are of the Al-undepleted Munro-type. Crustal contamination is evident in many units (Songvang Basalt, Never Can Tell Basalt, Redeemer Basalt, and Turrett Dolerite), as judged by [La/Sm]>1, negative Nb and Ti anomalies, and geochemical mixing trends towards felsic contaminants. Crystal fractionation was also significant, with early olivine and chromite (Mg#>65) followed by plagioclase and clinopyroxene removal (Mg<65), and in the most evolved case, titanomagnetite accumulation. Three new TIMS dates on granophyric zones of mafic sills and one ICP-MS date from an interflow felsic tuff are presented and used for regional stratigraphic correlation. Cycle I magmatism began at ~2720 Ma and ended ~2705 Ma, whereas cycle II began ~2705 Ma and ended at 2690.7±1.2 Ma. Regional correlations indicate the western Kalgoorlie Terrane consists of a remarkably similar stratigraphy that can be recognised at Agnew, Ora Banda and Coolgardie, whereas the eastern part of the terrane (e.g., Kambalda Domain) does not include cycle I, but correlates well with cycle II. This research supports an autochthonous model of greenstone formation, in which one large igneous province, represented by two complete cycles, is constructed on sialic crust. New stratigraphic correlations for the Kalgoorlie Terrane indicate that many units can be traced over distances >100 km, which has implications for exploration targeting for stratigraphically hosted ultramafic Ni and VMS deposits.

Visual analytics for large-scale bioinformatic data sets

Rapid advances in sequencing technologies (Next Generation Sequencing or NGS) have led to a vast increase in the quantity of bioinformatics data available, with this increasing scale presenting enormous challenges to researchers seeking to identify complex interactions. This paper is concerned with the domain of transcriptional regulation, and the use of visualisation to identify relationships between specific regulatory proteins (the transcription factors or TFs) and their associated target genes (TGs). We present preliminary work from an ongoing study which aims to determine the effectiveness of different visual representations and large scale displays in supporting discovery. Following an iterative process of implementation and evaluation, representations were tested by potential users in the bioinformatics domain to determine their efficacy, and to understand better the range of ad hoc practices among bioinformatics literate users. Results from two rounds of small scale user studies are considered with initial findings suggesting that bioinformaticians require richly detailed views of TF data, features to compare TF layouts between organisms quickly, and ways to keep track of interesting data points.

A highly efficient and consistent method for harvesting large volumes of high-titre lentiviral vectors

Lentiviral vectors pseudotyped with vesicular stomatitis virus glycoprotein (VSV-G) are emerging as the vectors of choice for in vitro and in vivo gene therapy studies. However, the current method for harvesting lentivectors relies upon ultracentrifugation at 50 000 g for 2 h. At this ultra-high speed, rotors currently in use generally have small volume capacity. Therefore, preparations of large volumes of high-titre vectors are time-consuming and laborious to perform. In the present study, viral vector supernatant harvests from vector-producing cells (VPCs) were pre-treated with various amounts of poly-L-lysine (PLL) and concentrated by low speed centrifugation. Optimal conditions were established when 0.005% of PLL (w/v) was added to vector supernatant harvests, followed by incubation for 30 min and centrifugation at 10 000 g for 2 h at 4 degreesC. Direct comparison with ultracentrifugation demonstrated that the new method consistently produced larger volumes (6 ml) of high-titre viral vector at 1 x 10(8) transduction unit (TU)/ml (from about 3000 ml of supernatant) in one round of concentration. Electron microscopic analysis showed that PLL/viral vector formed complexes, which probably facilitated easy precipitation at low-speed concentration (10 000 g), a speed which does not usually precipitate viral particles efficiently. Transfection of several cell lines in vitro and transduction in vivo in the liver with the lentivector/PLL complexes demonstrated efficient gene transfer without any significant signs of toxicity. These results suggest that the new method provides a convenient means for harvesting large volumes of high-titre lentivectors, facilitate gene therapy experiments in large animal or human gene therapy trials, in which large amounts of lentiviral vectors are a prerequisite.

Shape transition in very large germanium islands on Si(111)

Ge islands with areas up to hundreds of μm2 were grown on Si(111). These islands, grown above 750 °C and at a deposition rate of 1 monolayer/min, become decreasingly compact with increasing size and can have nonuniform cross sections with heights reaching over 500 nm. The largest islands are ramified, often comprising multiple discrete parts. X-rayphotoemission electron microscopy absorption maps show that the islands have a higher concentration of Ge at their centers, with more Si near the edges. We propose that the shape transformation is driven by strain relief at the island perimeters.

Exploring collaborative modeling of business processes on large interactive touch display walls - video

Analyzing and redesigning business processes is a complex task, which requires the collaboration of multiple actors. Current approaches focus on collaborative modeling workshops where process stakeholders verbally contribute their perspective on a process while modeling experts translate their contributions and integrate them into a model using traditional input devices. Limiting participants to verbal contributions not only affects the outcome of collaboration but also collaboration itself. We created CubeBPM – a system that allows groups of actors to interact with process models through a touch based interface on a large interactive touch display wall. We are currently in the process of conducting a study that aims at assessing the impact of CubeBPM on collaboration and modeling performance. Initial results presented in this paper indicate that the setting helped participants to become more active in collaboration.

Exploring collaborative modeling of business processes on large interactive touch display walls

Analyzing and redesigning business processes is a complex task, which requires the collaboration of multiple actors. Current approaches focus on collaborative modeling workshops where process stakeholders verbally contribute their perspective on a process while modeling experts translate their contributions and integrate them into a model using traditional input devices. Limiting participants to verbal contributions not only affects the outcome of collaboration but also collaboration itself. We created CubeBPM – a system that allows groups of actors to interact with process models through a touch based interface on a large interactive touch display wall. We are currently in the process of conducting a study that aims at assessing the impact of CubeBPM on collaboration and modeling performance. Initial results presented in this paper indicate that the setting helped participants to become more active in collaboration.

Towards collaborative modeling of business processes on large interactive touch display walls

Analyzing and redesigning business processes is a complex task, which requires the collaboration of multiple actors. Current approaches focus on workshops where process stakeholders together with modeling experts create a graphical visualization of a process in a model. Within these workshops, stakeholders are mostly limited to verbal contributions, which are integrated into a process model by a modeling expert using traditional input devices. This limitation negatively affects the collaboration outcome and also the perception of the collaboration itself. In order to overcome this problem we created CubeBPM – a system that allows groups of actors to interact with process models through a touch based interface on a large interactive touch display wall. Using this system for collaborative modeling, we expect to provide a more effective collaboration environment thus improving modeling performance and collaboration.

Destinations: 3 Large Cast Plays for Young People

This book is a collection of three large-cast plays written in response to a very specific problem. My work as a teacher of drama often required me to locate a script that would somehow miraculously work for a cast of unknown number and gender, and most likely uneven skills and enthusiasm, who I hadn’t even met yet. It’s a familiar dilemma for teachers and students of drama in education contexts, at whatever level you’re teaching. I’d first addressed this creative problem with scripts such as Gate 38 (2010). I had tried using scripts that already existed, but found they required such extensive editing to suit the parameters of cast and performance duration that I may as well have been writing them myself. Even in the setting of a closed studio, in altering these plays I felt I was bending the vision of the playwright, and certainly their narrative structure, out of shape. Everyone who’s attempted to stage a performance with a large cast of students in an educational setting knows it takes time to truly connect with a play, its social contexts, themes and characters. It also takes a lot of time to get on top of the practicalities of learning, rehearsing, directing and running a performance with young people. Often the curtain goes up on something unfinished and unstable. I was looking for ways to reduce the complexity of staging a script, while maintaining the potential of this process as a site of rich, enjoyable learning. Two of the plays (Duty Free and Please Be Seated) are comprised of multiple monologues, combined with music-driven ensemble sequences. The monologues enable individuals to develop and polish their own performances, work in small groups, and cut down on the laborious detail of directing naturalistic scenes based in character interaction. The third (Australian Drama) involves a lot of duologues, meaning that its rehearsal process can happily employ that mainstay of the drama classroom: small group work. There’s plenty of room to move in terms of gender-blind casting as well. Please be Seated is mainly young women. The scripts also contain ensemble-based interludes which are non-verbal, music driven, with a choreographic element. They have also springboarded further explorations in form. The ethical and aesthetic complexities of verbatim works; the interaction between music and theatre; and meta-concerns related to the performing of performance: ‘how can the act of acting ‘acted’. The narratives of all three of these plays are deliberately open, enabling the flexible casting and on-the hop editing that large-group, time-poor processes sometimes necessitate. Duty Free is about the overseas ‘adventures’ of young people. Please Be Seated is based in verbatim text about young people falling in and out of love. Australian Drama is about young people in a drama classroom trying to connect with each other and put their own shine on dull fragments of the theatrical canon. The plays were published as a collection in hardcopy and digital editions by Playlab Press in 2015. Please be Seated is a co-write with a large group. These co-author’s names are listed in the publication, and below in ‘additional information’.

Prediction of a large-gap quantum-spin-Hall insulator: Diamond-like GaBi bilayer

A quantum-spin-Hall (QSH) state was achieved experimentally, albeit at a low critical temperature because of the narrow band gap of the bulk material. Twodimensional topological insulators are critically important for realizing novel topological applications. Using density functional theory (DFT), we demonstrated that hydrogenated GaBi bilayers (HGaBi) form a stable topological insulator with a large nontrivial band gap of 0.320 eV, based on the state-of-the-art hybrid functional method, which is implementable for achieving QSH states at room temperature. The nontrivial topological property of the HGaBi lattice can also be confirmed from the appearance of gapless edge states in the nanoribbon structure. Our results provide a versatile platform for hosting nontrivial topological states usable for important nanoelectronic device applications.

A large-scale analysis of genetic variants within putative miRNA binding sites in prostate cancer

Prostate cancer is the second most common malignancy among men worldwide. Genome-wide association studies have identified 100 risk variants for prostate cancer, which can explain approximately 33% of the familial risk of the disease. We hypothesized that a comprehensive analysis of genetic variations found within the 3' untranslated region of genes predicted to affect miRNA binding (miRSNP) can identify additional prostate cancer risk variants. We investigated the association between 2,169 miRSNPs and prostate cancer risk in a large-scale analysis of 22,301 cases and 22,320 controls of European ancestry from 23 participating studies. Twenty-two miRSNPs were associated (P<2.3×10(-5)) with risk of prostate cancer, 10 of which were within 7 genes previously not mapped by GWAS studies. Further, using miRNA mimics and reporter gene assays, we showed that miR-3162-5p has specific affinity for the KLK3 rs1058205 miRSNP T-allele, whereas miR-370 has greater affinity for the VAMP8 rs1010 miRSNP A-allele, validating their functional role. SIGNIFICANCE Findings from this large association study suggest that a focus on miRSNPs, including functional evaluation, can identify candidate risk loci below currently accepted statistical levels of genome-wide significance. Studies of miRNAs and their interactions with SNPs could provide further insights into the mechanisms of prostate cancer risk.

Common SNPs explain a large proportion of the heritability for human height

SNPs discovered by genome-wide association studies (GWASs) account for only a small fraction of the genetic variation of complex traits in human populations. Where is the remaining heritability? We estimated the proportion of variance for human height explained by 294,831 SNPs genotyped on 3,925 unrelated individuals using a linear model analysis, and validated the estimation method with simulations based on the observed genotype data. We show that 45% of variance can be explained by considering all SNPs simultaneously. Thus, most of the heritability is not missing but has not previously been detected because the individual effects are too small to pass stringent significance tests. We provide evidence that the remaining heritability is due to incomplete linkage disequilibrium between causal variants and genotyped SNPs, exacerbated by causal variants having lower minor allele frequency than the SNPs explored to date.

Genome-wide linkage analysis of multiple measures of neuroticism of 2 large cohorts from Australia and the Netherlands

CONTEXT People meeting diagnostic criteria for anxiety or depressive disorders tend to score high on the personality scale of neuroticism. Studying this personality dimension can give insights into the etiology of these important psychiatric disorders. OBJECTIVES To undertake a comprehensive genome-wide linkage study of neuroticism using large study samples that have been measured multiple times and to compare the results between countries for replication and across time within countries for consistency. DESIGN Genome-wide linkage scan. SETTING Twin individuals and their family members from Australia and the Netherlands. PARTICIPANTS Nineteen thousand six hundred thirty-five sibling pairs completed self-report questionnaires for neuroticism up to 5 times over a period of up to 22 years. Five thousand sixty-nine sibling pairs were genotyped with microsatellite markers. METHODS Nonparametric linkage analyses were conducted in MERLIN-REGRESS for the mean neuroticism scores averaged across time. Additional analyses were conducted for the time-specific measures of neuroticism from each country to investigate consistency of linkage results. RESULTS Three chromosomal regions exceeded empirically derived thresholds for suggestive linkage using mean neuroticism scores: 10p 5 Kosambi cM (cM) (Dutch study sample), 14q 103 cM (Dutch study sample), and 18q 117 cM (combined Australian and Dutch study sample), but only 14q retained significance after correction for multiple testing. These regions all showed evidence for linkage in individual time-specific measures of neuroticism and 1 (18q) showed some evidence for replication between countries. Linkage intervals for these regions all overlap with regions identified in other studies of neuroticism or related traits and/or in studies of anxiety in mice. CONCLUSIONS Our results demonstrate the value of the availability of multiple measures over time and add to the optimism reported in recent reviews for replication of linkage regions for neuroticism. These regions are likely to harbor causal variants for neuroticism and its related psychiatric disorders and can inform prioritization of results from genome-wide association studies.

Migraine with aura and migraine without aura are not distinct entities: further evidence from a large Dutch population study

It is often debated whether migraine with aura (MA) and migraine without aura (MO) are etiologically distinct disorders. A previous study using latent class analysis (LCA) in Australian twins showed no evidence for separate subtypes of MO and MA. The aim of the present study was to replicate these results in a population of Dutch twins and their parents, siblings and partners (N = 10,144). Latent class analysis of International Headache Society (IHS)-based migraine symptoms resulted in the identification of 4 classes: a class of unaffected subjects (class 0), a mild form of nonmigrainous headache (class 1), a moderately severe type of migraine (class 2), typically without neurological symptoms or aura (8% reporting aura symptoms), and a severe type of migraine (class 3), typically with neurological symptoms, and aura symptoms in approximately half of the cases. Given the overlap of neurological symptoms and nonmutual exclusivity of aura symptoms, these results do not support the MO and MA subtypes as being etiologically distinct. The heritability in female twins of migraine based on LCA classification was estimated at .50 (95% confidence intervals [CI] .27 - .59), similar to IHS-based migraine diagnosis (h2 = .49, 95% CI .19-.57). However, using a dichotomous classification (affected-unaffected) decreased heritability for the IHS-based classification (h2 = .33, 95% CI .00-.60), but not the LCA-based classification (h2 = .51, 95% CI .23-.61). Importantly, use of the LCA-based classification increased the number of subjects classified as affected. The heritability of the screening question was similar to more detailed LCA and IHS classifications, suggesting that the screening procedure is an important determining factor in genetic studies of migraine.