Linear programming for large-scale Markov decision problems

We consider the problem of controlling a Markov decision process (MDP) with a large state space, so as to minimize average cost. Since it is intractable to compete with the optimal policy for large scale problems, we pursue the more modest goal of competing with a low-dimensional family of policies. We use the dual linear programming formulation of the MDP average cost problem, in which the variable is a stationary distribution over state-action pairs, and we consider a neighborhood of a low-dimensional subset of the set of stationary distributions (defined in terms of state-action features) as the comparison class. We propose a technique based on stochastic convex optimization and give bounds that show that the performance of our algorithm approaches the best achievable by any policy in the comparison class. Most importantly, this result depends on the size of the comparison class, but not on the size of the state space. Preliminary experiments show the effectiveness of the proposed algorithm in a queuing application.

Multipurpose nanoporous alumina-carbon nanowall bi-dimensional nano-hybrid platform via catalyzed and catalyst-free plasma CVD

Simple, rapid, plasma-assisted synthesis of large-area arrays of vertically-aligned carbon nanowalls on highly-porous, transparent bare and gold-coated alumina membranes with the two pore sizes is reported. It is demonstrated that the complex patterns of vertically aligned nanowalls can nucleate and form different morphologies in the low-temperature plasmas. The process is stable, and the twofold change in the gas flow (10 and 20 sccm) does not noticeably influence the morphology of the nanowall pattern. Application of a thin (5 nm) gold layer to nanoporous membrane prior to the nanowall growth allows controlling the network morphology.

Autonomy-supportive pedagogical approach to sports coaching: Research, challenges and opportunities

There has been an increasing body of research on autonomy- or need-support specific to a coaching context that warrants some review of what we know and don't know, and what might be generative for future research. The previous studies reviewed within this article have shown consistent support for Self-determination theory with autonomy-supportive environments linked with adaptive outcomes, such as superior performance, enhanced self-worth, increased effort, and self-determined motivation; while controlling environments have been linked with increased attrition and extrinsic motivation or amotivation. In this way, much of the research in autonomy-supportive coaching has focused on the impact of coaching behaviours on athlete outcomes. While this is an important focus of inquiry, there has been a dearth of research examining those causal factors that impact coaches' pedagogical behaviours in the first case. This review underscores the need for future research to examine the antecedents to coaching behaviours, which is central to understanding the complexity and challenges in promoting an autonomy-supportive approach to sport coaching.

Evolution of a ~2.7 Ga large igneous province: A volcanological, geochemical and geochronological study of the Agnew Greenstone Belt, and new regional correlations for the Kalgoorlie Terrane (Yilgarn Craton, Western Australia)

The thick package of ~2.7 Ga mafic and ultramafic lavas and intrusions preserved among the Neoarchean of the Kalgoorlie Terrene in Western Australia provides valuable insight into geological processes controlling the most prodigious episode of growth and preservation of juvenile continental crust in Earth’s history. Limited exposure of these rocks results in uncertainty about their age, physical and chemical characteristics, and stratigraphic relationships. This in turn prevents confident correlation of regional occurrences of mafic and ultramafic successions (both intrusive and extrusive) and hinders the interpretation of tectonic setting and magmatic evolution. A recent stratigraphic drilling program of the Neoarchean stratigraphy of the Agnew Greenstone Belt in Western Australia has provided continuous exposures through a c. 7 km thick sequence of mafic and ultramafic units. In this study, we present a volcanological, lithogeochemical and chronological study of the Agnew Greenstone Belt, and provide the first pre-2690 Ma regional correlation across the Kalgoorlie Terrane. The Agnew Greenstone Belt records ~30 m.y. of episodic ultramafic-mafic magmatism that includes two cycles, each defined by a komatiite that is overlain by units that become more evolved and contaminated with time. The sequence is divided into nine conformable packages, each consisting of stacked subaqueous lava flows and comagmatic intrusions, as well as two sills without associated extrusions. Lavas, with the exception of intercalations between two units, form a layer-cake stratigraphy and were likely erupted from a system of fissures tapping the same magma source. The komatiites are not contaminated by continental crust ([La/Sm]PM ~0.7) and are of the Al-undepleted Munro-type. Crustal contamination is evident in many units (Songvang Basalt, Never Can Tell Basalt, Redeemer Basalt, and Turrett Dolerite), as judged by [La/Sm]>1, negative Nb and Ti anomalies, and geochemical mixing trends towards felsic contaminants. Crystal fractionation was also significant, with early olivine and chromite (Mg#>65) followed by plagioclase and clinopyroxene removal (Mg<65), and in the most evolved case, titanomagnetite accumulation. Three new TIMS dates on granophyric zones of mafic sills and one ICP-MS date from an interflow felsic tuff are presented and used for regional stratigraphic correlation. Cycle I magmatism began at ~2720 Ma and ended ~2705 Ma, whereas cycle II began ~2705 Ma and ended at 2690.7±1.2 Ma. Regional correlations indicate the western Kalgoorlie Terrane consists of a remarkably similar stratigraphy that can be recognised at Agnew, Ora Banda and Coolgardie, whereas the eastern part of the terrane (e.g., Kambalda Domain) does not include cycle I, but correlates well with cycle II. This research supports an autochthonous model of greenstone formation, in which one large igneous province, represented by two complete cycles, is constructed on sialic crust. New stratigraphic correlations for the Kalgoorlie Terrane indicate that many units can be traced over distances >100 km, which has implications for exploration targeting for stratigraphically hosted ultramafic Ni and VMS deposits.

Social Media Audience Metrics as a New Form of TV Audience Measurement

Digital media have contributed to significant disruptions in the business of audience measurement. Television broadcasters have long relied on simple and authoritative measures of who is watching what. The demand for ratings data, as a common currency in transactions involving advertising and program content, will likely remain, but accompanying measurements of audience engagement with media content would also be of value. Today's media environment increasingly includes social media and second-screen use, providing a data trail that affords an opportunity to measure engagement. If the limitations of using social media to indicate audience engagement can be overcome, social media use may allow for quantitative and qualitative measures of engagement. Raw social media data must be contextualized, and it is suggested that tools used by sports analysts be incorporated to do so. Inspired by baseball's Sabremetrics, the authors propose Telemetrics in an attempt to separate actual performance from contextual factors. Telemetrics facilitates measuring audience activity in a manner controlling for factors such as time slot, network, and so forth. It potentially allows both descriptive and predictive measures of engagement.

Effect of water management practice on pesticide behavior in paddy water

The fate and transport of three herbicides commonly used in rice production in Japan were compared using two water management practices. The herbicides were simetryn, thiobencarb and mefenacet. The first management practice was an intermittent irrigation scheme using an automatic irrigation system (AI) with a high drainage gate and the second one was a continuous irrigation and overflow drainage scheme (CI) in experimental paddy fields. Dissipation of the herbicides appeared to follow first order kinetics with the half-lives (DT₅₀) of 1.6-3.4 days and the DT₉₀ (90% dissipation) of 7.4-9.8 days. The AI scheme had little drainage even during large rainfall events thus resulting in losses of less than 4% of each applied herbicide through runoff. Meanwhile the CI scheme resulted in losses of about 37%, 12% and 35% of the applied masses of simetryn, thiobencarb and mefenacet, respectively. The intermittent irrigation scheme using an automatic irrigation system with a high drainage gate saved irrigation water and prevented herbicide runoff whereas the continuous irrigation and overflow scheme resulted in significant losses of water as well as the herbicides. Maintaining the excess water storage is important for preventing paddy water runoff during significant rainfall events. The organic carbon partition coefficient K_oc seems to be a strong indicator of the aquatic fate of the herbicide as compared to the water solubility (S_W). However, further investigations are required to understand the relation between K_oc and the agricultural practices upon the pesticide fate and transport. An extension of the water holding period up to 10 days after herbicide application based on the DT₉₀ from the currently specified period of 3-4 days in Japan is recommended to be a good agricultural practice for controlling the herbicide runoff from paddy fields. Also, the best water management practice, which can be recommended for use during the water holding period, is the intermittent irrigation scheme using an automatic irrigation system with a high drainage gate. © 2006 Elsevier B.V. All rights reserved.

Excess water storage depth - A water management practice to control simetryn and thiobencarb runoff from paddy fields

Experiments were carried out to verify the effectiveness of the excess water storage depth (EWSD) in reducing runoff losses of simetryn and thiobencarb from paddy fields upon appreciable rainfall events. A paddy plot having an EWSD of 2 cm was effective in controlling runoff with the herbicide losses of less than 1% of the applied herbicides. Meanwhile, a plot with 0-cm EWSD lost 18.1 and 3.7% of the applied mass of simetryn and thiobencarb, respectively. Therefore, an appropriate EWSD is essential during the recommended 7-day water holding period in order to completely hold the water inside the field in case of rainfall.

Pesticide exposure assessment in rice paddy areas: A Japanese perspective

This chapter provides an overview of the Japanese regulatory issues regarding pesticide use in rice paddies and an introduction of the new pesticide registration program. In addition, the experience of the environmental monitoring of pesticides and the modeling approaches used for the calculation of predicted environmental concentrations (PECs) in surface water and ground water systems adjacent to rice paddies in Japan are also discussed. Japan has been one of the major pesticide users in the world. Although having a long history in rice cultivation, the pesticide exposure assessment for paddy rice production received less attention compared with EU and US. Applications of up-to-date techniques and the development of realistic assessment procedures under specific climatic conditions as well as mitigation management practices for controlling pesticide contamination are important for an environmental-friendly rice production. Through the international cooperation and research exchanges, advances in pesticide risk assessment for rice paddies in Asian region and other rice-growing areas in the world would contribute to sustainable rice production. Transplanting of rice seedlings grows almost all rice paddies in Japan. The land preparation starts around April and June, and the harvest season lasts from August to October depending on the region and the rice varieties. Most of the rice paddies are treated with herbicides and other crop protection products, such as fungicides and insecticides that are applied during the crop season accordingly. Newly developed insecticides and fungicides are also applied during seedbed preparation.

Factors associated with health risk behavior among school children in urban Vietnam

Background Health risk behavior among young people is a public health problem in Vietnam. In addition, road traffic injuries are the leading cause of death for those aged 15–29 years. The consequences can be devastating for adolescents and their families, and can create a significant economic burden on society. Objective: The aim of this study was to identify protective and risk factors that may influence three health risk behaviors among school children: suicidal thinking (ST), drinking alcohol (DA), and underage motorbike driving (MD). Methods A cross-sectional survey of 972 adolescents (aged 12–15 years) was conducted in two secondary schools in Hanoi, Vietnam. The schools were purposely selected, one each from the inner city and a suburban area, from which classes (grade 6 to 8) were randomly selected. All students attending classes on survey days took part in the survey. The anonymous, self-completed questionnaire included measures of risk behavior, school connectedness, parental bonding, and other factors. Multivariable regression models were used to examine associations between the independent variables and the three health risk behaviors controlling for confounding factors. Results Young people in the inner city school reported a higher prevalence of all three risk behaviors than those in the suburban area (ST: 16.1% [95% confidence interval, or CI, 12.9–19.3] versus 4.6% [95% CI 2.7–6.5], p<0.001; DA: 20.3% [95% CI 16.8–23.8] versus 8.3% [95% CI 5.8–10.8], p<0.001, and MD: 10.1% [95% CI 7.4–12.8] versus 5.7% [95% CI 3.6–7.8], p<0.01). School connectedness and mother and father care appeared to be significant protective factors. For males, bullying in school was associated with suicidal thoughts, whereas for both males and females, school connectedness may be protective against suicidal ideation. Conclusion This study supports findings from other nations regarding suicidal thoughts and alcohol use, and appears to be one of the first to examine risk and protective factors forMD. Health promotion within schools should be introduced to improve students’ feelings of connectedness in combination with communication and education campaigns focusing on parental care and engaging teachers for the promotion of safer, supportive school environments.

Major histocompatibility complex associations of ankylosing spondylitis are complex and involve further epistasis with ERAP1

Ankylosing spondylitis (AS) is a common, highly heritable, inflammatory arthritis for which HLA-B*27 is the major genetic risk factor, although its role in the aetiology of AS remains elusive. To better understand the genetic basis of the MHC susceptibility loci, we genotyped 7,264 MHC SNPs in 22,647 AS cases and controls of European descent. We impute SNPs, classical HLA alleles and amino-acid residues within HLA proteins, and tested these for association to AS status. Here we show that in addition to effects due to HLA-B*27 alleles, several other HLA-B alleles also affect susceptibility. After controlling for the associated haplotypes in HLA-B, we observe independent associations with variants in the HLA-A, HLA-DPB1 and HLA-DRB1 loci. We also demonstrate that the ERAP1 SNP rs30187 association is not restricted only to carriers of HLA-B*27 but also found in HLA-B*40:01 carriers independently of HLA-B*27 genotype.

Structure and vascular tissue expression of duplicated TERMINAL EAR1-like paralogues in poplar

TERMINAL EAR1-like (TEL) genes encode putative RNA-binding proteins only found in land plants. Previous studies suggested that they may regulate tissue and organ initiation in Poaceae. Two TEL genes were identified in both Populus trichocarpa and the hybrid aspen Populus tremula × P. alba, named, respectively, PoptrTEL1-2 and PtaTEL1-2. The analysis of the organisation around the PoptrTEL genes in the P. trichocarpa genome and the estimation of the synonymous substitution rate for PtaTEL1-2 genes indicate that the paralogous link between these two Populus TEL genes probably results from the Salicoid large-scale gene-duplication event. Phylogenetic analyses confirmed their orthology link with the other TEL genes. The expression pattern of both PtaTEL genes appeared to be restricted to the mother cells of the plant body: leaf founder cells, leaf primordia, axillary buds and root differentiating tissues, as well as to mother cells of vascular tissues. Most interestingly, PtaTEL1-2 transcripts were found in differentiating cells of secondary xylem and phloem, but probably not in the cambium itself. Taken together, these results indicate specific expression of the TEL genes in differentiating cells controlling tissue and organ development in Populus (and other Angiosperm species).

Mycobacterium tuberculosis groE promoter controls the expression of the bicistronic groESL1 operon and shows differential regulation under stress conditions

Heat shock promoters of mycobacteria are strong promoters that become rapidly upregulated during macrophage infection and thus serve as valuable candidates for expressing foreign antigens in recombinant BCG vaccine. In the present study, a new heat shock promoter controlling the expression of the groESL1 operon was identified and characterized. Mycobacterium tuberculosis groESL1 operon codes for the immunodominant 10 kDa (Rv3418c, GroES/Cpn10/Hsp10) and 60 kDa (Rv3417c, GroEL1/Cpn60.1/Hsp60) heat shock proteins. The basal promoter region was 115 bp, while enhanced activity was seen only with a 277-bp fragment. No promoter element was seen in the groES-groEL1 intergenic region. This operon codes for a bicistronic mRNA transcript as determined by reverse transcriptase-PCR and Northern blot analysis. Primer extension analysis identified two transcriptional start sites (TSSs) TSS1 (-236) and TSS2 (-171), out of which one (TSS2) was heat inducible. The groE promoter was more active than the groEL2 promoter in Mycobacterium smegmatis. Further, it was found to be differentially regulated under stress conditions, while the groEL2 promoter was constitutive.

The high temperature mechanical characteristics of superplastic 3 mol% yttria stabilized zirconia

A detailed study was undertaken to characterize the deformation behavior of a superplastic 3 mol% yttria-stabilized tetragonal zirconia (3YTZ) over a wide range of strain rates, temperatures and grain sizes. The experimental data were analyzed in terms of the following equation for high temperature deformation: Image Full-size image ∞ σn d−pexp(−Q/RT), where Image Full-size image is the strain rate, σ is the flow stress, d is the grain size, Q is the activation energy, R is the gas constant, T is the absolute temperature, and n and p are constants termed the stress exponent and the inverse grain size exponent, respectively. The experimental data over a wide range of stresses revealed a transition in stress exponent. Deformation in the low and high stress regions was associated with n not, vert, similar 3 and p not, vert, similar 1, and n not, vert, similar 2 and p not, vert, similar 3, respectively. The transition stress between the two regions decreased with increasing grain size. The activation energy was similar for both regions with a value of not, vert, similar 550 kJ mol−1. Microstructural measurements revealed that grains remained essentially equiaxed after the accumulation of large strains, and very limited concurrent grain growths occurred in most experiments. Assessment of possible rate controlling creep mechanisms and comparison with previous studied indicate that in the n not, vert, similar 2 region, deformation occurs by a grain boundary sliding process whose rate is independent of impurity content. Deformation in the n not, vert, similar 3 region is controlled by an interface reaction that is highly sensitive to impurity content. It is concluded that an increase in impurity content increases yttrium segregation to grain boundaries, which enhances the rate of the interface reaction, thereby decreasing the apparent transition stress between the n not, vert, similar 2 and n not, vert, similar 3 regions. This unified approach incorporating two sequential mechanisms can rationalize many of the apparently dissimilar results that have been reported previously for deformation of 3YTZ.

The treatment of recurrent abdominal pain in children : a controlled comparison of cognitive-behavioral family intervention and standard pediatric care

This study describes the results of a controlled clinical trial involving 44 7- to 14-year-old children with recurrent abdominal pain who were randomly allocated to either cognitive-behavioral family intervention (CBFI) or standard pediatric care (SPC). Both treatment conditions resulted in significant improvements on measures of pain intensity and pain behavior. However, the children receiving CBFI had a higher rate of complete elimination of pain, lower levels of relapse at 6- and 12-month follow-up, and lower levels of interference with their activities as a result of pain and parents reported a higher level of satisfaction with the treatment than children receiving SPC. After controlling for pretreatment levels of pain, children's active self-coping and mothers' caregiving strategies were significant independent predictors of pain behavior at posttreatment.

Nanoporous Pt with High Surface Area by Reaction-Limited Aggregation of Nanoparticles

Nanoporous structures with high active surface areas are critical for a variety of applications. Here, we present a general templateless strategy to produce such porous structures by controlled aggregation of nanostructured subunits and apply the principles for synthesizing nanoporous Pt for electrocatalytic oxidation of methanol. The nature of the aggregate produced is controlled by tuning the electrostatic interaction between surfactant-free nanoparticles in the solution phase. When the repulsive force between the particles is very large, the particles are stabilized in the solution while instantaneous aggregation leading to fractal-like structures results when the repulsive force is very low. Controlling the repulsive interaction to an optimum, intermediate value results in the formation of compact structures with very large surface areas. In the case of Pt, nanoporous clusters with an extremely high specific surface area (39 m(2)/g) and high activity for methanol oxidation have been produced. Preliminary investigations indicate that the method is general and can be easily extended to produce nanoporous structures of many inorganic materials.