Linear programming for large-scale Markov decision problems

We consider the problem of controlling a Markov decision process (MDP) with a large state space, so as to minimize average cost. Since it is intractable to compete with the optimal policy for large scale problems, we pursue the more modest goal of competing with a low-dimensional family of policies. We use the dual linear programming formulation of the MDP average cost problem, in which the variable is a stationary distribution over state-action pairs, and we consider a neighborhood of a low-dimensional subset of the set of stationary distributions (defined in terms of state-action features) as the comparison class. We propose a technique based on stochastic convex optimization and give bounds that show that the performance of our algorithm approaches the best achievable by any policy in the comparison class. Most importantly, this result depends on the size of the comparison class, but not on the size of the state space. Preliminary experiments show the effectiveness of the proposed algorithm in a queuing application.

Multipurpose nanoporous alumina-carbon nanowall bi-dimensional nano-hybrid platform via catalyzed and catalyst-free plasma CVD

Simple, rapid, plasma-assisted synthesis of large-area arrays of vertically-aligned carbon nanowalls on highly-porous, transparent bare and gold-coated alumina membranes with the two pore sizes is reported. It is demonstrated that the complex patterns of vertically aligned nanowalls can nucleate and form different morphologies in the low-temperature plasmas. The process is stable, and the twofold change in the gas flow (10 and 20 sccm) does not noticeably influence the morphology of the nanowall pattern. Application of a thin (5 nm) gold layer to nanoporous membrane prior to the nanowall growth allows controlling the network morphology.

Autonomy-supportive pedagogical approach to sports coaching: Research, challenges and opportunities

There has been an increasing body of research on autonomy- or need-support specific to a coaching context that warrants some review of what we know and don't know, and what might be generative for future research. The previous studies reviewed within this article have shown consistent support for Self-determination theory with autonomy-supportive environments linked with adaptive outcomes, such as superior performance, enhanced self-worth, increased effort, and self-determined motivation; while controlling environments have been linked with increased attrition and extrinsic motivation or amotivation. In this way, much of the research in autonomy-supportive coaching has focused on the impact of coaching behaviours on athlete outcomes. While this is an important focus of inquiry, there has been a dearth of research examining those causal factors that impact coaches' pedagogical behaviours in the first case. This review underscores the need for future research to examine the antecedents to coaching behaviours, which is central to understanding the complexity and challenges in promoting an autonomy-supportive approach to sport coaching.

Evolution of a ~2.7 Ga large igneous province: A volcanological, geochemical and geochronological study of the Agnew Greenstone Belt, and new regional correlations for the Kalgoorlie Terrane (Yilgarn Craton, Western Australia)

The thick package of ~2.7 Ga mafic and ultramafic lavas and intrusions preserved among the Neoarchean of the Kalgoorlie Terrene in Western Australia provides valuable insight into geological processes controlling the most prodigious episode of growth and preservation of juvenile continental crust in Earth’s history. Limited exposure of these rocks results in uncertainty about their age, physical and chemical characteristics, and stratigraphic relationships. This in turn prevents confident correlation of regional occurrences of mafic and ultramafic successions (both intrusive and extrusive) and hinders the interpretation of tectonic setting and magmatic evolution. A recent stratigraphic drilling program of the Neoarchean stratigraphy of the Agnew Greenstone Belt in Western Australia has provided continuous exposures through a c. 7 km thick sequence of mafic and ultramafic units. In this study, we present a volcanological, lithogeochemical and chronological study of the Agnew Greenstone Belt, and provide the first pre-2690 Ma regional correlation across the Kalgoorlie Terrane. The Agnew Greenstone Belt records ~30 m.y. of episodic ultramafic-mafic magmatism that includes two cycles, each defined by a komatiite that is overlain by units that become more evolved and contaminated with time. The sequence is divided into nine conformable packages, each consisting of stacked subaqueous lava flows and comagmatic intrusions, as well as two sills without associated extrusions. Lavas, with the exception of intercalations between two units, form a layer-cake stratigraphy and were likely erupted from a system of fissures tapping the same magma source. The komatiites are not contaminated by continental crust ([La/Sm]PM ~0.7) and are of the Al-undepleted Munro-type. Crustal contamination is evident in many units (Songvang Basalt, Never Can Tell Basalt, Redeemer Basalt, and Turrett Dolerite), as judged by [La/Sm]>1, negative Nb and Ti anomalies, and geochemical mixing trends towards felsic contaminants. Crystal fractionation was also significant, with early olivine and chromite (Mg#>65) followed by plagioclase and clinopyroxene removal (Mg<65), and in the most evolved case, titanomagnetite accumulation. Three new TIMS dates on granophyric zones of mafic sills and one ICP-MS date from an interflow felsic tuff are presented and used for regional stratigraphic correlation. Cycle I magmatism began at ~2720 Ma and ended ~2705 Ma, whereas cycle II began ~2705 Ma and ended at 2690.7±1.2 Ma. Regional correlations indicate the western Kalgoorlie Terrane consists of a remarkably similar stratigraphy that can be recognised at Agnew, Ora Banda and Coolgardie, whereas the eastern part of the terrane (e.g., Kambalda Domain) does not include cycle I, but correlates well with cycle II. This research supports an autochthonous model of greenstone formation, in which one large igneous province, represented by two complete cycles, is constructed on sialic crust. New stratigraphic correlations for the Kalgoorlie Terrane indicate that many units can be traced over distances >100 km, which has implications for exploration targeting for stratigraphically hosted ultramafic Ni and VMS deposits.

Social Media Audience Metrics as a New Form of TV Audience Measurement

Digital media have contributed to significant disruptions in the business of audience measurement. Television broadcasters have long relied on simple and authoritative measures of who is watching what. The demand for ratings data, as a common currency in transactions involving advertising and program content, will likely remain, but accompanying measurements of audience engagement with media content would also be of value. Today's media environment increasingly includes social media and second-screen use, providing a data trail that affords an opportunity to measure engagement. If the limitations of using social media to indicate audience engagement can be overcome, social media use may allow for quantitative and qualitative measures of engagement. Raw social media data must be contextualized, and it is suggested that tools used by sports analysts be incorporated to do so. Inspired by baseball's Sabremetrics, the authors propose Telemetrics in an attempt to separate actual performance from contextual factors. Telemetrics facilitates measuring audience activity in a manner controlling for factors such as time slot, network, and so forth. It potentially allows both descriptive and predictive measures of engagement.

Effect of water management practice on pesticide behavior in paddy water

The fate and transport of three herbicides commonly used in rice production in Japan were compared using two water management practices. The herbicides were simetryn, thiobencarb and mefenacet. The first management practice was an intermittent irrigation scheme using an automatic irrigation system (AI) with a high drainage gate and the second one was a continuous irrigation and overflow drainage scheme (CI) in experimental paddy fields. Dissipation of the herbicides appeared to follow first order kinetics with the half-lives (DT₅₀) of 1.6-3.4 days and the DT₉₀ (90% dissipation) of 7.4-9.8 days. The AI scheme had little drainage even during large rainfall events thus resulting in losses of less than 4% of each applied herbicide through runoff. Meanwhile the CI scheme resulted in losses of about 37%, 12% and 35% of the applied masses of simetryn, thiobencarb and mefenacet, respectively. The intermittent irrigation scheme using an automatic irrigation system with a high drainage gate saved irrigation water and prevented herbicide runoff whereas the continuous irrigation and overflow scheme resulted in significant losses of water as well as the herbicides. Maintaining the excess water storage is important for preventing paddy water runoff during significant rainfall events. The organic carbon partition coefficient K_oc seems to be a strong indicator of the aquatic fate of the herbicide as compared to the water solubility (S_W). However, further investigations are required to understand the relation between K_oc and the agricultural practices upon the pesticide fate and transport. An extension of the water holding period up to 10 days after herbicide application based on the DT₉₀ from the currently specified period of 3-4 days in Japan is recommended to be a good agricultural practice for controlling the herbicide runoff from paddy fields. Also, the best water management practice, which can be recommended for use during the water holding period, is the intermittent irrigation scheme using an automatic irrigation system with a high drainage gate. © 2006 Elsevier B.V. All rights reserved.

Excess water storage depth - A water management practice to control simetryn and thiobencarb runoff from paddy fields

Experiments were carried out to verify the effectiveness of the excess water storage depth (EWSD) in reducing runoff losses of simetryn and thiobencarb from paddy fields upon appreciable rainfall events. A paddy plot having an EWSD of 2 cm was effective in controlling runoff with the herbicide losses of less than 1% of the applied herbicides. Meanwhile, a plot with 0-cm EWSD lost 18.1 and 3.7% of the applied mass of simetryn and thiobencarb, respectively. Therefore, an appropriate EWSD is essential during the recommended 7-day water holding period in order to completely hold the water inside the field in case of rainfall.

Pesticide exposure assessment in rice paddy areas: A Japanese perspective

This chapter provides an overview of the Japanese regulatory issues regarding pesticide use in rice paddies and an introduction of the new pesticide registration program. In addition, the experience of the environmental monitoring of pesticides and the modeling approaches used for the calculation of predicted environmental concentrations (PECs) in surface water and ground water systems adjacent to rice paddies in Japan are also discussed. Japan has been one of the major pesticide users in the world. Although having a long history in rice cultivation, the pesticide exposure assessment for paddy rice production received less attention compared with EU and US. Applications of up-to-date techniques and the development of realistic assessment procedures under specific climatic conditions as well as mitigation management practices for controlling pesticide contamination are important for an environmental-friendly rice production. Through the international cooperation and research exchanges, advances in pesticide risk assessment for rice paddies in Asian region and other rice-growing areas in the world would contribute to sustainable rice production. Transplanting of rice seedlings grows almost all rice paddies in Japan. The land preparation starts around April and June, and the harvest season lasts from August to October depending on the region and the rice varieties. Most of the rice paddies are treated with herbicides and other crop protection products, such as fungicides and insecticides that are applied during the crop season accordingly. Newly developed insecticides and fungicides are also applied during seedbed preparation.

Factors associated with health risk behavior among school children in urban Vietnam

Background Health risk behavior among young people is a public health problem in Vietnam. In addition, road traffic injuries are the leading cause of death for those aged 15–29 years. The consequences can be devastating for adolescents and their families, and can create a significant economic burden on society. Objective: The aim of this study was to identify protective and risk factors that may influence three health risk behaviors among school children: suicidal thinking (ST), drinking alcohol (DA), and underage motorbike driving (MD). Methods A cross-sectional survey of 972 adolescents (aged 12–15 years) was conducted in two secondary schools in Hanoi, Vietnam. The schools were purposely selected, one each from the inner city and a suburban area, from which classes (grade 6 to 8) were randomly selected. All students attending classes on survey days took part in the survey. The anonymous, self-completed questionnaire included measures of risk behavior, school connectedness, parental bonding, and other factors. Multivariable regression models were used to examine associations between the independent variables and the three health risk behaviors controlling for confounding factors. Results Young people in the inner city school reported a higher prevalence of all three risk behaviors than those in the suburban area (ST: 16.1% [95% confidence interval, or CI, 12.9–19.3] versus 4.6% [95% CI 2.7–6.5], p<0.001; DA: 20.3% [95% CI 16.8–23.8] versus 8.3% [95% CI 5.8–10.8], p<0.001, and MD: 10.1% [95% CI 7.4–12.8] versus 5.7% [95% CI 3.6–7.8], p<0.01). School connectedness and mother and father care appeared to be significant protective factors. For males, bullying in school was associated with suicidal thoughts, whereas for both males and females, school connectedness may be protective against suicidal ideation. Conclusion This study supports findings from other nations regarding suicidal thoughts and alcohol use, and appears to be one of the first to examine risk and protective factors forMD. Health promotion within schools should be introduced to improve students’ feelings of connectedness in combination with communication and education campaigns focusing on parental care and engaging teachers for the promotion of safer, supportive school environments.

Major histocompatibility complex associations of ankylosing spondylitis are complex and involve further epistasis with ERAP1

Ankylosing spondylitis (AS) is a common, highly heritable, inflammatory arthritis for which HLA-B*27 is the major genetic risk factor, although its role in the aetiology of AS remains elusive. To better understand the genetic basis of the MHC susceptibility loci, we genotyped 7,264 MHC SNPs in 22,647 AS cases and controls of European descent. We impute SNPs, classical HLA alleles and amino-acid residues within HLA proteins, and tested these for association to AS status. Here we show that in addition to effects due to HLA-B*27 alleles, several other HLA-B alleles also affect susceptibility. After controlling for the associated haplotypes in HLA-B, we observe independent associations with variants in the HLA-A, HLA-DPB1 and HLA-DRB1 loci. We also demonstrate that the ERAP1 SNP rs30187 association is not restricted only to carriers of HLA-B*27 but also found in HLA-B*40:01 carriers independently of HLA-B*27 genotype.

Structure and vascular tissue expression of duplicated TERMINAL EAR1-like paralogues in poplar

TERMINAL EAR1-like (TEL) genes encode putative RNA-binding proteins only found in land plants. Previous studies suggested that they may regulate tissue and organ initiation in Poaceae. Two TEL genes were identified in both Populus trichocarpa and the hybrid aspen Populus tremula × P. alba, named, respectively, PoptrTEL1-2 and PtaTEL1-2. The analysis of the organisation around the PoptrTEL genes in the P. trichocarpa genome and the estimation of the synonymous substitution rate for PtaTEL1-2 genes indicate that the paralogous link between these two Populus TEL genes probably results from the Salicoid large-scale gene-duplication event. Phylogenetic analyses confirmed their orthology link with the other TEL genes. The expression pattern of both PtaTEL genes appeared to be restricted to the mother cells of the plant body: leaf founder cells, leaf primordia, axillary buds and root differentiating tissues, as well as to mother cells of vascular tissues. Most interestingly, PtaTEL1-2 transcripts were found in differentiating cells of secondary xylem and phloem, but probably not in the cambium itself. Taken together, these results indicate specific expression of the TEL genes in differentiating cells controlling tissue and organ development in Populus (and other Angiosperm species).

The treatment of recurrent abdominal pain in children : a controlled comparison of cognitive-behavioral family intervention and standard pediatric care

This study describes the results of a controlled clinical trial involving 44 7- to 14-year-old children with recurrent abdominal pain who were randomly allocated to either cognitive-behavioral family intervention (CBFI) or standard pediatric care (SPC). Both treatment conditions resulted in significant improvements on measures of pain intensity and pain behavior. However, the children receiving CBFI had a higher rate of complete elimination of pain, lower levels of relapse at 6- and 12-month follow-up, and lower levels of interference with their activities as a result of pain and parents reported a higher level of satisfaction with the treatment than children receiving SPC. After controlling for pretreatment levels of pain, children's active self-coping and mothers' caregiving strategies were significant independent predictors of pain behavior at posttreatment.

Engineering cellulose nanofibre suspensions to control filtration resistance and sheet permeability

This study examines and quantifies the effect of adding polyelectrolytes to cellulose nanofibre suspensions on the gel point of cellulose nanofibre suspensions, which is the lowest solids concentration at which the suspension forms a continuous network. The lower the gel point, the faster the drainage time to produce a sheet and the higher the porosity of the final sheet formed. Two new techniques were designed to measure the dynamic compressibility and the drainability of nanocellulose–polyelectrolyte suspensions. We developed a master curve which showed that the independent variable controlling the behaviour of nanocellulose suspensions and its composite is the structure of the flocculated suspension which is best quantified as the gel point. This was independent of the type of polyelectrolyte used. At an addition level of 2 mg/g of nanofibre, a reduction in gel point over 50 % was achieved using either a high molecular weight (13 MDa) linear cationic polyacrylamide (CPAM, 40 % charge), a dendrimer polyethylenimine of high molecular weight of 750,000 Da (HPEI) or even a low molecular weight of 2000 Da (LPEI). There was no significant difference in the minimum gel point achieved, despite the difference in polyelectrolyte morphology and molecular weight. In this paper, we show that the gel point controls the flow through the fibre suspension, even when comparing fibre suspensions with solids content above the gel point. A lower gel point makes it easier for water to drain through the fibre network,reducing the pressure required to achieve a given dewatering rate and reducing the filtering time required to form a wet laid sheet. We further show that the lower gel point partially controls the structure of the wet laid sheet after it is dried. Halving the gel point increased the air permeability of the dry sheet by 37, 46 and 25 %, when using CPAM, HPEI and LPEI, respectively. The resistance to liquid flow was reduced by 74 and 90 %, when using CPAM and LPEI. Analysing the paper formed shows that sheet forming process and final sheet properties can be engineered and controlled by adding polyelectrolytes to the nanofibre suspension.

Control of Ship Roll Motion

The undesirable effects of roll motion of ships (rocking about the longitudinal axis) became noticeable in the mid-nineteenth century when significant changes were introduced to the design of ships as a result of sails being replaced by steam engines and the arrangement being changed from broad to narrow hulls. The combination of these changes led to lower transverse stability (lower restoring moment for a given angle of roll) with the consequence of larger roll motion. The increase in roll motion and its effect on cargo and human performance lead to the development several control devices that aimed at reducing and controlling roll motion. The control devices most commonly used today are fin stabilizers, rudder, anti-roll tanks, and gyrostabilizers. The use of different types of actuators for control of ship roll motion has been amply demonstrated for over 100 years. Performance, however, can still fall short of expectations because of difficulties associated with control system design, which have proven to be far from trivial due to fundamental performance limitations and large variations of the spectral characteristics of wave-induced roll motion. This short article provides an overview of the fundamentals of control design for ship roll motion reduction. The overview is limited to the most common control devices.

Therapeutic upper gastrointestinal endoscopy in children : An audit of 443 procedures and literature review

The safety, effectiveness and capabilities of therapeutic upper fibreoptic endoscopy in children undergoing therapeutic endoscopic procedures (n = 443) was studied. Therapy for gastrointestinal bleeding formed the major group (injection sclerotherapy for varices, n = 197 procedures; thermocoagulation for haemorrhagic gastritis, n = 1; and photocoaulation for Dieulafoy's disease, n = 1). Sclerotherapy was 97% effective in controlling acute bleeding and 84% effective in obliterating varices with no serious complications or deaths. Oesophageal dilatations for surgical, caustic, congenital and peptic strictures and achalasia (n = 193) were performed with no oesophageal perforations or deaths. Foreign bodies were retrieved (n = 34) with no failures or complications. Percutaneous endoscopic gastrostomy was performed (n = 11) with one failure, proceeding to an unsuccessful surgical gastrostomy. Miscellaneous procedures included endoscopic transpyloric tube placement (n = 5) and endoscopic diathermy of pyloric web (n = 1). Therapeutic fibreoptic endoscopy is therefore concluded to be safe and effective in children, replacing rigid oesophagoscopy and some traditional surgical approaches.