Linear programming for large-scale Markov decision problems

We consider the problem of controlling a Markov decision process (MDP) with a large state space, so as to minimize average cost. Since it is intractable to compete with the optimal policy for large scale problems, we pursue the more modest goal of competing with a low-dimensional family of policies. We use the dual linear programming formulation of the MDP average cost problem, in which the variable is a stationary distribution over state-action pairs, and we consider a neighborhood of a low-dimensional subset of the set of stationary distributions (defined in terms of state-action features) as the comparison class. We propose a technique based on stochastic convex optimization and give bounds that show that the performance of our algorithm approaches the best achievable by any policy in the comparison class. Most importantly, this result depends on the size of the comparison class, but not on the size of the state space. Preliminary experiments show the effectiveness of the proposed algorithm in a queuing application.

Tracking adversarial targets

We study linear control problems with quadratic losses and adversarially chosen tracking targets. We present an efficient algorithm for this problem and show that, under standard conditions on the linear system, its regret with respect to an optimal linear policy grows as O(log^2 T), where T is the number of rounds of the game. We also study a problem with adversarially chosen transition dynamics; we present an exponentiallyweighted average algorithm for this problem, and we give regret bounds that grow as O(sqtr p T).

The effects of ambient temperature on cerebrovascular mortality: An epidemiologic study in four climatic zones in China

Background Little evidence is available about the association between temperature and cerebrovascular mortality in China. This study aims to examine the effects of ambient temperature on cerebrovascular mortality in different climatic zones in China. Method We obtained daily data on weather conditions, air pollution and cerebrovascular deaths from five cities (Beijing, Tianjin, Shanghai, Wuhan, and Guangzhou) in China during 2004-2008. We examined city-specific associations between ambient temperature and the cerebrovascular mortality, while adjusting for season, long-term trends, day of the week, relative humidity and air pollution. We examined cold effects using a 1°C decrease in temperature below a city-specific threshold, and hot effects using a 1°C increase in temperature above a city-specific threshold. We used a meta-analysis to summarize the cold and hot effects across the five cities. Results Beijing and Tianjin (with low mean temperature) had lower thresholds than Shanghai, Wuhan and Guangzhou (with high mean temperature). In Beijing, Tianjin, Wuhan and Guangzhou cold effects were delayed, while in Shanghai there was no or short induction. Hot effects were acute in all five cities. The cold effects lasted longer than hot effects. The hot effects were followed by mortality displacement. The pooled relative risk associated with a 1°C decrease in temperature below thresholds (cold effect) was 1.037 (95% confidence interval (CI): 1.020, 1.053). The pooled relative risk associated with a 1°C increase in temperature above thresholds (hot effect) was 1.014 (95% CI: 0.979, 1.050). Conclusion Cold temperatures are significantly associated with cerebrovascular mortality in China, while hot effect is not significant. People in colder climate cities were sensitive to hot temperatures, while people in warmer climate cities were vulnerable to cold temperature.

Crossing international boundaries through doctoral partnerships: Learnings from a Chinese-Australian forum

International forums for doctoral students offer a fertile context for developing strategic partner-ships between higher education institutions, as well as for building the intercultural capacity of early career academics. However, there is limited research investigating the benefits of international doctoral forum partnerships. This paper presents learnings from a recent international doctoral forum held in Beijing, China and attended by doctoral students and academics from Beijing Normal University (China) and Queensland University of Technology (Australia). Drawing on qualitative case study method and a model of boundary crossing mechanisms, we identify the beneficial outcomes of the forum. We describe how the forum arose from a strong ongoing partnership between the Education Faculties of Beijing Normal University and Queensland University of Technology. We then identify how, at the institutional and individual level, international doctoral forum participants can be challenged and benefit in four areas: collaboration, intercultural capacity, academic enhancement and program development. Implications for engaging successfully in international doctoral forum partnerships are also discussed.

Comparison of the performance of two commercial genome-wide association study genotyping platforms in Han Chinese samples

Most genome-wide association studies to date have been performed in populations of European descent, but there is increasing interest in expanding these studies to other populations. The performance of genotyping chips in Asian populations is not well established. Therefore, we sought to test the performance of widely used fixed-marker, genome-wide association studies chips in the Han Chinese population. Non-HapMap Chinese samples (n = 396) were genotyped using the Illumina OmniExpress and Affymetrix 6.0 platforms, whereas a subset also were genotyped using the Immunochip. Genotyped markers from the Affymetrix 6.0 and Illumina OmniExpress were used for full genome imputation based on the HapMap 2 JPT+CHB (Japanese from Tokyo, Japan and Chinese from Beijing, China) reference panel. The concordance between markers genotypes for the three platforms was very high whether directly genotyped or genotyped and imputed single nucleotide polymorphisms (SNPs; .99.8% for directly genotyped and .99.5% for genotyped and imputed SNPs, respectively) were compared. The OmniExpress chip data enabled more SNPs to be imputed, particularly SNPs with minor allele frequency .5%. The OmniExpress chip achieved better coverage of HapMap SNPs than the Affymetrix 6.0 chip (73.6% vs. 65.9%, respectively, for minor allele frequency .5%). The Affymetrix 6.0 and Illumina OmniExpress chip have similar genotyping accuracy and provide similar accuracy of imputed SNPs. The OmniExpress chip however provides better coverage of Asian HapMap SNPs, although its coverage of HapMap SNPs is moderate. © 2013 Jiang et al.

Genome-wide association study identifies eight loci associated with blood pressure

Elevated blood pressure is a common, heritable cause of cardiovascular disease worldwide. To date, identification of common genetic variants influencing blood pressure has proven challenging. We tested 2.5 million genotyped and imputed SNPs for association with systolic and diastolic blood pressure in 34,433 subjects of European ancestry from the Global BPgen consortium and followed up findings with direct genotyping (N 71,225 European ancestry, N 12,889 Indian Asian ancestry) and in silico comparison (CHARGE consortium, N = 29,136). We identified association between systolic or diastolic blood pressure and common variants in eight regions near the CYP17A1 (P = 7 × 10 24), CYP1A2 (P = 1 × 10 23), FGF5 (P = 1 × 10 21), SH2B3 (P = 3 × 10 18), MTHFR (P = 2 × 10 13), c10orf107 (P = 1 × 10 9), ZNF652 (P = 5 × 10 9) and PLCD3 (P = 1 × 10 8) genes. All variants associated with continuous blood pressure were associated with dichotomous hypertension. These associations between common variants and blood pressure and hypertension offer mechanistic insights into the regulation of blood pressure and may point to novel targets for interventions to prevent cardiovascular disease.

Association scan of 14,500 nonsynonymous SNPs in four diseases identifies autoimmunity variants

We have genotyped 14,436 nonsynonymous SNPs (nsSNPs) and 897 major histocompatibility complex (MHC) tag SNPs from 1,000 independent cases of ankylosing spondylitis (AS), autoimmune thyroid disease (AITD), multiple sclerosis (MS) and breast cancer (BC). Comparing these data against a common control dataset derived from 1,500 randomly selected healthy British individuals, we report initial association and independent replication in a North American sample of two new loci related to ankylosing spondylitis, ARTS1 and IL23R, and confirmation of the previously reported association of AITD with TSHR and FCRL3. These findings, enabled in part by increased statistical power resulting from the expansion of the control reference group to include individuals from the other disease groups, highlight notable new possibilities for autoimmune regulation and suggest that IL23R may be a common susceptibility factor for the major 'seronegative' diseases.

Localization of type 1 diabetes susceptibility to the MHC class I genes HLA-B and HLA-A

The major histocompatibility complex (MHC) on chromosome 6 is associated with susceptibility to more common diseases than any other region of the human genome, including almost all disorders classified as autoimmune. In type 1 diabetes the major genetic susceptibility determinants have been mapped to the MHC class II genes HLA-DQB1 and HLA-DRB1 (refs 1–3), but these genes cannot completely explain the association between type 1 diabetes and the MHC region4, 5, 6, 7, 8, 9, 10, 11. Owing to the region's extreme gene density, the multiplicity of disease-associated alleles, strong associations between alleles, limited genotyping capability, and inadequate statistical approaches and sample sizes, which, and how many, loci within the MHC determine susceptibility remains unclear. Here, in several large type 1 diabetes data sets, we analyse a combined total of 1,729 polymorphisms, and apply statistical methods—recursive partitioning and regression...

A follow up MRI-based geometry and computational fluid dynamics study of carotid bifurcation

Cardiovascular disease is the leading causes of death in the developed world. Wall shear stress (WSS) is associated with the initiation and progression of atherogenesis. This study combined the recent advances in MR imaging and computational fluid dynamics (CFD) and evaluated the patient-specific carotid bifurcation. The patient was followed up for 3 years. The geometry changes (tortuosity, curvature, ICA/CCA area ratios, central to the cross-sectional curvature, maximum stenosis) and the CFD factors (Velocity distribute, Wall Shear Stress (WSS) and Oscillatory Shear Index (OSI)) were compared at different time points.The carotid stenosis was a slight increase in the central to the cross-sectional curvature, and it was minor and variable curvature changes for carotid centerline. The OSI distribution presents ahigh-values in the same region where carotid stenosis and normal border, indicating complex flow and recirculation.The significant geometric changes observed during the follow-up may also cause significant changes in bifurcation hemodynamics.

Effect of inflow and outflow angles on the computational hemodynamics in abdominal aortic aneurysm

To help with the clinical screening and diagnosis of abdominal aortic aneurysm (AAA), we evaluated the effect of inflow angle (IA) and outflow bifurcation angle (BA) on the distribution of blood flow and wall shear stress (WSS) in an idealized AAA model. A 2D incompressible Newtonian flow is assumed and the computational simulation is performed using finite volume method. The results showed that the largest WSS often located at the proximal and the distal end of the AAA. An increase in IA resulted in an increase in maximum WSS. We also found that WSS was maximal when BA was 90°. IA and BA are two important geometrical factors, they may help with AAA risk assessment along with the commonly used AAA diameter.

Mechanical analysis of foot plantar fascia during normal walking condition

Foot plantar fascia is an important foot tissue in stabilizing the longitudinal arch of human foot. Direct measurement to monitor the mechanical situation of plantar fascia at human locomotion is difficult. The purpose of this study was to construct a three-dimensional finite element model of the foot to calculate the internal stress/strain value of plantar fascia during different stage of gait. The simulated stress distribution of plantar fascia was the lowest at heel-strike, which concentrated on the medial side of calcaneal tubercle. The peak stress of plantar fascia was appeared at push-off, and the value is more than 5 times of the heel-strike position. Current FE model was able to explore the plantar fascia tension trend at the main sub-phases of foot. More detailed fascia model and intrinsic muscle forces could be developed in the further study.

Inverse Correlation between Vitamin D and C-Reactive Protein in Newborns

Some studies suggested that adequate vitamin D might reduce inflammation in adults. However, little is known about this association in early life. We aimed to determine the relationship between cord blood 25-hydroxyvitamin D (25(OH)D) and C-reactive protein (CRP) in neonates. Cord blood levels of 25(OH)D and CRP were measured in 1491 neonates in Hefei, China. Potential confounders including maternal sociodemographic characteristics, perinatal health status, lifestyle, and birth outcomes were prospectively collected. The average values of cord blood 25(OH)D and CRP were 39.43 nmol/L (SD = 20.35) and 6.71 mg/L (SD = 3.07), respectively. Stratified by 25(OH)D levels, per 10 nmol/L increase in 25(OH)D, CRP decreased by 1.42 mg/L (95% CI: 0.90, 1.95) among neonates with 25(OH)D <25.0 nmol/L, and decreased by 0.49 mg/L (95% CI: 0.17, 0.80) among neonates with 25(OH)D between 25.0 nmol/L and 49.9 nmol/L, after adjusting for potential confounders. However, no significant association between 25(OH)D and CRP was observed among neonates with 25(OH)D ≥50 nmol/L. Cord blood 25(OH)D and CRP levels showed a significant seasonal trend with lower 25(OH)D and higher CRP during winter-spring than summer-autumn. Stratified by season, a significant linear association of 25(OH)D with CRP was observed in neonates born in winter-spring (adjusted β = −0.11, 95% CI: −0.13, −0.10), but not summer-autumn. Among neonates born in winter-spring, neonates with 25(OH)D <25 nmol/L had higher risk of CRP ≥10 mg/L (adjusted OR = 3.06, 95% CI: 2.00, 4.69), compared to neonates with 25(OH)D ≥25 nmol/L. Neonates with vitamin D deficiency had higher risk of exposure to elevated inflammation at birth.

Pack

Inspiration for this work came from my recent experience of living in Beijing, China. Having a massive population of over 21 million people, one cannot feel but just another number within the crowd of this hectic megalopolis. Society is conditioned to obey, to conform, with some cultures being more hard lined with their citizens than others. However, there is a desire within each of us to have freedom of expression… to project an identity, to be an individual… nevertheless a desire not to be different… to follow trends and fads… a desire to fit in and connect. Within the pack there is also the outcast… the one who is different… the one who does not fit in. Pack has been created to be absorbed and interpreted openly by each individual. Driven by repetition and cycles, I have used this choreographic approach as a metaphor for the daily routine inherent in one’s life.

Steel–concrete–steel sandwich system in Arctic offshore structure: Materials, experiments, and design

The gravity based structure (GBS) with external Steel–Concrete–Steel (SCS) sandwich ice-resistant wall has been developed for the Arctic oil and gas drilling. This paper firstly reported the experimental studies on the mechanical properties of steel and concretes under Arctic low temperature. With the test data, design equations were developed to incorporate the influences of the low temperature on these mechanical properties. Two types of Arctic GBS structure with flower-conical SCS sandwich shell type and plate type of ice-resistant wall have been developed for the Arctic offshore structure. Besides the studies on the materials, two SCS sandwich prototype shells and plates were, respectively, prepared and tested under patch loading that simulated the localized ice-contact pressure. The structural behaviors of the SCS sandwich structure under patch loading were reported and discussions were made on the influences of different parameters on the structural behavior of the structure. Analytical models were developed to predict the punching shear resistances of the SCS sandwich structure through modifying the code provisions. The accuracies of the developed analytical models were checked through validations against 27 tests in the literature. Corresponding design procedures on resistances of SCS sandwich structure were recommended based on these discussions and validations.

Sustainable conversion of cellulosic biomass to chemicals under visible-light irradiation

For the first time, the conversion of crystalline cellulose to valuable chemicals was enhanced by visible-light irradiation using zeolite-based gold nanoparticles (Au-NPs). This plasmon-enhanced photocatalytic conversion significantly improved processing efficiency and achieved a high yield of 60% at relatively low temperature. Moreover, the photocatalytic properties of the photocatalysts varied with the light intensity and the irradiation wavelength.