An Online Actor-Critic Algorithm with Function Approximation for Constrained Markov Decision Processes

We develop an online actor-critic reinforcement learning algorithm with function approximation for a problem of control under inequality constraints. We consider the long-run average cost Markov decision process (MDP) framework in which both the objective and the constraint functions are suitable policy-dependent long-run averages of certain sample path functions. The Lagrange multiplier method is used to handle the inequality constraints. We prove the asymptotic almost sure convergence of our algorithm to a locally optimal solution. We also provide the results of numerical experiments on a problem of routing in a multi-stage queueing network with constraints on long-run average queue lengths. We observe that our algorithm exhibits good performance on this setting and converges to a feasible point.

A POSTERIORI ERROR CONTROL OF DISCONTINUOUS GALERKIN METHODS FOR ELLIPTIC OBSTACLE PROBLEMS

In this article, we derive an a posteriori error estimator for various discontinuous Galerkin (DG) methods that are proposed in (Wang, Han and Cheng, SIAM J. Numer. Anal., 48: 708-733, 2010) for an elliptic obstacle problem. Using a key property of DG methods, we perform the analysis in a general framework. The error estimator we have obtained for DG methods is comparable with the estimator for the conforming Galerkin (CG) finite element method. In the analysis, we construct a non-linear smoothing function mapping DG finite element space to CG finite element space and use it as a key tool. The error estimator consists of a discrete Lagrange multiplier associated with the obstacle constraint. It is shown for non-over-penalized DG methods that the discrete Lagrange multiplier is uniformly stable on non-uniform meshes. Finally, numerical results demonstrating the performance of the error estimator are presented.

A Constitutive Equation for Grain Boundary Sliding: An Experimental Approach

Although grain boundary sliding (GBS) has been recognized as an important process during high-temperature deformation in crystalline materials, there is paucity in experimental data for characterizing a constitutive equation for GBS. High-temperature tensile creep experiments were conducted, together with measurements of GBS at different strains, stresses, grain sizes, and temperatures. Experimental data obtained on a Mg AZ31 alloy demonstrate that, for the first time, dynamic recrystallization during creep does not alter the contribution of GBS to creep during high-temperature deformation. The experimentally observed invariance of the sliding contribution with strain was used together with the creep data for developing a constitutive equation for GBS in a manner similar to the standard creep equation. Using this new approach, it is demonstrated that the stress, grain size, and temperature dependence for creep and GBS are identical. This is rationalized by a model based on GBS controlled by dislocations, within grains or near-grain boundaries. (C) The Minerals, Metals & Materials Society and ASM International 2013

A three-component protocol for the enantiodifferentiation of amines using triphenyl borate and BINOL: is it an ion pair or an amine-coordinated complex?

The structure of the borate complex responsible for the enantiodifferentiation of amines using a previously reported three-component protocol has been established. The choice between an ion pair and an amine-coordinated complex with the N atom of the amine coordinated to the B atom is favored for the former structure based on the DFT-calculated B-11 NMR chemical shifts. In contrast to expectations, the anisotropies of the quadrupolar B-11 nucleus for the two structures were calculated to be indistinguishable with regard to their effect on the linewidth of the NMR signal. (C) 2014 Elsevier Ltd. All rights reserved.

First principles DFT investigation Of Yttrium-decorated Boron-Nitride Nanotube: Electronic Structure and Hydrogen Storage

The electronic structure and hydrogen storage capability of Yttrium-doped BNNTs has been theoretically investigated using first principles density functional theory (DFT). Yttrium atom prefers the hollow site in the center of the hexagonal ring with a binding energy of 0.8048eV. Decorating by Y makes the system half-metallic and magnetic with a magnetic moment of 1.0 mu(B). Y decorated Boron-Nitride (8,0) nanotube can adsorb up to five hydrogen molecules whose average binding energy is computed as 0.5044eV. All the hydrogen molecules are adsorbed with an average desorption temperature of 644.708 K. Taking that the Y atoms can be placed only in alternate hexagons, the implied wt% comes out to be 5.31%, a relatively acceptable value for hydrogen storage materials. Thus, this system can serve as potential hydrogen storage medium.

潮汐调和分析与预报系统

为满足近海勘测前预测海域潮位的需要,利用VC++设计开发一个集潮汐调和分析及预报于一体的系统. 输入与勘测作业海域相近的潮汐观测站点数据,利用该系统的调和分析模块可得到30个分潮的潮汐调和常数,进而用于勘测施工海域的潮位预报. 该系统用户界面友好、操作简便、精度高、通用性强,在近海勘测作业中预估海域潮位具有实用和推广价值.

Disciplinamento do processo e julgamento do mandado de injunção : uma análise sistemática

Analisa o Projeto de Lei nº 6.002/1990 e apensos, que pretendem disciplinar o processo e julgamento do mandado de injunção individual e coletivo. A abordagem e o desenvolvimento da pesquisa serão realizados no contexto da judicialização da política ou do ativismo judicial, questionando-se qual será a efetividade dos limites/parâmetros impostos ao Supremo Tribunal Federal, acaso o Projeto de Lei nº 6.002/1990 e apensos, se transformem em norma jurídica. Tem-se como hipótese compreender se o pretenso disciplinamento limitará o ativismo judicial que retira o protagonismo do Poder Legislativo e o seu papel preponderante de poder legiferante. Os objetivos específicos da pesquisa são examinar a extensão e os efeitos das decisões do Supremo Tribunal Federal no julgamento de alguns mandados de injunção; avaliar se a conduta omissiva do Poder Legislativo causa prejuízos à sua própria imagem e se essa omissão inviabiliza o exercício de direitos, liberdades e prerrogativas constitucionais. A metodologia do trabalho será balizada na análise sistemática dos Mandados de Injunção números 107/1989-DF, 631/2000-MS, 670/2002-ES, 708/2004-DF, 712/2004-PA, 721/2005- DF, 758/2007-DF, 786/2007-DF e 795/2007-DF; na análise do Projeto de Lei nº 6.002/1990 e apensos; na Constituição Federal. O trabalho terá como principais referenciais teóricos e conceituais fontes e bibliografia apropriadas, a exemplo dos doutrinadores Alexandre de Moraes, Cândido Rangel Dinamarco, José Afonso da Silva, José Joaquim Gomes Canotilho,Luís Roberto Barroso e Manoel Gonçalves Ferreira Filho.

水平分支管路中油水两相流动研究

该文研究了两种直径的直管油水两相流动对流型和相含率的影响和在不同管径的水平并行分支管路中的相含率变化规律。实验设备包括内径为50mm的水平主管道和内径为25mm的分支管路。得到了不同入口条件下实验管段的流型和相含率图。实验指出:管道的尺度变化对于流型的影响较小,但对于油水两相的相含率和速度滑移有显著的作用。当油水两相流在并行分支管路中同时流动时,随着入口处水的表观流速增大,并行主管的截面油含率与并行分支管的差距逐渐缩小。

P.v.b. virgillii maronis : bucolicorum, eclogaex., georgicorum, libri iii., aeneidos, libri xii. et in ea, mauri servii honorati : grammatici comentarii, ex antiquiss : exemplaribus longe meliores et auctiores : ex bibliotheca petri danielis i.c. : accessit fabij planciadis fulgentij liber de continentia virgiliana, auctior e mss. codd. item iunij philargyrij commentariolus in bucolica & georgica virgilij. : cum certissimo et copiosissimo indice

As Bucólicas são constituídas de dez éclogas, consideradas como traduzidas ou imitadas de Teócrito. As Geórgias são um poema didático no qual se acentua a predileção de Virgílio pela vida campestre. A Eneida é uma utopia política que o poeta não conseguiu acabar e foi publicada contra a sua vontade expressa.

Diário da Constituinte [gravação de vídeo] : [programa n. 680 2ª ed.]

Os constituintes já garantiram vários aspectos dos direitos individuais e coletivos. Já aprovaram 27 incisos, mas faltam 57. Os direitos já foram garantidos: habeas data, defesa do consumidor, racismo como crime inafiançável, mandado de segurança e injunção. Os constituintes pedem maior rigor aos faltantes. O presidente Ulysses solicita a presença em plenário para a votação do 2º turno da Assembléia Constituinte, que deverá votar 708 destaques.

Diário da Constituinte [gravação de vídeo] : [programa n. 680 2ª ed.]

Ulysses Guimarães faz apelo para a votação do segundo turno, que deve terminar o Capítulo das Liberdades Individuais e Coletivas, ainda faltam 56 incisos para votação neste capítulo. Já foram aprovados 27 incisos e são dados como certo de aprovação: o habeas data, a defesa do consumidor, racismo, o mandado de injunção e coletivo. Os direitos individuais recebem o apoio de todos os setores. Ulysses Guimarães apela para que os constituintes compareçam para a votação do 2º turno para apreciar 708 destaques.

Optimum hot electron production with low-density foams for laser fusion by fast ignition

We propose a foam cone-in-shell target design aiming at optimum hot electron production for the fast ignition. A thin low-density foam is proposed to cover the inner tip of a gold cone inserted in a fuel shell. An intense laser is then focused on the foam to generate hot electrons for the fast ignition. Element experiments demonstrate increased laser energy coupling efficiency into hot electrons without increasing the electron temperature and beam divergence with foam coated targets in comparison with solid targets. This may enhance the laser energy deposition in the compressed fuel plasma.