Two timescale convergent Q-learning for sleep-scheduling in wireless sensor networks

In this paper, we consider an intrusion detection application for Wireless Sensor Networks. We study the problem of scheduling the sleep times of the individual sensors, where the objective is to maximize the network lifetime while keeping the tracking error to a minimum. We formulate this problem as a partially-observable Markov decision process (POMDP) with continuous stateaction spaces, in a manner similar to Fuemmeler and Veeravalli (IEEE Trans Signal Process 56(5), 2091-2101, 2008). However, unlike their formulation, we consider infinite horizon discounted and average cost objectives as performance criteria. For each criterion, we propose a convergent on-policy Q-learning algorithm that operates on two timescales, while employing function approximation. Feature-based representations and function approximation is necessary to handle the curse of dimensionality associated with the underlying POMDP. Our proposed algorithm incorporates a policy gradient update using a one-simulation simultaneous perturbation stochastic approximation estimate on the faster timescale, while the Q-value parameter (arising from a linear function approximation architecture for the Q-values) is updated in an on-policy temporal difference algorithm-like fashion on the slower timescale. The feature selection scheme employed in each of our algorithms manages the energy and tracking components in a manner that assists the search for the optimal sleep-scheduling policy. For the sake of comparison, in both discounted and average settings, we also develop a function approximation analogue of the Q-learning algorithm. This algorithm, unlike the two-timescale variant, does not possess theoretical convergence guarantees. Finally, we also adapt our algorithms to include a stochastic iterative estimation scheme for the intruder's mobility model and this is useful in settings where the latter is not known. Our simulation results on a synthetic 2-dimensional network setting suggest that our algorithms result in better tracking accuracy at the cost of only a few additional sensors, in comparison to a recent prior work.

Los Suelos de la Finca "Las Mercedes" y las propiedades más relevantes para planear su uso y manejo

Este trabajo se efectuó en la finca “las mercedes” propiedad del instituto superior de ciencias agropecuarias. Consistió en realizar un levantamiento de suelos a nivel muy detallado (escala 1.5, 000), con la finalidad de conocer las principales propiedades de sus suelos. Estas propiedades resultan del proceso de información y evaluación del suelos y su conocimiento permite elaborar criterios valioso para plantear el uso y manejo más propiado para la finca. El patrón de distribución de los suelos y la delimitación de sus linderos se realizó mediante un muestreo sistemático, además se hizo la descripción y toma de muestra en calicatas, para su posterior análisis en el laboratorio. Se hicieron pruebas de permeabilidad e infiltración básica.

Genetic improvement and effective dissemination: keys to prosperous and sustainable aquaculture industries

There is an increasing demand for fish in the world due to a growing population, better economic situation in some sectors, and greater awareness of health issues in relation to food. Since capture fisheries have stagnated, fish farming has become a very fast growing food production system. In this presentation, the author gives an overview of the technologies that are available for genetic improvement of fish, and briefly discuss their merit in the context of a sustainable development. He also discusses the essential prerequisites for effective dissemination of improved stock to farmers. It is concluded that genetic improvement programs based on selective breeding can substantially contribute to sustainable fish production systems. Furthermore, if such genetic improvement programs are followed up with effective dissemination strategies, they can result in a positive impact on farmers' incomes.

Enfermagem cuidando do recém-nascido na Unidade de Terapia Intensiva Neonatal: um olhar ético da ação profissional

Trata-se de um estudo do tipo qualitativo, sobre as ações experienciadas pela equipe de enfermagem no cotidiano da Unidade de Terapia Intensiva Neonatal (UTI Neonatal), tendo como objetivo apreender os aspectos éticos implícitos nas ações experienciadas pelos profissionais de enfermagem ao cuidar do recém-nascido (RN). Foram utilizados como referencial teórico-filosófico alguns autores renomados como: Mehry, Pegoraro, Pessini, entre outros. A abordagem metodológica aplicada no estudo foi a fenomenologia sociológica de Alfred Schutz, buscando, na intencionalidade das ações de enfermagem, a motivação que sustenta este cuidar. A aproximação face a face aos sujeitos do estudo deu-se solicitando o seguinte: Fale-me sobre a sua experiência ao cuidar de um RN no cotidiano da UTI. Para alcançar o objetivo proposto, utilizei as questões orientadoras da entrevista fenomenológica: O que você tem em vista ao cuidar do RN na UTI? Em relação à ética, o que você pensa ao cuidar do RN? As entrevistas foram realizadas com 16 profissionais da equipe de enfermagem da UTI de uma Maternidade Pública do Município do Rio de Janeiro, escolhidos de forma aleatória. Foram respeitados os critérios estabelecidos pela Resolução n 196/96, garantindo a privacidade e o anonimato dos entrevistados, bem como aprovação do estudo pelo comitê de ética em pesquisa. A partir da análise das falas emergiram três categorias, que possibilitaram a apreensão dos aspectos éticos das ações de enfermagem na UTI como um típico. Esses profissionais têm em vista realizar o melhor cuidado desejando a cura e a alta do RN, apoiando-se na tecnologia para valorizar a perspectiva humana do cuidado na UTI e na possibilidade de agir com ética. Na realidade pesquisada, a tecnologia manifestou-se de maneira positiva no projeto intencional dos profissionais, mostrando uma enfermagem que acredita estar fazendo o seu melhor, envolvida com as questões éticas e humanas. A apreensão do típico da ação e compreensão do cotidiano da equipe de enfermagem permitirá uma avaliação crítica e reflexiva sobre a adequação da tecnologia no cuidado neonatal, bem como a adoção de medidas e estratégias que valorizem e respeitem a vida humana em toda a sua dimensão. Ratifica a sensibilidade, intuição e percepção do cuidador, propiciando um cuidado individualizado e personalizado ao RN e sua família. Além disso, contribui para se repensar novas maneiras de cuidar, utilizando a arte e a criatividade na adequação e humanização das tecnologias.

双程掺镱光纤放大器的增益特征及优化

比较了掺钕光纤和掺镱光纤对1064nm光放大的特点．基于速率方程和传输方程，数值分析了在915nm泵浦下双程掺镱光纤放大器的增益特征，并且和传统的单程放大进行了比较．分析了信号光和泵浦光，以及粒子数沿着光纤方向的分布特点．最后对双程掺镱光纤放大器进行了优化．

Line-width reduction of a laser diode array using an external cavity with two feedback mirrors

A novel Littman-Metcalf external cavity laser diode array with two feedback mirrors is introduced. The line-width broadening effect caused by smile can be reduced by the novel external cavity. At the drive current of 16A, the line-width is narrowed to 0.1nm from free-running width of 1.6nm with output efficiency of 84%.

创新工程结硕果

中国科学院昆明动物研究所始建于1959年. 历经40余年的艰苦努力, 现已发展成为具有一定规模和特色、多学科相互交叉渗透的综合性动物学研究机构. 1999～2000年, 在中国科学院知识创新工程建设的推动下, 昆明动物研究所在科研目标凝练和学科建设、创新机制转换、队伍建设和人才培养, 科研成果转化, 创新文化与园区建设等方面都取得了长足的进展。

Experimental observation of resonant modes in GaInAsP microsquare resonators

GaInAsP-InP microsquare resonators with InP pedestals are fabricated by two-step chemical etching, and obvious mode peaks are observed in the photoluminescence spectra of the resonators. The mode Q-factors about 500 are obtained for a microsquare resonator with the side length of 7 mu m. The experimental mode interval is in agreement with that predicted by the light ray method based on the cavity length, instead of that of the whispering-gallery (WG)-like modes, which has mode interval twice of that determined by the cavity length. The finite-difference time-domain simulation shows that a little asymmetry may greatly reduce the difference of the Q-factors between the WG-like modes and the other modes.

黑土中乙草胺吸附、迁移及微生物降解研究

东北黑土区是我国重要的商品粮生产基地，在保证我国的粮食安全中发挥着重要作用。随着生产的发展，多种农用化学品尤其是大量杀虫剂和除草剂进入黑土农田环境，在预防作物病虫害及减少人工劳动强度的同时，这些化学品在环境中会发生一系列复杂的物理、化学和生物化学反应，使黑土面临着环境安全危机。因此，研究农用化学品的土壤生态过程与黑土农田生态系统环境安全有关的科学问题显得尤为重要。 本文以东北地区广泛使用的除草剂乙草胺为代表，在推荐施用量条件下，通过室内恒温（25℃）避光培养试验，研究了乙草胺在黑土中的主要生态过程（降解、吸附）及在土壤中的残留时间特征，探讨了影响乙草胺生态过程行为的主要因素，同时利用磷脂脂肪酸（Phospholipid Fatty Acids，PLFAs）为标识物研究了土壤微生物对外源污染物的的响应。 研究结果表明：吸附是乙草胺在土壤中主要去向之一，高有机质黑土对乙草胺的吸附能力很强。微生物降解是乙草胺消失的另一个重要要因素，适当的水分有益于土壤中微生物生长，从而促进土壤中乙草胺降解，其中，细菌比真菌具有更强的降解乙草胺的能力；随着乙草胺的施药量增加，乙草胺总降解率下降。在乙草胺施入及降解过程中，土壤微生物群落不断发生变化，真菌PLFAs、细菌PLFAs；G+菌PLFAs、G-菌PLFAs数量及比例受到乙草胺施入的显著影响，细菌比真菌的变化更为显著。原位土壤中，乙草胺在表层土壤（0-10cm和10-20cm）微生物降解作用显著；而降水是促进乙草胺向深层次迁移的主要因素。 通过对乙草胺的主要生态过程进行研究，对深入探讨乙草胺生态环境安全性及合理使用除草剂有着重要的指导作用。

RNAi沉默烟草GA 20-氧化酶基因研究

赤霉素是一种高效能的广谱植物生长调节剂，为五大植物激素之一，具有重要的生物学功能。目前利用赤霉素突变体研究生物合成途径和信号转导已经成为热点。 GA 20-氧化酶是GA生物合成中的一类关键酶，它位于GA合成途径的中心位置。本研究根据烟草（Nicotiana tabacum）GA 20-氧化酶基因序列，设计2对分别含有特定酶切位点的特异引物，以烟草基因组DNA为模板，扩增目的基因(约250 bp)片段。将正、反向目的片段分别插入中间载体的内含子两侧，再经BamH I和Sac I双酶切回收约700 bp的目的片段，插入到双元载体质粒p2355中，成功构建了含GA 20-氧化酶基因片段反向重复序列的植物表达载体p23700。分别将p2355质粒和p23700质粒导入根癌农杆菌（Agrobacterium tumefaciens）EHA105中并转化烟草叶片细胞，经卡那霉素选择培养，PCR及GUS组织染色鉴定，获得转基因烟草植株。以EHA105-p2355转化的烟草，获得41株转基因植株，均没有矮化表型；而以EHA105-p23700转化的烟草，获得转基因植株14株，其中具有矮化表型的烟草10株，表明反向重复序列转录产物能形成发夹RNA(hpRNA)，产生小分子干扰RNA（small interferring RNA，简称siRNA），干扰目的基因的表达。 赤霉素含量测定表明矮化植株中赤霉素合成途径的最终产物GA3总含量明显低于野生型烟草植株。荧光定量PCR结果表明，矮化转基因烟草的GA 20-氧化酶基因表达量受到明显抑制，表达量明显低于野生型对照。同时对上游内根-贝壳杉合成酶（Ent-kaurene synthase，KS）基因，下游的GA-3β羟化酶基因进行了RT-PCR分析，结果显示上游基因的表达没有规律性变化，而下游基因表达量亦降低。上述结果表明，GA 20-氧化酶基因的表达被有效地干扰了，表达受到抑制，从而影响植株体内GA3的合成，影响植株的生长发育，导致植株矮化。并推测，GA 20-氧化酶基因受到抑制，可能影响下游基因的表达。并且通过干旱胁迫测试，发现矮化植株相对于野生型植株及不含干扰片段的转基因植株，对干旱的耐受力有了很大的提高，具有更强的耐受力。 研究结果为进一步进行相关研究奠定基础。 Gibberellin(GA) is an efficient plant growth regulator. As one of five major plant hormones, it plays an important biological function. Using GA mutant for investigating biosynthetic pathways and signal transduction has become high lights. GA 20-oxidase is a crucial enzyme involved in gibberellin biosynthesis. According to tobacco (Nicotiana tabacum) GA 20-oxidase enzyme gene sequence and based on binary vector p2355, we constructed a plant expression vector p23700, which habors an inverted repeat DNA fragment of GA 20-oxidase gene drivered by Cauliflower mosaic virus promtor (CaMV 35Sp). Binary plasmid p2355 had no inverted repeat DNA fragment of GA 20-oxidase gene. The vector p2355 and p23700 were introduced into Agrobacterium tumefaciens EHA105 and tobacco leaf transformation was conducted. After selected by kanamycin and characterized by PCR and GUS hischemical reaction, transsgenic plants were obtained. Fourtheen transgenic plants, which were transformed by EHA105-p23700, were obtained. Among them, 10 were dwarf mutants. However, 41 transgenic plants with the same normal phenotype as wild type,which were transformed by EHA105-p2355, were obtained. Analysis of Gibberellin contents showed that it was lower in dwarf mutants than in normal phenotype plants. Moreover, comparing to normal phenotype plants including wild type and transgenic plants with no interference fragment, the drought tolerance of dwarf plants have greatly increased. And their proline content increased obviously after drought test. Fluorescence quantitative real time PCR (RT-PCR) showed that GA 20-oxidase gene expression was significantly inhibited in dwarf transgenic tobacco. Meanwhile, the expression of the upstream gene ent-kaurene synthase (KS) gene and downstream gene GA-3β hydroxylase gene was also detected by RT-PCR. The results presented that KS gene expression had no regular change while GA-3β hydroxylase gene expression reduced. It implied that inhibiting GA 20-oxidase gene probably reduce the expression of downstream genes. The results showed that the transcriptional products of the foreign inverted repeat fragment can form hairpin RNA (hpRNA) to induce RNAi. It presented that GA 20-oxidase gene expression was effectively interfered, resulting in reducing GA3 synthesis and inhibiting plant growth and development, then dwarf plants were produced. However, the dwarf plants had higher tolerance of drought.