Parametrized actor-critic algorithms for finite-horizon MDPs

Due to their non-stationarity, finite-horizon Markov decision processes (FH-MDPs) have one probability transition matrix per stage. Thus the curse of dimensionality affects FH-MDPs more severely than infinite-horizon MDPs. We propose two parametrized 'actor-critic' algorithms to compute optimal policies for FH-MDPs. Both algorithms use the two-timescale stochastic approximation technique, thus simultaneously performing gradient search in the parametrized policy space (the 'actor') on a slower timescale and learning the policy gradient (the 'critic') via a faster recursion. This is in contrast to methods where critic recursions learn the cost-to-go proper. We show w.p 1 convergence to a set with the necessary condition for constrained optima. The proposed parameterization is for FHMDPs with compact action sets, although certain exceptions can be handled. Further, a third algorithm for stochastic control of stopping time processes is presented. We explain why current policy evaluation methods do not work as critic to the proposed actor recursion. Simulation results from flow-control in communication networks attest to the performance advantages of all three algorithms.

Cytotoxicity of half sandwich ruthenium(II) complexes with strong hydrogen bond acceptor ligands and their mechanism of action

Neutral and cationic organometallic ruthenium(II) piano stool complexes of the type [(eta(6)-cymene)R-uCl(X)(Y)] (complexes R1-R8) has been synthesized and characterized. In cationic complexes, X, Y is either a eta(2) phosphorus ligand such as 1,1-bis(diphenylphosphino)methane (DPPM) and 1,2-bis(diphenylphosphino)ethane (DPPE) or partially oxidized ligands such as 1,2-bis(diphenylphosphino)methane monooxide (DPPMO) and 1,2-bis(diphenylphosphino)ethane monooxide (DPPEO) which are strong hydrogen bond acceptors. In neutral complexes. X is chloride and Y is a monodentate phosphorous donor. Complexes with DPPM and DPPMO ligands ([(eta(6)-cymene)Ru(eta(2)-DPPM)Cl]PF6 (R2), [(eta(6)-cymene)Ru(eta(2)-DPPMO)Cl]PF6 (R3), [(eta(6)-cymene)Ru(eta(1)-DPPM)Cl-2] (R5) and [(eta(6)-cymene)Ru(eta(1)-DPPMO)Cl-2] (R6) show good cytotoxicity. Growth inhibition study of several human cancer cell lines by these complexes has been carried out. Mechanistic studies for R5 and R6 show that inhibition of cancer cell growth involves both cell cycle arrest and apoptosis induction. Using an apoptosis PCR array, we identified the sets of antiapoptotic genes that were down regulated and pro-apoptotic genes that were up regulated. These complexes were also found to be potent metastasis inhibitors as they prevented cell invasion through matrigel. The complexes were shown to bind DNA in a non intercalative fashion and cause unwinding of plasmid DNA in cell-free medium by competitive ethidium bromide binding, viscosity measurements, thermal denaturation and gel mobility shift assays.

Human Action Recognition in Compressed Domain using PBL-McRBFN Approach

Large variations in human actions lead to major challenges in computer vision research. Several algorithms are designed to solve the challenges. Algorithms that stand apart, help in solving the challenge in addition to performing faster and efficient manner. In this paper, we propose a human cognition inspired projection based learning for person-independent human action recognition in the H.264/AVC compressed domain and demonstrate a PBL-McRBEN based approach to help take the machine learning algorithms to the next level. Here, we use gradient image based feature extraction process where the motion vectors and quantization parameters are extracted and these are studied temporally to form several Group of Pictures (GoP). The GoP is then considered individually for two different bench mark data sets and the results are classified using person independent human action recognition. The functional relationship is studied using Projection Based Learning algorithm of the Meta-cognitive Radial Basis Function Network (PBL-McRBFN) which has a cognitive and meta-cognitive component. The cognitive component is a radial basis function network while the Meta-Cognitive Component(MCC) employs self regulation. The McC emulates human cognition like learning to achieve better performance. Performance of the proposed approach can handle sparse information in compressed video domain and provides more accuracy than other pixel domain counterparts. Performance of the feature extraction process achieved more than 90% accuracy using the PTIL-McRBFN which catalyzes the speed of the proposed high speed action recognition algorithm. We have conducted twenty random trials to find the performance in GoP. The results are also compared with other well known classifiers in machine learning literature.

Mycobacterium tuberculosis pantothenate kinase: possible changes in location of ligands during enzyme action

The crystal structures of complexes of Mycobacterium tuberculosis pantothenate kinase with the following ligands have been determined: (i) citrate; (ii) the nonhydrolysable ATP analogue AMPPCP and pantothenate (the initiation complex); (iii) ADP and phosphopantothenate resulting from phosphorylation of pantothenate by ATP in the crystal (the end complex); (iv) ATP and ADP, each with half occupancy, resulting from a quick soak of crystals in ATP (the intermediate complex); (v) CoA; (vi) ADP prepared by soaking and cocrystallization, which turned out to have identical structures, and (vii) ADP and pantothenate. Solution studies on CoA binding and catalytic activity have also been carried out. Unlike in the case of the homologous Escherichia coli enzyme, AMPPCP and ADP occupy different, though overlapping, locations in the respective complexes; the same is true of pantothenate in the initiation complex and phosphopantothenate in the end complex. The binding site of MtPanK is substantially preformed, while that of EcPanK exhibits considerabl plasticity. The difference in the behaviour of the E. coli and M. tuberculosis enzymes could be explained in terms of changes in local structure resulting from substitutions. It is unusual for two homologous enzymes to exhibit such striking differences in action. Therefore, the results have to be treated with caution. However, the changes in the locations of ligands exhibited by M. tuberculosis pantothenate kinase are remarkable and novel.

Xylan-Degrading Enzymes from the Thermophilic Fungus Humicola Zanuginosa (Griffon and Maublanc) Bunce: Action Pattern of Xylanase and beta-Glucosidase on Xylans, Xylooligomers and Arabinoxylooligomers

The mode of action of xylanase and beta-glucosidase purified from the culture filtrate of Humicola lanuginosa (Griffon and Maublanc) Bunce on the xylan extracted from sugarcane bagasse and on two commercially available larchwood and oat spelt xylans, on xylooligomers and on arabinoxylooligomers was studied. While larchwood and oat spelt xylans were hydrolyzed to the same extent in 24 h, sugarcane bagasse xylan was hydrolyzed to a lesser extent in the same period. It was found that the rate of hydrolysis of xylooligomers by xylanase increased with increase in chain length, while beta-glucosidase acted rather slowly on all the oligomers tested. Xylanase exhibited predominant ''endo'' action on xylooligomers attacking the xylan chain at random while beta-glucosidase had ''exo'' action, releasing one xylose residue at a time. On arabinoxylooligomers, however, xylanase exhibited ''exo'' action. Thus, it appears that the presence of the arabinose substituent has, in some way, rendered the terminal xylose-xylose linkage more susceptible to xylanase action. It was also observed that even after extensive hydrolysis with both the enzymes, substantial amounts of the parent arabinoxylooligomer remained unhydrolyzed together with the accumulation of arabinoxylobiose. It can therefore be concluded that the presence of the arabinose substituent in the xylan chain results in linkages that offer resistance to both xylanase and beta-glucosidase action.

Identification of putative regulatory motifs in the upstream regions of co-expressed functional groups of genes in Plasmodium falciparum

Background: Regulation of gene expression in Plasmodium falciparum (Pf) remains poorly understood. While over half the genes are estimated to be regulated at the transcriptional level, few regulatory motifs and transcription regulators have been found. Results: The study seeks to identify putative regulatory motifs in the upstream regions of 13 functional groups of genes expressed in the intraerythrocytic developmental cycle of Pf. Three motif-discovery programs were used for the purpose, and motifs were searched for only on the gene coding strand. Four motifs – the 'G-rich', the 'C-rich', the 'TGTG' and the 'CACA' motifs – were identified, and zero to all four of these occur in the 13 sets of upstream regions. The 'CACA motif' was absent in functional groups expressed during the ring to early trophozoite transition. For functional groups expressed in each transition, the motifs tended to be similar. Upstream motifs in some functional groups showed 'positional conservation' by occurring at similar positions relative to the translational start site (TLS); this increases their significance as regulatory motifs. In the ribonucleotide synthesis, mitochondrial, proteasome and organellar translation machinery genes, G-rich, C-rich, CACA and TGTG motifs, respectively, occur with striking positional conservation. In the organellar translation machinery group, G-rich motifs occur close to the TLS. The same motifs were sometimes identified for multiple functional groups; differences in location and abundance of the motifs appear to ensure different modes of action. Conclusion: The identification of positionally conserved over-represented upstream motifs throws light on putative regulatory elements for transcription in Pf.

Action of Transition Metal Oxides on Composite Solid Propellants

The catalytic effects of Fe2O3, Ni2O3, MnO2, and Co2O3 transition metal oxides (TMO) on the combustion of polystyrene and carboxyl-terminated polybutadiene were investigated. The order of activity of TMO's was explained by the presence of Co and absence of Fe and Ni in their lattice systems along with a reduced electron-transfer process; in systems which induce the metal ions to enter the lattice, the electron transfer process is much greater. The thermal decomposition of ammonium perchlorate propellants was enhanced to a greater extent by Co2O3 and MnO2 than by Fe2O3 and Ni2O3.

Paracrine action of sFLT-1 secreted by stably-transfected Ehrlich ascites tumor cells and therapy using sFLT-1 inhibits ascites tumor growth in vivo

Background Vascular endothelial growth factor (VEGF) is known to play a major role in angiogenesis. A soluble form of Flt-1, a VEGF receptor, is potentially useful as an antagonist of VEGF, and accumulating evidence suggests the applicability of sFlt-1 in tumor suppression. In the present study, we have developed and tested strategies targeted specifically to VEGF for the treatment of ascites formation.Methods As an initial strategy, we produced recombinant sFLT-1 in the baculovirus expression system and used it as a trap to sequester VEGF in the murine ascites carcinoma model. The effect of the treatment on the weight of the animal, cell number, ascites volume and proliferating endothelial cells was studied. The second strategy involved, producing Ehrlich ascites tumor (EAT) cells stably transfected with vectors carrying cDNA encoding truncated form of Flt-1 and using these cells to inhibit ascites tumors in a nude mouse model. Results The sFLT-1 produced by the baculovirus system showed potent antiangiogenic activity as assessed by rat cornea and tube formation assay. sFLT-1 treatment resulted in reduced peritoneal angiogenesis with a concomitant decrease in tumor cell number, volume of ascites, amount of free VEGF and the number of invasive tumor cells as assayed by CD31 staining. EAT cells stably transfected with truncated form of Flt-1 also effectively reduced the tumor burden in nude mice transplanted with these cells, and demonstrated a reduction in ascites formation and peritoneal angiogenesis. Conclusions The inhibition of peritoneal angiogenesis and tumor growth by sequestering VEGF with either sFlt-1 gene expression by recombinant EAT cells or by direct sFLT-1 protein therapy is shown to comprise a potential therapy. Copyright (C) 2009 John Wiley & Sons, Ltd.

Comment on path integration of a quadratic action with a generalized memory

Using the promeasure technique, we give an alternative evaluation of a path integral corresponding to a quadratic action with a generalized memory.

Comment on “path integration of a quadratic action with a generalized memory

Using the promeasure technique, we give an alternative evaluation of a path integral corresponding to a quadratic action with a generalized memory.

Reliable Means of Diagnosis and Serovar Determination of Blood-Borne Salmonella Strains: Quick PCR Amplification of Unique Genomic Loci by Novel Primer Sets

Typhoid fever is becoming an ever increasing threat in the developing countries. We have improved considerably upon the existing PCR-based diagnosis method by designing primers against a region that is unique to Salmonella enterica subsp. enterica serovar Typhi and Salmonella enterica subsp. enterica serovar Paratyphi A, corresponding to the STY0312 gene in S. Typhi and its homolog SPA2476 in S. Paratyphi A. An additional set of primers amplify another region in S. Typhi CT18 and S. Typhi Ty2 corresponding to the region between genes STY0313 to STY0316 but which is absent in S. Paratyphi A. The possibility of a false-negative result arising due to mutation in hypervariable genes has been reduced by targeting a gene unique to typhoidal Salmonella serovars as a diagnostic marker. The amplified region has been tested for genomic stability by amplifying the region from clinical isolates of patients from various geographical locations in India, thereby showing that this region is potentially stable. These set of primers can also differentiate between S. Typhi CT18, S. Typhi Ty2, and S. Paratyphi A, which have stable deletions in this specific locus. The PCR assay designed in this study has a sensitivity of 95% compared to the Widal test which has a sensitivity of only 63%. As observed, in certain cases, the PCR assay was more sensitive than the blood culture test was, as the PCR-based detection could also detect dead bacteria.

Mechanistic studies on the action of ammonium phosphate on polymer fire retardancy

The mechanism of fire retardant action of mono- and diammonium phosphates on polystyrene has been investigated. Ignition delay and mass burning rate studies reveal that the phosphates bring down both parameters considerably though to different extents. This has been adequately explained on the basis of the existing combustion models and physicochemical behavior of the material. Similar to their action on cellulosic materials, phosphates bring about fire retardancy in polystyrene via char formation. This is suggested to occur through a series of processes consisting of initial peroxide formation, decomposition to alcohols and aldehydes, formation of alkyl-phosphate esters, dehydration and subsequent char formation. Infrared and mass spectral studies support this mechanism.

Studies on the Mechanism of Action of Miconazole: Effect of Miconazole on Respiration and Cell Permeability of Candida albicans

The antifungal drug, miconazole nitrate, inhibits the growth of several species of Candida. Candida albicans, one of the pathogenic species, was totally inhibited at a concentration of approximately 10 μg/ml. Endogenous respiration was unaffected by the drug at a concentration as high as 100 μg/ml, whereas exogenous respiration was markedly sensitive and inhibited to an extent of 85%. The permeability of the cell membrane was changed as evidenced by the leakage of 260-nm absorbing materials, amino acids, proteins, and inorganic cations. The results we present clearly show that the drug alters the cellular permeability, and thus the exogenous respiration becomes sensitive to the drug.

Studies on the mechanism of follitropin action at the cellular level

With a view toward understanding better the mechanism of action of follitropin, an attempt was made using granulosa cells obtained from intact immature estrogenized rats to study in short-term incubations the effect of highly purified ovine follitropin on the binding of the hormone to the cells and the associated aromatase response. A modified radioimmunoassay procedure has been used to monitor unlabeled physiologically fully active follitropin bound to the cell. A linear relationship between the actual amount of hormone bound to the cells and the estradiol produced in vitro has been established. The amount of ovine follitropin bound that can elicit a half-maximal response in estrogen production was calculated to be 400 pg. The number of follitropin binding sites per cell was 375 and the Kd of binding was 3.03 × 10−10 Image . By the addition of ovine follitropin antiserum at different time points of a 4-h incubation period, a continual need for follitropin support for estradiol production has been established.