Solving MDPs using two-timescale simulated annealing with multiplicative weights

We develop extensions of the Simulated Annealing with Multiplicative Weights (SAMW) algorithm that proposed a method of solution of Finite-Horizon Markov Decision Processes (FH-MDPs). The extensions developed are in three directions: a) Use of the dynamic programming principle in the policy update step of SAMW b) A two-timescale actor-critic algorithm that uses simulated transitions alone, and c) Extending the algorithm to the infinite-horizon discounted-reward scenario. In particular, a) reduces the storage required from exponential to linear in the number of actions per stage-state pair. On the faster timescale, a 'critic' recursion performs policy evaluation while on the slower timescale an 'actor' recursion performs policy improvement using SAMW. We give a proof outlining convergence w.p. 1 and show experimental results on two settings: semiconductor fabrication and flow control in communication networks.

No-reference image quality assessment using modified extreme learning machine classifier

In this paper, we present a machine learning approach to measure the visual quality of JPEG-coded images. The features for predicting the perceived image quality are extracted by considering key human visual sensitivity (HVS) factors such as edge amplitude, edge length, background activity and background luminance. Image quality assessment involves estimating the functional relationship between HVS features and subjective test scores. The quality of the compressed images are obtained without referring to their original images ('No Reference' metric). Here, the problem of quality estimation is transformed to a classification problem and solved using extreme learning machine (ELM) algorithm. In ELM, the input weights and the bias values are randomly chosen and the output weights are analytically calculated. The generalization performance of the ELM algorithm for classification problems with imbalance in the number of samples per quality class depends critically on the input weights and the bias values. Hence, we propose two schemes, namely the k-fold selection scheme (KS-ELM) and the real-coded genetic algorithm (RCGA-ELM) to select the input weights and the bias values such that the generalization performance of the classifier is a maximum. Results indicate that the proposed schemes significantly improve the performance of ELM classifier under imbalance condition for image quality assessment. The experimental results prove that the estimated visual quality of the proposed RCGA-ELM emulates the mean opinion score very well. The experimental results are compared with the existing JPEG no-reference image quality metric and full-reference structural similarity image quality metric.

Heme biosynthesis by the malarial parasite - Import of delta-aminolevulinate dehydrase from the host red cell

The mouse and human malarial parasites, Plasmodium berghei and Plasmodium falciparum, respectively, synthesize heme de novo following the standard pathway observed in animals despite the availability of large amounts of heme, derived from red cell hemoglobin, which is stored as hemozoin pigment, The enzymes, delta-aminolevulinate dehydrase (ALAD), coproporphyrinogen oxidase, and ferrochelatase are present at strikingly high levels in the P, berghei infected mouse red cell in vivo, The isolated parasite has low levels of ALAD and the data clearly indicate it to be of red cell origin. The purified enzyme preparations from the uninfected red cell and the parasite are identical in kinetic properties, subunit molecular weight, cross-reaction with antibodies to the human enzyme, and N-terminal amino acid sequence. Immunogold electron microscopy of the infected culture indicates that the enzyme is present inside the parasite and, therefore, is not a contaminant, The parasite derives functional ALAD from the host and the enzyme binds specifically to isolated parasite membrane in vitro, suggestive of the involvement of a receptor in its translocation into the parasite, While, ALAD, coproporphyrinogen oxidase, and ferrochelatase from the parasite and the uninfected red cell supernatant have identical subunit molecular weights on SDS-polyacrylamide gel electrophoresis and show immunological cross-reaction with antibodies to the human enzymes, as revealed by Western analysis, the first enzyme of the pathway, namely, delta-aminolevulinate synthase (ALAS) in the parasite, unlike that of the red cell host, does not cross-react with antibodies to the human enzyme, However, ALAS enzyme activity in the parasite is higher than that of the infected red cell supernatant. We therefore conclude that the parasite, while making its own ALAS, imports ALAD and perhaps most of the other enzymes of the pathway from the host to synthesize heme de novo, and this would enable it to segregate this heme from the heme derived from red cell hemoglobin degradation, ALAS of the parasite and the receptor(s) involved in the translocation of the host enzymes into the parasite would be unique drug targets.

Synthesis and properties of main chain discotic liquid crystalline polyethers based on rufigallol

Two series of thermotropic main chain discotic liquid crystalline polyethers, PR4m-n, based on rufigallol were prepared starting from the symmetric tetraethers of rufigallol, R4m; m and n represent the number of carbon atoms in the side chain and spacer segment, respectively. The symmetric tetraethers were in turn readily prepared by selective alkylation of rufigallol under controlled phase-transfer conditions. GPC analysis of the polymers suggested that they were all of moderate molecular weights, with M-n varying between 5400 and 17 000. The length of the spacer segment n in these polyethers was systematically varied, and its effect on the phase transition temperatures and the mesophase structure was examined using DSC, polarized light microscopy, and X-ray diffraction. It is noticed that when the spacer lengths are relatively long(n greater than or equal to 2m), the isotropization temperature (TD-i) decreases as the spacer length n increases, an observation that is in accordance with those previously made. However, when the spacer lengths are relatively small (n < 2m), the dependence of TD-i is quite the opposite; TD-i actually increases with an increase in spacer length. Furthermore, X-ray diffraction studies indicate that, in the discotic columnar mesophases that are formed, the columns pack in a hexagonal manner when n greater than or equal to 2m, while they do so in a rectangular lattice when n < 2m, leading to the formation of Dh and Dr mesophases, respectively. Finally, comparison of the discotic polyethers with their low molar mass analogues confirms the role of polymerization in stabilizing the mesophase; while all the polymers exhibit columnar mesophases, some of their low molar mass analogues are not liquid crystalline.

SPSA Based Feature Relevance Estimation For Video Retrieval

With the availability of a huge amount of video data on various sources, efficient video retrieval tools are increasingly in demand. Video being a multi-modal data, the perceptions of ``relevance'' between the user provided query video (in case of Query-By-Example type of video search) and retrieved video clips are subjective in nature. We present an efficient video retrieval method that takes user's feedback on the relevance of retrieved videos and iteratively reformulates the input query feature vectors (QFV) for improved video retrieval. The QFV reformulation is done by a simple, but powerful feature weight optimization method based on Simultaneous Perturbation Stochastic Approximation (SPSA) technique. A video retrieval system with video indexing, searching and relevance feedback (RF) phases is built for demonstrating the performance of the proposed method. The query and database videos are indexed using the conventional video features like color, texture, etc. However, we use the comprehensive and novel methods of feature representations, and a spatio-temporal distance measure to retrieve the top M videos that are similar to the query. In feedback phase, the user activated iterative on the previously retrieved videos is used to reformulate the QFV weights (measure of importance) that reflect the user's preference, automatically. It is our observation that a few iterations of such feedback are generally sufficient for retrieving the desired video clips. The novel application of SPSA based RF for user-oriented feature weights optimization makes the proposed method to be distinct from the existing ones. The experimental results show that the proposed RF based video retrieval exhibit good performance.

Bounds on isoperimetric values of trees

Let G = (V, E) be a finite, simple and undirected graph. For S subset of V, let delta(S, G) = {(u, v) is an element of E : u is an element of S and v is an element of V - S} be the edge boundary of S. Given an integer i, 1 <= i <= vertical bar V vertical bar, let the edge isoperimetric value of G at i be defined as b(e)(i, G) = min(S subset of V:vertical bar S vertical bar=i)vertical bar delta(S, G)vertical bar. The edge isoperimetric peak of G is defined as b(e)(G) = max(1 <= j <=vertical bar V vertical bar)b(e)(j, G). Let b(v)(G) denote the vertex isoperimetric peak defined in a corresponding way. The problem of determining a lower bound for the vertex isoperimetric peak in complete t-ary trees was recently considered in [Y. Otachi, K. Yamazaki, A lower bound for the vertex boundary-width of complete k-ary trees, Discrete Mathematics, in press (doi: 10.1016/j.disc.2007.05.014)]. In this paper we provide bounds which improve those in the above cited paper. Our results can be generalized to arbitrary (rooted) trees. The depth d of a tree is the number of nodes on the longest path starting from the root and ending at a leaf. In this paper we show that for a complete binary tree of depth d (denoted as T-d(2)), c(1)d <= b(e) (T-d(2)) <= d and c(2)d <= b(v)(T-d(2)) <= d where c(1), c(2) are constants. For a complete t-ary tree of depth d (denoted as T-d(t)) and d >= c log t where c is a constant, we show that c(1)root td <= b(e)(T-d(t)) <= td and c(2)d/root t <= b(v) (T-d(t)) <= d where c(1), c(2) are constants. At the heart of our proof we have the following theorem which works for an arbitrary rooted tree and not just for a complete t-ary tree. Let T = (V, E, r) be a finite, connected and rooted tree - the root being the vertex r. Define a weight function w : V -> N where the weight w(u) of a vertex u is the number of its successors (including itself) and let the weight index eta(T) be defined as the number of distinct weights in the tree, i.e eta(T) vertical bar{w(u) : u is an element of V}vertical bar. For a positive integer k, let l(k) = vertical bar{i is an element of N : 1 <= i <= vertical bar V vertical bar, b(e)(i, G) <= k}vertical bar. We show that l(k) <= 2(2 eta+k k)

Isolation and characterization of binding proteins for retinol from the cytosol, nucleosol and chromatin of the oviduct magnum of laying hens

Protein fractions that bind retinol were isolated from the cytosol, nucleosol and chromatin of the oviduct magnum of laying hens. The proteins isolated from the three sources showed similar elution profiles on chromatography through Sephadex G-75 and G-50 columns, and comparable mobility during electrophoresis on sodium dodecyl sulphate/polyacrylamide gels. Their molecular weights were calculated to be around 14500. When oviducts from vitamin A-depleted and vitamin A-repleted immature chicks given oestrogen injections for 6 consecutive days were incubated with [3H]retinyl acetate, uptake of the radioactivity in the nuclei of the vitamin A-depleted tissue was severalfold higher than that in the nuclei from the vitamin A-repleted tissue.

Photo-induced double-strand DNA and site-specific protein cleavage activity of L-histidine (mu-oxo)diiron(III) complexes of heterocyclic bases

Three oxo-bridged diiron(III) complexes of L-histidine and heterocyclic bases [Fe-2(mu-O)(L-his)(2)(B)(2)](ClO4)(2) (1-3), where B is 2,2'-bipyridine (bpy),1,10-phenanthroline (phen), dipyrido[3,2-d:2',3'-f]quinoxaline (dpq), were prepared and characterized. The bpy complex 1 was structurally characterized by X-ray crystallography. The molecular structure showed a {Fe-2(mu-O)} core in which iron(III) in a FeN4O2 coordination is bound to tridentate monoanionic L-histidine and bidentate bpy ligands. The Fe center dot center dot center dot Fe distance is similar to 3.5 angstrom. The Fe-O-Fe unit is essentially linear, giving a bond angle of similar to 172 degrees. The complexes showed irreversible cyclic voltammetric cathodic response near -0.1 V vs. SCE in H2O-0.1 M KCl. The binuclear units displayed antiferromagnetic interaction between two high-spin (S = 5/2) iron(III) centers giving a -J value of -110 cm(-1). The complexes showed good DNA binding propensity giving a binding constant value of similar to 10(5) M-1. Isothermal titration calorimetric data indicated single binding mode to the DNA. The binding was found to be driven by negative free energy change and enthalpy. The dpq complex 3 showed oxidative double-strand DNA cleavage on exposure to UV-A and visible light. The phen complex 2 displayed single-strand photocleavage of DNA. The DNA double-strand breaks were rationalized from theoretical molecular docking calculations. Mechanistic investigations showed formation of hydroxyl radicals as the reactive species through photodecarboxylation of the L-histidine ligand. The complexes exhibited good binding propensity to bovine serum albumin (BSA) protein in Tris-HCl/NaCl buffer medium. The dpq complex 3 showed UV-A light-induced site-specific oxidative BSA cleavage forming fragments of similar to 45 kDa and similar to 20 kDa molecular weights via SOH pathway.

Effect of Ethanol Extract of Whole Plant of Trichosanthes cucumerina var. cucumerina L. on Gonadotropins, Ovarian Follicular Kinetics and Estrous Cycle for Screening of Antifertility Activity in Albino Rats

Ethanol extract of whole plant of Trichosanthes cucumerina L. var. cucumerina was evaluated for antiovulatory activity in adult rats. The ethanol extract at the doses 200 and 400mg/kg body weight (orally) affected the normal estrous cycle showing a significant increase in estrus and metestrus phases and decrease in diestrus and proestrus phases. The extract also significantly reduced the number of healthy follicles (Class I-Class VI) and corpora lutea and increased the number of regressing follicles (Stage IA, Stage IB, Stage IIA, and Stage IIB). The protein and glycogen content in the ovaries were significantly reduced in treated rats. The cholesterol level was significantly increased, whereas, the enzyme activities like 3b-HSD and 17b-HSD were significantly inhibited in the ovary of treated rats. Serum FSH and LH levels were significantly reduced in the treated groups were measured by RIA. In acute toxicity test, neither mortality nor change in the behavior or any other physiological activities in mice were observed in the treated groups. In chronic toxicity studies, no mortality was recorded and there were no significant differences in the body and organ weights were observed between controls and treated rats. Hematological analysis showed no significant differences in any of the parameters examined (RBC, WBC count and Hemoglobin estimation). These observations showed the antiovulatory activity of ethanol extract of whole plant of Trichosanthes cucumerina L. var. cucumerina in female albino rats.

On the Conversion of Hensel Codes to Farey Rationals

Three different algorithms are described for the conversion of Hensel codes to Farey rationals. The first algorithm is based on the trial and error factorization of the weight of a Hensel code, inversion and range test. The second algorithm is deterministic and uses a pair of different p-adic systems for simultaneous computation; from the resulting weights of the two different Hensel codes of the same rational, two equivalence classes of rationals are generated using the respective primitive roots. The intersection of these two equivalence classes uniquely identifies the rational. Both the above algorithms are exponential (in time and/or space).

A conditionally linearized Monte Carlo filter in non-linear structural dynamics

State and parameter estimations of non-linear dynamical systems, based on incomplete and noisy measurements, are considered using Monte Carlo simulations. Given the measurements. the proposed method obtains the marginalized posterior distribution of an appropriately chosen (ideally small) subset of the state vector using a particle filter. Samples (particles) of the marginalized states are then used to construct a family of conditionally linearized system of equations and thus obtain the posterior distribution of the states using a bank of Kalman filters. Discrete process equations for the marginalized states are derived through truncated Ito-Taylor expansions. Increased analyticity and reduced dispersion of weights computed over a smaller sample space of marginalized states are the key features of the filter that help achieve smaller sample variance of the estimates. Numerical illustrations are provided for state/parameter estimations of a Duffing oscillator and a 3-DOF non-linear oscillator. Performance of the filter in parameter estimation is also assessed using measurements obtained through experiments on simple models in the laboratory. Despite an added computational cost, the results verify that the proposed filter generally produces estimates with lower sample variance over the standard sequential importance sampling (SIS) filter.

Optimal Interconnections in the Design of Microprocessors and Digital Systems

This paper recasts the multiple data path assignment problem solved by Torng and Wilhelm by the dynamic programming method [1] into a minimal covering problem following a switching theoretic approach. The concept of bus compatibility for the data transfers is used to obtain the various ways of interconnecting the circuit modules with the minimum number of buses that allow concurrent data transfers. These have been called the feasible solutions of the problem. The minimal cost solutions are obtained by assigning weights to the bus-compatible sets present in the feasible solutions. Minimization of the cost of the solution by increasing the number of buses is also discussed.

Optimal Interconnections in the Design of Microprocessors and Digital Systems

This paper recasts the multiple data path assignment problem solved by Torng and Wilhelm by the dynamic programming method [1] into a minimal covering problem following a switching theoretic approach. The concept of bus compatibility for the data transfers is used to obtain the various ways of interconnecting the circuit modules with the minimum number of buses that allow concurrent data transfers. These have been called the feasible solutions of the problem. The minimal cost solutions are obtained by assigning weights to the bus-compatible sets present in the feasible solutions. Minimization of the cost of the solution by increasing the number of buses is also discussed.

Improvement in Intrusion Detection With Advances in Sensor Fusion

Various intrusion detection systems (IDSs) reported in the literature have shown distinct preferences for detecting a certain class of attack with improved accuracy, while performing moderately on the other classes. In view of the enormous computing power available in the present-day processors, deploying multiple IDSs in the same network to obtain best-of-breed solutions has been attempted earlier. The paper presented here addresses the problem of optimizing the performance of IDSs using sensor fusion with multiple sensors. The trade-off between the detection rate and false alarms with multiple sensors is highlighted. It is illustrated that the performance of the detector is better when the fusion threshold is determined according to the Chebyshev inequality. In the proposed data-dependent decision ( DD) fusion method, the performance optimization of ndividual IDSs is first addressed. A neural network supervised learner has been designed to determine the weights of individual IDSs depending on their reliability in detecting a certain attack. The final stage of this DD fusion architecture is a sensor fusion unit which does the weighted aggregation in order to make an appropriate decision. This paper theoretically models the fusion of IDSs for the purpose of demonstrating the improvement in performance, supplemented with the empirical evaluation.

Effect of antiserum to luteinizing hormone (LHAS) on the physiology of the epididymis and accessory glands in the albino rat

Rabbit antiserum specific to ovine luteinizing hormone free of contaminating antibodies to nonspecific proteins and FSH was administered to adult, intact rats at a dose of 0.1 and 0.2 ml/day for five days. LHAS had no effect on the weights of the epididymis but decreased their secretory activity to castrate level. Administration of 0.2 ml of LHAS or castration resulted in a marked and comparable reduction in the weights and secretory activity of the accessory glands. LHAS, even at a lower dose (0.1 ml/day), caused a significant reduction in the content of sialic acid in the vas deferons and Cowper's glands. These results are discussed in relation to the factors that regulate the functions of the epididymis and accessory glands.