Ergodic control of partially observed Markov chains

The ergodic or long-run average cost control problem for a partially observed finite-state Markov chain is studied via the associated fully observed separated control problem for the nonlinear filter. Dynamic programming equations for the latter are derived, leading to existence and characterization of optimal stationary policies.

A numerical approach to determine the sufficiency of given boundary data sets for uniquely estimating interior elastic properties

We consider an inverse elasticity problem in which forces and displacements are known on the boundary and the material property distribution inside the body is to be found. In other words, we need to estimate the distribution of constitutive properties using the finite boundary data sets. Uniqueness of the solution to this problem is proved in the literature only under certain assumptions for a given complete Dirichlet-to-Neumann map. Another complication in the numerical solution of this problem is that the number of boundary data sets needed to establish uniqueness is not known even under the restricted cases where uniqueness is proved theoretically. In this paper, we present a numerical technique that can assess the sufficiency of given boundary data sets by computing the rank of a sensitivity matrix that arises in the Gauss-Newton method used to solve the problem. Numerical experiments are presented to illustrate the method.

Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space

In this article, we study risk-sensitive control problem with controlled continuous time Markov chain state dynamics. Using multiplicative dynamic programming principle along with the atomic structure of the state dynamics, we prove the existence and a characterization of optimal risk-sensitive control under geometric ergodicity of the state dynamics along with a smallness condition on the running cost.

T chart to evaluate consolidation test results

Using Terzaghi's degree of consolidation, U, and the time factor, T, relationship, if M-U1 and M-U2 (M-U1 not equal M-U2) are slopes of the U-root T curve at any two time factors T-U1 and T-U2, then it can be shown that a unique relationship exists between T-U2/T-U1, M-U1/M-U2, and TU, (or TU2), and knowing any two of these, the third can be uniquely determined. A chart, called the T chart, has been plotted using these three variables for quickly determining T and U at any experimental time, t, to determine the coefficient of consolidation, c(v), corrected zero settlement, delta(o), and ultimate primary settlement, delta(100). The chart can be used even in those cases where settlement and time, at the instant of load increment, are not known.

Comparative kinomics of human and chimpanzee reveal unique kinship and functional diversity generated by new domain combinations

Background: Phosphorylation by protein kinases is a common event in many cellular processes. Further, many kinases perform specialized roles and are regulated by non-kinase domains tethered to kinase domain. Perturbation in the regulation of kinases leads to malignancy. We have identified and analysed putative protein kinases encoded in the genome of chimpanzee which is a close evolutionary relative of human. Result: The shared core biology between chimpanzee and human is characterized by many orthologous protein kinases which are involved in conserved pathways. Domain architectures specific to chimp/human kinases have been observed. Chimp kinases with unique domain architectures are characterized by deletion of one or more non-kinase domains in the human kinases. Interestingly, counterparts of some of the multi-domain human kinases in chimp are characterized by identical domain architectures but with kinase-like non-kinase domain. Remarkably, out of 587 chimpanzee kinases no human orthologue with greater than 95% sequence identity could be identified for 160 kinases. Variations in chimpanzee kinases compared to human kinases are brought about also by differences in functions of domains tethered to the catalytic kinase domain. For example, the heterodimer forming PB1 domain related to the fold of ubiquitin/Ras-binding domain is seen uniquely tethered to PKC-like chimpanzee kinase. Conclusion: Though the chimpanzee and human are evolutionary very close, there are chimpanzee kinases with no close counterpart in the human suggesting differences in their functions. This analysis provides a direction for experimental analysis of human and chimpanzee protein kinases in order to enhance our understanding on their specific biological roles.

Oxygen transfer and energy dissipation rate in surface aerator

The dissipation rate of turbulent kinetic energy (epsilon) is a key parameter for mixing in surface aerators. In particular, determination epsilon across the impeller stream, where the most intensive mixing takes place, is essential to ascertain that an appropriate degree of mixing is achieved. Present work by using commercial software VisiMix (R) calculates the energy dissipation rate in geometrically similar unbaffled surface aeration systems in order to scale-up the oxygen transfer process. It is found that in geometrically similar system, oxygen transfer rate is uniquely correlated with dissipation rate of energy. Simulation or scale-up equation governing oxygen transfer rate and dissipation rate of energy has been developed in the present work.

Oxygen transfer and energy dissipation rate in surface aerator

The dissipation rate of turbulent kinetic energy(e)is a key parameter for mixing in surface aerators. In particular, determination e across the impeller stream, where the most intensive mixing takes place, is essential to ascertain that an appropriate degree of mixing is achieved. Present work by using commercial software VisiMix calculates the energy dissipation rate in geometrically similar unbaffled surface aeration systems in order to scale-up the oxygen transfer process. It is found that in geometrically similar system,oxygen transfer rate is uniquely correlated with dissipation rate of energy. Simulation or scale-up equation governing oxygen transfer rate and dissipation rate of energy has been developed in the present work.

Flow of metal in a wedge-shaped cavity

The wedge shape is a fairly common cross-section found in many non-axisymmetric components used in machines, aircraft, ships and automobiles. If such components are forged between two mutually inclined dies the metal displaced by the dies flows into the converging as well as into the diverging channels created by the inclined dies. The extent of each type of flow (convergent/divergent) depends on the die—material interface friction and the included die angle. Given the initial cross-section, the length as well as the exact geometry of the forged cross-section are therefore uniquely determined by these parameters. In this paper a simple stress analysis is used to predict changes in the geometry of a wedge undergoing compression between inclined platens. The flow in directions normal to the cross-section is assumed to be negligible. Experiments carried out using wedge-shaped lead billets show that, knowing the interface friction and as long as the deformation is not too large, the dimensional changes in the wedge can be predicted with reasonable accuracy. The predicted flow behaviour of metal for a wide range of die angles and interface friction is presented: these characteristics can be used by the die designer to choose the die lubricant (only) if the die angle is specified and to choose both of these parameters if there is no restriction on the exact die angle. The present work shows that the length of a wedge undergoing compression is highly sensitive to die—material interface friction. Thus in a situation where the top and bottom dies are inclined to each other, a wedge made of the material to be forged could be put between the dies and then compressed, whereupon the length of the compressed wedge — given the degree of compression — affords an estimate of the die—material interface friction.

Raman Spectroscopic study of valinomycin-metal complexes

Valinomycin, an ionophore of considerable interest for its ion selectivity, and its K+, Mg2+, Ba2+, and Ca2+ complexes were studied by Raman spectroscopy. Each complex has a characteristic spectrum which differs from that of uncomplexed valinomycin, suggesting several distinct structures for each of the metal-valinomycin complexes. The biologically active potassium complex shows the most significant changes in its spectrum, especially in the intensity of the symmetric C---H stretching vibration of CH3 and the convergence of the two ester carbonyl stretching vibration bands into one complex formation. These results are due to the unique orientation of the ester carbonyl groups toward the caged potassium ion and the resulting more free rotation of isopropyl side chains. The divalent cation-valinomycin complexes examined showed spectra which differed in each case uniquely from both valinomycin and its complex with potassium.

On the Conversion of Hensel Codes to Farey Rationals

Three different algorithms are described for the conversion of Hensel codes to Farey rationals. The first algorithm is based on the trial and error factorization of the weight of a Hensel code, inversion and range test. The second algorithm is deterministic and uses a pair of different p-adic systems for simultaneous computation; from the resulting weights of the two different Hensel codes of the same rational, two equivalence classes of rationals are generated using the respective primitive roots. The intersection of these two equivalence classes uniquely identifies the rational. Both the above algorithms are exponential (in time and/or space).

Glass-Transition In Isopentane - A Monte-Carlo Study

Monte Carlo simulations with realistic interaction potentials have been carried out on isopentane to investigate the glass transition. Intermolecular pair-correlation functions of the glass show distinct differences from those of the liquid, the CH-CH pair-correlation function being uniquely different from the other pair-correlation functions. The coordination number of the glass is higher than that of the liquid, and the packing in the glass seems to be mainly governed by the geometrical constraints of the molecule. Annealing affects the properties of the glass significantly.

Multiaction learning automata possessing ergodicity of the mean

Multiaction learning automata which update their action probabilities on the basis of the responses they get from an environment are considered in this paper. The automata update the probabilities according to whether the environment responds with a reward or a penalty. Learning automata are said to possess ergodicity of the mean if the mean action probability is the state probability (or unconditional probability) of an ergodic Markov chain. In an earlier paper [11] we considered the problem of a two-action learning automaton being ergodic in the mean (EM). The family of such automata was characterized completely by proving the necessary and sufficient conditions for automata to be EM. In this paper, we generalize the results of [11] and obtain necessary and sufficient conditions for the multiaction learning automaton to be EM. These conditions involve two families of probability updating functions. It is shown that for the automaton to be EM the two families must be linearly dependent. The vector defining the linear dependence is the only vector parameter which controls the rate of convergence of the automaton. Further, the technique for reducing the variance of the limiting distribution is discussed. Just as in the two-action case, it is shown that the set of absolutely expedient schemes and the set of schemes which possess ergodicity of the mean are mutually disjoint.

Measurement of sensitivities for the thermal recording of laser beams

A simple technique for determining the energy sensitivities for the thermographic recording of laser beams is described. The principle behind this technique is that, if a laser beam with a known spatial distribution such as a Gaussian profile is used for imaging, the radius of the thermal image formed depends uniquely on the intensity of the impinging beam. Thus by measuring the radii of the images produced for different incident beam intensities the minimum intensity necessary (that is, the threshold) for thermographic imaging is found. The diameter of the laser beam can also be found from this measurement. A simple analysis based on the temperature distribution in the laser heated material shows that there is an inverse square root dependence on pulse duration or period of exposure for the energy fluence of the laser beam required, both for the threshold and the subsequent increase in the size of the recording. It has also been shown that except for low intensity, long duration exposure on very low conductivity materials, heat losses are not very significant.

A real-time algorithm for simulation of flexible objects and hyper-redundant manipulators

Flexible objects such as a rope or snake move in a way such that their axial length remains almost constant. To simulate the motion of such an object, one strategy is to discretize the object into large number of small rigid links connected by joints. However, the resulting discretised system is highly redundant and the joint rotations for a desired Cartesian motion of any point on the object cannot be solved uniquely. In this paper, we revisit an algorithm, based on the classical tractrix curve, to resolve the redundancy in such hyper-redundant systems. For a desired motion of the `head' of a link, the `tail' is moved along a tractrix, and recursively all links of the discretised objects are moved along different tractrix curves. The algorithm is illustrated by simulations of a moving snake, tying of knots with a rope and a solution of the inverse kinematics of a planar hyper-redundant manipulator. The simulations show that the tractrix based algorithm leads to a more `natural' motion since the motion is distributed uniformly along the entire object with the displacements diminishing from the `head' to the `tail'.

Three-dimensional structure of heat shock protein 90 from Plasmodium falciparum: molecular modelling approach to rational drug design against malaria

We have recently implicated heat shock protein 90 from Plasmodium falciparum (PfHsp90) as a potential drug target against malaria. Using inhibitors specific to the nucleotide binding domain of Hsp90, we have shown potent growth inhibitory effects on development of malarial parasite in human erythrocytes. To gain better understanding of the vital role played by PfHsp90 in parasite growth, we have modeled its three dimensional structure using recently described full length structure of yeast Hsp90. Sequence similarity found between PfHsp90 and yeast Hsp90 allowed us to model the core structure with high confidence. The superimposition of the predicted structure with that of the template yeast Hsp90 structure reveals an RMSD of 3.31 angstrom. The N-terminal and middle domains showed the least RMSD (1.76 angstrom) while the more divergent C-terminus showed a greater RMSD (2.84 angstrom) with respect to the template. The structure shows overall conservation of domains involved in nucleotide binding, ATPase activity, co-chaperone binding as well as inter-subunit interactions. Important co-chaperones known to modulate Hsp90 function in other eukaryotes are conserved in malarial parasite as well. An acidic stretch of amino acids found in the linker region, which is uniquely extended in PfHsp90 could not be modeled in this structure suggesting a flexible conformation. Our results provide a basis to compare the overall structure and functional pathways dependent on PfHsp90 in malarial parasite. Further analysis of differences found between human and parasite Hsp90 may make it possible to design inhibitors targeted specifically against malaria.