Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Physicochemical studies on the gelation of hen egg yolk; separation of gelling protein components from yolk plasma

A study of the component(s) in egg yolk responsible for gelation of yolk on freezing and thawing has shown that granule-free yolk plasma, obtained by high-speed centrifugation of yolk, has the capacity to gel. As with the whole yolk, gelation of yolk plasma on freezing and thawing could be inhibited by additives such as sugars, sodium chloride, proteolytic enzymes, and phospholipase-A. Phospholipase-C, which induces gelation of whole yolk at room temperature, has a similar effect on yolk plasma. Yolk plasma has been separated into aggregating (gelling) and soluble fractions by delipidation, using formic acid. Each of these fractions consists of three or four protein components, as observed by gel filtration, ultracentrifugation, and agar electrophoresis. The proteins are glycoproteins and contain bound hexoses, hexosamine, and sialic acid. The gelation of yolk has been attributed to the interactions between protein molecules following disruption of lipid-protein bonds.

Boundary value problems for third-order nonlinear ordinary differential equations

In this paper, we describe how to analyze boundary value problems for third-order nonlinear ordinary differential equations over an infinite interval. Several physical problems of interest are governed by such systems. The seminumerical schemes described here offer some advantages over solutions obtained by using traditional methods such as finite differences, shooting method, etc. These techniques also reveal the analytic structure of the solution function. For illustrative purposes, several physical problems, mainly drawn from fluid mechanics, are considered; they clearly demonstrate the efficiency of the techniques presented here.

Effect of boundary condition description on convergence of solution in a boundary-value problem

It is well known that the numerical accuracy of a series solution to a boundary-value problem by the direct method depends on the technique of approximate satisfaction of the boundary conditions and on the stage of truncation of the series. On the other hand, it does not appear to be generally recognized that, when the boundary conditions can be described in alternative equivalent forms, the convergence of the solution is significantly affected by the actual form in which they are stated. The importance of the last aspect is studied for three different techniques of computing the deflections of simply supported regular polygonal plates under uniform pressure. It is also shown that it is sometimes possible to modify the technique of analysis to make the accuracy independent of the description of the boundary conditions.

Physicochemical studies on the gelation of hen's egg yolk: Delipidation of yolk plasma by treatment with phospholipase-C and extraction with solvents

A method for the delipidation of egg yolk plasma using phospholipase-C, n-heptane, and 1-butanol has been described. An aggregating protein fraction and a soluble protein fraction were separated by the action of phospholipase-C. The aggregating protein fraction freed of most of the lipids by treatment with n-heptane and 1-butanol was shown to be the apolipoproteins of yolk plasma, whereas the soluble proteins were identified as the livetins. Carbohydrate and the N-terminal amino acid analysis of these protein fractions are reported. A comparison of these protein fractions with the corresponding fractions obtained by formic acid delipidation of yolk plasma has been made. The gelation of yolk plasma by the action of phospholipase-C has been interpreted as an aggregation of lipoproteins caused by ionic interactions. The role of lecithin in maintaining the structural integrity of lipoproteins has been discussed.

Comparative study on damage identification from lso-Eigen-Value-Change contours and smeared damage model

The paper proposes two methodologies for damage identification from measured natural frequencies of a contiguously damaged reinforced concrete beam, idealised with distributed damage model. The first method identifies damage from Iso-Eigen-Value-Change contours, plotted between pairs of different frequencies. The performance of the method is checked for a wide variation of damage positions and extents. The method is also extended to a discrete structure in the form of a five-storied shear building and the simplicity of the method is demonstrated. The second method is through smeared damage model, where the damage is assumed constant for different segments of the beam and the lengths and centres of these segments are the known inputs. First-order perturbation method is used to derive the relevant expressions. Both these methods are based on distributed damage models and have been checked with experimental program on simply supported reinforced concrete beams, subjected to different stages of symmetric and un-symmetric damages. The results of the experiments are encouraging and show that both the methods can be adopted together in a damage identification scenario.

Reliability models for existing structures based on dynamic state estimation and data based asymptotic extreme value analysis

The problem of time variant reliability analysis of existing structures subjected to stationary random dynamic excitations is considered. The study assumes that samples of dynamic response of the structure, under the action of external excitations, have been measured at a set of sparse points on the structure. The utilization of these measurements m in updating reliability models, postulated prior to making any measurements, is considered. This is achieved by using dynamic state estimation methods which combine results from Markov process theory and Bayes' theorem. The uncertainties present in measurements as well as in the postulated model for the structural behaviour are accounted for. The samples of external excitations are taken to emanate from known stochastic models and allowance is made for ability (or lack of it) to measure the applied excitations. The future reliability of the structure is modeled using expected structural response conditioned on all the measurements made. This expected response is shown to have a time varying mean and a random component that can be treated as being weakly stationary. For linear systems, an approximate analytical solution for the problem of reliability model updating is obtained by combining theories of discrete Kalman filter and level crossing statistics. For the case of nonlinear systems, the problem is tackled by combining particle filtering strategies with data based extreme value analysis. In all these studies, the governing stochastic differential equations are discretized using the strong forms of Ito-Taylor's discretization schemes. The possibility of using conditional simulation strategies, when applied external actions are measured, is also considered. The proposed procedures are exemplifiedmby considering the reliability analysis of a few low-dimensional dynamical systems based on synthetically generated measurement data. The performance of the procedures developed is also assessed based on a limited amount of pertinent Monte Carlo simulations. (C) 2010 Elsevier Ltd. All rights reserved.

A monoclonal antibody recognizing the C-terminal region of chicken egg white riboflavin carrier protein terminates early pregnancy in mice

In order to identify the functionally relevant epitopes on chicken riboflavin carrier protein, we have raised monoclonal antibodies to the vitamin carrier. One of these, 6B2C12, was found to interact specifically with a synthetic oligopeptide corresponding to the C-terminal 17 amino acid residues of the chicken egg white riboflavin carrier protein, which is missing in part in the egg yolk riboflavin carrier protein. This epitope is conserved through evolution in mammals including humans. Administration of the ascites fluid of 6B2C12 to pregnant mice intraperitoneally, resulted in the termination of pregnancy indicating that this epitope is involved in or closely associated with the transplacental transport of the vitamin from the maternal circulation to the growing fetus.

A simplified method for the purification of riboflavin-binding protein from hen's egg yolk

A simple and efficient procedure for the purification of the riboflavin-binding protein from hen's egg yolk is described. This method involves the removal by exclusion of lipoproteins and subsequent fractionation of soluble yolk proteins held on a DEAE-cellulose column by a salt gradient which is followed by purification by gel filtration on Sephadex G-100. The protein thus isolated is homogeneous by various physicoehemical, immunological, and functional criteria.

Seasonal variation in the onset of egg laying in a primitively eusocial wasp: implications for the evolution of sociality

When freshly eclosed females of the primitively eusocial wasp, Rapalidia marginata are isolated into individual cages, only about half of them build nests and lay eggs and those that do so take a long and variable amount of time (Mean +/- SD = 66 +/- 37 days) before they lay their first egg. Part of the reason for this delay is because, when kept in isolation, no wasp begins to lay eggs during a period of approximately 82 days from mid - October to early January. Wasps maintained at a constant temperature of 26 +/- 1-degrees-C however initiate egg laying throughout the year, suggesting that the low temperatures during mid - October to early January may be at least one factor that makes this period unfavourable for wasps maintained at room temperature. Egg laying continues more or less normally throughout October-January however, in all natural and laboratory colonies studied. Natural colonies of R. marginata are initiated throughout the year and often by groups of females. Huddling together is a striking feature of the wasps especially on cold mornings. We therefore suggest that the isolated animals in our experiment are unable to lay eggs during the coldest part of the year because of their inability to huddle together, share metabolic heat and perform "co-operative thermoregulation". Such "co-operative thermoregulation" may thus be another factor that facilitates the evolution of socialitly.