Efficient solutions to factored MDPs with imprecise transition probabilities

When modeling real-world decision-theoretic planning problems in the Markov Decision Process (MDP) framework, it is often impossible to obtain a completely accurate estimate of transition probabilities. For example, natural uncertainty arises in the transition specification due to elicitation of MOP transition models from an expert or estimation from data, or non-stationary transition distributions arising from insufficient state knowledge. In the interest of obtaining the most robust policy under transition uncertainty, the Markov Decision Process with Imprecise Transition Probabilities (MDP-IPs) has been introduced to model such scenarios. Unfortunately, while various solution algorithms exist for MDP-IPs, they often require external calls to optimization routines and thus can be extremely time-consuming in practice. To address this deficiency, we introduce the factored MDP-IP and propose efficient dynamic programming methods to exploit its structure. Noting that the key computational bottleneck in the solution of factored MDP-IPs is the need to repeatedly solve nonlinear constrained optimization problems, we show how to target approximation techniques to drastically reduce the computational overhead of the nonlinear solver while producing bounded, approximately optimal solutions. Our results show up to two orders of magnitude speedup in comparison to traditional ""flat"" dynamic programming approaches and up to an order of magnitude speedup over the extension of factored MDP approximate value iteration techniques to MDP-IPs while producing the lowest error of any approximation algorithm evaluated. (C) 2011 Elsevier B.V. All rights reserved.

Efficient solutions to robust, semi-implicit discretizations of the immersed boundary method

The immersed boundary method is a versatile tool for the investigation of flow-structure interaction. In a large number of applications, the immersed boundaries or structures are very stiff and strong tangential forces on these interfaces induce a well-known, severe time-step restriction for explicit discretizations. This excessive stability constraint can be removed with fully implicit or suitable semi-implicit schemes but at a seemingly prohibitive computational cost. While economical alternatives have been proposed recently for some special cases, there is a practical need for a computationally efficient approach that can be applied more broadly. In this context, we revisit a robust semi-implicit discretization introduced by Peskin in the late 1970s which has received renewed attention recently. This discretization, in which the spreading and interpolation operators are lagged. leads to a linear system of equations for the inter-face configuration at the future time, when the interfacial force is linear. However, this linear system is large and dense and thus it is challenging to streamline its solution. Moreover, while the same linear system or one of similar structure could potentially be used in Newton-type iterations, nonlinear and highly stiff immersed structures pose additional challenges to iterative methods. In this work, we address these problems and propose cost-effective computational strategies for solving Peskin`s lagged-operators type of discretization. We do this by first constructing a sufficiently accurate approximation to the system`s matrix and we obtain a rigorous estimate for this approximation. This matrix is expeditiously computed by using a combination of pre-calculated values and interpolation. The availability of a matrix allows for more efficient matrix-vector products and facilitates the design of effective iterative schemes. We propose efficient iterative approaches to deal with both linear and nonlinear interfacial forces and simple or complex immersed structures with tethered or untethered points. One of these iterative approaches employs a splitting in which we first solve a linear problem for the interfacial force and then we use a nonlinear iteration to find the interface configuration corresponding to this force. We demonstrate that the proposed approach is several orders of magnitude more efficient than the standard explicit method. In addition to considering the standard elliptical drop test case, we show both the robustness and efficacy of the proposed methodology with a 2D model of a heart valve. (C) 2009 Elsevier Inc. All rights reserved.

Microwave-Assisted Derivatization of Cellulose in an Ionic Liquid: An Efficient, Expedient Synthesis of Simple and Mixed Carboxylic Esters

Microwave (MW)-assisted cellulose dissolution in ionic liquids (ILs) has routinely led either to incomplete biopolymer solubilization, or its degradation. We show that these problems can be avoided by use of low-energy MW heating, coupled with efficient stirring. Dissolution of microcrystalline cellulose in the IL 1-allyl-3-methylimidazolium chloride has been achieved without changing its degree of polymerization; regenerated cellulose showed pronounced changes in its index of crystallinity, surface area, and morphology. MW-assisted functionalization of MCC by ethanoic, propanoic, butanoic, pentanoic, and hexanoic anhydrides has been studied. Compared with conventional heating, MW irradiation has resulted in considerable decrease in dissolution and reaction times. The value of the degree of substitution (DS) was found to be DS(ethanoate) > DS(propanoate) > DS(butanoate). The values of DS(pentanoate) and DS(hexanoate) were found to be slightly higher than DS(ethanoate). This surprising dependence on the chain length of the acylating agent has been reported before, but not rationalized. On the basis of the rate constants and activation parameters of the hydrolysis of ethanoic, butanoic, and hexanoic anhydrides in aqueous acetonitrile (a model acyl transfer reaction), we suggest that this result may be attributed to the balance between two opposing effects, namely, steric crowding and (cooperative) hydrophobic interactions between the anhydride and the cellulosic surface, whose lipophilicity has increased, due to its partial acylation. Four ethanoate-based mixed esters were synthesized by the reaction with a mixture of the two anhydrides; the ethanoate moiety predominated in all products. The DS is reproducible and the IL is easily recycled. (C) 2009 Wiley Periodicals, Inc. J Polym Sci Part A: Polym Chem 48: 134-143, 2010