A Simultaneous Deterministic Perturbation Actor-Critic Algorithm with an Application to Optimal Mortgage Refinancing

We develop a simulation-based, two-timescale actor-critic algorithm for infinite horizon Markov decision processes with finite state and action spaces, with a discounted reward criterion. The algorithm is of the gradient ascent type and performs a search in the space of stationary randomized policies. The algorithm uses certain simultaneous deterministic perturbation stochastic approximation (SDPSA) gradient estimates for enhanced performance. We show an application of our algorithm on a problem of mortgage refinancing. Our algorithm obtains the optimal refinancing strategies in a computationally efficient manner

Simultaneous Geometry Optimization and Material Selection for Truss Structures

In this work, we explore simultaneous design and material selection by posing it as an optimization problem. The underlying principles for our approach are Ashby's material selection procedure and structural optimization. For the simplicity and ease of initial implementation of the general procedure, truss structures under static load are considered in this work in view of maximum stiffness, minimum weight/cost and safety against failure. Along the lines of Ashby's material indices, a new design index is derived for trusses. This helps in choosing the most suitable material for any design of a truss. Using this, both the design space and material database are searched simultaneously using optimization algorithms. The important feature of our approach is that the formulated optimization problem is continuous even though the material selection is an inherently discrete problem.

The determination of stem cell fate by 3D scaffold structures through the control of cell shape

Stem cell response to a library of scaffolds with varied 3D structures was investigated. Microarray screening revealed that each type of scaffold structure induced a unique gene expression signature in primary human bone marrow stromal cells (hBMSCs). Hierarchical cluster analysis showed that treatments sorted by scaffold structure and not by polymer chemistry suggesting that scaffold structure was more influential than scaffold composition. Further, the effects of scaffold structure on hBMSC function were mediated by cell shape. Of all the scaffolds tested, only scaffolds with a nanofibrous morphology were able to drive the hBMSCs down an osteogenic lineage in the absence of osteogenic supplements. Nanofiber scaffolds forced the hBMSCs to assume an elongated, highly branched morphology. This same morphology was seen in osteogenic controls where hBMSCs were cultured on flat polymer films in the presence of osteogenic supplements (OS). In contrast, hBMSCs cultured on flat polymer films in the absence of OS assumed a more rounded and less-branched morphology. These results indicate that cells are more sensitive to scaffold structure than previously appreciated and suggest that scaffold efficacy can be optimized by tailoring the scaffold structure to force cells into morphologies that direct them to differentiate down the desired lineage. Published by Elsevier Ltd.

Electrochemical Determination of the Stability of Mono- and Dicalcium Stannates

he thermodynamic properties of mono- and dicalcium stannates have been determined in the temperature range 973–-1423°K from the electromotive force measurements on solid oxide galvanic cells[dformula Pt, Ni + NiO//CaO - ZrO[sub 2]/Y[sub 2]0[sub 3] - ThO[sub 2]//SnO[sub 2] + Sn, W, Pt][dformula Pt, Ni + NiO//CaO - ZrO[sub 2]/Y[sub 2]O[sub 3] - ThO[sub 2]//CaSnO[sub 3] + SnO[sub 2] + Sn, W, Pt][dformula Pt, Ni + NiO//CaO - ZrO[sub 2]/Y[sub 2]O[sub 3] - ThO[sub 2]/Ca[sub 2]SnO[sub 4] + CaSnO[sub 3] + Sn, W, Pt]and [dformula Pt, Ni + NiO//CaO - ZrO[sub 2]sol;Y[sub 2]O[sub 3] - ThO[sub 2]//Ca[sub 2]SnO[sub 4] + CaO, W, Pt] The Gibbs free energy changes accompanying the formation of the stannates from component oxides may be represented by the equations[dformula 2CaO + SnO[sub 2] --> Ca[sub 2]SnO[sub 4]][dformula Delta G[degree] = - 17,040 + 0.85T ([plus-minus]300) cal][dformula CaO + SnO[sub 2] --> CaSnO[sub 3]][dformula Delta G[degree] = - 17,390 + 2.0T ([plus-minus]300) cal]The partial pressures of the tin bearing oxide species resulting from the decomposition of the stannates have been calculated as a function of the oxygen partial pressure by combining the results of this study with published information on the partial pressures and composition of oxide species over stannic oxide.

An entropy meter based on the thermoelectric potential of a nonisothermal solid electrolyte cell

The theory, design, and performance of a solid electrolyte twin thermocell for the direct determination of the partial molar entropy of oxygen in a single-phase or multiphase mixture are described. The difference between the Seebeck coefficients of the concentric thermocells is directly related to the difference in the partial molar entropy of oxygen in the electrodes of each thermocell. The measured potentials are sensitive to small deviations from equilibrium at the electrodes. Small electric disturbances caused by simultaneous potential measurements or oxygen fluxes caused by large oxygen potential gradients between the electrodes also disturb the thermoelectric potential. An accuracy of ±0.5 calth K−1 mol−1 has been obtained by this method for the entropies of formation of NiO and NiAl2O4. This “entropy meter” may be used for the measurement of the entropies of formation of simple or complex oxides with significant residual contributions which cannot be detected by heat-capacity measurements.

Potentiometric determination of the Gibbs free energy of formation of cadmium and magnesium chromites

The standard Gibbs free energy of formation of magnesium and cadmiumchromites have been determined by potentiometric measurements on reversiblesolid-state electrochemical cells [dformula (Au-5%Cd, , Au-5%Cd; Pt, + , CaO-ZrO[sub 2], + ,Pt; CdO, , CdCr[sub 2]O[sub 4] + Cr[sub 2]O[sub 3])] in the temperature range 500°–730°C, and [dformula Pt, Cr + Cr[sub 2]O[sub 3]/Y[sub 2]O[sub 3]-ThO[sub 2]/Cr + MgCr[sub 2]O[sub 4] + MgO, Pt] in the temperature range 800°–1200°C. The temperature dependence of the freeenergies of formation of the ternary compounds can be represented by theequations [dformula CdO(r.s.) + Cr[sub 2]O[sub 3](cor) --> CdCr[sub 2]O[sub 4](sp)] [dformula Delta G[sup 0] = - 42,260 + 7.53T ([plus-minus]400) J] and [dformula MgO(r.s.) + Cr[sub 2]O[sub 3](cor) --> MgCr[sub 2]O[sub 4](sp)] [dformula Delta G[sup 0] = - 45,200 + 5.36T ([plus-minus]400) J] The entropies of formation of these spinels are discussed in terms of cationdisorder and extent of reduction of Cr3+ ions to Cr2+ ions. Thermodynamicdata on the chromates of cadmium and magnesium are derived by combiningthe results obtained in this study with information available in the literatureon high temperature, high pressure phase equilibria in the systems CdO-Cr2O3-O2 and MgO-Cr2O3-O2.

Electrochemical determination of activities in Cr2O3 Al2O3 solid solutions

The activity of Cr20~ in Cr20~-A12Oa solid solution has been determined in the temperature range 800~176 from electromotive force measurements on the solid oxide galvanic cell Pt,Cr + Cr2OJY~O~-ThO2/Cr + Cr~A12-xO~,Pt The activities of Cr203 and A120~ in the solid solution show both positive and negative deviations from Raoult's law. The heat and entropy of mixing of the solid Solution obtained from the temperature dependence of the emf can be expressed as AH = XCr203XA1203 [31,700Xcrzo3 -}- 37,470XA1203] J mole -I hS = -- 1.8R [Xcr2o3 In Xcr2o3 + XA12o3 In XAaos]The entropy of mixing is 10% lower than that predicted by the Temkin model.The large positive heat of mixing in the Cr2Os-A12Oa solid solution, however, suggests that this apparent: entropy discrepancy originates with the clustering of positive ions on the cation sublattice. The asymmetric miscibility gap exhibited in the CrzOa-A12Oa system below 900~ is consistent with the thermodynamic data trends recorded at the more elevated temperatures.

Potentiometric determination of the Gibbs energies of formation of lead aluminates

The Gibbs energies of formation of three compounds in the PbO-Al2O3 system—2PbO · Al2O3, PbO · Al2O3, andPbO· 6Al2O3—have been determined from potentiometric measurements on reversible solid-state galvanic cells [dformula Pt, Ir | Pb, alpha-Al[sub 2]O[sub 3], PbO [center-dot] 6Al[sub 2]O[sub 3] | ZrO[sub 2]-CaO | NiO, Ni | Pt] [dformula Pt | NiO, Ni | ZrO[sub 2]-CaO | Pb, PbO [center-dot] 6Al[sub 2]O[sub 3], PbO [center-dot] Al[sub 2]O[sub 3] | Ir, Pt] and [dformula Pt | NiO, Ni | ZrO[sub 2]-CaO | Pb, PbO [center-dot] Al[sub 2]O[sub 3], 2PbO [center-dot] Al[sub 2]O[sub 3] | Ir, Pt] in the temperature range 850–1375 K. The results are discussed in the light of reported phase diagrams for the PbO-Al2O3system. The partial pressures of different lead oxide species, PbnOn, n = 1–6, in the gas phase in equilibrium withthe aluminates are calculated by combining the results of this study with the mass-spectrometric data of Drowart et al.(1) for polymerization equilibria in the gas phase. The concentration of oxygen in lead in equilibrium with the aluminatesare also derived from the results and the literature data on the Gibbs energy of solution of oxygen in liquid lead.

Detection and determination of manganese concentration in water using a fiber Bragg grating coupled with nanotechnology

Through this paper we experimentally demonstrate the fabrication of a fiber Bragg grating (FBG) chemical sensor to detect and determine the manganese concentration in water and compare our results with sophisticated spectroscopic methods, such as atomic absorption spectrometry and the inductively coupled plasma method. Here we propose a simple method to develop a thin layer of gold nanoparticles above the etched grating region to enhance the sensitivity of the reflected spectrum of the FBG. By doing so, we achieve a sensitivity of 1.26 nm/parts per million in determining the trace level of Mn in water. Proper reagents are used to detect manganese in water. (C) 2011 Optical Society of America

Potentiometric determination of the stability of BaCu2O2

The thermodynamic stability of the compound BaCu2O2 was determined using a solid-state galvanic cell: View the MathML source as a function of temperature in the range 970–1170 K. Single crystal BaF2 was used as the solid electrolyte. The partial pressure of oxygen in the argon gas flowing over the electrodes was 1.27 Pa. The reversible e.m.f. of the cell can be expressed by View the MathML source. The Gibbs free energy of formation of barium cuprite from component oxides according to the reaction View the MathML source is View the MathML source.

Electrochemical determination of the Gibbs energy of formation of MgAl2O4

The standard Gibbs energy of formation of the spinel MgAl2O4 from component oxides, MgO and α-Al2O3, has been determined in the temperature range 900 to 1250 K using a solid-state cell incorporating single-crystal CaF2 as the solid electrolyte. The cell can be represented as—Pt,O2,MgO+MgF2|CaF2|MgF2+MgAl2O4+α-Al2O3,O2,Pt—The standard Gibbs energy of formation from binary oxides, computed from the reversible emf, can be represented by the expression—capdeltaG°f,ox=−23600 − 5.91T(±150) J/mol—The ‘second-law’ enthalpy of formation of MgAl2O4 obtained in this study is in good agreement with high-temperature solution calorimetric studies reported in the literature.

Determination of surge-diverter voltage/current characteristic

A mathematical model has been proposed to determine the voltage/current characteristic of the surge diverter for a wide range of currents of short duration of 8/20 and 4/10ÿs waveshapes. Experimental data agree well with the proposed model.