A Simultaneous Deterministic Perturbation Actor-Critic Algorithm with an Application to Optimal Mortgage Refinancing

We develop a simulation-based, two-timescale actor-critic algorithm for infinite horizon Markov decision processes with finite state and action spaces, with a discounted reward criterion. The algorithm is of the gradient ascent type and performs a search in the space of stationary randomized policies. The algorithm uses certain simultaneous deterministic perturbation stochastic approximation (SDPSA) gradient estimates for enhanced performance. We show an application of our algorithm on a problem of mortgage refinancing. Our algorithm obtains the optimal refinancing strategies in a computationally efficient manner

Robust controller for an autonomous small refrigeration unit

The authors describe the constructional features of a controller for operating an autonomous refrigeration unit powered by a field of photovoltaic panels and backed up by a generator set. The controller enables three voltage levels of operation of an inverter to meet the start, run and off cycle conditions of the refrigerator compressor. The algorithm considers several input and output parameters and status signals from each subsystem of the unit to deduce a control strategy. Such units find application for storage of vaccines and life-saving medicines requiring uninterrupted refrigeration, in medical shops, rural health centres, veterinary laboratories etc.

Studies on the optimisation of unbalanced magnetron sputtering cathodes

The optimisation is reported on the design of unbalanced magnetron (UBM) sputtering cathodes. For the study, a planar circular cathode backed by a double-coil electromagnet (compatible for a 100 mm diameter target) was developed. The variation of the structure and strength of the magnetic field in front of the target was investigated for different current combinations in the electromagnetic coils, and its effect on the sputtering process was analysed. The observations on the magnetic field geometry revealed some interesting features, such as the balancing point of the fields along the axis (null-point), and the zero axial region over the target surface (B-z = 0 ring). The positions of both could be controlled by adjusting the ratio of the electric current in the coils. The magnetic field null-point could be used as a reference for the region of homogeneous film growth. The B-z = 0 ring was the location where the glow discharge concentrated (or where the maximum target erosion occurred). The diameter of the ring determined the area covered by the discharge and thus the sputtering efficiency. The optimum substrate position can be fixed according to the position of the null-point and optimisation of sputtering can be achieved by adjusting the diameter of the B-z = 0 ring. The results of this study should be helpful in the designing of an ideal UBM using permanent magnets as well as electromagnets. (C) 1999 Elsevier Science Ltd. All rights reserved.

Vermicompost reduces the invasiveness of the earthworm species Dichogaster bolaui compared to the use of compost in a degraded tropical soil in Northern Vietnam

In Northern Vietnam, organic fertilization programmes are being tested to restore soil fertility and reduce soil erosion. However, the amendment of organic matter in soil is also associated with the development of the invasive earthworm species Dichogaster bolaui. The objective of this study was to investigate the influence of organic matter amendment quality (compost vs. vermicompost) on D. bolaui. Our study confirmed D. bolaui development in organic patches in the field. However, we also observed that the flat-backed millipede Asiomorpha coarctata proliferated in these organic patches. Native to Asia, this millipede species is also considered as invasive in America. Both D. bolaui and A. coarctata more rapidly colonized compost than vermicompost patches. A laboratory experiment confirmed this trend and showed the limited development of D. bolaui in vermicompost. This is probably because of the decreased palatability of this substrate to soil fauna. In conclusion, any restoration practice that aims to increase the organic stocks in soils degraded by erosion should consider the quality of the organic amendment. In Northern Vietnam, vermicompost may be the preferred substrate for restoring soils while limiting the spread of D. bolaui. (C) 2014 Elsevier Masson SAS. All rights reserved.