Explorations of the Practical Issues of Learning Prediction-Control Tasks Using Temporal Difference Learning Methods

There has been recent interest in using temporal difference learning methods to attack problems of prediction and control. While these algorithms have been brought to bear on many problems, they remain poorly understood. It is the purpose of this thesis to further explore these algorithms, presenting a framework for viewing them and raising a number of practical issues and exploring those issues in the context of several case studies. This includes applying the TD(lambda) algorithm to: 1) learning to play tic-tac-toe from the outcome of self-play and of play against a perfectly-playing opponent and 2) learning simple one-dimensional segmentation tasks.

Biological Routes to Gold Nanoplates

Much effort has been devoted to the synthesis of gold nanoparticles with different shapes, including the zero-dimensional nanospheres, one dimensional nanorods, and two-dimensional nanoplates. Compared to zero or one dimensional nanostructures, the synthesis of two-dimensional nanostructures in high yield has always been more involved, often requiring complex and time-consuming steps such as morphology transformation from the nanospheres, or the seeded growth process. Herein we report a high yield method for gold nanoplate synthesis using the extract of unicellular green alga Chlorella vulgaris, which can be carried out under ambient conditions. More than 90% of the total nanoparticle population is of the platelet morphology, surpassing the previously reported value of 45%. The control of the anisotropic growth of different planes; as well as the lateral size, has also been partially optimized.