Explorations of the Practical Issues of Learning Prediction-Control Tasks Using Temporal Difference Learning Methods

There has been recent interest in using temporal difference learning methods to attack problems of prediction and control. While these algorithms have been brought to bear on many problems, they remain poorly understood. It is the purpose of this thesis to further explore these algorithms, presenting a framework for viewing them and raising a number of practical issues and exploring those issues in the context of several case studies. This includes applying the TD(lambda) algorithm to: 1) learning to play tic-tac-toe from the outcome of self-play and of play against a perfectly-playing opponent and 2) learning simple one-dimensional segmentation tasks.

The Informational Complexity of Learning from Examples

This thesis attempts to quantify the amount of information needed to learn certain tasks. The tasks chosen vary from learning functions in a Sobolev space using radial basis function networks to learning grammars in the principles and parameters framework of modern linguistic theory. These problems are analyzed from the perspective of computational learning theory and certain unifying perspectives emerge.

A Proposal for Enterprise Value Phase of the Lean Aerospace Initiative

The Massachusetts Institute of Technology (MIT) submits this proposal for the Enterprise Value Phase of the Lean Aerospace Initiative (LAI) in response to the October 9, 2002 Request for Proposal (RFP) F33615-02-2-5501 from the Air Force Research Laboratory (AFRL/MLKT), Wright-Patterson Air Force Base, Ohio. This proposal addresses the conduct of the LAI as set forth in the Enterprise Value Phase Concept of Operations (final draft dated 5 June 2002. The creation of this Enterprise Value Phase Concept of Operations (ConOps) was the result of extensive interaction among all stakeholders in the LAI consortium. The proposed products and research topics have been developed by the MIT LAI team based on this extended interaction with the Lean Aerospace Initiative consortium members during the concept of operations development. This proposal is in consonance with the Enterprise Value Phase vision, and mission as set forth in the concept of operations so as to meet stakeholder needs to achieve the goals and deliverables desired, prioritized to fit available funding.