Modeling Robot Dynamic Performance for Endpoint Force Control

This research aims to understand the fundamental dynamic behavior of servo-controlled machinery in response to various types of sensory feedback. As an example of such a system, we study robot force control, a scheme which promises to greatly expand the capabilities of industrial robots by allowing manipulators to interact with uncertain and dynamic tasks. Dynamic models are developed which allow the effects of actuator dynamics, structural flexibility, and workpiece interaction to be explored in the frequency and time domains. The models are used first to explain the causes of robot force control instability, and then to find methods of improving this performance.

Building Grounded Abstractions for Artificial Intelligence Programming

Most Artificial Intelligence (AI) work can be characterized as either ``high-level'' (e.g., logical, symbolic) or ``low-level'' (e.g., connectionist networks, behavior-based robotics). Each approach suffers from particular drawbacks. High-level AI uses abstractions that often have no relation to the way real, biological brains work. Low-level AI, on the other hand, tends to lack the powerful abstractions that are needed to express complex structures and relationships. I have tried to combine the best features of both approaches, by building a set of programming abstractions defined in terms of simple, biologically plausible components. At the ``ground level'', I define a primitive, perceptron-like computational unit. I then show how more abstract computational units may be implemented in terms of the primitive units, and show the utility of the abstract units in sample networks. The new units make it possible to build networks using concepts such as long-term memories, short-term memories, and frames. As a demonstration of these abstractions, I have implemented a simulator for ``creatures'' controlled by a network of abstract units. The creatures exist in a simple 2D world, and exhibit behaviors such as catching mobile prey and sorting colored blocks into matching boxes. This program demonstrates that it is possible to build systems that can interact effectively with a dynamic physical environment, yet use symbolic representations to control aspects of their behavior.

Interaction and Intelligent Behavior

We introduce basic behaviors as primitives for control and learning in situated, embodied agents interacting in complex domains. We propose methods for selecting, formally specifying, algorithmically implementing, empirically evaluating, and combining behaviors from a basic set. We also introduce a general methodology for automatically constructing higher--level behaviors by learning to select from this set. Based on a formulation of reinforcement learning using conditions, behaviors, and shaped reinforcement, out approach makes behavior selection learnable in noisy, uncertain environments with stochastic dynamics. All described ideas are validated with groups of up to 20 mobile robots performing safe--wandering, following, aggregation, dispersion, homing, flocking, foraging, and learning to forage.

Synthesis and Aggregation Behavior of Pluronic F87/Poly(acrylic acid) Block Copolymer with Doxorubicin

Poly(acrylic acid) (PAA) was grafted onto both termini of Pluronic F87 (PEO₆₇-PPO₃₉-PEO₆₇) via atom transfer radical polymerization to produce a novel muco-adhesive block copolymer PAA₈₀-b-F₈₇-b-PAA₈₀. It was observed that PAA₈₀-F₈₇-PAA₈₀ forms stable complexes with weakly basic anti-cancer drug, Doxorubicin. Thermodynamic changes due to the drug binding to the copolymer were assessed at different pH by isothermal titration calorimetry (ITC). The formation of the polymer/drug complexes was studied by turbidimetric titration and dynamic light scattering. Doxorubicin and PAA-b-F87-b-PAA block copolymer are found to interact strongly in aqueous solution via non-covalent interactions over a wide pH range. At pH>4.35, drug binding is due to electrostatic interactions. Hydrogen-bond also plays a role in the stabilization of the PAA₈₀-F₈₇-PAA₈₀/DOX complex. At pH 7.4 (α=0.8), the size and stability of polymer/drug complex depend strongly on the doxorubicin concentration. When CDOX <0.13mM, the PAA₈₀-F₈₇-PAA₈₀ copolymer forms stable inter-chain complexes with DOX (110 ~ 150 nm). When CDOX >0.13mM, as suggested by the light scattering result, the reorganization of the polymer/drug complex is believed to occur. With further addition of DOX (CDOX >0.34mM), sharp increase in the turbidity indicates the formation of large aggregates, followed by phase separation. The onset of a sharp enthalpy increase corresponds to the formation of a stoichiometric complex.