Interaction and Intelligent Behavior

We introduce basic behaviors as primitives for control and learning in situated, embodied agents interacting in complex domains. We propose methods for selecting, formally specifying, algorithmically implementing, empirically evaluating, and combining behaviors from a basic set. We also introduce a general methodology for automatically constructing higher--level behaviors by learning to select from this set. Based on a formulation of reinforcement learning using conditions, behaviors, and shaped reinforcement, out approach makes behavior selection learnable in noisy, uncertain environments with stochastic dynamics. All described ideas are validated with groups of up to 20 mobile robots performing safe--wandering, following, aggregation, dispersion, homing, flocking, foraging, and learning to forage.

Synthesis and Aggregation Behavior of Pluronic F87/Poly(acrylic acid) Block Copolymer with Doxorubicin

Poly(acrylic acid) (PAA) was grafted onto both termini of Pluronic F87 (PEO₆₇-PPO₃₉-PEO₆₇) via atom transfer radical polymerization to produce a novel muco-adhesive block copolymer PAA₈₀-b-F₈₇-b-PAA₈₀. It was observed that PAA₈₀-F₈₇-PAA₈₀ forms stable complexes with weakly basic anti-cancer drug, Doxorubicin. Thermodynamic changes due to the drug binding to the copolymer were assessed at different pH by isothermal titration calorimetry (ITC). The formation of the polymer/drug complexes was studied by turbidimetric titration and dynamic light scattering. Doxorubicin and PAA-b-F87-b-PAA block copolymer are found to interact strongly in aqueous solution via non-covalent interactions over a wide pH range. At pH>4.35, drug binding is due to electrostatic interactions. Hydrogen-bond also plays a role in the stabilization of the PAA₈₀-F₈₇-PAA₈₀/DOX complex. At pH 7.4 (α=0.8), the size and stability of polymer/drug complex depend strongly on the doxorubicin concentration. When CDOX <0.13mM, the PAA₈₀-F₈₇-PAA₈₀ copolymer forms stable inter-chain complexes with DOX (110 ~ 150 nm). When CDOX >0.13mM, as suggested by the light scattering result, the reorganization of the polymer/drug complex is believed to occur. With further addition of DOX (CDOX >0.34mM), sharp increase in the turbidity indicates the formation of large aggregates, followed by phase separation. The onset of a sharp enthalpy increase corresponds to the formation of a stoichiometric complex.

Understanding Subsystems in Biology through Dimensionality Reduction, Graph Partitioning and Analytical Modeling

Biological systems exhibit rich and complex behavior through the orchestrated interplay of a large array of components. It is hypothesized that separable subsystems with some degree of functional autonomy exist; deciphering their independent behavior and functionality would greatly facilitate understanding the system as a whole. Discovering and analyzing such subsystems are hence pivotal problems in the quest to gain a quantitative understanding of complex biological systems. In this work, using approaches from machine learning, physics and graph theory, methods for the identification and analysis of such subsystems were developed. A novel methodology, based on a recent machine learning algorithm known as non-negative matrix factorization (NMF), was developed to discover such subsystems in a set of large-scale gene expression data. This set of subsystems was then used to predict functional relationships between genes, and this approach was shown to score significantly higher than conventional methods when benchmarking them against existing databases. Moreover, a mathematical treatment was developed to treat simple network subsystems based only on their topology (independent of particular parameter values). Application to a problem of experimental interest demonstrated the need for extentions to the conventional model to fully explain the experimental data. Finally, the notion of a subsystem was evaluated from a topological perspective. A number of different protein networks were examined to analyze their topological properties with respect to separability, seeking to find separable subsystems. These networks were shown to exhibit separability in a nonintuitive fashion, while the separable subsystems were of strong biological significance. It was demonstrated that the separability property found was not due to incomplete or biased data, but is likely to reflect biological structure.