A Reinforcement-Learning Approach to Power Management

We describe an adaptive, mid-level approach to the wireless device power management problem. Our approach is based on reinforcement learning, a machine learning framework for autonomous agents. We describe how our framework can be applied to the power management problem in both infrastructure and ad~hoc wireless networks. From this thesis we conclude that mid-level power management policies can outperform low-level policies and are more convenient to implement than high-level policies. We also conclude that power management policies need to adapt to the user and network, and that a mid-level power management framework based on reinforcement learning fulfills these requirements.

Performance-Driven Microfabrication-Oriented Methodology for MEMS Conceptual Design with Application in Microfluidic Device Design

Performance and manufacturability are two important issues that must be taken into account during MEMS design. Existing MEMS design models or systems follow a process-driven design paradigm, that is, design starts from the specification of process sequence or the customization of foundry-ready process template. There has been essentially no methodology or model that supports generic, high-level design synthesis for MEMS conceptual design. As a result, there lacks a basis for specifying the initial process sequences. To address this problem, this paper proposes a performance-driven, microfabrication-oriented methodology for MEMS conceptual design. A unified behaviour representation method is proposed which incorporates information of both physical interactions and chemical/biological/other reactions. Based on this method, a behavioural process based design synthesis model is proposed, which exploits multidisciplinary phenomena for design solutions, including both the structural components and their configuration for the MEMS device, as well as the necessary substances for the chemical/biological/other reactions. The model supports both forward and backward synthetic search for suitable phenomena. To ensure manufacturability, a strategy of using microfabrication-oriented phenomena as design knowledge is proposed, where the phenomena are developed from existing MEMS devices that have associated MEMS-specific microfabrication processes or foundry-ready process templates. To test the applicability of the proposed methodology, the paper also studies microfluidic device design and uses a micro-pump design for the case study.

Stimuli-responsive Novel Amphiphilic Polymers for Chemical and Biomedical Applications

Amphiphilic polymers are a class of polymers that self-assemble into different types of microstructure, depending on the solvent environment and external stimuli. Self assembly structures can exist in many different forms, such as spherical micelles, rod-like micelles, bi-layers, vesicles, bi-continuous structure etc. Most biological systems are basically comprised of many of these organised structures arranged in an intelligent manner, which impart functions and life to the system. We have adopted the atom transfer radical polymerization (ATRP) technique to synthesize various types of block copolymer systems that self-assemble into different microstructure when subject to an external stimuli, such as pH or temperature. The systems that we have studied are: (1) pH responsive fullerene (C60) containing poly(methacrylic acid) (PMAA-b-C60); (2) pH and temperature responsive fullerene containing poly[2-(dimethylamino)ethyl methacrylate] (C₆₀-b-PDMAEMA); (3) other responsive water-soluble fullerene systems. By varying temperature, pH and salt concentration, different types microstructure can be produced. In the presence of inorganic salts, fractal patterns at nano- to microscopic dimension were observed for negatively charged PMAA-b-C60, while such structure was not observed for positively charged PDMAEMA-b-C60. We demonstrated that negatively charged fullerene containing polymeric systems can serve as excellent nano-templates for the controlled growth of inorganic crystals at the nano- to micrometer length scale and the possible mechanism was proposed. The physical properties and the characteristics of their self-assembly properties will be discussed, and their implications to chemical and biomedical applications will be highlighted.

Nonlinear Device Noise Models:Thermodynamic Requirements

This paper proposes three tests to determine whether a given nonlinear device noise model is in agreement with accepted thermodynamic principles. These tests are applied to several models. One conclusion is that every Gaussian noise model for any nonlinear device predicts thermodynamically impossible circuit behavior: these models should be abandoned. But the nonlinear shot-noise model predicts thermodynamically acceptable behavior under a constraint derived here. Further, this constraint specifies the current noise amplitude at each operating point from knowledge of the device v - i curve alone. For the Gaussian and shot-noise models, this paper shows how the thermodynamic requirements can be reduced to concise mathematical tests involving no approximatio