Distributed optimization in power networks and general multi-agent systems

The dissertation studies the general area of complex networked systems that consist of interconnected and active heterogeneous components and usually operate in uncertain environments and with incomplete information. Problems associated with those systems are typically large-scale and computationally intractable, yet they are also very well-structured and have features that can be exploited by appropriate modeling and computational methods. The goal of this thesis is to develop foundational theories and tools to exploit those structures that can lead to computationally-efficient and distributed solutions, and apply them to improve systems operations and architecture.

Specifically, the thesis focuses on two concrete areas. The first one is to design distributed rules to manage distributed energy resources in the power network. The power network is undergoing a fundamental transformation. The future smart grid, especially on the distribution system, will be a large-scale network of distributed energy resources (DERs), each introducing random and rapid fluctuations in power supply, demand, voltage and frequency. These DERs provide a tremendous opportunity for sustainability, efficiency, and power reliability. However, there are daunting technical challenges in managing these DERs and optimizing their operation. The focus of this dissertation is to develop scalable, distributed, and real-time control and optimization to achieve system-wide efficiency, reliability, and robustness for the future power grid. In particular, we will present how to explore the power network structure to design efficient and distributed market and algorithms for the energy management. We will also show how to connect the algorithms with physical dynamics and existing control mechanisms for real-time control in power networks.

The second focus is to develop distributed optimization rules for general multi-agent engineering systems. A central goal in multiagent systems is to design local control laws for the individual agents to ensure that the emergent global behavior is desirable with respect to the given system level objective. Ideally, a system designer seeks to satisfy this goal while conditioning each agent’s control on the least amount of information possible. Our work focused on achieving this goal using the framework of game theory. In particular, we derived a systematic methodology for designing local agent objective functions that guarantees (i) an equivalence between the resulting game-theoretic equilibria and the system level design objective and (ii) that the resulting game possesses an inherent structure that can be exploited for distributed learning, e.g., potential games. The control design can then be completed by applying any distributed learning algorithm that guarantees convergence to the game-theoretic equilibrium. One main advantage of this game theoretic approach is that it provides a hierarchical decomposition between the decomposition of the systemic objective (game design) and the specific local decision rules (distributed learning algorithms). This decomposition provides the system designer with tremendous flexibility to meet the design objectives and constraints inherent in a broad class of multiagent systems. Furthermore, in many settings the resulting controllers will be inherently robust to a host of uncertainties including asynchronous clock rates, delays in information, and component failures.

Alternative trajectories for decarbonizing urban transportation

4 p.

Decarbonising urban transportation

18 p.

A comparison of the costs of operation of the motor bus, Birney safety car, and trolley bus on the local transportation routes in Pasadena

With the installation by the Pacific Electric Railway of a bus system in Pasadena to supplant most of its trolley lines, the problem of the comparison of the costs of the two systems naturally presented itself. The study here undertaken was originally started as just a comparison of the motor bus and Birney Safety Car, but as the work progressed it seemed advisable to include the trolley bus as well - a method of transportation that is comparatively new as far as development is concerned, but which seems to be finding increasing favor in the East.

Solutions for New Terrestrial Broadcasting Systems Offering Simultaneously Stationary and Mobile Services

221 p.

Learning Multirobot Hose Transportation and Deployment by Distributed Round-Robin Q-Learning

Multi-Agent Reinforcement Learning (MARL) algorithms face two main difficulties: the curse of dimensionality, and environment non-stationarity due to the independent learning processes carried out by the agents concurrently. In this paper we formalize and prove the convergence of a Distributed Round Robin Q-learning (D-RR-QL) algorithm for cooperative systems. The computational complexity of this algorithm increases linearly with the number of agents. Moreover, it eliminates environment non sta tionarity by carrying a round-robin scheduling of the action selection and execution. That this learning scheme allows the implementation of Modular State-Action Vetoes (MSAV) in cooperative multi-agent systems, which speeds up learning convergence in over-constrained systems by vetoing state-action pairs which lead to undesired termination states (UTS) in the relevant state-action subspace. Each agent's local state-action value function learning is an independent process, including the MSAV policies. Coordination of locally optimal policies to obtain the global optimal joint policy is achieved by a greedy selection procedure using message passing. We show that D-RR-QL improves over state-of-the-art approaches, such as Distributed Q-Learning, Team Q-Learning and Coordinated Reinforcement Learning in a paradigmatic Linked Multi-Component Robotic System (L-MCRS) control problem: the hose transportation task. L-MCRS are over-constrained systems with many UTS induced by the interaction of the passive linking element and the active mobile robots.

Fish for the poor under a rising global demand and changing fishery regime

In the past, agricultural researchers tended to ignore the fisheries factor in global food and nutritional security. However, the role of fish is becoming critical as a result of changes in fisheries regimes, income distribution, demand and increasing international trade. Fish has become the fastest growing food commodity in international trade and this is raising concern for the supply of fish for poorer people. As a result, the impact of international trade regimes on fish supply and demand, and the consequences on the availability of fish for developing countries need to be studied. Policies aimed at increasing export earnings are in conflict with those aimed at increasing food security in third world countries. Fisheries policy research will need to focus on three primary areas which have an impact on the marginal and poorer communities of developing countries: increased international demand for low-value fish on the supply of poorer countries; improved aquaculture technologies and productivity on poorer and marginal farmers; and land and water allocation policy on productivity, food security and sustainability across farm, fishery and related sectors. The key to local food security is in the integration of agriculture, aquaculture and natural resources but an important focus on fisheries policy research will be to look at the linkages between societal, economic and natural systems in order to develop adequate and flexible solutions to achieve sustainable use of aquatic resources systems.

Reducing energy demand: what are the practical limits?

Concern over the global energy system, whether driven by climate change, national security, or fears of shortage, is being discussed widely and in every arena but with a bias toward energy supply options. While demand reduction is often mentioned in passing, it is rarely a priority for implementation, whether through policy or through the search for innovation. This paper aims to draw attention to the opportunity for major reduction in energy demand, by presenting an analysis of how much of current global energy demand could be avoided. Previous work led to a "map" of global energy use that traces the flow of energy from primary sources (fuels or renewable sources), through fuel refinery, electricity generation, and end-use conversion devices, to passive systems and the delivery of final energy services (transport, illumination, and sustenance). The key passive systems are presented here and analyzed through simple engineering models with scalar equations using data based on current global practice. Physically credible options for change to key design parameters are identified and used to predict the energy savings possible for each system. The result demonstrates that 73% of global energy use could be saved by practically achievable design changes to passive systems. This reduction could be increased by further efficiency improvements in conversion devices. A list of the solutions required to achieve these savings is provided.

Exploratory analysis of resource demand and the environmental footprint of future aquaculture development using Life Cycle Assessment

Increases in fish demand in the coming decades are projected to be largely met by growth of aquaculture. However, increased aquaculture production is linked to higher demand for natural resources and energy as well as emissions to the environment. This paper explores the use of Life Cycle Assessment to improve knowledge of potential environmental impacts of future aquaculture growth. Different scenarios of future aquaculture development are taken into account in calculating the life cycle environmental impacts. The environmental impact assessments were built on Food and Agriculture Organization statistics in terms of production volume of different species, whereas the inputs and outputs associated with aquaculture production systems were sourced from the literature. The matrix of input-output databases was established through the Blue Frontiers study.

Present status of harvesting, transportation and marketing of freshwater Small Indigenous Species of Fish (SIS) of Bangladesh

A survey conducted to evaluate the present status of harvesting, transportation and marketing of freshwater SIS of Bangladesh showed that among the 56 to 73 species of small indigenous fish species (SIS), mola (Amblypharyngodon mola), dhela (Osteobrama cotio cotio), puti (Barbodes sarana), tit puti (Puntius ticto), tengra (Mystus vitatus), chapila ( Gudusia chapra), batashi (Pseudotropius atherinoides), buzuri tengra (Mystus tengra), katchki (Corika soborna), gol chanda (Chanda ranga), lamba chanda (Chanda nama), phul chela (Chela phulo) and lata (Channa punctatus) are the most common. But the abundance of the mola, puti, tengra, batashi and chapila are higher than the other SIS species. Puti was at the top of the list in percentage abundance (7-9%), followed by mola (7-8%), tengra 6-7% and chapila 5-6% in all the investigated areas. Three levels of market or marketing systems were observed in the distribution channel of fish trade: primary, secondary/higher secondary and final consuming markets. Primary market is the catching point in the rural area. In secondary market, the collectors bring the fish from primary market to the landing ghats, usually to the nearest thana market or at a place well linked by rivers, road and rail transport. On purchasing the fish from the higher secondary market, the paikars sell the fish to the retailers who take it to the final consumer market. Different types of crafts and gears are used for catching the SIS in Bangladesh. Monofilament gill nets (20%), traps and line nets (25%) and seine nets (25%) are the dominant gears in respect of the total catch followed by lift net (10%) and cast net (20%). A total of 10 types of gear are listed according to their mode of operation which used for catching SIS. The processors in consumer market received higher marketing profit followed by primary market and secondary market, respectively.

Bulk packages for storage and transportation of salted and dried fish

The effect of bulk packaging on the storage of salted and dried fish was studied at ambient conditions. Four different packaging systems were tried, among which gusseted type high density polyethylene woven sacks having either circular loom or traditional loom laminated with 100 gauge low density polyethylene were found to be best suited for dry fish packaging as they could withstand the hazards of handling, transportation and storage.

Modular distributed manufacturing systems and the implications for integrated control

Driven by the need for more responsive manufacturing processes and as a consequence of increasing complexity in products and production systems, this short paper introduces a number of developments in the area of modular, distributed manufacturing systems. Requirements for the development of such systems are addressed and, in particular, the relevance to current and future integrated control systems is examined. One of the key issues for integrated control systems in the future is the need to provide support for distributed decision-making in addition to existing distributed control capabilities.

The use of energy in China: Tracing the flow of energy from primary source to demand drivers

We present a map of the transformation of energy in China as a Sankey diagram. After a review of previous work, and a statement of methodology, our main work has been the identification, evaluation, and treatment of appropriate data sources. This data is used to construct the Sankey diagram, in which flows of energy are traced from energy sources through end-use conversion devices, passive systems and final services to demand drivers. The resulting diagram provides a convenient and clear snapshot of existing energy transformations in China which can usefully be compared with a similar global analysis and which emphasises the potential for improvements in energy efficiency in 'passive systems'. More broadly, it gives a basis for examining and communicating future energy scenarios, including changes to demand, changes to the supply mix, changes in efficiency and alternative provision of existing services. © 2012 Elsevier Ltd.

Managing water resources and their connection to land and energy

Effective management is a key to ensuring the current and future sustainability of land, water and energy resources. Identifying the complexities of such management is not an easy task, especially since past studies have focussed on studying these resources in isolation from one another. However, with rapid population growth and an increase in the awareness of a potential change in climatic conditions that may affect the demand for and supply of food, water and energy, there has been a growing need to integrate the planning decisions relating to these three resources. The paper shows the visualisation of linked resources by drawing a set of interconnected Sankey diagrams for energy, water and land. These track the changes from basic resource (e.g. coal, surface water, groundwater and cropland) through transformations (e.g. fuel refining and desalination) to final services (e.g. sustenance, hygiene and transportation). The focus here is on the water analysis aspects of the tool, which uses California as a detailed case study. The movement of water in California is traced from its source to its services by mapping the different transformations of water from when it becomes available, through its use, to further treatment, to final sinks (including recycling and reuse of that resource). The connections that water has with energy and land resources for the state of California are highlighted. This includes the amount of energy used to pump and treat water, and the amount of water used for energy production and the land resources which create a water demand to produce crops for food. By mapping water in this way, policy-makers and resource managers can more easily understand the competing uses of water (environment, agriculture and urban use) through the identification of the services it delivers (e.g. sanitation, agriculture, landscaping), the potential opportunities for improving the management of the resource (e.g. building new desalination plants, reducing the demand for services), and the connections with other resources which are often overlooked in a traditional sector-based management strategy.

Content Based Integration of Construction Site Images in Architecture, Engineering, Construction, and Facilities Management (AEC/FM) Model based Systems

This book explores the processes for retrieval, classification, and integration of construction images in AEC/FM model based systems. The author describes a combination of techniques from the areas of image and video processing, computer vision, information retrieval, statistics and content-based image and video retrieval that have been integrated into a novel method for the retrieval of related construction site image data from components of a project model. This method has been tested on available construction site images from a variety of sources like past and current building construction and transportation projects and is able to automatically classify, store, integrate and retrieve image data files in inter-organizational systems so as to allow their usage in project management related tasks. objects. Therefore, automated methods for the integration of construction images are important for construction information management. During this research, processes for retrieval, classification, and integration of construction images in AEC/FM model based systems have been explored. Specifically, a combination of techniques from the areas of image and video processing, computer vision, information retrieval, statistics and content-based image and video retrieval have been deployed in order to develop a methodology for the retrieval of related construction site image data from components of a project model. This method has been tested on available construction site images from a variety of sources like past and current building construction and transportation projects and is able to automatically classify, store, integrate and retrieve image data files in inter-organizational systems so as to allow their usage in project management related tasks.