Learning Multirobot Hose Transportation and Deployment by Distributed Round-Robin Q-Learning

Multi-Agent Reinforcement Learning (MARL) algorithms face two main difficulties: the curse of dimensionality, and environment non-stationarity due to the independent learning processes carried out by the agents concurrently. In this paper we formalize and prove the convergence of a Distributed Round Robin Q-learning (D-RR-QL) algorithm for cooperative systems. The computational complexity of this algorithm increases linearly with the number of agents. Moreover, it eliminates environment non sta tionarity by carrying a round-robin scheduling of the action selection and execution. That this learning scheme allows the implementation of Modular State-Action Vetoes (MSAV) in cooperative multi-agent systems, which speeds up learning convergence in over-constrained systems by vetoing state-action pairs which lead to undesired termination states (UTS) in the relevant state-action subspace. Each agent's local state-action value function learning is an independent process, including the MSAV policies. Coordination of locally optimal policies to obtain the global optimal joint policy is achieved by a greedy selection procedure using message passing. We show that D-RR-QL improves over state-of-the-art approaches, such as Distributed Q-Learning, Team Q-Learning and Coordinated Reinforcement Learning in a paradigmatic Linked Multi-Component Robotic System (L-MCRS) control problem: the hose transportation task. L-MCRS are over-constrained systems with many UTS induced by the interaction of the passive linking element and the active mobile robots.

Eurobalise-Train communication modelling to assess interferences in railway control signalling systems

The evolution of the railway sector depends, to a great extent, on the deployment of advanced railway signalling systems. These signalling systems are based on communication architectures that must cope with complex electromagnetical environments. This paper is outlined in the context of developing the necessary tools to allow the quick deployment of these signalling systems by contributing to an easier analysis of their behaviour under the effect of electromagnetical interferences. Specifically, this paper presents the modelling of the Eurobalise-train communication flow in a general purpose simulation tool. It is critical to guarantee this communication link since any lack of communication may lead to a stop of the train and availability problems. In order to model precisely this communication link we used real measurements done in a laboratory equipped with elements defined in the suitable subsets. Through the simulation study carried out, we obtained performance indicators of the physical layer such as the received power, SNR and BER. The modelling presented in this paper is a required step to be able to provide quality of service indicators related to perturbed scenarios.

The fish stocks in Uganda aquatic systems: opportunities and challenges for transformation

The status of fish stocks in a water body at any one time is a function of several factors affecting the production of fish in that water body. These include: total number (abundance) and biomass(weight) present, growth (size and age), recruitment (the quantity of fish entering the fishery) including reproduction, mortality which is caused by fishing or natural causes, Other indirect factors of major importance to the status of the stocks include production factors (water quality and availability of natural food for fish), the life history parameters of the different species making up the stocks (e.g. sex ratios, condition of the fish, reproductive potential (i.e. fecundity) etc), Changes in fish stocks do occur when any of the above listed factors directly influence aspects of growth, reproduction and mortality and therefore, numbers and standing stock (biomass). In the exploited fisheries, major research concerns regarding stocks relate to the listed factors especially: estimates of stock abundance/biomass, the quantity of fish being caught,where the fish are caught, which species are caught (relative abundance)when the fish are caught, how the fish are caught. The balance between stock abundance and amount of fish caught provides the basis for intervention. Due to the diverse characteristics of the physical water environment, fishes are in general, not evenly distributed throughout a water body. Shallow and vegetated areas tend to support higher abundance and diversity of fish species. In addition, seasonal variations in fish abundance are so strong that fluctuations in catch have to be expected at fish landings.

Content Based Integration of Construction Site Images in AEC/FM Model Based Systems

The Architecture, Engineering, Construction and Facilities Management (AEC/FM) industry is rapidly becoming a multidisciplinary, multinational and multi-billion dollar economy, involving large numbers of actors working concurrently at different locations and using heterogeneous software and hardware technologies. Since the beginning of the last decade, a great deal of effort has been spent within the field of construction IT in order to integrate data and information from most computer tools used to carry out engineering projects. For this purpose, a number of integration models have been developed, like web-centric systems and construction project modeling, a useful approach in representing construction projects and integrating data from various civil engineering applications. In the modern, distributed and dynamic construction environment it is important to retrieve and exchange information from different sources and in different data formats in order to improve the processes supported by these systems. Previous research demonstrated that a major hurdle in AEC/FM data integration in such systems is caused by its variety of data types and that a significant part of the data is stored in semi-structured or unstructured formats. Therefore, new integrative approaches are needed to handle non-structured data types like images and text files. This research is focused on the integration of construction site images. These images are a significant part of the construction documentation with thousands stored in site photographs logs of large scale projects. However, locating and identifying such data needed for the important decision making processes is a very hard and time-consuming task, while so far, there are no automated methods for associating them with other related objects. Therefore, automated methods for the integration of construction images are important for construction information management. During this research, processes for retrieval, classification, and integration of construction images in AEC/FM model based systems have been explored. Specifically, a combination of techniques from the areas of image and video processing, computer vision, information retrieval, statistics and content-based image and video retrieval have been deployed in order to develop a methodology for the retrieval of related construction site image data from components of a project model. This method has been tested on available construction site images from a variety of sources like past and current building construction and transportation projects and is able to automatically classify, store, integrate and retrieve image data files in inter-organizational systems so as to allow their usage in project management related tasks.

UK-NEES - Distributed hybrid testing between Bristol, Cambridge and Oxford Universities: Connecting structural dynamics labs to a geotechnical centrifuge

Distributed hybrid testing is a natural extension to and builds upon the local hybrid testing technique. Taking advantage of the hybrid nature of the test, it allows a sharing of resources and expertise between researchers from different disciplines by connecting multiple geographically distributed sites for joint testing. As part of the UK-NEES project, a successful series of three-site distributed hybrid tests have been carried out between Bristol, Cambridge and Oxford Universities. The first known multi-site distributed hybrid tests in the UK, they connected via a dedicated fibre network, using custom software, the geotechnical centrifuge at Cambridge to structural components at Bristol and Oxford. These experiments were to prove the connection and useful insights were gained into the issues involved with this distributed environment. A wider aim is towards providing a flexible testing framework to facilitate multi-disciplinary experiments such as the accurate investigation of the influence of foundations on structural systems under seismic and other loading. Time scaling incompatibilities mean true seismic soil structure interaction using a centrifuge at g is not possible, though it is clear that distributed centrifuge testing can be valuable in other problems. Development is continuing to overcome the issues encountered, in order to improve future distributed tests in the UK and beyond.

Rationales of holonic manufacturing systems in leather industry

This paper presents an insight into leather manufacturing processes, depicting peculiarities and challenges faced by leather industry. An analysis of this industry reveals the need for a new approach to optimize the productivity of leather processing operations, ensure consistent quality of leather, mitigate the adverse health effects in tannery workers exposed to chemicals and comply with environmental regulation. Holonic manufacturing systems (HMS) paradigm represent a bottom-up distributed approach that provides stability, adaptability, efficient use of resources and a plug and operate functionality to the manufacturing system. A vision of how HMS might operate in a tannery is illustrated presenting the rationales behind its application in this industry. © 2013 Springer-Verlag.

Control limitations from distributed sensing: Theory and Extremely Large Telescope application

We investigate performance bounds for feedback control of distributed plants where the controller can be centralized (i.e. it has access to measurements from the whole plant), but sensors only measure differences between neighboring subsystem outputs. Such "distributed sensing" can be a technological necessity in applications where system size exceeds accuracy requirements by many orders of magnitude. We formulate how distributed sensing generally limits feedback performance robust to measurement noise and to model uncertainty, without assuming any controller restrictions (among others, no "distributed control" restriction). A major practical consequence is the necessity to cut down integral action on some modes. We particularize the results to spatially invariant systems and finally illustrate implications of our developments for stabilizing the segmented primary mirror of the European Extremely Large Telescope. © 2013 Elsevier Ltd. All rights reserved.

Macro - A tool to support distributed MDO

This paper addresses a new way for handling distributed design know as the Macro concept. It is based round the assumption that future design teams will become more distributed in nature as industry exploits the Internet and other integrated communication and data exchange systems. The paper notes that this concept is part of an attack on the problems associated with the total process of Distribute Multi-Disciplinary design and Optimisation. The concepts rely on the creation of distributed self-building and self-organising teams made up from members who are globally distributed. The paper describes both the approach adopted and its implementation in a prototype software system operating over the Internet. In essence the work presented is describing a novel method for implementing a distributed design process which is far from complete but which is producing challenging ideas. © 2000 by Cranfield University.

Dual-wavelength distributed feedback laser for CWDM based on non-identical quantum well

Using non-identical quantum wells as the active material, a new distributed-feed back laser is fabricated with period varied Bragg grating. The full width at half maximum of 115 nm is observed in the amplified spontaneous emission spectrum of this material, which is flatter and wider than that of the identical quantum wells. Two wavelengths of 1.51 mu m and 1.53 mu m are realized under different work conditions. The side-mode suppression ratios of both wavelengths reach 40 dB. This device can be used as the light source of coarse wavelength division multiplexer communication systems.

Ground target detection, classification and sensor fusion in distributed fiber seismic sensor network - art. no. 683015

This paper describes the ground target detection, classification and sensor fusion problems in distributed fiber seismic sensor network. Compared with conventional piezoelectric seismic sensor used in UGS, fiber optic sensor has advantages of high sensitivity and resistance to electromagnetic disturbance. We have developed a fiber seismic sensor network for target detection and classification. However, ground target recognition based on seismic sensor is a very challenging problem because of the non-stationary characteristic of seismic signal and complicated real life application environment. To solve these difficulties, we study robust feature extraction and classification algorithms adapted to fiber sensor network. An united multi-feature (UMF) method is used. An adaptive threshold detection algorithm is proposed to minimize the false alarm rate. Three kinds of targets comprise personnel, wheeled vehicle and tracked vehicle are concerned in the system. The classification simulation result shows that the SVM classifier outperforms the GMM and BPNN. The sensor fusion method based on D-S evidence theory is discussed to fully utilize information of fiber sensor array and improve overall performance of the system. A field experiment is organized to test the performance of fiber sensor network and gather real signal of targets for classification testing.

VLSI architecture of a K-best detector for MIMO--OFDM wireless communication systems

The K-best detector is considered as a promising technique in the MIMO-OFDM detection because of its good performance and low complexity. In this paper, a new K-best VLSI architecture is presented. In the proposed architecture, the metric computation units (MCUs) expand each surviving path only to its partial branches, based on the novel expansion scheme, which can predetermine the branches' ascending order by their local distances. Then a distributed sorter sorts out the new K surviving paths from the expanded branches in pipelines. Compared to the conventional K-best scheme, the proposed architecture can approximately reduce fundamental operations by 50% and 75% for the 16-QAM and the 64-QAM cases, respectively, and, consequently, lower the demand on the hardware resource significantly. Simulation results prove that the proposed architecture can achieve a performance very similar to conventional K-best detectors. Hence, it is an efficient solution to the K-best detector's VLSI implementation for high-throughput MIMO-OFDM systems.

Coupled AlxGa1-xAs-AlAs distributed Bragg reflectors for high brightness AlGaInP light emitting diodes

A novel coupled distributed Bragg reflector (DBR) with double thickness periods was theoretically analyzed based on the spontaneous radiation properties of high brightness AlGaInP light emitting diodes(LED). Several important factors were considered including spontaneous radiation angle distribution, absorption and FTR of DBR. Calculation results showed that the optimum optical thickness of single layer of the DBR deviates from 1/4 lambda. AIGaInP high brightness light emitting diodes both with Al0.5Ga0.5As/AlAs coupled DBR and with conventional DBR were fabricated by metalorganic chemical vapor deposition(MOCVD). X-ray double crystal diffraction and reflection spectrum were employed to determine the thickness and reflectivity of the DBR. It was found that reflectivity of coupled DBR is less sensitive to incident angle than conventional DBR, higher external quantum efficiency of light emitting diodes with coupled DBR was obtained than that with conventional DBR.