A behavior-based scheme using reinforcement learning for autonomous underwater vehicles

This paper presents a hybrid behavior-based scheme using reinforcement learning for high-level control of autonomous underwater vehicles (AUVs). Two main features of the presented approach are hybrid behavior coordination and semi on-line neural-Q_learning (SONQL). Hybrid behavior coordination takes advantages of robustness and modularity in the competitive approach as well as efficient trajectories in the cooperative approach. SONQL, a new continuous approach of the Q_learning algorithm with a multilayer neural network is used to learn behavior state/action mapping online. Experimental results show the feasibility of the presented approach for AUVs

An hybrid methodology for RL-based behavior coordination in a target following mission with an AUV

Proposes a behavior-based scheme for high-level control of autonomous underwater vehicles (AUVs). Two main characteristics can be highlighted in the control scheme. Behavior coordination is done through a hybrid methodology, which takes in advantages of the robustness and modularity in competitive approaches, as well as optimized trajectories

The mapping of the local contributions of Fermi and Coulomb correlation into intracule and extracule density distributions

The contributions of the correlated and uncorrelated components of the electron-pair density to atomic and molecular intracule I(r) and extracule E(R) densities and its Laplacian functions ∇2I(r) and ∇2E(R) are analyzed at the Hartree-Fock (HF) and configuration interaction (CI) levels of theory. The topologies of the uncorrelated components of these functions can be rationalized in terms of the corresponding one-electron densities. In contrast, by analyzing the correlated components of I(r) and E(R), namely, IC(r) and EC(R), the effect of electron Fermi and Coulomb correlation can be assessed at the HF and CI levels of theory. Moreover, the contribution of Coulomb correlation can be isolated by means of difference maps between IC(r) and EC(R) distributions calculated at the two levels of theory. As application examples, the He, Ne, and Ar atomic series, the C2-2, N2, O2+2 molecular series, and the C2H4 molecule have been investigated. For these atoms and molecules, it is found that Fermi correlation accounts for the main characteristics of IC(r) and EC(R), with Coulomb correlation increasing slightly the locality of these functions at the CI level of theory. Furthermore, IC(r), EC(R), and the associated Laplacian functions, reveal the short-ranged nature and high isotropy of Fermi and Coulomb correlation in atoms and molecules

Electron localization function at the correlated level

The electron localization function (ELF) has been proven so far a valuable tool to determine the location of electron pairs. Because of that, the ELF has been widely used to understand the nature of the chemical bonding and to discuss the mechanism of chemical reactions. Up to now, most applications of the ELF have been performed with monodeterminantal methods and only few attempts to calculate this function for correlated wave functions have been carried out. Here, a formulation of ELF valid for mono- and multiconfigurational wave functions is given and compared with previous recently reported approaches. The method described does not require the use of the homogeneous electron gas to define the ELF, at variance with the ELF definition given by Becke. The effect of the electron correlation in the ELF, introduced by means of configuration interaction with singles and doubles calculations, is discussed in the light of the results derived from a set of atomic and molecular systems

Adsorbents a partir de fangs biològics excedents de depuradora mitjançant l'aplicació de microones: estudi d'obtenció, caracterització i aplicació en fase líquida

El fang biològic es produeix en les plantes de tractament d'aigües residuals urbanes i industrials. El tractament i la gestió dels fangs és un dels problemes més importants en el camp del tractament de les aigües residuals. Aquesta situació es preveu que es veurà agreujada en el futur, per un increment del volum de fang produït associat a l'exigència de nivells més alts de depuració i per l'augment dels nombre d'estacions depuradores en funcionament. D'altre banda, les limitacions que presenten les opcions tradicionals de gestió dels fangs, fa necessari buscar solucions innovadores i efectives per a solucionar el problema que suposa la gestió d'aquests fangs biològics. Els fangs biològics són de naturalesa carbonosa i amb un alt contingut de matèria orgànica. Aquestes característiques, permeten la conversió del fang en un sòlid adsorbent de tipus carbonós. Aquesta conversió ofereix el doble benefici de reduir el volum de fang que ha de ser gestionat i alhora produir un adsorbent amb un cost inferior a la dels adsorbents convencionals (carbons actius comercials). Fins el moment, els tractaments alta temperatura han demostrat la seva efectivitat per du a terme el procés de transformació dels excedents de fang biològic en un sòlid adsorbent carbonós (carbó actiu). Com a alternativa a aquests processos a alta temperatura, es proposa un nou procés d'obtenció d'un sòlid adsorbent carbonós a partir dels excedents de fangs biològics, mitjançant un tractament a baixa temperatura, combinant el tractament per microones amb l'addició d'un reactiu químic (H2SO4). La present tesi analitza el tractament dels excedents de fangs biològics utilitzant un tractament mitjançant microones i l'addició d'àcid sulfúric (H2SO4), al mateix temps analitza la possibilitat d'utilitzar els sòlids adsorbents obtinguts per a millorar la qualitat de les aigües residuals. Paràmetres d'operació com poden ser la quantitat d'àcid sulfúric addicionada al fang, el nivell de potència del forn microones i el temps de tractament, es modificaran per tal de determinar la influència que poden tenir sobre la qualitat del sòlid adsorbent. Un cop determinada la qualitat dels diferent sòlids adsorbents s'avalua la seva capacitat per a l'eliminació de colorant i metalls en fase líquida. Els resultats obtinguts es comparen amb els obtinguts per un carbó actiu derivat de fangs i un carbó actiu comercial.

Simplification, approximation and deformation of large models

The high level of realism and interaction in many computer graphic applications requires techniques for processing complex geometric models. First, we present a method that provides an accurate low-resolution approximation from a multi-chart textured model that guarantees geometric fidelity and correct preservation of the appearance attributes. Then, we introduce a mesh structure called Compact Model that approximates dense triangular meshes while preserving sharp features, allowing adaptive reconstructions and supporting textured models. Next, we design a new space deformation technique called *Cages based on a multi-level system of cages that preserves the smoothness of the mesh between neighbouring cages and is extremely versatile, allowing the use of heterogeneous sets of coordinates and different levels of deformation. Finally, we propose a hybrid method that allows to apply any deformation technique on large models obtaining high quality results with a reduced memory footprint and a high performance.

Enhanced convolution approach for CAC in ATM networks, an analytical study and implementation

The characteristics of service independence and flexibility of ATM networks make the control problems of such networks very critical. One of the main challenges in ATM networks is to design traffic control mechanisms that enable both economically efficient use of the network resources and desired quality of service to higher layer applications. Window flow control mechanisms of traditional packet switched networks are not well suited to real time services, at the speeds envisaged for the future networks. In this work, the utilisation of the Probability of Congestion (PC) as a bandwidth decision parameter is presented. The validity of PC utilisation is compared with QOS parameters in buffer-less environments when only the cell loss ratio (CLR) parameter is relevant. The convolution algorithm is a good solution for CAC in ATM networks with small buffers. If the source characteristics are known, the actual CLR can be very well estimated. Furthermore, this estimation is always conservative, allowing the retention of the network performance guarantees. Several experiments have been carried out and investigated to explain the deviation between the proposed method and the simulation. Time parameters for burst length and different buffer sizes have been considered. Experiments to confine the limits of the burst length with respect to the buffer size conclude that a minimum buffer size is necessary to achieve adequate cell contention. Note that propagation delay is a no dismiss limit for long distance and interactive communications, then small buffer must be used in order to minimise delay. Under previous premises, the convolution approach is the most accurate method used in bandwidth allocation. This method gives enough accuracy in both homogeneous and heterogeneous networks. But, the convolution approach has a considerable computation cost and a high number of accumulated calculations. To overcome this drawbacks, a new method of evaluation is analysed: the Enhanced Convolution Approach (ECA). In ECA, traffic is grouped in classes of identical parameters. By using the multinomial distribution function instead of the formula-based convolution, a partial state corresponding to each class of traffic is obtained. Finally, the global state probabilities are evaluated by multi-convolution of the partial results. This method avoids accumulated calculations and saves storage requirements, specially in complex scenarios. Sorting is the dominant factor for the formula-based convolution, whereas cost evaluation is the dominant factor for the enhanced convolution. A set of cut-off mechanisms are introduced to reduce the complexity of the ECA evaluation. The ECA also computes the CLR for each j-class of traffic (CLRj), an expression for the CLRj evaluation is also presented. We can conclude that by combining the ECA method with cut-off mechanisms, utilisation of ECA in real-time CAC environments as a single level scheme is always possible.