Embodied Autonomy in Digital Ecosystems: From Bio-Inspired Agents to Cognitive Systems

This paper proposes to promote autonomy in digital ecosystems so that it provides agents with information to improve the behavior of the digital ecosystem in terms of stability. This work proposes that, in digital ecosystems, autonomous agents can provide fundamental services and information. The final goal is to run the ecosystem, generate novel conditions and let agents exploit them. A set of evaluation measures must be defined as well. We want to provide an outline of some global indicators, such as heterogeneity and diversity, and establish relationships between agent behavior and these global indicators to fully understand interactions between agents, and to understand the dependence and autonomy relations that emerge between the interacting agents. Individual variations, interaction dependencies, and environmental factors are determinants of autonomy that would be considered. The paper concludes with a discussion of situations when autonomy is a milestone

Modelling, control and supervision for a class of hybrid systems

The aim of this thesis is to narrow the gap between two different control techniques: the continuous control and the discrete event control techniques DES. This gap can be reduced by the study of Hybrid systems, and by interpreting as Hybrid systems the majority of large-scale systems. In particular, when looking deeply into a process, it is often possible to identify interaction between discrete and continuous signals. Hybrid systems are systems that have both continuous, and discrete signals. Continuous signals are generally supposed continuous and differentiable in time, since discrete signals are neither continuous nor differentiable in time due to their abrupt changes in time. Continuous signals often represent the measure of natural physical magnitudes such as temperature, pressure etc. The discrete signals are normally artificial signals, operated by human artefacts as current, voltage, light etc. Typical processes modelled as Hybrid systems are production systems, chemical process, or continuos production when time and continuous measures interacts with the transport, and stock inventory system. Complex systems as manufacturing lines are hybrid in a global sense. They can be decomposed into several subsystems, and their links. Another motivation for the study of Hybrid systems is the tools developed by other research domains. These tools benefit from the use of temporal logic for the analysis of several properties of Hybrid systems model, and use it to design systems and controllers, which satisfies physical or imposed restrictions. This thesis is focused in particular types of systems with discrete and continuous signals in interaction. That can be modelled hard non-linealities, such as hysteresis, jumps in the state, limit cycles, etc. and their possible non-deterministic future behaviour expressed by an interpretable model description. The Hybrid systems treated in this work are systems with several discrete states, always less than thirty states (it can arrive to NP hard problem), and continuous dynamics evolving with expression: with Ki ¡ Rn constant vectors or matrices for X components vector. In several states the continuous evolution can be several of them Ki = 0. In this formulation, the mathematics can express Time invariant linear system. By the use of this expression for a local part, the combination of several local linear models is possible to represent non-linear systems. And with the interaction with discrete events of the system the model can compose non-linear Hybrid systems. Especially multistage processes with high continuous dynamics are well represented by the proposed methodology. Sate vectors with more than two components, as third order models or higher is well approximated by the proposed approximation. Flexible belt transmission, chemical reactions with initial start-up and mobile robots with important friction are several physical systems, which profits from the benefits of proposed methodology (accuracy). The motivation of this thesis is to obtain a solution that can control and drive the Hybrid systems from the origin or starting point to the goal. How to obtain this solution, and which is the best solution in terms of one cost function subject to the physical restrictions and control actions is analysed. Hybrid systems that have several possible states, different ways to drive the system to the goal and different continuous control signals are problems that motivate this research. The requirements of the system on which we work is: a model that can represent the behaviour of the non-linear systems, and that possibilities the prediction of possible future behaviour for the model, in order to apply an supervisor which decides the optimal and secure action to drive the system toward the goal. Specific problems can be determined by the use of this kind of hybrid models are: - The unity of order. - Control the system along a reachable path. - Control the system in a safe path. - Optimise the cost function. - Modularity of control The proposed model solves the specified problems in the switching models problem, the initial condition calculus and the unity of the order models. Continuous and discrete phenomena are represented in Linear hybrid models, defined with defined eighth-tuple parameters to model different types of hybrid phenomena. Applying a transformation over the state vector : for LTI system we obtain from a two-dimensional SS a single parameter, alpha, which still maintains the dynamical information. Combining this parameter with the system output, a complete description of the system is obtained in a form of a graph in polar representation. Using Tagaki-Sugeno type III is a fuzzy model which include linear time invariant LTI models for each local model, the fuzzyfication of different LTI local model gives as a result a non-linear time invariant model. In our case the output and the alpha measure govern the membership function. Hybrid systems control is a huge task, the processes need to be guided from the Starting point to the desired End point, passing a through of different specific states and points in the trajectory. The system can be structured in different levels of abstraction and the control in three layers for the Hybrid systems from planning the process to produce the actions, these are the planning, the process and control layer. In this case the algorithms will be applied to robotics ¡V a domain where improvements are well accepted ¡V it is expected to find a simple repetitive processes for which the extra effort in complexity can be compensated by some cost reductions. It may be also interesting to implement some control optimisation to processes such as fuel injection, DC-DC converters etc. In order to apply the RW theory of discrete event systems on a Hybrid system, we must abstract the continuous signals and to project the events generated for these signals, to obtain new sets of observable and controllable events. Ramadge & Wonham¡¦s theory along with the TCT software give a Controllable Sublanguage of the legal language generated for a Discrete Event System (DES). Continuous abstraction transforms predicates over continuous variables into controllable or uncontrollable events, and modifies the set of uncontrollable, controllable observable and unobservable events. Continuous signals produce into the system virtual events, when this crosses the bound limits. If this event is deterministic, they can be projected. It is necessary to determine the controllability of this event, in order to assign this to the corresponding set, , controllable, uncontrollable, observable and unobservable set of events. Find optimal trajectories in order to minimise some cost function is the goal of the modelling procedure. Mathematical model for the system allows the user to apply mathematical techniques over this expression. These possibilities are, to minimise a specific cost function, to obtain optimal controllers and to approximate a specific trajectory. The combination of the Dynamic Programming with Bellman Principle of optimality, give us the procedure to solve the minimum time trajectory for Hybrid systems. The problem is greater when there exists interaction between adjacent states. In Hybrid systems the problem is to determine the partial set points to be applied at the local models. Optimal controller can be implemented in each local model in order to assure the minimisation of the local costs. The solution of this problem needs to give us the trajectory to follow the system. Trajectory marked by a set of set points to force the system to passing over them. Several ways are possible to drive the system from the Starting point Xi to the End point Xf. Different ways are interesting in: dynamic sense, minimum states, approximation at set points, etc. These ways need to be safe and viable and RchW. And only one of them must to be applied, normally the best, which minimises the proposed cost function. A Reachable Way, this means the controllable way and safe, will be evaluated in order to obtain which one minimises the cost function. Contribution of this work is a complete framework to work with the majority Hybrid systems, the procedures to model, control and supervise are defined and explained and its use is demonstrated. Also explained is the procedure to model the systems to be analysed for automatic verification. Great improvements were obtained by using this methodology in comparison to using other piecewise linear approximations. It is demonstrated in particular cases this methodology can provide best approximation. The most important contribution of this work, is the Alpha approximation for non-linear systems with high dynamics While this kind of process is not typical, but in this case the Alpha approximation is the best linear approximation to use, and give a compact representation.

Informed recommender: basing recommendations on consumer product reviews

Recommender systems attempt to predict items in which a user might be interested, given some information about the user's and items' profiles. Most existing recommender systems use content-based or collaborative filtering methods or hybrid methods that combine both techniques (see the sidebar for more details). We created Informed Recommender to address the problem of using consumer opinion about products, expressed online in free-form text, to generate product recommendations. Informed recommender uses prioritized consumer product reviews to make recommendations. Using text-mining techniques, it maps each piece of each review comment automatically into an ontology

The effects of information and communication technologies on the banking sector and the payments system

This dissertation studies the effects of Information and Communication Technologies (ICT) on the banking sector and the payments system. It provides insight into how technology-induced changes occur, by exploring both the nature and scope of main technology innovations and evidencing their economic implications for banks and payment systems. Some parts in the dissertation are descriptive. They summarise the main technological developments in the field of finance and link them to economic policies. These parts are complemented with sections of the study that focus on assessing the extent of technology application to banking and payment activities. Finally, it includes also some work which borrows from the economic literature on banking. The need for an interdisciplinary approach arises from the complexity of the topic and the rapid path of change to which it is subject. The first chapter provides an overview of the influence of developments in ICT on the evolution of financial services and international capital flows. We include main indicators and discuss innovation in the financial sector, exchange rates and international capital flows. The chapter concludes with impact analysis and policy options regarding the international financial architecture, some monetary policy issues and the role of international institutions. The second chapter is a technology assessment study that focuses on the relationship between technology and money. The application of technology to payments systems is transforming the way we use money and, in some instances, is blurring the definition of what constitutes money. This chapter surveys the developments in electronic forms of payment and their relationship to the banking system. It also analyses the challenges posed by electronic money for regulators and policy makers, and in particular the opportunities created by two simultaneous processes: the Economic and Monetary Union and the increasing use of electronic payment instruments. The third chapter deals with the implications of developments in ICT on relationship banking. The financial intermediation literature explains relationship banking as a type of financial intermediation characterised by proprietary information and multiple interactions with customers. This form of banking is important for the financing of small and medium-sized enterprises. We discuss the effects of ICT on the banking sector as a whole and then apply these developments to the case of relationship banking. The fourth chapter is an empirical study of the effects of technology on the banking business, using a sample of data from the Spanish banking industry. The design of the study is based on some of the events described in the previous chapters, and also draws from the economic literature on banking. The study shows that developments in information management have differential effects on wholesale and retail banking activities. Finally, the last chapter is a technology assessment study on electronic payments systems in Spain and the European Union. It contains an analysis of existing payment systems and ongoing or planned initiatives in Spain. It forms part of a broader project comprising a series of country-specific analyses covering ten European countries. The main issues raised across the countries serve as the starting point to discuss implications of the development of electronic money for regulation and policies, and in particular, for monetary-policy making.

Desenvolupament d'un sistema expert com a eina per a una millor gestió de la qualitat de les aigües fluvials

Avui en dia no es pot negar el fet que els humans són un component més de les conques fluvials i que la seva activitat afecta enormement la qualitat de les aigües. A nivell europeu, l'elevada densitat de població situada en les conques fluvials ha comportat un increment de la mala qualitat de les seves aigües fluvials. En les darreres dècades l'increment de les càrregues de nutrients en els sistemes aquàtics ha esdevingut un problema prioritari a solucionar per les administracions competents en matèria d'aigua. La gestió dels ecosistemes fluvials no és una tasca fàcil. Els gestors es troben amb què són sistemes molt complexos, donada l'estreta relació existent entre els ecosistemes fluvials i els ecosistemes terrestres que drenen. Addicionalment a la complexitat d'aquests sistemes es troba la dificultat associada de la gestió o control de les entrades de substàncies contaminants tant de fonts puntuals com difoses. Per totes aquestes raons la gestió de la qualitat de les aigües fluvials esdevé una tasca complexa que requereix un enfocament multidisciplinar. Per tal d'assolir aquest enfocament diverses eines han estat utilitzades, des de models matemàtics fins a sistemes experts i sistemes de suport a la decisió. Però, la major part dels esforços han estat encarats cap a la resolució de problemes de reduïda complexitat, fent que molts dels problemes ambientals complexos, com ara la gestió dels ecosistemes fluvials, no hagin estat vertaderament tractats. Per tant, es requereix l'aplicació d'eines que siguin de gran ajuda en els processos de presa de decisions i que incorporin un ampli coneixement heurístic i empíric: sistemes experts i sistemes de suport a la decisió. L'òptima gestió de la qualitat de l'aigua fluvial requereix una aproximació integrada i multidisciplinar, que pot ésser aconseguida amb una eina intel·ligent construïda sobre els conceptes i mètodes del raonament humà. La present tesi descriu la metodologia desenvolupada i aplicada per a la creació i construcció d'un Sistema Expert, així com el procés de desenvolupament d'aquest Sistema Expert, com el principal mòdul de raonament d'un Sistema de Suport a la Decisió Ambiental. L'objectiu principal de la present tesi ha estat el desenvolupament d'una eina d'ajuda en el procés de presa de decisions dels gestors de l'aigua en la gestió de trams fluvials alterats antròpicament per tal de millorar la qualitat de la seva aigua fluvial. Alhora, es mostra el funcionament de l'eina desenvolupada a través de dos casos d'estudi. Els resultats derivats del Sistema Expert desenvolupat, implementat i presentat en la present tesi mostren que aquests sistemes poden ésser eines útils per a millorar la gestió dels ecosistemes fluvials.

New mono- and dinuclear ruthenium complexes containing the 3,5-bis(2-pyridyl)pyrazole ligand. Synthesis, characterization and applications

Se han sintetizado dos nuevos complejos mononucleares de Ru, con formula [RuCl2(Hbpp)(dmso)2], a partir de la reacción entre [RuCl2(dmso)4] y Hbpp (3,5-bis(2-piridil)pirazola). El hecho que sólo tres de los seis posibles estereoisómeros se obtengan a partir de esta reacción, se ha racionalizado en base a factores estructurales y electrónicos. Estos complejos se han caracterizado de forma estructural, espectroscópica y electroquímica. En acetonitrilo en medio básico, el isómero trans,cis-[RuCl2(Hbpp)(dmso)2] da lugar a procesos de isomerización de enlace de un ligando dmso cuando el Ru(II) se oxida a Ru(III). Las constantes termodinámicas y cinéticas para el proceso se han determinado por voltametria cíclica. La irradiación de trans,cis-[RuCl2(Hbpp)(dmso)2] y cis(out),cis-[RuCl2(Hbpp)(dmso)2] con luz UV o solar da lugar a reacciones de fotosustitución de un ligando dmso por una molécula de acetonitrilo para dar un nuevo compuesto el cual ha sido caracterizado en solución por técnicas espectroscópicas y electroquímicas. Ambos complejos resultan catalizadores útiles en la transferencia de hidrógeno de isopropanol a acetofenona, obteniéndose 1-feniletanol como único producto y un 42.1% de conversión (36.1 ciclos metálicos) a 80ºC con el isómero trans,cis-[RuCl2(Hbpp)(dmso)2], que resulta significativamente más eficaz que el complejo cis(out),cis-[RuCl2(Hbpp)(dmso)2]. La reacción de cis(out),cis-[RuCl2(Hbpp)(dmso)2] con trpy (2,2':6',2"-terpiridina) da lugar a los dos isómeros geométricos del complejo [Ru(Hbpp)(trpy)(Cl)]+, el in y el out. Estos complejos se han aislado y caracterizado por técnicas estructurales, espectroscópicas y electroquímicas. Estos cloro complejos han sido utilizados como precursores para la síntesis de los complejos análogos con ligandos aqua (in,out-[Ru(Hbpp)(trpy)(H2O)]2+) y piridina (in,out-[Ru(Hbpp)(trpy)(py)]2+), los cuales también han sido aislados y caracterizados. Las propiedades ácido-base de los aqua complejos, y del complejo out-py se han estudiado detalladamente por voltametria cíclica y mediante valoraciones espectrofotométricas ácido-base. El tratamiento matemático de los datos así obtenidos nos ha permitido determinar los valores de pKa para los distintos equilibrios de protonación de los complejos en los estados de oxidación II y III. El complejo out-aqua ha demostrado ser un buen catalizador para la oxidación electroquímica del alcohol benzílico, presumiblemente a benzaldehido. La constante de velocidad de segundo orden para el proceso ha sido determinada como 17.1 M-1 s-1, por simulación matemática. El dímero con un puente cloro, [Ru2Cl(bpp)(trpy)2]2+ ha sido preparado por dos rutas sintéticas diferentes. El dímero análogo con un puente acetato se ha obtenido por reacción del cloro dímero con un exceso de acetato sódico. El dímero con dos ligandos aqua [Ru2(bpp)(trpy)2(OH2)2]3+ puede obtenerse por hidrólisis ácida del complejo con un acetato puente o por hidrólisis básica del complejo con un puente cloro. Estos complejos han sido caracterizados por técnicas estructurales, espectroscópicas y electroquímicas. Las soluciones del dímero con dos ligandos aqua en medio ácido resultan inestables a la coordinación de aniones de la solución con el tiempo. Las propiedades ácido-base del dímero con dos aguas coordinadas han sido estudiadas por voltametria cíclica y mediante experimentos de electrólisis a potencial controlado. El pKa para la desprotonación de uno de los ligandos aqua ha sido determinado mediante una valoración espectrofotométrica ácido-base como 6.7. Este valor tan bajo de pKa se atribuye a la formación de la entidad {Ru2O2H3}, favorable termodinámicamente. Los espectros UV-vis para los distintos estados de oxidación del aqua dímero, de RuIIRuII a RuIIIRuIV, han sido obtenidos por oxidación química y electroquímica del complejo. Se han llevado a cabo estudios cinéticos de la oxidación, paso a paso, de RuII,II a RuIV,IV , y se han determinado las constantes de oxidación de segundo orden para los distintos procesos de oxidación. La capacidad del aqua dímero en la oxidación del agua a oxígeno molecular ha sido investigada en solución homogénea utilizando CeIV como oxidante. La evolución de oxígeno se ha demostrado por cromatografia de gases. Se ha obtenido una eficiencia del 73% y 18.6 ciclos catalíticos, cuando 1.83 x 10-6 moles de dímero se han mezclado con un exceso de 100 equivalentes de cerio. El dímero con dos aguas cataliza también la oxidación del agua de forma heterogénea, con el complejo adsorbido sobre una membrana de nafion, aunque la eficiencia es menor. Se ha propuesto un mecanismo intramolecular para la reacción de oxidación del agua. Consiste en la oxidación a 4 electrones del dímero, de RuII,II a RuIV,IV, el cual reacciona con el agua para formar oxígeno y revierte nuevamente al estado de oxidación II,II. Este modelo es consistente con estudios catalíticos de la evolución de oxígeno en función de las concentraciones de cerio y catalizador, llevados a cabo en solución ácida homogénea, que demuestran que la oxidación a 4 electrones del agua se encuentra catalizada por una sola molécula de complejo bajo concentraciones elevadas de cerio. La constante de pseudo-primer-orden para la evolución de oxígeno tiene un valor de 1.4 x 10-2 s-1, que es uno de los valores de constante más elevados obtenidos hasta la fecha. Desafortunadamente, el aqua dímero se desactiva durante el proceso de catálisis dando lugar a una especie naranja, la cual estamos actualmente tratando de caracterizar.

Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

SQualTrack: A Tool for Robust Fault Detection

One of the techniques used to detect faults in dynamic systems is analytical redundancy. An important difficulty in applying this technique to real systems is dealing with the uncertainties associated with the system itself and with the measurements. In this paper, this uncertainty is taken into account by the use of intervals for the parameters of the model and for the measurements. The method that is proposed in this paper checks the consistency between the system's behavior, obtained from the measurements, and the model's behavior; if they are inconsistent, then there is a fault. The problem of detecting faults is stated as a quantified real constraint satisfaction problem, which can be solved using the modal interval analysis (MIA). MIA is used because it provides powerful tools to extend the calculations over real functions to intervals. To improve the results of the detection of the faults, the simultaneous use of several sliding time windows is proposed. The result of implementing this method is semiqualitative tracking (SQualTrack), a fault-detection tool that is robust in the sense that it does not generate false alarms, i.e., if there are false alarms, they indicate either that the interval model does not represent the system adequately or that the interval measurements do not represent the true values of the variables adequately. SQualTrack is currently being used to detect faults in real processes. Some of these applications using real data have been developed within the European project advanced decision support system for chemical/petrochemical manufacturing processes and are also described in this paper