Artificial intelligence approaches to network management: recent advances and a survey

With increased number of new services and users being added to the communication network, management of such networks becomes crucial to provide assured quality of service. Finding skilled managers is often a problem. To alleviate this problem and also to provide assistance to the available network managers, network management has to be automated. Many attempts have been made in this direction and it is a promising area of interest to researchers in both academia and industry. In this paper, a review of the management complexities in present day networks and artificial intelligence approaches to network management are presented. Published by Elsevier Science B.V.

Kinetics of copolyurethane network formation

Cure kinetics for the formation of copolyurethane networks of various compositions based on hydroxy-terminated polybutadiene(HTPB), poly(12-hydroxy stearic acid-co-TMP) ester polyol(PEP), and different isocyanates has been studied through viscosity build up during the cure reaction. The viscosity (N)-time (t) plots conform to the equation N = ae(bt), where a and b are empirical constants, dependent on the composition and the nature of the polyols and the isocyanates. The rate constants (b) for viscosity build up, evaluated from the slopes of dN/dt versus N plots at different temperatures, were found to vary significantly from 0.0073 to 0.25 min(-1); and the activation energies for gelation were found to be in the range 20 to 40 kJ mol(-1). The results have been interpreted in terms of the dependence of the rate constants on structural characteristics of the prepolymers. (C) 1997 John Wiley & Sons, Inc.

Reinforcement Learning With Function Approximation for Traffic Signal Control

We propose, for the first time, a reinforcement learning (RL) algorithm with function approximation for traffic signal control. Our algorithm incorporates state-action features and is easily implementable in high-dimensional settings. Prior work, e. g., the work of Abdulhai et al., on the application of RL to traffic signal control requires full-state representations and cannot be implemented, even in moderate-sized road networks, because the computational complexity exponentially grows in the numbers of lanes and junctions. We tackle this problem of the curse of dimensionality by effectively using feature-based state representations that use a broad characterization of the level of congestion as low, medium, or high. One advantage of our algorithm is that, unlike prior work based on RL, it does not require precise information on queue lengths and elapsed times at each lane but instead works with the aforementioned described features. The number of features that our algorithm requires is linear to the number of signaled lanes, thereby leading to several orders of magnitude reduction in the computational complexity. We perform implementations of our algorithm on various settings and show performance comparisons with other algorithms in the literature, including the works of Abdulhai et al. and Cools et al., as well as the fixed-timing and the longest queue algorithms. For comparison, we also develop an RL algorithm that uses full-state representation and incorporates prioritization of traffic, unlike the work of Abdulhai et al. We observe that our algorithm outperforms all the other algorithms on all the road network settings that we consider.