An Estimator Algorithm For Learning Automata With Changing Number Of Actions

In many problems of decision making under uncertainty the system has to acquire knowledge of its environment and learn the optimal decision through its experience. Such problems may also involve the system having to arrive at the globally optimal decision, when at each instant only a subset of the entire set of possible alternatives is available. These problems can be successfully modelled and analysed by learning automata. In this paper an estimator learning algorithm, which maintains estimates of the reward characteristics of the random environment, is presented for an automaton with changing number of actions. A learning automaton using the new scheme is shown to be e-optimal. The simulation results demonstrate the fast convergence properties of the new algorithm. The results of this study can be extended to the design of other types of estimator algorithms with good convergence properties.

An exploration framework to identify and track movement of cloud systems

We describe a framework to explore and visualize the movement of cloud systems. Using techniques from computational topology and computer vision, our framework allows the user to study this movement at various scales in space and time. Such movements could have large temporal and spatial scales such as the Madden Julian Oscillation (MJO), which has a spatial scale ranging from 1000 km to 10000 km and time of oscillation of around 40 days. Embedded within these larger scale oscillations are a hierarchy of cloud clusters which could have smaller spatial and temporal scales such as the Nakazawa cloud clusters. These smaller cloud clusters, while being part of the equatorial MJO, sometimes move at speeds different from the larger scale and in a direction opposite to that of the MJO envelope. Hitherto, one could only speculate about such movements by selectively analysing data and a priori knowledge of such systems. Our framework automatically delineates such cloud clusters and does not depend on the prior experience of the user to define cloud clusters. Analysis using our framework also shows that most tropical systems such as cyclones also contain multi-scale interactions between clouds and cloud systems. We show the effectiveness of our framework to track organized cloud system during one such rainfall event which happened at Mumbai, India in July 2005 and for cyclone Aila which occurred in Bay of Bengal during May 2009.

An empirical understanding of use of internal analogies in conceptual design

Internal analogies are created if the knowledge of source domain is obtained only from the cognition of designers. In this paper, an understanding of the use of internal analogies in conceptual design is developed by studying: the types of internal analogies; the roles of internal analogies; the influence of design problems on the creation of internal analogies; the role of experience of designers on the use of internal analogies; the levels of abstraction at which internal analogies are searched in target domain, identified in source domain, and realized in the target domain; and the effect of internal analogies from the natural and artificial domains on the solution space created using these analogies. To facilitate this understanding, empirical studies of design sessions from earlier research, each involving a designer solving a design problem by identifying requirements and developing conceptual solutions, without using any support, are used. The following are the important findings: designers use analogies from the natural and artificial domains; analogies are used for generating requirements and solutions; the nature of the design problem influences the use of analogies; the role of experience of designers on the use of analogies is not clearly ascertained; analogical transfer is observed only at few levels of abstraction while many levels remain unexplored; and analogies from the natural domain seem to have more positive influence than the artificial domain on the number of ideas and variety of idea space.