A tutorial survey of reinforcement learning

This paper gives a compact, self-contained tutorial survey of reinforcement learning, a tool that is increasingly finding application in the development of intelligent dynamic systems. Research on reinforcement learning during the past decade has led to the development of a variety of useful algorithms. This paper surveys the literature and presents the algorithms in a cohesive framework.

A Study on the Success Potential of Multiple Mobile Payment Technologies

Payment systems all over the world have grown into a complicated web of solutions. This is more challenging in the case of mobile based payment systems. Mobile based payment systems are many and consist of different technologies providing different services. The diffusion of these various technologies in a market is uncertain. Diffusion theorists, for example Rogers, and Davis suggest how innovation is accepted in markets. In the case of electronic payment systems, the tale of Mondex vs Octopus throws interesting insights on diffusion. Our paper attempts to understand the success potential of various mobile payment technologies. We illustrate what we describe as technology breadth in mobile payment systems using data from payment systems all over the world (n=62). Our data shows an unexpected superiority of SMS technology, over other technologies like NFC, WAP and others. We also used a Delphi based survey (n=5) with experts to address the possibility that SMS will gain superiority in market diffusion. The economic conditions of a country, particularly in developing countries, the services availed and characteristics of the user (for example number of un-banked users in large populated countries) may put SMS in the forefront. This may be true more for micro payments using the mobile.

Genetic algorithms: a survey

Genetic algorithms provide an alternative to traditional optimization techniques by using directed random searches to locate optimal solutions in complex landscapes. We introduce the art and science of genetic algorithms and survey current issues in GA theory and practice. We do not present a detailed study, instead, we offer a quick guide into the labyrinth of GA research. First, we draw the analogy between genetic algorithms and the search processes in nature. Then we describe the genetic algorithm that Holland introduced in 1975 and the workings of GAs. After a survey of techniques proposed as improvements to Holland's GA and of some radically different approaches, we survey the advances in GA theory related to modeling, dynamics, and deception

Performance Analysis of User Selected Subband Channel Quality Indicator Feedback Scheme of LTE

Frequency-domain scheduling and rate adaptation have helped next generation orthogonal frequency division multiple access (OFDMA) based wireless cellular systems such as Long Term Evolution (LTE) achieve significantly higher spectral efficiencies. To overcome the severe uplink feedback bandwidth constraints, LTE uses several techniques to reduce the feedback required by a frequency-domain scheduler about the channel state information of all subcarriers of all users. In this paper, we analyze the throughput achieved by the User Selected Subband feedback scheme of LTE. In it, a user feeds back only the indices of the best M subbands and a single 4-bit estimate of the average rate achievable over all selected M subbands. In addition, we compare the performance with the subband-level feedback scheme of LTE, and highlight the role of the scheduler by comparing the performances of the unfair greedy scheduler and the proportional fair (PF) scheduler. Our analysis sheds several insights into the working of the feedback reduction techniques used in LTE.

Soft condensed matter: A survey and a proposal

Pn this perspective on the increasingly important field of soft condensed matter science, I make the case for a concentrated multidisciplinary effort to develop the area in India. I base my arguments on its demonstrated potential for new 'emergent' phenomena, interesting table-top experiments, and applications.

Status Survey of the Malabar Pied Hornbill in the Dandeli Region, Northern Western Ghats, India

The Malabar Pied Hornbill, Anthracoceros coronatus, is a near threatened species, endemic to the tropical deciduous forests of central and southern India and Sri Lanka. The Dandeli region in Karnataka (India) is believed to be the last stronghold of this species in the Western Ghats biodiversity hotspot. Being a rapidly developing area with a growing human population, the threats to this species and their habitat are mounting, especially due to a large number of hydroelectric projects and habitat fragmentation caused by paper and plywood industries. This study evaluated the change in population status of the Malabar Pied Hornbill over a 23 year period and defined priorities for the long term conservation and monitoring of hornbills in Dandeli. Encounter rates of hornbills were also analysed in relation to the density and species richness of trees and fruiting trees, basal area, canopy cover and distance from river. Hornbill encounters were not significantly different compared to the earlier study carried out by Reddy in 1988, but were significantly different across the five sites in the current study. Higher numbers of hornbills were encountered closer to the river, but these results were only marginally significant. The mean numbers of hornbills recorded at the two roost sites identified in Dandeli were 26 +/- 4.47 (n=16 counts) and 31.78 +/- 3.53 (n=14 counts) respectively. The study also helped build local awareness about the species, train local Forest Department staff in monitoring hornbills and develop a management plan for its conservation.

Anti-malarial herbal remedies of northeast India, Assam: An ethnobotanical survey

Ethnopharmacological relevance: Malaria is a serious public health problem in the north-eastern region of India including Assam, in view of development of chloroquine resistant Plasmodium falciparum. There is need for alternative and affordable therapy. Aim of the study: This study was conducted to document indigenous knowledge, usage customs and practices of medicinal plant species traditionally used by the residents of Sonitpur district of Tezpur, Assam to treat malaria and its associated symptoms. Materials and methods:A total of 50 randomly selected sampling represented by male (38.76%) and female respondents (12.24%) were interviewed using a semi-structured questionnaire. Results: The present ethno-botanical survey revealed 22 species of plants belonging to 17 botanical families were reported to be used exclusively in this region for the treatment of malaria. Verbenaceae (three species), Menispermaceae (two species), and Acanthaceae (two species) botanical families represented the species that are most commonly cited in this survey work and the detailed use of plants has been collected and described. Conclusions: The most serious threat to the existing knowledge and practice on traditional medicinal plants included cultural change, particularly the influence of modernization and lack of interests shown by the next younger generations were the main problems reported by the informants during the field survey. Hence, the proper documentation of traditional medicinal plants being used as anti-malarial agents and related indigenous knowledge held by the tribal community is an important approach to control the spread of vector-borne diseases like malaria reported in this survey work. (C) 2010 Elsevier Ireland Ltd. All rights reserved.

An ethnobotanical survey of medicinal plants in the Eastern Himalayan zone of Arunachal Pradesh, India

Aim of the study: The medicinal plants are integral source of easily available remedy used in rural healthcare system. This study was conducted among three major ethnic groups namely the Nocte, the Nyishi and the Adi in the Eastern Himalayan region of Arunachal Pradesh to evaluate their comparative knowledge on medicinal plants. Materials and methods: The three remote districts of Arunachal Pradesh namely the Tirap, the Dibang Valley and the Papum Pare were surveyed through interviewing of randomly selected 237 participants using semi-structured questionnaire and regular field visits to selected districts. Results: We recorded the traditional use of 74 medicinal plants species belonging to 41 taxonomic plant families used for treating a total of 25 different diseases/ailments. The informant consensus factor (ICF) values demonstrated that local people tend to agree more with each other in terms of the plants used to treat malaria (0.71), jaundice (0.62), urological problems (0.56), dermatological disorders (0.45), pain (0.30), and respiratory disorder (0.33), and while the general health (0.15) and gastro-intestinal disorders category (0.28) were found low ICF values. Conclusion: Of the total 74 species recorded, the highest number of medicinal plants (36 species) was reported from the Adi of Lower Dibang Valley followed by the Nocte of the Tirap (25 species) and the Nyishi ethnic groups of Papum Pare districts (13 species). In the present study, we found that the men, elder people and illiterate ones had better knowledge on medicinal plants as compared to women, younger and literate people. Findings of this documentation study can be used as an ethnopharmacological basis for selecting plants for future phytochemical and pharmaceutical studies. (C) 2010 Elsevier Ireland Ltd. All rights reserved.

Artificial intelligence approaches to network management: recent advances and a survey

With increased number of new services and users being added to the communication network, management of such networks becomes crucial to provide assured quality of service. Finding skilled managers is often a problem. To alleviate this problem and also to provide assistance to the available network managers, network management has to be automated. Many attempts have been made in this direction and it is a promising area of interest to researchers in both academia and industry. In this paper, a review of the management complexities in present day networks and artificial intelligence approaches to network management are presented. Published by Elsevier Science B.V.

A checking method for probabilistic seismic-hazard assessment: case studies on three cities

The conventional Cornell's source-based approach of probabilistic seismic-hazard assessment (PSHA) has been employed all around the world, whilst many studies often rely on the use of computer packages such as FRISK (McGuire FRISK-a computer program for seismic risk analysis. Open-File Report 78-1007, United States Geological Survey, Department of Interior, Washington 1978) and SEISRISK III (Bender and Perkins SEISRISK III-a computer program for seismic hazard estimation, Bulletin 1772. United States Geological Survey, Department of Interior, Washington 1987). A ``black-box'' syndrome may be resulted if the user of the software does not have another simple and robust PSHA method that can be used to make comparisons. An alternative method for PSHA, namely direct amplitude-based (DAB) approach, has been developed as a heuristic and efficient method enabling users to undertake their own sanity checks on outputs from computer packages. This paper experiments the application of the DAB approach for three cities in China, Iran, and India, respectively, and compares with documented results computed by the source-based approach. Several insights regarding the procedure of conducting PSHA have also been obtained, which could be useful for future seismic-hazard studies.

On optimal timer-based distributed selection for rate-adaptive multi-user diversity systems

We develop an optimal, distributed, and low feedback timer-based selection scheme to enable next generation rate-adaptive wireless systems to exploit multi-user diversity. In our scheme, each user sets a timer depending on its signal to noise ratio (SNR) and transmits a small packet to identify itself when its timer expires. When the SNR-to-timer mapping is monotone non-decreasing, timers of users with better SNRs expire earlier. Thus, the base station (BS) simply selects the first user whose timer expiry it can detect, and transmits data to it at as high a rate as reliably possible. However, timers that expire too close to one another cannot be detected by the BS due to collisions. We characterize in detail the structure of the SNR-to-timer mapping that optimally handles these collisions to maximize the average data rate. We prove that the optimal timer values take only a discrete set of values, and that the rate adaptation policy strongly influences the optimal scheme's structure. The optimal average rate is very close to that of ideal selection in which the BS always selects highest rate user, and is much higher than that of the popular, but ad hoc, timer schemes considered in the literature.

Modelling, simulation, and graphical user interface for industrial gas carburising process

A mathematical model has been developed for the gas carburising (diffusion) process using finite volume method. The computer simulation has been carried out for an industrial gas carburising process. The model's predictions are in good agreement with industrial experimental data and with data collected from the literature. A study of various mass transfer and diffusion coefficients has been carried out in order to suggest which correlations should be used for the gas carburising process. The model has been interfaced in a Windows environment using a graphical user interface. In this way, the model is extremely user friendly. The sensitivity analysis of various parameters such as initial carbon concentration in the specimen, carbon potential of the atmosphere, temperature of the process, etc. has been carried out using the model.

Techniques for realistic visualization of fluids: A survey

Visualization of fluids has wide applications in science, engineering and entertainment. Various methodologies Of visualizing fluids have evolved which emphasize on capturing different aspects of the fluids accurately. In this survey the existing methods for realistic visualization of fluids are reviewed. The approaches are classified based on the key concept they rely on for fluid modeling. This classification allows for easy selection of the method to be adopted for visualization given an application. It also enables identification of alternative techniques for fluid modeling.

Finite Signal-set Capacity of Two-user Gaussian Multiple Access Channel

The capacity region of a two-user Gaussian Multiple Access Channel (GMAC) with complex finite input alphabets and continuous output alphabet is studied. When both the users are equipped with the same code alphabet, it is shown that, rotation of one of the user’s alphabets by an appropriate angle can make the new pair of alphabets not only uniquely decodable, but will result in enlargement of the capacity region. For this set-up, we identify the primary problem to be finding appropriate angle(s) of rotation between the alphabets such that the capacity region is maximally enlarged. It is shown that the angle of rotation which provides maximum enlargement of the capacity region also minimizes the union bound on the probability of error of the sumalphabet and vice-verse. The optimum angle(s) of rotation varies with the SNR. Through simulations, optimal angle(s) of rotation that gives maximum enlargement of the capacity region of GMAC with some well known alphabets such as M-QAM and M-PSK for some M are presented for several values of SNR. It is shown that for large number of points in the alphabets, capacity gains due to rotations progressively reduce. As the number of points N tends to infinity, our results match the results in the literature wherein the capacity region of the Gaussian code alphabet doesn’t change with rotation for any SNR.

Seismic Hazard and Microzonation Studies using Geographic Information System - A Case Study of Bangalore city

Seismic hazard and microzonation of cities enable to characterize the potential seismic areas that need to be taken into account when designing new structures or retrofitting the existing ones. Study of seismic hazard and preparation of geotechnical microzonation maps has been attempted using Geographical Information System (GIS). GIS will provide an effective solution for integrating different layers of information thus providing a useful input for city planning and in particular input to earthquake resistant design of structures in an area. Seismic hazard is the study of expected earthquake ground motions at any point on the earth. Microzonation is the process of sub division of region in to number of zones based on the earthquake effects in the local scale. Seismic microzonation is the process of estimating response of soil layers under earthquake excitation and thus the variation of ground motion characteristic on the ground surface. For the seismic microzonation, geotechnical site characterization need to be assessed at local scale (micro level), which is further used to assess of the site response and liquefaction susceptibility of the sites. Seismotectonic atlas of the area having a radius of 350km around Bangalore has been prepared with all the seismogenic sources and historic earthquake events (a catalogue of about 1400 events since 1906). We have attempted to carryout the site characterization of Bangalore by collating conventional geotechnical boreholes data (about 900 borehole data with depth) and integrated in GIS. 3-D subsurface model of Bangalore prepared using GIS is shown in Figure 1.Further, Shear wave velocity survey based on geophysical method at about 60 locations in the city has been carried out in 220 square Kms area. Site response and local site effects have been evaluated using 1-dimensional ground response analysis. Spatial variability of soil overburden depths, ground surface Peak Ground Acceleration’s(PGA), spectral acceleration for different frequencies, liquefaction susceptibility have been mapped in the 220 sq km area using GIS.ArcInfo software has been used for this purpose. These maps can be used for the city planning and risk & vulnerability studies. Figure 2 shows a map of peak ground acceleration at rock level for Bangalore city. Microtremor experiments were jointly carried out with NGRI scientists at about 55 locations in the city and the predominant frequency of the overburden soil columns were evaluated.