Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey

This work is a survey of the average cost control problem for discrete-time Markov processes. The authors have attempted to put together a comprehensive account of the considerable research on this problem over the past three decades. The exposition ranges from finite to Borel state and action spaces and includes a variety of methodologies to find and characterize optimal policies. The authors have included a brief historical perspective of the research efforts in this area and have compiled a substantial yet not exhaustive bibliography. The authors have also identified several important questions that are still open to investigation.

Some experiments on human memory and a new neural model

An associative memory with parallel architecture is presented. The neurons are modelled by perceptrons having only binary, rather than continuous valued input. To store m elements each having n features, m neurons each with n connections are needed. The n features are coded as an n-bit binary vector. The weights of the n connections that store the n features of an element has only two values -1 and 1 corresponding to the absence or presence of a feature. This makes the learning very simple and straightforward. For an input corrupted by binary noise, the associative memory indicates the element that is closest (in terms of Hamming distance) to the noisy input. In the case where the noisy input is equidistant from two or more stored vectors, the associative memory indicates two or more elements simultaneously. From some simple experiments performed on the human memory and also on the associative memory, it can be concluded that the associative memory presented in this paper is in some respect more akin to a human memory than a Hopfield model.

Some features of spray breakup in effervescent atomizers

The near orifice spray breakup at low GLR (gas to liquid ratio by mass) values in an effervescent atomizer is studied experimentally using water as a simulant and air as atomizing gas. From the visualizations, the near orifice spray structures are classified into three modes: discrete bubble explosions, continuous bubble explosions and annular conical spray. The breakup of the spray is quantified in terms of the mean bubble bursting distance from the orifice. The parametric study indicates that the mean bubble bursting distance mainly depends on airflow rate, jet diameter and mixture velocity. It is also observed that the jet diameter has a dominant effect on the bubble bursting distance when compared to mixture velocity at a given airflow rate. The mean bubble bursting distance is shown to be governed by a nondimensional two-phase flow number consisting of all the aforementioned parameters. The location of bubble bursting is found to be highly unsteady spatially, which is influenced by flow dynamics inside the injector. It is proposed that this unsteadiness in jet breakup length is a consequence of varying degree of bubble expansion caused due to the intermittent occurrence of single phase and two-phase flow inside the orifice.

Quantification of enantiomeric excess by H-1-detected heteronuclear refocusing and homonuclear multiple quantum NMR experiments

The omega(1)-heterodecoupled-C-13-filtered proton detected NMR experiments are reported for the accurate quantification of enantiomeric excess in chiral molecules embedded in chiral liquid crystal. The differential values of both H-1-H-1 and C-13-H-1 dipolar couplings in the direct dimension and only H-1-H-1 dipolar couplings in the indirect dimension enable unraveling of overlapped enantiomeric peaks. The creation of unequal C-13-bound proton signal for each enantiomer in the INEPT block and non-uniform excitation of coherences in homonuclear multiple quantum experiments do not yield accurate quantification of enantiomeric excess. In circumventing these difficulties, a coupling dependent intensity correction factor has been invoked. (C) 2010 Elsevier B.V. All rights reserved.

A discrete state perspective of manipulator workspaces Vorstellungen von diskreten zuständen von manipulator-arbeitsräumen

The finite resolution of joint drives or sensors imparts a discrete nature to the joints of a manipulator. Because of this an arbitrary point in the workspace cannot be reached without error even in ideal mechanical environment. This paper investigates the effect of this discrete nature of the joints on the accuracy of performance of a manipulator and develops a method to select the joint states to reach a point with least error. It is shown that the configuration leading to least error cannot, in general, be found from configuration space, especially when there is large variation in the link lengths or joint resolutions or both. The anomaly becomes severe when the gross motion of the end-effector approaches the local resolution of the workspace. The paper also shows how to distinguish two workspaces which may be identical so far as the boundary points are concerned, taking the joint resolutions into account. Finally, the concepts have been extended to define continuous space global and local performance indices for general multi degree of freedom manipulators.

The gasification of wood-char spheres in CO2---N2 mixtures: analysis and experiments

The gasification of charcoal spheres in an atmosphere of carbon-dioxide-nitrogen mixture involving diffusion and reactions in the pores is modelled and the results are compared with experiments of Standish and Tanjung and those performed in the laboratory on wood-char spheres to determine the effects of diameter, density, gas composition and flow. The results indicate that the conversion time, t(c) approximately d1.03 for large particles (> 5 mm), departing substantially from the t(c) approximately d2 law valid for diffusion limited conditions. The computational studies indicate that the kinetic limit for the particle is below 100 mum. The conversion time varies inversely as the initial char density as expected in the model. Predictions from the model show that there is no significant change in conversion time up to 60% N2 consistent with the CO2-N2 experiments. The variation of diameter and density with time are predicted. The peculiar dependence of conversion time on flow velocity in the experiments is sought to be explained by opposing free and forced convection heat transfer and the attempt is only partly successful. The studies also indicate that the dependence on the CO concentration with low CO2 is significant, indicating the need for multistep reaction mechanism against the generally accepted single-step reaction.

A note on the choice of interfacial friction angle

Estimates of interfacial friction angle (delta) are necessary for the design of retaining structures and deep foundations, Recommendations in the literature regarding delta values are often contradictory and are therefore not easy to apply in geotechnical design, A critical examination of past studies in terms of data generation techniques used and conclusions drawn indicates that two distinctly different test procedures/techniques have been evolved. The interfacial situation in practice can also be categorized into two broad types, These two types of interface problems in geotechnical engineering are (a) the structure is placed on the free surface of prepared fill (type A situation) and (b) the fill is placed against the material surface which functions as a confined boundary (type B situation), The friction angle delta depends on the surface roughness of the construction material, But in the type A situation, it is independent of density and its limiting maximum value (delta(lim)) is the critical state friction angle phi(cv). In the type B situation, it is dependent on density of the fill and its limiting maximum value is the peak angle of internal friction phi(p) of the fill.

Active vibration suppression of beams with discrete actuators using optimal dynamic inversion

Most of the structural elements like beams, cables etc. are flexible and should be modeled as distributed parameter systems (DPS) to represent the reality better. For large structures, the usual approach of 'modal representation' is not an accurate representation. Moreover, for excessive vibrations (possibly due to strong wind, earthquake etc.), external power source (controller) is needed to suppress it, as the natural damping of these structures is usually small. In this paper, we propose to use a recently developed optimal dynamic inversion technique to design a set of discrete controllers for this purpose. We assume that the control force to the structure is applied through finite number of actuators, which are located at predefined locations in the spatial domain. The method used in this paper determines control forces directly from the partial differential equation (PDE) model of the system. The formulation has better practical significance, both because it leads to a closed form solution of the controller (hence avoids computational issues) as well as because a set of discrete actuators along the spatial domain can be implemented with relative ease (as compared to a continuous actuator)

Choice of Classifiers in Hierarchical Recognition of Online Handwritten Kannada and Tamil Aksharas

In this paper, we propose a novel dexterous technique for fast and accurate recognition of online handwritten Kannada and Tamil characters. Based on the primary classifier output and prior knowledge, the best classifier is chosen from set of three classifiers for second stage classification. Prior knowledge is obtained through analysis of the confusion matrix of primary classifier which helped in identifying the multiple sets of confused characters. Further, studies were carried out to check the performance of secondary classifiers in disambiguating among the confusion sets. Using this technique we have achieved an average accuracy of 92.6% for Kannada characters on the MILE lab dataset and 90.2% for Tamil characters on the HP Labs dataset.

Metal-insulator transition in perovskite oxides: Tunneling experiments

In this paper we have investigated the composition-driven metal-insulator (MI) transitions in two ABO3 classes of perovskite oxides (LaNixCo1-xO3 and NaxTayW1-yO3) in the composition range close to the critical region by using the tunneling technique. Two types of junctions (point-contact and planar) have been used for the investigation covering the temperature range 0.4 K

Sensitivity Enhancement in Solid-State Separated Local Field NMR Experiments by the Use of Adiabatic Cross-Polarization

Measurement of dipolar couplings using separated local field (SLF) NMR experiment is a powerful tool for structural and dynamics studies of oriented molecules such as liquid crystals and membrane proteins in aligned lipid bilayers. Enhancing the sensitivity of such SLF techniques is of significant importance in present-day solid-state NMR methodology. The present study considers the use of adiabatic cross-polarization for this purpose, which is applied for the first time to one of the well-known SLF techniques, namely, polarization inversion spin exchange at the magic angle (PISEMA). The experiments have been carried out on a single crystal of a model peptide, and a dramatic enhancement in signal-to-noise up to 90% has been demonstrated.

Solvation dynamics in monohydroxy alcohols: Agreement between theory and different experiments

Recently three different experimental studies on ultrafast solvation dynamics in monohydroxy straight-chain alcohols (C-1-C-4) have been carried out, with an aim to quantify the time constant (and the amplitude) of the ultrafast component. The results reported are, however, rather different from different experiments. In order to understand the reason for these differences, we have carried out a detailed theoretical study to investigate the time dependent progress of solvation of both an ionic and a dipolar solute probe in these alcohols. For methanol, the agreement between the theoretical predictions and the experimental results [Bingemann and Ernsting J. Chem. Phys. 1995, 102, 2691 and Horng et al. J: Phys, Chern, 1995, 99, 17311] is excellent. For ethanol, propanol, and butanol, we find no ultrafast component of the time constant of 70 fs or so. For these three liquids, the theoretical results are in almost complete agreement with the experimental results of Horng et al. For ethanol and propanol, the theoretical prediction for ionic solvation is not significantly different from that of dipolar solvation. Thus, the theory suggests that the experiments of Bingemann and Ernsting and those of Horng et al. studied essentially the polar solvation dynamics. The theoretical studies also suggest that the experimental investigations of Joo et al. which report a much faster and larger ultrafast component in the same series of solvents (J. Chem. Phys. 1996, 104, 6089) might have been more sensitive to the nonpolar part of solvation dynamics than the polar part. In addition, a discussion on the validity of the present theoretical approach is presented. In this theory the ultrafast component arises from almost frictionless inertial motion of the individual solvent molecules in the force field of its neighbors.

Some algorithms for discrete time queues with finite capacity

We consider a discrete time queue with finite capacity and i.i.d. and Markov modulated arrivals, Efficient algorithms are developed to calculate the moments and the distributions of the first time to overflow and the regeneration length, Results are extended to the multiserver queue. Some illustrative numerical examples are provided.

Transitional intermittency detection by neural network

A neural network has been used to predict the flow intermittency from velocity signals in the transition zone in a boundary layer. Unlike many of the available intermittency detection methods requiring a proper threshold choice in order to distinguish between the turbulent and non-turbulent parts of a signal, a trained neural network does not involve any threshold decision. The intermittency prediction based on the neural network has been found to be very satisfactory.

Precoding with X-codes to increase capacity with discrete input alphabets

We consider Gaussian multiple-input multiple-output (MIMO) channels with discrete input alphabets. We propose a non-diagonal precoder based on X-Codes in to increase the mutual information. The MIMO channel is transformed into a set of parallel subchannels using Singular Value Decomposition (SVD) and X-codes are then used to pair the subchannels. X-Codes are fully characterized by the pairings and the 2 × 2 real rotation matrices for each pair (parameterized with a single angle). This precoding structure enables to express the total mutual information as a sum of the mutual information of all the pairs. The problem of finding the optimal precoder with the above structure, which maximizes the total mutual information, is equivalent to i) optimizing the rotation angle and the power allocation within each pair and ii) finding the optimal pairing and power allocation among the pairs. It is shown that the mutual information achieved with the proposed pairing scheme is very close to that achieved with the optimal precoder by Cruz et al., and significantly better than mercury/waterfilling strategy by Lozano et al.. Our approach greatly simplifies both the precoder optimization and the detection complexity, making it suitable for practical applications.