Optimal Control of Markov Processes with Age-Dependent Transition Rates

We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterise the value function and optimal controls for both discounted and average cost cases.

Computational algorithms inspired by biological processes and evolution

In recent times computational algorithms inspired by biological processes and evolution are gaining much popularity for solving science and engineering problems. These algorithms are broadly classified into evolutionary computation and swarm intelligence algorithms, which are derived based on the analogy of natural evolution and biological activities. These include genetic algorithms, genetic programming, differential evolution, particle swarm optimization, ant colony optimization, artificial neural networks, etc. The algorithms being random-search techniques, use some heuristics to guide the search towards optimal solution and speed-up the convergence to obtain the global optimal solutions. The bio-inspired methods have several attractive features and advantages compared to conventional optimization solvers. They also facilitate the advantage of simulation and optimization environment simultaneously to solve hard-to-define (in simple expressions), real-world problems. These biologically inspired methods have provided novel ways of problem-solving for practical problems in traffic routing, networking, games, industry, robotics, economics, mechanical, chemical, electrical, civil, water resources and others fields. This article discusses the key features and development of bio-inspired computational algorithms, and their scope for application in science and engineering fields.

Peraluminous sapphirine-cordierite pods in Mg-rich orthopyroxene granulite from southern India: Implications for lower crustal processes

Sapphirine-cordierite intergrowths occur as pods within garnet-absent, high-Mg orthopyroxene-granulite xenoliths in the Kambam valley, Madurai Block, southern India. Whereas the cores of the pods are composed of sapphirine (X-Mg = 0.871-0.897) - cordierite (X-Mg = 0.892-0.931) intergrowth along with rutile, zircon and monazite, the rims are characterized by cordierite, apatite, plagioclase, K-feldspar, quartz and minor calcite. The surrounding matrix comprises orthopyroxene (maximum Al2O3 4.1 wt.%, X-Mg 0.848-0.850), plagioclase, biotite and quartz, similar to the assemblage in the surrounding charnockites. Sapphirine in the Kambam rocks is characterized by high Al contents with an end-member composition in the range of 7:9:3 and 3:5:1. The occurrence of peraluminous sapphirine in association with cordierite and in the absence of phases such as sillimanite and garnet is distinct from ultrahigh-temperature assemblages in other localities within the Madurai Block. The peraluminous composition of the pods suggests that these domains could represent cryptic pathways through which aluminous melts migrated. The reaction of such peraluminous melts with Mg-rich orthopyroxene in the host granulite at temperatures of 1025 degrees C and pressures around 8 kbar as computed from phase equilibria modeling followed by an isobaric cooling is inferred to have generated the sapphirine-cordierite pods. The unusual high-Mg orthopyroxene granulite suggests interaction of supracrustal rocks with mafic magmas, which probably acted as the heat source for the partial melting of lower crust and UHT metamorphism.

Non-Stationary Semi-Markov Decision Processes on a Finite Horizon

We introduce and study a class of non-stationary semi-Markov decision processes on a finite horizon. By constructing an equivalent Markov decision process, we establish the existence of a piecewise open loop relaxed control which is optimal for the finite horizon problem.

Selective excitation and detection of maximum quantum coherence of a group of scalar coupled protons in chiral molecules: an NMR experiment for enantiodiscrimination

The H-1 NMR spectroscopic discrimination of enantiomers in the solution state and the measurement of enantiomeric composition is most often hindered due to either very small chemical shift differences between the discriminated peaks or severe overlap of transitions from other chemically non-equivalent protons. In addition the use of chiral auxiliaries such as, crown ether and chiral lanthanide shift reagent may often cause enormous line broadening or give little degree of discrimination beyond the crown ether substrate ratio, hampering the discrimination. In circumventing such problems we are proposing the utilization of the difference in the additive values of all the chemical shifts of a scalar coupled spin system. The excitation and detection of appropriate highest quantum coherence yields the measurable difference in the frequencies between two transitions, one pertaining to each enantiomer in the maximum quantum dimension permitting their discrimination and the F-2 cross section at each of these frequencies yields an enantiopure spectrum. The advantage of the utility of the proposed method is demonstrated on several chiral compounds where the conventional one dimensional H-1 NMR spectra fail to differentiate the enantiomers.

Fracture processes of self compacting Concrete using image analysis

The mode I fracture toughness of concrete can be experimentally determined using three point bend beam in conjunction with digital image correlation (DIC). Three different geometrically similar sizes of beams are cast for this study. To study the influence of fly ash and silica fume on fracture toughness of SCC, three SCC mixes are prepared with and without mineral additions. The scanning electron microscope (SEM) images are taken on the fractured surface to add information on fracture process in SCC. From this study, it is concluded that the fracture toughness of SCC with mineral addition is higher when compared to those without mineral addition.

Sub-band envelope approach to obtain instants of significant excitation in speech

In this paper, we propose a new sub-band approach to estimate the glottal activity. The method is based on the spectral harmonicity and the sub-band temporal properties of voiced speech. We propose a method to represent glottal excitation signal using sub-band temporal envelope. Instants of maximum glottal excitation or Glottal Closure Instants (GCI) are extracted from the estimated glottal excitation pattern and the result is compared with a standard GCI computation method, DYPSA [1]. The performance of the algorithm is also compared for the noisy signal and it is shown that the proposed method is less variant to GCI estimation under noisy conditions compared to DYPSA. The algorithm is evaluated on the CMU-ARCTIC database.

A novel Q-learning algorithm with function approximation for constrained Markov decision processes

We present a novel multi-timescale Q-learning algorithm for average cost control in a Markov decision process subject to multiple inequality constraints. We formulate a relaxed version of this problem through the Lagrange multiplier method. Our algorithm is different from Q-learning in that it updates two parameters - a Q-value parameter and a policy parameter. The Q-value parameter is updated on a slower time scale as compared to the policy parameter. Whereas Q-learning with function approximation can diverge in some cases, our algorithm is seen to be convergent as a result of the aforementioned timescale separation. We show the results of experiments on a problem of constrained routing in a multistage queueing network. Our algorithm is seen to exhibit good performance and the various inequality constraints are seen to be satisfied upon convergence of the algorithm.

Some implications of lepton flavor violating processes in a supersymmetric Type II seesaw model at TeV scale

We have conceived a supersymmetric Type II seesaw model at TeV scale, which has some additional particles consisting of scalar and fermionic triplet Higgs states, whose masses are around a few hundred GeV. In this particular model, we have studied constraints on the masses of triplet states arising from the lepton flavor violating (LFV) processes, such as mu -> 3e and mu -> e gamma. We have analyzed the implications of these constraints on other observable quantities such as the muon anomalous magnetic moment and the decay patterns of scalar triplet Higgses. Scalar triplet Higgs states can decay into leptons and into supersymmetric fields. We have found that the constraints from LFV can affect these various decay modes.

Excitation- and power-dependent photoluminescence from oxidized Ge

Wafer/microcrystallites of oxidized Ge with holes/nanoholes synthesized by thermal oxidation strategy from Ge wafer/microcrystallites can convert one wavelength to another. Both oxidized Ge wafer and microcrystallites shows excitation- and power-dependent luminescence. Red-shift is observed as the excitation wavelength is increased, while blue-shift is observed as power density is increased. Over all, blue-green-yellow-orange luminescence is observed depending on the excitation wavelength and the morphology of oxidized Ge. The various defects level associated with germanium-oxygen vacancies in GeO2 and Ge/GeO2 interface are responsible for the excitation-dependent luminescence. Being a light-conversion material, oxidized Ge is expected to find potential applications in solid-state lighting, photovoltaic devices and photocatalysis.

Loss and gain signals in broadband stimulated-Raman spectra: Theoretical analysis

Stimulated optical signals obtained by subjecting the system to a narrow band and a broadband pulse show both gain and loss Raman features at the red and blue side of the narrow beam, respectively. Recently observed temperature-dependent asymmetry in these features Mallick et al., J. Raman Spectrosc. 42, 1883 (2011); Dang et al., Phys. Rev. Lett. 107, 043001 (2011)] has been attributed to the Stokes and anti-Stokes components of the third-order susceptibility, chi((3)). By treating the setup as a steady state of an open system coupled to four quantum radiation field modes, we show that Stokes and anti-Stokes processes contribute to both the loss and gain resonances. chi((3)) predicts loss and gain signals with equal intensity for electronically off-resonant excitation. Some asymmetry may exist for resonant excitation. However, this is unrelated to the Stokes vs anti-Stokes processes. Any observed temperature-dependent asymmetry must thus originate from effects lying outside the chi((3)) regime.

Adiabatic eigenfunction-based approach for coherent excitation transfer: An almost analytical treatment of the Fenna-Matthews-Olson complex

We suggest a method of studying coherence in finite-level systems coupled to the environment and use it for the Hamiltonian that has been used to describe the light-harvesting pigment-protein complex. The method works with the adiabatic states and transforms the Hamiltonian to a form in which the terms responsible for decoherence and population relaxation are separated out. Decoherence is then accounted for nonperturbatively and population relaxation using a Markovian master equation. Almost analytical results can be obtained for the seven-level system, and the calculations are very simple for systems with more levels. We apply the treatment to the seven-level system, and the results are in excellent agreement with the exact numerical results of Nalbach et al. Nalbach, Braun, and Thorwart, Phys. Rev. E 84, 041926 (2011)]. Our approach is able to account for decoherence and population relaxation separately. It is found that decoherence causes only damping of oscillations and does not lead to transfer to the reaction center. Population relaxation is necessary for efficient transfer to the reaction center, in agreement with earlier findings. Our results show that the transformation to the adiabatic basis followed by a Redfield type of approach leads to results in good agreement with exact simulation.

Flow cytometry analysis of human fetal osteoblast fate processes on spark plasma sintered hydroxyapatite-titanium biocomposites

Hydroxyapatite (HA)-based biocomposites have been widely investigated for a multitude of applications and these studies have been largely driven to improve mechanical properties (toughness and strength) without compromising cytocompatibility properties. Apart from routine cell viability/proliferation analysis, limited efforts have been made to quantify the fate processes (cell proliferation, cell cycle, and cell apoptosis) of human fetal osteoblast (hFOB) cells on HA-based composites, in vitro. In this work, the osteoblast cell fate process has been studied on a model hydroxyapatite-titanium (HA-Ti) system using the flow cytometry. In order to retain both HA and Ti, the novel processing technique, that is, spark plasma sintering, was suitably adopted. The cell fate processes of hFOBs, as evaluated using a flow cytometry, revealed statistically insignificant differences among HA-10 wt % Ti and HA and control (tissue culture polystyrene surface) in terms of osteoblast apoptosis, proliferation index as well as division index. For the first time, we provide quantified flow cytometry results to demonstrate that 10 wt % Ti additions to HA do not have any significant influence on the fate processes of human osteoblast-like cells, in vitro.

Validation based sparse Gaussian processes for ordinal regression

This paper proposes a sparse modeling approach to solve ordinal regression problems using Gaussian processes (GP). Designing a sparse GP model is important from training time and inference time viewpoints. We first propose a variant of the Gaussian process ordinal regression (GPOR) approach, leave-one-out GPOR (LOO-GPOR). It performs model selection using the leave-one-out cross-validation (LOO-CV) technique. We then provide an approach to design a sparse model for GPOR. The sparse GPOR model reduces computational time and storage requirements. Further, it provides faster inference. We compare the proposed approaches with the state-of-the-art GPOR approach on some benchmark data sets. Experimental results show that the proposed approaches are competitive.

Image deconvolution research: its scope and importance in live cell microscopy

Fluorescence microscopy has become an indispensable tool in cell biology research due its exceptional specificity and ability to visualize subcellular structures with high contrast. It has highest impact when applied in 4D mode, i.e. when applied to record 3D image information as a function of time, since it allows the study of dynamic cellular processes in their native environment. The main issue in 4D fluorescence microscopy is that the phototoxic effect of fluorescence excitation gets accumulated during 4D image acquisition to the extent that normal cell functions are altered. Hence to avoid the alteration of normal cell functioning, it is required to minimize the excitation dose used for individual 2D images constituting a 4D image. Consequently, the noise level becomes very high degrading the resolution. According to the current status of technology, there is a minimum required excitation dose to ensure a resolution that is adequate for biological investigations. This minimum is sufficient to damage light-sensitive cells such as yeast if 4D imaging is performed for an extended period of time, for example, imaging for a complete cell cycle. Nevertheless, our recently developed deconvolution method resolves this conflict forming an enabling technology for visualization of dynamical processes of light-sensitive cells for durations longer than ever without perturbing normal cell functioning. The main goal of this article is to emphasize that there are still possibilities for enabling newer kinds of experiment in cell biology research involving even longer 4D imaging, by only improving deconvolution methods without any new optical technologies.