Stochastic modelling of T cell homeostasis for two competing clonotypes via the master equation

Stochastic models for competing clonotypes of T cells by multivariate, continuous-time, discrete state, Markov processes have been proposed in the literature by Stirk, Molina-París and van den Berg (2008). A stochastic modelling framework is important because of rare events associated with small populations of some critical cell types. Usually, computational methods for these problems employ a trajectory-based approach, based on Monte Carlo simulation. This is partly because the complementary, probability density function (PDF) approaches can be expensive but here we describe some efficient PDF approaches by directly solving the governing equations, known as the Master Equation. These computations are made very efficient through an approximation of the state space by the Finite State Projection and through the use of Krylov subspace methods when evolving the matrix exponential. These computational methods allow us to explore the evolution of the PDFs associated with these stochastic models, and bimodal distributions arise in some parameter regimes. Time-dependent propensities naturally arise in immunological processes due to, for example, age-dependent effects. Incorporating time-dependent propensities into the framework of the Master Equation significantly complicates the corresponding computational methods but here we describe an efficient approach via Magnus formulas. Although this contribution focuses on the example of competing clonotypes, the general principles are relevant to multivariate Markov processes and provide fundamental techniques for computational immunology.

Stochastic chemical kinetics and the quasi-steady-state assumption : application to the stochastic simulation algorithm and chemical master equation

Recently the application of the quasi-steady-state approximation (QSSA) to the stochastic simulation algorithm (SSA) was suggested for the purpose of speeding up stochastic simulations of chemical systems that involve both relatively fast and slow chemical reactions [Rao and Arkin, J. Chem. Phys. 118, 4999 (2003)] and further work has led to the nested and slow-scale SSA. Improved numerical efficiency is obtained by respecting the vastly different time scales characterizing the system and then by advancing only the slow reactions exactly, based on a suitable approximation to the fast reactions. We considerably extend these works by applying the QSSA to numerical methods for the direct solution of the chemical master equation (CME) and, in particular, to the finite state projection algorithm [Munsky and Khammash, J. Chem. Phys. 124, 044104 (2006)], in conjunction with Krylov methods. In addition, we point out some important connections to the literature on the (deterministic) total QSSA (tQSSA) and place the stochastic analogue of the QSSA within the more general framework of aggregation of Markov processes. We demonstrate the new methods on four examples: Michaelis–Menten enzyme kinetics, double phosphorylation, the Goldbeter–Koshland switch, and the mitogen activated protein kinase cascade. Overall, we report dramatic improvements by applying the tQSSA to the CME solver.

A Krylov-based finite state projection algorithm for solving the chemical master equation arising in the discrete modelling of biological systems

Biochemical reactions underlying genetic regulation are often modelled as a continuous-time, discrete-state, Markov process, and the evolution of the associated probability density is described by the so-called chemical master equation (CME). However the CME is typically difficult to solve, since the state-space involved can be very large or even countably infinite. Recently a finite state projection method (FSP) that truncates the state-space was suggested and shown to be effective in an example of a model of the Pap-pili epigenetic switch. However in this example, both the model and the final time at which the solution was computed, were relatively small. Presented here is a Krylov FSP algorithm based on a combination of state-space truncation and inexact matrix-vector product routines. This allows larger-scale models to be studied and solutions for larger final times to be computed in a realistic execution time. Additionally the new method computes the solution at intermediate times at virtually no extra cost, since it is derived from Krylov-type methods for computing matrix exponentials. For the purpose of comparison the new algorithm is applied to the model of the Pap-pili epigenetic switch, where the original FSP was first demonstrated. Also the method is applied to a more sophisticated model of regulated transcription. Numerical results indicate that the new approach is significantly faster and extendable to larger biological models.

Quantum measurement of a solid-state qubit: A unified quantum master equation approach

Quantum measurement of a solid-state qubit by a mesoscopic detector is of fundamental interest in quantum physics and an essential issue in quantum computing. In this work, by employing a unified quantum master equation approach constructed in our recent publications, we study the measurement-induced relaxation and dephasing of the coupled-quantum-dot states measured by a quantum-point contact. Our treatment pays particular attention on the detailed-balance relation, which is a consequence of properly accounting for the energy exchange between the qubit and detector during the measurement process. As a result, our theory is applicable to measurement at arbitrary voltage and temperature. Both numerical and analytical results for the qubit relaxation and dephasing are carried out, and important features are highlighted in concern with their possible relevance to future experiments.

Quantum master-equation approach to quantum transport through mesoscopic systems

For quantum transport through mesoscopic systems, a quantum master-equation approach is developed in terms of compact expressions for the transport current and the reduced density matrix of the system. The present work is an extension of Gurvitz's approach for quantum transport and quantum measurement, namely, to finite temperature and arbitrary bias voltage. Our derivation starts from a second-order cumulant expansion of the tunneling Hamiltonian; then follows the conditional average over the electrode reservoir states. As a consequence, in the usual weak-tunneling regime, the established formalism is applicable for a wide range of transport problems. The validity of the formalism and its convenience in application are well illustrated by a number of examples.

Exact quantum master equation via the calculus on path integrals

An exact quantum master equation formalism is constructed for the efficient evaluation of quantum non-Markovian dissipation beyond the weak system-bath interaction regime in the presence of time-dependent external field. A novel truncation scheme is further proposed and compared with other approaches to close the resulting hierarchically coupled equations of motion. The interplay between system-bath interaction strength, non-Markovian property, and required level of hierarchy is also demonstrated with the aid of simple spin-boson systems. (C) 2005 American Institute of Physics.

Calculation of the current noise spectrum in mesoscopic transport: A quantum master equation approach

Based on our recent work on quantum transport [X. Q. Li , Phys. Rev. B 71, 205304 (2005)], we show how an efficient calculation can be performed for the current noise spectrum. Compared to the classical rate equation or the quantum trajectory method, the proposed approach is capable of tackling both the many-body Coulomb interaction and quantum coherence on an equal footing. The practical applications are illustrated by transport through quantum dots. We find that this alternative approach is in a certain sense simpler and more straightforward than the well-known Landauer-Buttiker scattering matrix theory.

Continuous weak measurement and feedback control of a solid-state charge qubit: A physical unravelling of non-Lindblad master equation

Conventional quantum trajectory theory developed in quantum optics is largely based on the physical unravelling of a Lindblad-type master equation, which constitutes the theoretical basis of continuous quantum measurement and feedback control. In this work, in the context of continuous quantum measurement and feedback control of a solid-state charge qubit, we present a physical unravelling scheme of a non-Lindblad-type master equation. Self-consistency and numerical efficiency are well demonstrated. In particular, the control effect is manifested in the detector noise spectrum, and the effect of measurement voltage is discussed.