Equilibrium distributions of discrete non-autonomous graphs

We introduce the notions of equilibrium distribution and time of convergence in discrete non-autonomous graphs. Under some conditions we give an estimate to the convergence time to the equilibrium distribution using the second largest eigenvalue of some matrices associated with the system.

Mass- Radius Relation for Magnetized Strange Quarks Stars

We review the stability of magnetized strange quark matter (MSQM) within the phenomenological MIT bag model, taking into account the variation of the relevant input parameters, namely, the strange quark mass, baryon density, magnetic field and bag parameter. A comparison with magnetized asymmetric quark matter in beta-equilibrium as well as with strange quark matter (SQM) is presented. We obtain that the energy per baryon for MSQM decreases as the magnetic field increases, and its minimum value at vanishing pressure is lower than the value found for SQM, which implies that MSQM is more stable than non-magnetized SQM. The mass-radius relation for magnetized strange quark stars is also obtained in this framework.

Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

Non-enzymatic assay for glucose by using immobilized whole-cells of E. coli containing glucose binding protein fused to fluorescent proteins

Glucose monitoring in vivo is a crucial issue for gaining new understanding of diabetes. Glucose binding protein (GBP) fused to two fluorescent indicator proteins (FLIP) was used in the present study such as FLIP-glu- 3.2 mM. Recombinant Escherichia coli whole-cells containing genetically encoded nanosensors as well as cell-free extracts were immobilized either on inner epidermis of onion bulb scale or on 96-well microtiter plates in the presence of glutaraldehyde. Glucose monitoring was carried out by Förster Resonance Energy Transfer (FRET) analysis due the cyano and yellow fluorescent proteins (ECFP and EYFP) immobilized in both these supports. The recovery of these immobilized FLIP nanosensors compared with the free whole-cells and cell-free extract was in the range of 50–90%. Moreover, the data revealed that these FLIP nanosensors can be immobilized in such solid supports with retention of their biological activity. Glucose assay was devised by FRET analysis by using these nanosensors in real samples which detected glucose in the linear range of 0–24 mM with a limit of detection of 0.11 mM glucose. On the other hand, storage and operational stability studies revealed that they are very stable and can be re-used several times (i.e. at least 20 times) without any significant loss of FRET signal. To author's knowledge, this is the first report on the use of such immobilization supports for whole-cells and cell-free extract containing FLIP nanosensor for glucose assay. On the other hand, this is a novel and cheap high throughput method for glucose assay.