A new method for analysing the equilibrium and time-dependent behaviour of Markovian models

Many large-scale stochastic systems, such as telecommunications networks, can be modelled using a continuous-time Markov chain. However, it is frequently the case that a satisfactory analysis of their time-dependent, or even equilibrium, behaviour is impossible. In this paper, we propose a new method of analyzing Markovian models, whereby the existing transition structure is replaced by a more amenable one. Using rates of transition given by the equilibrium expected rates of the corresponding transitions of the original chain, we are able to approximate its behaviour. We present two formulations of the idea of expected rates. The first provides a method for analysing time-dependent behaviour, while the second provides a highly accurate means of analysing equilibrium behaviour. We shall illustrate our approach with reference to a variety of models, giving particular attention to queueing and loss networks. (C) 2003 Elsevier Ltd. All rights reserved.

The swelling behaviour of polyelectrolyte networks

Being basic ingredients of numerous daily-life products with significant industrial importance as well as basic building blocks for biomaterials, charged hydrogels continue to pose a series of unanswered challenges for scientists even after decades of practical applications and intensive research efforts. Despite a rather simple internal structure it is mainly the unique combination of short- and long-range forces which render scientific investigations of their characteristic properties to be quite difficult. Hence early on computer simulations were used to link analytical theory and empirical experiments, bridging the gap between the simplifying assumptions of the models and the complexity of real world measurements. Due to the immense numerical effort, even for high performance supercomputers, system sizes and time scales were rather restricted until recently, whereas it only now has become possible to also simulate a network of charged macromolecules. This is the topic of the presented thesis which investigates one of the fundamental and at the same time highly fascinating phenomenon of polymer research: The swelling behaviour of polyelectrolyte networks. For this an extensible simulation package for the research on soft matter systems, ESPResSo for short, was created which puts a particular emphasis on mesoscopic bead-spring-models of complex systems. Highly efficient algorithms and a consistent parallelization reduced the necessary computation time for solving equations of motion even in case of long-ranged electrostatics and large number of particles, allowing to tackle even expensive calculations and applications. Nevertheless, the program has a modular and simple structure, enabling a continuous process of adding new potentials, interactions, degrees of freedom, ensembles, and integrators, while staying easily accessible for newcomers due to a Tcl-script steering level controlling the C-implemented simulation core. Numerous analysis routines provide means to investigate system properties and observables on-the-fly. Even though analytical theories agreed on the modeling of networks in the past years, our numerical MD-simulations show that even in case of simple model systems fundamental theoretical assumptions no longer apply except for a small parameter regime, prohibiting correct predictions of observables. Applying a "microscopic" analysis of the isolated contributions of individual system components, one of the particular strengths of computer simulations, it was then possible to describe the behaviour of charged polymer networks at swelling equilibrium in good solvent and close to the Theta-point by introducing appropriate model modifications. This became possible by enhancing known simple scaling arguments with components deemed crucial in our detailed study, through which a generalized model could be constructed. Herewith an agreement of the final system volume of swollen polyelectrolyte gels with results of computer simulations could be shown successfully over the entire investigated range of parameters, for different network sizes, charge fractions, and interaction strengths. In addition, the "cell under tension" was presented as a self-regulating approach for predicting the amount of swelling based on the used system parameters only. Without the need for measured observables as input, minimizing the free energy alone already allows to determine the the equilibrium behaviour. In poor solvent the shape of the network chains changes considerably, as now their hydrophobicity counteracts the repulsion of like-wise charged monomers and pursues collapsing the polyelectrolytes. Depending on the chosen parameters a fragile balance emerges, giving rise to fascinating geometrical structures such as the so-called pear-necklaces. This behaviour, known from single chain polyelectrolytes under similar environmental conditions and also theoretically predicted, could be detected for the first time for networks as well. An analysis of the total structure factors confirmed first evidences for the existence of such structures found in experimental results.

CO2 absorption into aqueous amine blended solutions containing monoethanolamine (MEA), N,N-dimethylethanolamine (DMEA), N,N-diethylethanolamine (DEEA) and 2-amino-2-methyl-1-propanol (AMP) for post-combustion capture processes

Presently monoethanolamine (MEA) remains the industrial standard solvent for CO2 capture processes. Operating issues relating to corrosion and degradation of MEA at high temperatures and concentrations, and in the presence of oxygen, in a traditional PCC process, have introduced the requisite for higher quality and costly stainless steels in the construction of capture equipment and the use of oxygen scavengers and corrosion inhibitors. While capture processes employing MEA have improved significantly in recent times there is a continued attraction towards alternative solvents systems which offer even more improvements. This movement includes aqueous amine blends which are gaining momentum as new generation solvents for CO2 capture processes. Given the exhaustive array of amines available to date endless opportunities exist to tune and tailor a solvent to deliver specific performance and physical properties in line with a desired capture process. The current work is focussed on the rationalisation of CO2 absorption behaviour in a series of aqueous amine blends incorporating monoethanolamine, N,N-dimethylethanolamine (DMEA), N,N-diethylethanolamine (DEEA) and 2-amino-2-methyl-1-propanol (AMP) as solvent components. Mass transfer/kinetic measurements have been performed using a wetted wall column (WWC) contactor at 40°C for a series of blends in which the blend properties including amine concentration, blend ratio, and CO2 loadings from 0.0-0.4 (moles CO2/total moles amine) were systematically varied and assessed. Equilibrium CO2 solubility in each of the blends has been estimated using a software tool developed in Matlab for the prediction of vapour liquid equilibrium using a combination of the known chemical equilibrium reactions and constants for the individual amine components which have been combined into a blend.From the CO2 mass transfer data the largest absorption rates were observed in blends containing 3M MEA/3M Am2 while the selection of the Am2 component had only a marginal impact on mass transfer rates. Overall, CO2 mass transfer in the fastest blends containing 3M MEA/3M Am2 was found to be only slightly lower than a 5M MEA solution at similar temperatures and CO2 loadings. In terms of equilibrium behaviour a slight decrease in the absorption capacity (moles CO2/mole amine) with increasing Am2 concentration in the blends with MEA was observed while cyclic capacity followed the opposite trend. Significant increases in cyclic capacity (26-111%) were observed in all blends when compared to MEA solutions at similar temperatures and total amine concentrations. In view of the reasonable compromise between CO2 absorption rate and capacity a blend containing 3M MEA and 3M AMP as blend components would represent a reasonable alternative in replacement of 5M MEA as a standalone solvent.

The non-equilibrium nature of culinary evolution

Food is an essential part of civilization, with a scope that ranges from the biological to the economic and cultural levels. Here, we study the statistics of ingredients and recipes taken from Brazilian, British, French and Medieval cookery books. We find universal distributions with scale invariant behaviour. We propose a copy-mutate process to model culinary evolution that fits our empirical data very well. We find a cultural 'founder effect' produced by the non-equilibrium dynamics of the model. Both the invariant and idiosyncratic aspects of culture are accounted for by our model, which may have applications in other kinds of evolutionary processes.

Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

Wetting behaviour of femtosecond laser textured Ti-6Al-4V surfaces

The aim of the present work was to investigate the wetting behaviour of biomedical grade Ti-6Al-4V alloy surfaces textured by a femtosecond laser treatment. The material was treated in ambient atmosphere using an Yb: KYW chirped-pulse-regenerative amplification laser with a wavelength of 1030 nm and a pulse duration of 500 fs. Four main types of surface textures were obtained depending on the processing parameters and laser treatment method. These textures consist of: (1) nanoscale laser-induced periodic surface structures (LIPSS); (2) nanopillars; (3) a bimodal roughness distribution texture formed of LIPSS overlapping microcolumns; (4) a complex texture formed of LIPSS overlapping microcolumns with a periodic variation of the columns size in the laser scanning direction. The wettability of the surfaces was evaluated by the sessile drop method using distilled-deionized (DD) water and Hank's balanced salt solution (HBSS) as testing liquids. The laser treated surfaces present a hydrophilic behaviour as well as a high affinity for the saline solution, with equilibrium contact angles in the ranges 24.1-76.2. for DD water and 8.4-61.8. for HBSS. The wetting behaviour is anisotropic, reflecting the anisotropy of the surface textures. (c) 2012 Elsevier B.V. All rights reserved.

Sorption behaviour of bifenthrin on cork

Biphentrin, a known pyrethroid, was studied, aiming its removal from aqueous solutions by granulated cork sorption. Batch experiments, either for equilibrium or for kinetics, with two granulated cork sizes were performed and results were compared with those obtained with of activated carbon sorption. Langmuir and Freundlich adsorption isotherms were obtained both showing high linear correlations. Bifenthrin desorption was evaluated for cork and results varied with the granule size of sorbent. The results obtained in this work indicate that cork wastes may be used as a cheap natural sorbent for bifenthrin or similar compounds removal from wastewaters.

A comparison of results from MRIO and interregional computable general equilibrium (CGE) analyses of the impacts of a positive demand shock on the ‘CO2 trade balance’ between Scotland and the rest of the UK

In previous work we have applied the environmental multi-region input-output (MRIO) method proposed by Turner et al (2007) to examine the ‘CO2 trade balance’ between Scotland and the Rest of the UK. In McGregor et al (2008) we construct an interregional economy-environment input-output (IO) and social accounting matrix (SAM) framework that allows us to investigate methods of attributing responsibility for pollution generation in the UK at the regional level. This facilitates analysis of the nature and significance of environmental spillovers and the existence of an environmental ‘trade balance’ between regions. While the existence of significant data problems mean that the quantitative results of this study should be regarded as provisional, we argue that the use of such a framework allows us to begin to consider questions such as the extent to which a devolved authority like the Scottish Parliament can and should be responsible for contributing to national targets for reductions in emissions levels (e.g. the UK commitment to the Kyoto Protocol) when it is limited in the way it can control emissions, particularly with respect to changes in demand elsewhere in the UK. However, while such analysis is useful in terms of accounting for pollution flows in the single time period that the accounts relate to, it is limited when the focus is on modelling the impacts of any marginal change in activity. This is because a conventional demand-driven IO model assumes an entirely passive supply-side in the economy (i.e. all supply is infinitely elastic) and is further restricted by the assumption of universal Leontief (fixed proportions) technology implied by the use of the A and multiplier matrices. In this paper we argue that where analysis of marginal changes in activity is required, a more flexible interregional computable general equilibrium approach that models behavioural relationships in a more realistic and theory-consistent manner, is more appropriate and informative. To illustrate our analysis, we compare the results of introducing a positive demand stimulus in the UK economy using both IO and CGE interregional models of Scotland and the rest of the UK. In the case of the latter, we demonstrate how more theory consistent modelling of both demand and supply side behaviour at the regional and national levels affect model results, including the impact on the interregional CO2 ‘trade balance’.

Forward Looking and Myopic Regional Computable General Equilibrium Models. How Significant is the Distinction?

We present a stylized intertemporal forward-looking model able that accommodates key regional economic features, an area where the literature is not well developed. The main difference, from the standard applications, is the role of saving and its implication for the balance of payments. Though maintaining dynamic forward-looking behaviour for agents, the rate of private saving is exogenously determined and so no neoclassical financial adjustment is needed. Also, we focus on the similarities and the differences between myopic and forward-looking models, highlighting the divergences among the main adjustment equations and the resulting simulation outcomes.

Vaporization behaviour and some thermodynamic properties of the Pd-In, Pd-Pb, Pd-Sn systems

In this study, the vaporization behaviour of solid Pd-rich phases in the Pd-Pb, Pd-In and Pd-Sn systems was investigated by Knudsen-effusion-cell coupled with mass-spectrometry. The Pb, Pd, In vapor pressures [no Sn(g) has been detected in the vapor of Pd-Sn system] were evaluated in the temperatures range 1190-1563 K from the ion intensities measured over two-phases regions. Thermodynamic quantities were derived from vapor pressure data. In particular, for the Pd-Sn binary, the intermediate phase Pd7Sn2, the existence of which has been recently proposed, has been studied here for the first time. Furthermore, preliminary thermochemical data are presented for the diatomic intermetallic molecules PdSn and PdPb, which have been for the first time identified in the vapors in equilibrium over liquid solutions of appropriate composition at higher temperatures (1935-2025 K). (C) 2000 Elsevier Science Ltd. All rights reserved.

Comparisons between two economically valuable forest species (Eucalyptus grandis and Pinus taeda) in relation to seed behaviour under controlled deterioration

The objectives of this work were to analyze seed behaviour under controlled deterioration and estimate viability equations for forest species Eucalyptus grandis and Pinus taeda. Desired moisture content levels were achieved from initial values after either rehydration over water or drying over silica gel, both at 25 ºC. Seed sub samples with 8 moisture contents each for E. grandis (1.2 to 18.1%, initial value of 11.3%) and P. taeda (1.5 to 19.5%, initial value of 12.9%) were sealed in laminate aluminium-foil packets and stored in incubators maintained at 40, 50 and 65 ºC. The seeds from these species exhibited true orthodox and sub-orthodox storage behaviour, respectively, however E. grandis showed higher seed storability, probably due to a different seed chemical composition. Lowest moisture content limits estimated for application of the viability equations at 65 ºC were 4.9 and 4.1 mc for E. grandis and P. taeda, on equilibrium with ±20% RH. The viability equation estimated quantified the response of seed longevity to storage environment well with K E = 9.661 and 8.838; C W = 6.467 and 5.981; C H = 0.03498 and 0.10340; C Q = 0.0002330 and 0.0005476, for E. grandis and P. taeda, respectively.

Effects of algal turbidity on foraging and antipredator behaviour of the three-spined stickleback (Gasterosteus aculeatus)

The aim of this thesis was to examine how aquatic organisms, such as fish, behave in an altered environmental condition. Many species of fish use vision as their primary tool to gain information about their surrounding environment. The visual conditions of aquatic habitats are often altered as a result of anthropogenic disturbance, such as eutrophication that initiates algal turbidity. In general, turbidity reduces the visibility and can be hypothesized to have an influence on the behaviour of fish. I used the three-spined stickleback (Gasterosteus aculeatus) as a model species and conducted four studies in the laboratory to test how algal turbidity affects its behaviour. In this thesis, two major behavioural aspects are discussed. The first is antipredator behaviour. In study I, the combined effects of turbidity and shoot density on habitat choice (shelter vs open) behaviour was tested on a group of sticklebacks (20 fish) in the presence and absence of piscivorous perch (Perca fluviatilis). In study II, I examined the behavioural responses of feeding sticklebacks when they were exposed to the sudden appearance of an avian predator (the silhouette of a common tern, Sterna hirundo). The study was done in turbid and clear water using three different groups sizes (1, 3 and 6 fish). The second aspect is foraging behaviour. Study III & IV focused on the effects of algal turbidity on the foraging performance of sticklebacks. In study III, I conducted two separate experiments to examine the effects of turbidity on prey consumption and prey choice of sticklebacks. In this experiment turbidity levels and the proportion of large and small prey (Daphnia spp.) were manipulated. In study IV, I studied whether a group of six sticklebacks can distribute themselves according to food input at two feeding stations in a way that provided each fish with the same amount of food in clear and turbid water. I also observed whether the fish can follow changes in resource distribution between the foraging patches. My results indicate an overall influence of algal turbidity on the antipredator and foraging behaviour of sticklebacks. In the presence of a potential predator, the use of the sheltered habitat was more pronounced at higher turbidity. Besides this, sticklebacks reduced their activity levels with predator presence at higher turbidity and shoot density levels, suggesting a possible antipredator adaptation to avoid a predator. When exposed to a sudden appearance of an avian predator, sticklebacks showed a weaker antipredator response in turbid water, which suggests that turbidity degrades the risk assessment capabilities of sticklebacks. I found an effect of group size but not turbidity in the proportion of sticklebacks that fled to the shelter area, which indicates that sticklebacks are able to communicate among group members at the experimental turbidity levels. I found an overall negative effect of turbidity on food intake. Both turbidity and changes in the proportion of prey sizes played a significant role in a stickleback’s prey selection. At lower turbidity levels (clear <1 and 5 NTU) sticklebacks showed preferences for large prey, whereas in more turbid conditions and when the proportion of large to small prey increased sticklebacks became increasingly random in their prey selection. Finally, my results showed that groups of sticklebacks disperse themselves between feeding stations according to the reward ratios following the predictions of the ideal free distribution theory. However, they took a significantly longer time to reach the equilibrium distribution in turbid water than in clear water. In addition, they showed a slower response to changes in resource distribution in a turbid environment. These findings suggest that turbidity interferes with the information transfer among group foragers. It is important to understand that aquatic animals are often exposed to a degraded environment. The findings of this thesis suggest that algal turbidity negatively affects their behavioural performance. The results also shed light on the underlying behavioural strategies of sticklebacks in turbid conditions that might help them adapt to an altered environmental situation and increase their survival. In conclusion, I hold that although algal turbidity has detrimental effects on the antipredator and foraging behaviour of sticklebacks, their behavioural adjustment might help them adapt to a changing environment.

Effect of citrate on the redox properties of cytochrome C and its kinetic and binding behaviour with cytochrome oxidase /

Increasing citrate concentration, at constant ionic strength (30 mM) decreases the rate of cytochrome ~ reduction by ascorbate. This effect is also seen at both high (600 mM) and low (19 mM) ionic strengths, and the Kapp for citrate increases with increasing ionic strength. Citrate binds d both ferri -and ferrocytochrome ~, but with a lower affinity for the latter form (Kox . .red d = 2 mM, Kd = 8 mM) as shown by an equilibrium assay with N,N,N',N', Tetramethyl E- phenylenediamine. The reaction of ferricytochrome ~with cyanide is also altered in the presence of citrate: citrate increases the K~PP for cyanide. Column chromatography of cytochrome ~-cytochrome oxidase mixtures shows citrate increases the dissociation constant of the complex. These results are confirmed in kinetic assays for the "loose"site (Km = 20 pM) only. The effect of increasing citrate observable at the "tight" site (Km = 0.25 pM) is on the turnover number and not on the K . These results suggest a mechanism m where anion binding to cytochrome £ at the tight site affects the equilibrium between two forms of cytochrome c bound cytochrome oxidase: an active and an inactive one.

Political Influence, Economic Interests and Endogenous Tax Structure in a Computable Equilibrium Framework: with Applicatioon to the United States, 1973 and 1983

A full understanding of public affairs requires the ability to distinguish between the policies that voters would like the government to adopt, and the influence that different voters or group of voters actually exert in the democratic process. We consider the properties of a computable equilibrium model of a competitive political economy in which the economic interests of groups of voters and their effective influence on equilibrium policy outcomes can be explicitly distinguished and computed. The model incorporates an amended version of the GEMTAP tax model, and is calibrated to data for the United States for 1973 and 1983. Emphasis is placed on how the aggregation of GEMTAP households into groups within which economic and political behaviour is assumed homogeneous affects the numerical representation of interests and influence for representative members of each group. Experiments with the model suggest that the changes in both interests and influence are important parts of the story behind the evolution of U.S. tax policy in the decade after 1973.