Investigations on Stochastic Storage Systems with Positive Service Time

In this thesis the queueing-inventory models considered are analyzed as continuous time Markov chains in which we use the tools such as matrix analytic methods. We obtain the steady-state distributions of various queueing-inventory models in product form under the assumption that no customer joins the system when the inventory level is zero. This is despite the strong correlation between the number of customers joining the system and the inventory level during lead time. The resulting quasi-birth-anddeath (QBD) processes are solved explicitly by matrix geometric methods

Meteorological aspects of an abnormal cooling event over Iran in April 2009

During the period from 12 to 15 April, 2009 nearly the entire Iran, apart from the southern border, experienced an advective cooling event. While winter freezing concerns are typical, the nature of this freezing event was unusual with respect to its date of occurrence and accompanying synoptic meteorological situation. To analyze the freezing event, the relevant meteorological data at multiple levels of the atmosphere were examined from the NCEP/ NCAR reanalysis dataset. The results showed that a polar vortex was responsible for the freezing event over the country extending southward extraordinarily in such a way that its ridge influenced most parts of Iran. This was recognized as an abnormal extension of a polar vortex in the recent years. The sea-level pressure fields indicated that a ridge of large-scale anticyclone centered over Black Sea extended southward and prevailed over most parts of Iran. This resulted in the formation of a severe cold air advection from high latitudes (Polar region) over Iran. During the study period, moisture pumping was observed from the Arabian Sea and Persian Gulf. The winds at 1000 hPa level blew with a magnitude of 10 m s-1 toward south in the region of convergence (between -2 9 10-6 s-1 and -12 9 10-6 s-1). The vertical profilesof temperature and humidity also indicated that the ICE structural icing occurred at multiple levels of the atmosphere, i.e, from 800 hPa through 400 hPa levels. In addition to the carburetor (or induction), icing occurred between 900 and 700 hPa levels in the selected radiosonde stations during the study period. In addition, the HYSPLIT backward trajectory model outputs were in quite good agreement with the observed synoptic features

Analysis of Some Stochastic Inventory Models with Pooling/ Retrial of Customers

In this thesis we have presented several inventory models of utility. Of these inventory with retrial of unsatisfied demands and inventory with postponed work are quite recently introduced concepts, the latt~~ being introduced for the first time. Inventory with service time is relatively new with a handful of research work reported. The di lficuity encoLlntered in inventory with service, unlike the queueing process, is that even the simplest case needs a 2-dimensional process for its description. Only in certain specific cases we can introduce generating function • to solve for the system state distribution. However numerical procedures can be developed for solving these problem.

The role of lower partial moments in stochastic modeling

Lower partial moments plays an important role in the analysis of risks and in income/poverty studies. In the present paper, we further investigate its importance in stochastic modeling and prove some characterization theorems arising out of it. We also identify its relationships with other important applied models such as weighted and equilibrium models. Finally, some applications of lower partial moments in poverty studies are also examined

Analysis of Stochastic Volatility Sequences Generated by Product Autoregressive Models

The classical methods of analysing time series by Box-Jenkins approach assume that the observed series uctuates around changing levels with constant variance. That is, the time series is assumed to be of homoscedastic nature. However, the nancial time series exhibits the presence of heteroscedasticity in the sense that, it possesses non-constant conditional variance given the past observations. So, the analysis of nancial time series, requires the modelling of such variances, which may depend on some time dependent factors or its own past values. This lead to introduction of several classes of models to study the behaviour of nancial time series. See Taylor (1986), Tsay (2005), Rachev et al. (2007). The class of models, used to describe the evolution of conditional variances is referred to as stochastic volatility modelsThe stochastic models available to analyse the conditional variances, are based on either normal or log-normal distributions. One of the objectives of the present study is to explore the possibility of employing some non-Gaussian distributions to model the volatility sequences and then study the behaviour of the resulting return series. This lead us to work on the related problem of statistical inference, which is the main contribution of the thesis

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Recent developments in the area of reinforcement learning have yielded a number of new algorithms for the prediction and control of Markovian environments. These algorithms, including the TD(lambda) algorithm of Sutton (1988) and the Q-learning algorithm of Watkins (1989), can be motivated heuristically as approximations to dynamic programming (DP). In this paper we provide a rigorous proof of convergence of these DP-based learning algorithms by relating them to the powerful techniques of stochastic approximation theory via a new convergence theorem. The theorem establishes a general class of convergent algorithms to which both TD(lambda) and Q-learning belong.

Stochastic Processes

Exercises, exams and solutions for a second year maths course.

Dynamic programming for stochastic target problems, Viscosity solutions and hedging in markets with Portfolio constraints and large investors

The purpose of this expository arti le is to present a self- ontained overview of some results on the hara terization of the optimal value fun tion of a sto hasti target problem as (dis ontinuous) vis osity solution of a ertain dynami programming PDE and its appli ation to the problem of hedging ontingent laims in the presen e of portfolio onstraints and large investors

Distinct Unfolding and Refolding Pathways of Ribonuclease A Revealed by Heating and Cooling Temperature Jumps

Heating and cooling temperature jumps (T-jumps) were performed using a newly developed technique to trigger unfolding and refolding of wild-type ribonuclease A and a tryptophan-containing variant (Y115W). From the linear Arrhenius plots of the microscopic folding and unfolding rate constants, activation enthalpy (ΔH#), and activation entropy (ΔS#) were determined to characterize the kinetic transition states (TS) for the unfolding and refolding reactions. The single TS of the wild-type protein was split into three for the Y115W variant. Two of these transition states, TS1 and TS2, characterize a slow kinetic phase, and one, TS3, a fast phase. Heating T-jumps induced protein unfolding via TS2 and TS3; cooling T-jumps induced refolding via TS1 and TS3. The observed speed of the fast phase increased at lower temperature, due to a strongly negative ΔH# of the folding-rate constant. The results are consistent with a path-dependent protein folding/unfolding mechanism. TS1 and TS2 are likely to reflect X-Pro114 isomerization in the folded and unfolded protein, respectively, and TS3 the local conformational change of the β-hairpin comprising Trp115. A very fast protein folding/unfolding phase appears to precede both processes. The path dependence of the observed kinetics is suggestive of a rugged energy protein folding funne

Analysis and Simulation of Transverse Random Fracture of Long Fibre Reinforced Composites

La present tesi proposa una metodología per a la simulació probabilística de la fallada de la matriu en materials compòsits reforçats amb fibres de carboni, basant-se en l'anàlisi de la distribució aleatòria de les fibres. En els primers capítols es revisa l'estat de l'art sobre modelització matemàtica de materials aleatoris, càlcul de propietats efectives i criteris de fallada transversal en materials compòsits. El primer pas en la metodologia proposada és la definició de la determinació del tamany mínim d'un Element de Volum Representatiu Estadístic (SRVE) . Aquesta determinació es du a terme analitzant el volum de fibra, les propietats elàstiques efectives, la condició de Hill, els estadístics de les components de tensió i defromació, la funció de densitat de probabilitat i les funcions estadístiques de distància entre fibres de models d'elements de la microestructura, de diferent tamany. Un cop s'ha determinat aquest tamany mínim, es comparen un model periòdic i un model aleatori, per constatar la magnitud de les diferències que s'hi observen. Es defineix, també, una metodologia per a l'anàlisi estadístic de la distribució de la fibra en el compòsit, a partir d'imatges digitals de la secció transversal. Aquest anàlisi s'aplica a quatre materials diferents. Finalment, es proposa un mètode computacional de dues escales per a simular la fallada transversal de làmines unidireccionals, que permet obtenir funcions de densitat de probabilitat per a les variables mecàniques. Es descriuen algunes aplicacions i possibilitats d'aquest mètode i es comparen els resultats obtinguts de la simulació amb valors experimentals.

A Filter for Visual Tracking Based on a Stochastic Model for Driver Behaviour

A driver controls a car by turning the steering wheel or by pressing on the accelerator or the brake. These actions are modelled by Gaussian processes, leading to a stochastic model for the motion of the car. The stochastic model is the basis of a new filter for tracking and predicting the motion of the car, using measurements obtained by fitting a rigid 3D model to a monocular sequence of video images. Experiments show that the filter easily outperforms traditional filters.

Climate response to basin-scale warming and cooling of the North Atlantic Ocean

Using experiments with an atmospheric general circulation model, the climate impacts of a basin-scale warming or cooling of the North Atlantic Ocean are investigated. Multidecadal fluctuations with this pattern were observed during the twentieth century, and similar variations--but with larger amplitude--are believed to have occurred in the more distant past. It is found that in all seasons the response to warming the North Atlantic is strongest, in the sense of highest signal-to-noise ratio, in the Tropics. However there is a large seasonal cycle in the climate impacts. The strongest response is found in boreal summer and is associated with suppressed precipitation and elevated temperatures over the lower-latitude parts of North and South America. In August­-September-­October there is a significant reduction in the vertical shear in the main development region for Atlantic hurricanes. In winter and spring, temperature anomalies over land in the extratropics are governed by dynamical changes in circulation rather than simply reflecting a thermodynamic response to the warming or cooling of the ocean. The tropical climate response is primarily forced by the tropical SST anomalies, and the major features are in line with simple models of the tropical circulation response to diabatic heating anomalies. The extratropical climate response is influenced both by tropical and higher-latitude SST anomalies and exhibits nonlinear sensitivity to the sign of the SST forcing. Comparisons with multidecadal changes in sea level pressure observed in the twentieth century support the conclusion that the impact of North Atlantic SST change is most important in summer, but also suggest a significant influence in lower latitudes in autumn and winter. Significant climate impacts are not restricted to the Atlantic basin, implying that the Atlantic Ocean could be an important driver of global decadal variability. The strongest remote impacts are found to occur in the tropical Pacific region in June­-August and September­-November. Surface anomalies in this region have the potential to excite coupled ocean­atmosphere feedbacks, which are likely to play an important role in shaping the ultimate climate response.