Dynamic Programming Approaches for Estimating and Applying Large-scale Discrete Choice Models

People go through their life making all kinds of decisions, and some of these decisions affect their demand for transportation, for example, their choices of where to live and where to work, how and when to travel and which route to take. Transport related choices are typically time dependent and characterized by large number of alternatives that can be spatially correlated. This thesis deals with models that can be used to analyze and predict discrete choices in large-scale networks. The proposed models and methods are highly relevant for, but not limited to, transport applications. We model decisions as sequences of choices within the dynamic discrete choice framework, also known as parametric Markov decision processes. Such models are known to be difficult to estimate and to apply to make predictions because dynamic programming problems need to be solved in order to compute choice probabilities. In this thesis we show that it is possible to explore the network structure and the flexibility of dynamic programming so that the dynamic discrete choice modeling approach is not only useful to model time dependent choices, but also makes it easier to model large-scale static choices. The thesis consists of seven articles containing a number of models and methods for estimating, applying and testing large-scale discrete choice models. In the following we group the contributions under three themes: route choice modeling, large-scale multivariate extreme value (MEV) model estimation and nonlinear optimization algorithms. Five articles are related to route choice modeling. We propose different dynamic discrete choice models that allow paths to be correlated based on the MEV and mixed logit models. The resulting route choice models become expensive to estimate and we deal with this challenge by proposing innovative methods that allow to reduce the estimation cost. For example, we propose a decomposition method that not only opens up for possibility of mixing, but also speeds up the estimation for simple logit models, which has implications also for traffic simulation. Moreover, we compare the utility maximization and regret minimization decision rules, and we propose a misspecification test for logit-based route choice models. The second theme is related to the estimation of static discrete choice models with large choice sets. We establish that a class of MEV models can be reformulated as dynamic discrete choice models on the networks of correlation structures. These dynamic models can then be estimated quickly using dynamic programming techniques and an efficient nonlinear optimization algorithm. Finally, the third theme focuses on structured quasi-Newton techniques for estimating discrete choice models by maximum likelihood. We examine and adapt switching methods that can be easily integrated into usual optimization algorithms (line search and trust region) to accelerate the estimation process. The proposed dynamic discrete choice models and estimation methods can be used in various discrete choice applications. In the area of big data analytics, models that can deal with large choice sets and sequential choices are important. Our research can therefore be of interest in various demand analysis applications (predictive analytics) or can be integrated with optimization models (prescriptive analytics). Furthermore, our studies indicate the potential of dynamic programming techniques in this context, even for static models, which opens up a variety of future research directions.

An introduction to mathematical models of coagulation-fragmentation processes: a discrete deterministic mean-field approach

We summarise the properties and the fundamental mathematical results associated with basic models which describe coagulation and fragmentation processes in a deterministic manner and in which cluster size is a discrete quantity (an integer multiple of some basic unit size). In particular, we discuss Smoluchowski's equation for aggregation, the Becker-Döring model of simultaneous aggregation and fragmentation, and more general models involving coagulation and fragmentation.

Frequency domain analysis of stationary time series

This thesis provides a necessary and sufficient condition for asymptotic efficiency of a nonparametric estimator of the generalised autocovariance function of a Gaussian stationary random process. The generalised autocovariance function is the inverse Fourier transform of a power transformation of the spectral density, and encompasses the traditional and inverse autocovariance functions. Its nonparametric estimator is based on the inverse discrete Fourier transform of the same power transformation of the pooled periodogram. The general result is then applied to the class of Gaussian stationary ARMA processes and its implications are discussed. We illustrate that for a class of contrast functionals and spectral densities, the minimum contrast estimator of the spectral density satisfies a Yule-Walker system of equations in the generalised autocovariance estimator. Selection of the pooling parameter, which characterizes the nonparametric estimator of the generalised autocovariance, controlling its resolution, is addressed by using a multiplicative periodogram bootstrap to estimate the finite-sample distribution of the estimator. A multivariate extension of recently introduced spectral models for univariate time series is considered, and an algorithm for the coefficients of a power transformation of matrix polynomials is derived, which allows to obtain the Wold coefficients from the matrix coefficients characterizing the generalised matrix cepstral models. This algorithm also allows the definition of the matrix variance profile, providing important quantities for vector time series analysis. A nonparametric estimator based on a transformation of the smoothed periodogram is proposed for estimation of the matrix variance profile.

Agrin And Perlecan Mediate Tumorigenic Processes In Oral Squamous Cell Carcinoma.

Oral squamous cell carcinoma is the most common type of cancer in the oral cavity, representing more than 90% of all oral cancers. The characterization of altered molecules in oral cancer is essential to understand molecular mechanisms underlying tumor progression as well as to contribute to cancer biomarker and therapeutic target discovery. Proteoglycans are key molecular effectors of cell surface and pericellular microenvironments, performing multiple functions in cancer. Two of the major basement membrane proteoglycans, agrin and perlecan, were investigated in this study regarding their role in oral cancer. Using real time quantitative PCR (qRT-PCR), we showed that agrin and perlecan are highly expressed in oral squamous cell carcinoma. Interestingly, cell lines originated from distinct sites showed different expression of agrin and perlecan. Enzymatically targeting chondroitin sulfate modification by chondroitinase, oral squamous carcinoma cell line had a reduced ability to adhere to extracellular matrix proteins and increased sensibility to cisplatin. Additionally, knockdown of agrin and perlecan promoted a decrease on cell migration and adhesion, and on resistance of cells to cisplatin. Our study showed, for the first time, a negative regulation on oral cancer-associated events by either targeting chondroitin sulfate content or agrin and perlecan levels.

Unusual branching in the palm Euterpe edulis Mart

The unusual development of branches along the stem of Euterpe edulis is described for the first time. Branches originated at 2 to 190 cm from the ground. Ramified individuals and branches were able to produce reproductive structures and some branches produced roots. A plausible cause for the observed anomaly could be genetic problems due to small population sizes. The better agreement of this process can have a positive effect in the harvest of the heart of palm through the artificial induction of sprouts, what would prevent the death of the individual.

Effects of light-curing time on the cytotoxicity of a restorative composite resin on odontoblast-like cells

This in vitro study evaluated the cytotoxicity of an experimental restorative composite resin subjected to different light-curing regimens. METHODS: Forty round-shaped specimens were prepared and randomly assigned to four experimental groups (n=10), as follows: in Group 1, no light-curing; in Groups 2, 3 and 4, the composite resin specimens were light-cured for 20, 40 or 60 s, respectively. In Group 5, filter paper discs soaked in 5 µL PBS were used as negative controls. The resin specimens and paper discs were placed in wells of 24-well plates in which the odontoblast-like cells MDPC-23 (30,000 cells/cm²) were plated and incubated in a humidified incubator with 5% CO2 and 95% air at 37ºC for 72 h. The cytotoxicity was evaluated by the cell metabolism (MTT assay) and cell morphology (SEM). The data were analyzed statistically by Kruskal-Wallis and Mann-Whitney tests (p<0.05). RESULTS: In G1, cell metabolism decreased by 86.2%, indicating a severe cytotoxicity of the non-light-cured composite resin. On the other hand, cell metabolism decreased by only 13.3% and 13.5% in G2 and G3, respectively. No cytotoxic effects were observed in G4 and G5. In G1, only a few round-shaped cells with short processes on their cytoplasmic membrane were observed. In the other experimental groups as well as in control group, a number of spindle-shaped cells with long cytoplasmic processes were found. CONCLUSION: Regardless of the photoactivation time used in the present investigation, the experimental composite resin presented mild to no toxic effects to the odontoblast-like MDPC-23 cells. However, intense cytotoxic effects occurred when no light-curing was performed.

Reaction time assessment in children with ADHD

Attention deficit, impulsivity and hyperactivity are the cardinal features of attention deficit hyperactivity disorder (ADHD) but executive function (EF) disorders, as problems with inhibitory control, working memory and reaction time, besides others EFs, may underlie many of the disturbs associated with the disorder. OBJECTIVE: To examine the reaction time in a computerized test in children with ADHD and normal controls. METHOD: Twenty-three boys (aged 9 to 12) with ADHD diagnosis according to Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, 2000 (DSM-IV) criteria clinical, without comorbidities, Intelligence Quotient (IQ) >89, never treated with stimulant and fifteen normal controls, age matched were investigated during performance on a voluntary attention psychophysical test. RESULTS: Children with ADHD showed reaction time higher than normal controls. CONCLUSION: A slower reaction time occurred in our patients with ADHD. This findings may be related to problems with the attentional system, that could not maintain an adequate capacity of perceptual input processes and/or in motor output processes, to respond consistently during continuous or repetitive activity.

Internal and external time conflicts in adolescents: sleep characteristics and interventions

Daytime fatigue and lack of sleep seem to increase throughout adolescent years. Several environmental, psychological, and biological factors have been associated with the development of sleep across adolescence. The aim of the present article is to summarize these factors and to give examples of various outcomes in sleep patterns among adolescents studied in different cultural settings. It is obvious from earlier work that many adolescents have displaced circadian rhythms and lack of adaptation to school hours due to an early school start or additional burdens for work. Several interventions have aimed to help the adaptation process by supporting sleep processes and changing scheduling, in this way promoting classroom alertness. In summary, adolescents worldwide shorten their sleep due to schoolwork hours and additional work, especially by disturbing their sleep due to circadian misalignment

A reliable measure of similarity based on dependency for short time series: an application to gene expression networks

Background: Microarray techniques have become an important tool to the investigation of genetic relationships and the assignment of different phenotypes. Since microarrays are still very expensive, most of the experiments are performed with small samples. This paper introduces a method to quantify dependency between data series composed of few sample points. The method is used to construct gene co-expression subnetworks of highly significant edges. Results: The results shown here are for an adapted subset of a Saccharomyces cerevisiae gene expression data set with low temporal resolution and poor statistics. The method reveals common transcription factors with a high confidence level and allows the construction of subnetworks with high biological relevance that reveals characteristic features of the processes driving the organism adaptations to specific environmental conditions. Conclusion: Our method allows a reliable and sophisticated analysis of microarray data even under severe constraints. The utilization of systems biology improves the biologists ability to elucidate the mechanisms underlying celular processes and to formulate new hypotheses.

CHARACTERIZATION OF EXPONENTIAL DIVERGENCE OF THE KALMAN FILTER FOR TIME-VARYING SYSTEMS

This paper studies semistability of the recursive Kalman filter in the context of linear time-varying (LTV), possibly nondetectable systems with incorrect noise information. Semistability is a key property, as it ensures that the actual estimation error does not diverge exponentially. We explore structural properties of the filter to obtain a necessary and sufficient condition for the filter to be semistable. The condition does not involve limiting gains nor the solution of Riccati equations, as they can be difficult to obtain numerically and may not exist. We also compare semistability with the notions of stability and stability w.r.t. the initial error covariance, and we show that semistability in a sense makes no distinction between persistent and nonpersistent incorrect noise models, as opposed to stability. In the linear time invariant scenario we obtain algebraic, easy to test conditions for semistability and stability, which complement results available in the context of detectable systems. Illustrative examples are included.

Time correlation function in systems with two coexisting biological species

We study a stochastic lattice model describing the dynamics of coexistence of two interacting biological species. The model comprehends the local processes of birth, death, and diffusion of individuals of each species and is grounded on interaction of the predator-prey type. The species coexistence can be of two types: With self-sustained coupled time oscillations of population densities and without oscillations. We perform numerical simulations of the model on a square lattice and analyze the temporal behavior of each species by computing the time correlation functions as well as the spectral densities. This analysis provides an appropriate characterization of the different types of coexistence. It is also used to examine linked population cycles in nature and in experiment.

Equivalence between Redfield- and master-equation approaches for a time-dependent quantum system and coherence control

We present a derivation of the Redfield formalism for treating the dissipative dynamics of a time-dependent quantum system coupled to a classical environment. We compare such a formalism with the master equation approach where the environments are treated quantum mechanically. Focusing on a time-dependent spin-1/2 system we demonstrate the equivalence between both approaches by showing that they lead to the same Bloch equations and, as a consequence, to the same characteristic times T(1) and T(2) (associated with the longitudinal and transverse relaxations, respectively). These characteristic times are shown to be related to the operator-sum representation and the equivalent phenomenological-operator approach. Finally, we present a protocol to circumvent the decoherence processes due to the loss of energy (and thus, associated with T(1)). To this end, we simply associate the time dependence of the quantum system to an easily achieved modulated frequency. A possible implementation of the protocol is also proposed in the context of nuclear magnetic resonance.

Physical signatures of discontinuities of the time-dependent exchange-correlation potential

The exact exchange-correlation (XC) potential in time-dependent density-functional theory (TDDFT) is known to develop steps and discontinuities upon change of the particle number in spatially confined regions or isolated subsystems. We demonstrate that the self-interaction corrected adiabatic local-density approximation for the XC potential has this property, using the example of electron loss of a model quantum well system. We then study the influence of the XC potential discontinuity in a real-time simulation of a dissociation process of an asymmetric double quantum well system, and show that it dramatically affects the population of the resulting isolated single quantum wells. This indicates the importance of a proper account of the discontinuities in TDDFT descriptions of ionization, dissociation or charge transfer processes.

gamma Cassiopeiae: an X-ray Be star with personality

An exciting unsolved problem in the study of high energy processes of early type stars concerns the physical mechanism for producing X-rays near the Be star gamma Cassiopeiae. By now we know that this source and several ""gamma Cas analogs"" exhibit an unusual hard thermal X-ray spectrum, compared both to normal massive stars and the non-thermal emission of known Be/X-ray binaries. Also, its light curve is variable on almost all conceivable timescales. In this study we reanalyze a high dispersion spectrum obtained by Chandra in 2001 and combine it with the analysis of a new (2004) spectrum and light curve obtained by XMM-Newton. We find that both spectra can be fit well with 3-4 optically thin, thermal components consisting of a hot component having a temperature kT(Q) similar to 12-14 keV, perhaps one with a value of similar to 2.4 keV, and two with well defined values near 0.6 keV and 0.11 keV. We argue that these components arise in discrete (almost monothermal) plasmas. Moreover, they cannot be produced within an integral gas structure or by the cooling of a dominant hot process. Consistent with earlier findings, we also find that the Fe abundance arising from K-shell ions is significantly subsolar and less than the Fe abundance from L-shell ions. We also find novel properties not present in the earlier Chandra spectrum, including a dramatic decrease in the local photoelectric absorption of soft X-rays, a decrease in the strength of the Fe and possibly of the Si K fluorescence features, underpredicted lines in two ions each of Ne and N (suggesting abundances that are similar to 1.5-3x and similar to 4x solar, respectively), and broadening of the strong NeXLy alpha and OVIII Ly alpha lines. In addition, we note certain traits in the gamma Cas spectrum that are different from those of the fairly well studied analog HD110432 - in this sense the stars have different ""personalities."" In particular, for gamma Cas the hot X-ray component remains nearly constant in temperature, and the photoelectric absorption of the X-ray plasmas can change dramatically. As found by previous investigators of gamma Cas, changes in flux, whether occurring slowly or in rapidly evolving flares, are only seldomly accompanied by variations in hardness. Moreover, the light curve can show a ""periodicity"" that is due to the presence of flux minima that recur semiregularly over a few hours, and which can appear again at different epochs.

Survival time of random walk in random environment among soft obstacles

We consider a Random Walk in Random Environment (RWRE) moving in an i.i.d. random field of obstacles. When the particle hits an obstacle, it disappears with a positive probability. We obtain quenched and annealed bounds on the tails of the survival time in the general d-dimensional case. We then consider a simplified one-dimensional model (where transition probabilities and obstacles are independent and the RWRE only moves to neighbour sites), and obtain finer results for the tail of the survival time. In addition, we study also the ""mixed"" probability measures (quenched with respect to the obstacles and annealed with respect to the transition probabilities and vice-versa) and give results for tails of the survival time with respect to these probability measures. Further, we apply the same methods to obtain bounds for the tails of hitting times of Branching Random Walks in Random Environment (BRWRE).