A Local Circuit Model of Learned Straitial and Dopamine Cell Responses under Probabilistic Schedules of Reward

Before choosing, it helps to know both the expected value signaled by a predictive cue and the associated uncertainty that the reward will be forthcoming. Recently, Fiorillo et al. (2003) found the dopamine (DA) neurons of the SNc exhibit sustained responses related to the uncertainty that a cure will be followed by reward, in addition to phasic responses related to reward prediction errors (RPEs). This suggests that cue-dependent anticipations of the timing, magnitude, and uncertainty of rewards are learned and reflected in components of the DA signals broadcast by SNc neurons. What is the minimal local circuit model that can explain such multifaceted reward-related learning? A new computational model shows how learned uncertainty responses emerge robustly on single trial along with phasic RPE responses, such that both types of DA responses exhibit the empirically observed dependence on conditional probability, expected value of reward, and time since onset of the reward-predicting cue. The model includes three major pathways for computing: immediate expected values of cures, timed predictions of reward magnitudes (and RPEs), and the uncertainty associated with these predictions. The first two model pathways refine those previously modeled by Brown et al. (1999). A third, newly modeled, pathway is formed by medium spiny projection neurons (MSPNs) of the matrix compartment of the striatum, whose axons co-release GABA and a neuropeptide, substance P, both at synapses with GABAergic neurons in the SNr and with the dendrites (in SNr) of DA neurons whose somas are in ventral SNc. Co-release enables efficient computation of sustained DA uncertainty responses that are a non-monotonic function of the conditonal probability that a reward will follow the cue. The new model's incorporation of a striatal microcircuit allowed it to reveals that variability in striatal cholinergic transmission can explain observed difference, between monkeys, in the amplitutude of the non-monotonic uncertainty function. Involvement of matriceal MSPNs and striatal cholinergic transmission implpies a relation between uncertainty in the cue-reward contigency and action-selection functions of the basal ganglia. The model synthesizes anatomical, electrophysiological and behavioral data regarding the midbrain DA system in a novel way, by relating the ability to compute uncertainty, in parallel with other aspects of reward contingencies, to the unique distribution of SP inputs in ventral SN.

Comparison of deterministic, stochastic and fuzzy logic uncertainty modelling for capacity extension projects of DI/WFI pharmaceutical plant utilities with variable/dynamic demand

The last 30 years have seen Fuzzy Logic (FL) emerging as a method either complementing or challenging stochastic methods as the traditional method of modelling uncertainty. But the circumstances under which FL or stochastic methods should be used are shrouded in disagreement, because the areas of application of statistical and FL methods are overlapping with differences in opinion as to when which method should be used. Lacking are practically relevant case studies comparing these two methods. This work compares stochastic and FL methods for the assessment of spare capacity on the example of pharmaceutical high purity water (HPW) utility systems. The goal of this study was to find the most appropriate method modelling uncertainty in industrial scale HPW systems. The results provide evidence which suggests that stochastic methods are superior to the methods of FL in simulating uncertainty in chemical plant utilities including HPW systems in typical cases whereby extreme events, for example peaks in demand, or day-to-day variation rather than average values are of interest. The average production output or other statistical measures may, for instance, be of interest in the assessment of workshops. Furthermore the results indicate that the stochastic model should be used only if found necessary by a deterministic simulation. Consequently, this thesis concludes that either deterministic or stochastic methods should be used to simulate uncertainty in chemical plant utility systems and by extension some process system because extreme events or the modelling of day-to-day variation are important in capacity extension projects. Other reasons supporting the suggestion that stochastic HPW models are preferred to FL HPW models include: 1. The computer code for stochastic models is typically less complex than a FL models, thus reducing code maintenance and validation issues. 2. In many respects FL models are similar to deterministic models. Thus the need for a FL model over a deterministic model is questionable in the case of industrial scale HPW systems as presented here (as well as other similar systems) since the latter requires simpler models. 3. A FL model may be difficult to "sell" to an end-user as its results represent "approximate reasoning" a definition of which is, however, lacking. 4. Stochastic models may be applied with some relatively minor modifications on other systems, whereas FL models may not. For instance, the stochastic HPW system could be used to model municipal drinking water systems, whereas the FL HPW model should or could not be used on such systems. This is because the FL and stochastic model philosophies of a HPW system are fundamentally different. The stochastic model sees schedule and volume uncertainties as random phenomena described by statistical distributions based on either estimated or historical data. The FL model, on the other hand, simulates schedule uncertainties based on estimated operator behaviour e.g. tiredness of the operators and their working schedule. But in a municipal drinking water distribution system the notion of "operator" breaks down. 5. Stochastic methods can account for uncertainties that are difficult to model with FL. The FL HPW system model does not account for dispensed volume uncertainty, as there appears to be no reasonable method to account for it with FL whereas the stochastic model includes volume uncertainty.

Can population-level variation in early childhood development be measured in a manner that supports service planning and intervention?

Background: The Early Development Instrument (EDI) is a population-level measure of five developmental domains at school-entry age. The overall aim of this thesis was to explore the potential of the EDI as an indicator of early development in Ireland. Methods: A cross-sectional study was conducted in 47 primary schools in 2011 using the EDI and a linked parental questionnaire. EDI (teacher completed) scores were calculated for 1,344 children in their first year of full-time education. Those scoring in the lowest 10% of the sample population in one or more domains were deemed to be 'developmentally vulnerable'. Scores were correlated with contextual data from the parental questionnaire and with indicators of area and school-level deprivation. Rasch analysis was used to determine the validity of the EDI. Results: Over one quarter (27.5%) of all children in the study were developmentally vulnerable. Individual characteristics associated with increased risk of vulnerability were being male; under 5 years old; and having English as a second language. Adjusted for these demographics, low birth weight, poor parent/child interaction and mother’s lower level of education showed the most significant odds ratios for developmental vulnerability. Vulnerability did not follow the area-level deprivation gradient as measured by a composite index of material deprivation. Children considered by the teacher to be in need of assessment also had lower scores, which were not significantly different from those of children with a clinical diagnosis of special needs. all domains showed at least reasonable fit to the Rasch model supporting the validity of the instrument. However, there was a need for further refinement of the instrument in the Irish context. Conclusion: This thesis provides a unique snapshot of early development in Ireland. The EDI and linked parental questionnaires are promising indicators of the extent, distribution and determinants of developmental vulnerability.

A soft robust model for optimization under ambiguity

In this paper, we propose a framework for robust optimization that relaxes the standard notion of robustness by allowing the decision maker to vary the protection level in a smooth way across the uncertainty set. We apply our approach to the problem of maximizing the expected value of a payoff function when the underlying distribution is ambiguous and therefore robustness is relevant. Our primary objective is to develop this framework and relate it to the standard notion of robustness, which deals with only a single guarantee across one uncertainty set. First, we show that our approach connects closely to the theory of convex risk measures. We show that the complexity of this approach is equivalent to that of solving a small number of standard robust problems. We then investigate the conservatism benefits and downside probability guarantees implied by this approach and compare to the standard robust approach. Finally, we illustrate theme thodology on an asset allocation example consisting of historical market data over a 25-year investment horizon and find in every case we explore that relaxing standard robustness with soft robustness yields a seemingly favorable risk-return trade-off: each case results in a higher out-of-sample expected return for a relatively minor degradation of out-of-sample downside performance. © 2010 INFORMS.

Discounting the distant future: How much do uncertain rates increase valuations?

We demonstrate that when the future path of the discount rate is uncertain and highly correlated, the distant future should be discounted at significantly lower rates than suggested by the current rate. We then use two centuries of US interest rate data to quantify this effect. Using both random walk and mean-reverting models, we compute the "certainty-equivalent rate" that summarizes the effect of uncertainty and measures the appropriate forward rate of discount in the future. Under the random walk model we find that the certainty-equivalent rate falls continuously from 4% to 2% after 100 years, 1% after 200 years, and 0.5% after 300 years. At horizons of 400 years, the discounted value increases by a factor of over 40,000 relative to conventional discounting. Applied to climate change mitigation, we find that incorporating discount rate uncertainty almost doubles the expected present value of mitigation benefits. © 2003 Elsevier Science (USA). All rights reserved.

Probabilistic modeling of structural deterioration of reinforced concrete beams under saline environment corrosion

For existing reinforced concrete structures exposed to saline or marine conditions, there is an increasing engineering interest in their remaining safety and serviceability. A significant factor is the corrosion of steel reinforcement. At present there is little field experience and other data available. This limits the possibility for developing purely empirical models for strength and performance deterioration for use in structural safety and serviceability assessment. An alternative approach using theoretical concepts and probabilistic modeling is proposed herein. It is based on the evidence that the rate of diffusion of chlorides is influenced by internal damage to the concrete surrounding the reinforcement. This may be due to localized stresses resulting from external loading or through concrete shrinkage. Usually, the net effect is that the time to initiation of active corrosion is shortened, leading to greater localized corrosion and earlier reduction of ultimate capacity and structural stiffness. The proposed procedure is applied to an example beam and compared to experimental observations,including estimates of uncertainty in the remaining ultimate moment capacity and beam stiffness. Reasonably good agreement between the results of the proposed procedure and the experiment was found

Towards Data Management Planning Support for Research Data

Görzig, H., Engel, F., Brocks, H., Vogel, T. & Hemmje, M. (2015, August). Towards Data Management Planning Support for Research Data. Paper presented at the ASE International Conference on Data Science, Stanford, United States of America.

The origins of the control of information in war coverage

The conflict’s coverage, since its inception, has been closely linked to the relationship that both the military and the media have. The freedom they maintained during their first conflicts, although not without problems, though they suffered strict censorship suffered during World War I, and lastly the straitjacket treatment that they have endured during recent wars. The Vietnam War marked a turning point in this relationship, and after the invasion of Grenada, the military would launch new information guidelines, called Department of Defense National Media Pool. The lack of clear guidance of both control and space, has made for a complicated relationship between media and military, so the rules have evolved after every conflict shaping the future of press coverage and thus, war reporting.

A Method from the 'Lifeworld': Some Possibilities for Person Centred Planning for Children in Care

This paper describes a method for working with chldren who are the subjects of care planning and review under the Children Act 1989. The person centred planning model, as it is termed, has been well established in working with adults with special needs but can be extrapolated to encounters with children. It focuses on three fundamental areas: relationship, meaning and narrative. In underscoring these areas, the method restrains the bureaucracy and experience of stigma that is often present for those residing in State care.

An analysis of geometric uncertainty calculations for prostate radiotherapy in clinical practice.

Margins are used in radiotherapy to assist in the calculation of planning target volumes. These margins can be determined by analysing the geometric uncertainties inherent to the radiotherapy planning and delivery process. An important part of this process is the study of electronic portal images collected throughout the course of treatment. Set-up uncertainties were determined for prostate radiotherapy treatments at our previous site and the new purpose-built centre, with margins determined using a number of different methods. In addition, the potential effect of reducing the action level from 5 mm to 3 mm for changing a patient set-up, based on off-line bony anatomy-based portal image analysis, was studied. Margins generated using different methodologies were comparable. It was found that set-up errors were reduced following relocation to the new centre. Although a significant increase in the number of corrections to a patient's set-up was predicted if the action level was reduced from 5 mm to 3 mm, minimal reduction in patient set-up uncertainties would be seen as a consequence. Prescriptive geometric uncertainty analysis not only supports calculation and justification of the margins used clinically to generate planning target volumes, but may also best be used to monitor trends in clinical practice or audit changes introduced by new equipment, technology or practice. Simulations on existing data showed that a 3 mm rather than a 5 mm action level during off-line, bony anatomy-based portal imaging would have had a minimal benefit for the patients studied in this work.

Mechanical behaviour of unsaturated kaolin (with isotropic and anisotropic stress history). Part 2: performance under shear loading

Validation of a framework for unsaturated soil behaviour has frequently resulted in disagreement with basic propositions. A primary reason for this disparity is considered to be attributable to the anisotropic properties of the soil specimens tested as a result of preparation using one-dimensional compaction. As part of the work presented, comparison is made between tests on samples of unsaturated kaolin prepared at identical specific volumes and specific water volumes using isotropic compression and one-dimensional compression. The suctions in the samples were reduced to predefined values by wetting under low isotropic loading in a triaxial cell. The samples were then taken through various stress paths to failure, defined as the critical state strength, while the suctions were held constant. Stress path tests were also performed on samples without reducing the suction to predefined values. In the latter, constant water mass tests, the suctions were allowed to vary and were measured using a psychrometer. The results of the tests at critical state are compared with the propositions of Wheeler and Sivakumar. The shear strengths of samples with isotropic previous history are shown to be significantly greater than those of samples with one-dimensional stress history when plotted against the mean net stress. The normal compression lines, critical state lines and yield characteristics are also shown to be significantly influenced by the previous stress history and are shown to be different for isotropically and one-dimensionally prepared samples.

Network formation under mutual consent and costly communication

We consider two different approaches to describe the formation of social networks under mutual consent and costly communication. First, we consider a network-based approach; in particular Jackson–Wolinsky’s concept of pairwise stability. Next, we discuss a non-cooperative game-theoretic approach, through a refinement of the Nash equilibria of Myerson’s consent game. This refinement, denoted as monadic stability, describes myopically forward looking behavior of the players. We show through an equivalence that the class of monadically stable networks is a strict subset of the class of pairwise stable networks that can be characterized fully by modifications of the properties defining pairwise stability.

Aligning conservation priorities across taxa in Madagascar with high-resolution planning tools

Globally, priority areas for biodiversity are relatively well known, yet few detailed plans exist to direct conservation action within them, despite urgent need. Madagascar, like other globally recognized biodiversity hot spots, has complex spatial patterns of endemism that differ among taxonomic groups, creating challenges for the selection of within-country priorities. We show, in an analysis of wide taxonomic and geographic breadth and high spatial resolution, that multitaxonomic rather than single-taxon approaches are critical for identifying areas likely to promote the persistence of most species. Our conservation prioritization, facilitated by newly available techniques, identifies optimal expansion sites for the Madagascar government's current goal of tripling the land area under protection. Our findings further suggest that high-resolution multitaxonomic approaches to prioritization may be necessary to ensure protection for biodiversity in other global hot spots.