Bounded parameter Markov Decision Processes with average reward criterion

Bounded parameter Markov Decision Processes (BMDPs) address the issue of dealing with uncertainty in the parameters of a Markov Decision Process (MDP). Unlike the case of an MDP, the notion of an optimal policy for a BMDP is not entirely straightforward. We consider two notions of optimality based on optimistic and pessimistic criteria. These have been analyzed for discounted BMDPs. Here we provide results for average reward BMDPs. We establish a fundamental relationship between the discounted and the average reward problems, prove the existence of Blackwell optimal policies and, for both notions of optimality, derive algorithms that converge to the optimal value function.

Multitask learning with expert advice

We consider the problem of prediction with expert advice in the setting where a forecaster is presented with several online prediction tasks. Instead of competing against the best expert separately on each task, we assume the tasks are related, and thus we expect that a few experts will perform well on the entire set of tasks. That is, our forecaster would like, on each task, to compete against the best expert chosen from a small set of experts. While we describe the “ideal” algorithm and its performance bound, we show that the computation required for this algorithm is as hard as computation of a matrix permanent. We present an efficient algorithm based on mixing priors, and prove a bound that is nearly as good for the sequential task presentation case. We also consider a harder case where the task may change arbitrarily from round to round, and we develop an efficient approximate randomized algorithm based on Markov chain Monte Carlo techniques.

Dietary modification for women after breast cancer treatment : a narrative review

Diet is thought to account for about 25% of cancers in developed countries. It is well documented that the risks associated with both the breast cancer itself and its treatments are important for women previously treated for breast cancer. Women are at risk of recurrence of the primary disease and prone to develop treatment-induced co-morbidities, some of which are thought to be modified by diet. With a view to making dietary recommendations for the breast cancer patients we encounter in our clinical nursing research, we mined the literature to scope the most current robust evidence concerning the role of the diet in protecting women against the recurrence of breast cancer and its potential to ameliorate some of the longer-term morbidities associated with the disease. We found that the evidence about the role of the diet in breast cancer recurrence is largely inconclusive. However, drawing on international guidelines enabled us to make three definitive recommendations. Women at risk of breast cancer recurrence, or who experience co-morbidities as a result of treatment, should limit their exposure to alcohol, moderate their nutritional intake so it does not contribute to postmenopausal weight gain, and should adhere to a balanced diet. Nursing education planned for breast cancer patients about dietary issues should ideally be individually tailored, based on a good understanding of the international recommendations and the evidence underpinning them

Using the Precede-Proceed Model of Health Program Planning in breast cancer nursing research

Aim: In this paper we discuss the use of the Precede-Proceed model when investigating health promotion options for breast cancer survivors. Background: Adherence to recommended health behaviors can optimize well-being after cancer treatment. Guided by the Precede-Proceed approach, we studied the behaviors of breast cancer survivors in our health service area. Data sources: The interview data from the cohort of breast cancer survivors are used in this paper to illustrate the use of Precede-Proceed in this nursing research context. Interview data were collected from June to December 2009. We also searched Medline, CINAHL, PsychInfo and PsychExtra up to 2010 for relevant literature in English to interrogate the data from other theoretical perspectives. Discussion: The Precede-Proceed model is theoretically-complex. The deductive analytic process guided by the model usefully explained some of the health behaviors of cancer survivors, although it could not explicate many other findings. A complementary inductive approach to the analysis and subsequent interpretation by way of Uncertainty in Illness Theory and other psychosocial perspectives provided a comprehensive account of the qualitative data that resulted in contextually-relevant recommendations for nursing practice. Implications for nursing: Nursing researchers using Precede-Proceed should maintain theoretical flexibility when interpreting qualitative data. Perspectives not embedded in the model might need to be considered to ensure that the data are analyzed in a contextually-relevant way. Conclusion: Precede-Proceed provides a robust framework for nursing researchers investigating health promotion in cancer survivors; however additional theoretical lenses to those embedded in the model can enhance data interpretation.

Post-operative CT assessment of interbody fusion two years after thoracoscopic scoliosis surgery

The relationship between radiologic union and clinical outcome in thoracoscopic scoliosis surgery is not clear, as apparent non-union of a spinal fusion does not always correspond to a poor clinical result. The aim of this study was to evaluate CT fusion rates 24 months after thoracoscopic anterior scoliosis surgery, and to explore the relationship between fusion scores and; (i) rod diameter, (ii) graft type, (iii) fusion level, (iv) occurrence of post-operative implant failure, and (v) lateral position of the fusion mass in the intervertebral disc space. We propose that moderate fusion scores on the Sucato scale secure successful clinical outcomes in thoracoscopic scoliosis surgery.

Using reflective clothing to enhance the conspicuity of bicyclists at night

Bicycling at night is more dangerous than in the daytime and poor conspicuity is likely to be a contributing factor. The use of reflective markings on a pedestrian’s major joints to facilitate the perception of biological motion has been shown to greatly enhance pedestrian conspicuity at night, but few corresponding data exist for bicyclists. Twelve younger and twelve older participants drove around a closed-road circuit at night and indicated when they first saw a bicyclist who wore black clothing either alone, or together with a reflective bicycling vest, or a vest plus ankle and knee reflectors. The bicyclist pedaled in place on a bicycle that had either a static or flashing light, or no light on the handlebars. Bicyclist clothing significantly affected conspicuity; drivers responded to bicyclists wearing the vest plus ankle and knee reflectors at significantly longer distances than when the bicyclist wore the vest alone or black clothing without a vest. Older drivers responded to bicyclists less often and at shorter distances than younger drivers. The presence of a bicycle light, whether static or flashing, did not enhance the conspicuity of the bicyclist; this may result in bicyclists who use a bicycle light being overconfident of their own conspicuity at night. The implications of our findings are that ankle and knee markings are a simple and very effective approach for enhancing bicyclist conspicuity at night.

A descriptive approach for power system stability and security assessment

Power system dynamic analysis and security assessment are becoming more significant today due to increases in size and complexity from restructuring, emerging new uncertainties, integration of renewable energy sources, distributed generation, and micro grids. Precise modelling of all contributed elements/devices, understanding interactions in detail, and observing hidden dynamics using existing analysis tools/theorems are difficult, and even impossible. In this chapter, the power system is considered as a continuum and the propagated electomechanical waves initiated by faults and other random events are studied to provide a new scheme for stability investigation of a large dimensional system. For this purpose, the measured electrical indices (such as rotor angle and bus voltage) following a fault in different points among the network are used, and the behaviour of the propagated waves through the lines, nodes, and buses is analyzed. The impact of weak transmission links on a progressive electromechanical wave using energy function concept is addressed. It is also emphasized that determining severity of a disturbance/contingency accurately, without considering the related electromechanical waves, hidden dynamics, and their properties is not secure enough. Considering these phenomena takes heavy and time consuming calculation, which is not suitable for online stability assessment problems. However, using a continuum model for a power system reduces the burden of complex calculations

A comprehensive EA benefit realization model -- An exploratory study

Enterprise architecture (EA) management has be-come an intensively discussed approach to manage enterprise transformations. While there is a strong interest in EA frameworks and EA modeling, a lack of knowledge remains about the theoretical foundation of EA benefits. In this paper, we identify EA success factors and EA benefits through a literature review, and integrate these findings with the DeLone & McLean IS success model to propose a theoretical model explaining the realization of EA benefits. In addition, we con-ducted semi-structured interviews with EA experts for a preliminary validation and further exploration of the model. We see this model as a first step to gain insights in and start a discussion on the theory of EA benefit realization. In future research, we plan to empirically validate the proposed model.

Even moderate visual impairments degrade drivers’ ability to see pedestrians at night

Purpose: To determine the effect of moderate levels of refractive blur and simulated cataracts on nighttime pedestrian conspicuity in the presence and absence of headlamp glare. Methods: The ability to recognize pedestrians at night was measured in 28 young adults (M=27.6 years) under three visual conditions: normal vision, refractive blur and simulated cataracts; mean acuity was 20/40 or better in all conditions. Pedestrian recognition distances were recorded while participants drove an instrumented vehicle along a closed road course at night. Pedestrians wore one of three clothing conditions and oncoming headlamps were present for 16 participants and absent for 12 participants. Results: Simulated visual impairment and glare significantly reduced the frequency with which drivers recognized pedestrians and the distance at which the drivers first recognized them. Simulated cataracts were significantly more disruptive than blur even though photopic visual acuity levels were matched. With normal vision, drivers responded to pedestrians at 3.6x and 5.5x longer distances on average than for the blur or cataract conditions, respectively. Even in the presence of visual impairment and glare, pedestrians were recognized more often and at longer distances when they wore a “biological motion” reflective clothing configuration than when they wore a reflective vest or black clothing. Conclusions: Drivers’ ability to recognize pedestrians at night is degraded by common visual impairments even when the drivers’ mean visual acuity meets licensing requirements. To maximize drivers’ ability to see pedestrians, drivers should wear their optimum optical correction, and cataract surgery should be performed early enough to avoid potentially dangerous reductions in visual performance.

Identification of bifunctional GA and AG intrastrand crosslinks formed between cisplatin and DNA

A combination of enzymatic digestion and electrospray ionisation mass spectrometry (ESI-MS) was used to characterise bifunctional adducts in which cisplatin is bound to GA base sequences in 8mer and 16mer oligonucleotides that do not contain other, higher affinity binding sites. The extent of formation of bifunctional adducts with GA base sequences was significant, but less than that seen with similar oligonucleotides containing either AG or GG sequences.

Comparison of the binding stoichiometries of positively charged DNA-binding drugs using positive and negative ion electrospray ionization mass spectrometry

Positive and negative ion electrospray ionization (ESI) mass spectra of complexes of positively charged small molecules (distamycin, Hoechst 33258, [Ru(phen)2dpq]Cl2 and [Ru(phen)2dpqC]Cl2) have been compared. [Ru(phen)2dpq]Cl2 and [Ru(phen)2dpqC]Cl2 bind to DNA by intercalation. Negative ion ESI mass spectra of mixtures of [Ru(phen)2dpq]Cl2 or [Ru(phen)2dpqC]Cl2 with DNA showed ions from DNA-ligand complexes consistent with solution studies. In contrast, only ions from freeDNAwere present in positive ion ESI mass spectra of mixtures of [Ru(phen)2dpq]Cl2 or [Ru(phen)2dpqC]Cl2 with DNA, highlighting the need for obtaining ESI mass spectra of non-covalent complexes under a range of experimental conditions. Negative ion spectra of mixtures of the minor groove binder Hoechst 33258 with DNA containing a known minor groove binding sequence were dominated by ions from a 1:1 complex. In contrast, in positive ion spectra there were also ions present from a 2:1 (Hoechst 33258: DNA) complex, suggesting an alternative binding mode was possible either in solution or in the gas phase. When Hoechst 33258 was mixed with a DNA sequence lacking a high affinity minor groove binding site, the negative ion ESI mass spectra showed that 1:1 and 2:1 complexes were formed, consistent with existence of binding modes other than minor groove binding. The data presented suggest that comparison of positive and negative ion ESI-MS spectra might provide an insight into various binding modes in both solution and the gas phase.