Optimistic linear programming gives logarithmic regret for irreducible MDPs

We present an algorithm called Optimistic Linear Programming (OLP) for learning to optimize average reward in an irreducible but otherwise unknown Markov decision process (MDP). OLP uses its experience so far to estimate the MDP. It chooses actions by optimistically maximizing estimated future rewards over a set of next-state transition probabilities that are close to the estimates, a computation that corresponds to solving linear programs. We show that the total expected reward obtained by OLP up to time T is within C(P) log T of the reward obtained by the optimal policy, where C(P) is an explicit, MDP-dependent constant. OLP is closely related to an algorithm proposed by Burnetas and Katehakis with four key differences: OLP is simpler, it does not require knowledge of the supports of transition probabilities, the proof of the regret bound is simpler, but our regret bound is a constant factor larger than the regret of their algorithm. OLP is also similar in flavor to an algorithm recently proposed by Auer and Ortner. But OLP is simpler and its regret bound has a better dependence on the size of the MDP.

ERP success: Does organisation size matter?

Organisations invest enormous sums of money in acquiring Enterprise Resource Planning (ERP) systems, presumably expecting positive impacts to the organisation and its functions. Despite the optimistic motives some ERP projects have reported nil or detrimental impacts. This paper studies the proposition that the size of an organisation (e.g. small, large) may have contributed to the differences in receiving benefits reported in prior studies in this domain. The alleged differences in organisational performance are empirically measured using a prior validated model, using five constructs and fortytwo sub-constructs. Information is gathered from three hundred and ten respondents representing twenty-seven public sector organisations. Results suggests that (1) larger organisations have received more benefits compared to small organisations, (2) small organisations demonstrated higher reliance on their ERP systems, (3) employment cohorts demonstrate significant differences in perceived benefits in small and large organisations.

Youth, Sport and the Social Inclusion Agenda

The purpose of this paper is to assess aspects of the British Government's attempts to use sporting participation as a vehicle to re-integrate socially disadvantaged, excluded and 'at-risk' youth into mainstream society. A number of organisations, policy-makers, commentators, and practitioners with a stake in the 'sport and social inclusion agenda' were interviewed. General agreement was found on a number of points: that the field was overly crowded with policies, programmes and initiatives; that the field worked in a 'bottom-up' way, with the most significant factor determining success being effective local workers with good networks and cultural access; that the dichotomising rhetoric of inclusion/exclusion was counter-productive; that the notion of the 'at-risk youth' was problematic and unhelpful; and that they all now dealt with a marketplace, where 'clients' had to be enrolled in their own reformation. There was also disagreement on a number of points: that policy acts as a relatively accurate template for practice, as opposed to the argument that it was simply regarded as a cluster of suggestions for practice; that policy was exceptionally piecemeal in its formulation and application, as opposed to regarding policy as necessarily targeted and dispersed; and that the inclusion agenda was largely politically driven and transitory, as opposed to the optimistic view that it had become ingrained in local practice. Finally, the paper examines some issues that are the most likely points of contribution by researchers in the area: that more research needs to be done on the processes of identity formation associated with participation in sport; that more effective programme evaluation needs to be done for such forms of governmental intervention to work properly; and that the relationship between different kinds of physical activity and social and personal change needs to be more thoroughly theorised.

Hell-vetica

Helvetica (connotes Swiss typeface) has been used the most widely from street signs to government campaign posters since 1957. Helvetica represents a great leap forward for modernity: clean, sans-serif, optimistic. However in history, there was a movement against Helvetica among American artists and designers since David Carson and Paula Scher indicted Helvetica as the cause of Vietnam war. Paradoxically, we celebrated its 50th birthday in 2007. Helvetica’s message it this: “you are going to get to your destination on time; your plan will not crash; your money is safe in our vault; we will not break the package; the paperwork has been filled in; everything is going to be OK” (Finlo Rohrer, Helvetica At 50, BBC News Magazine 9 May 2007). The artwork, Hell-vetica describes its characteristic of double agent for modernism and postmodernism in this contemporary era by combination of a stylised graphical form of a heart shape in red and a typographical manipulation - Hell-vetica.

Australian foundations and the downturn

Building on the investigation of the Charity Commission (2009) on the effects of the economic downturn on the largest trusts and foundation in the United Kingdom, the purpose of this research was to assess the extent to which Australian trusts and foundations were taking an actively strategic approach to their investments and pursuit of mission (including grant-making), and the relationship between the two in the context of the economic downturn. Focus was given to identifying the issues raised as a consequence of the economic downturn, rather than providing a generalised snapshot of the ‘average’ foundations response. In September 2009, semi-structured, in depth interviews were conducted with executives of 23 grant making trusts and foundations. The interviews for this research focused on the largest grant makers in terms of grant expenditure, however included foundations from different geographical locations and from across different cause areas. It is important to stress at the outset that this was not a representative sample of foundations; the study aimed to identify issues rather than to present a representative picture of the ‘average’ foundation’s response. It is also important to note that the study was undertaken in September 2009 at a time when many foundations were beginning to feel more optimistic about the longer term future, but aware of continuing and possibly worsening short term income problems. But whatever the financial future, some of the underlying issues, concerning investment and grant making management practices, raised in this report will be of continuing relevance worthy of wider discussion. If a crisis is too good to waste, it is also too good to forget. One other introductory point – as previously noted, interviews for this study were conducted in September 2009 – just one month prior to the introduction of the new Private Ancillary Fund (PAF) legislation which replaced the previous Prescribed Private Fund (PPF) arrangement1. References to PAFs and/or PPFs reflect that time.

The relationship between culture, attitude, social networks and quality of life in midlife Australian and Taiwanese citizens

Objectives: The objectives of this study were to specifically investigate the differences in culture, attitudes and social networks between Australian and Taiwanese men and women and identify the factors that predict midlife men and women’s quality of life in both countries. Methods: A stratified random sample strategy based on probability proportional sampling (PPS) was conducted to investigate 278 Australian and 398 Taiwanese midlife men and women’s quality of life. Multiple regression modelling and classification and regression trees (CARTs) were performed to examine the potential differences on culture, attitude, social networks, social demographic factors and religion/spirituality in midlife men and women’s quality of life in both Australia and Taiwan. Results: The results of this study suggest that culture involves multiple functions and interacts with attitudes, social networks and individual factors to influence a person’s quality of life. Significant relationships were found between the interaction between cultural circumstances and a person’s internal and external factors. The research found that good social support networks and a healthy optimistic disposition may significantly enhance midlife men and women’s quality of life. Conclusion: The study indicated that there is a significant relationship between culture, attitude, social networks and quality of life in midlife Australian and Taiwanese men and women. People who had higher levels of horizontal individualism and collectivism, positive attitudes and better social support had better psychological, social, physical and environmental health, while it emerged that vertical individualists with competitive characteristics would experience a lower quality of life. This study has highlighted areas where opportunities exist to further reflect upon contemporary social health policies for Australian and Taiwanese societies and also within the global perspective, in order to provide enhanced quality care for growing midlife populations.

Optimism about safety and group-serving interpretations of safety among pedestrians and cyclists in relation to road use in general and under low light conditions

Drivers are known to be optimistic about their risk of crash involvement, believing that they are less likely to be involved in a crash than other drivers. However, little comparative research has been conducted among other road users. In addition, optimism about crash risk is conceptualised as applying only to an individual’s assessment of his or her personal risk of crash involvement. The possibility that the self-serving nature of optimism about safety might be generalised to the group-level as a cyclist or a pedestrian, i.e., becoming group-serving rather than self-serving, has been overlooked in relation to road safety. This study analysed a subset of data collected as part of a larger research project on the visibility of pedestrians, cyclists and road workers, focusing on a set of questionnaire items administered to 406 pedestrians, 838 cyclists and 622 drivers. The items related to safety in various scenarios involving drivers, pedestrians and cyclists, allowing predictions to be derived about group differences in agreement with items based on the assumption that the results would exhibit group-serving bias. Analysis of the responses indicated that specific hypotheses about group-serving interpretations of safety and responsibility were supported in 22 of the 26 comparisons. When the nine comparisons relevant to low lighting conditions were considered separately, seven were found to be supported. The findings of the research have implications for public education and for the likely acceptance of messages which are inconsistent with current assumptions and expectations of pedestrians and cyclists. They also suggest that research into group-serving interpretations of safety, even for temporary roles rather than enduring groups, could be fruitful. Further, there is an implication that gains in safety can be made by better educating road users about the limitations of their visibility and the ramifications of this for their own road safety, particularly in low light.

Adapting to the work-life interface : the influence of individual differences, work and family on well-being, mental health and work engagement

Bronfenbrenner.s Bioecological Model, expressed as the developmental equation, D f PPCT, is the theoretical framework for two studies that bring together diverse strands of psychology to study the work-life interface of working adults. Occupational and organizational psychology is focused on the demands and resources of work and family, without emphasising the individual in detail. Health and personality psychology examine the individual but without emphasis on the individual.s work and family roles. The current research used Bronfenbrenner.s theoretical framework to combine individual differences, work and family to understand how these factors influence the working adult.s psychological functioning. Competent development has been defined as high well-being (measured as life satisfaction and psychological well-being) and high work engagement (as work vigour, work dedication and absorption in work) and as the absence of mental illness (as depression, anxiety and stress) and the absence of burnout (as emotional exhaustion, cynicism and professional efficacy). Study 1 and 2 were linked, with Study 1 as a cross-sectional survey and Study 2, a prospective panel study that followed on from the data used in Study1. Participants were recruited from a university and from a large public hospital to take part in a 3-wave, online study where they completed identical surveys at 3-4 month intervals (N = 470 at Time 1 and N = 198 at Time 3). In Study 1, hierarchical multiple regressions were used to assess the effects of individual differences (Block 1, e.g. dispositional optimism, coping self-efficacy, perceived control of time, humour), work and family variables (Block 2, e.g. affective commitment, skill discretion, work hours, children, marital status, family demands) and the work-life interface (Block 3, e.g. direction and quality of spillover between roles, work-life balance) on the outcomes. There were a mosaic of predictors of the outcomes with a group of seven that were the most frequent significant predictors and which represented the individual (dispositional optimism and coping self-efficacy), the workplace (skill discretion, affective commitment and job autonomy) and the work-life interface (negative work-to-family spillover and negative family-to-work spillover). Interestingly, gender and working hours were not important predictors. The effects of job social support, generally and for work-life issues, perceived control of time and egalitarian gender roles on the outcomes were mediated by negative work-to-family spillover, particularly for emotional exhaustion. Further, the effect of negative spillover on depression, anxiety and work engagement was moderated by the individual.s personal and workplace resources. Study 2 modelled the longitudinal relationships between the group of the seven most frequent predictors and the outcomes. Using a set of non-nested models, the relative influences of concurrent functioning, stability and change over time were assessed. The modelling began with models at Time 1, which formed the basis for confirmatory factor analysis (CFA) to establish the underlying relationships between the variables and calculate the composite variables for the longitudinal models. The CFAs were well fitting with few modifications to ensure good fit. However, using burnout and work engagement together required additional analyses to resolve poor fit, with one factor (representing a continuum from burnout to work engagement) being the only acceptable solution. Five different longitudinal models were investigated as the Well-Being, Mental Distress, Well-Being-Mental Health, Work Engagement and Integrated models using differing combinations of the outcomes. The best fitting model for each was a reciprocal model that was trimmed of trivial paths. The strongest paths were the synchronous correlations and the paths within variables over time. The reciprocal paths were more variable with weak to mild effects. There was evidence of gain and loss spirals between the variables over time, with a slight net gain in resources that may provide the mechanism for the accumulation of psychological advantage over a lifetime. The longitudinal models also showed that there are leverage points at which personal, psychological and managerial interventions can be targeted to bolster the individual and provide supportive workplace conditions that also minimise negative spillover. Bronfenbrenner.s developmental equation has been a useful framework for the current research, showing the importance of the person as central to the individual.s experience of the work-life interface. By taking control of their own life, the individual can craft a life path that is most suited to their own needs. Competent developmental outcomes were most likely where the person was optimistic and had high self-efficacy, worked in a job that they were attached to and which allowed them to use their talents and without too much negative spillover between their work and family domains. In this way, individuals had greater well-being, better mental health and greater work engagement at any one time and across time.

It really is black and white when you look at it like this : reporting on a study into Australian professors' research and teaching priorities

Despite optimistic claims about the research-teaching nexus, Australian academics still face tension between research and teaching. The teaching and research priorities, beliefs and behaviours of 70 Professorial and Associate Professorial academics in Science, Information Technology and Engineering were examined in this study. The academics from 4 faculties in 3 Australian universities, were asked to rank 16 research activities and 16 matched learning and teaching (L&T) activities from each of three perspectives: job satisfaction, leadership behaviour, and perceptions of professional importance. The findings, which were remarkably consistent across the three universities, were unequivocally in favour of Research. The only L&T activity that was ranked consistently well was “Improving student satisfaction ratings for Teaching”. The data demonstrates that Australian government and university initiatives to raise the status of L&T activity are not impacting significantly on Australia’s future leaders of university learning.

Assessment of commercial network RTK user positioning performance over long inter-station distances

The paper provides an assessment of the performance of commercial Real Time Kinematic (RTK) systems over longer than recommended inter-station distances. The experiments were set up to test and analyse solutions from the i-MAX, MAX and VRS systems being operated with three triangle shaped network cells, each having an average inter-station distance of 69km, 118km and 166km. The performance characteristics appraised included initialization success rate, initialization time, RTK position accuracy and availability, ambiguity resolution risk and RTK integrity risk in order to provide a wider perspective of the performance of the testing systems. ----- ----- The results showed that the performances of all network RTK solutions assessed were affected by the increase in the inter-station distances to similar degrees. The MAX solution achieved the highest initialization success rate of 96.6% on average, albeit with a longer initialisation time. Two VRS approaches achieved lower initialization success rate of 80% over the large triangle. In terms of RTK positioning accuracy after successful initialisation, the results indicated a good agreement between the actual error growth in both horizontal and vertical components and the accuracy specified in the RMS and part per million (ppm) values by the manufacturers. ----- ----- Additionally, the VRS approaches performed better than the MAX and i-MAX when being tested under the standard triangle network with a mean inter-station distance of 69km. However as the inter-station distance increases, the network RTK software may fail to generate VRS correction and then may turn to operate in the nearest single-base RTK (or RAW) mode. The position uncertainty reached beyond 2 meters occasionally, showing that the RTK rover software was using an incorrect ambiguity fixed solution to estimate the rover position rather than automatically dropping back to using an ambiguity float solution. Results identified that the risk of incorrectly resolving ambiguities reached 18%, 20%, 13% and 25% for i-MAX, MAX, Leica VRS and Trimble VRS respectively when operating over the large triangle network. Additionally, the Coordinate Quality indicator values given by the Leica GX1230 GG rover receiver tended to be over-optimistic and not functioning well with the identification of incorrectly fixed integer ambiguity solutions. In summary, this independent assessment has identified some problems and failures that can occur in all of the systems tested, especially when being pushed beyond the recommended limits. While such failures are expected, they can offer useful insights into where users should be wary and how manufacturers might improve their products. The results also demonstrate that integrity monitoring of RTK solutions is indeed necessary for precision applications, thus deserving serious attention from researchers and system providers.

Bounded parameter Markov Decision Processes with average reward criterion

Bounded parameter Markov Decision Processes (BMDPs) address the issue of dealing with uncertainty in the parameters of a Markov Decision Process (MDP). Unlike the case of an MDP, the notion of an optimal policy for a BMDP is not entirely straightforward. We consider two notions of optimality based on optimistic and pessimistic criteria. These have been analyzed for discounted BMDPs. Here we provide results for average reward BMDPs. We establish a fundamental relationship between the discounted and the average reward problems, prove the existence of Blackwell optimal policies and, for both notions of optimality, derive algorithms that converge to the optimal value function.

Closing the gap between bandit and full-information online optimization : high-probability regret bound

We demonstrate a modification of the algorithm of Dani et al for the online linear optimization problem in the bandit setting, which allows us to achieve an O( \sqrt{T ln T} ) regret bound in high probability against an adaptive adversary, as opposed to the in expectation result against an oblivious adversary of Dani et al. We obtain the same dependence on the dimension as that exhibited by Dani et al. The results of this paper rest firmly on those of Dani et al and the remarkable technique of Auer et al for obtaining high-probability bounds via optimistic estimates. This paper answers an open question: it eliminates the gap between the high-probability bounds obtained in the full-information vs bandit settings.

High-probability regret bounds for bandit online linear optimization

We present a modification of the algorithm of Dani et al. [8] for the online linear optimization problem in the bandit setting, which with high probability has regret at most O ∗ ( √ T) against an adaptive adversary. This improves on the previous algorithm [8] whose regret is bounded in expectation against an oblivious adversary. We obtain the same dependence on the dimension (n 3/2) as that exhibited by Dani et al. The results of this paper rest firmly on those of [8] and the remarkable technique of Auer et al. [2] for obtaining high probability bounds via optimistic estimates. This paper answers an open question: it eliminates the gap between the high-probability bounds obtained in the full-information vs bandit settings.

Identifying parent perspectives to guide active travel intervention with small populations : case study in Denver, Colorado

This paper investigates a strategy for guiding school-based active travel intervention. School-based active travel programs address the travel behaviors and perceptions of small target populations (i.e., at individual schools) so they can encourage people to walk or bike. Thus, planners need to know as much as possible about the behaviors and perceptions of their target populations. However, existing strategies for modeling travel behavior and segmenting audiences typically work with larger populations and may not capture the attitudinal diversity of smaller groups. This case study used Q technique to identify salient travel-related attitude types among parents at an elementary school in Denver, Colorado; 161 parents presented their perspectives about school travel by rank-ordering 36 statements from strongly disagree to strongly agree in a normalized distribution, single centered around no opinion. Thirty-nine respondents' cases were selected for case-wise cluster analysis in SPSS according to criteria that made them most likely to walk: proximity to school, grade, and bus service. Analysis revealed five core perspectives that were then correlated with the larger respondent pool: optimistic walkers, fair-weather walkers, drivers of necessity, determined drivers, and fence sitters. Core perspectives are presented—characterized by parents' opinions, personal characteristics, and reported travel behaviors—and recommendations are made for possible intervention approaches. The study concludes that Q technique provides a fine-grained assessment of travel behavior for small populations, which would benefit small-scale behavioral interventions