REGAL : a regularization based algorithm for reinforcement learning in weakly communicating MDPs

We provide an algorithm that achieves the optimal regret rate in an unknown weakly communicating Markov Decision Process (MDP). The algorithm proceeds in episodes where, in each episode, it picks a policy using regularization based on the span of the optimal bias vector. For an MDP with S states and A actions whose optimal bias vector has span bounded by H, we show a regret bound of ~ O(HS p AT ). We also relate the span to various diameter-like quantities associated with the MDP, demonstrating how our results improve on previous regret bounds.

Reconciling community and commerce? Collaboration between produsage communities and commercial operators

Collaborative user-led content creation by online communities, or produsage (Bruns 2008), has generated a variety of useful and important resources and other valuable outcomes, from open source software through the Wikipedia to a variety of smaller-scale, specialist projects. These are often seen as standing in an inherent opposition to commercial interests, and attempts to develop collaborations between community content creators and commercial partners have had mixed success rates to date. However, such tension between community and commerce is not inevitable, and there is substantial potential for more fruitful exchanges and collaboration. This article contributes to the development of this understanding by outlining the key underlying principles of such participatory community processes and exploring the potential tensions which could arise between these communities and their potential external partners. It also sketches out potential approaches to resolving them.

Acceptability of the distress thermometer and problem list to community-based telephone cancer helpline operators, and to cancer patients and carers

Background Cancer can be a distressing experience for cancer patients and carers, impacting on psychological, social, physical and spiritual functioning. However, health professionals often fail to detect distress in their patients due to time constraints and a lack of experience. Also, with the focus on the patient, carer needs are often overlooked. This study investigated the acceptability of brief distress screening with the Distress Thermometer (DT) and Problem List (PL) to operators of a community-based telephone helpline, as well as to cancer patients and carers calling the service. Methods Operators (n = 18) monitored usage of the DT and PL with callers (cancer patients/carers, >18 years, and English-speaking) from September-December 2006 (n = 666). The DT is a single item, 11-point scale to rate level of distress. The associated PL identifies the cause of distress. Results The DT and PL were used on 90% of eligible callers, most providing valid responses. Benefits included having an objective, structured and consistent means for distress screening and triage to supportive care services. Reported challenges included apparent inappropriateness of the tools due to the nature of the call or level of caller distress, the DT numeric scale, and the level of operator training. Conclusions We observed positive outcomes to using the DT and PL, although operators reported some challenges. Overcoming these challenges may improve distress screening particularly by less experienced clinicians, and further development of the PL items and DT scale may assist with administration. The DT and PL allow clinicians to direct/prioritise interventions or referrals, although ongoing training and support is critical in distress screening.

The construction of social identity in new nuclear operators : a longitudinal study

Countless studies have stressed the importance of social identity, particularly its role in various organizational outcomes, yet questions remain as to how identities initially develop, shift and change based on the configuration of multiple, pluralistic relationships grounded in an organizational setting. The interactive model of social identity formation has been proposed recently to explain the internalization of shared norms and values – critical in identity formation – has not received empirical examination. We analyzed multiple sources of data from nine nuclear professionals over three years to understand the construction of social identity in new entrants entering an organization. Informed by our data analyses, we found support for the interactive model and that age and level of experience influenced whether they undertook an inductive or deductive route of the group norm and value internalization. This study represents an important contribution to the study of social identity and the process by which identities are formed, particularly under conditions of duress or significant organizational disruption.

Improving the detection of donations within the RHD negative blood donor panel which weakly express the RHD antigen

This project improved the detection and classification of very weakly expressed RhD variants in the Australian blood donor panel and contributed to the knowledge of anti-D reactivity patterns of RHD alleles that are undescribed. As such, the management of donations possessing these RHD alleles can be improved upon and the overall safety of transfusion medicine pertaining to the Rh blood group system will be increased. Future projects at ARCBS will be able to utilise the procedures developed in this project, thereby decreasing throughput time. The specificity of current testing will be improved and the need for outsourced RHD testing diminished.

How to strengthen any weakly unforgeable signature into a strongly unforgeable signature

Standard signature schemes are usually designed only to achieve weak unforgeability – i.e. preventing forgery of signatures on new messages not previously signed. However, most signature schemes are randomised and allow many possible signatures for a single message. In this case, it may be possible to produce a new signature on a previously signed message. Some applications require that this type of forgery also be prevented – this requirement is called strong unforgeability. At PKC2006, Boneh Shen and Waters presented an efficient transform based on any randomised trapdoor hash function which converts a weakly unforgeable signature into a strongly unforgeable signature and applied it to construct a strongly unforgeable signature based on the CDH problem. However, the transform of Boneh et al only applies to a class of so-called partitioned signatures. Although many schemes fall in this class, some do not, for example the DSA signature. Hence it is natural to ask whether one can obtain a truly generic efficient transform based on any randomised trapdoor hash function which converts any weakly unforgeable signature into a strongly unforgeable one. We answer this question in the positive by presenting a simple modification of the Boneh-Shen-Waters transform. Our modified transform uses two randomised trapdoor hash functions.

SOTrain: A new program for training supervisors and operators in Australian sugar factories

The provision of effective training of supervisors and operators is essential if sugar factories are to operate profitably and in an environmentally sustainable and safe manner. The benefits of having supervisor and operator staff with a high level of operational skills are reduced stoppages, increased recovery, improved sugar quality, reduced damage to equipment, and reduced OH&S and environmental impacts. Training of new operators and supervisors in factories has traditionally relied on on-the-job training of the new or inexperienced staff by experienced supervisors and operators, supplemented by courses conducted by contractors such as Sugar Research Institute (SRI). However there is clearly a need for staff to be able to undertake training at any time, drawing on the content of online courses as required. An improved methodology for the training of factory supervisors and operators has been developed by QUT on behalf of a syndicate of mills. The new methodology provides ‘at factory’ learning via self-paced modules. Importantly, the training resources for each module are designed to support the training programs within sugar factories, thereby establishing a benchmark for training across the sugar industry. The modules include notes, training guides and session plans, guidelines for walkthrough tours of the stations, learning activities, resources such as videos, animations, job aids and competency assessments. The materials are available on the web for registered users in Australian Mills and many activities are best undertaken online. Apart from a few interactive online resources, the materials for each module can also be downloaded. The acronym SOTrain (Supervisor and Operator Training) has been applied to the new training program.

Linear and weakly nonlinear stability analyses of cooperative car-following models

Stability analyses have been widely used to better understand the mechanism of traffic jam formation. In this paper, we consider the impact of cooperative systems (a.k.a. connected vehicles) on traffic dynamics and, more precisely, on flow stability. Cooperative systems are emerging technologies enabling communication between vehicles and/or with the infrastructure. In a distributed communication framework, equipped vehicles are able to send and receive information to/from other equipped vehicles. Here, the effects of cooperative traffic are modeled through a general bilateral multianticipative car-following law that improves cooperative drivers' perception of their surrounding traffic conditions within a given communication range. Linear stability analyses are performed for a broad class of car-following models. They point out different stability conditions in both multianticipative and nonmultianticipative situations. To better understand what happens in unstable conditions, information on the shock wave structure is studied in the weakly nonlinear regime by the mean of the reductive perturbation method. The shock wave equation is obtained for generic car-following models by deriving the Korteweg de Vries equations. We then derive traffic-state-dependent conditions for the sign of the solitary wave (soliton) amplitude. This analytical result is verified through simulations. Simulation results confirm the validity of the speed estimate. The variation of the soliton amplitude as a function of the communication range is provided. The performed linear and weakly nonlinear analyses help justify the potential benefits of vehicle-integrated communication systems and provide new insights supporting the future implementation of cooperative systems.

Detecting rare events using Kullback-Leibler divergence: A weakly supervised approach

Video surveillance infrastructure has been widely installed in public places for security purposes. However, live video feeds are typically monitored by human staff, making the detection of important events as they occur difficult. As such, an expert system that can automatically detect events of interest in surveillance footage is highly desirable. Although a number of approaches have been proposed, they have significant limitations: supervised approaches, which can detect a specific event, ideally require a large number of samples with the event spatially and temporally localised; while unsupervised approaches, which do not require this demanding annotation, can only detect whether an event is abnormal and not specific event types. To overcome these problems, we formulate a weakly-supervised approach using Kullback-Leibler (KL) divergence to detect rare events. The proposed approach leverages the sparse nature of the target events to its advantage, and we show that this data imbalance guarantees the existence of a decision boundary to separate samples that contain the target event from those that do not. This trait, combined with the coarse annotation used by weakly supervised learning (that only indicates approximately when an event occurs), greatly reduces the annotation burden while retaining the ability to detect specific events. Furthermore, the proposed classifier requires only a decision threshold, simplifying its use compared to other weakly supervised approaches. We show that the proposed approach outperforms state-of-the-art methods on a popular real-world traffic surveillance dataset, while preserving real time performance.

On Ordinal VC-Dimension and Some Notions of Complexity

We generalize the classical notion of Vapnik–Chernovenkis (VC) dimension to ordinal VC-dimension, in the context of logical learning paradigms. Logical learning paradigms encompass the numerical learning paradigms commonly studied in Inductive Inference. A logical learning paradigm is defined as a set W of structures over some vocabulary, and a set D of first-order formulas that represent data. The sets of models of ϕ in W, where ϕ varies over D, generate a natural topology W over W. We show that if D is closed under boolean operators, then the notion of ordinal VC-dimension offers a perfect characterization for the problem of predicting the truth of the members of D in a member of W, with an ordinal bound on the number of mistakes. This shows that the notion of VC-dimension has a natural interpretation in Inductive Inference, when cast into a logical setting. We also study the relationships between predictive complexity, selective complexity—a variation on predictive complexity—and mind change complexity. The assumptions that D is closed under boolean operators and that W is compact often play a crucial role to establish connections between these concepts. We then consider a computable setting with effective versions of the complexity measures, and show that the equivalence between ordinal VC-dimension and predictive complexity fails. More precisely, we prove that the effective ordinal VC-dimension of a paradigm can be defined when all other effective notions of complexity are undefined. On a better note, when W is compact, all effective notions of complexity are defined, though they are not related as in the noncomputable version of the framework.

The impact of perceived stage of cancer on carers’ anxiety and depression during the patients’ final year of life

Objective: This paper explores the effects of perceived stage of cancer (PSOC) on carers' anxiety and depression during the patients' final year. Methods: A consecutive sample of patients and carers (N=98) were surveyed at regular intervals regarding PSOC, and anxiety and depression using the Hospital Anxiety and Depression Scale. Means were compared by gender using the Mann-Whitney U-test. The chi-square was used to analyse categorical data. Agreement between carers' and patients' PSOC was estimated using kappa statistics. Correlations between carers' PSOC and their anxiety and depression were calculated using the Spearman's rank correlation. Results: Over time, an increasing proportion of carers reported that the cancer was advanced, culminating at 43% near death. Agreement regarding PSOC was fair (kappa=0.29-0.34) until near death (kappa=0.21). Carers' anxiety increased over the year; depression increased in the final 6 months. Females were more anxious (p=0.049, 6 months; p=0.009, 3 months) than males, and more depressed until 1 month to death. The proportion of carers reporting moderate-severe anxiety almost doubled over the year to 27%, with more females in this category at 6 months (p=0.05). Carers with moderate-severe depression increased from 6 to 15% over the year. Increased PSOC was weakly correlated with increased anxiety and depression. Conclusions: Carers' anxiety exceeded depression in severity during advanced cancer. Females generally experienced greater anxiety and depression. Carers were more realistic than patients regarding the ultimate outcome, which was reflected in their declining mental health, particularly near the end.

Safer construction voluntary code of practice : implications for SMEs

The majority of Australian construction firms are small businesses, with 97% of general construction businesses employing less than 20 employees and 85% employing less than five employees (Lin and Mills, 2001; Lingard and Holmes, 2001). The Australian Bureau of Statistics’ definition of a small to medium enterprise was used for the purpose of this study (McLennan, 2000). This included small business employing less than twenty people and medium business employing less than 200 people. Although small to medium enterprises (SME) make up the major share of construction organisations in Australia, there is a paucity of published research in relation to occupational health and safety (OHS) issues for this group. Typically, SME organisations “are frequently undercapitalized and depend on continuous cash flow for their continued business” (Cole, 2003; 12). Research by Lin and Mills (2001) indicates that these factors influence the smaller operators’ ability and motivation to achieve high levels of OHS compared to larger firms which tend to integrate OHS into their management systems. According to Lin and Mills (2001; 137) small firms “do not feel the need to focus on OHS in their management systems, instead they often believe that the control of risk is the responsibility of employees”. This report documents findings from a qualitative research study that examined SME organisations’ views of a newly developed voluntary code of practice (VCOP), and ways in which they might implement the code in their businesses. The research also explored respondents’ awareness of current safety issues in industry in the context of their personal experiences.

Generalising unitary time evolution

In this third Quantum Interaction (QI) meeting it is time to examine our failures. One of the weakest elements of QI as a field, arises in its continuing lack of models displaying proper evolutionary dynamics. This paper presents an overview of the modern generalised approach to the derivation of time evolution equations in physics, showing how the notion of symmetry is essential to the extraction of operators in quantum theory. The form that symmetry might take in non-physical models is explored, with a number of viable avenues identified.

AITPM Email Newsletter Volume 0903, March 2009: Presidents Message

President’s Report Hello fellow AITPM members, First I would like on behalf of all AITPM members to send our condolences to all who have been affected by February’s tragic bushfires in regional Victoria, and deliver our best wishes to all of those involved in the rebuilding efforts. Over time I expect that the Victorian Government’s Royal Commission will analyse the circumstances and put forward a range of measures which will improve fire safety in vulnerable areas. As transport professionals it will be important for us to consider the findings and look to undertaking any recommendations that relate to the work we do. Not only in Victoria, but nationwide. In particular, the importance of logistics was highlighted following the fire events. Donors across Australia were this time requested to donate money rather than goods, presumably due in part to problems associated with the transport system coping with additional uncoordinated freight load, whilst being needed to support emergency management vehicle and managed freight movements. Notwithstanding, it was wonderful to see otherwise difficult to obtain goods, such as animal feed, being donated from far afield and transported in kind by trucking operators. As stated in last month’s Newsletter, AITPM made a direct cash donation to the Red Cross Bushfire Appeal immediately following the events, and a further donation to the Queensland Premier’s Disaster Relief Fund to support recovery after the North Queensland floods, which claimed seven lives. Again, we will need to monitor how the rebuilding effort unfolds particularly in regional Victoria and centres including Ingham in North Queensland, but I would urge all AITPM members who are in a position to support the restoration of the affected communities to play a part, particularly over time once the initial shock subsides and the steady job of rebuilding is underway. Onto lighter matters, AITPM’s flagship event, the 2009 AITPM National Conference, Traffic Beyond Tomorrow, being held in Adelaide from 5 to 7 August, is fast approaching. www.aitpm.com has all of the details about how to register, sponsor a booth, and so forth. We are looking forward to catching up with our conference “regulars” and meeting with new folks to AITPM, and Australian traffic and transport planning and management. Adelaide is one of my favourite places to visit and I’m looking forward to riding the light rail line extension through town and checking out progress on the road system development. Best regards all, Jon Bunker