NICaN Regional Supportive & Palliative Care Network

NICaN Regional Supportive & Palliative Care Network Friday 30th May 2008 Lecture Theatre, Fern House Antrim 2.00 pm - 5.00 pm Welcome, Introductions Stuart MacDonnell, Chair of the Supportive and Palliative Care network welcomed everyone to the meeting. This meeting had been rescheduled to accommodate the validation workshop for the regional palliative care model, which took place on Friday,18th April. Acknowledging the full agenda, several items were pulled forward to accommodate speakers SPC_0809_03 Modernisation and Reform of Supportive and Palliative care Mr MacDonnell welcomed Dr Sonja McIlfatrick and Dr Donna Fitzimons, members of the Phase 1 Project Team for the Modernisation and Reform of palliative care. Their presentation highlighted the journey taken by the Project Team since January 2008 - May 2008. Seeking to deliver the network vision, for any person with palliative care need, cancer or non - cancer, the project team incorporated several methodologies. The literature review identified best practice. An assessment of need including epidemiological data and review of service provision. Consultation reflected the engagement with patients, carers and professional forums, primary care and non-malignant focus groups. The breadth of consultation confirmed the evidence for the identified components of the model. These were validated at the April workshop. External review of the work was provided by Dr Phil Larkin (Galway Uni) Prof David Clark (End of Life Care Observatory, Lancaster University) and Mr Bob Neillans (Chair of the Mid Trent Palliative care network, which has been involved in the Delivering choice programme within Lincolnshire). The Guiding Principles of the model reinforced Patient and family centred care, enhanced community provision and supported by specialists. The components of the model are · Identification of patient with Palliative careened · Holistic Assessment · Integration of services · Coordination of care · End of Life Care and Bereavement Care The consultation process also highlighted the need for Increased Public and Professional Awareness. This was recognised as an encompassing component. Underpinning the model is the need for robust Education and common core values e.g. dignity, choice, advocacy, empowerment, partnership working. Stuart MacDonnell, who also chaired the steering group during the project, congratulated the Project Team for delivering the comprehensive document on schedule. The Report has been submitted to the NICaN Board and the DHSSPSNI. In addition, an outline for Phase 2 of this work has been submitted. Mr MacDonnell recognised that there is real opportunity for palliative care to benefit from the DHSSPSNI commitment to concrete developments. Phase 2 will progress the current high-level components of the model into quality services developments at a local level, demonstrating integration throughout. The methods propose continued engagement with the Delivering Choice Programme enabled through a Central and also Local Teams. The report and the Appendices care available on the NICaN website www.nican@n-i.nhs.uk SPC_0809_01 Chairman's Business · Update on the Cancer Service Framework, the document has been submitted and presented to the Departmental Programme Board. Next stages will include the review of costs and development of a implementation guidance It is hoped that the completed document should be available for public consultation in Autumn 2008. with a launch of the framework document and accompanying implementation guide in Spring 2009. Some funding has already been identified to advance key areas of work including, Advanced communication skills training, peer review and an appointment of a post to develop the cancerni.net, focusing on children and e-learning tools. · Children's and Adolescent Cancer network group , Liz Henderson is to convene a group to consider how this is to be taken forward. · NICaN appointments Recognition was given to the significant contribution made by Dr Gerard Daly during his position as NICaN Lead Clinician, particularly throughout the early establishment of the NICaN. Dr Dermott Hughes (Western Trust) has been appointed as the NICaN Medical Director. The Primary Care Director post has been advertised and it is hoped that the Director of Network will be advertised later in Summer. Endorsement of End of Life care paper. The Paper was presented and endorsed at the March 2008 NICaN Board meeting. Mr David Galloway (Director of Secondary Care) emphasised the need for this important work to be recognised within the regional model to ensure that it is reflected in future models of service delivery Congratulations were again echoed to the Chair of the End of Life Group for this work, Dr Glynis Henry, and the working group Other recognition Mr MacDonnell congratulated the significant achievements across the network. These include: · Dr Francis Robinson (Consultant Palliative Medicine, Western Trust) Awarded - Consultant of the year at the NI Health Care awards. · Mrs Evelyn Whittaker Hospice Nurse Specialist, NI Hospice, Joint Second Prize in the Development award within the International Journal of Palliative Nursing Awards, for her work in development of palliative care education in nursing homes. · Mr Ray Elder is the newly appointed Team Leader of Community Palliative care, SE Trust. · Mrs Bridget Denvir, who managed the establishment of one of the first community multiprofessional palliative care teams is moving to work with establishing integrated teams within the Belfast Trust. Bridget has been an active core member of the network and here contribution has been much appreciated. Mrs Sharon Barr will attend in future. SPC_0809_02 Minutes & matters Arising from Meeting, 13th December 2007 No amendments were made to the draft minutes from the December meeting. These will be posted on the NICaN website for future reference. Palliative Care Research Following consultation, the response to the business case for the All Ireland Institute was forwarded on 22 February 2008 to Prof David Clark. Prof Judith Hill informed the group that terms of tender are now being developed. Awareness raising across academic institutions continues to engage interest in potential partnerships. Atlantic Philantrophies have offered financial support to the venture and match funding is being sought from across jurisdictions. Previous discussions at Network meetings have endorsed the need to establish a work strand for research and development within palliative and end of life care. To identify the body of interested parties and explore the strengths and weaknesses of a collaborative model for research, a workshop, - Building collaboration for Palliative and End of life Care Research -will take place on 4 June 10am - 2pm.in the Comfort Hotel.Antrim, The workshop will be chaired by Prof David Clark, Director of the International Observatory on End of Life Care. Prof Shelia Payne, Help the Hospices Chair in Hospice Studies and co director of the Cancer Experiences Collaborative will present the Experiences and Results from Research Collaborative. Feedback from this event will be brought back to the next meeting in September. SPC_0809_04 Patient Information pathways - a pathway for advanced disease Ms Danny Sinclair, NICaN Regional Coordinator for Patient Information informed the network of how patient information pathways have been developed in line with the Cancer Services Collaborative. Emerging themes, with regard to information needs of patients with advanced disease, are being identified from the work undertaken across the tumour groups. It is important to identify all information needs to develop a generic pathway of information resources for advanced disease to be endorsed by the Supportive and Palliative care network. This could be used across the all tumour specific information pathways and across organisational boundaries. The resulting pathway could potentially be used for non- cancer condition. A group is to be established to take this work forward. The group will: · Develop a list of advanced disease information themes · .Identify when they become relevant for the patient or their carer · .Identify existing resources · .Develop resources where needed · .Participate or nominate when review is required Dr Sheila Kelly nominated Helen Hume (SETrust) Paula Kealey will also contribute to this work; a nomination from the Patient and Public Information Forum has also been identified. A date will be circulated across the network to engage further interest and establish group SPC_0809_08 Development of a Regional Syringe Driver Prescription Chart Ms Kathy Stephenson reported that the second consultation of the draft regional syringe driver prescription chart and the focus group discussions, Pilots of the chart are to be undertaken within Trust, Hospices and General Practices. SPC_0809_05 A framework for Generalist and Specialist Palliative and End of Life Care Competency Dr Kathleen Dunne, lead of the Education works strand, reported on the findings following consultation of the Education framework. The report was widely appreciated across the network and valued as a significant and timely document for the commissioning of generalist and specialist adult palliative care education. Mr MacDonnell congratulated Dr Dunne and the members of the education workstrand for developing the framework aligning its significance to the underpinning needs of the regional model Amendments will be made to the document and then forwarded to the NICaN Board for endorsement. A process of implementation will be explored and reported to the network group at the September meeting. Key target areas for generalist palliative care education were highlighted within care of the elderly and general medicine. . SPC_0809_06 Pallcareni.net-a website for people with palliative care needs Ms Danny Sinclair, reminded the group of the pending amalgamation of the CAPriCORN and NICaN website. The resulting new web address will be www. cancerni.net. Recurrent funding has been secured to ensure the development of the supportive and palliative care website.www.Pallcareni.net The new website will host good information for people with palliative care needs, regardless of diagnosis. It will be accessible via the cancerni.net portal or independently as the pallcareni portal. It will signpost people with palliative care needs to condition- specific websites. The website will also enable the communication needs of the NI Regional Supportive & Palliative Care Network. This is a very significant method of seeking to enable greater understanding of palliative care for public and professionals, as highlighted within the regional model. Currently the material from the CAPriCORN website is being migrated onto cancerni and /or pallcareni.net as appropriate. To enable the further development of this opportunity a steering group of interested individuals is to be established. Their role will be to: · Drive the development of the website so it meets the needs of public and professionals through the sourcing and development of additional content · Identify any support that is needed, e.g. technical support · Review the website as a whole as it grows (coordinating condition-specific developments) · Review the functions of the website to aid communication throughout the Supportive and Palliative care network The steering group representation should reflect the constituencies within the Supportive and Palliative Care network. Current expressions of interest have come from Heather Reid and Valerie Peacock. A date will be circulated across the network to engage further interest and establish group SPC_0809_07 Update of Guidelines workstrand Dr Pauline Wilkinson presented the current work within the guidelines workstrand. 1. Brief Holistic Assessment & Referral Criteria to Specialist Palliative Care The development of an Holistic assessment Tool will help to identify holistic need at generalist and specialist level. Recognition of complex need prompts appropriate referral to specialist palliative care. The regional referral form is compatible with the Minimum Data set. The final drafts of this work are to be circulated widely, inclusive of service framework groups, primary care, secondary care and the supportive and palliative care network. Consultation will take place during June and July. Piloting of the forms will also be undertaken. 2. Control of Pain in Cancer Patients The original guidelines where developed 2003 and are now ready for review. The Mapping exercise, undertaken in May 2007, highlighted that the Guidelines were poorly adopted. The group have reviewed the pending SIGN 2 guidelines for pain with regard to practice in Northern Ireland. These are highly evidence based and are due to be launched this Summer. Whilst an excellent resource their comprehensiveness limits their readability, this may result in poor compliance. The Guidelines group feel it is important to have accessible and user-friendly guidelines particularly for Generalists and Out of hours. There are examples of good work that has taken place across the province, but there is a need for regional consistency. Dr Wilkinson has contacted Dr Carolyn Harper (Deputy CMO) and GAIN with regard to enabling funding to progress this work. The Guidelines group hope to approach the NICaN Primary Care Group to work in collaboratively on this piece, based on the templates already available. The works should be available in both electronic and paper versions. 3. Care of the dying & Breaking bad news Dr Gail Johnston has now completed an Audit of the Care of the Dying Pathways within the EHSSB. Gail is also seeking to examine to what extent the Regional Guidelines for Breaking Bad News are being implemented in the EHSSB with a view to identifying the need for further training or organisational structures that would facilitate future uptake. 4. Advances in new Technology Syringe Drivers Dr Wilkinson reported on a presentation made to the guidelines group by Mr Jim Elliot, Principle Engineer, Cardiology & Ann McLean, and Macmillan Palliative Care Nurse RVH. There is increasing concern with regard to how devices meet the recommended safety standards and how to reduce error. New devices have 3 point checking, automatic detection of syringe, automatic flow rates, full range of alarms, battery status and data download to provide an event log. There are now 2 companies in UK who have devices that meet these safety criteria. The current Graseby syringe drivers, which have been on the market and used predominately within Northern Ireland over the past 27 years Most new devices are not compatible with the regionally available monoject syringe, however contractual changes will lead to the withdrawal of the monoject syringes in October 2008. The Guidelines group supports a regional approach to this matter. This was echoed in the Supportive and Palliative care network. An option appraisal, identifying costs, and training issues should be developed through the engagement with Trusts and DHSSPSNI. The issue of Patient safety should be raised with the DHSSPSNI. SPC_0809_09 Evaluation of Supportive and Palliative Care network Deferred to next meeting. . SPC_0809_10 Emerging Issues Mrs Anne Coyle, Bereavement Coordinator, Southern Trust, announced that the Regional Bereavement Strategy is soon to be released. Anne supported the close alignment between the content of the strategy and the work of the regional model and other workstrands within the Supportive and Palliative care network. Ms Eleanor Donaghy, Transplant Coordinator, briefly highlighted the issue of tissue donation. Each year Northern Ireland has a dearth of corneal donations. There is no upper age limit for donation and retrieval is not limited by a cancer diagnosis. Recipients do not require immunosuppressive and the transplant is lifelong. The National Blood Service provided coordination of this donation they may be contacted via 07659180773. It is hoped that Mrs Coyle and Ms Donaghy could provide more comprehensive presentations at a future meeting. Events · Irish Psycho- Oncology Group Seminar, Cork 6 June, Exploring the Struggle for meaning in Cancer · Integrated Care: Putting Research into Practice, 13June, Trinity College, Dublin · Macmillan online conference Friday 13 June 2008, 9am - 5pm · Delivering effective end of life care: developing partnership working 15 Oct 2008, 9.30 -4.15 pm London Network Meeting was closed at 5.00pm SPC_0607_ Dates of Future Meetings (please note the change of venue) 10th September 2008, 1.30 - 5pm venue to be decided15th January 2009, 1.30 - 5pm venue to be decided12th May 2009, 1.30 - 5pm venue to be decided Attendances Apologies Stuart MacDonnellLorna NevinSonja McIlfatrick Donna FitzsimonsKathleen DunnePauline WilkinsonKathy StephensonSheila KellyMarie Nugent,Anne CoyleFiona GilmourJudith HillLorna DicksonMargaret CarlinLoretta GribbenYvonne Duff Lesley NelsonLiz HendersonSue FosterCathy PayneGraeme PaynePatricia MageeGeraldine WeatherupPaula KealyCaroline McAfeeLinda WrayValerie PeacockAnn McCleanRay Elder Martin BradleyHelen HumeGillian RankinHeather MonteverdeJulie DoyleAlison PorterYvonne SmythLiz Atkinson,Glynis HenryMaeve HullyCaroline HughesAnn FinnBob BrownSharon BarrJulie DoyleJanis McCulla .

Open video tools to support the production of online collaborative audiovisual projects : how to promote collective creation in e-learning

This paper analyses the use of open video editing tools to support the creation and production of online collaborative audiovisual projects for higher education. It focuses on the possibilities offered by these tools to promote collective creation in virtual environments.

Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

Learning about Distributed Systems

This paper presents the "state of the art" about distributed systems and applications and it's focused on teaching about these systems. It presents different platforms where to run distributed applications and describes some development toolkits whose can be used to develop prototypes, practices and distributed applications. It also presents some existing distributed algorithms useful for class practices, and some tools to help managing distributed environments. Finally, the paper presents some teaching experiences with different approaches on how to teach about distributed systems.

On optimal learning schedules and the marginal value of cumulative cultural evolution.

The age-dependent choice between expressing individual learning (IL) or social learning (SL) affects cumulative cultural evolution. A learning schedule in which SL precedes IL is supportive of cumulative culture because the amount of nongenetically encoded adaptive information acquired by previous generations can be absorbed by an individual and augmented. Devoting time and energy to learning, however, reduces the resources available for other life-history components. Learning schedules and life history thus coevolve. Here, we analyze a model where individuals may have up to three distinct life stages: "infants" using IL or oblique SL, "juveniles" implementing IL or horizontal SL, and adults obtaining material resources with learned information. We study the dynamic allocation of IL and SL within life stages and how this coevolves with the length of the learning stages. Although no learning may be evolutionary stable, we find conditions where cumulative cultural evolution can be selected for. In that case, the evolutionary stable learning schedule causes individuals to use oblique SL during infancy and a mixture between IL and horizontal SL when juvenile. We also find that the selected pattern of oblique SL increases the amount of information in the population, but horizontal SL does not do so.

Slope processes in changing permafrost environments: a geomorphological and sedimentological approach

Estudi realitzat a partir d’una estada al Centro de Estudos Geograficos de la Universidade de Lisboa, Portugal, entre 2011 i 2012. En aquest grup he desenvolupat la meva recerca focalitzada en ambients polars en presència de permafrost, concretament centrada en l’extrem nord-occidental de la Península Antàrtica (Shetland del Sud) i a l’Alt Àrtic (Svalvard). Ambdós àrees han registrat un augment de temperatura molt significatiu les darreres dècades. La meva recerca ha contemplat l’anàlisi de registres sedimentaris (lacustres, eòlics, vessant) i la monitorització de processos geomorfològics actuals a fi efecte d’entendre la dinàmica ambiental present i passada (i.e. clima). Amb aquesta finalitat he realitzat tres campanyes de treball de camp a l’Antàrtida i dues a l’Àrtic. El posterior treball de laboratori i d’oficina està propiciant nombroses publicacions que donen fe dels èxits assolits. A més, cal enfatitzar altres activitats desenvolupades durant la BP-A: coneixement de com organitzar i gestionar una campanya antàrtica, docència universitària, participació en comitès, associacions i tribunals de tesis doctorals, organització i participació en nombroses conferències, treball de camp en noves àrees d’estudi, referee per revistes internacionals, etc. Tanmateix, la concessió del projecte de recerca HOLOANTAR, del qual en sóc l’Investigador Responsable, ha estat l’èxit més important d’aquesta estada. Aquest projecte m’està conferint la capacitat de gestionar i integrar la recerca de 16 investigadors de diferents nacionalitats des d’una perspectiva multidisciplinar. Tothora, cal remarcar que no s’ha assolit un dels èxits que pretenia el meu projecte de BP-A: la transferència del bagatge i coneixement adquirit al sistema de recerca català. Malgrat haver presentat la meva candidatura per un contracte BP-B per tal que aquest background après a l’estranger revertís a Catalunya, el procés de selecció emprat en la convocatòria ho ha impedit i m’obliga a continuar la meva recerca a l’estranger.

Decision making in uncertain and changing environments

We consider an agent who has to repeatedly make choices in an uncertainand changing environment, who has full information of the past, who discountsfuture payoffs, but who has no prior. We provide a learning algorithm thatperforms almost as well as the best of a given finite number of experts orbenchmark strategies and does so at any point in time, provided the agentis sufficiently patient. The key is to find the appropriate degree of forgettingdistant past. Standard learning algorithms that treat recent and distant pastequally do not have the sequential epsilon optimality property.

Influence of learning on range expansion and adaptation to novel habitats.

Learning has been postulated to 'drive' evolution, but its influence on adaptive evolution in heterogeneous environments has not been formally examined. We used a spatially explicit individual-based model to study the effect of learning on the expansion and adaptation of a species to a novel habitat. Fitness was mediated by a behavioural trait (resource preference), which in turn was determined by both the genotype and learning. Our findings indicate that learning substantially increases the range of parameters under which the species expands and adapts to the novel habitat, particularly if the two habitats are separated by a sharp ecotone (rather than a gradient). However, for a broad range of parameters, learning reduces the degree of genetically-based local adaptation following the expansion and facilitates maintenance of genetic variation within local populations. Thus, in heterogeneous environments learning may facilitate evolutionary range expansions and maintenance of the potential of local populations to respond to subsequent environmental changes.

The Relationship between Teachers and Students in the Classroom: Communicative Language Teaching Approach and Cooperative Learning Strategy to Improve Learning

The aim of this research is to to investigate how a supportive relationship between teachers and students in the classroom can improve the learning process. By having a good relationship with students, teachers can offer to students chances to be motivated and feel engaged in the learning process. Students will be engaged actively in the learning instead of being passive learners. I wish to investigate how using communicative approach and cooperative learning strategies while teaching do affect and improve students’ learning performance. To achieve these goals qualitative data collection was used as the primary method. The results show that teachers and students value a supportive and caring relationship between them and that interaction is essential to the teacher-student relationship. This sense of caring and supporting from teachers motivates students to become a more interested learner. Students benefit and are motivated when their teachers create a safe and trustful environment. And also the methods and strategies teachers uses, makes students feel engaged and stimulated to participate in the learning process. The students have in their mind that a positive relationship with their teachers positively impacts their interest and motivation in school which contributes to the enhancement of the learning process.

Characterization and Application of Educational Virtual Environments for Science Teaching in Secondary School

This work describes the characteristics of a representative set of seven different virtual laboratories (VLs) aimed for science teaching in secondary school. For this purpose, a 27-item evaluation model that facilitates the characterization of the VLs was prepared. The model takes into account the gaming features, the overall usability, and also the potential to induce scientific literacy. Five of the seven VLs were then tested with two larger and highly heterogenic groups of students, and in two different contexts – biotechnology and physics, respectively. It is described how the VLs were received by the students, taking into account both their motivation and their self-reported learning outcome. In some cases, students’ approach to work with the VLs was recorded digitally, and analyzed qualitatively. In general, the students enjoyed the VL activities, and claimed that they learned from them. Yet, more investigation is required to address the effectiveness of these tools for significant learning.

The Arts (Music, Arts&Crafts and Drama) as a procedure for learning pre-school content: Grupo Edebé Project

There is nothing as amazing and fascinating as children learning process. Between 0 and 6 years old, a child brain develops in a waythat will never be repeated. At this age, children are eager to discover and they have great potential of active and affective life.Because of this, their learning capacity in this period is incalculable. (Jordan-Decarbo y Nelson, 2002; Wild, 1999).Pre-school Education is a unique and special stage, with self identity, which aims are:attending children as a whole,motivate them to learn,give them an affective and stable environment in which they can grow up and get to be balanced and confident people and inwhich they can relate to others, learn, enjoy and be happy.Arts, Music, Visual Arts and Drama (Gardner, 1994) can provide a framework of special, even unique, personal expression.With the aim of introducing qualitative improvements in the education of children and to ensure their emotional wellbeing, and havingnoticed that teachers had important needs and concerns as regards to diversity in their student groups, we developed a programbased on the detection of needs and concerns explained by professionals in education.This program of Grupo edebé, object of our research, is a multicultural, interdisciplinary and globalizing project the aims of which are:developing children's talent and personality,keeping their imagination and creativity and using these as a learning resource,promoting reasoning, favouring expression and communication,providing children with the tools to manage their emotions,and especially, introducing Arts as a procedure to increase learning.We wanted to start the research by studying the impact (Brice, 2003) that this last point had on the learning of five-year-old childrenschooled in multicultural environments.Therefore, the main goal of the research was the assessment of the implementation of a child education programme attending todiversity in a population of five-year-old children, specifically in the practice of procedures based on the use of Arts (music, arts andcrafts and theatre) as a vehicle or procedure for learning contents in Pre-school stage.Because children emotional welfare was a subject of our concern, and bearing in mind that the affective aspects are of vitalimportance for learning and child development (Parke and Gauvain, 2009), Grupo Edebé has also evaluated the starting, evolving andfinal impact in five-year-old children given that they finish Pre-school education at that age.

Remote collaborative multi-user informal learning experiences: design and evaluation

This paper presents a customizable system used to develop a collaborative multi-user problem solving game. It addresses the increasing demand for appealing informal learning experiences in museum-like settings. The system facilitates remote collaboration by allowing groups of learners tocommunicate through a videoconferencing system and by allowing them to simultaneously interact through a shared multi-touch interactive surface. A user study with 20 user groups indicates that the game facilitates collaboration between local and remote groups of learners. The videoconference and multitouch surface acted as communication channels, attracted students’ interest, facilitated engagement, and promoted inter- and intra-group collaboration—favoring intra-group collaboration. Our findings suggest that augmentingvideoconferencing systems with a shared multitouch space offers newpossibilities and scenarios for remote collaborative environments and collaborative learning.

On learning dynamics underlying the evolution of learning rules.

In order to understand the development of non-genetically encoded actions during an animal's lifespan, it is necessary to analyze the dynamics and evolution of learning rules producing behavior. Owing to the intrinsic stochastic and frequency-dependent nature of learning dynamics, these rules are often studied in evolutionary biology via agent-based computer simulations. In this paper, we show that stochastic approximation theory can help to qualitatively understand learning dynamics and formulate analytical models for the evolution of learning rules. We consider a population of individuals repeatedly interacting during their lifespan, and where the stage game faced by the individuals fluctuates according to an environmental stochastic process. Individuals adjust their behavioral actions according to learning rules belonging to the class of experience-weighted attraction learning mechanisms, which includes standard reinforcement and Bayesian learning as special cases. We use stochastic approximation theory in order to derive differential equations governing action play probabilities, which turn out to have qualitative features of mutator-selection equations. We then perform agent-based simulations to find the conditions where the deterministic approximation is closest to the original stochastic learning process for standard 2-action 2-player fluctuating games, where interaction between learning rules and preference reversal may occur. Finally, we analyze a simplified model for the evolution of learning in a producer-scrounger game, which shows that the exploration rate can interact in a non-intuitive way with other features of co-evolving learning rules. Overall, our analyses illustrate the usefulness of applying stochastic approximation theory in the study of animal learning.

Reinforcement learning utilizes proxemics: an avatar learns to manipulate the position of people in immersive virtual reality

A reinforcement learning (RL) method was used to train a virtual character to move participants to a specified location. The virtual environment depicted an alleyway displayed through a wide field-of-view head-tracked stereo head-mounted display. Based on proxemics theory, we predicted that when the character approached within a personal or intimate distance to the participants, they would be inclined to move backwards out of the way. We carried out a between-groups experiment with 30 female participants, with 10 assigned arbitrarily to each of the following three groups: In the Intimate condition the character could approach within 0.38m and in the Social condition no nearer than 1.2m. In the Random condition the actions of the virtual character were chosen randomly from among the same set as in the RL method, and the virtual character could approach within 0.38m. The experiment continued in each case until the participant either reached the target or 7 minutes had elapsed. The distributions of the times taken to reach the target showed significant differences between the three groups, with 9 out of 10 in the Intimate condition reaching the target significantly faster than the 6 out of 10 who reached the target in the Social condition. Only 1 out of 10 in the Random condition reached the target. The experiment is an example of applied presence theory: we rely on the many findings that people tend to respond realistically in immersive virtual environments, and use this to get people to achieve a task of which they had been unaware. This method opens up the door for many such applications where the virtual environment adapts to the responses of the human participants with the aim of achieving particular goals.