Hierarchical Reinforcement Learning in Behavior and the Brain

Dissertation presented to obtain the Ph.D degree in Biology, Neuroscience

Impact of an intervention in the use of sequential antibiotic therapy in a Brazilian university hospital

INTRODUCTION: Sequential antibiotic therapy (SAT) is safe and economical. However, the unnecessary use of intravenous (IV) administration usually occurs. The objective of this work was to get to know the effectiveness of an intervention to implement the SAT in a teaching hospital in Brazil. METHODS: This was a prospective and interventional study, historically controlled, and was conducted in the Hospital de Clínicas, Universidade Federal de Uberlândia, State of Minas Gerais, Brazil, a high complexity teaching hospital having 503 beds. In each of the periods, from 04/04/05 to 07/20/05 (pre-intervention) and from 09/24/07 to 12/20/07 (intervention), 117 patients were evaluated. After the pre-intervention period, guidelines were developed which were implemented during the intervention period along with educational measures and a reminder system added to the patients' prescription. RESULTS: In the pre-intervention and intervention periods, the IV antibiotics were used as treatment for a average time of 14.8 and 11.8 days, respectively. Ceftriaxone was the antibiotic most prescribed in both periods (23.4% and 21.6% respectively). Starting from the first prescription of antibiotics, the average length of hospitalization time was 21.8 and 17.5 days, respectively. The SAT occurred only in 4 and 5 courses of treatment, respectively, and 12.8% and 18.8% of the patients died in the respective periods. CONCLUSIONS: Under the presented conditions, the evaluated intervention strategy is ineffective in promoting the exchange of the antibiotic administration from IV to oral treatment (SAT).

How to improve consumer decision skills in children? A case study of an intervention with institutionalized children

The aim of this study is to assess the institutionalized children’s skills as consumers but also to assess how we can improve their knowledge through an intervention. The sample was composed of two subgroups (38 institutionalized children and 36 non-institutionalized children). In order to assess children’s knowledge, a questionnaire and an interview were used. The method used as intervention was a 30-minute class. Results suggested that institutionalized children have lower levels of knowledge regarding consumption-related practices and lower levels of accuracy at estimating prices than non-institutionalized children. However, results also showed that the attitudes of institutionalized children towards advertising and making decisions based on price/quantity evaluation or based on the use of the same strategy in different situations are not significantly different from the non-institutionalized children. Regarding the intervention, it was possible to conclude that one class is not the best method to improve children’s knowledge. Institutionalized children need a longer and more practical intervention.

A description of the Australian early psychosis intervention model and a proposal to establish a Pilot Early Intervention Program in Santa Cruz de la Sierra, Bolívia

RESUMO: Em 2011, a Associação Psiquiátrica Mundial lançou um programa de bolsas de investigação para psiquiatras em início de carreira a partir de países de renda baixa ou média-baixa, no âmbito deste programa, o autor foi selecionado para uma bolsa de pesquisa no Centre for Youth Mental Health/Orygen Youth Health Research Centre da Universidade de Melbourne. Orygen, é a principal organização de pesquisa e tradução do conhecimento do mundo com foco em problemas de saúde mental em pessoas jovens. O estágio foi baseado em Prevenção e Intervenção Precoce Psychosis Centre (EPPIC), que faz parte do Orygen. EPPIC fornece programa de tratamento abrangente e integrada, baseada na comunidade para o primeiro episódio de psicose. Esta dissertação descreve o modelo EPPIC, e seus componentes essenciais e fatores que são necessários para uma implementação de serviço direito. Além disso, uma proposta de criação de um programa-piloto de intervenção psicose precoce é discutido. Este programa inclui um programa de extensão inovadora que combina princípios comerciais sólidos, com metas sociais, a fim de combater especificamente a maior barreira para o tratamento da psicose precoce na Bolívia: o estigma da doença mental. Ao utilizar uma equipe de tratamento móvel, multidisciplinar, que enfatiza os papéis dos gerentes do caso treinados focada em fornecer indivíduo intensiva e apoio familiar no lar, este programa irá prestar cuidados culturalmente apropriados que irá alavancar contribuições de um suprimento limitado de psiquiatras e mudar longe da dependência um sistema médico fragmentado. ---------------------------- ABSTRACT: In 2011, the World Psychiatric Association launched a programme of research fellowships for early-career psychiatrists from low- or lower-middle income countries, within this programme, the author was selected to a research fellowship at the Centre for Youth Mental Health/Orygen Youth Health Research Centre at University of Melbourne. Orygen, is the world’s leading research and knowledge translation organization focusing on mental ill-health in young people. The traineeship was based on Early Psychosis Prevention and Intervention Centre (EPPIC), which is part of Orygen. EPPIC provides comprehensive, integrated, community-based treatment program for first-episode psychosis. This dissertation describes the EPPIC model, and its core components and factors which are necessary to a right service implementation. Additionally, a proposal to establish a pilot early psychosis intervention programme is discussed. This programme includes an innovative outreach programme that combines sound business principals with social goals in order to specifically target the largest barrier to early psychosis treatment in Bolivia: the stigma of mental illness. By utilizing a mobile, multidisciplinary treatment team that emphasizes the roles of trained case managers focused on providing intensive individual and family support in the home, this programme will provide culturally appropriate care that will leverage contributions from a limited supply of psychiatrists and shift dependence away from a fragmented medical system.

Protocol for the psychotherapeutic group intervention for facilitating posttraumatic growth in nonmetastatic breast cancer patients

Breast cancer can be perceived as a traumatic event with disturbing effects on psychological domains such as depression, anxiety, and Posttraumatic Stress Disorder. In contrast, growing evidence has shown that posttraumatic growth can occur as a result of coping with breast cancer. Challenging the assumptive world, deliberate rumination, and emotional disclosure are recognized as strong predictors of posttraumatic growth. Group interventions may also increase social support, distress disclosure, and posttraumatic growth. The aim of this study is to evaluate how group-based interventions can facilitate posttraumatic growth and promote improved psychosocial adjustment to breast cancer. This article describes the study protocol and the applied research methods.

Essays in health economics: Volume-Outcome Effect, upcoding behaviour and the evaluation of a short-term intervention program

Evidence in the literature suggests a negative relationship between volume of medical procedures and mortality rates in the health care sector. In general, high-volume hospitals appear to achieve lower mortality rates, although considerable variation exists. However, most studies focus on US hospitals, which face different incentives than hospitals in a National Health Service (NHS). In order to add to the literature, this study aims to understand what happens in a NHS. Results reveal a statistically significant correlation between volume of procedures and better outcomes for the following medical procedures: cerebral infarction, respiratory infections, circulatory disorders with AMI, bowel procedures, cirrhosis, and hip and femur procedures. The effect is explained with the practice-makes-perfect hypothesis through static effects of scale with little evidence of learning-by-doing. The centralization of those medical procedures is recommended given that this policy would save a considerable number of lives (reduction of 12% in deaths for cerebral infarction).

Reinvigorating and redesigning early intervention in psychosis services for young people in Auckland

RESUMO: Auckland tem sido pioneira na implementação de modelos de Intervenção Precoce em Psicose. No entanto, esta organização do serviço não mudou nos últimos 19 anos. Segundo os dados obtidos da utilização do serviço, no período de 1996 -2012 foram atendidos 997 doentes, que tinham um número médio de 89 contactos (IQR: 36-184), com uma duração média de 62 horas de contactos (IQR: 24-136). Estes doentes passaram um número médio de 338 dias (IQR: 93-757) em contacto com o programa. 517 doentes (52%) não necessitaram de internamento no hospital, e os que foram internados, ficaram uma mediana de 124 dias no hospital (IQR: 40-380). Os doentes asiáticos tiveram um aumento de 50% de probabilidade de serem internados no hospital. Este relatório inclui 15 recomendações para orientar as reformas para o serviço e, nomeadamente, delinear a importância de uma visão organizacional e dos seus componentes-chave. As recomendações incluem o reforço da gestão e da liderança numa estrutura de equipe mais integrada, com recursos dedicados a melhorar a consciencialização da comunidade, a educação e deteção precoce, bem como a capacidade de receber referenciações diretas. Os Indicadores Chave de Desempenho devem ser estabelecidos, mas os Exames de Estado Mental em risco, devem ser removidos. Auckland deve manter a faixa etária alvo atual. A duração do serviço deve ser aumentada para um mínimo de três anos, com a opção de aumentá-la para cinco anos. A proporção de gestor de cuidados para os doentes deve ser preconizada em 1:15, enquanto o pessoal de apoio não-clínico deve ser aumentado. Os psiquiatras devem ter uma carga de trabalho de cerca de 80 doentes por equivalente de tempo completo. Um serviço local de prestação de cuidados deve ser desenvolvido com, nomeadamente, intervenções culturais para responder às necessidades da população multicultural de Auckland. A capacidade de investigação deve ser incorporada no Serviço de Intervenção Precoce em Psicoses. Qualquer alteração deverá envolver contacto com todas as partes interessadas, e a Administração Regional de Saúde deve comprometer-se em tempo, recursos humanos e políticos para apoiar e facilitar a mudança do sistema, investindo de forma significativa para melhor servir a comunidade Auckland.----------------------------------- ABSTRACT: Auckland has been pioneering in the adoption of Early Intervention in Psychosis models but the design of the service has not changed in 19 years. In service utilisation data from 997 patients seen from 1996 -2012, patients had a median number of 89 contacts (IQR: 36-184), with a median duration of 62 hours of contact (IQR: 24-136). Patients spent a median number of 338 days (IQR: 93-757) in contact with the program. 517 patients (52%) did not require admission to hospital, and those who did spent a median of 124 days in hospital (IQR: 40-380). Asian patients had a 50% increased chance of being admitted to hospital. This report includes 15 recommendations to guide reforms to the service, including outlining the importance of vision and key components. It recommends strengthened managerial leadership and a more integrated team structure with dedicated resources for improved community awareness, education and early detection as well as the capacity to take direct referrals. Key Performance Indicators (KPIs) should be established but At Risk Mental States should be excluded. Auckland should maintain the current target age range. The duration of service should be increased to a minimum of three years, with the option to extend this to five years. The ratio of care co-ordinator to patients should be capped at 1:15 whilst non-clinical supporting staff should be increased. Psychiatrists should have a caseload of about 80 per FTE. A local Service Delivery framework should be developed, as should cultural interventions to meet the needs of the multicultural population of Auckland. Research capacity should be incorporated into the fabric of Early Intervention in Psychosis Services. Any changes should involve consultation with all stakeholders, and the DHB should commit to investing time, human and political resources to support and facilitate meaningful system change to best serve the Auckland community.

Social impact bond feasibility study AEIPS intervention

AEIPS is a Portuguese social organization promoting the integration of people with mental health illnesses and/or substance abuse in the community through the intervention model Housing First. The philosophy of Housing First aims at lifting people out of their homelessness status by providing instant access to individualized and permanent housing as well as support services. Housing First projects from all over the world have proved very positive results in terms of residential stability and community integration of its participants. This feasibility study evaluates the suitability of using a Social Impact Bond to fund the Housing First intervention of AEIPS in Portugal.

Updating of the hierarchical rock mass rating (HRMR) system and a new subsystem developed for weathered granite formations

The RMR system is still very much applied in rock mechanics engineering context. It is based on the evaluation of six weights to obtain a final rating. To obtain the final rating a considerable amount of information is needed concerning the rock mass which can be difficult to obtain in some projects or project stages at least with accuracy. In 2007 an alternative classification scheme based on the RMR, the Hierarchical Rock Mass Rating (HRMR) was presented. The main feature of this system was the adaptation to the level of knowledge existent about the rock mass to obtain the classification of the rock mass since it followed a decision tree approach. However, the HRMR was only valid for hard rock granites with low fracturing degrees. In this work, the database was enlarged with approximately 40% more cases considering other types of granite rock masses including weathered granites and based on this increased database the system was updated. Granite formations existent in the north of Portugal including Porto city are predominantly granites. Some years ago a light rail infrastructure was built in the city of Porto and surrounding municipalities whi h involved considerable challenges due to the high heterogeneity levels of the granite formations and the difficulties involved in their geomechanical characterization. In this work it is intended to provide also a contribution to improve the characterization of these formations with special emphasis to the weathered horizons. A specific subsystem applicable to the weathered formations was developed. The results of the validation of these systems are presented and show acceptable performances in identifying the correct class using less information than with the RMR system.

Psychological intervention in Portuguese college students: effects of two career self-management seminars

This article describes the evaluation of a psychological intervention—the Career Self-Management Seminar, Version A, for undergraduate students, and Version B for postgraduate students—developed to support Portuguese college students in career exploration, goal setting, design and implementation of action plans, and decision-making. A total of 120 participants from CSMS-A (experimental group, n = 58; control group, n = 62) and 98 from CSMS-B (experimental group, n = 62; control group, n = 36) were assessed by the Career Exploration Survey according to a pretest and posttest plan. Results demonstrate a significant increase in most of the cognitive, behavioral, and affective career exploration dimensions among the CSMS-A and CSMS-B experimental groups.

Mothers' beliefs concerning severity and need for intervention in child maltreatment

Dissertação de mestrado integrado em Psicologia Clínica e da Saúde

Intervention program on adolescent’s creativity representations and academic motivation

Creativity and its promotion are widespread concerns in education. However, few efforts have been made to implement intervention programs designed to promote creativity and other related aspects (e.g., academic motivation). The Future Problem Solving Program International (FPSPI), aimed for training creativity representations and creative problem solving skills in young people, has been one of the most implemented programs. This intervention’s materials and activities were adapted for Portuguese students, and a longitudinal study was conducted. The program was implemented during four months, in weekly sessions, by thirteen teachers. Teachers received previous training for the program and during the program’s implementation. Intervention participants included 77 Basic and Secondary Education students, and control participants included 78 equivalent students. Pretest-posttest measures of academic motivation and creativity representations were collected. Results suggest a significant increase, in the intervention group, in motivation and the appropriate representations of creativity. Practical implications and future research perspectives are presented.

[Letter to the editor] Sustained effects of a neural-based intervention in a refractory case of Tourette syndrome

There are only a few treatments available for Tourette syndrome (TS). These treatments frequently do notwork in patients with moderate to severe TS [1]. Neuroimaging studies show a correlation between tics severity and increased activation over motor pathways, along with reduced activation over the control areas of the cortico-striato-thalamo-cortical circuits [2]. Moreover, the temporal pattern of tic generation suggests that cortical activation especially in the SMA precedes subcortical activation [3]. Following this assumption, here we explored the brain effects of 10-daily sessions of cathodal transcranial Direct Current Stimulation (tDCS) delivered over the pre-SMA in a patient with refractory and severe TS and also assessed whether those changes were long lasting (up to 6 months).

Multiphasic, multistructured and hierarchical strategies for cartilage regeneration

Cartilage tissue is a complex nonlinear, viscoelastic, anisotropic, and multiphasic material with a very low coefficient of friction, which allows to withstand millions of cycles of joint loading over decades of wear. Upon damage, cartilage tissue has a low self-reparative capacity due to the lack of neural connections, vascularization, and a latent pool of stem/chondroprogenitor cells. Therefore, the healing of articular cartilage defects remains a significant clinical challenge, affecting millions of people worldwide. A plethora of biomaterials have been proposed to fabricate devices for cartilage regeneration, assuming a wide range of forms and structures, such as sponges, hydrogels, capsules, fibers, and microparticles. In common, the fabricated devices were designed taking in consideration that to fully achieve the regeneration of functional cartilage it is mandatory a well-orchestrated interplay of biomechanical properties, unique hierarchical structures, extracellular matrix (ECM), and bioactive factors. In fact, the main challenge in cartilage tissue engineering is to design an engineered device able to mimic the highly organized zonal architecture of articular cartilage, specifically its spatiomechanical properties and ECM composition, while inducing chondrogenesis, either by the proliferation of chondrocytes or by stimulating the chondrogenic differentiation  of stem/chondro-progenitor cells. In this chapter we present the recent advances in the development of innovative and complex biomaterials that fulfill the required structural key elements for cartilage regeneration. In particular, multiphasic, multiscale, multilayered, and hierarchical strategies composed by single or multiple biomaterials combined in a welldefined structure will be addressed. Those strategies include biomimetic scaffolds mimicking the structure of articular cartilage or engineered scaffolds as models of research to fully understand the biological mechanisms that influence the regeneration of cartilage tissue.

Nonlinear behavior of gelatin networks reveals a hierarchical structure

We investigate the strain hardening behavior of various gelatin networks-namely physical gelatin gel, chemically cross-linked gelatin gel, and a hybrid gel made of a combination of the former two-under large shear deformations using the pre-stress, strain ramp, and large amplitude oscillations shear protocols. Further, the internal structures of physical gelatin gels and chemically cross-linked gelatin gels were characterized by small angle neutron scattering (SANS) to enable their internal structures to be correlated with their nonlinear rheology. The Kratky plots of SANS data demonstrate the presence of small cross-linked aggregates within the chemically cross-linked network whereas, in the physical gelatin gels, a relatively homogeneous structure is observed. Through model fitting to the scattering data, we were able to obtain structural parameters, such as the correlation length (ξ), the cross-sectional polymer chain radius (Rc) and the fractal dimension (df) of the gel networks. The fractal dimension df obtained from the SANS data of the physical and chemically cross-linked gels is 1.31 and 1.53, respectively. These values are in excellent agreement with the ones obtained from a generalized nonlinear elastic theory that has been used to fit the stress-strain curves. The chemical cross-linking that generates coils and aggregates hinders the free stretching of the triple helix bundles in the physical gels.