Hierarchical Reinforcement Learning in Behavior and the Brain

Dissertation presented to obtain the Ph.D degree in Biology, Neuroscience

Preliminary study of the acoustic behavior concerning an innovative prototype for indoor modular partitioning

This paper presents a preliminary acoustic study concerning the development of the first prototype of a patented removable module for interior partitioning. It is a prefabricated, vertical element for division of interior spaces that does not require the use of gutters or technical support. A set of such modules, linearly disposed, will create a division, allowing the personalization of any indoor area, including open office spaces, rooms, among others. The main characteristic that distinguishes this element from the existing solutions available on the market is that its mobility relies exclusively on a set of integrated bearings at the base of each module. Through an incorporated elevation system, the user can lower the module, move it to the desired position and re-elevate it until pressed against the ledge of the ceiling, making it stable. In this sense, and taking into account its acoustic behavior, several tests were made in the LNEC acoustics lab. Airborne sound insulation tests for different typologies of the prototype were conducted, according to the applicable standards EN ISO 354:2003, EN ISO 717-1:2013 and EN ISO 10140-2:2010. Some important conclusions and analysis of the prototype viability were extracted.

As imagens do envelhecimento e as práticas idadistas em Cuidados de Saúde Primários: implicações na actividade física dos idosos

RESUMO: O envelhecimento demográfico tem vindo a aumentar em todo o mundo. Porém, constata-se que os últimos anos de vida são, frequentemente, acompanhados de situações de incapacidade que poderiam ter sido prevenidas. Apesar da importância da actividade física na saúde, verifica-se que uma grande proporção de idosos são sedentários, aumentando o risco de incapacidade. Os profissionais de saúde podem ser influenciados por imagens negativas relativas ao envelhecimento. Tal pode conduzir a práticas de discriminação, com repercussão na forma como os idosos se vêem a si próprios e, consequentemente, no seu comportamento na prática de actividade física. Este estudo tem como objectivo analisar o modo como as imagens do envelhecimento e dos idosos, bem como as práticas idadistas percebidas pelos idosos no contacto com profissionais de saúde influenciam a sua prática de actividade física. Realizou-se um estudo qualitativo, com recurso à entrevista semi-estruturada e de associação livre das palavras, sendo entrevistados 18 utentes que recorreram a um Centro de Saúde. Pelos resultados, constatou-se que uma parte considerável dos participantes (n=8) mencionou que a forma como são vistos pelos profissionais de saúde e como estes lidam consigo influencia a sua prática de actividade física. A imagem mais referida como favorecendo esta prática foi o facto de se considerarem pessoas com vontade de viver. Como principal prática favorecedora identificou-se o aconselhamento/educação para a saúde. A imagem mais mencionada como dificultando a actividade física foi a de os idosos serem deprimidos/tristes/aborrecidos e rabugentos/teimosos. As práticas mais identificadas como dificultando a actividade física foram: o desinteresse face aos problemas de saúde; o não encaminhamento para intervenções adequadas às necessidades; a indicação de que o problema de saúde é devido à idade, não o sendo; a postura autoritária em que só o profissional decide a opção terapêutica; e a verbalização de que o utente já tem muita idade para realizar uma actividade. Conclui-se que as imagens negativas do envelhecimento e dos idosos bem como a existência de práticas idadistas por parte dos profissionais de saúde, condicionam de forma negativa a prática de actividade física nos idosos.---------------ABSTRACT: The aging population has been increasing around the world. However, it appears that the last years of life are often accompanied by situations of disability, which could have been prevented. Despite the importance of physical activity on health, it appears that a large proportion of elderly people are sedentary, increasing the risk of disability. Health professionals may be influenced by negative images related to aging and that may lead to discriminatory practices with repercussion in how older people see themselves and thus their behavior as related to physical activity. This study aims to examine how the images concerning aging and older people, as well as ageist practices perceived by older people in contact with health professionals, do influence their physical activity. A qualitative study was conducted using a semi-structured interview and techniques of free word association. Eighteen primary care elderly users were interviewed. A considerable proportion of the sample (n=8) mentioned that the way health professionals see them and deal with them influences their level of physical activity. The image that most favoured this practice was that people are willing to live. Counseling/health education was identified as the main favouring practice. The image which was most often mentioned as hindering physical activity was that of elderly as being depressed, sad or bored, and grumpy or stubborn.The practices most often identified as hindering physical activity were: lack of interest regarding health problems; non-referral to appropriate intervention needs; indicating that the health problem is due to age, not being the case; authoritarian professional attitudes regarding who decides the treatment options; verbalization that the user is already to old to perform an activity. This study concludes that the negative images of aging and older people as well the existence of ageist practices by health professionals negatively affect the practice of physical activity in the elderly.

Study of the electromyographic signal dynamic behavior in Amyotrophic Lateral Sclerosis (ALS)

Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disease characterized by motor neurons degeneration, which reduces muscular force, being very difficult to diagnose. Mathematical methods are used in order to analyze the surface electromiographic signal’s dynamic behavior (Fractal Dimension (FD) and Multiscale Entropy (MSE)), evaluate different muscle group’s synchronization (Coherence and Phase Locking Factor (PLF)) and to evaluate the signal’s complexity (Lempel-Ziv (LZ) techniques and Detrended Fluctuation Analysis (DFA)). Surface electromiographic signal acquisitions were performed in upper limb muscles, being the analysis executed for instants of contraction for ipsilateral acquisitions for patients and control groups. Results from LZ, DFA and MSE analysis present capability to distinguish between the patient group and the control group, whereas coherence, PLF and FD algorithms present results very similar for both groups. LZ, DFA and MSE algorithms appear then to be a good measure of corticospinal pathways integrity. A classification algorithm was applied to the results in combination with extracted features from the surface electromiographic signal, with an accuracy percentage higher than 70% for 118 combinations for at least one classifier. The classification results demonstrate capability to distinguish members between patients and control groups. These results can demonstrate a major importance in the disease diagnose, once surface electromyography (sEMG) may be used as an auxiliary diagnose method.

A matter of time: Phases of customer co-creation community participation and their impact on customer behavior

Despite the growing relevance of co-creating customer communities only little scientific evidence is available on their impact on transactional behavior of participants. Previous research has mostly used self-reported data or distinguished only between during and pre-community phases obtaining mixed results. However, the author proposes that co-creating community activity takes place in five distinguishable phases and changes in transactional behavior are limited to certain phases. Using 33 months of transactional data of a Dutch online auction provider a study was conducted covering all five phases of the community co-creation process from community planning over community set-up, co-development and co-testing to post-launch. The overall results indicate mixed effects of community participation on the different transactional variables during the co-creation process. Community participation had positive effects on auctions listing behavior at the community set-up, co-development and post-launch phases, whereby the number of auctions listed peaked during the community set-up phase. These results suggest that the impact on transactional behavior differs between co-creation phases and different psychological mechanism limited to certain phases might trigger the respective changes.

The effect of ownership concentration on management behavior in Belgian banks: A case study

Double Degree. A Work Project, presented as part of the requirements for the Award of a Master’s Degree in Finance from NOVA – School of Business and Economics and a Masters Degree in Management from Louvain School of Management

Online consumer behavior: The tablet shopper – A new kind of customer?

Tablet computers are on the rise and are increasingly superseding stationary computers in terms of modern online shopping. This paper therefore aims on understanding how tablet and website characteristics might impact online consumer behavior. The collected data resulted from focus groups and in-depth interviews conducted with a technology affine audience. It has shown that tablets indeed may have shifted shopping behavior from utilitarian towards rather recreational attributes. Discussions also revealed high customer expectations towards visited shopping websites and prevailing deficits. Thus, harnessing the concept of experiential flow is crucial. Compelling experiences are required to increase the duration of stay and consequently the likelihood of increased purchases.

Ethical leadership and unethical pro-organizational behavior: A moderated mediation model of affective commitment and authenticity at work

Recently, unethical conduct in the workplace has been a focus of literature and media. Unethical pro-organizational behavior (UPB) refers to unethical conduct that employees engage in to benefit the organization. Given the complexity of UPB, there is an increasing need to understand how and under what conditions this attitude originates within organizations. Based on a sample of 167 employees and seven organizations, results support the moderated mediation model. An ethical leader increases employees’ organizational affective commitment which increases the likelihood to engage in UPB. However, the indirect relationship diminishes when employees feel authentic at work.

Consumer behavior: Online grocery shopping in Portugal

Living in the digital era, activities that have for centuries acted one way, have now changed and entered the online world, and online grocery shopping is one of them. It is a worldwide phenomenon and is already a significant part of people’s lifestyle in several countries however, in Portugal, it is still in expansion and improvement. Based on the Theory of Planned Behavior, this study allowed to estimate how the perceived risk and shopping orientation counterbalances the convenience offered to consumers. Furthermore, it validated how usability and access to focused promotions can help speed up this adaptation in Portugal

Basel III new capital requirements, impacts and bank behavior

For some years, researchers could not find a clear effect of capital adequacy on the risk profile of banks, as shareholders could increase the riskiness of the assets (qualitative effect), crowding-out the effect of reduced leverage (volume effect). Some shareholders might have the will to increase the riskiness of the assets, but they may lack the power to do so. Considering only ”powerful” shareholders, definitive conclusions were drawn but with constant ownership profile. In this paper I investigate whether there is a significant change in the type of shareholders in response to regulatory capital shocks and, if so, will the banking system be in the hands of more “desired” shareholders. I find that ownership profile responds to a regulatory shock, changing the risk appetite of the ruling power at the bank. I find more banks and the government in the ownership of undercapitalised banks and much less institutional shareholders and free float. I claim that these new shareholders may not the desired ones, given the objective of the regulatory change, as they are associated with a preference for more leverage. One possible explanation for this crowding-out effect is that regulators are trying to contain idiosyncratic risk (more linked to the riskiness of the assets) with a rule that contains systematic risk (capital adequacy). This has a distorting effect on ownership. Another insight can be drawn from the tests: supervisors should be aware of significant ownership movements that cause the crowding-out.

Fiscal dynamics and electoral behavior in the Eurozone

Abstract: The Stability Growth Pact and the 3% rule did not prevent countries from running large deficits. Countries in the EMU administrate fiscal policies differently, despite the existence of a common quantitative goal. The main focus of this work project is to study differences in the fiscal dynamics of eight EMU countries and assess the role of political variables in shaping those dynamics. We find that elections negatively affect government revenue in Austria, Belgium, Portugal, Spain and Germany. Expenditure, on the other hand, responds positively to incoming elections in Portugal, Italy, France and Netherlands, and negatively in the case of Germany.

A doença pulmonar obstrutiva crónica e o exercício: impacto da doença no declínio funcional e importância do treino de exercício nos benefícios para a saúde

RESUMO: A reabilitação respiratória (RR) é uma intervenção abrangente e interdisciplinar dirigida aos doentes respiratórios crónicos e inclui o treino de exercício, programas de educação e de modificação comportamental, entre outros, desenhados individualmente para melhorar o desempenho físico e psicossocial e promover a adesão a longo prazo a comportamentos promotores de saúde. A doença pulmonar obstrutiva crónica (DPOC) é uma doença comum, afetando cerca de 210 milhões de pessoas em todo o mundo, com elevada mortalidade e com custos económicos significativos decorrentes do agravamento progressivo da doença, das hospitalizações e de reinternamentos frequentes. Apesar do crescente conhecimento da DPOC e do papel da RR nos benefícios para a saúde, existem aspetos ainda não esclarecidos que têm impacto na prática clínica e de investigação e nas decisões das autoridades de saúde. A primeira parte desta tese focou a DPOC e o seu impacto negativo e incluiu: o estudo da prevalência da DPOC em Portugal; os fatores clínicos e funcionais que se associam à mortalidade em doentes com DPOC avançada; a morbilidade, impacto funcional e risco dos doentes se tornarem dependentes para as atividades diárias e a influência da inflamação sistémica. A prevalência estimada da DPOC de 14,2% indica que esta é uma doença comum em Portugal e alerta para a necessidade de uma maior sensibilização da população, dos profissionais de saúde e autoridades de saúde com vista a um diagnóstico precoce e à alocação dos recursos terapêuticos adequados. A elevada taxa de mortalidade em doentes com DPOC avançada - 36,6% em 3 anos - associou-se a insuficiência respiratória, a elevado número de exacerbações, ao cancro do pulmão e a reduzida capacidade funcional para a marcha, salientando a importância da referenciação precoce para RR, a identificação e o tratamento das comorbilidades e a prevenção das exacerbações. A aplicação de um questionário que avaliou as atividades da vida diária básicas e instrumentais, permitiu identificar um marcador clínico do risco de dependência, complementando as avaliações funcionais e associando-se a outros marcadores de mau prognóstico, como as exacerbações. Em doentes com DPOC, com FEV1 médio de 46,76% (desvio padrão: 20,90%), 67% da categoria D do GOLD, verificou-se uma associação positiva entre a expressão de genes inflamatórios avaliada pela reação em cadeia da polimerase (ARN mensageiro de IFNg, IL1b, IL6, IL8, TNFa, TGFb1, iNOS) e o índice de massa corporal em repouso, acentuando-se após o exercício. Este estudo aponta a inflamação como o potencial elo de ligação entre a obesidade e a inflamação sistémica em doentes com DPOC. A segunda parte da tese focou a RR, nomeadamente os seus efeitos em doentes das categorias GOLD A, B, C e D; o impacto das comorbilidades nos resultados da RR e os resultados de diferentes intensidades de treino aeróbio. Após o programa de RR, verificaram-se melhorias significativas na capacidade de exercício funcional e de endurance e no estado geral de saúde dos doentes de todas as categorias GOLD. Esta classificação não distingue os doentes que melhor poderão beneficiar desta intervenção, indicando que devem ser referenciados para RR, os doentes sintomáticos ou com repercussão na qualidade de vida, independentemente da categoria da DPOC a que pertençam. A prevalência das comorbilidades no grupo de doentes com DPOC que é referenciado para RR, é elevada, sendo as mais frequentes, as cardiovasculares, as respiratórias e as psicológicas. Apesar de poderem diminuir o impacto da RR, os resultados desta foram semelhantes independentemente do número de comorbilidades. A identificação e o tratamento sistemáticos das comorbilidades conferem maior segurança clínica a esta intervenção terapêutica a qual, por apresentar bons resultados, não deve limitar a referenciação dos doentes. Com o programa de RR, verificou-se melhoria significativa em todos os resultados centrados no doente para ambas as intensidades de treino aeróbio, a 60% e a 80% da potência aeróbica máxima (Wmax), com melhoria do estado geral de saúde, nos sintomas e na capacidade para o exercício, o que questiona a indicação sistemática de elevadas intensidades de treino em doentes com DPOC para a obtenção de benefícios a curto prazo. Na terceira e última parte da tese foi estudado o papel da atividade física na DPOC, focando os fatores que influenciam a atividade física diária; a evolução da capacidade funcional e o estado de saúde 2 anos após um programa de RR e o papel da telemonitorização na quantificação e monitorização da atividade física. Confirmámos que os doentes com DPOC são marcadamente sedentários e os fatores que se associaram ao sedentarismo nestes doentes foram a dispneia e a distância percorrida na prova de marcha de seis minutos. Este estudo sublinha a importância do controlo sintomático, nomeadamente da dispneia, bem como, mais uma vez, o potencial papel da reabilitação respiratória no aumento da capacidade funcional para o exercício e na aquisição de hábitos de vida fisicamente ativa. Verificámos que, apesar de os doentes com DPOC apresentarem benefícios clinicamente significativos na capacidade funcional para o exercício e no estado geral de saúde com o programa de RR, apenas os que se mantêm ativos, podem, no final dos dois anos de seguimento, manter os efeitos benéficos desse programa. O sistema de telemonitorização que combina a oximetria e a quantificação da atividade física provou ser clinicamente útil na avaliação da necessidade de oxigenoterapia de longa duração (OLD) e na aferição do débito de oxigénio em repouso, no esforço e no sono, podendo contribuir para uma melhor adequação da prescrição da OLD. A monitorização dos níveis de atividade física regular é um importante instrumento de avaliação dos programas de RR e o seu uso potencial na telereabilitação permitirá prolongar a eficácia dos programas e reduzir os custos associados aos cuidados de saúde.---------------------------------------------------------------------------------------------------ABSTRACT: Pulmonary rehabilitation (PR) is a comprehensive interdisciplinary intervention that includes, but is not limited to, exercise training, education, and behavior change, individually designed to improve physical and psychological conditions of people with chronic respiratory disease and to promote long-term adherence to health-enhancing behaviors. Chronic obstructive pulmonary disease (COPD) is a common disease, affecting about 210 million people worldwide, with high mortality and significant health-related costs due to disease progression, hospitalizations and frequent hospital readmissions. Although the increasing knowledge about COPD and benefitial outcomes of PR, some aspects with impact in clinical practice, research and health authorities’ decisions, remain to be clarified. The first part of this thesis focused on COPD and its negative impact, including the study of COPD prevalence in Portugal; clinical and functional factors associated with mortality in advanced COPD patients; morbidity, functional impact and risk of others’ dependance to perform activities of daily living; and the role of systemic inflammation. The evidence of 14.2% estimated COPD prevalence as a common disease in Portugal raises the need of an increasing awareness of population, health care professionals and health authorities towards an earlier diagnosis and apropriate treatment resources allocation. High mortality in patients with advanced COPD – 36.6% in 3 years - was associated with respiratory failure, high frequency of exacerbations, lung cancer and a low functional capacity in walking. This highlightens the importance of an earlier referral to PR, comorbidity identification and treatment, and prevention of exacerbations. A questionnaire evaluated basic and instrumental activities of daily living, and identified a clinical marker of the risk of becoming dependent. This clinical marker complemented other functional evaluations and was associated with prognosis markers such as the number of exacerbations. In COPD patients with a mean FEV1 46.76% (SD 20.90%), 67% belonging to GOLD grade D, we found a positive association between inflammatory gene expression evaluated by polymerase chain reaction (IFNg, IL1b, IL6, IL8, TNFa, TGFb1, iNOS RNA messenger) and body mass index at rest, and a further increase with exercise. This study evidenced obesity as one potential link between COPD and systemic inflammation. The second part of this thesis focused PR, namely its outcomes in patients of GOLD categories A, B, C and D; comorbidities impact in PR outcomes, and the impact of different exercise training intensities in patient related outcomes. xviii With PR intervention, we found significant improvement in functional exercise capacity, endurance exercise capacity and health status in patients of all GOLD categories. This classification did not differentiate which patients would benefit more from PR, hence all symptomatic patients with a negative impact in health status should be referred to PR, regardless of the GOLD category they belong to. There is a high prevalence of comorbidities in COPD patients referred to PR, being cardiovascular, respiratory and psychological, the most prevalent. Although some comorbidities might reduce PR impact, the results were similar regardless of the number of comorbidities. Systematic comorbidities identification and treatment provides safety to PR intervention, and its good results should not preclude patients referral. With PR intervention we found a significant improvement in all patient reported outcomes for exercise training intensities at 60% and 80% maximum work rate (Wmax), namely in health status, symptoms and exercise capacity. These findings challenge the current systematic indication of high exercise training intensities to achieve PR short-term benefits. In the third and last part of the thesis, the role of physical activity in COPD was studied, focusing factors that may influence daily physical activity; the evolution of functional capacity and health status two years after a PR program, and the role of a telemonitoring system in physical activity quantification and monitoring. We confirmed that COPD patients are markedly inactive and factors associated with a sedentary lifestyle are dyspnea and 6 minute walking distance. This study emphasized the importance of symptom control, namely of dyspnea, as well as, once again, the potential role of PR in functional exercise improvement and in integrating physically active habits in daily life. We verified that, although COPD patients improve functional exercise capacity and health status after a PR program, only those who kept physical activity habits were able to maintain those effects after 2 years of follow-up. A telemonitoring system that combines oximetry and physical activity quantification proved to be clinically useful in the evaluation of long-term oxygen therapy (LTOT) indication, as well as in the titration of oxygen levels at rest, exertion, and sleeping, which might contribute to a more adequate LTOT prescription. Monitoring of daily physical activity levels is an important PR evaluation instrument and its potential use in telerehabilitation might allow lengthening programs efficacy, while reducing health-care costs.