Using online peer assessment tools to provide feedback and promote learning

A set of slides used for the RAP SIG event on 19 Jan 2017

New perspectives on A.I. in sentencing. Human decision-making between risk assessment tools and protection of humans rights.

The aim of this thesis is to investigate a field that until a few years ago was foreign to and distant from the penal system. The purpose of this undertaking is to account for the role that technology could plays in the Italian Criminal Law system. More specifically, this thesis attempts to scrutinize a very intricate phase of adjudication. After deciding on the type of an individual's liability, a judge must decide on the severity of the penalty. This type of decision implies a prognostic assessment that looks to the future. It is precisely in this field and in prognostic assessments that, as has already been anticipated in the United, instruments and processes are inserted in the pre-trial but also in the decision-making phase. In this contribution, we attempt to describe the current state of this field, trying, as a matter of method, to select the most relevant or most used tools. Using comparative and qualitative methods, the uses of some of these instruments in the supranational legal system are analyzed. Focusing attention on the Italian system, an attempt was made to investigate the nature of the element of an individual's ‘social dangerousness’ (pericolosità sociale) and capacity to commit offences, types of assessments that are fundamental in our system because they are part of various types of decisions, including the choice of the best sanctioning treatment. It was decided to turn our attention to this latter field because it is believed that the judge does not always have the time, the means and the ability to assess all the elements of a subject and identify the best 'individualizing' treatment in order to fully realize the function of Article 27, paragraph 3 of the Constitution.

Concepts and tools for comprehensive sustainability assessments for tourism destinations: a comparative review

This paper reviews a wide range of tools for comprehensive sustainability assessments at whole tourism destinations, covering socio-cultural, economic and environmental issues. It considers their strengths, weaknesses and site specific applicability. It is intended to facilitate their selection (and combination where necessary). Tools covered include Sustainability Indicators, Environmental Impact Assessment, Life Cycle Assessment, Environmental Audits, Ecological Footprints, Multi-Criteria Analysis and Adaptive Environmental Assessment. Guidelines for evaluating their suitability for specific sites and situations are given as well as examples of their use.

Needs assessment of people with severe mental illnesses and their families in Azerbaijan

RESUMO: Os indivíduos com doença mental grave, assim como os seus familiares, podem ser caracterizados como uma população em que ocorre uma combinação complexa de necessidades médicas e psicossociais, nomeadamente a nível do diagnóstico e do acesso aos serviços de saúde mental. A avaliação de necessidades pode fornecer informações importantes para o desenvolvimento de intervenções eficazes, tanto a nível da população como a nível individual. Este estudo teve como objetivo determinar as diferentes necessidades reportadas pelos pacientes com doença mental grave e seus familiares , assim como investigar as possíveis relações entre o estado de necessidades e as variáveis sócio-demográficas e clínicas. Simultaneamente, o estudo teve como objetivo avaliar a sobrecarga familiar e a satisfação dos utentes com os serviços de saúde mental. Foi elaborado um estudo transversal, realizado numa amostra de conveniência de cinquenta díades de paciente/membro da família, seguidos em regime de ambulatório no Centro Nacional de Saúde Mental. Foram utilizados como instrumentos de avaliação um questionário sociodemográfico, a Escala Breve de Avaliação Psiquiátrica (BPRS), o questionário de Avaliação de Necessidades de Camberwell (CAN), o Questionário de Avaliação do Envolvimento (IEQ) e a Escala de Verona de Satisfação com os Serviços (VSSS). As mais frequentes necessidades não-satisfeitas foram o ‘sofrimento psicológico’, as ‘atividades sociais’ e os ‘benefícios sociais’. O estudo mostrou uma sobrecarga significativa nas famílias que cuidam de pessoas com doença mental grave, que se correlacionou com as suas opiniões sobre as necessidades dos pacientes e teve um impacto negativo sobre o bem-estar psicológico. Os três mais importantes predictores de sofrimento psíquico em familiares foram o sexo, a situação laboral e a relação com o paciente. A avaliação da satisfação com os serviços revelou a existência de um hiato significativo entre os serviços prestados e os serviços desejados, reportados pelos pacientes e seus familiares. A maioria dos participantes do estudo desejavam ter um trabalho protegido, ou receber ajuda para encontrar emprego. Os resultados deste estudo poderão ser usados para fins de planeamento desenvolvimento e avaliação de serviços de saúde mental no Azerbeijão. Algumas recomendações sobre a melhoria dos serviços de saúde mental para pacientes com doença mental grave e suas famílias são feitas na secção final do trabalho.----------ABSTRACT: Patients suffering from severe mental illness, in addition to their family members, may be characterized as a population with a complex combination of medical and psychosocial needs, which are under-recognized and under-addressed by mental health services. At the same time, needs assessment provides important information necessary for developing effective interventions at both population and individual level. The study was aimed to determine various needs perceived by patients with SMI and their family members, as well as to find out possible relations between the needs and socio-demographic and clinical variables. Similarly the study was intended to evaluate family burden and users’ satisfaction with services. This was a cross-sectional study conducted on a convenience sample. Fifty dyads of a patient and family member applying for out-patient services to the National Mental Health Centre participated in the study. Sociodemographic questionnaire, Brief Psychiatric Rating Scale, Camberwell Assessment of Need, Involvement Evaluation Questionnaire, and Verona Service Satisfaction Scale were used as assessment tools. The most prominent unmet needs reported by people with SMI and their relatives were psychological distress, social activities and welfare benefits. The study showed significant burden in families caring for people with SMI, which correlated with their views about patients’ needs and had a negative impact on the psychological well-being. The three most important predictors of psychological distress in family members were gender, employment status and relationship to patient. Evaluation of satisfaction with services pointed out the gap between provided and desired services reported by patients and their relatives. Most of study participants wished to have sheltered work, or receive help in finding employment. The results of this study may be used for the purposes of mental health service planning, development and evaluation in our country. Some recommendations on improvement of mental health services for patients with SMI and their families have been made in the conclusion.

Support in decision-making under uncertainty: a project risk assessment tool development and supplementary advances

A foremost dispute that persists on the contemporary world’s agenda is change. The on-going social/technological/economic changes create a competitive and challenging environment for companies to endure. To benefit from these changes, world economies partially depend on emerging Small and Medium Enterprises (SMEs) and their adaptability skills, and subsequently the development of an integrated capability to innovate has become the prime strategy for most of SMEs to subsist and grow. However, innovation and change are always somewhat bonded to an inherent risk development, which subsequently brings on the necessity of a revision of risk management approaches in innovative processes, whose importance SMEs tend to disregard. Additionally, little efforts have been made to improve and create empirical models, metrics and tools to assist SMEs managing latent risks in their innovative projects. This work seeks to present and discuss a solution to support SMEs in engaging on systematic risk management practices, which consists on an integrated risk assessment and response support web-based tool - Spotrisk® - designed for SMEs. On the other hand, an inherent subjectivity is linked with risk management and identification processes, due to uncertainty trait of its nature, for each individual perceives situations according to his own idiosyncrasy, which brings complications in normalizing risk profiles and procedures. This essay aims to bring insights concerning the support in decision-making processes under uncertainty, by addressing issues related with the risk behavior character among individuals. To address such issues, subjects of neuroscience or psychology are explored and models to identify such character are proposed, as well as models to improve presented tool. This work attempts to go beyond the restrictive aim of endeavoring on technical improvement dissertation, and in embraces an exploratory conceptualization concerning micro, small and medium businesses’ traits regarding risk characters and project risk assessment tools.

Assessment by doppler ultrasound of entheseal lesions in spondyloarthritis : a longitudial study to determine structural damage and disease activity lesions

RESUMO: Enthesitis is the hallmark of spondyloarthritis (SpA), and is observed in all subtypes. Wide information on SpA abnormalities, including synovitis, tendinitis and enthesitis, can be efficiently perceived by Doppler ultrasound. Furthermore, several studies on imaging of enthesis showed that imaging techniques are better than clinical examination to detect enthesis alterations; and vascularized enthesitis detected by Doppler ultrasound appears to be a valuable diagnostic tool to confirm SpA diagnosis. However, data published until now concerning entheseal elementary alterations that characterize SpA enthesitis (enthesis inflammatory activity) or enthesopathy (permanent structural changes) reflect rather the authors’ empiric opinion than a methodological validation process. In this sense it seems crucial to identify elementary entheseal lesions associated with activity or damage, in order to improve monitoring and treatment response in SpA patients. The development of better assessment tools is today a challenge and a need in SpA. The first study of this thesis focused on the analysis of the reliability of inter-lector and inter-ultrasonography equipment of Madrid sonography enthesitis index (MASEI). Fundamental data for the remaining unrolling project validity. In the second and third studies we concerned about two entheseal elemental lesions: erosions and bursa. In literature erosions represent a permanent structural damage, being useful for monitoring joint injury, disease activity and therapeutic response in many rheumatic diseases; and to date, this concept has been mostly applied in rheumatoid arthritis (RA). Unquestionably, erosion is a tissue-related damage and a structural change. However, the hypothesis that we decided to test was if erosions represent a permanent structural change that can only grow and worsen over time, as occurs in RA, or a transitory alteration. A longitudinal study of early SpA patients was undertaken, and the Achilles enthesis was used as a model. Our results strongly suggested that previously detected erosions could disappear during the course of the disease, being consistent with the dynamic behavior of erosion over time. Based on these striking results it seems reasonable to suggest that the new-bone formation process in SpA could be associated with the resolution of cortical entheseal erosion over time. These results could also be in agreement with the apparent failure of anti-tumor necrosis factor (TNF) therapies to control bone proliferation in SpA; and with the relation of TNF-α, Dickkopf-related protein 1 (Dkk-1) and the regulatory molecule of the Wnt signaling pathway in the bone proliferation in SpA. In the same model, we then proceeded to study the enthesis bursa. Interestingly, the Outcome Measures in Rheumatology Clinical Trials (OMERACT) enthesopathy definition does not include bursa as an elementary entheseal lesion. Nonetheless, bursa was included in 46% of the enthesis studies in a recently systematic literature review, being in agreement with the concept of “synovio-entheseal complex” that includes the link between enthesitis and osteitis in SpA. It has been clarified in recent data that there is not only a close functional integration of the enthesis with the neighboring bone, but also a connection between enthesitis and synovitis. Therefore, we tried to assess the prevalence and relevance of the bursa-synovial lesion in SpA. Our findings showed a significant increase of Achilles bursa presence and thickness in SpA patients compared to controls (healthy/mechanical controls and RA controls). These results raise awareness to the need to improve the enthesopathy ultrasonographic definition. In the final work of this thesis, we have explored new perspectives, not previously reported, about construct validity of enthesis ultrasound as a possible activity outcome in SpA. We performed a longitudinal Achilles enthesis ultrasound study in patients with early SpA. Achilles ultrasound examinations were performed at baseline, six- and twelve-month time periods and compared with clinical outcome measures collected at basal visit. Our results showed that basal erythrocyte sedimentation rate (ESR) and C-reactive protein (CRP) are higher in patients with Doppler signal in enthesis, and even that higher basal ESR, CRP and Ankylosing Spondylitis Disease Activity Score (ASDAS) predicted a higher Doppler signal (an ultrasound alteration accepted as representative of inflammation) six months later. Patients with very high disease activity assessed by ASDAS (>3.5) at baseline had significantly higher Achilles total ultrasound score verified at the same time; and ASDAS <1.3 predicted no Doppler signal at six and twelve months. This seems to represent a connection between classical biomarkers and clinical outcomes associated with SpA activity and Doppler signal, not only at the same time, but also for the following months. Remarkably, patients with inactive disease (ASDAS < 1.3) at baseline had no Doppler signal at six and twelve months. These findings reinforce the potential use of ultrasound related techniques for disease progression assessment and prognosis purposes. Intriguingly, Ankylosing Spondylitis Disease Activity Index (BASDAI) didn’t show significant differences between different cut-offs concerning ultrasound lesions or Doppler signal, while verified with ASDAS. These results seem to indicate that ASDAS reflects better than BASDAI what happens in the enthesis. The work herein discussed clearly shows the potential utility of ultrasound in enthesis assessment in SpA patients, and can be important for the development of ultrasound activity and structural damage scores for diagnosis and monitoring purposes. Therefore, local promotion of this technique constitutes a medical intervention that is worth being tested in SpA patients for diagnosis, monitoring and prognosis purposes.

Analysis and selection of indicators for a sustainability assessment method for school buildings based on SBTool ‐ PT

Nowadays, the sustainability of buildings has an extreme importance. This concept goes towards the European aims of the Program Horizon 2020, which concerns about the reduction of the environmental impacts through such aspects as the energy efficiency and renewable technologies, among others. Sustainability is an extremely broad concept but, in this work, it is intended to include the concept of sustainability in buildings. Within the concept that aims the integration of environmental, social and economic levels towards the preservation of the planet and the integrity of the users, there are, currently, several types of tools of environmental certification that are applicable to the construction industry (LEED, BREEAM, DGNB, SBTool, among others). Within this context, it is highlighted the tool SBTool (Sustainable Building Tool) that is employed in several countries and can be subject to review in institutions of basic education, which are the base for the formation of the critical masses and for the development of a country. The main aim of this research is to select indicators that can be used in a methodology for sustainability assessment (SBTool) of school buildings in Portugal and in Brazil. In order to achieve it, it will also be analyzed other methodologies that already incorporate parameters directly related with the schools environment, such as BREEAM or LEED.

Psychometric properties of assessment instruments for autism spectrum disorder: a systematic review of Brazilian studies

Objective To systematically review the scientific literature on the psychometric properties of international instruments for the assessment of autism spectrum disorder (ASD) in the Brazilian population. Methods A search of bibliographic references was conducted in six electronic databases: PsycINFO, PubMed, IndexPsi, Lilacs, Capes (theses and dissertations) and SciELO. The studies were selected by two independent researchers. Results The procedure identified 11 studies of the Brazilian population that encompassed six ASD assessment tools. Given the information provided, the adaptation of the M-CHAT, a screening instrument, was the best conducted. All steps of the adaptation process were described and the changes made to the final version of the instrument were presented, which was not addressed in other studies. In terms of reliability, all of the instruments that assessed internal consistency showed adequate values. In addition, the ADI-R and the CARS adaptations also satisfactorily contemplated inter-rater reliability and test-retest indices, respectively. Finally, all studies aiming to validate instruments showed evidence of validity and sensitivity, and specificity values above 0.90 were observed in the ASQ, ADI-R and ABC. Conclusion Considering both the psychometric aspects and the copyright information, the screening instrument that currently appears to be best indicated for clinical and research use is the M-CHAT. It was also noticed that there are still no specific ASD diagnostic tools available for use in Brazil. This lack of diagnostic instruments consists in a critical situation for the improvement of clinical practice and the development of research in this area.

QuesTInSitu: from tests to routes for assessment in situ activities

Test-based assessment tools are mostly focused on the use of computers. However, advanced Information and Communication Technologies, such as handheld devices, opens up the possibilities of creating new assessment scenarios, increasing the teachers’ choices to design more appropriate tests for their subject areas. In this paper we use the term Computing-Based Testing (CBT) instead of Computer-Based Testing, as it captures better the emerging trends. Within the CBT context, the paper is centred on proposing an approach for “Assessment in situ” activities, where questions have to be answered in front of a real space/location (situ). In particular, we present the QuesTInSitu software implementation that includes both an editor and a player based on the IMS Question and Test Interoperability specification and GoogleMaps. With QuesTInSitu teachers can create geolocated questions and tests (routes), and students can answer the tests using mobile devices with GPS when following a route. Three illustrating scenarios and the results from the implementation of one of them in a real educational situation show that QuesTInSitu enables the creation of innovative, enriched and context-aware assessment activities. The results also indicate that the use of mobile devices and location-based systems in assessment activities facilitates students to put explorative and spatial skills into practice and fosters their motivation, reflection and personal observation.

The promotion and assessment of generic skills from interdisciplinary teaching teams

The paper explains a teaching project financed by the University of Barcelona (UB). It focuses on ageneric skill of the University of Barcelona, which is defined as "the learning capability andresponsibility”, and in which analytical and synthesis skills are included. It follows a multidisciplinaryapproach including teachers of Mathematics, World Economics and Economic History. All of us sharethe same students during the first and the second course of the grade in Economics at the Faculty ofEconomics and Business. The project has been developed in three stages. The first one has beendone during the first semester of the course 2012/13, being applied to first year students on thesubjects of Mathematics and Economic History. The second phase is being to be done during thesecond semester only on the Economic History subject. A third stage is going to be done next course2013/14 to second year students on the subject of World Economics. Each different teaching teamhas developed specific materials and assessment tools for each one of the subjects included in theproject. The project emphasizes two teaching dimensions: the elaboration of teaching materials topromote the acquisition of generic skills from an interdisciplinary point of view, and the design ofspecific tools to assess such skills. The first results of the first phase of the project shows cleardeficiencies in the analytical skill regarding to first year students.

The promotion and assessment of generic skills from interdisciplinary teaching teams

The paper explains a teaching project financed by the University of Barcelona (UB). It focuses on ageneric skill of the University of Barcelona, which is defined as "the learning capability andresponsibility”, and in which analytical and synthesis skills are included. It follows a multidisciplinaryapproach including teachers of Mathematics, World Economics and Economic History. All of us sharethe same students during the first and the second course of the grade in Economics at the Faculty ofEconomics and Business. The project has been developed in three stages. The first one has beendone during the first semester of the course 2012/13, being applied to first year students on thesubjects of Mathematics and Economic History. The second phase is being to be done during thesecond semester only on the Economic History subject. A third stage is going to be done next course2013/14 to second year students on the subject of World Economics. Each different teaching teamhas developed specific materials and assessment tools for each one of the subjects included in theproject. The project emphasizes two teaching dimensions: the elaboration of teaching materials topromote the acquisition of generic skills from an interdisciplinary point of view, and the design ofspecific tools to assess such skills. The first results of the first phase of the project shows cleardeficiencies in the analytical skill regarding to first year students.