External school evaluation : teachers’ perspectives : two case studies from Northern Portugal

The external evaluation of non-higher education schools in Portugal has been developed by the General Inspectorate of Education since 2006. A first cycle of evaluation was completed, covering all educational units in continental Portugal up to 2011. The model of evaluation has since been subject to alterations, and a second cycle of evaluation is now coming to an end. The current model of evaluation is based on documental analysis, analysis of students’ results, and panel interviews with a variety of representatives of the school community, and addresses three domains: results, provision of educational service and management. This paper is part of an ongoing research project, developed by 6 universities and supported by the Portuguese Foundation for Science and Technology (PTDC/CPE-CED/116674/2010) which intends to analyse the impacts and effects this process of external evaluation has had on Portuguese schools. This project includes a variety of perspectives and methodologies. In particular, we will focus on two case studies undertaken in two schools from the northern region of Portugal, and more specifically on the perspectives expressed by the teachers of those schools. These particular schools were chosen because they have been evaluated twice and represent different educational levels (basic and secondary), contexts and results. These case studies included the analysis of documental data, interviews to key informants and a questionnaire directed to teachers (n = 141) – the latter will be the main focus of this paper. Teachers are essential elements of the school community when considering the impacts of external evaluation, as any changes directed at teaching practices, student evaluation, among others are only possible through their direct action and implication. Therefore, their perceptions on the process and its impacts are crucial to the understanding of what does and does not change in schools as a consequence of external evaluation. Although teachers’ opinions are not homogenous and each school reveals a number of differences when it comes to teachers’ perceptions of School Evaluation, it was possible to stress some areas as the most and as the least consensual. Teachers in both schools agree External School Evaluation (ESE) is useful for the identification of the schools’ strengths and weaknesses, values students’ external evaluation results, imposes a model for schools internal evaluation (and in fact contributes to the very existence of internal evaluation practices), and contributes to schools improvement. However teachers in both schools do not believe ESE contributes to teachers’ autonomy produces changes in how curriculum is managed, or leads to innovative teaching practices. These results point to a greater emphasis on change at the levels of school management, self-evaluation and particularly internal evaluation, but little impact on the teaching practices. We believe the classroom is at the core of school practices and teaching processes are essential to any measure of school quality and to their impacts on student learning.

QSAR modeling of antitubercular activity of diverse organic compounds

Tuberculosis (TB) is a worldwide infectious disease that has shown over time extremely high mortality levels. The urgent need to develop new antitubercular drugs is due to the increasing rate of appearance of multi-drug resistant strains to the commonly used drugs, and the longer durations of therapy and recovery, particularly in immuno-compromised patients. The major goal of the present study is the exploration of data from different families of compounds through the use of a variety of machine learning techniques so that robust QSAR-based models can be developed to further guide in the quest for new potent anti-TB compounds. Eight QSAR models were built using various types of descriptors (from ADRIANA.Code and Dragon software) with two publicly available structurally diverse data sets, including recent data deposited in PubChem. QSAR methodologies used Random Forests and Associative Neural Networks. Predictions for the external evaluation sets obtained accuracies in the range of 0.76-0.88 (for active/inactive classifications) and Q(2)=0.66-0.89 for regressions. Models developed in this study can be used to estimate the anti-TB activity of drug candidates at early stages of drug development (C) 2011 Elsevier B.V. All rights reserved.

Políticas de intervenção prioritária em Portugal: novas políticas, novas práticas?

Em Portugal, no final da década de 90 do século XX, começaram a ser desenvolvidas estratégias de discriminação positiva visando garantir o cumprimento da escolaridade obrigatória e a luta contra a exclusão escolar e social, designadamente nas periferias das grandes cidades. É neste contexto que surgem as escolas e os Territórios Educativos de Intervenção Prioritária (TEIP) pelo Despacho nº147-B/ME/96, de 1 de Agosto de 1996. Este programa, inicialmente inspirado nas zonas de intervenção prioritárias francesas, visava a intervenção de vários parceiros locais (professores, alunos, pessoal não docente, associações de pais, autarquias locais, associações culturais e associações recreativas) na elaboração do Projeto Educativo. Com o XVII Governo Constitucional o programa foi redefinido passando a incluir novas vertentes: necessidade de existência de um projeto educativo próprio; consultadoria externa; avaliação periódica de resultados em diferentes domínios (taxas de insucesso e abandono escolar, assiduidade, comportamento, participação, inovações organizacionais, parcerias educativas estabelecidas no âmbito do Programa, etc.). Foi também alargado a todo o território nacional, envolvendo atualmente cento e cinco agrupamentos escolares. Com esta apresentação visamos analisar se as novas políticas e diretrizes, no domínio da educação prioritária, contribuíram para a emergência de novas estratégias pedagógicas, organizacionais e de envolvimento comunitário. Os elementos em que basearemos a nossa análise serão os seguintes: (i) relatório nacional do programa TEIP (2010-2011); (ii) relatórios do programa de avaliação externa das escolas; (iii) entrevistas realizadas aos atores locais, designadamente a coordenadores e consultores dos projetos TEIP. As conclusões da nossa comunicação centrar-se-ão no papel dos atores locais no desenvolvimento do Programa TEIP e no impacto deste programa na melhoria dos resultados académicos, na diminuição da indisciplina e violência escolar e na construção de percursos de vida que contrariem as tendências para a exclusão escolar e social.

Credit risk measures: a case of renewable energy companies

The Basel III will have a significant impact on the European banking sector. In September 2010, supervisors of various countries adopted the new rules proposed by the prudential Committee on Banking Supervision to be applied to the business of credit institutions (hereinafter called ICs) in a phased manner from 2013, assuming to its full implementation by 2019. The purpose of this new regulation is to limit the excessive risk that these institutions took on the period preceding the global financial crisis of 2008. This new regulation is known in slang by Basel III. Depending on the requirement of Basel II for banks and their supervisors to assess the soundness and adequacy of internal risk measurement and credit management systems, the development of methodologies for the validation of internal and external evaluation systems is clearly an important issue . More specifically, there is a need to develop tools to validate the systems used to generate the parameters (such as PD, LGD, EAD and ratings of perceived risk) that serve as starting points for the IRB approach for credit risk. In this context, the work is composed of a number of approaches and tools used to evaluate the robustness of these elements IRB systems.

Comparing clustering solutions: the use of adjusted paired indices

In the present paper we compare clustering solutions using indices of paired agreement. We propose a new method - IADJUST - to correct indices of paired agreement, excluding agreement by chance. This new method overcomes previous limitations known in the literature as it permits the correction of any index. We illustrate its use in external clustering validation, to measure the accordance between clusters and an a priori known structure. The adjusted indices are intended to provide a realistic measure of clustering performance that excludes agreement by chance with ground truth. We use simulated data sets, under a range of scenarios - considering diverse numbers of clusters, clusters overlaps and balances - to discuss the pertinence and the precision of our proposal. Precision is established based on comparisons with the analytical approach for correction specific indices that can be corrected in this way are used for this purpose. The pertinence of the proposed correction is discussed when making a detailed comparison between the performance of two classical clustering approaches, namely Expectation-Maximization (EM) and K-Means (KM) algorithms. Eight indices of paired agreement are studied and new corrected indices are obtained.

Relationship between ISO 9001 certification maturity and EFQM business excellence model results

Purpose: This exploratory research evaluates if there is a relationship between the number of years since an organization has achieved ISO 9001 certification and the highest level of recognition received by the same organization with the EFQM Business Excellence Model. Methodology/Approach: After state of the art review a detailed comparison between both models was made. Fifty two Portuguese organizations were considered and Correlation coefficient Spearman Rho was used to investigate the possible relationships. Findings: Conclusion is that there is indeed a moderate positive correlation between these two variables, the higher the number of years of ISO 9001 certification, the higher the results of the organization EFQM model evaluation and recognition. This supports the assumption that ISO 9001 International Standard by incorporating many of the principles present in the EFQM Business Excellence Model is consistent with this model and can be considered as a step towards that direction. Research Limitation/implication: Due to the dynamic nature of these models that might change over time and the possible time delays between implementation and results, more in-depth studies like experimental design or a longitudinal quasi-experimental design could be used to confirm the results of this investigation. Originality/Value of paper: This research gives additional insights on conjunct studies of both models. The use of external evaluation results carried out by the independent EFQM assessors minimizes the possible bias of previous studies accessing the value of ISO 9001 certification.

Avaliação externa de escolas: perspetivas dos diretores da região norte de Portugal

Este trabalho insere-se no âmbito do Projeto de investigação «Impacto e Efeitos da Avaliação Externa nas Escolas do Ensino Não-Superior» (FCT PTDC/CPE-CED/116674/2010), desenvolvidopor 6 universidades nacionais. Em concreto, situa a sua análise sobre os resultados de um inquérito por questionário enviado a todos os diretores de unidades educativas do continente português. Analisamos, neste texto, os resultados atinentes às perspetivas da Região Norte de Portugal, por ser aquela que está geograficamente mais próxima da Universidade do Minho. Os resultados apontam para uma perceção moderadamente positiva da Avaliação Externa de Escolas.

Lideranças curriculares intermédias no contexto da avaliação externa das escolas em Portugal

Tese de Doutoramento em Ciências da Educação (área de especialização em Desenvolvimento Curricular).

O ensino da matemática e a avaliação externa de escolas: um estudo com professores do 1.º e 2.º ciclos

Os processos e práticas de educação e formação portugueses estão cada vez mais integrados em agendas globalmente estruturadas, cujo eixo de influência se situa no quadro comum das políticas da União Europeia e de organismos transnacionais como a OCDE (Pacheco, 2009). A avaliação tem vindo a assumir, nas últimas décadas, um papel central, extrapolando a sua importância para além do campo da educação (Afonso, 2010). O destaque atribuído à avaliação das escolas decorre de duas tendências que marcam a generalidade dos países europeus: a descentralização de meios e a definição de objetivos nacionais e de patamares de resultados escolares (Eurydice, 2011). Utilizando a análise político-económica da globalização na educação e fazendo também uma abordagem crítica às políticas de partilha (Takayama, 2013), pretendese analisar a mediação das pressões das políticas curriculares de homogeneização e estandardização dos resultados (Afonso, 2012; Santiago, Donaldson, Looney & Nusche, 2012) e a sua influência nos professores de Matemática. O presente estudo quantitativo envolve a realização de um inquérito por questionário aos professores do 1.º e 2.º ciclos de Matemática do Ensino Básico, onde se averigua de que forma o modelo de avaliação externa de escolas, implementado em Portugal desde 2006, tem colaborado para a elaboração de consequências concretas nos standards de avaliação, e na preponderância dos testes sumativos na disciplina de Matemática, considerando as mudanças curriculares e pedagógicas.

Dispositivo de avaliação externa ao ensino superior: um estudo exploratório sobre acreditação à Universidade Nacional Timor Lorosa'e, 2008 – 2013

Dissertação de mestrado em Ciências da Educação (área de especialização em Avaliação)

A excelência da escola pública portuguesa: efeitos sobre o modo de trabalho do professor

Dissertação de mestrado em Ciências da Educação (área de especialização em Educação de Adultos)

La evaluación de la reducción de amenazas en el Parque Natural de la Zona Volcánica de la Garrotxa (Girona)

En este artículo se presenta la metodología y los resultados derivados de la aplicación de una adaptación del denominado modelo de evaluación de reducción de amenazas (Threat Reduction Assesment) en el Parque Natural de la Zona Volcánica de la Garrotxa (PNZVG). Endefinitiva, se pretende valorar la efectividad de la gestión a partir del grado de reducción de amenazas en el PNZVG. El estudio se realizó a partir de la elaboración de una evaluación externa e independiente, que ha contado a la vez con una estrecha colaboración de los órganos gestores y rectores del Parque, así como con una activa participación de distintos agentes sociales clave. Se concluye que, después de veinticinco años de existencia del Parque, muchas de las amenazas iniciales sólo se han reducido de forma modesta e incluso a partir del índice adaptado, considerado un enfoque más realista; con lo cual se llega a la preocupante conclusión de que algunas de las amenazas más importantes se han incrementado

Avaliação Externa de Escolas: Estudo Comparativo entre Portugal e Cabo Verde

A avaliação externa de escolas assumiu, nos últimos anos, uma grande centralidade nas políticas educativas e apercebemos que cada vez mais, se tornou uma exigência nos estabelecimentos de ensino. É nesta perspetiva que levamos a cabo uma investigação cuja preocupação central assenta na avaliação externa de escolas como nosso objeto de estudo, uma vez que, devido à pertinência atribuída pelas políticas educativas e sustentada nas boas práticas internacionais é considerada um gerador de mudança que contribui para a melhoria da aprendizagem dos alunos e para o desenvolvimento das instituições. Assim, optamos por realizar o trabalho segundo uma abordagem predominantemente qualitativa, através de um inquérito por entrevistas, com o propósito de obter dados que permitissem compreender e conhecer o modelo da avaliação externa de escolas, que, enquanto área de avaliação e de melhorias é assumida como uma das prioridades na educação, que caminha para o progresso das escolas, qualificando-as, com o objetivo de gerar impacto na melhoria dos resultados dos alunos. De uma forma global constatamos que nas últimas décadas, particularmente em Portugal, varias foram as iniciativas de avaliação de escolas e que a lei nº 31/2002, de 20 de dezembro, veio dar continuidade aos programas antes implementados, atribuindo-lhe um caráter obrigatório. Entretanto, Cabo Verde não dispõe de nenhum regulamento que estabeleça a obrigatoriedade da mesma, mas tendo consciência do impacto que a avaliação externa de escolas tem suscitado em muitos países europeus, a inspeção - geral da educação iniciou-se uma experiência em março de 2012, mas falta ainda fazer a revisão dos normativos que permitam regularizar este fenómeno, de modo a que se torne seja uma prática regularizada e consistente. De acordo com os argumentos dos entrevistados, os dados revelam-se que, a avaliação externa de escolas têm como finalidade a melhoria do sistema educativo e os efeitos nomeadamente a este nível são o desenvolvimento a nível institucional e profissional dos professores, a boa gestão pedagógica e ainda o de produzir uma cultura de autoavaliação nas escolas.

Immersion communautaire à Lausanne : une autre façon d'enseigner la santé publique [Community immersion in Lausanne: a different approach to teaching public health?].

Teaching community medicine represents a significant challenge for medical schools, which tend to struggle to promote interest in the issue among students. In 2009, the Lausanne medical school introduced a "community immersion" module specifically designed to address the issue. The new module requires students working in small groups under the supervision of a tutor to investigate a health question of their choice. The investigation involves conducting interviews with stakeholders (health professionals, patients, politicians, etc.), carrying out a survey, and presenting the results of the investigation in a "congress". An external evaluation showed that the objectives of the initiative had been largely achieved, with an increase of interest in community medicine for over 50% of students (based on a total cohort of 150 students) and a high level of satisfaction for over 90% of students and tutors. This paper presents the results of the initiative and its use for promoting community-oriented medicine.

Are niche-based species distribution models transferable in space?

Aim To assess the geographical transferability of niche-based species distribution models fitted with two modelling techniques. Location Two distinct geographical study areas in Switzerland and Austria, in the subalpine and alpine belts. Methods Generalized linear and generalized additive models (GLM and GAM) with a binomial probability distribution and a logit link were fitted for 54 plant species, based on topoclimatic predictor variables. These models were then evaluated quantitatively and used for spatially explicit predictions within (internal evaluation and prediction) and between (external evaluation and prediction) the two regions. Comparisons of evaluations and spatial predictions between regions and models were conducted in order to test if species and methods meet the criteria of full transferability. By full transferability, we mean that: (1) the internal evaluation of models fitted in region A and B must be similar; (2) a model fitted in region A must at least retain a comparable external evaluation when projected into region B, and vice-versa; and (3) internal and external spatial predictions have to match within both regions. Results The measures of model fit are, on average, 24% higher for GAMs than for GLMs in both regions. However, the differences between internal and external evaluations (AUC coefficient) are also higher for GAMs than for GLMs (a difference of 30% for models fitted in Switzerland and 54% for models fitted in Austria). Transferability, as measured with the AUC evaluation, fails for 68% of the species in Switzerland and 55% in Austria for GLMs (respectively for 67% and 53% of the species for GAMs). For both GAMs and GLMs, the agreement between internal and external predictions is rather weak on average (Kulczynski's coefficient in the range 0.3-0.4), but varies widely among individual species. The dominant pattern is an asymmetrical transferability between the two study regions (a mean decrease of 20% for the AUC coefficient when the models are transferred from Switzerland and 13% when they are transferred from Austria). Main conclusions The large inter-specific variability observed among the 54 study species underlines the need to consider more than a few species to test properly the transferability of species distribution models. The pronounced asymmetry in transferability between the two study regions may be due to peculiarities of these regions, such as differences in the ranges of environmental predictors or the varied impact of land-use history, or to species-specific reasons like differential phenotypic plasticity, existence of ecotypes or varied dependence on biotic interactions that are not properly incorporated into niche-based models. The lower variation between internal and external evaluation of GLMs compared to GAMs further suggests that overfitting may reduce transferability. Overall, a limited geographical transferability calls for caution when projecting niche-based models for assessing the fate of species in future environments.