Performance assessment and league tables. Comparing like with like.

We formulate performance assessment as a problem of causal analysis and outline an approach based on the missing data principle for its solution. It is particularly relevant in the context of so-called league tables for educational, health-care and other public-service institutions. The proposed solution avoids comparisons of institutions that have substantially different clientele (intake).

Performance assessment and league tables. Comparing like with like

We formulate performance assessment as a problem of causal analysis and outline an approach based on the missing data principle for its solution. It is particularly relevant in the context of so-called league tables for educational, health-care and other public-service institutions. The proposed solution avoids comparisons of institutions that have substantially different clientele (intake).

International journal of engineering education

This work presents an analysis of the assessment tools used by professors at the Universitat Politécnica de Catalunya to assess the generic competencies introduced in the Bachelor’s Degrees in Engineering. In order to conduct this study, a survey was designed and administered anonymously to a sample of the professors most receptive to educational innovation at their own university. All total, 80 professors responded to this survey, of whom 26% turned out to be members of the university’s own evaluation innovation group (https://www.upc.edu/rima/grups/grapa), GRAPA. This percentage represents 47% of the total GRAPA membership, meaning that nearly half of the professors most concerned about evaluation at the university chose to participate. The analysis of the variables carried out using the statistical program SPSS v19 shows that for practically 49% of those surveyed, rubrics are the tools most commonly used to assess generic competencies integrated in more specific ones. Of those surveyed, 60% use them either frequently or always. The most frequently evaluated generic competencies were teamwork (28%), problem solving (26%), effective oral and written communication (24%) and autonomous learning (13%), all of which constitute commonly recognized competencies in the engineering profession. A two-dimensional crosstabs analysis with SPSS v19 shows a significant correlation (Asymp. Sig. 0.001) between the type of tool used and the competencies assessed. However, no significant correlation was found between the type of assessment tool used and the type of subject, type of evaluation (formative or summative), frequency of feedback given to the students or the degree of student satisfaction, and thus none of these variables can be considered to have an influence on the kind of assessment tool used. In addition, the results also indicate that there are no significant differences between the instructors belonging to GRAPA and the rest of those surveyed

Investigating university students' adaptation to digital learner course portfolio

Digital learner portfolios are of growing importance in higher education as the sector seeks new teaching-learning-assessment methods which promote students" autonomy as managers of their own virtual learning environment. The purpose of this study was to analyse descriptively the undergraduate students" perceptions, attitudes and behaviour when using an eportfolio to support their learning and assessment in practice based courses at two traditional Spanish universities. The participants were 88 students, who were studying through a blended learning mode. Data were collected through questionnaires: a computer experience survey, another which examined the psychological, pedagogical and technological dimensions of eportfolios use. Further, an individual overall reflection was obtained from each student to help gain an understanding of their experiences of using the eportfolio. A mixed-method analysis was applied in order to study the impact of this technological innovation on students and their satisfaction. The results showed that the students had positive opinions and self-efficiency through the eportfolio as a tool to manage their learning and assessment during a semester, especially from the second month of use. However, the expected impact on their learning was not so significant. Nevertheless, the students emphasised that the eportfolio was valuable as a personal developmental learning tool.

Farmacología y toxicología en I+D+i: adquisición de competencias a través de un ejemplo de desarrollo de un fármaco

The implementation of the subject Pharmacology and Toxicology in R+D+i in the Pharmacy Degree, has led to the launch of a new methodological approach and teaching performance with the aim of developing the generic skills of the University of Barcelona (e.g., self-learning, team-working). An additional objective was students' integration of knowledge from different subjects in the degree which form the basis of the preclinical and clinical development of a drug. For this purpose, the teaching strategy used in the development of the subject was based on: 1) re-developing the content that students had been taught previously or were being taught in the same semester as a part of other subjects, and framing them in the environment of the pharmaceutical industry, 2) introducing new and previously unseen contents to do with drug development and toxicology, 3) developing a battery of activities to be undertaken by teams of students relating to the R+D+i of a particular drug. During the development of these activities, students have to acquire generic skills in addition to the subject-specific skills. The results obtained from the student survey give us grounds for satisfaction and allow us to consider that we have reached the goal of improving students' learning in Pharmacology and Toxicology applied to drug development in the pharmaceutical world today.

The promotion and assessment of generic skills from interdisciplinary teaching teams

The paper explains a teaching project financed by the University of Barcelona (UB). It focuses on ageneric skill of the University of Barcelona, which is defined as "the learning capability andresponsibility”, and in which analytical and synthesis skills are included. It follows a multidisciplinaryapproach including teachers of Mathematics, World Economics and Economic History. All of us sharethe same students during the first and the second course of the grade in Economics at the Faculty ofEconomics and Business. The project has been developed in three stages. The first one has beendone during the first semester of the course 2012/13, being applied to first year students on thesubjects of Mathematics and Economic History. The second phase is being to be done during thesecond semester only on the Economic History subject. A third stage is going to be done next course2013/14 to second year students on the subject of World Economics. Each different teaching teamhas developed specific materials and assessment tools for each one of the subjects included in theproject. The project emphasizes two teaching dimensions: the elaboration of teaching materials topromote the acquisition of generic skills from an interdisciplinary point of view, and the design ofspecific tools to assess such skills. The first results of the first phase of the project shows cleardeficiencies in the analytical skill regarding to first year students.

The promotion and assessment of generic skills from interdisciplinary teaching teams

The paper explains a teaching project financed by the University of Barcelona (UB). It focuses on ageneric skill of the University of Barcelona, which is defined as "the learning capability andresponsibility”, and in which analytical and synthesis skills are included. It follows a multidisciplinaryapproach including teachers of Mathematics, World Economics and Economic History. All of us sharethe same students during the first and the second course of the grade in Economics at the Faculty ofEconomics and Business. The project has been developed in three stages. The first one has beendone during the first semester of the course 2012/13, being applied to first year students on thesubjects of Mathematics and Economic History. The second phase is being to be done during thesecond semester only on the Economic History subject. A third stage is going to be done next course2013/14 to second year students on the subject of World Economics. Each different teaching teamhas developed specific materials and assessment tools for each one of the subjects included in theproject. The project emphasizes two teaching dimensions: the elaboration of teaching materials topromote the acquisition of generic skills from an interdisciplinary point of view, and the design ofspecific tools to assess such skills. The first results of the first phase of the project shows cleardeficiencies in the analytical skill regarding to first year students.

The promotion and assessment of generic skills from interdisciplinary teaching teams

The paper explains a teaching project financed by the University of Barcelona (UB). It focuses on ageneric skill of the University of Barcelona, which is defined as "the learning capability andresponsibility”, and in which analytical and synthesis skills are included. It follows a multidisciplinaryapproach including teachers of Mathematics, World Economics and Economic History. All of us sharethe same students during the first and the second course of the grade in Economics at the Faculty ofEconomics and Business. The project has been developed in three stages. The first one has beendone during the first semester of the course 2012/13, being applied to first year students on thesubjects of Mathematics and Economic History. The second phase is being to be done during thesecond semester only on the Economic History subject. A third stage is going to be done next course2013/14 to second year students on the subject of World Economics. Each different teaching teamhas developed specific materials and assessment tools for each one of the subjects included in theproject. The project emphasizes two teaching dimensions: the elaboration of teaching materials topromote the acquisition of generic skills from an interdisciplinary point of view, and the design ofspecific tools to assess such skills. The first results of the first phase of the project shows cleardeficiencies in the analytical skill regarding to first year students.

Enseñar a aprender a pensar en los centros educativos, incluso en las actividades de evaluación.= Teaching to learn how to think at schools, even within assessment activities

El auténtico protagonismo de los centros educativostiene que dirigirse a ayudar a pensar a sus alumnos y aenseñarlos a aprender, es decir, el docente tiene queenseñar estrategias de aprendizaje y debe promover elesfuerzo del estudiante para facilitar la construcción deesquemas y el aprendizaje permanente.El profesor debe utilizar cualquier situación deaprendizaje para enseñar dichas estrategias deaprendizaje, incluso en las situaciones de evaluación;por lo tanto, en este trabajo se sugiere que en lasevaluaciones de los alumnos y alumnas se tenga encuenta la metacognición como factor fundamental en elaprendizaje y la enseñanza

Integrated assessment of agricultural sustainability: the pros and cons of reductionism

In this paper I review a series of theoretical concepts that are relevant for the integrated assessment of agricultural sustainability but that are not generally included in the curriculum of the various scientific disciplines dealing with quantitative analysis of agriculture. I first illustrate with plain narratives and concrete examples that sustainability is an extremely complex issue requiring the simultaneous consideration of several aspects, which cannot be reduced into a single indicator of performance. Following, I justify this obvious need for multi-criteria analysis with theoretical concepts dealing with the epistemological predicament of complexity, starting from classic philosophical lessons to arrive to recent developments in complex system theory, in particular Rosen´s theory of modelling relation which is essential to analyze the quality of any quantitative representation. The implications of these theoretical concepts are then illustrated with applications of multi-criteria analysis to the sustainability of agriculture. I wrap up by pointing out the crucial difference between "integrated assessment" and "integrated analysis". An integrated analysis is a set of indicators and analytical models generating an analytical output. An integrated assessment is much more than that. It is about finding an effective way to deal with three key issues: (i) legitimacy – how to handle the unavoidable existence of legitimate but contrasting points of view about different meanings given by social actors to the word "development"; (ii) pertinence – how to handle in a coherent way scientific analyses referring to different scales and dimensions; and (iii) credibility – how to handle the unavoidable existence of uncertainty and genuine ignorance, when dealing with the analysis of future scenarios.

Desenvolupament d'eines per l'apliació de l'aprenentatge basat en projectes a l'enginyeria tècnica de telecomunicacions

El projecte d'innovació docent s'emmarca dintre de la línia de treball de l'Escola Politècnica Superior de Castelldefels. Aquesta escola, des de els seus inicis ha destacat per la seva aposta per la innovació docent i l'aplicació de mètodes pedagògics pioners arreu d'Espanya. El sistema d'ensenyament basat en el seguiment individualitzat de l'estudiant, facilitat per una bona relació professor/nombre d'estudiants (grups de 40 o 20 estudiants), l'avaluació continuada, que parteix de les activitats acadèmiques realitzades en una matèria, i l'avaluació curricular, que atén el rendiment global de l'estudiant, fan que el sistema fomenti el treball regular al mateix temps que l'informa en tot moment del seu progrés acadèmic. Per un altre banda, dintre del sistema educatiu de la nostra escola podem destacar l'aplicació de l'Aprenentatge Basat en Projectes (PBL), aplicat inicialment als estudis de Segon Cicle. D'acord amb aquest model, els alumnes aprenen realitzant projectes en grup. Les intervencions del professorat i els materials del curs estan orientats a donar suport a les necessitats dels projectes que es desenvolupen a cada moment. Tot seguint la línia de treball de l'escola i la seva adequació als criteris determinats en el Espai Europeu d'Educació Superior, aquest projecte segueix tres línies d’actuació: (1) incideix en l'aplicació del PBL dintre d'assignatures Optatives i en assignatures de primers cursos de la Titulació d'Enginyeria de Telecomunicacions, (2) estimular l’alumnat, a través de treballs interdisciplinaris i la utilització de les noves tecnologies, (3) generació de documentació adaptada als nous plans d’estudi. Aquestes línies d’actuació es desenvolupen per motivar els alumnes en els estudis d'enginyeria que estan cursant i fer-los veure l'aplicabilitat, en el camp de la recerca, de gran quantitat dels coneixements que van adquirint durant la seva formació dintre de la Universitat.

Projecte pilot d'innovació docent de l'assignatura Estructura de Computadors I

L'objectiu del projecte ha estat la millora de la qualitat docent de l'assignatura Estructura de Computadors I, impartida a la Facultat d'Informàtica de Barcelona (UPC) dins els estudis d'Enginyeria Informàtica, Enginyeria Tècnica en Informàtica de Sistemes i Enginyeria Tècnica en Informàtica de Gestió. S'ha treballat en quatre línies d'actuació: (i) aplicació de tècniques d'aprenentatge actiu a les classes; (ii) aplicació de tècniques d'aprenentage cooperatiu no presencials; (iii) implantació de noves TIC i adaptació de les ja emprades per tal d'habilitar mecanismes d'autoavaluació i de realimentació de la informació referent a l'avaluació; i (iv) difusió de les experiències derivades de les diferents actuacions. Referent a les dues primeres mesures s'avalua l'impacte de metodologies docents que afavoreixen l'aprenentatge actiu tant de forma presencial com no presencial, obtenint-se clares millores en el rendiment respecte a altres metodologies utilitzades anteriorment enfocades a la realització de classes del tipus magistral, en què únicament es posa a l'abast dels alumnes la documentació de l'assignatura per a què puguin treballar de forma responsable. Les noves metodologies fan especial èmfasi en el treball en grup a classe i la compartició de les experiències fora de classe a través de fòrums de participació. La mesura que ha requerit més esforç en aquest projecte és la tercera, amb el desenvolupament d'un entorn d'interfície web orientat a la correcció automàtica de programes escrits en llenguatge assemblador. Aquest entorn permet l'autoavaluació per part dels alumnes dels exercicis realitzats a l'assignatura, amb obtenció d'informació detallada sobre les errades comeses. El treball realitzat dins d'aquest projecte s'ha publicat en congressos rellevants en l'àrea docent tant a nivell estatal com internacional. El codi font de l'entorn esmentat anteriorment es posa a disposició pública a través d'un enllaç a la web.

Análisis de la enseñanza-aprendizaje y evaluación de competencias transversales en general, y de la competencia de la comunicación escrita en particular, en currículos TIC

Este Proyecto Fin de Carrera, pertenece al área de 'Competencias profesionales' y tiene como objetivo el análisis de diversas experiencias de enseñanza-aprendizaje y de evaluación de competencias transversales, haciendo hincapié en la competencia de la comunicación escrita, dentro de la formación de currículos TIC. El análisis se centra en los planes de estudios del Grado en Ingeniería Informática de 10 universidades españolas representativas (públicas, privadas y a distancia) como representación de la "nueva" formación de currículos TIC en nuestra sociedad.

A teaching/learning support tool for introductory programming courses

In This work we present a Web-based tool developed with the aim of reinforcing teaching and learning of introductory programming courses. This tool provides support for teaching and learning. From the teacher's perspective the system introduces important gains with respect to the classical teaching methodology. It reinforces lecture and laboratory sessions, makes it possible to give personalized attention to the student, assesses the degree of participation of the students and most importantly, performs a continuous assessment of the student's progress. From the student's perspective it provides a learning framework, consisting in a help environment and a correction environment, which facilitates their personal work. With this tool students are more motivated to do programming