Method for the evaluation of social projects

This instrument was part of the research project "Research on Evaluation of Health and Education Plans and Programs in the Province of Buenos Aires", developed by the of Chair Preventive Psychology of the Psychology course of studies at the School of Humanities and Educational Sciences, National Univer- sity of La Plata (Argentina). The basis for proposing an assessment instrument is the need for a method enabling analysis, systematization of knowledge and the assignment of values distributed into scales and organized in general charts, on social programs. Its main concern is the analysis of health and education programs and projects, restricted to certain specific areas or regions, in search for theoretic trustworthi-ness, methodological accuracy as well as pragmatic operability. This is the result of four years of researching said programs at system, service and community levels.

Reading comprehension in nacional and internacional programs of educational assessment

El principal objetivo de este artículo es identificar distintos programas de evaluación educativa, tanto nacionales como internacionales, y describir sus características generales. Asimismo, analiza el modo en que se conceptualiza y evalúa la competencia lectora. Finalmente, este trabajo presenta los resultados que ha obtenido Argentina en esta área. Los programas analizados son: el Programa para la Evaluación Internacional de Alumnos (PISA, Programme for International Student Assessment) , el Segundo Estudio Regional Comparativo y Explicativo (SERCE) y, específicamente en nuestro país, el Operativo Nacional de Evaluación (ONE) y el Programa de Evaluación de la Calidad Educativa de la Provincia de Buenos Aires. Estos diferentes estudios sitúan la importancia de la lectura comprensiva en tanto "competencia para la vida" necesaria para la realización de otros aprendizajes, para el logro de una participación activa en la sociedad y ligada a la posibilidad de proyectar un futuro mejor. Los informes muestran la existencia de diferencias entre los resultados de distintos países y al interior de los mismos. El desarrollo de competencias desiguales aparece como un desafío a nivel nacional e internacional, ya que constituye un importante indicador de la situación crítica en la que se encuentran un número significativo de niños y adolescentes.

Method for the evaluation of social projects

This instrument was part of the research project "Research on Evaluation of Health and Education Plans and Programs in the Province of Buenos Aires", developed by the of Chair Preventive Psychology of the Psychology course of studies at the School of Humanities and Educational Sciences, National Univer- sity of La Plata (Argentina). The basis for proposing an assessment instrument is the need for a method enabling analysis, systematization of knowledge and the assignment of values distributed into scales and organized in general charts, on social programs. Its main concern is the analysis of health and education programs and projects, restricted to certain specific areas or regions, in search for theoretic trustworthi-ness, methodological accuracy as well as pragmatic operability. This is the result of four years of researching said programs at system, service and community levels.

Reading comprehension in nacional and internacional programs of educational assessment

El principal objetivo de este artículo es identificar distintos programas de evaluación educativa, tanto nacionales como internacionales, y describir sus características generales. Asimismo, analiza el modo en que se conceptualiza y evalúa la competencia lectora. Finalmente, este trabajo presenta los resultados que ha obtenido Argentina en esta área. Los programas analizados son: el Programa para la Evaluación Internacional de Alumnos (PISA, Programme for International Student Assessment) , el Segundo Estudio Regional Comparativo y Explicativo (SERCE) y, específicamente en nuestro país, el Operativo Nacional de Evaluación (ONE) y el Programa de Evaluación de la Calidad Educativa de la Provincia de Buenos Aires. Estos diferentes estudios sitúan la importancia de la lectura comprensiva en tanto "competencia para la vida" necesaria para la realización de otros aprendizajes, para el logro de una participación activa en la sociedad y ligada a la posibilidad de proyectar un futuro mejor. Los informes muestran la existencia de diferencias entre los resultados de distintos países y al interior de los mismos. El desarrollo de competencias desiguales aparece como un desafío a nivel nacional e internacional, ya que constituye un importante indicador de la situación crítica en la que se encuentran un número significativo de niños y adolescentes.

Problèmes de lecture en langue étrangère : Evaluation de la compréhension de textes à partir des résumés en langue maternelle

Como resultado de nuestra experiencia docente en la Facultad de Humanidades y Ciencias de la Educación de la UNLP impartiendo cursos de lectocomprensión en Lengua extranjera (LE) y con el objetivo siempre presente de mejorar las prácticas didácticas para lograr el resultado esperado del lector autónomo en Francés, decidimos encarar el presente trabajo de investigación. La hipótesis de partida de nuestro análisis es que la verificación de la comprensión lectora en LE podría hacerse a partir de resúmenes en Lengua Materna (LM), y que habría una estrecha relación entre las estrategias lectoras utilizadas en LM y las que se utilizan en LE. A partir de esto nos planteamos una serie de preguntas organizadas alrededor de tres ejes según los componentes a los que apuntan: cognitivo, metodológico-estratégico y discursivo. Tomamos como base un corpus de resúmenes en LM de un texto en LE realizado por un grupo voluntario de alumnos de la Cátedra Capacitación en Idioma Francés I, creando con ellos un dispositivo de observación y análisis conjunto compuesto por: una Encuesta Previa al comienzo del curso con respuestas en LM, una Encuesta previa a la lectura del texto por resumir con respuestas en LM, y una Encuesta post resumen con respuestas en LM. El trabajo está estructurado en seis partes: Introducción, Problemática, Marco teórico, Metodología de recolección de datos, Análisis del corpus y Conclusiones y perspectivas. Creemos que el presente trabajo constituye una reflexión y un punto de partida para el análisis de uno de los problemas planteados por la didáctica de la lectocomprensión LE en la universidad: las estrategias lectoras de los estudiantes de LE y más particularmente en Francés Lengua Extranjera.

Returns to migration : the role of educational attainment in rural Tanzania

Given the migration premium previously identified in an impact evaluation approach, this paper asks the question of why migration is not more prominent, given such high premium associated with it. Using long-term household panel data drawn from rural Tanzania, Kagera for the period 1991-2004, this study aims to answer this question by exploring the contribution of education in the migration premium. By separating migrants into those that moved out of original villages but remained within Kagera and those who left the region, this study finds that, in consumption, the return on investment in education is higher at both destinations. However, whilst the higher return on education fully explains the gains associated with migration within Kagera, it only partly explains those of external migration. These findings suggest that welfare opportunities are higher at the destination and that an individual's limited investment in education plays a major role in preventing short-distance migration from becoming a significant source of raising welfare, which is not the case for long-distance migration. While education plays a role, it appears that other mechanisms may prohibit rural agents from exploiting the arbitrage opportunity when they migrate to the destination at a great distance from the source.

Local relevancy evaluation in the accreditation bodies for engineering master's programs

Accreditation models in the international context mainly consider the evaluation of learning outcomes and the ability of programs (or higher education institutions) to achieve the educational objectives stated in their mission. However, it is not clear if these objectives and therefore their outcomes satisfy real national and regional needs, a critical point in engineering master's programs, especially in developing countries. The aim of this paper is to study the importance of the local relevancy evaluation of these programs and to analyze the main models of quality assurance and accreditation bodies of USA, Europe and Latin America, in order to ascertain whether the relevancy is evaluated or not. After a literature review, we found that in a free-market economic context and international education, the accreditation of master’s programs follows an international accreditation model, and doesn´t take in account in most cases criteria and indicators for local relevancy. It concludes that it is necessary both, international accreditation to ensure the effectiveness of the program (achievement of learning outcomes) and the national accreditation through which it could ensure local relevancy of programs, for which we are giving some indicators.

A model for evaluation of generic competences in engineering: application to the problem. Solving competence at the technical University of Madrid.

The competence evaluation promoted by the European High Education Area entails a very important methodological change that requires guiding support to help teachers carry out this new and complex task. In this regard, the Technical University of Madrid (UPM, by its Spanish acronym) has financed a series of coordinated projects with a two-fold objective: a) To develop a model for teaching and evaluating core competences that is useful and easily applicable to its different degrees, and b) to provide support to teachers by creating an area within the Website for Educational Innovation where they can search for information on the model corresponding to each core competence approved by UPM. Information available on each competence includes its definition, the formulation of indicators providing evidence on the level of acquisition, the recommended teaching and evaluation methodology, examples of evaluation rules for the different levels of competence acquisition, and descriptions of best practices. These best practices correspond to pilot tests applied to several of the academic subjects conducted at UPM in order to validate the model. This work describes the general procedure that was used and presents the model developed specifically for the problem-solving competence. Some of the pilot experiences are also summarised and their results analysed

A model for evaluation of generic competences in engineering: application to the problem-solving competence at UPM.

The competence evaluation promoted by the European High Education Area entails a very important methodological change that requires guiding support to help teachers carry out this new and complex task. In this regard, the Technical University of Madrid (UPM, by its Spanish acronym) has financed a series of coordinated projects with a two-fold objective: a) To develop a model for teaching and evaluating core competences that is useful and easily applicable to its different degrees, and b) to provide support to teachers by creating an area within the Website for Educational Innovation where they can search for information on the model corresponding to each core competence approved by UPM. Information available on each competence includes its definition, the formulation of indicators providing evidence on the level of acquisition, the recommended teaching and evaluation methodology, examples of evaluation rules for the different levels of competence acquisition, and descriptions of best practices. These best practices correspond to pilot tests applied to several of the academic subjects conducted at UPM in order to validate the model. This work describes the general procedure that was used and presents the model developed specifically for the problem-solving competence. Some of the pilot experiences are also summarised and their results analysed

Methodological Proposal for Teamwork Evaluation in the field of training Project Management.

Teamwork, is one of the abilities that today is highly valued in the professional arena with a great importance for various personal and interpersonal skills associated with it. In this context, the Technical University of Madrid, is developing a coordinated educational innovation project, which main objective is to develop methodological and assessment tools for the acquisition of personal skills necessary to improve the employability of graduates and their skills for project management. Within this context, this paper proposes a methodology composed of various activities and indicators, as well as specific assessment instruments linked to the teamwork competence. Through a series of systematic steps it was allowed the design of an instrument and construction of a scale for measuring the competence of teamwork. The practical application of the methodology has been carried out in Projects lectures from different Schools of Engineering at the Technical University of Madrid, which results are presented in this document as a pilot experience. Results show the various aspects and methods that teachers should consider in evaluating the competence of the work, including analysis of the quality of results, through reliability and construct validity. On the other hand, show the advantages of applying this methodology in the field of project management teaching.

Self Learning and self evaluation exercises database in basic mechanics: a theoretical-practical approach

In the School of Mines of the Technical University of Madrid (UPM) the first course of different degrees has been implemented and adapted to the European Higher Educational Area (EHEA). In all of the degrees there is a first semester course which gathers all the contents of basic mechanics: from the first kinematics concepts to the rigid solid plane motion Before the Bologna process took place, the authors had established the final assessment of the theoretical contents through open questions of theoretical-practical character In the present work, the elaboration of a wide database containing theoretical-practical questions that students can access on line is presented. The questions are divided in thirteen different questionnaires composed of a number of questions randomly chosen from a certain group in the database. Each group corresponds to a certain learning objective that the student knows. After answering the questionnaire and checking the grade assigned according to the performance of the student, the pupils can see the correct response displayed on the screen and widely explained by the professors. This represents a 10% of the final grade. As the student can access the questionnaires as many times as they want, the main goal is the self-assessment of each learning objective and therefore, getting the students involved in their own learning process so they can decide how much time they need to acquire the required level.

The influence of transparency on self-evaluation as part of the university accreditation process in Peru.

In order to show the choice of transparency as the guiding principle of the accreditation process, the article evaluates its influence on the fundamental subprocess of self-evaluation, thereby confirming that transparency is an essential tool for continuous improvement of academic processes and those of educational quality management. It fosters educational innovation and permits the sustainability of the continuous accreditation process over time, resulting in greater probabilities of university self-regulation through systemization of the process, with the objective of continuous improvement of university degree programs. The article analyzes the influence of transparency on each activity of the self-evaluation process according to the Peruvian accreditation model prepared under the total quality approach, as a reference for other accreditation models, proposing concrete transparency actions and evaluating its influence on the stakeholder groups in the self-evaluation process, as well as on the efficiency and effectiveness of the process. It is concluded that transparency has a positive influence on the training of human capital and the formation of the university?s organizational culture, facilitating dissemination, understanding and involvement of the stakeholder groups in the continuous improvement of accreditation activities and increasing their acceptance of change and commitment to the process. It is confirmed that transparency contributes toward increasing the efficiency index of the self-evaluation process by reducing operating costs through adequate, accessible, timely contribution of information by the stakeholders and through the optimization of the time spent gathering relevant information. In addition, it is concluded that transparency contributes toward increasing the effectiveness index of self-evaluation by facilitating the achievement of its objectives through synthetic, useful, reliable interpretation of the education situation and the formulation of feasible improvement plans based on the adequacy, relevance, visibility, pertinence and truthfulness of the information analyzed.

A flexible open source web platform to facilitate Learning Object evaluation

Systematic evaluation of Learning Objects is essential to make high quality Web-based education possible. For this reason, several educational repositories and e-Learning systems have developed their own evaluation models and tools. However, the differences of the context in which Learning Objects are produced and consumed suggest that no single evaluation model is sufficient for all scenarios. Besides, no much effort has been put in developing open tools to facilitate Learning Object evaluation and use the quality information for the benefit of end users. This paper presents LOEP, an open source web platform that aims to facilitate Learning Object evaluation in different scenarios and educational settings by supporting and integrating several evaluation models and quality metrics. The work exposed in this paper shows that LOEP is capable of providing Learning Object evaluation to e-Learning systems in an open, low cost, reliable and effective way. Possible scenarios where LOEP could be used to implement quality control policies and to enhance search engines are also described. Finally, we report the results of a survey conducted among reviewers that used LOEP, showing that they perceived LOEP as a powerful and easy to use tool for evaluating Learning Objects.

Local relevance evaluation in the accreditation bodies for engineering masters programs

Accreditation models in the international context mainly consider the evaluation of learning outcomes and the ability of programs (or higher education institutions) to achieve the educational objectives stated in their mission. However, it is not clear if these objectives and therefore their outcomes satisfy real national and regional needs, a critical point in engineering master's programs, especially in developing countries. The aim of this paper is to study the importance of the local relevancy evaluation of these programs and to analyze the main models of quality assurance and accreditation bodies of USA, Europe and Latin America, in order to ascertain whether the relevancy is evaluated or not. After a literature review, we found that in a free-market economic context and international education, the accreditation of master's programs follows an international accreditation model, and doesńt take in account in most cases criteria and indicators for local relevancy. It concludes that it is necessary both, international accreditation to ensure the effectiveness of the program (achievement of learning outcomes) and the national accreditation through which it could ensure local relevancy of programs, for which we are giving some indicators.

Evaluation of online tools as didactic resource in the university education

Recently, many efforts have been made in the academic world to adapt the new degrees to the new European Higher Education Area (EHEA). New technologies have been the most important factor to carry out this adaptation. In particular, the tools 2.0 have been spreading quickly, not just the Web 2.0, but even in all the educational levels. Nevertheless, it is now necessary to evaluate whether all these efforts and all the changes, carried out in order to obtain improved academic performance among students, have provided good results. Therefore, the aim of this paper is focused on studying the impact of the implementation of information and communication technologies (ICTs) in a subject belonging to a Master from the University of Alicante in the academic year (2010-2011). In special, it is an elective course called "Advanced Visual Ergonomics" from the Master of Clinical Optometry and Vision. The methodology used to teach this course differs from the traditional one in many respects. For example, one of the resources used for the development of this course is a blog developed specifically to coordinate a series of virtual works, whose purpose is that the student goes into specific aspects of the current topic. Next, the student participates in an active role by writing a personal assessment on the blog. However, in the course planning, there is an attendance to lessons, where the teacher presents certain issues in a more traditional way, that is, with a lecture supported with audiovisual materials, such as materials generated in powerpoint. To evaluate the quality of the results achieved with this methodology, in this work the personal assessment of the students, who have completed this course during this academic year, are collected. In particular, we want to know their opinion about the used resources, as well as the followed methodology. The tool used to collect this information was a questionnaire. This questionnaire evaluates different aspects of the course: a general opinion, quality of the received information, satisfaction about the followed methodology and the student´s critical awareness. The design of this questionnaire is very important to get conclusive information about the methodology followed in the course. The questionnaire has to have an adequate number of questions; whether it has many questions, it might be boring for the student who would pay no enough attention. The questions should be well-written, with a clear structure and message, to avoid confusion and an ambiguity. The questions should be objectives, without any suggestion for a desired answer. In addition, the questionnaire should be interesting to encourage the student´ s interest. In conclusion, this questionnaire developed for this subject provided good information to evaluate whether the methodology was a useful tool to teach "Advanced Visual Ergonomics". Furthermore, the student´s opinion collected by this questionnaire might be very helpful to improve this didactic resource.