International journal of engineering education

This work presents an analysis of the assessment tools used by professors at the Universitat Politécnica de Catalunya to assess the generic competencies introduced in the Bachelor’s Degrees in Engineering. In order to conduct this study, a survey was designed and administered anonymously to a sample of the professors most receptive to educational innovation at their own university. All total, 80 professors responded to this survey, of whom 26% turned out to be members of the university’s own evaluation innovation group (https://www.upc.edu/rima/grups/grapa), GRAPA. This percentage represents 47% of the total GRAPA membership, meaning that nearly half of the professors most concerned about evaluation at the university chose to participate. The analysis of the variables carried out using the statistical program SPSS v19 shows that for practically 49% of those surveyed, rubrics are the tools most commonly used to assess generic competencies integrated in more specific ones. Of those surveyed, 60% use them either frequently or always. The most frequently evaluated generic competencies were teamwork (28%), problem solving (26%), effective oral and written communication (24%) and autonomous learning (13%), all of which constitute commonly recognized competencies in the engineering profession. A two-dimensional crosstabs analysis with SPSS v19 shows a significant correlation (Asymp. Sig. 0.001) between the type of tool used and the competencies assessed. However, no significant correlation was found between the type of assessment tool used and the type of subject, type of evaluation (formative or summative), frequency of feedback given to the students or the degree of student satisfaction, and thus none of these variables can be considered to have an influence on the kind of assessment tool used. In addition, the results also indicate that there are no significant differences between the instructors belonging to GRAPA and the rest of those surveyed

A multicase study for the evaluation of a pattern-based visual design process for collaborative learning

Collage is a pattern-based visual design authoring tool for the creation of collaborative learning scripts computationally modelled with IMS Learning Design (LD). The pattern-based visual approach aims to provide teachers with design ideas that are based on broadly accepted practices. Besides, it seeks hiding the LD notation so that teachers can easily create their own designs. The use of visual representations supports both the understanding of the design ideas and the usability of the authoring tool. This paper presents a multicase study comprising three different cases that evaluate the approach from different perspectives. The first case includes workshops where teachers use Collage. A second case implies the design of a scenario proposed by a third-party using related approaches. The third case analyzes a situation where students follow a design created with Collage. The cross-case analysis provides a global understanding of the possibilities and limitations of the pattern-based visual design approach.

What form of relative performance evaluation?

We study relative performance evaluation in executive compensation whenexecutives have private information about their ability. We assume that thejoint distribution of an individual firm s profit and market movements dependson the ability of the executive that runs the firm. In the equilibrium of theexecutive labor market, compensation schemes exploit this fact to sortexecutives of di ?erent abilities. This implies that executive compensation isincreasing in own performance, but may also be increasing in industryperformance-a sharp departure from standard relative performance evaluation.This result provides an explanation for the scarcity of relative performanceconsiderations in executive compensation documented by the empirical literature.

Evaluation of transversal competencies: pilot project in a maths course for first-year business

The aim of this communication is to describe the results of a pilot project for the assessment of the transversal competency "the capacity for learning and responsibility". This competency is centred on the capacity for the analysis, synthesis, overview, and practical application of newly acquired knowledge. It is proposed by the University of Barcelona in its undergraduate degree courses,through multidisciplinary teaching teams. The goal of the pilot project is to evaluate this competency.We worked with a group of students in a first-year Business Degree maths course, during the firstsemester of the 2012/2013 academic year. The development of the project was in two stages: (i)design of a specific task to share with the same students in the following semester when the subjectwould be economic history; and (ii) the elaboration of an evaluation rubric in which we defined thecontent, the aspects to evaluate, the evaluation criteria, and the marking scale. The attainment of theexpectations of quality on the specific task was scored following this rubric, which provided a singlebasis for the precise and fair assessment by the instructor and for the students' own self-evaluation.We conclude by describing the main findings of the experience. There particularly stood out the highscore in the students' self-evaluation given to one aspect of the competency – their capacity forlearning – in stark contrast to their instructor's quite negative evaluation. This means that we have towork both to improve teaching practice and to identify the optimal competency evaluationmethodology.

Correlating trainees' translating performance with the quality of their metacognitive self-evaluation

This paper presents a study of correlations between the performance of trainee translators, according to their teacher’s assessment, and the quality of their self-evaluation, according to their answers to metacognitive questionnaires. Two case-studies of two consecutive editions of a course in general translation from German into Spanish are dealt with. The course involved the use of post-translation metacognitive questionnaires designed to help trainees to evaluate their translating. A selection of the questionnaires (from the strongest and the weakest performances by students for each course edition) is considered. The study focuses on one item in these questionnaires that has to do with identifying translation problems and justifying their solutions. An interpretive analysis of the trainees’ answers for this questionnaire item reveals that the best-performing students were more strategically and translationally aware in self-evaluating their own translating. Our conclusions are based on considering six parameters from the analysis of the trainees’ answers, which are tentatively regarded as indicative of the quality of their self-evaluation.

A proposal to establish indicators for the evaluation of municipal councils' socio-cultural policies

How can municipal sociocultural policies stimulate and promote community empowerment, civic creativity or social cohesion? What objectives should be proposed at the municipal level to promote processes of sociocultural community development? How can we identify local needs in order to stimulate community development processes? In response to these questions, our paper proposes a creative solution: indicators to evaluate sociocultural policies. The proposal will enable us to obtain information about our own reality and, at the same time, contribute to producing changes and to outlining possible de intervention strategies for local administrations. The proposal describes a system of creative, flexible and rigourous indicators intended for municipal technicians and politicians interested in evaluating their sociocultural actions and strategies. We present the result of a research process whose methods included validation of the indicators by experts and technicians in or related to sociocultural community development, and the application of this system based on a case study of a Spanish municipality. Among the proposed indicators specific consideration is given to the support of local creators and the promotion of civic creativity, as well as the use, the creation and the articulation of sociocultural activities as strategies to contribute to cultural and civic diversity

The use of non-animal alternatives in the safety evaluations of cosmetics ingredients by the Scientific Committee on Consumer Safety (SCCS)

In Europe, the safety evaluation of cosmetics is based on the safety evaluation of each individual ingredient. Article 3 of the Cosmetics Regulation specifies that a cosmetic product made available on the market is to be safe for human health when used normally or under reasonably foreseeable conditions. For substances that cause some concern with respect to human health (e.g. colorants, preservatives, UV-filters), safety is evaluated at the Commission level by a scientific committee, presently called the Scientific Committee on Consumer Safety (SCCS). According to the Cosmetics Regulations, in the EU, the marketing of cosmetics products and their ingredients that have been tested on animals for most of their human health effects, including acute toxicity, is prohibited. Nevertheless, any study dating from before this prohibition took effect is accepted for the safety assessment of cosmetics ingredients. The in vitro methods reported in the dossiers summited to the SCCS are here evaluated from the published reports issued by the scientific committee of the Directorate General of Health and Consumers (DG SANCO); responsible for the safety of cosmetics ingredients. The number of studies submitted to the SCCS that do not involve animals is still low and in general the safety of cosmetics ingredients is based on in vivo studies performed before the prohibition.