QuesTInSitu: from tests to routes for assessment in situ activities

Test-based assessment tools are mostly focused on the use of computers. However, advanced Information and Communication Technologies, such as handheld devices, opens up the possibilities of creating new assessment scenarios, increasing the teachers’ choices to design more appropriate tests for their subject areas. In this paper we use the term Computing-Based Testing (CBT) instead of Computer-Based Testing, as it captures better the emerging trends. Within the CBT context, the paper is centred on proposing an approach for “Assessment in situ” activities, where questions have to be answered in front of a real space/location (situ). In particular, we present the QuesTInSitu software implementation that includes both an editor and a player based on the IMS Question and Test Interoperability specification and GoogleMaps. With QuesTInSitu teachers can create geolocated questions and tests (routes), and students can answer the tests using mobile devices with GPS when following a route. Three illustrating scenarios and the results from the implementation of one of them in a real educational situation show that QuesTInSitu enables the creation of innovative, enriched and context-aware assessment activities. The results also indicate that the use of mobile devices and location-based systems in assessment activities facilitates students to put explorative and spatial skills into practice and fosters their motivation, reflection and personal observation.

A multicase study for the evaluation of a pattern-based visual design process for collaborative learning

Collage is a pattern-based visual design authoring tool for the creation of collaborative learning scripts computationally modelled with IMS Learning Design (LD). The pattern-based visual approach aims to provide teachers with design ideas that are based on broadly accepted practices. Besides, it seeks hiding the LD notation so that teachers can easily create their own designs. The use of visual representations supports both the understanding of the design ideas and the usability of the authoring tool. This paper presents a multicase study comprising three different cases that evaluate the approach from different perspectives. The first case includes workshops where teachers use Collage. A second case implies the design of a scenario proposed by a third-party using related approaches. The third case analyzes a situation where students follow a design created with Collage. The cross-case analysis provides a global understanding of the possibilities and limitations of the pattern-based visual design approach.

Free-and open source software for a course on network management: authoring and enactment of scripts based on collaborative learning strategies

This paper describes a Computer-Supported Collaborative Learning (CSCL) case study in engineering education carried out within the context of a network management course. The case study shows that the use of two computing tools developed by the authors and based on Free- and Open-Source Software (FOSS) provide significant educational benefits over traditional engineering pedagogical approaches in terms of both concepts and engineering competencies acquisition. First, the Collage authoring tool guides and supports the course teacher in the process of authoring computer-interpretable representations (using the IMS Learning Design standard notation) of effective collaborative pedagogical designs. Besides, the Gridcole system supports the enactment of that design by guiding the students throughout the prescribed sequence of learning activities. The paper introduces the goals and context of the case study, elaborates onhow Collage and Gridcole were employed, describes the applied evaluation methodology, anddiscusses the most significant findings derived from the case study.

LdShake: learning design solutions sharing and co-edition

Two important challenges that teachers are currently facing are the sharing and the collaborative authoring of their learning design solutions, such as didactical units and learning materials. On the one hand, there are tools that can be used for the creation of design solutions and only some of them facilitate the co-edition. However, they do not incorporate mechanisms that support the sharing of the designs between teachers. On the other hand, there are tools that serve as repositories of educational resources but they do not enable the authoring of the designs. In this paper we present LdShake, a web tool whose novelty is focused on the combined support for the social sharing and co-edition of learning design solutions within communities of teachers. Teachers can create and share learning designs with other teachers using different access rights so that they can read, comment or co-edit the designs. Therefore, each design solution is associated to a group of teachers able to work on its definition, and another group that can only see the design. The tool is generic in that it allows the creation of designs based on any pedagogical approach. However, it can be particularized in instances providing pre-formatted designs structured according to a specific didactic method (such as Problem-Based Learning, PBL). A particularized LdShake instance has been used in the context of Human Biology studies where teams of teachers are required to work together in the design of PBL solutions. A controlled user study, that compares the use of a generic LdShake and a Moodle system, configured to enable the creation and sharing of designs, has been also carried out. The combined results of the real and controlled studies show that the social structure, and the commenting, co-edition and publishing features of LdShake provide a useful, effective and usable approach for facilitating teachers' teamwork.

Reusing IMS-LD formalized best practices in collaborative learning structuring

Designs of CSCL (Computer Supported Collaborative Learning)activities should be flexible, effective and customizable toparticular learning situations. On the other hand, structureddesigns aim to create favourable conditions for learning. Thus,this paper proposes the collection of representative and broadlyaccepted (best practices) structuring techniques in collaborative learning. With the aim of establishing a conceptual common ground among collaborative learning practitioners and softwaredevelopers, and reusing the expertise that best practicesrepresent, the paper also proposes the formulation of these techniques as patterns: the so-called CLFPs (CollaborativeLearning Flow Patterns). To formalize these patterns, we havechosen the educational modelling language IMS Learning Design (IMS-LD). IMS-LD has the capability to specify many of the collaborative characteristics of the CLFPs. Nevertheless, the language bears limited capability for describing the services that mediate interactions within a learning activity and the specification of temporal or rotated roles. This analysis isdiscussed in the paper, as well as our approaches towards thedevelopment of a system capable of integrating tools using IMSLDscripts and a CLFP-based Learning Design authoring tool.

Applying recommendations to aligncompetences, methodology and assessment in Telematics, Computing and Electronic Engineering courses

The alignment between competences, teaching-learning methodologies and assessment is a key element of the European Higher Education Area. This paper presents the efforts carried out by six Telematics, Computer Science and Electronic Engineering Education teachers towards achieving this alignment in their subjects. In a joint work with pedagogues, a set of recommended actions were identified. A selection of these actions were applied and evaluated in the six subjects. The cross-analysis of the results indicate that the actions allow students to better understand the methodologies and assessment planned for the subjects, facilitate (self-) regulation and increase students’ involvement in the subjects.

Hierachy-based methodology for producing educational contents with maximal reutilization

Computer based training or distance education are facing dramatic changes withthe advent of standardization efforts, some of them concentrating in maximal reuse.This is of paramount importance for a sustainable -cost affordable- production ofeducational materials. Reuse in itself should not be a goal, though, since manymethodological aspects might be lost. In this paper we propose two contentproduction approaches for the InterMediActor platform under a competence-basedmethodology: either a bottom-up approach where content is designed from scratchor a top-down methodology where existing material can be gradually adapted tofulfil requisites to be used with maximal flexibility into InterMediActor.

Guiding students through competence-based educational material

Student guidance is an always desired characteristic in any educational system, butit represents special difficulty if it has to be deployed in an automated way to fulfilsuch needs in a computer supported educational tool. In this paper we explorepossible avenues relying on machine learning techniques, to be included in a nearfuture -in the form of a tutoring navigational tool- in a teleeducation platform -InterMediActor- currently under development. Since no data from that platform isavailable yet, the preliminary experiments presented in this paper are builtinterpreting every subject in the Telecommunications Degree at Universidad CarlosIII de Madrid as an aggregated macro-competence (following the methodologicalconsiderations in InterMediActor), such that marks achieved by students can beused as data for the models, to be replaced in a near future by real data directlymeasured inside InterMediActor. We evaluate the predictability of students qualifications, and we deploy a preventive early detection system -failure alert-, toidentify those students more prone to fail a certain subject such that correctivemeans can be deployed with sufficient anticipation.

La introducción del inglés en la docencia y su influencia en los contenidos de las asignaturas de Derecho Financiero y Tributario

A pesar de que numerosos juristas (jueces, notarios, registradores de la propiedad...) puedan desarrollarsu carrera profesional sin necesitar conocer lenguas extranjeras, el dominio del inglés es una competenciaimprescindible para desarrollar una carrera profesional como jurista en los principalesdespachos de abogados españoles, en empresas multinacionales o en organizaciones internacionales.Así pues, es lógico que en el actual contexto del espacio europeo de educación superior los nuevosestudios de Grado promuevan el dominio de esta competencia introduciendo el inglés en la docencia.En el ámbito particular del Derecho Financiero y Tributario ello no resulta frecuentemente posible ya quefundamentalmente se estudia el ordenamiento jurídico español y por lo tanto las fuentes se encuentrandisponibles únicamente en castellano. Sin embargo, existen varias estrategias que permiten introducir elinglés en la docencia, aunque sea de forma parcial y afectando ligeramente a los contenidos tradicionalesde las asignaturas. Una posibilidad consiste en tratar cuestiones de Derecho Comparado en lasactividades que se desarrollan en las asignaturas centradas en el Derecho español. Otra posibilidadconsiste en impartir la asignatura de Fiscalidad Internacional en inglés, si bien ello requiere reformularsu contenido y centrarlo en los principios generales en vez de en la normativa española que regula latributación de supuestos de hecho con elementos internacionales. A pesar de que la introducción delinglés en la docencia plantee un importante reto tanto para el alumnado como para el profesorado, entendemosque es algo necesario en los tiempos actuales.

La evaluación como elemento clave de la formación basada en competencias: tres casos en el ámbito de la ingenierías

El Espacio Europeo de Educación Superior implica cambios organizativos y académicos referentes a la formación basada en competencias. El proyecto AlineaME, coordinado por la Unidad de Soporte a la Calidad y la Innovación Docente de la Escuela Superior Politécnica - Universidad Pompeu Fabra, propuso a docentes del área TIC y a pedagogos la reflexión conjunta en aras a diseñar recomendaciones centradas en la alineación entre los tres elementos clave del proyecto: competencias, metodología y evaluación (C*M*E). Este trabajo recoge tres casos de aplicación de recomendaciones, concretamente de Ingeniería Telemática (dos casos - Universidad de Valladolid y Pompeu Fabra) y de Ingeniería Técnica en Informática de Gestión (un caso - Universidad de Sevilla).Las recomendaciones aplicadas hacen referencia a la necesidad de explicitar la alineación C*M*E en los Planes Docentes de Asignaturas y de presentar esta alineación al estudiantado. También a la integración de la evaluación de la asignatura como tarea-proceso de aprendizaje. La metodología seguida para laaplicación de ambas es (salvo pequeñas diferencias) parecida en los tres casos. La primera recomendación consistió en recoger en el Plan Docente la Alineación y en verbalizar dicha alineación en la sesión de presentación de la asignatura. La segunda se incorporó incluyendo actividades formativas en las que se favorecía la evaluación entre iguales. Para evaluar la aplicación de recomendaciones se recogieron evidencias en clave de satisfacción por parte del estudiantado así como valoraciones de los propios docentes. Para ello se diseñaron instrumentos específicos.En cuanto a la presentación de la alineación C*M*E en los Planes Docentes de asignaturas, los resultados indican que los alumnos son más conscientes de qué, cómo y por qué van a trabajar y ser evaluados. Globalmente valoran positivamente su utilidad para la autorregulación. Asimismo, plantear la evaluación como tarea deaprendizaje resultó ser para los estudiantes un interesante elemento de reflexión.

Uso de rúbricas para el seguimiento y evaluación de los trabajos fin de grado

En este trabajo se presenta una muestra de la experiencia llevada a cabo en la Escuela Superior Politécnica de la Universitat Pompeu Fabra en cuanto al uso de rúbricas para el seguimiento y evaluación de los, hasta el momento, Proyectos Fin de Carrera. Los primeros resultados, basados en informaciones provenientes tanto de directores, miembros de tribunal como de los propiosestudiantes, muestran que, de manera global, el uso de rúbricas permitesistematizar tanto el seguimiento como la evaluación de los trabajos realizados, a la vez que facilita la homogenización de criterios (en clave de rigurosidad y transparencia). Por otro lado, esta experiencia nos ha permitido constatar algunos elementos de mejora de las rúbricas de cara a su implantación durante el curso académico 2012-2013 cuando comiencen en nuestra escuela los denominados Trabajos de Fin de Grado.

Learning design twofold strategies for teacher-led inquiry andstudent active learning

This workshop paper states that fostering active student participation both in face-to-face lectures / seminars and outside the classroom (personal and group study at home, the library, etc.) requires a certain level of teacher-led inquiry. The paper presents a set of strategies drawn from real practice in higher education with teacher-led inquiry ingredients that promote active learning. Thesepractices highlight the role of the syllabus, the importance of iterative learning designs, explicit teacher-led inquiry, and the implications of the context, sustainability and practitioners’ creativity. The strategies discussed in this paper can serve as input to the workshop as real cases that need to be represented in design and supported in enactment (with and without technologies).

From a pattern-language to a pattern ontology approach for CSCL script design

Collaborative activities, in which students actively interact with each other, have proved to provide significant learning benefits. In Computer-Supported Collaborative Learning (CSCL), these collaborative activities are assisted by technologies. However, the use of computers does not guarantee collaboration, as free collaboration does not necessary lead to fruitful learning. Therefore, practitioners need to design CSCL scripts that structure the collaborative settings so that they promote learning. However, not all teachers have the technical and pedagogical background needed to design such scripts. With the aim of assisting teachers in designing effective CSCL scripts, we propose a model to support the selection of reusable good practices (formulated as patterns) so that they can be used as a starting point for their own designs. This model is based on a pattern ontology that computationally represents the knowledge captured on a pattern language for the design of CSCL scripts. A preliminary evaluation of the proposed approach is provided with two examples based on a set of meaningful interrelated patters computationally represented with the pattern ontology, and a paper prototyping experience carried out with two teaches. The results offer interesting insights towards the implementation of the pattern ontology in software tools.

Overeducation among European university graduates : a comparative analysis ot its incidence and the importance of higher education differentiation

The incidence of over-education is here assessed by applying some standard subjective and objective indicators and a new skill-based indicator of over-education to the national samples of eight European countries in the REFLEX survey. With the exception of Spain, the results reveal that over-education is a minor risk amongst European tertiary graduates. Yet, the contrast between the standard indicators and the skill-based indicator reveals the existence of an over-education of a moderate kind in countries with high tertiary attainment rates (Norway, Finland and Netherlands). Such a type of over-education does not come to the surface when applying the standard indicators. Our results also reveal the importance of higher education differentiation (i.e. field of study and branch of higher education) for understanding the risk of over-education. Graduates from humanistic fields, bachelor courses and vocational colleges are more exposed to over-education, though their disadvantage varies across-nationally to a significant extent.

Teaching ethnic diversity in journalism school

It has been found that the symbolic elites have a prominent role in the discursive reproduction of racism in society, because they control the public discourse through which many ethnic prejudices are spread and shared. This special position of the mass media requires that the professional education of journalists, also featuring such topics as ethnic studies, diversity and racism, is optimally adapted to the multicultural societies in Europe, North America and Australia. This paper reports about an extensive research project examining ethnic education of journalists in these white-dominated countries, by examining the websites of many journalism and communication departments. Consistent with the general finding that white symbolic elites primarily deny or ignore (their) racism in society, none of the academic programs, anywhere in the world, mentions special classes on racism in the mass media. Finally, a practical proposal is made for a course on ethnic reporting in multicultural societies.