La evaluación de la calidad del aprendizaje en la universidad

El trabajo que se presenta en este artículo tiene como objetivo conocer los criterios y decisiones de los profesores universitarios para evaluar el aprendizaje de los estudiantes, y analizar la incidencia de estos factores en la calidad del aprendizaje. Para ello se ha contado con la colaboración de un grupo de profesores de la Universidad de Girona que nos han proporcionado las demandas de evaluación que formulan a través de los exámenes y las respuestas escritas de los estudiantes a estas demandas. Complementariamente se ha realizado una entrevista a los profesores colaboradores para conocer sus criterios e intenciones al realizar la evaluación. Entre las conclusiones obtenidas de este estudio destacaríamos la relación que se produce entre la tipología de pregunta y la demanda formulada, la diversidad de criterios de evaluación existente y la complejidad que supone evaluar la calidad del aprendizaje

Utilización de los apuntes de clase en las carreras de Enfermería y Medicina de la Universidad de Barcelona

Objetivo: Analizar aspectos relacionados con los apuntes que toman los alumnos de Enfermería y Medicina en el transcurso de las respectivas clases. Se comparan cuestiones relacionadas con la revisión, conservación, consulta, préstamo, etc. de los apuntes. Además, se identifican los recursos bibliográficos empleados (artículos, libros, Internet, etc.) como complemento de los apuntes y el uso que se les prevé dar en el futuro. Diseño: Descriptivo y transversal. Emplazamiento: Facultad de Medicina y Escuela de Enfermería de la Universidad de Barcelona. Período de estudio: desde noviembre de 2000 a febrero de 2001. Participantes: Estudiantes del último curso de Medicina y de Enfermería que asistían a una asignatura troncal. Se trata de una muestra no probabilística de conveniencia. Mediciones: Para la obtención de los datos se empleó una encuesta autoadministrada compuesta de 27 preguntas de respuesta múltiple que fue sometida una prueba piloto. Las variables estudiadas fueron: frecuencia en la toma de apuntes, material utilizado, revisión, préstamo, recursos documentales complementarios y su posible uso en el futuro profesional. Resultados principales: Se estudió a 299 sujetos: 168 (56, 19%) pertenecen a la carrera de Enfermería y 131 (43,81%) a la de Medicina. En la muestra, 254 (84,95%) son mujeres y 45 (15,05%) varones. Las medias de edad son de 22,69 (desviación estándar [DE]: 2,84) y 23,47 (DE: 2,56), respectivamente. Se aprecian diferencias estadísticamente significativas en la frecuencia en que se toman apuntes (x2 15,21; df 3; p = 0,002) y en el pasarlos a limpio (x2 66,71; df 3; p < 0,001) a favor de Enfermería; en cambio, se revisan con mayor frecuencia en Medicina (x2 23,04; df 3; p < 0,001). No se observan diferencias en la frecuencia, razones y actitud relacionada con el préstamo de apuntes. En Medicina se complementan los apuntes con mayor frecuencia que en Enfermería (x2 23,16; df 4; p < 0,001). Se tiene intención de guardar y consultar los apuntes sobre todo en Enfermería (x2 144,83; df 1; p < 0,001 ). Conclusiones: los apuntes son considerados como el principal recurso para la preparación de los exámenes en ambas carreras. En Enfermería se les asigna un mayor valor para la realización de la carrera y como material de consulta en el futuro; en tanto que en Medicina es más habitual complementarlos con otros materiales bibliográficos.

Utilización de los apuntes de clase en las carreras de Enfermería y Medicina de la Universidad de Barcelona

Objetivo: Analizar aspectos relacionados con los apuntes que toman los alumnos de Enfermería y Medicina en el transcurso de las respectivas clases. Se comparan cuestiones relacionadas con la revisión, conservación, consulta, préstamo, etc. de los apuntes. Además, se identifican los recursos bibliográficos empleados (artículos, libros, Internet, etc.) como complemento de los apuntes y el uso que se les prevé dar en el futuro. Diseño: Descriptivo y transversal. Emplazamiento: Facultad de Medicina y Escuela de Enfermería de la Universidad de Barcelona. Período de estudio: desde noviembre de 2000 a febrero de 2001. Participantes: Estudiantes del último curso de Medicina y de Enfermería que asistían a una asignatura troncal. Se trata de una muestra no probabilística de conveniencia. Mediciones: Para la obtención de los datos se empleó una encuesta autoadministrada compuesta de 27 preguntas de respuesta múltiple que fue sometida una prueba piloto. Las variables estudiadas fueron: frecuencia en la toma de apuntes, material utilizado, revisión, préstamo, recursos documentales complementarios y su posible uso en el futuro profesional. Resultados principales: Se estudió a 299 sujetos: 168 (56, 19%) pertenecen a la carrera de Enfermería y 131 (43,81%) a la de Medicina. En la muestra, 254 (84,95%) son mujeres y 45 (15,05%) varones. Las medias de edad son de 22,69 (desviación estándar [DE]: 2,84) y 23,47 (DE: 2,56), respectivamente. Se aprecian diferencias estadísticamente significativas en la frecuencia en que se toman apuntes (x2 15,21; df 3; p = 0,002) y en el pasarlos a limpio (x2 66,71; df 3; p < 0,001) a favor de Enfermería; en cambio, se revisan con mayor frecuencia en Medicina (x2 23,04; df 3; p < 0,001). No se observan diferencias en la frecuencia, razones y actitud relacionada con el préstamo de apuntes. En Medicina se complementan los apuntes con mayor frecuencia que en Enfermería (x2 23,16; df 4; p < 0,001). Se tiene intención de guardar y consultar los apuntes sobre todo en Enfermería (x2 144,83; df 1; p < 0,001 ). Conclusiones: los apuntes son considerados como el principal recurso para la preparación de los exámenes en ambas carreras. En Enfermería se les asigna un mayor valor para la realización de la carrera y como material de consulta en el futuro; en tanto que en Medicina es más habitual complementarlos con otros materiales bibliográficos.

Las redes de innovación docente de la Universitat de Girona : la perspectiva de los coordinadores

In 2009 the University of Girona (Spain) created four interest groups on teaching innovation. The objective of the project is that lecturers with an interest in teaching innovation can exchange their points of view and learn from one another, so University teaching is improved as a result. There are four such groups: “Problem based learning (ABP)”, “Cooperative learning”, “Evaluation”, and “Information and Communication Technologies (ICTs) and Teaching”. The coordinators of the groups or networks, as they are also called, are chosen on a free basis by its members. This paper presents their point of view as regards the current activity of encouragement of interest in higher education and they elaborate on the main difficulties involved. The implications of the interdisciplinary work are explored, as well as the challenges of an initiative of this kind. The evolution of the ongoing work is reviewed, taking into account the context of a changing University, the lack of previous experience regarding projects of this kind, the asynchronous communication among the participants, and the necessity of a flexible approach in organizational matters

Estudio sobre la construcción autorregulada del portafolio en el grado de Enfermería

Introduction. This study presents the results of the implementation process of portfolio in the course of four consecutive years. The plan includes three phases (initiation, development and consolidation). The sample is 480 students studying the first year of nursing at the University of Girona. The objective is to evaluate the effectiveness of the instrument and achieve its construction in a self-regulated process. Subjects and methods. The proposed methodology is based on the sequential triangulation between methods. The study of the same empirical unit it’s used two investigation strategies, quantitative and qualitative. Study 1: quantitative, descriptive, longitudinal and prospective. The statistical analysis of paired data for continuous variables that follow a normaldistribution is made with t Student-Fisher test. The correlation between two numerical variables is used the Pearson correlation index. Study 2: qualitative, uses the discussion groups and topics. For textual data analysis is used Atlas.ti. Results. The final score for students who prepare the portfolio is higher (7.78) than the score who do not prepare (7) (p ≤ 0.001). A significant correlation exists between the portfolio score and final score (p ≤ 0.001). The trend study showsa greater sensitivity of the instrument assessment. Conclusion. The final design of the portfolio is characterized by mixed, flexible and encourages the student reflection and empowers the reflection on the continuum of learning

Defining the criteria for the evaluation of self-study multimedia language learning materials: do they facilitate or inhibit learner autonomy?

Durant els darrers anys, s’han publicat un gran nombre de materials multimèdia destinats a l’aprenentatge de llengües, la major part dels quals son CD-ROM dissenyats com a cursos per l’autoaprenentatge. Amb aquests materials, els alumnes poden treballar independentment sense l’assessorament d’un professor, i per aquest motiu s’ha afirmat que promouen i faciliten l’aprenentatge autònom. Aquesta relació, però, no es certa, com Phil Benson i Peter Voller 1997:10) han manifestat encertadament:(…) Such claims are often dubious, however, because of the limited range of options and roles offered to the learner. Nevertheless, technologies of education in the broadest sense can be considered to be either more or less supportive of autonomy. The question is what kind of criteria do we apply in evaluating them? En aquest article presentem una investigació conjunta on es defineixen els criteris que poden ser utilitzats per avaluar materials multimèdia en relació a la seva facilitat per permetre l’aprenentatge autònom. Aquests criteris son la base d’un qüestionari que s’ha emprat per avaluar una selecció de CD-ROM destinats a l’autoaprenentatge de llengües. La estructura d’aquest article és la següent: - Una introducció de l’estudi - Els criteris que s’han utilitzar per la creació del qüestionari - Els resultats generals de l’avaluació - Les conclusions que s’han extret i la seva importància pel disseny instructiu multimèdia

Analysis and evaluation of techniques for the extraction of classes in the ontology learning process

This paper analyzes and evaluates, in the context of Ontology learning, some techniques to identify and extract candidate terms to classes of a taxonomy. Besides, this work points out some inconsistencies that may be occurring in the preprocessing of text corpus, and proposes techniques to obtain good terms candidate to classes of a taxonomy.

A multicase study for the evaluation of a pattern-based visual design process for collaborative learning

Collage is a pattern-based visual design authoring tool for the creation of collaborative learning scripts computationally modelled with IMS Learning Design (LD). The pattern-based visual approach aims to provide teachers with design ideas that are based on broadly accepted practices. Besides, it seeks hiding the LD notation so that teachers can easily create their own designs. The use of visual representations supports both the understanding of the design ideas and the usability of the authoring tool. This paper presents a multicase study comprising three different cases that evaluate the approach from different perspectives. The first case includes workshops where teachers use Collage. A second case implies the design of a scenario proposed by a third-party using related approaches. The third case analyzes a situation where students follow a design created with Collage. The cross-case analysis provides a global understanding of the possibilities and limitations of the pattern-based visual design approach.

Remote collaborative multi-user informal learning experiences: design and evaluation

This paper presents a customizable system used to develop a collaborative multi-user problem solving game. It addresses the increasing demand for appealing informal learning experiences in museum-like settings. The system facilitates remote collaboration by allowing groups of learners tocommunicate through a videoconferencing system and by allowing them to simultaneously interact through a shared multi-touch interactive surface. A user study with 20 user groups indicates that the game facilitates collaboration between local and remote groups of learners. The videoconference and multitouch surface acted as communication channels, attracted students’ interest, facilitated engagement, and promoted inter- and intra-group collaboration—favoring intra-group collaboration. Our findings suggest that augmentingvideoconferencing systems with a shared multitouch space offers newpossibilities and scenarios for remote collaborative environments and collaborative learning.

Gestión de la actividad no presencial y autoevaluación de competencias = Management of student learning outside the classroom and the self-evaluation of competences

La asignatura troncal “Evaluación Psicológica” de los estudios de Psicología y delestudio de grado “Desarrollo humano en la sociedad de la información” de laUniversidad de Girona consta de 12 créditos según la Ley Orgánica de Universidades.Hasta el año académico 2004-05 el trabajo no presencial del alumno consistía en larealización de una evaluación psicológica que se entregaba por escrito a final de curso yde la cual el estudiante obtenía una calificación y revisión si se solicitaba. En el caminohacia el Espacio Europeo de Educación Superior, esta asignatura consta de 9 créditosque equivalen a un total de 255 horas de trabajo presencial y no presencial delestudiante. En los años académicos 2005-06 y 2006-07 se ha creado una guía de trabajopara la gestión de la actividad no presencial con el objetivo de alcanzar aprendizajes anivel de aplicación y solución de problemas/pensamiento crítico (Bloom, 1975)siguiendo las recomendaciones de la Agencia para la Calidad del Sistema Universitariode Cataluña (2005). La guía incorpora: los objetivos de aprendizaje, los criterios deevaluación, la descripción de las actividades, el cronograma semanal de trabajos paratodo el curso, la especificación de las tutorías programadas para la revisión de losdiversos pasos del proceso de evaluación psicológica y el uso del foro para elconocimiento, análisis y crítica constructiva de las evaluaciones realizadas por loscompañeros

Experimental Results and Evaluation of SmartBox Stimulation Device in a P2P E-learning System

In this paper, we present the experimental results and evaluation of the SmartBox stimulation device in P2P e-learning system which is based on JXTA-Overlay. We also show the design and implementation of the SmartBox environment that is used for stimulating the learners motivation to increase the learning efficiency. The SmartBox is integrated with our P2P system as a useful tool for monitoring and controlling learners¿ activity. We found by experimental results that the SmartBox is an effective way to increase the learner¿s concentration. We also investigated the relation between learner¿s body movement, concentration, and amount of study. From the experimental results, we conclude that the use of SmartBox is an effective way to stimulate the learners in order to continue studying while maintaining the concentration.

Gestión de la actividad no presencial y autoevaluación de competencias = Management of Student Learning Outside the Classroom and the Self-evaluation of Competences

Psychological Assessment is a core subject of Psychology studies, and of the university degree Human development, at the University of Girona and according to the University regulations, had 12 credits. Until the 2005-06 academic years, the student work conducted outside the classroom consisted of undertaking a psychological assessment that was written and handed in at the end of the course. From this the student obtained a qualification and a review if they applied for it In accordance with the European Credits for Higher Education, this subject was reduced to 9 credits, which is the equivalent of a total of 255 hours of in-class work and outside the classroom. In the 2006-07 academic year we created a guide to manage the student’s experiences outside the classroom, with the objective of encouraging the application of problem solving/critical thinking (Bloom, 1975), in line with the recommendations of the Catalonia Agency for University System Quality (2005). The guide includes: learning objectives, evaluation criterions, a description of activities, work week timetable for the whole course, programmed tutorials to review all steps of the psychological assessment process, and the use of a web-based virtual forum for the transfer of knowledge, analysis and constructive critiques of the assessment done by themselves and their colleagues

Design and evaluation of learning algorithms for dynamic resource management in virtual networks

Network virtualisation is considerably gaining attentionas a solution to ossification of the Internet. However, thesuccess of network virtualisation will depend in part on how efficientlythe virtual networks utilise substrate network resources.In this paper, we propose a machine learning-based approachto virtual network resource management. We propose to modelthe substrate network as a decentralised system and introducea learning algorithm in each substrate node and substrate link,providing self-organization capabilities. We propose a multiagentlearning algorithm that carries out the substrate network resourcemanagement in a coordinated and decentralised way. The taskof these agents is to use evaluative feedback to learn an optimalpolicy so as to dynamically allocate network resources to virtualnodes and links. The agents ensure that while the virtual networkshave the resources they need at any given time, only the requiredresources are reserved for this purpose. Simulations show thatour dynamic approach significantly improves the virtual networkacceptance ratio and the maximum number of accepted virtualnetwork requests at any time while ensuring that virtual networkquality of service requirements such as packet drop rate andvirtual link delay are not affected.

Electronic voting system for computer supported collaborative learning

The EVS4CSCL project starts in the context of a Computer Supported Collaborative Learning environment (CSCL). Previous UOC projects created a CSCL generic platform (CLPL) to facilitate the development of CSCL applications. A discussion forum (DF) was the first application developed over the framework. This discussion forum was different from other products on the marketplace because of its focus on the learning process. The DF carried out the specification and elaboration phases from the discussion learning process but there was a lack in the consensus phase. The consensus phase in a learning environment is not something to be achieved but tested. Common tests are done by Electronic Voting System (EVS) tools, but consensus test is not an assessment test. We are not evaluating our students by their answers but by their discussion activity. Our educational EVS would be used as a discussion catalyst proposing a discussion about the results after an initial query or it would be used after a discussion period in order to manifest how the discussion changed the students mind (consensus). It should be also used by the teacher as a quick way to know where the student needs some reinforcement. That is important in a distance-learning environment where there is no direct contact between the teacher and the student and it is difficult to detect the learning lacks. In an educational environment, assessment it is a must and the EVS will provide direct assessment by peer usefulness evaluation, teacher marks on every query created and indirect assessment from statistics regarding the user activity.

Searching for and positioning of contextualized learning objects

Learning object economies are marketplaces for the sharing and reuse of learning objects (LO). There are many motivations for stimulating the development of the LO economy. The main reason is the possibility of providing the right content, at the right time, to the right learner according to adequate quality standards in the context of a lifelong learning process; in fact, this is also the main objective of education. However, some barriers to the development of a LO economy, such as the granularity and editability of LO, must be overcome. Furthermore, some enablers, such as learning design generation and standards usage, must be promoted in order to enhance LO economy. For this article, we introduced the integration of distributed learning object repositories (DLOR) as sources of LO that could be placed in adaptive learning designs to assist teachers’ design work. Two main issues presented as a result: how to access distributed LO, and where to place the LO in the learning design. To address these issues, we introduced two processes: LORSE, a distributed LO searching process, and LOOK, a micro context-based positioning process, respectively. Using these processes, the teachers were able to reuse LO from different sources to semi-automatically generate an adaptive learning design without leaving their virtual environment. A layered evaluation yielded good results for the process of placing learning objects from controlled learning object repositories into a learning design, and permitting educators to define different open issues that must be covered when they use uncontrolled learning object repositories for this purpose. We verified the satisfaction users had with our solution