La evaluación de los aprendizajes en los sMOOC. Estudio de caso en el Proyecto Europeo ECO

El siguiente artículo hace una reflexión crítica sobre los MOOC, prestando especial atención al análisis de los nuevos sistemas de evaluación; en concreto, el método peer to peer, y cómo esto afecta al rol de docentes y estudiantes. El estudio se ha llevado a cabo tomando como referencia dos sMOOC liderados por el Proyecto Europeo ECO (Elearning, Communication and Open-data: Massive Mobile, Ubiquitous and Open Learning). Los resultados que se presentan han sido analizados desde una perspectiva cuantitativa, utilizando como muestra a los miembros de la comunidad de aprendizaje que han participado en ambos cursos. A través de la utilización de un cuestionario se ha podido conocer cómo han valorado su experiencia formativa y su grado de satisfacción. La mitad de los sujetos encuestados ha considerado adecuado y justo el nuevo sistema evaluativo, sin embargo existe otra mitad que lo considera injusto y que tiene lagunas. Se ha abordado la evaluación como una parte intrínseca del proceso educativo y por ello se ha enfatizado en aspectos como el empoderamiento del alumnado, la cultura de la participación y la interacción social, conceptos que nos acercan a nuevos modelos de aprendizaje que potencian el intelecto colectivo y dejan atrás sistemas transmisivos de conocimiento.

Evaluation of hybrid and distance education learning environments in Spain

This article describes the adaptation and validation of the Distance Education Learning Environments Survey (DELES) for use in investigating the qualities found in distance and hybrid education psycho-social learning environments in Spain. As Europe moves toward post-secondary student mobility, equanimity in access to higher education, and more standardised degree programs across the European Higher Education Area (EHEA) the need for a high quality method for continually assessing the excellence of distance and hybrid learning environments has arisen. This study outlines how the English language DELES was adapted into the new Spanish-Distance Education Learning Environments Survey (S-DELES) for use with a Bachelor of Psychology and Criminology degree program offering both distance and hybrid education classes. We present the relationships between psycho-social learning environment perceptions and those of student affect. We also present the asynchronous aspects of the environment, scale means, and a comparison between the perceptions of distance education students and their hybrid education counterparts that inform the university about the baseline health of the information and communication technologies (ICT) environment within which the study was conducted.

Development and psychometric testing of the clinical learning environment, supervision and nurse teacher evaluation scale (CLES+T): The Spanish version

Background: The Clinical Learning Environment, Supervision and Nurse Teacher scale is a reliable and valid instrument to evaluate the quality of the clinical learning process in international nursing education contexts. Objectives: This paper reports the development and psychometric testing of the Spanish version of the Clinical Learning Environment, Supervision and Nurse Teacher scale. Design: Cross-sectional validation study of the scale. Setting: 10 public and private hospitals in the Alicante area, and the Faculty of Health Sciences (University of Alicante, Spain). Participants: 370 student nurses on clinical placement (January 2011–March 2012). Methods: The Clinical Learning Environment, Supervision and Nurse Teacher scale was translated using the modified direct translation method. Statistical analyses were performed using PASW Statistics 18 and AMOS 18.0.0 software. A multivariate analysis was conducted in order to assess construct validity. Cronbach’s alpha coefficient was used to evaluate instrument reliability. Results: An exploratory factorial analysis identified the five dimensions from the original version, and explained 66.4% of the variance. Confirmatory factor analysis supported the factor structure of the Spanish version of the instrument. Cronbach’s alpha coefficient for the scale was .95, ranging from .80 to .97 for the subscales. Conclusion: This version of the Clinical Learning Environment, Supervision and Nurse Teacher scale instrument showed acceptable psychometric properties for use as an assessment scale in Spanish-speaking countries.

Evaluation of the Implementation of CLIL (Content and Language Integrated Learning) Methodology in the Didactics of the English Language in Preschool Education Course Taught in the Preschool Education Teacher Undergraduate Program at the University of Alicante

Although it is known that the Spanish current Educative System promotes using the Communicate Approach to teach foreign languages in schools, other recently designed approaches are also used to help students improve their skills when communicating in a foreign language. One of these approaches is Content and Language Integrated Learning, also known as CLIL, which is used to teach content courses using the English language as the language of instruction. This approach improves the students’ skills in English as the same time as they learn content from other areas. The goal of this thesis is to present a research project carried out at the University of Alicante during the academic year 2011-2012. With this research we obtained results that provide quantitative and qualitative data which explains how the use of the CLIL methodology affects the English level of students in the “Didactics of the English Language in Preschool Education” course in Preschool Education Teacher Undergraduate Program as students acquire the contents of the course.

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing

Objective: to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. Method: prospective longitudinal study conducted in a population of 60 second-year Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. Results: nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). Conclusion: the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teaching-learning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care.

An exercises editor for an e-learning environment

One of the most important tenets of e-learning is that it bridges work and learning. A great e-learning experience brings learning into the work environment. This is a key point, the capacity to construct a work environment when the student can develop proper tasks to complete the learning process. This paper describes a work environment based on the development of two tools, an exercises editor and an exercises viewer. Both tools are able to manage color images where, because of the implementation of basic steganographic techniques, it is possible to add information, exercises, questions, and so on. The exercises editor allows to decide which information must be visible or remain hidden to the user, when the image is loaded in the exercises viewer. Therefore, it is possible to hide the solutions of the proposed tasks; this is very useful to complete a self-evaluation learning process. These tools constitute a learning architecture with the final objective that learners can apply and practice new concepts or skills.

How do primary health care teams learn to integrate intimate partner violence (IPV) management? A realist evaluation protocol

Background: Despite the existence of ample literature dealing, on the one hand, with the integration of innovations within health systems and team learning, and, on the other hand, with different aspects of the detection and management of intimate partner violence (IPV) within healthcare facilities, research that explores how health innovations that go beyond biomedical issues—such as IPV management—get integrated into health systems, and that focuses on healthcare teams’ learning processes is, to the best of our knowledge, very scarce if not absent. This realist evaluation protocol aims to ascertain: why, how, and under what circumstances primary healthcare teams engage (if at all) in a learning process to integrate IPV management in their practices; and why, how, and under what circumstances team learning processes lead to the development of organizational culture and values regarding IPV management, and the delivery of IPV management services. Methods: This study will be conducted in Spain using a multiple-case study design. Data will be collected from selected cases (primary healthcare teams) through different methods: individual and group interviews, routinely collected statistical data, documentary review, and observation. Cases will be purposively selected in order to enable testing the initial middle-range theory (MRT). After in-depth exploration of a limited number of cases, additional cases will be chosen for their ability to contribute to refining the emerging MRT to explain how primary healthcare learn to integrate intimate partner violence management. Discussion: Evaluations of health sector responses to IPV are scarce, and even fewer focus on why, how, and when the healthcare services integrate IPV management. There is a consensus that healthcare professionals and healthcare teams play a key role in this integration, and that training is important in order to realize changes. However, little is known about team learning of IPV management, both in terms of how to trigger such learning and how team learning is connected with changes in organizational culture and values, and in service delivery. This realist evaluation protocol aims to contribute to this knowledge by conducting this project in a country, Spain, where great endeavours have been made towards the integration of IPV management within the health system.

Towards a new proposal to evaluate the learning objects quality in learning strategies for education (QEES)

In Computer Science world several proposals have been developed for the assessment of the quality of the digital objects, based on the capabilities and facilities offered by current technologies and the available resources. Years ago researchers and specialists from both educational and technological areas have been committed to the development of strategies that improve the quality of education. At present, in the field of teaching-learning, another important aspect is the need to improve the manner of gaining knowledge and learning in education, which the use of learning strategies is a major advance in the teaching-learning process in institutions of higher education. This paper presents QEES, a proposal for evaluating the quality of the learning objects employed on learning strategies to support students during their education processes by using information extraction techniques and ontologies.

Level of involvement of clinical nurses in the evaluation of competence of nursing students

Objective. To determine the level of involvement of clinical nurses accredited by the Universitat Jaume I (Spain) as mentors of practice (Reference Nurses) in the evaluation of competence of nursing students. Methodolgy. Cross-sectional study, in which the “Clinical Practice Assessment Manual” (CPAM) reported by reference 41 nurses (n=55) were analyzed. Four quality criteria for completion were established: with information at least 80% of the required data, the presence of the signature and final grade in the right place. Verification of learning activities was also conducted. Data collection was performed concurrently reference for nurses and teachers of the subjects in the formative evaluations of clinical clerkship period in the matter “Nursing Care in Healthcare Processes “, from March to June 2013. Results. 63% of CPAM were completed correctly, without reaching the quality threshold established (80%). The absence of the signature is the main criteria of incorrect completion (21%). Nine learning activities do not meet the quality threshold set (80%) (p < 0.05). There are significant differences according to clinical units p < 0.05. From the 30 learning activities evaluated in the CPAM, it can be stated that nine of them do not reach the verification threshold established (80%), therefore it cannot be assumed that these activities had been completed by students and evaluated by the RefN throughout the clinical clerkship period. Conclusion. The level of involvement of Reference Nurse cannot be considered adequate, although strategies to encourage involvement through collaboration and training must be developed.

An electronic record system in nursing education: evaluation and utilization

The main objective of the present work is to analyze the results of the utilization and evaluation of the LORETO Record System (LRS), providing improvement areas in the teaching-learning process and technology, in second year nursing students. A descriptive, prospective, cross sectional study using inferential statics has been carried out on all electronic records reported by 55 nursing students during clinical internships (April 1º-June 26º, 2013). Electronic record average rated 7.22 points (s=0.6; CV=0.083), with differences based on the clinical practice units (p<0,05). Three items assessed did not exceed the quality threshold set at 0.7 (p<0.05). Record Rate exceeds the quality threshold set at 80% for the overall sample, with differences based on the practice units. Only two clinical practice units rated above the minimum threshold (p <0.05). Record of care provision every 3 days did not reach the estimated quality threshold (p <0.05). There is a dichotomy between qualitative and quantitative results of LRS. Improvement areas in theoretical education have been identified. The LRS seems an appropriate learning and assessment tool, although the development of a new APP version and the application of principles of gamification should be explored.

Factors that determine the level of commitment of our teaching staff when the implementation of continuous evaluation system takes place

Comunicación presentada en CIDUI 2010, Congreso Internacional Docencia Universitaria e Innovación, Barcelona, 30 junio-2 julio 2010.