A Web-based Support System for Providing Effective Monitoring, Feedback and Evaluation in Project Management Education

This work introduces a web-based learning environment to facilitate learning in Project Management. The proposed web-based support system integrates methodological procedures and information systems, allowing to promote learning among geographically-dispersed students. Thus, students who are enrolled in different universities at different locations and attend their own project management courses, share a virtual experience in executing and managing projects. Specific support systems were used or developed to automatically collect information about student activities, making it possible to monitor the progress made on learning and assess learning performance as established in the defined rubric.

Active learning and generic competences in an operating systems course

The Bologna Declaration and the implementation of the European Higher Education Area are promoting the use of active learning methodologies. The aim of this study is to evaluate the effects obtained after applying active learning methodologies to the achievement of generic competences as well as to the academic performance. This study has been carried out at the Universidad Politécnica de Madrid, where these methodologies have been applied to the Operating Systems I subject of the degree in Technical Engineering in Computer Systems. The fundamental hypothesis tested was whether the implementation of active learning methodologies (cooperative learning and problem based learning) favours the achievement of certain generic competences (‘teamwork’ and ‘planning and time management’) and also whether this fact improved the academic performance of our students. The original approach of this work consists in using psychometric tests to measure the degree of acquired student’s generic competences instead of using opinion surveys, as usual. Results indicated that active learning methodologies improve the academic performance when compared to the traditional lecture/discussion method, according to the success rate obtained. These methods seem to have as well an effect on the teamwork competence (the perception of the behaviour of the other members in the group) but not on the perception of each students’ behaviour. Active learning does not produce any significant change in the generic competence ‘planning and time management'.

Cooperative Learning vs. Project Base Learning.

The Bologna Declaration and the implementation of the European Higher Education Area are promoting the use of active learning methodologies such as cooperative learning and project based learning. This study was motivated by the comparison of the results obtained after applying Cooperative Learning (CL) and Project Based Learning (PBL) to a subject of Computer Engineering. The fundamental hypothesis tested was whether the academic success achieved by the students of the first years was higher when CL was applied than in those cases to which PBL was applied. A practical case, by means of which the effectiveness of CL and PBL are compared, is presented in this work. This study has been carried out at the Universidad Politécnica de Madrid, where these mechanisms have been applied to the Operating Systems I subject from the Technical Engineering in Computer Systems degree (OSIS) and to the same subject from the Technical Engineering in Computer Management degree (OSIM). Both subjects have the same syllabus, are taught in the same year and semester and share also formative objectives. From this study we can conclude that students¿ academic performance (regarding the grades given) is greater with PBL than with CL. To be more specific, the difference is between 0.5 and 1 point for the individual tests. For the group tests, this difference is between 2.5 and 3 points. Therefore, this study refutes the fundamental hypothesis formulated at the beginning. Some of the possible interpretations of these results are referred to in this study.

A web-based application for the management and evaluation of tutoring requests in PBL-based massive laboratories

One important steps in a successful project-based-learning methodology (PBL) is the process of providing the students with a convenient feedback that allows them to keep on developing their projects or to improve them. However, this task is more difficult in massive courses, especially when the project deadline is close. Besides, the continuous evaluation methodology makes necessary to find ways to objectively and continuously measure students' performance without increasing excessively instructors' work load. In order to alleviate these problems, we have developed a web service that allows students to request personal tutoring assistance during the laboratory sessions by specifying the kind of problem they have and the person who could help them to solve it. This service provides tools for the staff to manage the laboratory, for performing continuous evaluation for all students and for the student collaborators, and to prioritize tutoring according to the progress of the student's project. Additionally, the application provides objective metrics which can be used at the end of the subject during the evaluation process in order to support some students' final scores. Different usability statistics and the results of a subjective evaluation with more than 330 students confirm the success of the proposed application.

Especificaciones eMathTeacher, creación del Modelo Granular Lingüístico de la evaluación del aprendizaje humano, y diseño de sistemas que implementan estos conceptos

El concepto de algoritmo es básico en informática, por lo que es crucial que los alumnos profundicen en él desde el inicio de su formación. Por tanto, contar con una herramienta que guíe a los estudiantes en su aprendizaje puede suponer una gran ayuda en su formación. La mayoría de los autores coinciden en que, para determinar la eficacia de una herramienta de visualización de algoritmos, es esencial cómo se utiliza. Así, los estudiantes que participan activamente en la visualización superan claramente a los que la contemplan de forma pasiva. Por ello, pensamos que uno de los mejores ejercicios para un alumno consiste en simular la ejecución del algoritmo que desea aprender mediante el uso de una herramienta de visualización, i. e. consiste en realizar una simulación visual de dicho algoritmo. La primera parte de esta tesis presenta los resultados de una profunda investigación sobre las características que debe reunir una herramienta de ayuda al aprendizaje de algoritmos y conceptos matemáticos para optimizar su efectividad: el conjunto de especificaciones eMathTeacher, además de un entorno de aprendizaje que integra herramientas que las cumplen: GRAPHs. Hemos estudiado cuáles son las cualidades esenciales para potenciar la eficacia de un sistema e-learning de este tipo. Esto nos ha llevado a la definición del concepto eMathTeacher, que se ha materializado en el conjunto de especificaciones eMathTeacher. Una herramienta e-learning cumple las especificaciones eMathTeacher si actúa como un profesor virtual de matemáticas, i. e. si es una herramienta de autoevaluación que ayuda a los alumnos a aprender de forma activa y autónoma conceptos o algoritmos matemáticos, corrigiendo sus errores y proporcionando pistas para encontrar la respuesta correcta, pero sin dársela explícitamente. En estas herramientas, la simulación del algoritmo no continúa hasta que el usuario introduce la respuesta correcta. Para poder reunir en un único entorno una colección de herramientas que cumplan las especificaciones eMathTeacher hemos creado GRAPHs, un entorno ampliable, basado en simulación visual, diseñado para el aprendizaje activo e independiente de los algoritmos de grafos y creado para que en él se integren simuladores de diferentes algoritmos. Además de las opciones de creación y edición del grafo y la visualización de los cambios producidos en él durante la simulación, el entorno incluye corrección paso a paso, animación del pseudocódigo del algoritmo, preguntas emergentes, manejo de las estructuras de datos del algoritmo y creación de un log de interacción en XML. Otro problema que nos planteamos en este trabajo, por su importancia en el proceso de aprendizaje, es el de la evaluación formativa. El uso de ciertos entornos e-learning genera gran cantidad de datos que deben ser interpretados para llegar a una evaluación que no se limite a un recuento de errores. Esto incluye el establecimiento de relaciones entre los datos disponibles y la generación de descripciones lingüísticas que informen al alumno sobre la evolución de su aprendizaje. Hasta ahora sólo un experto humano era capaz de hacer este tipo de evaluación. Nuestro objetivo ha sido crear un modelo computacional que simule el razonamiento del profesor y genere un informe sobre la evolución del aprendizaje que especifique el nivel de logro de cada uno de los objetivos definidos por el profesor. Como resultado del trabajo realizado, la segunda parte de esta tesis presenta el modelo granular lingüístico de la evaluación del aprendizaje, capaz de modelizar la evaluación y generar automáticamente informes de evaluación formativa. Este modelo es una particularización del modelo granular lingüístico de un fenómeno (GLMP), en cuyo desarrollo y formalización colaboramos, basado en la lógica borrosa y en la teoría computacional de las percepciones. Esta técnica, que utiliza sistemas de inferencia basados en reglas lingüísticas y es capaz de implementar criterios de evaluación complejos, se ha aplicado a dos casos: la evaluación, basada en criterios, de logs de interacción generados por GRAPHs y de cuestionarios de Moodle. Como consecuencia, se han implementado, probado y utilizado en el aula sistemas expertos que evalúan ambos tipos de ejercicios. Además de la calificación numérica, los sistemas generan informes de evaluación, en lenguaje natural, sobre los niveles de competencia alcanzados, usando sólo datos objetivos de respuestas correctas e incorrectas. Además, se han desarrollado dos aplicaciones capaces de ser configuradas para implementar los sistemas expertos mencionados. Una procesa los archivos producidos por GRAPHs y la otra, integrable en Moodle, evalúa basándose en los resultados de los cuestionarios. ABSTRACT The concept of algorithm is one of the core subjects in computer science. It is extremely important, then, for students to get a good grasp of this concept from the very start of their training. In this respect, having a tool that helps and shepherds students through the process of learning this concept can make a huge difference to their instruction. Much has been written about how helpful algorithm visualization tools can be. Most authors agree that the most important part of the learning process is how students use the visualization tool. Learners who are actively involved in visualization consistently outperform other learners who view the algorithms passively. Therefore we think that one of the best exercises to learn an algorithm is for the user to simulate the algorithm execution while using a visualization tool, thus performing a visual algorithm simulation. The first part of this thesis presents the eMathTeacher set of requirements together with an eMathTeacher-compliant tool called GRAPHs. For some years, we have been developing a theory about what the key features of an effective e-learning system for teaching mathematical concepts and algorithms are. This led to the definition of eMathTeacher concept, which has materialized in the eMathTeacher set of requirements. An e-learning tool is eMathTeacher compliant if it works as a virtual math trainer. In other words, it has to be an on-line self-assessment tool that helps students to actively and autonomously learn math concepts or algorithms, correcting their mistakes and providing them with clues to find the right answer. In an eMathTeacher-compliant tool, algorithm simulation does not continue until the user enters the correct answer. GRAPHs is an extendible environment designed for active and independent visual simulation-based learning of graph algorithms, set up to integrate tools to help the user simulate the execution of different algorithms. Apart from the options of creating and editing the graph, and visualizing the changes made to the graph during simulation, the environment also includes step-by-step correction, algorithm pseudo-code animation, pop-up questions, data structure handling and XML-based interaction log creation features. On the other hand, assessment is a key part of any learning process. Through the use of e-learning environments huge amounts of data can be output about this process. Nevertheless, this information has to be interpreted and represented in a practical way to arrive at a sound assessment that is not confined to merely counting mistakes. This includes establishing relationships between the available data and also providing instructive linguistic descriptions about learning evolution. Additionally, formative assessment should specify the level of attainment of the learning goals defined by the instructor. Till now, only human experts were capable of making such assessments. While facing this problem, our goal has been to create a computational model that simulates the instructor’s reasoning and generates an enlightening learning evolution report in natural language. The second part of this thesis presents the granular linguistic model of learning assessment to model the assessment of the learning process and implement the automated generation of a formative assessment report. The model is a particularization of the granular linguistic model of a phenomenon (GLMP) paradigm, based on fuzzy logic and the computational theory of perceptions, to the assessment phenomenon. This technique, useful for implementing complex assessment criteria using inference systems based on linguistic rules, has been applied to two particular cases: the assessment of the interaction logs generated by GRAPHs and the criterion-based assessment of Moodle quizzes. As a consequence, several expert systems to assess different algorithm simulations and Moodle quizzes have been implemented, tested and used in the classroom. Apart from the grade, the designed expert systems also generate natural language progress reports on the achieved proficiency level, based exclusively on the objective data gathered from correct and incorrect responses. In addition, two applications, capable of being configured to implement the expert systems, have been developed. One is geared up to process the files output by GRAPHs and the other one is a Moodle plug-in set up to perform the assessment based on the quizzes results.

An Investigation of the Features and Effectiveness of the Full-Day Early Learning Kindergarten Program in Ontario

This dissertation includes two studies. Study 1 is a qualitative case study that describes enactment of the main components of a high fidelity Full-Day Early Learning Kindergarten (FDELK) classroom, specifically play-based learning and teacher-ECE collaboration. Study 2 is a quantitative analysis that investigates how effectively the FDELK program promotes school readiness skills, namely self-regulation, literacy, and numeracy, in Kindergarteners. To describe the main components of an FDELK classroom in Study 1, a sub-sample of four high fidelity case study schools were selected from a larger case study sample. Interview data from these schools’ administrators, educators, parents, and community stakeholders were used to describe how the main components of the FDELK program enabled educators to meet the individual needs of students and promote students’ SR development. In Study 2, hierarchical regression analyses of 32,207 students’ self-regulation, literacy, and numeracy outcomes using 2012 Ontario Early Development Instrument (EDI) data revealed essentially no benefit for students participating in the FDELK program when compared to peers in Half-Day or Alternate-Day Kindergarten programs. Being older and female predicted more positive SR and literacy outcomes. Age and gender accounted for limited variance in numeracy outcomes. Results from both studies suggest that the Ontario Ministry of Education should take steps to improve the quality of the FDELK program by incorporating evidence-based guidelines and goals for play, reducing Kindergarten class sizes to more effectively scaffold learning, and revising curriculum expectations to include a greater focus on SR, literacy, and numeracy skills.

Virtual learning communities beyond the classroom: perceptions of tertiary Chinese language and non-language learners

As class contact times are reduced as a result of fiscal restraints in the modern tertiary sector, language instructors are placed in the position of having to find new ways to provide experience and continuity in language learning. Extending 'learning communities'—sites of learner knowledge exchange, exposure to diverse learning styles and strategies, and mutual support—beyond the classroom is one solution to maintaining successful linguistic competencies amongst learners. This, however, can conflict with the diverse extra-curricular commitments faced by tertiary students. The flexibility of web-based learning platforms provides one means of overcoming these obstacles. This study investigates learner perceptions of the use of the WebCT platform's computer medicated communication (CMC) tools as a means of extending the community of learning in tertiary Chinese language and non-language courses. Learner responses to Likert and open-ended questionnaires show that flexibility and reduction of negative affect are seen as significant benefits to 'virtual' interaction and communication, although responses are notably stronger in the non-language compared with the language cohort. While both learner cohorts acknowledge positive learning outcomes, CMC is not seen to consistently further interpersonal rapport beyond that established in the classroom. Maintaining a balance between web-based and classroom learning emerges as a concern, especially amongst language learners. [Author abstract, ed]

SQLator: An online SQL learning workbench

SQL (Structured Query Language) is one of the essential topics in foundation databases courses in higher education. Due to its apparent simple syntax, learning to use the full power of SQL can be a very difficult activity. In this paper, we introduce SQLator, which is a web-based interactive tool for learning SQL. SQLator's key function is the evaluate function, which allows a user to evaluate the correctness of his/her query formulation. The evaluate engine is based on complex heuristic algorithms. The tool also provides instructors the facility to create and populate database schemas with an associated pool of SQL queries. Currently it hosts two databases with a query pool of 300+ across the two databases. The pool is divided into 3 categories according to query complexity. The SQLator user can perform unlimited executions and evaluations on query formulations and/or view the solutions. The SQLator evaluate function has a high rate of success in evaluating the user's statement as correct (or incorrect) corresponding to the question. We will present in this paper, the basic architecture and functions of SQLator. We will further discuss the value of SQLator as an educational technology and report on educational outcomes based on studies conducted at the School of Information Technology and Electrical Engineering, The University of Queensland.

A graphical specification of model transformations with triple graph grammars

Models and model transformations are the core concepts of OMG's MDA (TM) approach. Within this approach, most models are derived from the MOF and have a graph-based nature. In contrast, most of the current model transformations are specified textually. To enable a graphical specification of model transformation rules, this paper proposes to use triple graph grammars as declarative specification formalism. These triple graph grammars can be specified within the FUJABA tool and we argue that these rules can be more easily specified and they become more understandable and maintainable. To show the practicability of our approach, we present how to generate Tefkat rules from triple graph grammar rules, which helps to integrate triple graph grammars with a state of a art model transformation tool and shows the expressiveness of the concept.

Fostering professional development through integrating work and formal learning

The Undergraduate Site Learning Program (USLP) is an innovative work-based learning program that addresses the call to develop a broader set ofattributes in engineering graduates. Unlike cooperative education programs, site learning can give students full academic credit for their placement without extending the duration of the degree through the use of an innovative learning alignment model. A cenrralpart ofthis program is a unique course entitled Professional Development in which students articulate and reflect upon the lessons they leom while on placement in industry. Students spend the bulk ofa semester on-site often in remote locations, which requires a flexible approach to course operation and fosters independent learning. Thus the USLP challenges both staff and students and produces outcomes that bofh the alumni and industry value.

Embedding e-portfolios for effective lifelong learning:a case study

Lifelong learning is a ‘keystone’ of educational policies (Faure, 1972) where the emphasis on learning shifts from teacher to learner. Higher Education (HE) institutions should be committed to developing lifelong learning, that is promoting learning that is flexible, diverse and relevant at different times, and in different places, and is pursued throughout life. Therefore the HE sector needs to develop effective strategies to encourage engagement in meaningful learning for diverse student populations. The use of e-portfolios, as a ‘purposeful aggregation of digital items’ (Sutherland & Powell, 2007), can meet the needs of the student community by encouraging reflection, the recording of experiences and achievements, and personal development planning (PDP). The use of e-portfolios also promotes inclusivity in learning as it provides students with the opportunity to articulate their aspirations and take the first steps along the pathway of lifelong learning. However, ensuring the uptake of opportunities within their learning is more complex than the students simply having access to the software. Therefore it is argued here that crucial to the effective uptake and engagement of the e-portfolio is embedding it purposefully within the curriculum. In order to investigate effective implementation of e-portfolios an explanatory case study on their use was carried out, initially focusing on 3 groups of students engaged in work-based learning and professional practice. The 3 groups had e-Portfolios embedded and assessed at different levels. Group 1 did not have the e-Portfolio embedded into their curriculum nor was the e-Portfolio assessed. Group 2 had the e-Portfolio embedded into the curriculum and formatively assessed. Group 3 also had the e-Portfolio embedded into the curriculum and were summatively assessed. Results suggest that the use of e-Portfolios needs to be integral to curriculum design in modules rather than used as an additional tool. In addition to this more user engagement was found in group 2 where the e-Portfolio was formatively assessed only. The implications of this case study are further discussed in terms of curriculum development.

Promoting scholarship - The way forward: Learning & teaching research in a complex environment – A typology

This paper provides a critical overview into a distinctive typology of Learning and Teaching Research developed at a relatively small, research-led UK University. Based upon research into staff perceptions of the relationship between learning and teaching research and practice, the model represents an holistic approach to evidence-based learning and teaching practice in Contemporary Higher Education.

Work-based HE pathways for the electrical power engineering industry

Aston University has been working closely with key companies from within the electricity industry for several years, initially in the development and delivery of an employer-led foundation degree programme in electrical power engineering, and more recently, in the development of a progression pathway for foundation degree graduates to achieve a Bachelors-level qualification. The Electrical Power Engineering foundation degree was developed in close consultation with the industry such that the programme is essentially owned by the sector. Programme delivery has required significant shifts away from traditional HE teaching patterns whilst maintaining the quality requirement and without compromise of the academic degree standard. Block teaching (2-week slots), partnership delivery, off-site student support and work-based learning have all presented challenges as we have sought to maximise the student learning experience and to ensure that the graduates are fit-for purpose and "hit the ground running" within a defined career structure for sponsoring companies. This paper will outline the skills challenges facing the sector; describe programme developments and delivery challenges; before articulating some observations and conclusions around programme effectiveness, impact of foundation degree graduates in the workplace and the significance of the close working relationship with key sponsoring companies. Copyright © 2012, September.

Cognitive Approach to e-Learning in Sciences and Technologies

This article describes the approach adopted and the results obtained by the international team developing WBLST (Web Based Learning in Sciences and Technologies) a Web-based application for e-learning, developed for the students of “UVPL: Université Virtuelle des Pays de la Loire”. The developed e-learning system covers three levels of learning activities - content, exercises, and laboratory. The delivery model is designed to operate with domain concepts as relevant providers of semantic links. The aim is to facilitate the overview and to help the establishment of a mental map of the learning material. The implemented system is strongly based on the organization of the instruction in virtual classes. The obtained quality of the system is evaluated on the bases of feedback form students and professors.

Models, Techniques and Applications of e-Learning Personalization

In recent years Web has become mainstream medium for communication and information dissemination. This paper presents approaches and methods for adaptive learning implementation, which are used in some contemporary web-interfaced Learning Management Systems (LMSs). The problem is not how to create electronic learning materials, but how to locate and utilize the available information in personalized way. Different attitudes to personalization are briefly described in section 1. The real personalization requires a user profile containing information about preferences, aims, and educational history to be stored and used by the system. These issues are considered in section 2. A method for development and design of adaptive learning content in terms of learning strategy system support is represented in section 3. Section 4 includes a set of innovative personalization services that are suggested by several very important research projects (SeLeNe project, ELENA project, etc.) dated from the last few years. This section also describes a model for role- and competency-based learning customization that uses Web Services approach. The last part presents how personalization techniques are implemented in Learning Grid-driven applications.