Promoting Programming Learning. Engagement, Automatic Assessment with Immediate Feedback in Visualizations

The skill of programming is a key asset for every computer science student. Many studies have shown that this is a hard skill to learn and the outcomes of programming courses have often been substandard. Thus, a range of methods and tools have been developed to assist students’ learning processes. One of the biggest fields in computer science education is the use of visualizations as a learning aid and many visualization based tools have been developed to aid the learning process during last few decades. Studies conducted in this thesis focus on two different visualizationbased tools TRAKLA2 and ViLLE. This thesis includes results from multiple empirical studies about what kind of effects the introduction and usage of these tools have on students’ opinions and performance, and what kind of implications there are from a teacher’s point of view. The results from studies in this thesis show that students preferred to do web-based exercises, and felt that those exercises contributed to their learning. The usage of the tool motivated students to work harder during their course, which was shown in overall course performance and drop-out statistics. We have also shown that visualization-based tools can be used to enhance the learning process, and one of the key factors is the higher and active level of engagement (see. Engagement Taxonomy by Naps et al., 2002). The automatic grading accompanied with immediate feedback helps students to overcome obstacles during the learning process, and to grasp the key element in the learning task. These kinds of tools can help us to cope with the fact that many programming courses are overcrowded with limited teaching resources. These tools allows us to tackle this problem by utilizing automatic assessment in exercises that are most suitable to be done in the web (like tracing and simulation) since its supports students’ independent learning regardless of time and place. In summary, we can use our course’s resources more efficiently to increase the quality of the learning experience of the students and the teaching experience of the teacher, and even increase performance of the students. There are also methodological results from this thesis which contribute to developing insight into the conduct of empirical evaluations of new tools or techniques. When we evaluate a new tool, especially one accompanied with visualization, we need to give a proper introduction to it and to the graphical notation used by tool. The standard procedure should also include capturing the screen with audio to confirm that the participants of the experiment are doing what they are supposed to do. By taken such measures in the study of the learning impact of visualization support for learning, we can avoid drawing false conclusion from our experiments. As computer science educators, we face two important challenges. Firstly, we need to start to deliver the message in our own institution and all over the world about the new – scientifically proven – innovations in teaching like TRAKLA2 and ViLLE. Secondly, we have the relevant experience of conducting teaching related experiment, and thus we can support our colleagues to learn essential know-how of the research based improvement of their teaching. This change can transform academic teaching into publications and by utilizing this approach we can significantly increase the adoption of the new tools and techniques, and overall increase the knowledge of best-practices. In future, we need to combine our forces and tackle these universal and common problems together by creating multi-national and multiinstitutional research projects. We need to create a community and a platform in which we can share these best practices and at the same time conduct multi-national research projects easily.

Focusing on the quality of learning processes

S. 327-333

Verbal ability, previous practice and load on short-term memory as determiners of differences in a complex learning task: an experimental study

Traditional psychometric theory and practice classify people according to broad ability dimensions but do not examine how these mental processes occur. Hunt and Lansman (1975) proposed a 'distributed memory' model of cognitive processes with emphasis on how to describe individual differences based on the assumption that each individual possesses the same components. It is in the quality of these components ~hat individual differences arise. Carroll (1974) expands Hunt's model to include a production system (after Newell and Simon, 1973) and a response system. He developed a framework of factor analytic (FA) factors for : the purpose of describing how individual differences may arise from them. This scheme is to be used in the analysis of psychometric tes ts . Recent advances in the field of information processing are examined and include. 1) Hunt's development of differences between subjects designated as high or low verbal , 2) Miller's pursuit of the magic number seven, plus or minus two, 3) Ferguson's examination of transfer and abilities and, 4) Brown's discoveries concerning strategy teaching and retardates . In order to examine possible sources of individual differences arising from cognitive tasks, traditional psychometric tests were searched for a suitable perceptual task which could be varied slightly and administered to gauge learning effects produced by controlling independent variables. It also had to be suitable for analysis using Carroll's f ramework . The Coding Task (a symbol substitution test) found i n the Performance Scale of the WISe was chosen. Two experiments were devised to test the following hypotheses. 1) High verbals should be able to complete significantly more items on the Symbol Substitution Task than low verbals (Hunt, Lansman, 1975). 2) Having previous practice on a task, where strategies involved in the task may be identified, increases the amount of output on a similar task (Carroll, 1974). J) There should be a sUbstantial decrease in the amount of output as the load on STM is increased (Miller, 1956) . 4) Repeated measures should produce an increase in output over trials and where individual differences in previously acquired abilities are involved, these should differentiate individuals over trials (Ferguson, 1956). S) Teaching slow learners a rehearsal strategy would improve their learning such that their learning would resemble that of normals on the ,:same task. (Brown, 1974). In the first experiment 60 subjects were d.ivided·into high and low verbal, further divided randomly into a practice group and nonpractice group. Five subjects in each group were assigned randomly to work on a five, seven and nine digit code throughout the experiment. The practice group was given three trials of two minutes each on the practice code (designed to eliminate transfer effects due to symbol similarity) and then three trials of two minutes each on the actual SST task . The nonpractice group was given three trials of two minutes each on the same actual SST task . Results were analyzed using a four-way analysis of variance . In the second experiment 18 slow learners were divided randomly into two groups. one group receiving a planned strategy practioe, the other receiving random practice. Both groups worked on the actual code to be used later in the actual task. Within each group subjects were randomly assigned to work on a five, seven or nine digit code throughout. Both practice and actual tests consisted on three trials of two minutes each. Results were analyzed using a three-way analysis of variance . It was found in t he first experiment that 1) high or low verbal ability by itself did not produce significantly different results. However, when in interaction with the other independent variables, a difference in performance was noted . 2) The previous practice variable was significant over all segments of the experiment. Those who received previo.us practice were able to score significantly higher than those without it. J) Increasing the size of the load on STM severely restricts performance. 4) The effect of repeated trials proved to be beneficial. Generally, gains were made on each successive trial within each group. S) In the second experiment, slow learners who were allowed to practice randomly performed better on the actual task than subjeots who were taught the code by means of a planned strategy. Upon analysis using the Carroll scheme, individual differences were noted in the ability to develop strategies of storing, searching and retrieving items from STM, and in adopting necessary rehearsals for retention in STM. While these strategies may benef it some it was found that for others they may be harmful . Temporal aspects and perceptual speed were also found to be sources of variance within individuals . Generally it was found that the largest single factor i nfluencing learning on this task was the repeated measures . What e~ables gains to be made, varies with individuals . There are environmental factors, specific abilities, strategy development, previous learning, amount of load on STM , perceptual and temporal parameters which influence learning and these have serious implications for educational programs .

The Effectiveness of Learning Portfolios: A Study of Quality Assurance Programs of Selected Health Regulatory Colleges in Ontario

Health regulatory colleges promote quality practice and continued competence through Quality Assurance (QA) programs. For many colleges, a QA program includes the use of portfolios that incorporate self-directed learning. The purpose of this study was to determine some of the issues surrounding the effectiveness of QA portfolio programs. The literature review revealed that portfolios are valuable tools, but gaps in knowledge include a comparative analysis of QA programs and the perspective of regulatory college administrators. Data were collected through interviews with 6 administrators and a review of 14 portfolio models described on college websites. The results from the two data sources were applied to Robert Stake's responsive evaluation framework to identify issues related to the portfolio's effectiveness (Stake, 1967). The learning components of portfolios were analyzed through the humanist and constructivist lenses. All 14 portfolio models were found to have 3 main components: self-diagnosis, learning plan and activities, and self-evaluation. However, differences were uncovered in learners' autonomy in selecting learning activities, methods of portfolio evaluation, and the relationship between the portfolio and other QA components. The results revealed a dual philosophy of learning in portfolio models and an apparent contradiction between the needs of the individual learner and the organization. Paths for future research include the tenuous relationship between competence and learning, and the impact of technical approaches on selfdirected learning initiatives. A key recommendation is to acknowledge the unique identity of each profession so that health regulatory colleges can address legislative demands and learner needs.

Is Library Database Searching a Language Learning Activity?

A qualitative research study that asked international students how they thought of words to enter into a library database to see if language learning was also involved.

Gestión de la actividad no presencial y autoevaluación de competencias = Management of student learning outside the classroom and the self-evaluation of competences

La asignatura troncal “Evaluación Psicológica” de los estudios de Psicología y del estudio de grado “Desarrollo humano en la sociedad de la información” de la Universidad de Girona consta de 12 créditos según la Ley Orgánica de Universidades. Hasta el año académico 2004-05 el trabajo no presencial del alumno consistía en la realización de una evaluación psicológica que se entregaba por escrito a final de curso y de la cual el estudiante obtenía una calificación y revisión si se solicitaba. En el camino hacia el Espacio Europeo de Educación Superior, esta asignatura consta de 9 créditos que equivalen a un total de 255 horas de trabajo presencial y no presencial del estudiante. En los años académicos 2005-06 y 2006-07 se ha creado una guía de trabajo para la gestión de la actividad no presencial con el objetivo de alcanzar aprendizajes a nivel de aplicación y solución de problemas/pensamiento crítico (Bloom, 1975) siguiendo las recomendaciones de la Agencia para la Calidad del Sistema Universitario de Cataluña (2005). La guía incorpora: los objetivos de aprendizaje, los criterios de evaluación, la descripción de las actividades, el cronograma semanal de trabajos para todo el curso, la especificación de las tutorías programadas para la revisión de los diversos pasos del proceso de evaluación psicológica y el uso del foro para el conocimiento, análisis y crítica constructiva de las evaluaciones realizadas por los compañeros

Learning-related motives and the percepption of the motivational quality of the learning environment. ' Motivaciones relacionadas con el aprendizaje y percepci??n del valor del entorno instruccional'

Resumen tomado de la publicaci??n. Resumen tambi??n en ingl??s

Adaptive intelligent agent approach to guide the web navigation on the PLAN-G distance learning platform

Hypermedia systems based on the Web for open distance education are becoming increasingly popular as tools for user-driven access learning information. Adaptive hypermedia is a new direction in research within the area of user-adaptive systems, to increase its functionality by making it personalized [Eklu 961. This paper sketches a general agents architecture to include navigational adaptability and user-friendly processes which would guide and accompany the student during hislher learning on the PLAN-G hypermedia system (New Generation Telematics Platform to Support Open and Distance Learning), with the aid of computer networks and specifically WWW technology [Marz 98-1] [Marz 98-2]. The PLAN-G actual prototype is successfully used with some informatics courses (the current version has no agents yet). The propased multi-agent system, contains two different types of adaptive autonomous software agents: Personal Digital Agents {Interface), to interacl directly with the student when necessary; and Information Agents (Intermediaries), to filtrate and discover information to learn and to adapt navigation space to a specific student

Impact on the quality of learning as a result of the use of computers in schools

The educational software and computer assisted learning has been used in schools to promote the interest of students in new ways of thinking and learning so it can be useful in the reading learning process. Experimental studies performed in preschool and school age population have shown a better yield and a positive effect in reading, mathematics and cognitive skills in children who use educative software for fi fteen to twenty minutes a day periods. The goal of this study was to evaluate the progression in verbal, visual-motor integration and reading skills in children who were using educational software to compare them with a group in traditional pedagogic methodology. Results: All children were evaluated before using any kind of pedagogic approach. Initial evaluation revealed a lower–age score in all applied test. 11% of them were at high risk for learning disorders. There was a second evaluation that showed a significant positive change compared with the fi rst one. Nevertheless, despite some items, there were no general differences comparing the groups according if they were using or not a computer. In conclusion, policies on using educational software and computers must be revaluated due to the fact that children in our public schools come from a deprived environment with a lack of opportunities to use technologies.

The Recognition as a Quality Methodology Proposal in the Learning Process

In the education field, the question for the holistic formation is continuous and controversial. Moreover, with the obvious changes in the global knowledge production, apprehension and transmission, is crucial asking for the role of the education in the changes of the individual toward autonomy and take decisions in relationship with the educational process and the responsibility like a person sharing with knowledge like an issue of social development. In this context, this paper, presents results of an investigation made on 1995, about the recognition value like a methodology proposal of learning quality, for consider their propositions to be in force into an educational structure.

Teoría de modelado del e-learning y aplicación a un sistema de pistas adaptativo en tutoría inteligente utilizando técnicas de web semántica.

Se trata de habilitar las mejores prácticas de enseñanza a través de las tecnologías de la información para posibilitar un aprendizaje más efectivo para los alumnos, así como proporcionar un sencillo y flexible acceso a todas las potencialidades para los profesores, al mismo tiempo que se maximiza la eficiencia y adecuación de su implementación usando las tecnologías de la información. Se define una teoría de modelado del e-learning, que por un lado aporte una visión global de modelado del e-learning; y por otro, modele de forma completa desde diferentes puntos de vista aspectos para los que se detectan carencias Otro objetivo es crear un nuevo sistema de pistas adaptativo en tutoría inteligente utilizando técnicas de Web semántica, donde se apliquen varios de los diferentes aspectos de la teoría. En esta tesis se proporciona una teoría de modelado del e-learning, que incluye una visión global sobre qué modelar y cómo hacerlo, las interrelaciones entre diferentes conceptos y elementos, una visión ideal sobre el e-learning, una propuesta de proceso de desarrollo en ciclo de vida, y un plan general de evaluación de los diferentes aspectos involucrados. Además, como parte de esta teoría, se han analizado las relaciones entre las funcionalidades de sistemas de gestión del aprendizaje y los estándares de e-learning actuales, se ha definido un nuevo modelo que extiende UML y otro basado en la especificación IMS-CP (Content Packaging) para el modelado de cursos completos en sistemas de gestión del aprendizaje, se ha contribuido en varias herramientas de autor que pueden verse como modelados en lenguaje natural de diferentes aspectos del e-learning de forma que sean sencillos de utilizar por profesores sin grandes conocimientos tecnológicos, y se ha creado una nueva teoría de reglas de adaptación personalizadas que son atómicas, reusables, intercambiables, e interoperables. Se ha definido una nueva especificación de pistas para el aprendizaje basado en problemas, que recopila funcionalidades de otros sistemas del estado del arte, pero también incluye nuevas funcionalidades basadas en ideas propias, dando una justificación pedagógica de cada aspecto. Se ha establecido un mapeo a XML, y otra representación a UML. Así mismo, se ha diseñado una herramienta de autor que permite a profesores sin grandes conocimientos tecnológicos crear los ejercicios con pistas de acuerdo con la especificación. Para poner en práctica este modelo de pistas, se ha implementado un módulo reproductor de pistas programado en python como una extesión al tutor inteligente XTutor. Este reproductor permite desplegar ejercicios con pistas que cubren los casos de la nueva especificación definida y que quedan disponibles vía Web para su uso por parte de los alumnos. También se ha diseñado una herramienta de competición innovadora para aprovechar la motivación junto con el aprendizaje basado en problemas.

Websites construction as learning tools. 'Construcción de sitios web como herramientas de aprendizaje'.

Monográfico con el título: 'Aprendizaje y construcción del conocimiento en la red'. Resumen basado en el de la publicación

Vermunt's learning styles : searching for portuguese college student's functioning. 'Estilos de aprendizaje de Vermunt : en busca del funcionamiento de los estudiantes portugueses en la educación superior'.

Resumen basado en el de la publicación

Validade e fidelidade da vers??o portuguesa reduzida do web based learning environment inventory

Resumen basado en el de la publicaci??n