A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

Mobile authoring of open educational resources for authentic learning scenarios

The proliferation of smartphones in the last decade and the number of publications in the field of authoring systems for computer-assisted learning depict a scenario that needs to be explored in order to facilitate the scaffolding of learning activities across contexts. Learning resources are traditionally designed in desktop-based authoring systems where the context is mostly restricted to the learning objective, capturing relevant case characteristics, or virtual situation models. Mobile authoring tools enable learners and teachers to foster universal access to educational resources not only providing channels to share, remix or re-contextualize these, but also capturing the context in-situ and in-time. As a further matter, authoring educational resources in a mobile context is an authentic experience where authors can link learning with their own daily life activities and reflections. The contribution of this manuscript is fourfold: first, the main barriers for ubiquitous and mobile authoring of educational resources are identified; second, recent research on mobile authoring tools is reviewed, and 10 key shortcomings of current approaches are identified; third, the design of a mobile environment to author educational resources (MAT for ARLearn) is presented, and the results of an evaluation of usability and hedonic quality are presented; fourth, conclusions and a research agenda for mobile authoring are discussed.

Principles and Practical Grouping for the Use of Drill and Practice Programs

A previous paper showed that young children performed better when working as individuals rather than in pairs on a drill and practice program. This paper reports an analysis of behaviour and talk for individuals and single sex pairs using a computer-based drill and practice activity to explain differences in performance. Results indicated that individuals were more likely to be task-focused and to complete tasks successfully than children working in pairs. Differences were found in off-task activity, behaviours and type of talk. Grouping and verbal interaction are discussed in relation to the type of task/program that children are asked to undertake, and how both task and peer presence may constrain the child's task focus and performance when reinforcing pre-existing knowledge.

Impact on the quality of learning as a result of the use of computers in schools

The educational software and computer assisted learning has been used in schools to promote the interest of students in new ways of thinking and learning so it can be useful in the reading learning process. Experimental studies performed in preschool and school age population have shown a better yield and a positive effect in reading, mathematics and cognitive skills in children who use educative software for fi fteen to twenty minutes a day periods. The goal of this study was to evaluate the progression in verbal, visual-motor integration and reading skills in children who were using educational software to compare them with a group in traditional pedagogic methodology. Results: All children were evaluated before using any kind of pedagogic approach. Initial evaluation revealed a lower–age score in all applied test. 11% of them were at high risk for learning disorders. There was a second evaluation that showed a significant positive change compared with the fi rst one. Nevertheless, despite some items, there were no general differences comparing the groups according if they were using or not a computer. In conclusion, policies on using educational software and computers must be revaluated due to the fact that children in our public schools come from a deprived environment with a lack of opportunities to use technologies.

Computer game-based and traditional learning method: a comparison regarding students’ knowledge retention

Abstract Background Educational computer games are examples of computer-assisted learning objects, representing an educational strategy of growing interest. Given the changes in the digital world over the last decades, students of the current generation expect technology to be used in advancing their learning requiring a need to change traditional passive learning methodologies to an active multisensory experimental learning methodology. The objective of this study was to compare a computer game-based learning method with a traditional learning method, regarding learning gains and knowledge retention, as means of teaching head and neck Anatomy and Physiology to Speech-Language and Hearing pathology undergraduate students. Methods Students were randomized to participate to one of the learning methods and the data analyst was blinded to which method of learning the students had received. Students’ prior knowledge (i.e. before undergoing the learning method), short-term knowledge retention and long-term knowledge retention (i.e. six months after undergoing the learning method) were assessed with a multiple choice questionnaire. Students’ performance was compared considering the three moments of assessment for both for the mean total score and for separated mean scores for Anatomy questions and for Physiology questions. Results Students that received the game-based method performed better in the pos-test assessment only when considering the Anatomy questions section. Students that received the traditional lecture performed better in both post-test and long-term post-test when considering the Anatomy and Physiology questions. Conclusions The game-based learning method is comparable to the traditional learning method in general and in short-term gains, while the traditional lecture still seems to be more effective to improve students’ short and long-term knowledge retention.

Social skills as predictors of communication, performance and quality of collaboration in project-based learning

The assumption that social skills are necessary ingredients of collaborative learning is well established but rarely empirically tested. In addition, most theories on collaborative learning focus on social skills only at the personal level, while the social skill configurations within a learning group might be of equal importance. Using the integrative framework, this study investigates which social skills at the personal level and at the group level are predictive of task-related e-mail communication, satisfaction with performance and perceived quality of collaboration. Data collection took place in a technology-enhanced long-term project-based learning setting for pre-service teachers. For data collection, two questionnaires were used, one at the beginning and one at the end of the learning cycle which lasted 3 months. During the project phase, the e-mail communication between group members was captured as well. The investigation of 60 project groups (N = 155 for the questionnaires; group size: two or three students) and 33 groups for the e-mail communication (N = 83) revealed that personal social skills played only a minor role compared to group level configurations of social skills in predicting satisfaction with performance, perceived quality of collaboration and communication behaviour. Members from groups that showed a high and/or homogeneous configuration of specific social skills (e.g., cooperation/compromising, leadership) usually were more satisfied and saw their group as more efficient than members from groups with a low and/or heterogeneous configuration of skills.

P2P assisted streaming for low popularity VoD contents

The Video on Demand (VoD) service is becoming a dominant service in the telecommunication market due to the great convenience regarding the choice of content items and their independent viewing time. However, due to its high traffic demand nature, the VoD streaming systems are faced with the problem of huge amounts of traffic generated in the core of the network, especially for serving the requests for content items that are not in the top popularity range. Therefore, we propose a peer assisted VoD model that takes advantage of the clients unused uplink and storage capacity to serve requests for less popular items with the objective to keep the traffic on the periphery of the network, reduce the transport cost in the core of the network and make the system more scalable.

The strengths, weaknesses, opportunities and threats of using social software in higher and further education teaching and learning

Social software is increasingly being used in higher and further education to support teaching and learning processes. These applications provide students with social and cognitive stimulation and also add to the interaction between students and educators. However, in addition to the benefits the introduction of social software into a course environment can also have adverse implications on students, educators and the education institution as a whole, a phenomenon which has received much less attention in the literature. In this study we explore the various implications of introducing social software into a course environment in order to identify the associated benefits, but also the potential drawbacks. We draw on data from 20 social software initiatives in UK based higher and further education institutions to identify the diverse experiences and concerns of students and educators. The findings are presented in form of a SWOT analysis, which allows us to better understand the otherwise ambiguous implications of social software in terms of its strengths, weaknesses, opportunities and threats. From the analysis we have derived concrete recommendations for the use of social software as a teaching and learning tool.

Cooperative or collaborative learning: Is there a difference in university students’ perceptions?

The hypothesis that the same educational objective, raised as cooperative or collaborative learning in university teaching does not affect students’ perceptions of the learning model, leads this study. It analyses the reflections of two students groups of engineering that shared the same educational goals implemented through two different methodological active learning strategies: Simulation as cooperative learning strategy and Problem-based Learning as a collaborative one. The different number of participants per group (eighty-five and sixty-five, respectively) as well as the use of two active learning strategies, either collaborative or cooperative, did not show differences in the results from a qualitative perspective.

Please take out your phones : on the spot solicitation of student feedback in class

The use of mobile devices such as smart phones and tablets in classrooms has been met with mixed sentiments. Some instructors and teachers see them as a distraction and regularly ban their usage. Others who see their potential to enhance learning have started to explore ways to integrate them into their teaching in an attempt to improve student engagement. In this paper we report on a pilot study that forms part of a university-wide project reconceptualising its approach to the student evaluation of learning and teaching. In a progressive decision to embrace mobile technology, the university decided to trial a smart phone app designed for students to check-in to class and leave feedback on the spot. Our preliminary findings from trialling the app indicate that the application establishes a more immediate feedback loop between students and teachers. However, the app’s impact depends on how feedback is shared with students and how the teaching team responds.

Doctoral research training : encouraging timely completion – case study reflections of one university on how it supports a vibrant research training culture

This is a case study of a young university striving to generate and sustain a vibrant Research Training culture. The university’s research training framework is informed by a belief in a project management approach to achieving successful research candidature. This has led to the definition and reporting of key milestones during candidature. In turn, these milestones have generated a range of training programs to support Higher Degree Research (HDR) students to meet these milestones in a timely fashion. Each milestone focuses on a specific set of skills blended with supporting the development of different parts of the doctoral thesis. Data on student progress and completion has provided evidence in highlighting the role that the milestones and training are playing in supporting timely completion. A university-wide reporting cycle generated data on the range of workshops and training provided to Higher Degree Research students and supervisors. The report provided details of thesis topic and format, as well as participation in research training events and participant evaluation of those events. Analysis of the data led to recommendations and comments on the strengths and weaknesses of the current research training program. Discussion considered strategies and drivers for enhancements into the future. In particular, the paper reflects on the significant potential role of centrally curated knowledge systems to support HDR student and supervisor access, and engagement and success. The research training program was developed using blended learning as a model. It covered face-to-face workshops as well as online modules. These were supplemented by web portals that offered a range of services to inform and educate students and supervisors and included opportunities for students to interact with each other. Topics ranged from the research life cycle, writing and publication, ethics, managing research data, managing copyright, and project management to use of software and the University’s Code of Conduct for Research. The challenges discussed included: How to reach off campus students and those studying in external modes? How best to promote events to potential participants? How long and what format is best for face-to-face sessions? What online resources best supplement face-to-face offerings? Is there a place for peer-based learning and what form should this take? These questions are raised by a relatively young university seeking to build and sustain a vibrant research culture. The rapid growth in enrolments in recent years has challenged previous one-to-one models of support. This review of research training is timely in seeking strategies to address changing research training support capacity and student needs. Part of the discussion will focus on supervisory training, noting that good supervision is the one remaining place where one-to-one support is provided. Ensuring that supervisors are appropriately equipped to address student expectations is considered in the context of the research training provisions. The paper concludes with reflection on the challenges faced, and recommended ways forward as the number of research students grows into the future.

Toimintatutkimus tietokoneavusteisten opetusohjelmien hyödynnettävyydestä ammatillisessa koulutuksessa sähköalalla

Tutkimuksen tavoitteena oli tutkia tietokoneavusteisen opetuksen opetusmenetelmänä ja tietokoneavusteisten opetusohjelmien oppimateriaalina soveltuvuutta erilaisiin sähköalan ammatillisiin opetus- ja oppimistilanteisiin. Tietokoneavusteisilla opetusohjelmilla tarkoitetaan tässä tutkimuksessa erilaisia digitaaliseen muotoon tallennettuja oppimateriaaleja ja tietokoneavusteisella opetuksella näiden digitaalisten oppimateriaalien hyödyntämistä erilaisissa oppimistilanteissa. Opetusteknologian kehittymisen myötä myöskin opettajin valittavissa olevat opetusmenetelmät lisääntyvät ja monipuolistuvat. Vastaavalla tavalla myöskin oppimateriaalit kehittyvät ja mahdollistavat oppijan näkökulmasta entistä yksilöllisemmät opiskelumahdollisuudet. Tutkimuksen viitekehyksen liittyvinä keskeisinä elementteinä olivat tietokoneavusteinen opetus opetusmenetelmänä ja sen valintaan liittyvät tekijät: oppisisällöt ja oppimiselle asetetut tavoitteet, opettajan opetusmenetelmällinen osaaminen, erilaiset oppijat yksilöllisine oppimistavoitteineen sekä käytettävissä olevat erilaiset oppimateriaalit. Tutkimus toteutettiin toimintatutkimuksena ja siihen osallistui tutkijan lisäksi 15 sähköalan opettajaa kahdesta erikokoisesta ammattioppilaitoksesta. Varsinainen toimintatutkimus aloitettiin keväällä 1994 ja se jatkui kevääseen 1996. Lisäksi suoritettiin vertaileva tutkimus, johon osallistui 9 opettajaa kolmesta erillisestä ammattioppilaitoksesta syksyllä 1996 jatkuen kevääseen 1997. Keskeisimmistä tutkimustuloksista mainitsen opettajien heikon tuntemuksen tietokoneavusteisesta opetuksesta ja sen hyödyntämiseen liittyvistä elementeistä. Opettajilta puuttuu taito suunnitella tietokoneavusteisia opetusohjelmia oppimateriaaleina hyödyntäviä opetus- ja oppimistilanteita. Tutkimuksen mukaan opettajilla ei kuitenkaan ole negatiivista ennakkoasennetta opetusmenetelmää kohtaan ja opiskelijat suhtautuvat erittäin myönteisesti erilaisiin tietokoneavusteisiin opetusohjelmiin oppimateriaaleina. Avainsanat: Tietokoneavusteinen opetus, tietokoneavusteinen oppiminen, tietokoneavusteinen oppimateriaali

Datorstödda studier i hälso- och socialvård : MuPSiNet-projektet

The aim of the study was to explore why the MuPSiNet project - a computer and network supported learning environment for the field of health care and social work - did not develop as expected. To grasp the problem some hypotheses were formulated. The hypotheses regarded the teachers' skills in and attitudes towards computing and their attitudes towards constructivist study methods. An online survey containing 48 items was performed. The survey targeted all the teachers within the field of health care and social work in the country, and it produced 461 responses that were analysed against the hypotheses. The reliability of the variables was tested using the Cronbach alpha coefficient and t-tests. Poor basic computing skills among the teachers combined with a vulnerable technical solution, and inadequate project management combined with lack of administrative models for transforming economic resources into manpower were the factors that turned out to play a decisive role in the project. Other important findings were that the teachers had rather poor skills and knowledge in computing, computer safety and computer supported instruction, and that these skills were significantly poorer among female teachers who were in majority in the sample. The fraction of teachers who were familiar with software for electronic patient records (EPR) was low. The attitudes towards constructivist teaching methods were positive, and further education seemed to utterly increase the teachers' readiness to use alternative teaching methods. The most important conclusions were the following: In order to integrate EPR software as a natural tool in teaching planning and documenting health care, it is crucial that the teachers have sufficient basic skills in computing and that more teachers have personal experience of using EPR software. In order for computer supported teaching to become accepted it is necessary to arrange with extensive further education for the teachers presently working, and for that further education to succeed it should be backed up locally among other things by sufficient support in matters concerning computer supported teaching. The attitudes towards computing showed significant gender differences. Based on the findings it is suggested that basic skills in computing should also include an awareness of data safety in relation to work in different kinds of computer networks, and that projects of this kind should be built up around a proper project organisation with sufficient resources. Suggestions concerning curricular development and further education are also presented. Conclusions concerning the research method were that reminders have a better effect, and that respondents tend to answer open-ended questions more verbosely in electronically distributed online surveys compared to traditional surveys. A method of utilising randomized passwords to guarantee respondent anonymity while maintaining sample control is presented. Keywords: computer-assisted learning, computer-assisted instruction, health care, social work, vocational education, computerized patient record, online survey

围绕主题的同步交互学习支持方法的研究及工具开发

现代信息技术的发展促使世界各国进行教育信息化的改革。用IT技术辅助教学，特别是网络教学成为信息化教育的主要应用之一，它在提高教学效率的同时，缓解了知识爆炸对教育所带来的冲击，可是目前的IT技术只是用于加固传统落后的教学模式，不能从根本上改变现代教育不适应知识经济发展的社会需求，需要思考能建立适应信息社会人才需要的教育模式。 多尔的后现代课程观批判了现代主义课程观的弊端，例如封闭性、简单性和累积性，重视课程系统的开发性，课程内容的丰富性，注重学习环境的关联性。而网络教学突破教学时空的局限，提供丰富的教育资源，优化自主学习，强化教学互动。因此将后现代课程观理念融入网络教学的教学模式，用网络教学来支持后现代课程教学理念的实现，能为解决现代教学存在的问题开辟新的道路。 本文抓住后现代课程观的核心概念之一交互，通过分析目前网络教学中交互支持工具的现状，提出了围绕主题的同步交互学习支持的方法和工具实现，将后现代课程观中的交互理念与围绕主题学习的思想相结合，利用即时通信和个性化知识的再组织辅助学习中的交互过程，使得整个交互过程与学习内容紧密结合，提高了学习的效率和质量，体现了后现代课程观对课程教学的指导意义。

围绕主题的同步交互学习支持方法的研究及工具实现

现代信息技术的发展促使世界各国进行教育信息化的改革。用IT技术辅助教学，特别是网络教学成为信息化教育的主要应用之一，它在提高教学效率的同时，缓解了知识爆炸对教育所带来的冲击，可是目前的IT技术只是用于加固传统落后的教学模式，不能从根本上改变现代教育不适应知识经济发展的社会需求，需要思考能建立适应信息社会人才需要的教育模式。 多尔的后现代课程观批判了现代主义课程观的弊端，例如封闭性、简单性和累积性，重视课程系统的开发性，课程内容的丰富性，注重学习环境的关联性。而网络教学突破教学时空的局限，提供丰富的教育资源，优化自主学习，强化教学互动。因此将后现代课程观理念融入网络教学的教学模式，用网络教学来支持后现代课程教学理念的实现，能为解决现代教学存在的问题开辟新的道路。 本文抓住后现代课程观的核心概念之一交互，通过分析目前网络教学中交互支持工具的现状，提出了围绕主题的同步交互学习支持的方法和工具实现，将后现代课程观中的交互理念与围绕主题学习的思想相结合，利用即时通信和个性化知识的再组织辅助学习中的交互过程，使得整个交互过程与学习内容紧密结合，提高了学习的效率和质量，体现了后现代课程观对课程教学的指导意义。