A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

A Pharmacology-Based Enrichment Program for Undergraduates Promotes Interest in Science.

There is a strong need to increase the number of undergraduate students who pursue careers in science to provide the "fuel" that will power a science and technology-driven U.S. economy. Prior research suggests that both evidence-based teaching methods and early undergraduate research experiences may help to increase retention rates in the sciences. In this study, we examined the effect of a program that included 1) a Summer enrichment 2-wk minicourse and 2) an authentic Fall research course, both of which were designed specifically to support students' science motivation. Undergraduates who participated in the pharmacology-based enrichment program significantly improved their knowledge of basic biology and chemistry concepts; reported high levels of science motivation; and were likely to major in a biological, chemical, or biomedical field. Additionally, program participants who decided to major in biology or chemistry were significantly more likely to choose a pharmacology concentration than those majoring in biology or chemistry who did not participate in the enrichment program. Thus, by supporting students' science motivation, we can increase the number of students who are interested in science and science careers.