A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

Do the Messages Matter? An Investigation of Classroom Messages and College Students’ Personal Theories about Education

Students hold a number of personal theories about education that influence motivation and achievement in the classroom: theories about their own abilities, knowledge, and the learning process. Therefore, college instructors have a great interest in helping to develop adaptive personal theories in their students. The current studies investigated whether specific messages that instructors send in college classroom might serve as a mechanism of personal theory development. Across 2 studies, 17 college instructors and 401 students completed surveys assessing their personal theories about education at the beginning and end of college courses. Students and instructors reported hearing and sending many messages in the classroom, including instructor help messages, conciliatory messages, uncertainty in the field messages, differential ability messages and generalized positive and negative feedback. Between-class and within-class differences in message reports were associated with students’ personal theories at the end of their courses, controlling for initial personal theories. Students’ initial personal theories were also related to the messages students reported hearing. The findings demonstrate the utility of assessing non-content messages in college classrooms as potential mechanisms for changing students’ personal theories in college. Implications for research and practice are discussed.