A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

Scientific writing: a randomized controlled trial comparing standard and on-line instruction.

BACKGROUND: Writing plays a central role in the communication of scientific ideas and is therefore a key aspect in researcher education, ultimately determining the success and long-term sustainability of their careers. Despite the growing popularity of e-learning, we are not aware of any existing study comparing on-line vs. traditional classroom-based methods for teaching scientific writing. METHODS: Forty eight participants from a medical, nursing and physiotherapy background from US and Brazil were randomly assigned to two groups (n = 24 per group): An on-line writing workshop group (on-line group), in which participants used virtual communication, google docs and standard writing templates, and a standard writing guidance training (standard group) where participants received standard instruction without the aid of virtual communication and writing templates. Two outcomes, manuscript quality was assessed using the scores obtained in Six subgroup analysis scale as the primary outcome measure, and satisfaction scores with Likert scale were evaluated. To control for observer variability, inter-observer reliability was assessed using Fleiss's kappa. A post-hoc analysis comparing rates of communication between mentors and participants was performed. Nonparametric tests were used to assess intervention efficacy. RESULTS: Excellent inter-observer reliability among three reviewers was found, with an Intraclass Correlation Coefficient (ICC) agreement = 0.931882 and ICC consistency = 0.932485. On-line group had better overall manuscript quality (p = 0.0017, SSQSavg score 75.3 +/- 14.21, ranging from 37 to 94) compared to the standard group (47.27 +/- 14.64, ranging from 20 to 72). Participant satisfaction was higher in the on-line group (4.3 +/- 0.73) compared to the standard group (3.09 +/- 1.11) (p = 0.001). The standard group also had fewer communication events compared to the on-line group (0.91 +/- 0.81 vs. 2.05 +/- 1.23; p = 0.0219). CONCLUSION: Our protocol for on-line scientific writing instruction is better than standard face-to-face instruction in terms of writing quality and student satisfaction. Future studies should evaluate the protocol efficacy in larger longitudinal cohorts involving participants from different languages.

Effects of task instruction on autobiographical memory specificity in young and older adults

Older adults tend to retrieve autobiographical information that is overly general (i.e., not restricted to a single event, termed the overgenerality effect) relative to young adults' specific memories. A vast majority of studies that have reported overgenerality effects explicitly instruct participants to retrieve specific memories, thereby requiring participants to maintain task goals, inhibit inappropriate responses, and control their memory search. Since these processes are impaired in healthy ageing, it is important to determine whether such task instructions influence the magnitude of the overgenerality effect in older adults. In the current study participants retrieved autobiographical memories during presentation of musical clips. Task instructions were manipulated to separate age-related differences in the specificity of underlying memory representations from age-related differences in following task instructions. Whereas young adults modulated memory specificity based on task demands, older adults did not. These findings suggest that reported rates of overgenerality in older adults' memories might include age-related differences in memory representation, as well as differences in task compliance. Such findings provide a better understanding of the underlying cognitive mechanisms involved in age-related changes in autobiographical memory and may also be valuable for future research examining effects of overgeneral memory on general well-being. © 2013 Taylor & Francis.

Effects of task instruction on autobiographical memory specificity in young and older adults.

Older adults tend to retrieve autobiographical information that is overly general (i.e., not restricted to a single event, termed the overgenerality effect) relative to young adults' specific memories. A vast majority of studies that have reported overgenerality effects explicitly instruct participants to retrieve specific memories, thereby requiring participants to maintain task goals, inhibit inappropriate responses, and control their memory search. Since these processes are impaired in healthy ageing, it is important to determine whether such task instructions influence the magnitude of the overgenerality effect in older adults. In the current study participants retrieved autobiographical memories during presentation of musical clips. Task instructions were manipulated to separate age-related differences in the specificity of underlying memory representations from age-related differences in following task instructions. Whereas young adults modulated memory specificity based on task demands, older adults did not. These findings suggest that reported rates of overgenerality in older adults' memories might include age-related differences in memory representation, as well as differences in task compliance. Such findings provide a better understanding of the underlying cognitive mechanisms involved in age-related changes in autobiographical memory and may also be valuable for future research examining effects of overgeneral memory on general well-being.