A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

Using Behavioral Insights For a Better Understanding of Economic Decisions (Regarding Savings, Inequality and Dishonesty)

This dissertation consists of three essays on behavioral economics, with a general aim of enriching our understanding of economic decisions using behavioral insights and experimental methodology. Each essay takes on one particular topic with this general aim.

The first chapter studies savings behavior of the poor. In this project, partnering with a savings product provider in Kenya, we tested the extent to which behavioral interventions and financial incentives can increase the saving rate of individuals with low and irregular income. Our experiment lasted for six months and included a total of twelve conditions. The control condition received weekly reminders and balance reporting via text messages. The treatment conditions received in addition one of the following interventions: (1) reminder text messages framed as if they came from the participant’s kid (2) a golden colored coin with numbers for each week of the trial, on which participants were asked to keep track of their weekly deposits (3) a match of weekly savings: The match was either 10% or 20% up to a certain amount per week. The match was either deposited at the end of each week or the highest possible match was deposited at the start of each week and was adjusted at the end. Among these interventions, by far the most effective was the coin: Those in the coin condition saved on average the highest amount and more than twice as those in the control condition. We hypothesize that being a tangible track-keeping object; the coin made subjects remember to save more often. Our results support the line of literature suggesting that saving decisions involve psychological aspects and that policy makers and product designers should take these influences into account.

The second chapter is related to views towards inequality. In this project, we investigate how the perceived fairness of income distributions depends on the beliefs about the process that generated the inequality. Specifically, we examine how two crucial features of this process affect fairness views: (1) Procedural justice - equal treatment of all, (2) Agency - one's ability to determine his/her income. We do this in a lab experiment by varying the equality of opportunity (procedural justice), and one's ability to make choices, which consequently influence subjects’ ability to influence their income (agency). We then elicit ex-post redistribution decisions of the earnings as a function of these two elements. Our results suggest both agency and procedural justice matter for fairness. Our main findings can be summarized as follows: (1) Highlighting the importance of agency, we find that inequality resulting from risk is considered to be fair only when risk is chosen freely; (2) Highlighting the importance of procedural justice, we find that introducing inequality of opportunity significantly increases redistribution, however the share of subjects redistributing none remain close to the share of subjects redistributing fully revealing an underlying heterogeneity in the population about how fairness views should account for inequality of opportunity.

The third chapter is on morality. In this project, we study whether religious rituals act as an internal reminder for basic moral principles and thus affect moral judgments. To this end, we conducted two survey experiments in Turkey and Israel to specifically test the effect of Ramadan and Yom Kippur. The results from the Turkish sample how that Ramadan has a significant effect on moral judgments to some extent for those who report to believe in God. Those who believe in God judged the moral acceptability of ten out of sixty one actions significantly differently in Ramadan, whereas those who reported not to believe in God significantly changed their judgments only for one action in Ramadan. Our results extends the hypothesis established by lab experiments that religious reminders have a significant effect on morality, by testing it in the field in the natural environment of religious rituals.

This thesis is part of a broader collaborative research agenda with both colleagues and advisors. The programming, analyses, and writing, as well as any errors in this work, are my own.

Scholarly research productivity is not related to higher three-year licensure pass rates for physical therapy academic programs.

BACKGROUND: In the domain of academia, the scholarship of research may include, but not limited to, peer-reviewed publications, presentations, or grant submissions. Programmatic research productivity is one of many measures of academic program reputation and ranking. Another measure or tool for quantifying learning success among physical therapists education programs in the USA is 100 % three year pass rates of graduates on the standardized National Physical Therapy Examination (NPTE). In this study, we endeavored to determine if there was an association between research productivity through artifacts and 100 % three year pass rates on the NPTE. METHODS: This observational study involved using pre-approved database exploration representing all accredited programs in the USA who graduated physical therapists during 2009, 2010 and 2011. Descriptive variables captured included raw research productivity artifacts such as peer reviewed publications and books, number of professional presentations, number of scholarly submissions, total grant dollars, and numbers of grants submitted. Descriptive statistics and comparisons (using chi square and t-tests) among program characteristics and research artifacts were calculated. Univariate logistic regression analyses, with appropriate control variables were used to determine associations between research artifacts and 100 % pass rates. RESULTS: Number of scholarly artifacts submitted, faculty with grants, and grant proposals submitted were significantly higher in programs with 100 % three year pass rates. However, after controlling for program characteristics such as grade point average, diversity percentage of cohort, public/private institution, and number of faculty, there were no significant associations between scholarly artifacts and 100 % three year pass rates. CONCLUSIONS: Factors outside of research artifacts are likely better predictors for passing the NPTE.