A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

Do the Messages Matter? An Investigation of Classroom Messages and College Students’ Personal Theories about Education

Students hold a number of personal theories about education that influence motivation and achievement in the classroom: theories about their own abilities, knowledge, and the learning process. Therefore, college instructors have a great interest in helping to develop adaptive personal theories in their students. The current studies investigated whether specific messages that instructors send in college classroom might serve as a mechanism of personal theory development. Across 2 studies, 17 college instructors and 401 students completed surveys assessing their personal theories about education at the beginning and end of college courses. Students and instructors reported hearing and sending many messages in the classroom, including instructor help messages, conciliatory messages, uncertainty in the field messages, differential ability messages and generalized positive and negative feedback. Between-class and within-class differences in message reports were associated with students’ personal theories at the end of their courses, controlling for initial personal theories. Students’ initial personal theories were also related to the messages students reported hearing. The findings demonstrate the utility of assessing non-content messages in college classrooms as potential mechanisms for changing students’ personal theories in college. Implications for research and practice are discussed.

Perceived cannabis use norms and cannabis use among adolescents in the United States.

Due to changes in cannabis policies, concerns about cannabis use (CU) in adolescents have increased. The population of nonwhite groups is growing quickly in the United States. We examined perceived CU norms and their association with CU and CU disorder (CUD) for White, Black, Hispanic, Native-American, Asian-American, Native Hawaiian/Pacific Islander (NH/PI), and mixed-race adolescents. Data were from adolescents (12-17 years) in the 2004-2012 National Surveys on Drug Use and Health (N = 163,837). Substance use and CUD were assessed by computer-assisted, self-interviewing methods. Blacks, Hispanics, Native-Americans, and mixed-race adolescents had greater odds of past-year CU and CUD than Whites. Among past-year cannabis users (CUs), Hispanics and Native-Americans had greater odds of having a CUD than Whites. Asian-Americans had the highest prevalence of perceived parental or close friends' CU disapproval. Native-Americans and mixed-race adolescents had lower odds than Whites of perceiving CU disapproval from parents or close friends. In adjusted analyses, adolescent's disapproval of CU, as well as perceived disapproval by parents or close friends, were associated with a decreased odds of CU in each racial/ethnic group, except for NHs/PIs. Adolescent's disapproval of CU was associated with a decreased odds of CUD among CUs for Whites (personal, parental, and close friends' disapproval), Hispanics (personal, parental, and close friends' disapproval), and mixed-race adolescents (personal, close friends' disapproval). Racial/ethnic differences in adolescent CU prevalence were somewhat consistent with adolescents' reports of CU norm patterns. Longitudinal research on CU health effects should oversample nonwhite adolescents to assure an adequate sample for analysis and reporting.

Substance use disorders and co-morbidities among Asian Americans and Native Hawaiians/Pacific Islanders

© Cambridge University Press 2014.Background Asian Americans (AAs) and Native Hawaiians/Pacific Islanders (NHs/PIs) are the fastest growing segments of the US population. However, their population sizes are small, and thus AAs and NHs/PIs are often aggregated into a single racial/ethnic group or omitted from research and health statistics. The groups' substance use disorders (SUDs) and treatment needs have been under-recognized. Method We examined recent epidemiological data on the extent of alcohol and drug use disorders and the use of treatment services by AAs and NHs/PIs. Results NHs/PIs on average were less educated and had lower levels of household income than AAs. Considered as a single group, AAs and NHs/PIs showed a low prevalence of substance use and disorders. Analyses of survey data that compared AAs and NHs/PIs revealed higher prevalences of substance use (alcohol, drugs), depression and delinquency among NHs than among AAs. Among treatment-seeking patients in mental healthcare settings, NHs/PIs had higher prevalences of DSM-IV diagnoses than AAs (alcohol/drug, mood, adjustment, childhood-onset disruptive or impulse-control disorders), although co-morbidity was common in both groups. AAs and NHs/PIs with an SUD were unlikely to use treatment, especially treatment for alcohol problems, and treatment use tended to be related to involvement with the criminal justice system. Conclusions Although available data are limited by small sample sizes of AAs and NHs/PIs, they demonstrate the need to separate AAs and NHs/PIs in health statistics and increase research into substance use and treatment needs for these fast-growing but understudied population groups.

Mental Health and Substance Use Among Patients in a North Carolina HIV Clinic.

BACKGROUND: The HIV/AIDS epidemic is a significant public health concern in North Carolina, and previous research has pointed to elevated mental health distress and substance use among HIV-infected populations, which may impact patients' adherence to medications. The aims of this study were to describe the prevalence of mental health and substance use issues among patients of a North Carolina HIV clinic, to examine differences by demographic characteristics, and to examine factors associated with suboptimal adherence to HIV medications. METHODS: This study was a secondary analysis of clinical data routinely collected through a health behavior questionnaire at a large HIV clinic in North Carolina. We analyzed data collected from February 2011 to August 2012. RESULTS: The sample included 1,398 patients. Overall, 12.2% of patients endorsed current symptomology indicative of moderate or severe levels of depression, and 38.6% reported receiving a psychiatric diagnosis at some point in their life. Additionally, 19.1% had indications of current problematic drinking, and 8.2% reported problematic drug use. Nearly one-quarter (22.1%) reported suboptimal adherence to HIV medications. Factors associated with poor adherence included racial/ethnic minority, age less than 35 years, and indications of moderate or severe depression. LIMITATIONS: The questionnaire was not completed systematically in the clinic, which may limit generalizability, and self-reported measures may have introduced social desirability bias. CONCLUSION: Patients were willing to disclose mental health distress, substance use, and suboptimal medication adherence to providers, which highlights the importance of routinely assessing these behaviors during clinic visits. Our findings suggest that treating depression may be an effective strategy to improve adherence to HIV medications.

Gender and racial/ethnic differences in addiction severity, HIV risk, and quality of life among adults in opioid detoxification: results from the National Drug Abuse Treatment Clinical Trials Network.

PURPOSE: Detoxification often serves as an initial contact for treatment and represents an opportunity for engaging patients in aftercare to prevent relapse. However, there is limited information concerning clinical profiles of individuals seeking detoxification, and the opportunity to engage patients in detoxification for aftercare often is missed. This study examined clinical profiles of a geographically diverse sample of opioid-dependent adults in detoxification to discern the treatment needs of a growing number of women and whites with opioid addiction and to inform interventions aimed at improving use of aftercare or rehabilitation. METHODS: The sample included 343 opioid-dependent patients enrolled in two national multi-site studies of the National Drug Abuse Treatment Clinical Trials Network (CTN001-002). Patients were recruited from 12 addiction treatment programs across the nation. Gender and racial/ethnic differences in addiction severity, human immunodeficiency virus (HIV) risk, and quality of life were examined. RESULTS: Women and whites were more likely than men and African Americans to have greater psychiatric and family/social relationship problems and report poorer health-related quality of life and functioning. Whites and Hispanics exhibited higher levels of total HIV risk scores and risky injection drug use scores than African Americans, and Hispanics showed a higher level of unprotected sexual behaviors than whites. African Americans were more likely than whites to use heroin and cocaine and to have more severe alcohol and employment problems. CONCLUSIONS: Women and whites show more psychopathology than men and African Americans. These results highlight the need to monitor an increased trend of opioid addiction among women and whites and to develop effective combined psychosocial and pharmacologic treatments to meet the diverse needs of the expanding opioid-abusing population. Elevated levels of HIV risk behaviors among Hispanics and whites also warrant more research to delineate mechanisms and to reduce their risky behaviors.

Recent national trends in Salvia divinorum use and substance-use disorders among recent and former Salvia divinorum users compared with nonusers.

CONTEXT: Media and scientific reports have indicated an increase in recreational use of Salvia divinorum. Epidemiological data are lacking on the trends, prevalence, and correlates of S. divinorum use in large representative samples, as well as the extent of substance use and mental health problems among S. divinorum users. OBJECTIVE: To examine the national trend in prevalence of S. divinorum use and to identify sociodemographic, behavioral, mental health, and substance-use profiles of recent (past-year) and former users of S. divinorum. DESIGN: Analyses of public-use data files from the 2006-2008 United States National Surveys on Drug Use and Health (N = 166,453). SETTING: Noninstitutionalized individuals aged 12 years or older were interviewed in their places of residence. MAIN MEASURES: Substance use, S. divinorum, self-reported substance use disorders, criminality, depression, and mental health treatment were assessed by standardized survey questions administered by the audio computer-assisted self-interviewing method. RESULTS: Among survey respondents, lifetime prevalence of S. divinorum use had increased from 0.7% in 2006 to 1.3% in 2008 (an 83% increase). S. divinorum use was associated with ages 18-25 years, male gender, white or multiple race, residence of large metropolitan areas, arrests for criminal activities, and depression. S. divinorum use was particularly common among recent drug users, including users of lysergic acid diethylamide (53.7%), ecstasy (30.1%), heroin (24.2%), phencyclidine (22.4%), and cocaine (17.5%). Adjusted multinomial logistic analyses indicated polydrug use as the strongest determinant for recent and former S. divinorum use. An estimated 43.0% of past-year S. divinorum users and 28.9% of former S. divinorum users had an illicit or nonmedical drug-use disorder compared with 2.5% of nonusers. Adjusted logistic regression analyses showed that recent and former S. divinorum users had greater odds of having past-year depression and a substance-use disorder (alcohol or drugs) than past-year alcohol or drug users who did not use S. divinorum. CONCLUSION: S. divinorum use is prevalent among recent or active drug users who have used other hallucinogens or stimulants. The high prevalence of substance use disorders among recent S. divinorum users emphasizes the need to study health risks of drug interactions.

Essays on the Economics of Higher Education

At least since the seminal works of Jacob Mincer, labor economists have sought to understand how students make higher education investment decisions. Mincer’s original work seeks to understand how students decide how much education to accrue; subsequent work by various authors seeks to understand how students choose where to attend college, what field to major in, and whether to drop out of college.

Broadly speaking, this rich sub-field of literature contributes to society in two ways: First, it provides a better understanding of important social behaviors. Second, it helps policymakers anticipate the responses of students when evaluating various policy reforms.

While research on the higher education investment decisions of students has had an enormous impact on our understanding of society and has shaped countless education policies, students are only one interested party in the higher education landscape. In the jargon of economists, students represent only the `demand side’ of higher education---customers who are choosing options from a set of available alternatives. Opposite students are instructors and administrators who represent the `supply side’ of higher education---those who decide which options are available to students.

For similar reasons, it is also important to understand how individuals on the supply side of education make decisions: First, this provides a deeper understanding of the behaviors of important social institutions. Second, it helps policymakers anticipate the responses of instructors and administrators when evaluating various reforms. However, while there is substantial literature understanding decisions made on the demand side of education, there is far less attention paid to decisions on the supply side of education.

This dissertation uses empirical evidence to better understand how instructors and administrators make decisions and the implications of these decisions for students.

In the first chapter, I use data from Duke University and a Bayesian model of correlated learning to measure the signal quality of grades across academic fields. The correlated feature of the model allows grades in one academic field to signal ability in all other fields allowing me to measure both ‘own category' signal quality and ‘spillover' signal quality. Estimates reveal a clear division between information rich Science, Engineering, and Economics grades and less informative Humanities and Social Science grades. In many specifications, information spillovers are so powerful that precise Science, Engineering, and Economics grades are more informative about Humanities and Social Science abilities than Humanities and Social Science grades. This suggests students who take engineering courses during their Freshman year make more informed specialization decisions later in college.

In the second chapter, I use data from the University of Central Arkansas to understand how universities decide which courses to offer and how much to spend on instructors for these courses. Course offerings and instructor characteristics directly affect the courses students choose and the value they receive from these choices. This chapter reveals the university preferences over these student outcomes which best explain observed course offerings and instructors. This allows me to assess whether university incentives are aligned with students, to determine what alternative university choices would be preferred by students, and to illustrate how a revenue neutral tax/subsidy policy can induce a university to make these student-best decisions.

In the third chapter, co-authored with Thomas Ahn, Peter Arcidiacono, and Amy Hopson, we use data from the University of Kentucky to understand how instructors choose grading policies. In this chapter, we estimate an equilibrium model in which instructors choose grading policies and students choose courses and study effort given grading policies. In this model, instructors set both a grading intercept and a return on ability and effort. This builds a rich link between the grading policy decisions of instructors and the course choices of students. We use estimates of this model to infer what preference parameters best explain why instructors chose estimated grading policies. To illustrate the importance of these supply side decisions, we show changing grading policies can substantially reduce the gender gap in STEM enrollment.

Emotional intensity predicts autobiographical memory experience.

College students generated autobiographical memories from distinct emotional categories that varied in valence (positive vs. negative) and intensity (high vs. low). They then rated various perceptual, cognitive, and emotional properties for each memory. The distribution of these emotional memories favored a vector model over a circumplex model. For memories of all specific emotions, intensity accounted for significantly more variance in autobiographical memory characteristics than did valence or age of the memory. In two additional experiments, we examined multiple memories of emotions of high intensity and positive or negative valence and of positive valence and high or low intensity. Intensity was a more consistent predictor of autobiographical memory properties than was valence or the age of the memory in these experiments as well. The general effects of emotion on autobiographical memory properties are due primarily to intensity differences in emotional experience, not to benefits or detriments associated with a specific valence.