A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

Student-Athlete Learning: How Learning Spaces Influence Athletic and Academic Success

This study will utilize case study inquiry to examine student-athlete learning opportunities in the athletic learning space and academic learning space in a higher education NCAA Division I collegiate institution. This study will assess what learning opportunities exist within the athletic and academic learning space to better understand effective learning practices. This study will utilize the sociocultural Learning Sciences literature, supported with critical pedagogy and inclusive excellence literature, to understand how different learning spaces contribute to student-athlete learning opportunities and educational success in college.

Students’ conceptual knowledge about workplace pedagogies and applications to learning in the workplace

The development of effective workplace pedagogies is integral to work-integrated and work-based learning. The workplace pedagogies that facilitate and support learning include: activities in which individuals engage such as daily work practices, questioning; observing, and listening; interactions with more experienced workers through coaching and modelling; and referencing documented procedures. Each of these dimensions is significant in enhancing processes of workplace learning. Learning can be optimised when these pedagogies are appropriately embedded in the context of and process of participating in normal work activities. Yet learners need to understand the nature of these pedagogies, and how and for what purposes to use these to achieve a range of learning outcomes. This is because it is the worker-learners who play the key roles in the process and outcomes of learning through work. A pilot study was conducted on students’ conceptions of how each of these dimensions of workplace pedagogy help their learning, by providing examples of learning from these sources; and stating their preferences for learning in the workplace. A sample of seventeen students, enrolled in the second year of a Diploma in Nursing course at a Technical and Further Education institution, participated in a survey intended to capture these conceptions and the importance attached to each of them. The findings indicate that these students have basic understanding of how each of seven workplace pedagogic practices can contribute to their learning. They reported relying mostly on daily practices, observing and listening to others, modelling, coaching, and other workers. Their selection of these contributions emphasise significant opportunities for guided learning by others, yet suggest fewer student-initiated interactions, less intensity in interactions, and likelihood that learning is more passive. The data also suggests that these students rely mostly on using academic learning skill, and limited workplace learning skills. It is proposed, therefore, that the knowledge and understandings about workplace learning and pedagogies might be best embedded in the full curriculum and not become add-on shortly before students go on work placement. This approach will allow students to appreciate the significance and use of workplace pedagogies for learning.

An instrument to measure the approach to learning for assessment in economics

Economics education research studies conducted in the UK, USA and Australia to investigate the effects of learning inputs on academic performance have been dominated by the input-output model (Shanahan and Meyer, 2001). In the Student Experience of Learning framework, however, the link between learning inputs and outputs is mediated by students' learning approaches which in turn are influenced by their perceptions of the learning contexts (Evans, Kirby, & Fabrigar, 2003). Many learning inventories such as Biggs' Study Process Questionnaires and Entwistle and Ramsden' Approaches to Study Inventory have been designed to measure approaches to academic learning. However, there is a limitation to using generalised learning inventories in that they tend to aggregate different learning approaches utilised in different assessments. As a result, important relationships between learning approaches and learning outcomes that exist in specific assessment context(s) will be missed (Lizzio, Wilson, & Simons, 2002). This paper documents the construction of an assessment specific instrument to measure learning approaches in economics. The post-dictive validity of the instrument was evaluated by examining the association of learning approaches to students' perceived assessment demand in different assessment contexts.

Helping undergraduate students across disciplines and cultures actively engage and collaborate as equal members of a community of scholars : peer review within an e-learning environment

At the international level, the higher education sector is currently being subjected to increased calls for public accountability and the current move by the OECD to rank universities based on the quality of their teaching and learning outcomes. At the national level, Australian universities and their teaching staff face numerous challenges including financial restrictions, increasing student numbers and the reality of an increasingly diverse student population. The Australian higher education response to these competing policy and accreditation demands focuses on precise explicit systems and procedures which are inflexible and conservative and which ignore the fact that assessment is the single biggest influence on how students approach their learning. By seriously neglecting the quality of student learning outcomes, assessment tasks are often failing to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design, which includes new paradigms of student engagement and learning and pedagogically based technologies have the capacity to provide some measure of relief from these internal and external tensions by significantly enhancing the learning experience for an increasingly time-poor population of students. That is, the assessment process has the ability to deliver program objectives and active learning through a knowledge transfer process which increases student participation and engagement. This social constructivist view highlights the importance of peer review in assisting students to participate and collaborate as equal members of a community of scholars with both their peers and academic staff members. As a result of increasing the student’s desire to learn, peer review leads to more confident, independent and reflective learners who also become more skilled at making independent judgements of their own and others' work. Within this context, in Case Study One of this project, a summative, peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes achieved included: student failure rates declined 15%; tutorial participation increased fourfold; tutorial engagement increased six-fold; and there was a 100% student-based approval rating for the retention of the assessment task. However, in stark contrast to the positive student response, staff issues related to the loss of research time associated with the administration of the peer-review process threatened its survival. This paper contributes to the core conference topics of new trends and experiences in undergraduate assessment education and in terms of innovative, on-line, learning and teaching practices, by elaborating the Case Study Two “solution” generated to this dilemma. At the heart of the resolution is an e-Learning, peer-review process conducted in conjunction with the University of Melbourne which seeks to both create a virtual sense of belonging and to efficiently and effectively meet academic learning objectives with minimum staff involvement. In outlining the significant level of success achieved, student-based qualitative and quantitative data will be highlighted along with staff views in a comparative analysis of the advantages and disadvantages to both students and staff of the staff-led, peer review process versus its on-line counterpart.

Collaborative research into the affordances of place for primary school children’s literacy learning

In the context of culturally diverse high poverty areas of Australia, we have conducted collaborative research with teachers and students in a primary school for more than a decade. Teachers have been exploring the affordances of place‐based pedagogies (Gruenewald & Smith, 2008) for the development of students’ spatial literacies and their understandings of the politics of places and built environments (Comber, Nixon, Ashmore, Loo & Cook, 2006; Comber, Thomson and Wells, 2001). This paper reports on a project in which the affordances of placedbased pedagogy are being explored through teacher inquiries and classroom‐based design experiments (Cobb, Confrey, di Sessa, Lehrer & Schauble, 2003). Located within a large‐scale urban renewal project in which houses are being demolished and families relocated, the original school has been replaced by a larger school that serves a population from a wider area. In this paper we draw on the study to consider the challenges of working with teachers and primary school students to study innovative ideas and practices in educational research. Specifically we consider issues raised by collaborative studies of the affordances of cross curricular projects focusing on social and environmental change to engage students in academic learning and expand their literate repertoires in a changing policy climate.

A 3D virtual medical imaging suite : bridging the academic-clinical training boundary

Aims The Medical Imaging Training Immersive Environment (MITIE) system is a recently developed virtual reality (VR) platform that allows students to practice a range of medical imaging techniques. The aim of this pilot study was to harvest user feedback about the educational value of the application and inform future pedagogical development. This presentation explores the use of this technology for skills training and blurring the boundaries between academic learning and clinical skills training. Background MITIE is a 3D VR environment that allows students to manipulate a patient and radiographic equipment in order to produce a VR-generated image for comparison with a gold standard. As with VR initiatives in other health disciplines (1-6) the software mimics clinical practice as much as possible and uses 3D technology to enhance immersion and realism. The software was developed by the Medical Imaging Course Team at a provider University with funding from a Health Workforce Australia “Simulated Learning Environments” grant. Methods Over 80 students undertaking the Bachelor of Medical Imaging Course were randomised to receive practical experience with either MITIE or radiographic equipment in the medical radiation laboratory. Student feedback about the educational value of the software was collected and performance with an assessed setup was measured for both groups for comparison. Ethical approval for the project was provided by the university ethics panel. Results This presentation provides qualitative analysis of student perceptions relating to satisfaction, usability and educational value as well as comparative quantitative performance data. Students reported high levels of satisfaction and both feedback and assessment results confirmed the application’s significance as a pre-clinical training tool. There was a clear emerging theme that MITIE could be a useful learning tool that students could access to consolidate their clinical learning, either during their academic timetables or their clinical placement. Conclusion Student feedback and performance data indicate that MITIE has a valuable role to play in the clinical skills training for medical imaging students both in the academic and the clinical environment. Future work will establish a framework for an appropriate supporting pedagogy that can cross the boundary between the two environments. This project was possible due to funding made available by Health Workforce Australia.

Investigating the 'integrated' in work-integrated learning.

Work-integrated learning (WIL) is an educational strategy in which students undergo conventional academic learning with an educational institution, and combine this with some time spent in a workplace relevant to their program of study and career aims. It goes under a number of names internationally; sandwich degree (Ward & Jefferies, 2004); cooperative education; and internships (Groenewald, 2004; Sovilla & Varty, 2004; Walters, 1947). The name cooperative education reflects the tripartite nature of WIL in which the student, tertiary education institution (TEI), and workplace work together collaboratively to develop a comprehensive skill set in students (Coll, 1996). Recently the World Association for Cooperative Education added 'integrated' in a by-line to its name to reflect a broader perspective of the nature of cooperative education that can include capstone programs [practicum], internships, sandwich degrees, and work-based learning via industry projects (Franks & Blomqvist, 2004). A key aspect of WIL is the notion that it entails the integration of knowledge and skills gained in the educational institution and in the workplace. It is the integration aspect of WIL that distinguishes it from workplace learning (i.e., simply what a student or employee learns in the workplace, see Boud & Falchikov, 2006).

Eames (2003) notes that whilst there is a rich literature on the success of WIL programs, such research is almost entirely concerned with what he terms 'operational outcomes', such as benefits for students (Dressler & Keeling, 2004), employers (Braunstein & Loken, 2004), and TEIs (Weisz & Chapman, 2004). For example, it has been reported that compared with conventional graduates students who participate in WIL programs gain employment more easily, fit in better in the workplace, advance more rapidly in their careers, and so on (Dressler & Keeling, 2004). However, there is a serious paucity of research into what WIL students learn, how they learn, whom they learn from (Eames & Bell, 2005), and how the learning might be better facilitated and supported. A key purpose of work-integrated learning is the notion of providing graduates with a comprehensive skill set desired by potential employers. However, the literature notes that it is problematic for tertiary education providers to provide students with such skills, especially behavioural skills; the so-called soft skills (Burchell, Hodges & Rainsbury, 2000; Coll & Zegwaard, 2006). In what way does the student take what he or she has learned into the workplace, and conversely in what way does what the student learns in the workplace become related to, or incorporated into, the next phase of academic learning when he or she returns to the TEI after completing a work-placement?

Relationship between academic achievement and co-curricular involvement

Girls should increasingly participate in the health benefits of team sports learning opportunities. Boys need to not neglect academic learning goals in favour of team sports rewards that are highly valued by peers. Co-curricularly disengaged boys need to participate in co-curricular learning activities that provide opportunities for boys to succeed.

Degrees of difficulty : an ecological account of learning in Australian higher education

In this article, the difficulties some Australian university students experience in academic learning environments are explored. Particular attention is given to the experiences of students whose difficulties are often portrayed as intrinsic to them, and who are diagnosed as having learning disabilities or 'disorders'. In so doing, dominant neuro-psychological perspectives on students' learning 'problems' are challenged, broadening the discussion to include sociocultural explanations of students' difficulties. Research that foregrounds these students' own accounts of their problems is reported, identifying a number of tests of time, association and dissimulation that they experience in coming to terms with the particular institutional requirements of university life. At the very least, these explanations draw attention to the need for university teaching scholars to also be learners, and to consider their own practices in the construction of learning difficulties for their students.

Difficult times, difficult students? Teaching students with learning difficulties to be teachers

The last decade of Australian higher education has witnessed significant expansion in the provision of student places, relative to the Australian population, with student enrolment figures for undergraduate award courses in 1993 totalling 453,926, compared with 287,713 in 1983. Such expansion has raised considerable speculation amongst academics about the quality of students now entering university and their ability to successfully negotiate academic learning environments, particularly since the mid 1990s when unmet demand for higher education began to diminish; the assumption often being that lower entry scores are indicative of future academic problems. This is a significant issue for Australian regional universities, which historically have struggled to attract students with high entry scores and which are likely to experience even greater competition from metropolitan universities given the prospect of 'vouchers', a possibility (re)floated by the West Review, which will enable students to be more selective in their university of choice. Moreover, these 'problems' seem compounded for teacher educators who are required to deliver greater numbers of graduates to satisfy a current shortage of teachers in many Australian States and also to 'soak up' government funded places within their institutions that other faculties have been unable to fill, while drawing from a diminishing pool of high entry-scoring applicants. Within this context, this paper addresses the possibility for teacher educators of facing classes with increasing numbers of students with learning difficulties and learning disabilities, estimated in the early 1980s by Sykes (1982) to be about 5% of university students. In raising these issues, the paper makes two broad contributions. First, it engages with the discussion within the literature concerning competing definitions of university students' learning difficulties and learning disabilities, suggesting that the debate is unhelpful and that the differences are not that important when consideration is given to how they are experienced by students. Secondly, and flowing logically from this, the paper argues that rather than simply defining learning difficulty as intrinsic to students, academic learning environments, and those who construct them, are also implicated in the determination of how difficult (or otherwise) they are for students to access.

Comparing experiences of academic mobility and migration

Academic mobility and accompanying migration have become increasingly evident as manifestations of globalization and internationalization of education worldwide. This paper aims to provide some insights into intercultural communication in academia by comparing experiences of students and academics who partake in academic mobility or/and academic migration. It seeks to reflect on how differences in cultural patterns impact on the integrational experiences and outcomes of academic learning and everyday interactions. Two contrasting cultural patterns of collectivism and individualism are explored, as they are displayed in intercultural interactions among migrants and hosting societies. To expose this contrast effectively, this paper focuses on the Russian-speaking mobile academics and compares their intercultural experiences in academia of two countries—Italy and Australia. In-depth interviews were conducted with twenty-two academic migrants or/and mobile academics on their experiences, views and perceptions of intercultural integration in two diverse settings. This paper explores diverse aspects of intercultural dialogue and compares perceptions of intercultural integration and feelings of wellbeing. It analyses evolving empirical manifestations of cosmopolitanism in everyday intercultural interactions and argues that postmodern cosmopolitan milieu facilitates intercultural integration and enables knowledge transfer and creation of shared cultural meanings.

The social network learning cloud: architectural education for the 21 century

In less than a decade, architectural education has, in some ways, significantly evolved. The advent of computation has not so much triggered the change, but Social Networks (SN) have ignited a novel way of learning, interaction and knowledge construction. SN enable learners to engage with friends, tutors, professionals and peers, form the base for learning resources, allow students to make their voices heard, to listen to other views and much more. They offer a more authentic, inter-professional and integrated problem based, Just-in-Time (JIT), Just-in-Place (JIP) learning. Online SN work in close association with offline SN to form a blended social learning realm-the Social Network Learning Cloud (SNLC)-that greatly enables and enhances students' learning in a far more influential way than any other learning means, resources or methods do. This paper presents a SNLC for architectural education that provides opportunities for linking the academic Learning Management Systems (LMS) with private or professional SN such that it enhances the learning experience and deepens the knowledge of the students. The paper proposes ways of utilising SNLC in other learning and teaching areas of the curriculum and concludes with directions of how SNLC then may be employed in professional settings.

Students’ academic, intercultural and personal development in globalised education mobility

A growing number of students around the world are engaged in cross-border study mobility. Their academic, intercultural and personal development is a major concern and responsibility of not only the students themselves and their families but also the host institutions and other actors involved in the education of this cohort. This chapter addresses the pressing need to capitalise on international students’ dual strengths of diverse knowledge and transformative capacity as a meaningful and valuable approach to optimising their personal, intercultural and academic development. It also argues that international students’ learning should be conceptualised from a critical approach that considers how these diverse and intangible dimensions of the mobility landscape affect their learning experience rather than merely locating their learning in cultural, institutional or individual parameters.