Recipe for success — Lessons learnt from using xAPI within the Connected Learning Analytics toolkit

An ongoing challenge for Learning Analytics research has been the scalable derivation of user interaction data from multiple technologies. The complexities associated with this challenge are increasing as educators embrace an ever growing number of social and content related technologies. The Experience API (xAPI) alongside the development of user specific record stores has been touted as a means to address this challenge, but a number of subtle considerations must be made when using xAPI in Learning Analytics. This paper provides a general overview to the complexities and challenges of using xAPI in a general systemic analytics solution - called the Connected Learning Analytics (CLA) toolkit. The importance of design is emphasised, as is the notion of common vocabularies and xAPI Recipes. Early decisions about vocabularies and structural relationships between statements can serve to either facilitate or handicap later analytics solutions. The CLA toolkit case study provides us with a way of examining both the strengths and the weaknesses of the current xAPI specification, and we conclude with a proposal for how xAPI might be improved by using JSON-LD to formalise Recipes in a machine readable form.

The Connected Learning Analytics toolkit

This demonstration introduces the Connected Learning Analytics (CLA) Toolkit. The CLA toolkit harvests data about student participation in specified learning activities across standard social media environments, and presents information about the nature and quality of the learning interactions.

Towards automated content analysis of discussion transcripts: A cognitive presence case

In this paper, we present the results of an exploratory study that examined the problem of automating content analysis of student online discussion transcripts. We looked at the problem of coding discussion transcripts for the levels of cognitive presence, one of the three main constructs in the Community of Inquiry (CoI) model of distance education. Using Coh-Metrix and LIWC features, together with a set of custom features developed to capture discussion context, we developed a random forest classification system that achieved 70.3% classification accuracy and 0.63 Cohen's kappa, which is significantly higher than values reported in the previous studies. Besides improvement in classification accuracy, the developed system is also less sensitive to overfitting as it uses only 205 classification features, which is around 100 times less features than in similar systems based on bag-of-words features. We also provide an overview of the classification features most indicative of the different phases of cognitive presence that gives an additional insights into the nature of cognitive presence learning cycle. Overall, our results show great potential of the proposed approach, with an added benefit of providing further characterization of the cognitive presence coding scheme.

Digital competence and professional development of vocational education and training teachers in Queensland

Teaching with digital technologies is essential to the development of 21st century students’ graduate capabilities. However, relatively little is known about the extent to which Queensland VET teachers engage with digitally-enhanced teaching, or have the capacity to do so. Using a mixed methods approach, this thesis investigated the current digital teaching capacities of VET teachers and how current professional development opportunities are helping to address their learning needs.

Phenomenography in the Centre for Information Technology Innovation (CITI)

Phenomenography has its roots in educational research (Marton and Booth, 1997), but has since been adopted in other domains including business (Sandberg, 1994), health (Barnard, McCosker and Gerber, 1999), information science (Bruce, 1999a,b) and information technology (Bruce and Pham, 2001) as well as information systems. Emerging phenomenographic research in areas other than education, has been interdisciplinary, often bringing together technology, education and a host discipline such as health or business. In Australia, phenomenography has been used in information technology (IT) related research primarily in Victoria and Queensland. These studies have pursued the latter two of three established lines of phenomenographic research: 1) the study of conceptions of learning; 2) the study of conceptions in specific disciplines of study and 3) the study of how people conceive of various aspects of their everyday world that have not, for them, been the object of formal studies (Marton 1988, p.189). Information Technology researchers have predominantly pursued the latter two lines of research.

Portals and platforms: Does the technology matter when developing an online community?

Many education providers grapple with “where” to host their online education community. While many have invested significant funding and time into developing a user specific solution, others are using alternative open source software solutions that provide a just in time response. This research paper reports on the importance of the engagement of an online community within an open source learning management system, presents the key aspects of communication occurring and romanticizes the notion that a user specific solution is not a necessary consideration.

Enhancing students' self-concepts and related constructs: A critical longitudinal analysis capitalising on and combining promising enhancement techniques for educational settings

Enhancing children's self-concepts is widely accepted as a critical educational outcome of schooling and is postulated as a mediating variable that facilitates the attainment of other desired outcomes such as improved academic achievement. Despite considerable advances in self-concept research, there has been limited progress in devising teacher-administered enhancement interventions. This is unfortunate as teachers are crucial change agents during important developmental periods when self-concept is formed. The primary aim of the present investigation is to build on the promising features of previous self-concept enhancement studies by: (a) combining two exciting research directions developed by Burnett and Craven to develop a potentially powerful cognitive-based intervention; (b) incorporating recent developments in theory and measurement to ensure that the multidimensionality of self-concept is accounted for in the research design; (c) fully investigating the effects of a potentially strong cognitive intervention on reading, mathematics, school and learning self-concepts by using a large sample size and a sophisticated research design; (d) evaluating the effects of the intervention on affective and cognitive subcomponents of reading, mathematics, school and learning self-concepts over time to test for differential effects of the intervention; (e) modifying and extending current procedures to maximise the successful implementation of a teacher-mediated intervention in a naturalistic setting by incorporating sophisticated teacher training as suggested by Hattie (1992) and including an assessment of the efficacy of implementation; and (f) examining the durability of effects associated with the intervention.

The “Iranian ART Revolution”: infertility, assisted reproductive technology, and third-party donation in the Islamic Republic of Iran

Infertility is a social onus for women in Iran, who are expected to produce children early within marriage. With its estimated 1.5 million infertile couples, Iran is the only Muslim country in which assisted reproductive technologies (ARTs) using donor gametes and embryos have been legitimized by religious authorities and passed into law. Th is has placed Iran, a Shia-dominant country, in a unique position vis-à-vis the Sunni Islamic world, where all forms of gamete donation are strictly prohibited. In this article, we first examine the “Iranian ART revolution” that has allowed donor technologies to be admitted as a form of assisted reproduction. Then we examine the response of Iranian women to their infertility and the profound social pressures they face. We argue that the experience of infertility and its treatment are mediated by women’s socioeconomic position within Iranian society. Many women lack economic access to in vitro fertilization (IVF) technologies and fear the moral consequences of gamete donation. Thus, the benefits of the Iranian ART revolution are mixed: although many Iranian women have been able to overcome their infertility through ARTs, not all women’s lives are improved by these technologies.

Implementation of an integrated, technology-based, discovery mode assessment item involving an incubation period to enhance learning outcomes for engineering maths students

In this paper we discuss our current efforts to develop and implement an exploratory, discovery mode assessment item into the total learning and assessment profile for a target group of about 100 second level engineering mathematics students. The assessment item under development is composed of 2 parts, namely, a set of "pre-lab" homework problems (which focus on relevant prior mathematical knowledge, concepts and skills), and complementary computing laboratory exercises which are undertaken within a fixed (1 hour) time frame. In particular, the computing exercises exploit the algebraic manipulation and visualisation capabilities of the symbolic algebra package MAPLE, with the aim of promoting understanding of certain mathematical concepts and skills via visual and intuitive reasoning, rather than a formal or rigorous approach. The assessment task we are developing is aimed at providing students with a significant learning experience, in addition to providing feedback on their individual knowledge and skills. To this end, a noteworthy feature of the scheme is that marks awarded for the laboratory work are primarily based on the extent to which reflective, critical thinking is demonstrated, rather than the amount of CBE-style tasks completed by the student within the allowed time. With regard to student learning outcomes, a novel and potentially critical feature of our scheme is that the assessment task is designed to be intimately linked to the overall course content, in that it aims to introduce important concepts and skills (via individual student exploration) which will be revisited somewhat later in the pedagogically more restrictive formal lecture component of the course (typically a large group plenary format). Furthermore, the time delay involved, or "incubation period", is also a deliberate design feature: it is intended to allow students the opportunity to undergo potentially important internal re-adjustments in their understanding, before being exposed to lectures on related course content which are invariably delivered in a more condensed, formal and mathematically rigorous manner. In our presentation, we will discuss in more detail our motivation and rationale for trailing such a scheme for the targeted student group. Some of the advantages and disadvantages of our approach (as we perceived them at the initial stages) will also be enumerated. In a companion paper, the theoretical framework for our approach will be more fully elaborated, and measures of student learning outcomes (as obtained from eg. student provided feedback) will be discussed.