The application of learning analytics to improve learning: Questions from the academy

Since 2007, close collaboration between the Learning and Teaching Unit’s Academic Quality and Standards team and the Department of Reporting and Analysis’ Business Objects team resulted in a generational approach to reporting where QUT established a place of trust. This place of trust is where data owners are confident in date storage, data integrity, reported and shared. While the role of the Department of Reporting and Analysis focused on the data warehouse, data security and publication of reports, the Academic Quality and Standards team focused on the application of learning analytics to solve academic research questions and improve student learning. Addressing questions such as: • Are all students who leave course ABC academically challenged? • Do the students who leave course XYZ stay within the faculty, university or leave? • When students withdraw from a unit do they stay enrolled on full or part load or leave? • If students enter through a particular pathway, what is their experience in comparison to other pathways? • With five years historic reporting, can a two-year predictive forecast provide any insight? In answering these questions, the Academic Quality and Standards team then developed prototype data visualisation through curriculum conversations with academic staff. Where these enquiries were applicable more broadly this information would be brought into the standardised reporting for the benefit of the whole institution. At QUT an annual report to the executive committees allows all stakeholders to record the performance and outcomes of all courses in a snapshot in time or use this live report at any point during the year. This approach to learning analytics was awarded the Awarded 2014 ATEM/Campus Review Best Practice Awards in Tertiary Education Management for The Unipromo Award for Excellence in Information Technology Management.

How can evaluative thinking and practice inform performance models for organizations and personnel

In the world today there are many ways in which we measure, count and determine whether something is worth the effort or not. In Australia and many other countries, new government legislation is requiring government-funded entities to become more transparent in their practice and to develop a more cohesive narrative about the worth, or impact, for the betterment of society. This places the executives of such entities in a position of needing evaluative thinking and practice to guide how they may build the narrative that documents and demonstrates this type of impact. In thinking about where to start, executives, project and program managers may consider this workshop as a professional development opportunity to explore both the intended and unintended consequences of performance models as tools of evaluation. This workshop will offer participants an opportunity to unpack the place of performance models as an evaluative tool through the following: · What shape does an ethical, sound and valid performance measure for an organization or personnel take? · What role does cultural specificity play in the design and development of a performance model for an organization or for personnel? · How are stakeholders able to identify risk during the design and development of such models? · When and where will dissemination strategies be required? · And so what? How can you determine that your performance model implementation has made a difference now or in the future?

Establishing a framework for transforming student engagement, success and retention in higher education institutions

This poster summarises the outcomes of a national project to develop and provide a holistic framework consisting of a series of sequential and increasingly sophisticated stages that will allow higher education institutions (HEIs) to manage and improve their student engagement and retention strategies/programs.

Student facilitated PBL - A capstone collaborative learning experience in the Griffith University MBBS program

We report on an innovation in teaching and learning designed to extend the collaborative learning of PBL, that occurs during the first two years of a four year graduate entry medical program, to a capstone learning experience to assist the transition to a hospital based year 3. During the last five weeks of Year 2 the PBL sessions consist of an initial student facilitated session early in the week followed by a large format session for the entire class convened by two clinicians. The new format PBL was perceived positively by the students and staff involved and may have advantages over traditional formats in developing students' clinical reasoning and differential diagnosis skills.

Student perception of a new integrated anatomy practical program: Does students' prior learning make a difference?

While there is evidence that science and non-science background students display small differences in performance in basic and clinical sciences, early in a 4-year, graduate entry medical program, this lessens with time. With respect to anatomy knowledge, there are no comparable data as to the impact previous anatomy experience has on the student perception of the anatomy practical learning environment. A study survey was designed to evaluate student perception of the anatomy practical program and its impact on student learning, for the initial cohort of a new medical school. The survey comprised 19 statements requiring a response using a 5-point Likert scale, in addition to a free text opportunity to provide opinion of the perceived educational value of the anatomy practical program. The response rate for a total cohort of 82 students was 89%. The anatomy practical program was highly valued by the students in aiding their learning of anatomy, as indicated by the high mean scores for all statements (range: 4.04-4.7). There was a significant difference between the students who had and had not studied a science course prior to entering medicine, with respect to statements that addressed aspects of the course related to its structure, organization, variety of resources, linkage to problem-based learning cases, and fairness of assessment. Nonscience students were more positive compared to those who had studied science before (P levels ranging from 0.004 to 0.035). Students less experienced in anatomy were more challenged in prioritizing core curricular knowledge. © 2011 Wiley-Liss, Inc.

A Historical Approach to Children s Physics Education : Modelling of DC-circuit Phenomena in a Small Group

This three-phase design research describes the modelling processes for DC-circuit phenomena. The first phase presents an analysis of the development of the DC-circuit historical models in the context of constructing Volta s pile at the turn of the 18th century. The second phase involves the designing of a teaching experiment for comprehensive school third graders. Among other considerations, the design work utilises the results of the first phase and research literature of pupils mental models for DC-circuit phenomena. The third phase of the research was concerned with the realisation of the planned teaching experiment. The aim of this phase was to study the development of the external representations of DC-circuit phenomena in a small group of third graders. The aim of the study has been to search for new ways to guide pupils to learn DC-circuit phenomena while emphasing understanding at the qualitative level. Thus, electricity, which has been perceived as a difficult and abstract subject, could be learnt more comprehensively. Especially, the research of younger pupils learning of electricity concepts has not been of great interest at the international level, although DC-circuit phenomena are also taught in the lower classes of comprehensive schools. The results of this study are important, because there has tended to be more teaching of natural sciences in the lower classes of comprehensive schools, and attempts are being made to develop this trend in Finland. In the theoretical part of the research an Experimental-centred representation approach, which emphasises the role of experimentalism in the development of pupil s representations, is created. According to this approach learning at the qualitative level consists of empirical operations like experimenting, observations, perception, and prequantification of nature phenomena, and modelling operations like explaining and reasoning. Besides planning teaching, the new approach can be used as an analysis tool in describing both historical modelling and the development of pupils representations. In the first phase of the study, the research question was: How did the historical models of DC-circuit phenomena develop in Volta s time? The analysis uncovered three qualitative historical models associated with the historical concept formation process. The models include conceptions of the electric circuit as a scene in the DC-circuit phenomena, the comparative electric-current phenomenon as a cause of different observable effect phenomena, and the strength of the battery as a cause of the electric-current phenomenon. These models describe the concept formation process and its phases in Volta s time. The models are portrayed in the analysis using fragments of the models, where observation-based fragments and theoretical fragements are distinguished from each other. The results emphasise the significance of the qualitative concept formation and the meaning of language in the historical modelling of DC-circuit phenomena. For this reason these viewpoints are stressed in planning the teaching experiment in the second phase of the research. In addition, the design process utilised the experimentation behind the historical models of DC-circuit phenomena In the third phase of the study the research question is as follows: How will the small group s external representations of DC-circuit phenomena develop during the teaching experiment? The main question is divided into the following two sub questions: What kind of talk exists in the small group s learning? What kinds of external representations for DC-circuit phenomena exist in the small group discourse during the teaching experiment? The analysis revealed that the teaching experiment of the small group succeeded in its aim to activate talk in the small group. The designed connection cards proved especially successful in activating talk. The connection cards are cards that represent the components of the electric circuit. In the teaching experiment the pupils constructed different connections with the connection cards and discussed, what kinds of DC-circuit phenomena would take place in the corresponding real connections. The talk of the small group was analysed by comparing two situations, firstly, when the small group discussed using connections made with the connection cards and secondly with the same connections using real components. According to the results the talk of the small group included more higher-order thinking when using the connection cards than with similar real components. In order to answer the second sub question concerning the small group s external representations that appeared in the talk during the teaching experiment; student talk was visualised by the fragment maps which incorporate the electric circuit, the electric current and the source voltage. The fragment maps represent the gradual development of the external representations of DC-circuit phenomena in the small group during the teaching experiment. The results of the study challenge the results of previous research into the abstractness and difficulty of electricity concepts. According to this research, the external representations of DC-circuit phenomena clearly developed in the small group of third graders. Furthermore, the fragment maps uncover that although the theoretical explanations of DC-circuit phenomena, which have been obtained as results of typical mental model studies, remain undeveloped, learning at the qualitative level of understanding does take place.

The potential benefits of divergent thinking and metacognitive skills in STEAM learning: A discussion paper

In the wake of an almost decade long economic downturn and increasing competition from developing economies, a new agenda in the Australian Government for science, technology, engineering, and mathematics (STEM) education and research has emerged as a national priority. However, to art and design educators, the pervasiveness and apparent exclusivity of STEM can be viewed as another instance of art and design education being relegated to the margins of curriculum (Greene, 1995). In the spirit of interdisciplinarity, there have been some recent calls to expand STEM education to include the arts and design, transforming STEM into STEAM in education (Maeda, 2013). As with STEM, STEAM education emphasises the connections between previously disparate disciplines, meaning that education has been conceptualised in different ways, such as focusing on the creative design thinking process that is fundamental to engineering and art (Bequette & Bequette, 2012). In this article, we discuss divergent creative design thinking process and metacognitive skills, how, and why they may enhance learning in STEM and STEAM.

Law student lifestyle pressures

One significant factor influencing student wellbeing is the degree to which their studies are subject to external lifestyle pressures. These pressures are relieved or exacerbated by choices students make around their approaches to study, and the amount of time they devote to work and leisure. This Chapter considers results from a 2012 survey of law students at the University of New South Wales (UNSW), Sydney, Australia. Those results are compared to results from a similar US law student survey, and comparable data from the UK and Australia more broadly. In addition, the UNSW study compares key lifestyle choices of undergraduate (LLB) and graduate (JD) law students. The significance of the analysis in this Chapter for understanding law students’ wellbeing is that comparing American and Australian law students’ lifestyle patterns provides insights into contextual variation between both groups, which is important to bear in mind when comparing American and Australian research on law students’ wellbeing, and appreciating the limits of such comparisons. In particular, much of the wellbeing literature to date has focused on course-based stressors, but in light of recent research indicating that improvements in students’ course-based experiences may not have a direct effect on law students’ elevated levels of psychological distress, it is important to understand the broader life pressures and stressors that may be impacting law students’ wellbeing.

Student performance in field education placements: The findings of a 6-year Australian study of admissions data

This article reports on a 6-year study that examined the association between pre-admission variables and field placement performance in an Australian bachelor of social work program (N=463). Very few of the pre-admission variables were found to be significantly associated with performance. These findings and the role of the admissions process are discussed. In addition to the usual academic criteria, the authors urge schools to include a focus on nonacademic criteria during the admissions process and the ongoing educational program.

Student satisfaction with models of field placement supervision

Field placements provide social work students with the opportunity to integrate their classroom learning with the knowledge and skills used in various human service programs. The supervision structure that has most commonly been used is the intensive one-to-one, clinical teaching model. However, this model is being challenged by significant changes in educational and industry sectors, which have led to an increased use of alternative fieldwork structures and supervision arrangements, including task supervision, group supervision, external supervision, and shared supervisory arrangements. This study focuses on identifying models of supervision and student satisfaction with their learning experiences and the supervision received on placement. The study analysed responses to a questionnaire administered to 263 undergraduate social work students enrolled in three different campuses in Australia after they had completed their first or final field placement. The study identified that just over half of the placements used the traditional one student to one social work supervisor model. A number of “emerging” models were also identified, where two or more social workers were involved in the professional supervision of the student. High levels of dissatisfaction were reported by those students who received external social work supervision. Results suggest that students are more satisfied across all aspects of the placement where there is a strong on-site social work presence.

Student satisfaction with models of field placement supervision

Field placements provide social work students with the opportunity to integrate their classroom learning with the knowledge and skills used in various human service programs. The supervision structure that has most commonly been used is the intensive one-to-one, clinical teaching model. However, this model is being challenged by significant changes in educational and industry sectors, which have led to an increased use of alternative fieldwork structures and supervision arrangements, including task supervision, group supervision, external supervision, and shared supervisory arrangements. This study focuses on identifying models of supervision and student satisfaction with their learning experiences and the supervision received on placement. The study analysed responses to a questionnaire administered to 263 undergraduate social work students enrolled in three different campuses in Australia after they had completed their first or final field placement. The study identified that just over half of the placements used the traditional one student to one social work supervisor model. A number of “emerging” models were also identified, where two or more social workers were involved in the professional supervision of the student. High levels of dissatisfaction were reported by those students who received external social work supervision. Results suggest that students are more satisfied across all aspects of the placement where there is a strong on-site social work presence.

Enhancing Physics Education in the National Defence University : A design based research approach in the production of learning material

This research is connected with an education development project for the four-year-long officer education program at the National Defence University. In this curriculum physics was studied in two alternative course plans namely scientific and general. Observations connected to the later one e.g. student feedback and learning outcome gave indications that action was needed to support the course. The reform work was focused on the production of aligned course related instructional material. The learning material project produced a customized textbook set for the students of the general basic physics course. The research adapts phases that are typical in Design Based Research (DBR). The research analyses the feature requirements for physics textbook aimed at a specific sector and frames supporting instructional material development, and summarizes the experiences gained in the learning material project when the selected frames have been applied. The quality of instructional material is an essential part of qualified teaching. The goal of instructional material customization is to increase the product's customer centric nature and to enhance its function as a support media for the learning process. Textbooks are still one of the core elements in physics teaching. The idea of a textbook will remain but the form and appearance may change according to the prevailing technology. The work deals with substance connected frames (demands of a physics textbook according to the PER-viewpoint, quality thinking in educational material development), frames of university pedagogy and instructional material production processes. A wide knowledge and understanding of different frames are useful in development work, if they are to be utilized to aid inspiration without limiting new reasoning and new kinds of models. Applying customization even in the frame utilization supports creative and situation aware design and diminishes the gap between theory and practice. Generally, physics teachers produce their own supplementary instructional material. Even though customization thinking is not unknown the threshold to produce an entire textbook might be high. Even though the observations here are from the general physics course at the NDU, the research gives tools also for development in other discipline related educational contexts. This research is an example of an instructional material development work together the questions it uncovers, and presents thoughts when textbook customization is rewarding. At the same time, the research aims to further creative customization thinking in instruction and development. Key words: Physics textbook, PER (Physics Education Research), Instructional quality, Customization, Creativity

Working with Identities Promoting Student Teachers Professional Development

The starting point of the study was that good teaching requires a teacher to be aware of the sources of his or her pedagogical decisions; that is, personal values, beliefs and understandings. From this perspective, a teacher s professional development refers to a process of extending one s self-knowledge. The aim of this study was to promote student teachers' professional development with the help of identity work. Identity work refers to reflecting on both personal and professional experiences. Identity work consists of student teachers self-reflection on their life experiences (self-identity) and video diary-based reflection on their classroom practice (professional identity). The research questions of the study were 1) how is identity work manifested by the participants? and 2) what is the potential of identity work in promoting student teachers professional development? The research data was collected from four student teachers in the academic year 2007-2008; the research group had 24 meetings during the research process. Student teachers take part in a multimode teacher education programme, where students work as ordinary teachers in schools during their university studies. The data collection was conducted by using two methods: participants narratives based on autobiographical writings and video diaries based on participants lessons. Narrative research data was analysed by employing qualitative methods and strategies as they were needed in the research. The research results revealed four different ways of working with identities, each of them revealing different aspects of and approaches to identity work. The results also showed that identity work has the potential to promote professional development. As the research progressed, there were visible changes in the participants reflection. However, despite encouraging results, some issues should be critically questioned. Although reflection sounds attractive and fruitful as a tool for promoting professional development, there are also difficulties and obstacles. On the basis of the results, a proposal for promoting student teachers professional development is offered. Keywords: Teacher identity, identity work, reflection, teacher professional development

Avoimesti sitoutuneena : Lähetystyö kristillisessä kasvatuksessa ja vapaaehtoistyössä

In this study the junction of Christian mission, Christian education and voluntary work are examined in the Christian student voluntary association Opiskelijain Lähetysliitto (OL), which is the Finnish successor to the Student Volunteer Movement. The main subjects are the structure and content of the mission education as one aspect of Lutheran education and the reasons for expressing the mission interest through voluntary work. The research questions are as follows: What kind of organization has the OL been? What has mission education been like in the OL? Why have the former chairpersons participated in the OL? How have purposiveness and intentionality arisen among the former chairpersons? The study is empirical despite having a historical and retrospective view, since the OL is explored during the period 1972 2000. The data consists of the OL s annual reports, membership applications (N=629) and interviews of all 25 former chairmen. Data is analysed by qualitative and quantitative content analysis in a partly inductive and partly deductive manner. The pedagogical framework arises from situational learning theory (Lave - Wenger 1991), which was complemented with the criteria for meaningful learning (Jonassen 1995), the octagon model of volunteer motivation (Yeung 2004) and the definitions of intentionality and purposiveness in the theory of teachers pedagogical thinking (Kansanen et al. 2000). The analysis of the archive data showed that the activities of the OL are reminiscent of those of the missions of the Finnish Evangelical Lutheran Church congregations. The biggest difference was that all OL participants were young adults, the age group that is the greatest challenge to the Church. The OL is therefore an interesting context in which to explore mission education and mission interest. The key result of the study was the forming of a model of mission educa-tion. The model has three educational components: values, goals and methods. The gist of the model is formed by the goals. The main goal is the arousing and strengthening of mission interest which has emotional, cognitive and practical aspects. The subgoals create the horizontal vertical and inward outward dimensions of the model, which are the metalevels of mission education. The subgoals reveal that societal and religious education may embody a missionary dimension when they are understood as missionary training. Further, a distinction between mission education and missionary training was observed. The former emphasizes the main goal of the model and the latter underlines the subgoals. Based on the vertical dimension of the model the study suggests that the definition of religious competence needs to be complemented with missional competence. Reasons for participating in the OL were found to be diverse as noted in other studies on volunteering and motivating factors, and were typical to young people such as the importance of social relations. The study created new motivational themes that occurred in the middle of the continuity newness and the distance proximity dimensions, which were not found in Yeung s research. Mission interest as voluntary work appeared as oriented towards one s own spirituality or towards the social community. On the other hand, mission interest was manifested as intentional education in order to either improve the community or to promote the Christian mission. In the latter case the mission was seen as a purpose in life and as a future profession. Keywords: mission, Christian education, voluntary work, mission education, mission interest, stu-dent movement