Engineering education research - the UK perspective at a time of change

Engineering education in the United Kingdom is at the point of embarking upon an interesting journey into uncharted waters. At no point in the past have there been so many drivers for change and so many opportunities for the development of engineering pedagogy. This paper will look at how Engineering Education Research (EER) has developed within the UK and what differentiates it from the many small scale practitioner interventions, perhaps without a clear research question or with little evaluation, which are presented at numerous staff development sessions, workshops and conferences. From this position some examples of current projects will be described, outcomes of funding opportunities will be summarised and the benefits of collaboration with other disciplines illustrated. In this study, I will account for how the design of task structure according to variation theory, as well as the probe-ware technology, make the laws of force and motion visible and learnable and, especially, in the lab studied make Newton's third law visible and learnable. I will also, as a comparison, include data from a mechanics lab that use the same probe-ware technology and deal with the same topics in mechanics, but uses a differently designed task structure. I will argue that the lower achievements on the FMCE-test in this latter case can be attributed to these differences in task structure in the lab instructions. According to my analysis, the necessary pattern of variation is not included in the design. I will also present a microanalysis of 15 hours collected from engineering students' activities in a lab about impulse and collisions based on video recordings of student's activities in a lab about impulse and collisions. The important object of learning in this lab is the development of an understanding of Newton's third law. The approach analysing students interaction using video data is inspired by ethnomethodology and conversation analysis, i.e. I will focus on students practical, contingent and embodied inquiry in the setting of the lab. I argue that my result corroborates variation theory and show this theory can be used as a 'tool' for designing labs as well as for analysing labs and lab instructions. Thus my results have implications outside the domain of this study and have implications for understanding critical features for student learning in labs. Engineering higher education is well used to change. As technology develops the abilities expected by employers of graduates expand, yet our understanding of how to make informed decisions about learning and teaching strategies does not without a conscious effort to do so. With the numerous demands of academic life, we often fail to acknowledge our incomplete understanding of how our students learn within our discipline. The journey facing engineering education in the UK is being driven by two classes of driver. Firstly there are those which we have been working to expand our understanding of, such as retention and employability, and secondly the new challenges such as substantial changes to funding systems allied with an increase in student expectations. Only through continued research can priorities be identified, addressed and a coherent and strong voice for informed change be heard within the wider engineering education community. This new position makes it even more important that through EER we acquire the knowledge and understanding needed to make informed decisions regarding approaches to teaching, curriculum design and measures to promote effective student learning. This then raises the question 'how does EER function within a diverse academic community?' Within an existing community of academics interested in taking meaningful steps towards understanding the ongoing challenges of engineering education a Special Interest Group (SIG) has formed in the UK. The formation of this group has itself been part of the rapidly changing environment through its facilitation by the Higher Education Academy's Engineering Subject Centre, an entity which through the Academy's current restructuring will no longer exist as a discrete Centre dedicated to supporting engineering academics. The aims of this group, the activities it is currently undertaking and how it expects to network and collaborate with the global EER community will be reported in this paper. This will include explanation of how the group has identified barriers to the progress of EER and how it is seeking, through a series of activities, to facilitate recognition and growth of EER both within the UK and with our valued international colleagues.

Digital anthropology and educational eGames: learning through behavioural patterns in digital, game-based contexts

The selected publications are focused on the relations between users, eGames and the educational context, and how they interact together, so that both learning and user performance are improved through feedback provision. A key part of this analysis is the identification of behavioural, anthropological patterns, so that users can be clustered based on their actions, and the steps taken in the system (e.g. social network, online community, or virtual campus). In doing so, we can analyse large data sets of information made by a broad user sample,which will provide more accurate statistical reports and readings. Furthermore, this research is focused on how users can be clustered based on individual and group behaviour, so that a personalized support through feedback is provided, and the personal learning process is improved as well as the group interaction. We take inputs from every person and from the group they belong to, cluster the contributions, find behavioural patterns and provide personalized feedback to the individual and the group, based on personal and group findings. And we do all this in the context of educational games integrated in learning communities and learning management systems. To carry out this research we design a set of research questions along the 10-year published work presented in this thesis. We ask if the users can be clustered together based on the inputs provided by them and their groups; if and how these data are useful to improve the learner performance and the group interaction; if and how feedback becomes a useful tool for such pedagogical goal; if and how eGames become a powerful context to deploy the pedagogical methodology and the various research methods and activities that make use of that feedback to encourage learning and interaction; if and how a game design and a learning design must be defined and implemented to achieve these objectives, and to facilitate the productive authoring and integration of eGames in pedagogical contexts and frameworks. We conclude that educational games are a resourceful tool to provide a user experience towards a better personalized learning performance and an enhance group interaction along the way. To do so, eGames, while integrated in an educational context, must follow a specific set of user and technical requirements, so that the playful context supports the pedagogical model underneath. We also conclude that, while playing, users can be clustered based on their personal behaviour and interaction with others, thanks to the pattern identification. Based on this information, a set of recommendations are provided Digital Anthropology and educational eGames 6 /216 to the user and the group in the form of personalized feedback, timely managed for an optimum impact on learning performance and group interaction level. In this research, Digital Anthropology is introduced as a concept at a late stage to provide a backbone across various academic fields including: Social Science, Cognitive Science, Behavioural Science, Educational games and, of course, Technology-enhance learning. Although just recently described as an evolution of traditional anthropology, this approach to digital behaviour and social structure facilitates the understanding amongst fields and a comprehensive view towards a combined approach. This research takes forward the already existing work and published research onusers and eGames for learning, and turns the focus onto the next step — the clustering of users based on their behaviour and offering proper, personalized feedback to the user based on that clustering, rather than just on isolated inputs from every user. Indeed, this pattern recognition in the described context of eGames in educational contexts, and towards the presented aim of personalized counselling to the user and the group through feedback, is something that has not been accomplished before.

Game Learning Analytics: Learning Analytics for Serious Games

Video games have become one of the largest entertainment industries, and their power to capture the attention of players worldwide soon prompted the idea of using games to improve education. However, these educational games, commonly referred to as serious games, face different challenges when brought into the classroom, ranging from pragmatic issues (e.g. a high development cost) to deeper educational issues, including a lack of understanding of how the students interact with the games and how the learning process actually occurs. This chapter explores the potential of data-driven approaches to improve the practical applicability of serious games. Existing work done by the entertainment and learning industries helps to build a conceptual model of the tasks required to analyze player interactions in serious games (gaming learning analytics or GLA). The chapter also describes the main ongoing initiatives to create reference GLA infrastructures and their connection to new emerging specifications from the educational technology field. Finally, it explores how this data-driven GLA will help in the development of a new generation of more effective educational games and new business models that will support their expansion. This results in additional ethical implications, which are discussed at the end of the chapter.

Creating New Design-Build-Test Experiences as Outputs of Undergraduate Design-Build-Test Projects

This paper describes a methodology of using individual engineering undergraduate student projects as a means of effectively and efficiently developing new Design-Build-Test (DBT) learning experiences and challenges.
A key aspect of the rationale for this approach is that it benefits all parties. The student undertaking the individual project gets an authentic experience of producing a functional artefact, which has been the result of a design process that addresses conception, design, implementation and operation. The supervising faculty member benefits from live prototyping of new curriculum content and resources with a student who is at a similar level of knowledge and experience as the intended end users of the DBT outputs. The multiple students who ultimately undertake the DBT experiences / challenges benefit from the enhanced nature of a learning experience which has been “road tested” and optimised.
To demonstrate the methodology the paper will describe a case study example of an individual project completed in 2015. This resulted in a DBT design challenge with a theme of designing a catapult for throwing table tennis balls, the device being made from components laser cut from medium density fibreboard (MDF). Further three different modes of operation will be described which use the same resource materials but operate over different timescales and with different learning outcomes, from an icebreaker exercise focused on developing team dynamics through to full DBT where students get an opportunity to experience the full impact of their design decisions by competing against other students with a catapult they have designed and built themselves.

Barnsley College: Rethinking assessment of work-based learning

Barnsley College’s level 3 and 4 diplomas in digital learning design are delivered in one year, enabling apprentices to be employed alongside their studies in the college’s innovative learning design company, Elephant Learning Designs. The limited time this allows for delivery and assessment has prompted course leaders to rethink their approach to course structure, assessment and feedback design, and the role of technology in evidence collection.

Design de comunicação aplicado à educação musical

Dissertação de Mestrado para obtenção do grau de Mestre em Design de Comunicação, apresentada na Universidade de Lisboa - Faculdade de Arquitectura.

A new educational technology for media and communication studies : mapping media in Australia and Sweden

This chapter reports on Australian and Swedish experiences in the iterative design, development, and ongoing use of interactive educational systems we call ‘Media Maps.’ Like maps in general, Media Maps are usefully understood as complex cultural technologies; that is, they are not only physical objects, tools and artefacts, but also information creation and distribution technologies, the use and development of which are embedded in systems of knowledge and social meaning. Drawing upon Australian and Swedish experiences with one Media Map technology, this paper illustrates this three-layered approach to the development of media mapping. It shows how media mapping is being used to create authentic learning experiences for students preparing for work in the rapidly evolving media and communication industries. We also contextualise media mapping as a response to various challenges for curriculum and learning design in Media and Communication Studies that arise from shifts in tertiary education policy in a global knowledge economy.

Redefining the student-teacher relationship through online sharing activities

The student-teacher relationship should be a critical factor for successful teaching and learning in design education. In tradition, the relationship is defined as a master-apprentice, so design teachers’ visual assessment capability and technical standards significantly affect students’ quality of learning and achievements. However, there are some negative aspects of the master-apprentice relationship in design education that it may restrict student experiences to cultural diversity and interdisciplinary learning through various interactions with other students. A visual design subject was designed to adapt a new learning method that is to share students’ work and assessment through an asynchronous communication tool. This method was expected to reduce the negative aspects of the master-apprentice relationship and enhance peer-to-peer interactions and individualistic collaboration. A survey with two types of student groups in terms of their levels of participation was conducted to evaluate student experiences to this method. The outcomes implicate that online peer assessment is helpful to reduce the negative aspects of master-apprentice relation and can be useful for achieving the ultimate purpose of design education.

Pedagogical learnings for management education : developing creativity and innovation

This paper argues that management education needs to consider a trend in learning design which advances creative learning through an alliance with art-based pedagogical processes. A shift is required from skills training to facilitating transformational learning through experiences that expand human potential, facilitated by artistic processes. This creative learning focus stems from a qualitative and quantitative analysis of an arts-based intervention for management development, called Management Jazz, conducted over three years at a large Australian University. The paper reviews some of the salient literature in the field, including an ‘Artful Learning Wave Trajectory’ Model. The Model considers four stages of the learning process: capacity, artful event, increased capability, and application/action to produce product. Methodology for the field-based research analysis of the intervention outcomes is presented. Three illustrative examples of arts-based learning are provided from the Management Jazz program. Finally, research findings indicate that artful learning opportunities enhance capacity for awareness of creativity in one’s self and in others, leading, through a transformative process, to enhanced leaders and managers. The authors conclude that arts-based management education can enhance creative capacity and develop managers and leaders for the 21st century business environment.

There, yet not there : human relationships with technology

There is a “reality” to being online which we know to be false. We are simultaneously “there” but “not there” as we talk, work and play with others in online spaces. We move between physical and virtual spaces in ways that realise the predictions made for computers in the mid-20th Century and enact scenarios from science fiction. We are left wondering if our thoughts - through our disembodied selves - have become a “second self” or if we have become part of the machine itself. Information and communication technology (ICT) have brought differing human and technological agencies to all aspects of contemporary life including teaching and learning. This paper attempts to identify and categorise these agencies through the genres of technics and to illustrate them – and our relationships with technology - through reference to philosophy, fiction and reality. It also stands as an introduction to this special issue on the agency of technology.

Developing consistency in teacher judgment formation through online meeting centres

This paper investigates the complex interactions that occur as teachers meet online to justify and negotiate their assessment judgments of student work across relatively large and geographically dispersed populations. Drawing from sociocultural theories of learning and technology, the technology is positioned as playing a role in either supporting or hindering teachers reaching a common understanding of assessment standards. Meeting transcripts and interviews with the teachers have been qualitatively analysed in terms of the interactions that occurred and teachers’ perceptions of these interactions. While online meetings offer a partial solution to address the current demands of assessment in education, they also present new challenges as teachers meet, in an unfamiliar environment, to discuss student work.

Innovative use of Blackboard® to assess laboratory skills

A novel application of the popular web instruction architecture Blackboard Academic Suite® is described. The method was applied to a large number of students to assess quantitatively the accuracy of each student’s laboratory skills. The method provided immediate feedback to students on their personal skill level, replaced labour-intensive scrutiny of laboratory skills by teaching staff and identified immediately those students requiring further individual assistance in mastering the skill under evaluation. The method can be used for both formative and summative assessment. When used formatively, the assessment can be repeated by the student without penalty until the skill is mastered. When used for summative assessment, the method can save the teacher much time and effort in assessing laboratory skills of vital importance to students in the real world.

Integrated literacies : every online player wins a prize

QUT Library’s model of learning support brings together academic literacy (study skills) and information literacy (research skills). The blended portfolio enables holistic planning and development, seamless services, connected learning resources and more authentic curriculum-embedded education. The model reinforces the Library’s strategic focus on learning service innovation and active engagement in teaching and learning. ----- ----- ----- The online learning strategy is a critical component of the broader literacies framework. This strategy unifies new and existing online resources (e.g.: Pilot, QUT cite|write and IFN001|AIRS Online) to augment learner capability. Across the suite, prudent application of emerging technologies with visual communications and learning design delivers a wide range of adaptive study tools. Separately and together, these resources meet the learning needs and styles of a diverse cohort providing positive and individual learning opportunities. Deliberate articulation with strategic directions regarding First Year Experience, assessment, retention and curriculum alignment assures that the Library’s initiatives move in step with institutional objectives relating to enhancing the student experience and flexible blended learning. ----- ----- ----- The release of Studywell in 2010 emphasises the continuing commitment to blended literacy education. Targeting undergraduate learners (particularly 1st year/transition), this online environment provides 24/7 access to practical study and research tools. Studywell’s design and application of technology creates a “discovery infrastructure” [1] which facilitates greater self-directed learning and interaction with content. ----- ----- ----- This paper presents QUT Library’s online learning strategy within the context of the parent “integrated literacies” framework. Highlighting the key online learning resources, the paper describes the inter-relationships between those resources to develop complementary literacies. The paper details broad aspects of the overarching learning and study support framework as well as the online strategy, including strategic positioning, quality and evaluation processes, maintenance, development, implementation, and client engagement and satisfaction with the learning resources.

Course cohesion : an elusive goal for tertiary education

A program’s development and implementation in a higher education institution is usually launched with great fanfare, goodwill and a huge effort on the part of the whole development team to ensure a worthwhile cohesive set of learning experiences aligned to the desired course learning outcomes. It is often not long before the glue starts to come unstuck arising from staffing changes, subtle migration of course resources, opportunistic inclusions of “off the shelf” or unit based innovative teaching and learning approaches, and perhaps general poor attention to detail with regard to the impact of new introductions and electives. This paper presents an initial investigation into the elusive goal of achieving course cohesion. The authors consider building cohesion into a course as it is being designed through identified cohesion factors and in sustaining course cohesion through active leadership.

Nobody says no : student self-censorship in a collaborative knowledge building activity

This paper explores student self-censorship within an online learning environment. Self-censorship in group activity can be seen as a two-edged sword. While it can be advantageous that a student censor personal frustration and angst when working with others, if the self-censorship impacts on the cognitive contribution a student makes then this may significantly impact upon the overall quality of the group’s collective knowledge artefact. This paper reports on a study where it was found that students had self censored both their feelings and ideas as they collaboratively worked together.