Collaborative learning and critical thinking in technology-enhanced environments : an instructional design framework

The nature and characteristics of how learners learn today are changing. As technology use in learning and teaching continues to grow, its integration to facilitate deep learning and critical thinking becomes a primary consideration. The implications for learner use, implementation strategies, design of integration frameworks and evaluation of their effectiveness in learning environments cannot be overlooked. This study specifically looked at the impact that technology-enhanced learning environments have on different learners’ critical thinking in relation to eductive ability, technological self-efficacy, and approaches to learning and motivation in collaborative groups. These were explored within an instructional design framework called CoLeCTTE (collaborative learning and critical thinking in technology-enhanced environments) which was proposed, revised and used across three cases. The field of investigation was restricted to three key questions: 1) Do learner skill bases (learning approach and eductive ability) influence critical thinking within the proposed CoLeCTTE framework? If so, how?; 2) Do learning technologies influence the facilitation of deep learning and critical thinking within the proposed CoLeCTTE framework? If so, how?; and 3) How might learning be designed to facilitate the acquisition of deep learning and critical thinking within a technology-enabled collaborative environment? The rationale, assumptions and method of research for using a mixed method and naturalistic case study approach are discussed; and three cases are explored and analysed. The study was conducted at the tertiary level (undergraduate and postgraduate) where participants were engaged in critical technical discourse within their own disciplines. Group behaviour was observed and coded, attributes or skill bases were measured, and participants interviewed to acquire deeper insights into their experiences. A progressive case study approach was used, allowing case investigation to be implemented in a "ladder-like" manner. Cases 1 and 2 used the proposed CoLeCTTE framework with more in-depth analysis conducted for Case 2 resulting in a revision of the CoLeCTTE framework. Case 3 used the revised CoLeCTTE framework and in-depth analysis was conducted. The findings led to the final version of the framework. In Cases 1, 2 and 3, content analysis of group work was conducted to determine critical thinking performance. Thus, the researcher used three small groups where learner skill bases of eductive ability, technological self-efficacy, and approaches to learning and motivation were measured. Cases 2 and 3 participants were interviewed and observations provided more in-depth analysis. The main outcome of this study is analysis of the nature of critical thinking within collaborative groups and technology-enhanced environments positioned in a theoretical instructional design framework called CoLeCTTE. The findings of the study revealed the importance of the Achieving Motive dimension of a student’s learning approach and how direct intervention and strategies can positively influence critical thinking performance. The findings also identified factors that can adversely affect critical thinking performance and include poor learning skills, frustration, stress and poor self-confidence, prioritisations over learning; and inadequate appropriation of group role and tasks. These findings are set out as instructional design guidelines for the judicious integration of learning technologies into learning and teaching practice for higher education that will support deep learning and critical thinking in collaborative groups. These guidelines are presented in two key areas: technology and tools; and activity design, monitoring, control and feedback.

Using natural user interfaces for collaborative process modelling in virtual environments

Modelling business processes for analysis or redesign usually requires the collaboration of many stakeholders. These stakeholders may be spread across locations or even companies, making co-located collaboration costly and difficult to organize. Modern process modelling technologies support remote collaboration but lack support for visual cues used in co-located collaboration. Previously we presented a prototype 3D virtual world process modelling tool that supports a number of visual cues to facilitate remote collaborative process model creation and validation. However, the added complexity of having to navigate a virtual environment and using an avatar for communication made the tool difficult to use for novice users. We now present an evolved version of the technology that addresses these issues by providing natural user interfaces for non-verbal communication, navigation and model manipulation.

Using natural user interfaces for collaborative process modelling in virtual environments

A demo video showing the BPMVM prototype using several natural user interfaces, such as multi-touch input, full-body tracking and virtual reality.

On facilitating regional integration and economic development with collaborative technologies in the South Pacific

The current global economic instability and the vulnerability of small island nations are providing the impetus for greater integration between the countries of the South Pacific region. This exercise is critical for their survival in today’s turbulent economic environment. Past efforts of regional integration in the South Pacific have not been very successful. Reasons attributed to this outcome include issues related to damage of sovereignty, and lack of a shared integration infrastructure. Today, the IT resources with collaborative capacities provide the opportunity to develop a shared IT infrastructure to facilitate integration in the South Pacific. In an attempt to develop a model of regional integration with an IT-backed infrastructure, we identify and report on the antecedents of the current stage of regional integration, and the stakeholders’ perceived benefits of an IT resources backed regional integration in the South Pacific. Employing a case study based approach, the study finds that while most stakeholders were positive about the potential of IT-backed regional integration, significant challenges exist that hinder the realisation of this model. The study finds that facilitating IT-backed regional integration requires enabling IT infrastructure, equitable IT development in the region, greater awareness on the potential of the modern IT resources, market liberalisation of the information and telecommunications sector and greater political support for IT initiatives.

Sessional Academic Success : A distributed framework for academic support and development

With approximately half of Australian university teaching now performed by sessional academics, there has been growing recognition of the contribution they make to student learning. At the same time, sector-wide research and institutional audits continue to raise concerns about academic development, quality assurance, recognition and belonging. In response, universities have increasingly begun to offer academic development programs for sessional academics. However, such programs may be centrally delivered, generic in nature, and contained within the moment of delivery, while the Faculty contexts and cultures that sessional academics work within are diverse, and the need for support unfolds in ad-hoc and often unpredictable ways. In this paper we present the Sessional Academic Success (SAS) program–a new framework that complements and extends the central academic development program for sessional academic staff at Queensland University of Technology. This program recognises that experienced sessional academics have much to contribute to the advancement of learning and teaching, and harnesses their expertise to provide school-based academic development opportunities, peer-to-peer support, and locally contextualized community building. We describe the program’s implementation and explain how Sessional Academic Success Advisors (SASAs) are employed, trained and supported to provide advice and mentorship and, through a co-design methodology, to develop local development opportunities and communities of teaching practice within their schools. Besides anticipated benefits to new sessional academics in terms of timely and contextual support and improved sense of belonging, we explain how SAS provides a pathway for building leadership capacity and academic advancement for experienced sessional academics. We take a collaborative, dialogic and reflective practice approach to this paper, interlacing insights from the Associate Director, Academic: Sessional Development who designed the program, and two Sessional Academic Success Advisors who have piloted it within their schools.

A grand challenge : reflecting on university science curriculum design, collaborative partnerships and integration of information literacy skills

In 2012, Queensland University of Technology (QUT) committed to the massive project of revitalizing its Bachelor of Science (ST01) degree. Like most universities in Australia, QUT has begun work to align all courses by 2015 to the requirements of the updated Australian Qualifications Framework (AQF) which is regulated by the Tertiary Education Quality and Standards Agency (TEQSA). From the very start of the redesigned degree program, students approach scientific study with an exciting mix of theory and highly topical real world examples through their chosen “grand challenge.” These challenges, Fukushima and nuclear energy for example, are the lenses used to explore science and lead to 21st century learning outcomes for students. For the teaching and learning support staff, our grand challenge is to expose all science students to multidisciplinary content with a strong emphasis on embedding information literacies into the curriculum. With ST01, QUT is taking the initiative to rethink not only content but how units are delivered and even how we work together between the faculty, the library and learning and teaching support. This was the desired outcome but as we move from design to implementation, has this goal been achieved? A main component of the new degree is to ensure scaffolding of information literacy skills throughout the entirety of the three year course. However, with the strong focus on problem-based learning and group work skills, many issues arise both for students and lecturers. A move away from a traditional lecture style is necessary but impacts on academics’ workload and comfort levels. Therefore, academics in collaboration with librarians and other learning support staff must draw on each others’ expertise to work together to ensure pedagogy, assessments and targeted classroom activities are mapped within and between units. This partnership can counteract the tendency of isolated, unsupported academics to concentrate on day-to-day teaching at the expense of consistency between units and big picture objectives. Support staff may have a more holistic view of a course or degree than coordinators of individual units, making communication and truly collaborative planning even more critical. As well, due to staffing time pressures, design and delivery of new curriculum is generally done quickly with no option for the designers to stop and reflect on the experience and outcomes. It is vital we take this unique opportunity to closely examine what QUT has and hasn’t achieved to be able to recommend a better way forward. This presentation will discuss these important issues and stumbling blocks, to provide a set of best practice guidelines for QUT and other institutions. The aim is to help improve collaboration within the university, as well as to maximize students’ ability to put information literacy skills into action. As our students embark on their own grand challenges, we must challenge ourselves to honestly assess our own work.

Perioperative medication management: expanding the role of the preadmission clinic pharmacist in a single centre, randomised controlled trial of collaborative prescribing

Objectives Current evidence to support non-medical prescribing is predominantly qualitative, with little evaluation of accuracy, safety and appropriateness. Our aim was to evaluate a new model of service for the Australia healthcare system, of inpatient medication prescribing by a pharmacist in an elective surgery preadmission clinic (PAC) against usual care, using an endorsed performance framework. Design Single centre, randomised controlled, two-arm trial. Setting Elective surgery PAC in a Brisbane-based tertiary hospital. Participants 400 adults scheduled for elective surgery were randomised to intervention or control. Intervention A pharmacist generated the inpatient medication chart to reflect the patient's regular medication, made a plan for medication perioperatively and prescribed venous thromboembolism (VTE) prophylaxis. In the control arm, the medication chart was generated by the Resident Medical Officers. Outcome measures Primary outcome was frequency of omissions and prescribing errors when compared against the medication history. The clinical significance of omissions was also analysed. Secondary outcome was appropriateness of VTE prophylaxis prescribing. Results There were significantly less unintended omissions of medications: 11 of 887 (1.2%) intervention orders compared with 383 of 1217 (31.5%) control (p<0.001). There were significantly less prescribing errors involving selection of drug, dose or frequency: 2 in 857 (0.2%) intervention orders compared with 51 in 807 (6.3%) control (p<0.001). Orders with at least one component of the prescription missing, incorrect or unclear occurred in 208 of 904 (23%) intervention orders and 445 of 1034 (43%) controls (p<0.001). VTE prophylaxis on admission to the ward was appropriate in 93% of intervention patients and 90% controls (p=0.29). Conclusions Medication charts in the intervention arm contained fewer clinically significant omissions, and prescribing errors, when compared with controls. There was no difference in appropriateness of VTE prophylaxis on admission between the two groups.

Designing awareness support for distributed cooperative design teams

Motivation Awareness is an integral part of remote collaborative work and has been an important theme within the CSCW research. Our project aims at understanding and mediating non-verbal cues between remote participants involved in a design project. Research approach Within the AMIDA project we focus on distributed 'cooperative design' teams. We especially focus on the 'material' signals - signals in which people communicate through material artefacts, locations and their embodied actions. We apply an ethnographic approach to understand the role of physical artefacts in co-located naturalistic design setting. Based on the results we will generate important implications to support remote design work. We plan to develop a mixed-reality interface supported by a shared awareness display. This awareness display will provide information about the activities happening in the design room to remotely located participants. Findings/Design Our preliminary investigation with real-world design teams suggests that both the materiality of designers' work settings and their social practices play an important role in understanding these material signals that are at play. Originality/Value Most research supporting computer mediated communication have focused on either face-to-face or linguistically oriented communication paradigms. Our research focuses on mediating the non-verbal, material cues for supporting collaborative activities without impoverishing what designers do in their day to day working lives. Take away message An ethnographic approach allows us to understand the naturalistic practices of design teams, which can lead to designing effective technologies to support group work. In that respect, the findings of our research will have a generic value beyond the application domain chosen (design teams).

Active awareness : supporting the intentional disclosure of awareness information in collaborative systems

This thesis opens up the design space for awareness research in CSCW and HCI. By challenging the prevalent understanding of roles in awareness processes and exploring different mechanisms for actively engaging users in the awareness process, this thesis provides a better understanding of the complexity of these processes and suggests practical solutions for designing and implementing systems that support active awareness. Mutual awareness, a prominent research topic in the fields of Computer-Supported Cooperative Work (CSCW) and Human-Computer Interaction (HCI) refers to a fundamental aspect of a person’s work: their ability to gain a better understanding of a situation by perceiving and interpreting their co-workers actions. Technologically-mediated awareness, used to support co-workers across distributed settings, distinguishes between the roles of the actor, whose actions are often limited to being the target of an automated data gathering processes, and the receiver, who wants to be made aware of the actors’ actions. This receiver-centric view of awareness, focusing on helping receivers to deal with complex sets of awareness information, stands in stark contrast to our understanding of awareness as social process involving complex interactions between both actors and receivers. It fails to take into account an actors’ intimate understanding of their own activities and the contribution that this subjective understanding could make in providing richer awareness information. In this thesis I challenge the prevalent receiver-centric notion of awareness, and explore the conceptual foundations, design, implementation and evaluation of an alternative active awareness approach by making the following five contributions. Firstly, I identify the limitations of existing awareness research and solicit further evidence to support the notion of active awareness. I analyse ethnographic workplace studies that demonstrate how actors engage in an intricate interplay involving the monitoring of their co-workers progress and displaying aspects of their activities that may be of relevance to others. The examination of a large body of awareness research reveals that while disclosing information is a common practice in face-to-face collaborative settings it has been neglected in implementations of technically mediated awareness. Based on these considerations, I introduce the notion of intentional disclosure to describe the action of users actively and deliberately contributing awareness information. I consider challenges and potential solutions for the design of active awareness. I compare a range of systems, each allowing users to share information about their activities at various levels of detail. I discuss one of the main challenges to active awareness: that disclosing information about activities requires some degree of effort. I discuss various representations of effort in collaborative work. These considerations reveal that there is a trade-off between the richness of awareness information and the effort required to provide this information. I propose a framework for active awareness, aimed to help designers to understand the scope and limitations of different types of intentional disclosure. I draw on the identified richness/effort trade-off to develop two types of intentional disclosure, both of which aim to facilitate the disclosure of information while reducing the effort required to do so. For both of these approaches, direct and indirect disclosure, I delineate how they differ from related approaches and define a set of design criteria that is intended to guide their implementation. I demonstrate how the framework of active awareness can be practically applied by building two proof-of-concept prototypes that implement direct and indirect disclosure respectively. AnyBiff, implementing direct disclosure, allows users to create, share and use shared representations of activities in order to express their current actions and intentions. SphereX, implementing indirect disclosure, represents shared areas of interests or working context, and links sets of activities to these representations. Lastly, I present the results of the qualitative evaluation of the two prototypes and analyse the results with regard to the extent to which they implemented their respective disclosure mechanisms and supported active awareness. Both systems were deployed and tested in real world environments. The results for AnyBiff showed that users developed a wide range of activity representations, some unanticipated, and actively used the system to disclose information. The results further highlighted a number of design considerations relating to the relationship between awareness and communication, and the role of ambiguity. The evaluation of SphereX validated the feasibility of the indirect disclosure approach. However, the study highlighted the challenges of implementing cross-application awareness support and translating the concept to users. The study resulted in design recommendations aimed to improve the implementation of future systems.

Using value-based partnerships to support community engaged learning : benefits, challenges, stakeholder perspectives

Increasingly, the not-for-profit sector, as an emerging contributor to the creative economy, is creating a context for engaging creative practitioners in developing solutions to complex problems, triggering a demand for skills and knowledge needed to address this complexity. Across the university and community contexts alternative models of engagement are emerging to support this dynamic. This paper presents a case study of a creative project in which a value-based approach is used to foster a collaborative partnership between community partners and a multidisciplinary team of final year Creative Industries students who in the course of the project developed a range of communication resources, including a social media campaign, an interactive game and a series of short films to support volunteer engagement and leadership initiatives. The paper considers the implications this values approach has for the design of service learning curriculum for multidisciplinary creative teams and the potential it has to support meaningful collaboration between creatives and the not-for-profit sector. It further explores how it impact on student and partner engagement, learning outcomes and the benefits for the partner organisation. The paper concludes that a value-based approach to university-community engagement has the potential to support and enable a greater degree of reciprocity, deeper engagement between stakeholders and greater relevance of the final outcome.

Participatory Data Analytics: Collaborative interfaces for data composition and visualisation

This research proposes the development of interfaces to support collaborative, community-driven inquiry into data, which we refer to as Participatory Data Analytics. Since the investigation is led by local communities, it is not possible to anticipate which data will be relevant and what questions are going to be asked. Therefore, users have to be able to construct and tailor visualisations to their own needs. The poster presents early work towards defining a suitable compositional model, which will allow users to mix, match, and manipulate data sets to obtain visual representations with little-to-no programming knowledge. Following a user-centred design process, we are subsequently planning to identify appropriate interaction techniques and metaphors for generating such visual specifications on wall-sized, multi-touch displays.

A pilot study to assess the appropriateness of prescribing from a collaborative pharmacist prescribing study in a surgical pre admission clinic

Background Current evidence to support non-medical prescribing is predominantly qualitative, with little evaluation of appropriateness. This study aims to evaluate the appropriateness of prescribing, and significance of omissions, from a doctor pharmacist collaborative prescribing model in an elective surgery pre admission clinic (PAC). Method A modified version of the Medication Appropriate Index (MAI) was developed, piloted and subsequently used by an expert panel, comprised of a surgeon, anaesthetist, clinical pharmacologist, pharmacist, resident medical officer (RMO) and clinical nurse. The tool was used to rate the appropriateness of prescribing of medications, and the significance of omissions in a 5% sample (N=19) of the total cohort from a randomised, controlled two arm trial of doctor-pharmacist collaborative prescribing. Results When reviewer assessments were combined, 32 out of 294 (10.9%) medications assessed for appropriateness in the control arm were classed as inappropriate, compared to 13 of 266 (4.9%) in the intervention arm. Out of 89 regular medications in the control arm, 25 (28%) were omitted from the medication charts, compared to 1 out of 55 (2%) in the intervention arm (p<0.001, fishers exact) On average, 52% of omissions in the control arm were judged to have potential for patient harm or ward inconvenience. Conclusion For the appropriateness of prescribing, overall results were similar between arms, as judged by individual panel members. Medication charts in the control arm contained significantly more omissions than in the intervention arm, a number of which were rated by the panel members as having the potential for patient harm or ward inconvenience.

Dynamic digital posters : making the most of collaborative learning spaces

Academic and professional staff at Queensland University of Technology (QUT) have been faced with the challenge of how to create engaging student experiences in collaborative learning spaces. In 2013 a new Bachelor of Science course was implemented focusing on inquiry-based, collaborative and active learning. Student groups in two of the first year units carried out a poster assessment task. This paper provides a preliminary evaluation of the assessment approach used, whereby students created dynamic digital posters to capitalise on the affordances of the learning space.

Designing for collaborative learning spaces : an academic staff development pilot program

To prepare for the delivery of new Bachelor of Science units in collaborative learning spaces, academic and professional staff at Queensland University of Technology piloted an academic development program over the period of a semester. The program was informed by Rogers’ theory of innovation and diffusion (2003) and structured according to Wilson’s framework for faculty development (2007). Through a series of workshops and group mentoring activities, the program modelled inquiry-based learning in a collaborative learning space, and the participants designed and practiced the delivery of teaching activities. This paper provides a preliminary evaluation of the effectiveness of the pilot based on survey responses from participants, notes from the development team who coordinated the program and audience feedback from the final showcase session. The design and structure of the program is discussed as well as possible future directions.

A BIM-based collaborative design platform for variegated specialty design

With the increase in complexity of engineering projects and design quality in the construction industry, the traditional two-dimensional "Information Island" approach to design is becoming less able to meet current design needs due to its lack of coordination and information sharing. Collaborative design using a Build Information Modeling (BIM) technology platform promises to provide an effective means of designing and communicating through networking and real-time data sharing. This paper first analyzes the shortcomings of the two-dimensional design process and the potential application of collaborative design. By combining the attributes of BIM, a preliminary BIM-based building design collaborative platform is developed to improve the design approach and support a more collaborative design process. A real-life case is presented to demonstrate the feasibility and validity of the platform and its use in practice. From this, it is shown that BIM has the potential to realize effective information sharing and reduce errors, thereby improving design quality. The BIM-based building design collaborative platform presented is expected to provide the support needed for the extensive application of BIM in collaborative design and promote a new attitude to project management.