Collaborative learning and critical thinking in technology-enhanced environments : an instructional design framework

The nature and characteristics of how learners learn today are changing. As technology use in learning and teaching continues to grow, its integration to facilitate deep learning and critical thinking becomes a primary consideration. The implications for learner use, implementation strategies, design of integration frameworks and evaluation of their effectiveness in learning environments cannot be overlooked. This study specifically looked at the impact that technology-enhanced learning environments have on different learners’ critical thinking in relation to eductive ability, technological self-efficacy, and approaches to learning and motivation in collaborative groups. These were explored within an instructional design framework called CoLeCTTE (collaborative learning and critical thinking in technology-enhanced environments) which was proposed, revised and used across three cases. The field of investigation was restricted to three key questions: 1) Do learner skill bases (learning approach and eductive ability) influence critical thinking within the proposed CoLeCTTE framework? If so, how?; 2) Do learning technologies influence the facilitation of deep learning and critical thinking within the proposed CoLeCTTE framework? If so, how?; and 3) How might learning be designed to facilitate the acquisition of deep learning and critical thinking within a technology-enabled collaborative environment? The rationale, assumptions and method of research for using a mixed method and naturalistic case study approach are discussed; and three cases are explored and analysed. The study was conducted at the tertiary level (undergraduate and postgraduate) where participants were engaged in critical technical discourse within their own disciplines. Group behaviour was observed and coded, attributes or skill bases were measured, and participants interviewed to acquire deeper insights into their experiences. A progressive case study approach was used, allowing case investigation to be implemented in a "ladder-like" manner. Cases 1 and 2 used the proposed CoLeCTTE framework with more in-depth analysis conducted for Case 2 resulting in a revision of the CoLeCTTE framework. Case 3 used the revised CoLeCTTE framework and in-depth analysis was conducted. The findings led to the final version of the framework. In Cases 1, 2 and 3, content analysis of group work was conducted to determine critical thinking performance. Thus, the researcher used three small groups where learner skill bases of eductive ability, technological self-efficacy, and approaches to learning and motivation were measured. Cases 2 and 3 participants were interviewed and observations provided more in-depth analysis. The main outcome of this study is analysis of the nature of critical thinking within collaborative groups and technology-enhanced environments positioned in a theoretical instructional design framework called CoLeCTTE. The findings of the study revealed the importance of the Achieving Motive dimension of a student’s learning approach and how direct intervention and strategies can positively influence critical thinking performance. The findings also identified factors that can adversely affect critical thinking performance and include poor learning skills, frustration, stress and poor self-confidence, prioritisations over learning; and inadequate appropriation of group role and tasks. These findings are set out as instructional design guidelines for the judicious integration of learning technologies into learning and teaching practice for higher education that will support deep learning and critical thinking in collaborative groups. These guidelines are presented in two key areas: technology and tools; and activity design, monitoring, control and feedback.

Development of an integrated GIS and land use planning course : impacts of hybrid instructional methods

This study reports an action research undertaken at Queensland University of Technology. It evaluates the effectiveness of the integration of GIS within the substantive domains of an existing land use planning course in 2011. Using student performance, learning experience survey, and questionnaire survey data, it also evaluates the impacts of incorporating hybrid instructional methods (e.g., in-class and online instructional videos) in 2012 and 2013. Results show that: students (re)iterated the importance of GIS in the course justifying the integration; the hybrid methods significantly increased student performance; and unlike replacement, the videos are more suitable as a complement to in-class activity.

Research roadmap summary - Integrated Design and Delivery Solutions (IDDS)

Changes in the construction sector are creating opportunities in research to maximise the benefits of those changes and to continue the exciting developments in improved people skills, new processes and developing technologies. Many research centres around the world are investigating aspects of the current changes to drive their particular expertise forward. However, the CIB Integrated Design and Delivery Solutions (IDDS) priority research theme takes a higher-level view of the changes and then focuses down on a prioritised set of research targets. These targets have been investigated, re-focussed and validated over a period of four years through many workshops, conferences and meetings by a wide ranging group of representatives from approximately 90 industry and research organisations. The outcomes of such research, once put into practice should be significantly shortened timespans from conception of need to occupation of new or revised structures. As time is money, the owners will get their investments into productive use sooner, which means a shorter payback time. In addition, there will inevitably be a reduction in construction costs as productivity increases. The improvements in reliable delivery and improved quality currently being seen in relatively simplistic use of Building information Modelling (BIM) (compared to full IDDS) will inevitably continue its on-going trajectory of improvement. We should also consider the wider economic contribution to society that will stem from such improvements and, finally, and by no means unimportantly, the reliable modelling and delivery of sustainability at both the building and estate/ area scale will significantly improve carbon footprints and other sustainable outcomes. Whilst there are huge opportunities for early adopters, the primary risk will be the expansion of the gap between those working in this way and those who are not so advanced or who even refuse to progress . The opportunities to address the significant and widely varying wastes within the structure of the construction sector and within and across projects are huge and timely and industry is encouraged to become involved.

Research roadmap report : Integrated Design and Delivery Solutions (IDDS)

Changes in the construction sector are creating opportunities in research to maximise the benefits of those changes and to continue the exciting developments in improved people skills, new processes and developing technologies. There are many research centres around the world investigating aspects of the current changes to drive their particular expertise forward. However, the CIB Integrated Design and Delivery Solutions (IDDS) priority research theme takes a higher-level view of the changes and then focuses down on a prioritised set of research targets. These targets have been investigated, re-focussed and validated over a period of four years through many workshops, conferences and meetings by a wide ranging group of representatives from approximately 90 industry and research organisations. This roadmap prioritises and details the research to be performed, why and by whom. In particular, some 25 CIB Working Commissions and Task Groups are explained as having potential roles in the delivery of this research theme. We are extremely privileged to have been urged on by such distinguished construction professionals in their forewords and the case for research. The outcomes of such research, once put into practice should be significantly shortened timespans from conception of need to occupation of new or revised structures. As time is money, the owners will get their investments into productive use sooner, which means a shorter payback time. In addition, there will inevitably be a reduction in construction costs as productivity increases. The improvements in reliable delivery and improved quality currently being seen in relatively simplistic use of Building information Modelling (BIM) (compared to full IDDS) will inevitably continue its on-going trajectory of improvement. We should also consider the wider economic contribution to society that will stem from such improvements and, finally, and by no means unimportantly, the reliable modelling and delivery of sustainability at both the building and estate/ area scale will significantly improve carbon footprints and other sustainable outcomes. Whilst there are huge opportunities for early adopters, the primary risk will be the expansion of the gap between those working in this way and those who are not so advanced or who even refuse to progress1. However, a similar issue arises between industry, clients, educators and trainers; the latter have particular challenges, having existed for many years in a sector that has had relatively few technological changes. However, the opportunities to address the significant and widely varying wastes within the structure of the construction sector and within and across projects are huge and timely. Whilst this Roadmap is specifically targeted at the Standing Commissions and Task Groups of the CIB, it is hoped that there are elements for research and applied research across academia and industry.

Do instructional attributes pose multicollinearity problems? An empirical exploration

It is commonly perceived that variables ‘measuring’ different dimensions of teaching (construed as instructional attributes) used in student evaluation of teaching (SET) questionnaires are so highly correlated that they pose a serious multicollinearity problem for quantitative analysis including regression analysis. Using nearly 12000 individual student responses to SET questionnaires and ten key dimensions of teaching and 25 courses at various undergraduate and postgraduate levels for multiple years at a large Australian university, this paper investigates whether this is indeed the case and if so under what circumstances. This paper tests this proposition first by examining variance inflation factors (VIFs), across courses, levels and over time using individual responses; and secondly by using class averages. In the first instance, the paper finds no sustainable evidence of multicollinearity. While, there were one or two isolated cases of VIFs marginally exceeding the conservative threshold of 5, in no cases did the VIFs for any of the instructional attributes come anywhere close to the high threshold value of 10. In the second instance, however, the paper finds that the attributes are highly correlated as all the VIFs exceed 10. These findings have two implications: (a) given the ordinal nature of the data ordered probit analysis using individual student responses can be employed to quantify the impact of instructional attributes on TEVAL score; (b) Data based on class averages cannot be used for probit analysis. An illustrative exercise using level 2 undergraduate courses data suggests higher TEVAL scores depend first and foremost on improving explanation, presentation, and organization of lecture materials.

Instructional objectives to core-gameplay : a serious game design technique

This paper explores a gap within the serious game design research. That gap is the ambiguity surrounding the process of aligning the instructional objectives of serious games with their core-gameplay i.e. the moment-to-moment activity that is the core of player interaction. A core-gameplay focused design framework is proposed that can work alongside existing, more broadly focused serious games design frameworks. The framework utilises an inquiry-based approach that allows the serious game designer to use key questions as a means to clearly outline instructional objectives with the core-gameplay. The use of this design framework is considered in the context of a small section of gameplay from an educational game currently in development. This demonstration of the framework brings shows how instructional objectives can be embedded into a serious games core-gameplay.

Understanding classroom trouble through regulative gravity and instructional elasticity

This paper aims to develop a more nuanced analytic vocabulary to typify how and where classroom trouble can manifest in pedagogic discourse. It draws on classroom ethnographies conducted in non-academic secondary school pathways and alternative programs in Australian communities with high youth unemployment, where the policy of ‘earning or learning’ till age 17 has effectively extended compulsory schooling. Three concepts are developed and exemplified: ‘regulative flares’, being moments when teachers resort to explicitly reasserting the lesson’s social order; ‘moral gravity’ to describe the degree to which the moral order underpinning the regulative discourse is tied to the immediate context or beyond; and ‘instructional elasticity’ to account for trouble originating in the instructional register.

A roadmap for interpreting the literature on vision and driving

Over the past several decades there has been a sharp increase in the number of studies focused on the relationship between vision and driving. The intensified attention to this topic has most likely been stimulated by the lack of an evidence basis for determining vision standards for driving licensure and a poor understanding about how vision impairment impacts driver safety and performance. Clinicians depend on the literature on vision and driving to advise visually impaired patients appropriately about driving fitness. Policy makers also depend on the scientific literature in order to develop guidelines that are evidence-based and are thus fair to persons who are visually impaired. Thus it is important for clinicians and policy makers alike to understand how various study designs and measurement methods should be interpreted so that the conclusions and recommendations they make are not overly broad, too narrowly constrained, or even misguided. We offer a methodological framework to guide interpretations of studies on vision and driving that can also serve as a heuristic for researchers in the area. Here, we discuss research designs and general measurement methods for the study of vision as they relate to driver safety, driver performance, and driver-centered (self-reported) outcomes.

Effects of different instructional constraints on task performance and emergence of coordination in children

The objectives of this study were to determine the impact of different instructional constraints on standing board jump (sbj) performance in children and understand the underlying changes in emergent movement patterns. Two groups of novice participants were provided with either externally or internally focused attentional instructions during an intervention phase. Pre- and post-test sessions were undertaken to determine changes to performance and movement patterns. Thirty-six primary fourth-grade male students were recruited for this study and randomly assigned to either an external, internal focus or control group. Different instructional constraints with either an external focus (image of the achievement) or an internal focus (image of the act) were provided to the participants. Performance scores (jump distances), and data from key kinematic (joint range of motion, ROM) and kinetic variables (jump impulses) were collected. Instructional constraints with an emphasis on an external focus of attention were generally more effective in assisting learners to improve jump distances. Intra-individual analyses highlighted how enhanced jump distances for successful participants may be concomitant with specific changes to kinematic and kinetic variables. Larger joint ROM and adjustment to a comparatively larger horizontal impulse to a vertical impulse were observed for more successful participants at post-test performance. From a constraints-led perspective, the inclusion of instructional constraints encouraging self-adjustments in the control of movements (i.e., image of achievement) had a beneficial effect on individuals performing the standing broad jump task. However, the advantage of using an external focus of attentional instructions could be task- and individual-specific.

Making sense of an everyday science text : linguistic, visual and spatial design

In this article, we take a close look at the literacy demands of one task from the ‘Marvellous Micro-organisms Stage 3 Life and Living’ Primary Connections unit (Australian Academy of Science, 2005). One lesson from the unit, ‘Exploring Bread’, (pp 4-8) asks students to ‘use bread labels to locate ingredient information and synthesise understanding of bread ingredients’. We draw upon a framework offered by the New London Group (2000), that of linguistic, visual and spatial design, to consider in more detail three bread wrappers and from there the complex literacies that students need to interrelate to undertake the required task. Our findings are that although bread wrappers are an example of an everyday science text, their linguistic, visual and spatial designs and their interrelationship are not trivial. We conclude by reinforcing the need for teachers of science to also consider how the complex design elements of everyday science texts and their interrelated literacies are made visible through instructional practice.

In search of a theory of integrated marketing communication

For the most part, the literature base for Integrated Marketing Communication (IMC) has developed from an applied or tactical level rather than from an intellectual or theoretical one. Since industry, practitioner and even academic studies have provided little insight into what IMC is and how it operates, our approach has been to investigate that other IMC community, that is, the academic or instructional group responsible for disseminating IMC knowledge. We proposed that the people providing course instruction and directing research activities have some basis for how they organize, consider and therefore instruct in the area of IMC. A syllabi analysis of 87 IMC units in six countries investigated the content of the unit, its delivery both physically and conceptually, and defined the audience of the unit. The study failed to discover any type of latent theoretical foundation that might be used as a base for understanding IMC. The students who are being prepared to extend, expand and enhance IMC concepts do not appear to be well-served by the curriculum we found in our research. The study concludes with a model for further IMC curriculum development.

An investigation into the use of a blended model of learning in a first year accounting subject

The weaknesses of ‗traditional‘ modes of instruction in accounting education have been widely discussed. Many contend that the traditional approach limits the ability to provide opportunities for students to raise their competency level and allow them to apply knowledge and skills in professional problem solving situations. However, the recent body of literature suggests that accounting educators are indeed actively experimenting with ‗non-traditional‘ and ‗innovative‘ instructional approaches, where some authors clearly favour one approach over another. But can one instructional approach alone meet the necessary conditions for different learning objectives? Taking into account the ever changing landscape of not only business environments, but also the higher education sector, the premise guiding the collaborators in this research is that it is perhaps counter productive to promote competing dichotomous views of ‗traditional‘ and ‗non-traditional‘ instructional approaches to accounting education, and that the notion of ‗blended learning‘ might provide a useful framework to enhance the learning and teaching of accounting. This paper reports on the first cycle of a longitudinal study, which explores the possibility of using blended learning in first year accounting at one campus of a large regional university. The critical elements of blended learning which emerged in the study are discussed and, consistent with the design-based research framework, the paper also identifies key design modifications for successive cycles of the research.

Building Information Modelling for FM at Sydney Opera House

“SOH see significant benefit in digitising its drawings and operation and maintenance manuals. Since SOH do not currently have digital models of the Opera House structure or other components, there is an opportunity for this national case study to promote the application of Digital Facility Modelling using standardized Building Information Models (BIM)”. The digital modelling element of this project examined the potential of building information models for Facility Management focusing on the following areas: • The re-usability of building information for FM purposes • BIM as an Integrated information model for facility management • Extendibility of the BIM to cope with business specific requirements • Commercial facility management software using standardised building information models • The ability to add (organisation specific) intelligence to the model • A roadmap for SOH to adopt BIM for FM The project has established that BIM – building information modelling - is an appropriate and potentially beneficial technology for the storage of integrated building, maintenance and management data for SOH. Based on the attributes of a BIM, several advantages can be envisioned: consistency in the data, intelligence in the model, multiple representations, source of information for intelligent programs and intelligent queries. The IFC – open building exchange standard – specification provides comprehensive support for asset and facility management functions, and offers new management, collaboration and procurement relationships based on sharing of intelligent building data. The major advantages of using an open standard are: information can be read and manipulated by any compliant software, reduced user “lock in” to proprietary solutions, third party software can be the “best of breed” to suit the process and scope at hand, standardised BIM solutions consider the wider implications of information exchange outside the scope of any particular vendor, information can be archived as ASCII files for archival purposes, and data quality can be enhanced as the now single source of users’ information has improved accuracy, correctness, currency, completeness and relevance. SOH current building standards have been successfully drafted for a BIM environment and are confidently expected to be fully developed when BIM is adopted operationally by SOH. There have been remarkably few technical difficulties in converting the House’s existing conventions and standards to the new model based environment. This demonstrates that the IFC model represents world practice for building data representation and management (see Sydney Opera House – FM Exemplar Project Report Number 2005-001-C-3, Open Specification for BIM: Sydney Opera House Case Study). Availability of FM applications based on BIM is in its infancy but focussed systems are already in operation internationally and show excellent prospects for implementation systems at SOH. In addition to the generic benefits of standardised BIM described above, the following FM specific advantages can be expected from this new integrated facilities management environment: faster and more effective processes, controlled whole life costs and environmental data, better customer service, common operational picture for current and strategic planning, visual decision-making and a total ownership cost model. Tests with partial BIM data – provided by several of SOH’s current consultants – show that the creation of a SOH complete model is realistic, but subject to resolution of compliance and detailed functional support by participating software applications. The showcase has demonstrated successfully that IFC based exchange is possible with several common BIM based applications through the creation of a new partial model of the building. Data exchanged has been geometrically accurate (the SOH building structure represents some of the most complex building elements) and supports rich information describing the types of objects, with their properties and relationships.

Digital Modelling

This Digital Modelling Report incorporates the previous research completed for the FM Exemplar Project utilising the Sydney Opera House as a case study. The research has demonstrated significant benefits in digitising design documentation and operational and maintenance manuals. Since Sydney Opera House do not have digital models of its structure, there is an opportunity to investigate the application of Digital Facility Modelling using standardised Building Information Models (BIM). The digital modelling research project has examined the potential of standardised building information models to develop a digital facility model supporting facilities management (FM). The focus of this investigation was on the following areas: • The re-usability of standardised building information models (BIM) for FM purposes. • The potential of BIM as an information framework acting as integrator for various FM data sources. • The extendibility and flexibility of the BIM to cope with business specific data and requirements. • Commercial FM software using standardised building information models. • The ability to add (organisation-specific) intelligence to the model. • A roadmap for Sydney Opera House to adopt BIM for FM.