The design science research roadmap : in progress evaluation

Although Design Science Research (DSR) is now an accepted approach to research in the Information Systems (IS) discipline, consensus on the methodology of DSR has yet to be achieved. Lack of a comprehensive and detailed methodology for Design Science Research (DSR) in the Information System (IS) discipline is a main issue. Prior research (the parent-study) aimed to remedy this situation and resulted in the DSR-Roadmap (Alturki et al., 2011a). Continuing empirical validation and revision of the DSR-Roadmap strives towards a methodology with appropriate levels of detail, integration, and completeness for novice researchers to efficiently and effectively conduct and report DSR in IS. The sub-study reported herein contributes to this larger, ongoing effort. This paper reports results from a formative evaluation effort of the DSR-Roadmap conducted using focus group analysis. Generally, participants endorsed the utility and intuitiveness of the DSR-Roadmap, while also suggesting valuable refinements. Both parent-study and sub-study make methodological contributions. The parent-study is the first attempt of utilizing DSR to develop a research methodology showing an example of how to use DSR in research methodology construction. The sub-study demonstrates the value of the focus group method in DSR for formative product evaluation.

Collaborative learning and critical thinking in technology-enhanced environments : an instructional design framework

The nature and characteristics of how learners learn today are changing. As technology use in learning and teaching continues to grow, its integration to facilitate deep learning and critical thinking becomes a primary consideration. The implications for learner use, implementation strategies, design of integration frameworks and evaluation of their effectiveness in learning environments cannot be overlooked. This study specifically looked at the impact that technology-enhanced learning environments have on different learners’ critical thinking in relation to eductive ability, technological self-efficacy, and approaches to learning and motivation in collaborative groups. These were explored within an instructional design framework called CoLeCTTE (collaborative learning and critical thinking in technology-enhanced environments) which was proposed, revised and used across three cases. The field of investigation was restricted to three key questions: 1) Do learner skill bases (learning approach and eductive ability) influence critical thinking within the proposed CoLeCTTE framework? If so, how?; 2) Do learning technologies influence the facilitation of deep learning and critical thinking within the proposed CoLeCTTE framework? If so, how?; and 3) How might learning be designed to facilitate the acquisition of deep learning and critical thinking within a technology-enabled collaborative environment? The rationale, assumptions and method of research for using a mixed method and naturalistic case study approach are discussed; and three cases are explored and analysed. The study was conducted at the tertiary level (undergraduate and postgraduate) where participants were engaged in critical technical discourse within their own disciplines. Group behaviour was observed and coded, attributes or skill bases were measured, and participants interviewed to acquire deeper insights into their experiences. A progressive case study approach was used, allowing case investigation to be implemented in a "ladder-like" manner. Cases 1 and 2 used the proposed CoLeCTTE framework with more in-depth analysis conducted for Case 2 resulting in a revision of the CoLeCTTE framework. Case 3 used the revised CoLeCTTE framework and in-depth analysis was conducted. The findings led to the final version of the framework. In Cases 1, 2 and 3, content analysis of group work was conducted to determine critical thinking performance. Thus, the researcher used three small groups where learner skill bases of eductive ability, technological self-efficacy, and approaches to learning and motivation were measured. Cases 2 and 3 participants were interviewed and observations provided more in-depth analysis. The main outcome of this study is analysis of the nature of critical thinking within collaborative groups and technology-enhanced environments positioned in a theoretical instructional design framework called CoLeCTTE. The findings of the study revealed the importance of the Achieving Motive dimension of a student’s learning approach and how direct intervention and strategies can positively influence critical thinking performance. The findings also identified factors that can adversely affect critical thinking performance and include poor learning skills, frustration, stress and poor self-confidence, prioritisations over learning; and inadequate appropriation of group role and tasks. These findings are set out as instructional design guidelines for the judicious integration of learning technologies into learning and teaching practice for higher education that will support deep learning and critical thinking in collaborative groups. These guidelines are presented in two key areas: technology and tools; and activity design, monitoring, control and feedback.

Development of an integrated GIS and land use planning course : impacts of hybrid instructional methods

This study reports an action research undertaken at Queensland University of Technology. It evaluates the effectiveness of the integration of GIS within the substantive domains of an existing land use planning course in 2011. Using student performance, learning experience survey, and questionnaire survey data, it also evaluates the impacts of incorporating hybrid instructional methods (e.g., in-class and online instructional videos) in 2012 and 2013. Results show that: students (re)iterated the importance of GIS in the course justifying the integration; the hybrid methods significantly increased student performance; and unlike replacement, the videos are more suitable as a complement to in-class activity.

Research roadmap summary - Integrated Design and Delivery Solutions (IDDS)

Changes in the construction sector are creating opportunities in research to maximise the benefits of those changes and to continue the exciting developments in improved people skills, new processes and developing technologies. Many research centres around the world are investigating aspects of the current changes to drive their particular expertise forward. However, the CIB Integrated Design and Delivery Solutions (IDDS) priority research theme takes a higher-level view of the changes and then focuses down on a prioritised set of research targets. These targets have been investigated, re-focussed and validated over a period of four years through many workshops, conferences and meetings by a wide ranging group of representatives from approximately 90 industry and research organisations. The outcomes of such research, once put into practice should be significantly shortened timespans from conception of need to occupation of new or revised structures. As time is money, the owners will get their investments into productive use sooner, which means a shorter payback time. In addition, there will inevitably be a reduction in construction costs as productivity increases. The improvements in reliable delivery and improved quality currently being seen in relatively simplistic use of Building information Modelling (BIM) (compared to full IDDS) will inevitably continue its on-going trajectory of improvement. We should also consider the wider economic contribution to society that will stem from such improvements and, finally, and by no means unimportantly, the reliable modelling and delivery of sustainability at both the building and estate/ area scale will significantly improve carbon footprints and other sustainable outcomes. Whilst there are huge opportunities for early adopters, the primary risk will be the expansion of the gap between those working in this way and those who are not so advanced or who even refuse to progress . The opportunities to address the significant and widely varying wastes within the structure of the construction sector and within and across projects are huge and timely and industry is encouraged to become involved.

Research roadmap report : Integrated Design and Delivery Solutions (IDDS)

Changes in the construction sector are creating opportunities in research to maximise the benefits of those changes and to continue the exciting developments in improved people skills, new processes and developing technologies. There are many research centres around the world investigating aspects of the current changes to drive their particular expertise forward. However, the CIB Integrated Design and Delivery Solutions (IDDS) priority research theme takes a higher-level view of the changes and then focuses down on a prioritised set of research targets. These targets have been investigated, re-focussed and validated over a period of four years through many workshops, conferences and meetings by a wide ranging group of representatives from approximately 90 industry and research organisations. This roadmap prioritises and details the research to be performed, why and by whom. In particular, some 25 CIB Working Commissions and Task Groups are explained as having potential roles in the delivery of this research theme. We are extremely privileged to have been urged on by such distinguished construction professionals in their forewords and the case for research. The outcomes of such research, once put into practice should be significantly shortened timespans from conception of need to occupation of new or revised structures. As time is money, the owners will get their investments into productive use sooner, which means a shorter payback time. In addition, there will inevitably be a reduction in construction costs as productivity increases. The improvements in reliable delivery and improved quality currently being seen in relatively simplistic use of Building information Modelling (BIM) (compared to full IDDS) will inevitably continue its on-going trajectory of improvement. We should also consider the wider economic contribution to society that will stem from such improvements and, finally, and by no means unimportantly, the reliable modelling and delivery of sustainability at both the building and estate/ area scale will significantly improve carbon footprints and other sustainable outcomes. Whilst there are huge opportunities for early adopters, the primary risk will be the expansion of the gap between those working in this way and those who are not so advanced or who even refuse to progress1. However, a similar issue arises between industry, clients, educators and trainers; the latter have particular challenges, having existed for many years in a sector that has had relatively few technological changes. However, the opportunities to address the significant and widely varying wastes within the structure of the construction sector and within and across projects are huge and timely. Whilst this Roadmap is specifically targeted at the Standing Commissions and Task Groups of the CIB, it is hoped that there are elements for research and applied research across academia and industry.

Do instructional attributes pose multicollinearity problems? An empirical exploration

It is commonly perceived that variables ‘measuring’ different dimensions of teaching (construed as instructional attributes) used in student evaluation of teaching (SET) questionnaires are so highly correlated that they pose a serious multicollinearity problem for quantitative analysis including regression analysis. Using nearly 12000 individual student responses to SET questionnaires and ten key dimensions of teaching and 25 courses at various undergraduate and postgraduate levels for multiple years at a large Australian university, this paper investigates whether this is indeed the case and if so under what circumstances. This paper tests this proposition first by examining variance inflation factors (VIFs), across courses, levels and over time using individual responses; and secondly by using class averages. In the first instance, the paper finds no sustainable evidence of multicollinearity. While, there were one or two isolated cases of VIFs marginally exceeding the conservative threshold of 5, in no cases did the VIFs for any of the instructional attributes come anywhere close to the high threshold value of 10. In the second instance, however, the paper finds that the attributes are highly correlated as all the VIFs exceed 10. These findings have two implications: (a) given the ordinal nature of the data ordered probit analysis using individual student responses can be employed to quantify the impact of instructional attributes on TEVAL score; (b) Data based on class averages cannot be used for probit analysis. An illustrative exercise using level 2 undergraduate courses data suggests higher TEVAL scores depend first and foremost on improving explanation, presentation, and organization of lecture materials.

Instructional objectives to core-gameplay : a serious game design technique

This paper explores a gap within the serious game design research. That gap is the ambiguity surrounding the process of aligning the instructional objectives of serious games with their core-gameplay i.e. the moment-to-moment activity that is the core of player interaction. A core-gameplay focused design framework is proposed that can work alongside existing, more broadly focused serious games design frameworks. The framework utilises an inquiry-based approach that allows the serious game designer to use key questions as a means to clearly outline instructional objectives with the core-gameplay. The use of this design framework is considered in the context of a small section of gameplay from an educational game currently in development. This demonstration of the framework brings shows how instructional objectives can be embedded into a serious games core-gameplay.

Understanding classroom trouble through regulative gravity and instructional elasticity

This paper aims to develop a more nuanced analytic vocabulary to typify how and where classroom trouble can manifest in pedagogic discourse. It draws on classroom ethnographies conducted in non-academic secondary school pathways and alternative programs in Australian communities with high youth unemployment, where the policy of ‘earning or learning’ till age 17 has effectively extended compulsory schooling. Three concepts are developed and exemplified: ‘regulative flares’, being moments when teachers resort to explicitly reasserting the lesson’s social order; ‘moral gravity’ to describe the degree to which the moral order underpinning the regulative discourse is tied to the immediate context or beyond; and ‘instructional elasticity’ to account for trouble originating in the instructional register.

A roadmap for interpreting the literature on vision and driving

Over the past several decades there has been a sharp increase in the number of studies focused on the relationship between vision and driving. The intensified attention to this topic has most likely been stimulated by the lack of an evidence basis for determining vision standards for driving licensure and a poor understanding about how vision impairment impacts driver safety and performance. Clinicians depend on the literature on vision and driving to advise visually impaired patients appropriately about driving fitness. Policy makers also depend on the scientific literature in order to develop guidelines that are evidence-based and are thus fair to persons who are visually impaired. Thus it is important for clinicians and policy makers alike to understand how various study designs and measurement methods should be interpreted so that the conclusions and recommendations they make are not overly broad, too narrowly constrained, or even misguided. We offer a methodological framework to guide interpretations of studies on vision and driving that can also serve as a heuristic for researchers in the area. Here, we discuss research designs and general measurement methods for the study of vision as they relate to driver safety, driver performance, and driver-centered (self-reported) outcomes.

Effects of different instructional constraints on task performance and emergence of coordination in children

The objectives of this study were to determine the impact of different instructional constraints on standing board jump (sbj) performance in children and understand the underlying changes in emergent movement patterns. Two groups of novice participants were provided with either externally or internally focused attentional instructions during an intervention phase. Pre- and post-test sessions were undertaken to determine changes to performance and movement patterns. Thirty-six primary fourth-grade male students were recruited for this study and randomly assigned to either an external, internal focus or control group. Different instructional constraints with either an external focus (image of the achievement) or an internal focus (image of the act) were provided to the participants. Performance scores (jump distances), and data from key kinematic (joint range of motion, ROM) and kinetic variables (jump impulses) were collected. Instructional constraints with an emphasis on an external focus of attention were generally more effective in assisting learners to improve jump distances. Intra-individual analyses highlighted how enhanced jump distances for successful participants may be concomitant with specific changes to kinematic and kinetic variables. Larger joint ROM and adjustment to a comparatively larger horizontal impulse to a vertical impulse were observed for more successful participants at post-test performance. From a constraints-led perspective, the inclusion of instructional constraints encouraging self-adjustments in the control of movements (i.e., image of achievement) had a beneficial effect on individuals performing the standing broad jump task. However, the advantage of using an external focus of attentional instructions could be task- and individual-specific.

Instructional aid for tactical wargame model

A tactical gaming model for wargame play between two teams A and B through a control unit C has been developed, which can be handled using IBM personal computers (XT and AT models) having a local area network facility. This simulation model involves communication between the teams involved, logging and validation of the actions of the teams by the control unit. The validation procedure uses statistical and also monte carlo techniques. This model has been developed to evaluate the planning strategies of the teams involved. This application software using about 120 files has been developed in BASIC, DBASE and the associated network software. Experience gained in the instruction courses using this model will also be discussed.

Applying Agenda-Setting research in an international context : a roadmap for future research

El proceso de llevar a cabo investigaciones que examinen la función de la agenda setting de los medios de comunicación implica una serie de decisiones. El proyecto de investigación: ¿examinará el primer nivel de la agenda (con los temas o issues como unidad de análisis) o el segundo nivel (con los atributos como unidad de análisis) ¿Cuál o qué será el objeto de estudio? ¿Qué tipo de atributos se incluirán en el análisis? ¿Qué contenido se compararía? En este estudio se esbozan algunas posibles aplicaciones de la teoría de la agenda setting en un contexto internacional, lo cual podría servir de guía para futuras o posibles investigaciones. La fusión entre la cobertura de noticias internacionales y la investigación de la agenda setting parecería ser un área fructífera para los investigadores.