When non-significance maybe significant: lessons learned from a study into the development, implementation and evaluation of a risk assessment tool for fleet settings

Introduction This study reports on the development of a self report assessment tool to increase the efficacy of crash prediction within Australian Fleet settings Over last 20 years an array of measures have been produced (Driver anger scale, Driving Skill Inventory, Manchester Driver Behaviour Questionnaire, Driver Attitude Questionnaire, Driver Stress Inventory, Safety Climate Questionnaire) While these tools are useful, research has demonstrated limited ability to accurately identify individuals most likely to be involved in a crash. Reasons cited include; - Crashes are relatively rare - Other competing factors may influence crash event - Ongoing questions regarding the validity of self report measures (common method variance etc) - Lack of contemporary issues relating to fleet driving performance

Learning science through real-world contexts

Curriculum developers and researchers have promoted context based programmes to arrest waning student interest and participation in the enabling sciences at high school and university. Context-based programmes aim for connections between scientific discourse and real-world contexts to elevate curricular relevance without diminishing conceptual understanding. Literature relating to context-based approaches to learning will be reviewed in this chapter. In particular, international trends in curricular development and results from evaluations of major projects (e.g. PLON, Salters Advanced Chemistry, ChemCom) will be highlighted. Research projects that explore context-based interventions focusing on such outcomes as student interest, perceived relevance and conceptual understanding also will feature in the review. The chapter culminates with a discussion of current context-based research that interprets classroom actions from a dialectical socio-cultural framework, and identifies possible new directions for research.

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

Enterprise information security policy assessment : an extended framework for metrics development utilising the goal-question-metric approach

Effective enterprise information security policy management requires review and assessment activities to ensure information security policies are aligned with business goals and objectives. As security policy management involves the elements of policy development process and the security policy as output, the context for security policy assessment requires goal-based metrics for these two elements. However, the current security management assessment methods only provide checklist types of assessment that are predefined by industry best practices and do not allow for developing specific goal-based metrics. Utilizing theories drawn from literature, this paper proposes the Enterprise Information Security Policy Assessment approach that expands on the Goal-Question-Metric (GQM) approach. The proposed assessment approach is then applied in a case scenario example to illustrate a practical application. It is shown that the proposed framework addresses the requirement for developing assessment metrics and allows for the concurrent undertaking of process-based and product-based assessment. Recommendations for further research activities include the conduct of empirical research to validate the propositions and the practical application of the proposed assessment approach in case studies to provide opportunities to introduce further enhancements to the approach.

‘They get fed up with playing.’ Parents’ views on play-based learning in the Preparatory Year

Within early childhood education two ideas are firmly held: play is the best way for children to learn and parents are partners in the child’s learning. While these ideas have been explored, limited research to date has investigated the confluence of the two - how parents of young children view the concept of play. This paper investigates parents’ views on play by analysing the views of small group of parents of Prep Year children in Queensland, Australia. The parents in this study held varying definitions of what constitutes play, and complex and contradictory notions of its value. Positive views of play were linked to learning without knowing it, engaging in hands-on activities, and preparation for Year One through a strong focus on academic progress. Some parents held that Prep was play-based, while others did not. The complexities and diversity of parental opinion in this study echo the ongoing commentary about how play ought to be defined. Moreover, the notion that adults may interpret play in different ways is also reflected here. The authors suggest that for early childhood educators these complexities require an ongoing engagement, debate and reconceptualisation of the place of play in light of broader curricular and socio-political agendas.

Perceptions of physical versus virtual design studio education

While the studio environment has been promoted as an ideal educational setting for project-based disciplines associated with the art and design, few qualitative studies have been undertaken in a comprehensive way, with even fewer giving emphasis to the teachers and students and how they feel about changing their environment. This situation is problematic given the changes and challenges facing higher education, including those associated with new technologies such as online learning. In response, this paper describes a comparative study employing grounded theory to identify and describe teachers’ and students’ perceptions of the physical design studio (PDS) as well as the virtual design studio (VDS) of architectural students in an Australian university. The findings give significance to aspects of design education activities and their role in the development of integrated hybrid learning environments.

Pragmatics, perceptions and strategies in Chinese college English learning

This study investigated Chinese College English students. perceptions of pragmatics, their pragmatic competence in selected speech acts, strategies they employed in acquiring pragmatic knowledge, as well as their general approach to learning English as a foreign language. The research was triggered by a national curriculum initiative that prioritizes the need for College English students to enhance their ability to use English effectively in different social interactions (Chinese College English Education and Supervisory Committee, 2007). The traditional "grammar-translation" and "examination-oriented" method is believed to have reduced Chinese College English students to what is dubbed "mute" and "deaf" language learners (Zhang, 2008; Zhao, 2009). Many students lack pragmatic knowledge on how to interpret discourse by relating utterances to their meanings, understanding the intention of language users, and how language is used in specific settings (Bachman & Palmer, 1996, 2010). There is an increasing body of literature on awareness-raising of the importance of pragmatic knowledge and strategies for classroom instruction. However, to date, researchers have tended to focus largely on the teaching of pragmatics, rather than on how students acquire pragmatic competence (Bardovi-Harlig & Dornyei, 1998; Du, 2004; Hou, 2007; Ruan, 2007; Schauer, 2009). It is this gap in the research that this study fills, with a focus on different types of pragmatic knowledge, learner perceptions of such knowledge, and learning strategies that College English students employ in the process of learning English in general, and pragmatics in particular. Three strands of theories of second language acquisition (Ellis, 1985, 1994): pragmatics (Levinson, 1983; Mey, 2001; Yule, 1996), intercultural communications (Kramsch, 1998; Samovar & Porter, 1997; Samovar, Porter & McDaniel, 2009) and English as a lingua franca (ELF) (Canagarajah, 2006; Firth, 1996; Pennycook, 2010) were employed to establish a conceptual framework for data collection and analyses. Key constructs derived from the three related theories helped to form a typology for a detailed examination and theorization of the empirical evidence gathered from different sources. Four research instruments: a questionnaire (N=237), Discourse Completion Tasks (DCTs) (N=55), focus group interviews (N=18), and a textbook tasks analysis were employed to collect data for this systematic inquiry. Data collected by different instruments were analyzed and compared by way of a triangulation to enhance its validity and reliability. Major findings derived from different sources highlighted that, although College English students were grammatically advanced language learners, they displayed limited pragmatic knowledge and a highly restricted repertoire of language learning strategies. The majority of the respondents, however, believed that pragmatic knowledge was as important as linguistic knowledge in the process of developing communicative competence for interaction in different contexts. It was argued that a combination of a less than sufficient English proficiency, limited knowledge of pragmatics, inadequate language materials and tasks, and a small stock of language learning strategies, were a major hindrance to effective learning and communication, resulting in pragmatic failures in many intercultural communication situations. As the first systematic study of how Chinese College English students learned pragmatics, the research provided a solid empirical base for developing a tentative model for the learning of pragmatics in a College English classroom in China and similar educational contexts. The model was strengthened by a unique combination of theories of pragmatics, intercultural communication and ELF. Findings from this research provided insights into how Chinese College English students perceived pragmatics in the English as foreign language (EFL) curriculum, the processes of learning, as well as strategies they utilized in developing linguistic and pragmatic knowledge and competence.

Serious playground : using Second Life to engage high school students in urban planning

Virtual world platforms such as Second Life have been successfully used in educational contexts to motivate and engage learners. This article reports on an exploratory workshop involving a group of high school students using Second Life for an urban planning project. Young people are traditionally an under-represented demographic when it comes to participating in urban planning and decision making processes. The research team developed activities that combined technology with a constructivist approach to learning. Real world experiences and purposes ensured that the workshop enabled students to see the relevance of their learning. Our design also ensured that play remained an important part of the learning. By conceiving of the workshop as a ‘serious playground’ we investigated the ludic potential of learning in a virtual world.

Managing distraction and attention in diverse cohorts : 21st century challenges to law student engagement

It is imperative that we consider the use of current and emerging technologies in terms of the nature of our learners, the physical environment of the lecture theatre, and how technology may help to support appropriate pedagogies that facilitate the capturing of student attention in active engaging learning experiences. It is argued that a re-evaluation of pedagogy is required to address the tech-savy traits of the 21st century learner and the extent to which their mobile devices are capable of not only distracting them from learning but also enhancing face-to-face learning experiences.

Mandated literacy assessment and the reorganisation of teachers’ work : federal policy, local effects

This paper explores how mandated literacy assessment is reorganising teachers’ work in the context of Australia’s National Assessment Program – Literacy and Numeracy (NAPLAN), which was implemented in 2008. Students in Years 3, 5, 7 and 9 are tested annually, with school results publicly available. The wider policy context and the emergence of different forms of interconnected educational work associated with the testing phenomenon are described. Taking an Institutional Ethnography approach, the local effects of the federal policy regime are examined through a case study of one school. What mandated literacy assessment does to educators’ work in a culturally diverse low socioeconomic school community is discussed. Key themes include strategic exclusions of students from the testing process, appropriations and adaptations of literacy theory, work intensification, and ethical mediation of results. Questions concerning equity are raised about the differential effects of policy in different school contexts.

Please take out your phones : on the spot solicitation of student feedback in class

The use of mobile devices such as smart phones and tablets in classrooms has been met with mixed sentiments. Some instructors and teachers see them as a distraction and regularly ban their usage. Others who see their potential to enhance learning have started to explore ways to integrate them into their teaching in an attempt to improve student engagement. In this paper we report on a pilot study that forms part of a university-wide project reconceptualising its approach to the student evaluation of learning and teaching. In a progressive decision to embrace mobile technology, the university decided to trial a smart phone app designed for students to check-in to class and leave feedback on the spot. Our preliminary findings from trialling the app indicate that the application establishes a more immediate feedback loop between students and teachers. However, the app’s impact depends on how feedback is shared with students and how the teaching team responds.

Short answer versus multiple choice examination questions for first year chemistry

Multiple choice (MC) examinations are frequently used for the summative assessment of large classes because of their ease of marking and their perceived objectivity. However, traditional MC formats usually lead to a surface approach to learning, and do not allow students to demonstrate the depth of their knowledge or understanding. For these reasons, we have trialled the incorporation of short answer (SA) questions into the final examination of two first year chemistry units, alongside MC questions. Students’ overall marks were expected to improve, because they were able to obtain partial marks for the SA questions. Although large differences in some individual students’ performance in the two sections of their examinations were observed, most students received a similar percentage mark for their MC as for their SA sections and the overall mean scores were unchanged. In-depth analysis of all responses to a specific question, which was used previously as a MC question and in a subsequent semester in SA format, indicates that the SA format can have weaknesses due to marking inconsistencies that are absent for MC questions. However, inclusion of SA questions improved student scores on the MC section in one examination, indicating that their inclusion may lead to different study habits and deeper learning. We conclude that questions asked in SA format must be carefully chosen in order to optimise the use of marking resources, both financial and human, and questions asked in MC format should be very carefully checked by people trained in writing MC questions. These results, in conjunction with an analysis of the different examination formats used in first year chemistry units, have shaped a recommendation on how to reliably and cost-effectively assess first year chemistry, while encouraging higher order learning outcomes.

Using information communication technologies to develop dynamic curriculum frameworks for diverse cohorts: a case study from event management

This article investigates the role of information communication technologies (ICTs) in establishing a well-aligned, authentic learning environment for a diverse cohort of non-cognate and cognate students studying event management in a higher education context. Based on a case study which examined the way ICTs assisted in accommodating diverse learning needs, styles and stages in an event management subject offered in the Creative Industries Faculty at Queensland University of Technology in Brisbane, Australia, the article uses an action research approach to generate grounded, empirical data on the effectiveness of the dynamic, individualised curriculum frameworks that the use of ICTs makes possible. The study provides insights into the way non-cognate and cognate students respond to different learning tools. It finds that whilst non-cognate and cognate students do respond to learning tools differently, due to a differing degree of emphasis on technical, task or theoretical competencies, the use of ICTs allows all students to improve their performance by providing multiple points of entry into the content. In this respect, whilst the article focuses on the way ICTs can be used to develop an authentic, well-aligned curriculum model that meets the needs of event management students in a higher education context, with findings relevant for event educators in Business, Hospitality, Tourism and Creative Industries, the strategies outlined may also be useful for educators in other fields who are faced with similar challenges when designing and developing curriculum for diverse cohorts.

Problem-based learning : does accounting education need it?

Problem-based learning (PBL) has been used successfully in disciplines such as medicine, nursing, law and engineering. However a review of the literature shows that there has been little use of this approach to learning in accounting. This paper extends the research in accounting education by reporting the findings of a case study of the development and implementation of PBL at the Queensland University of Technology (QUT) in a new Accountancy Capstone unit that began in 2006. The fundamentals of the PBL approach were adhered to. However, one of the essential elements of the approach adopted was to highlight the importance of questioning as a means of gathering the necessary information upon which decisions are made. This approach can be contrasted with the typical ‘give all the facts’ case studies that are commonly used. Another feature was that students worked together in the same group for an entire semester (similar to how teams in the workplace operate) so there was an intended focus on teamwork in solving unstructured, real-world accounting problems presented to students. Based on quantitative and qualitative data collected from student questionnaires over seven semesters, it was found that students perceived PBL to be effective, especially in terms of developing the skills of questioning, teamwork, and problem solving. The effectiveness of questioning is very important as this is a skill that is rarely the focus of development in accounting education. The successful implementation of PBL in accounting through ‘learning by doing’ could be the catalyst for change to bring about better learning outcomes for accounting graduates.

Action research and unit improvement in higher education : a case study approach

Student satisfaction data has been collected on a national basis in Australia since 1972. In recent years this data has been used by federal government agencies to allocate funding, and by students in selecting their universities of choice. The purpose of this paper is to present the findings of an action research project designed to identify and implement unit improvement initiatives over a three year period for an underperforming unit. This research utilises student survey data and teacher reflections to identify areas of unit improvement, with a view to aligning learning experiences, teaching and assessment to learning outcomes and improved student satisfaction. This research concludes that whilst a voluntary student survey system may be imperfect, it nevertheless provides important data that can be utilised to the benefit of the unit, learning outcomes and student satisfaction ratings, as well as wider course related outcomes. Extrapolation of these findings is recommended to other underperforming units.