The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

V2V/V2I augmented maps : state-of-the-art and contribution to real-time crash risk assessment

A number of advanced driver assistance systems (ADAS) are currently being released on the market, providing safety functions to the drivers such as collision avoidance, adaptive cruise control or enhanced night-vision. These systems however are inherently limited by their sensory range: they cannot gather information from outside this range, also called their “perceptive horizon”. Cooperative systems are a developing research avenue that aims at providing extended safety and comfort functionalities by introducing vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) wireless communications to the road actors. This paper presents the problematic of cooperative systems, their advantages and contributions to road safety and exposes some limitations related to market penetration, sensors accuracy and communications scalability. It explains the issues of how to implement extended perception, a central contribution of cooperative systems. The initial steps of an evaluation of data fusion architectures for extended perception are exposed.

Culture-fair assessment : challenging Indigenous students through effortful mathematics teaching

This paper reports on a mathematics education research project centred on teachers’ pedagogical practices and capacity to assess Indigenous Australian students in a culture-fair manner. The project has been funded by the Australian Research Council Linkage program and is being conducted in seven Catholic and Independent primary schools in north Queensland. Our Industry Partners are Catholic Education and the Association of Independent Schools, Queensland. The study aims to provide greater understanding about how to build more equitable assessment practices to address the issue of underperforming Aboriginal and Torres Strait Islander (ATSI) students in regional and remote Australia. The goal is to identify ways forward by attending to culture-fair assessment practice. The research is exploring the attitudes, beliefs and responses of Indigenous students to assessment in the context of mathematics learning with particular focus on teacher knowledge in these educational settings in relation to the design of assessment tasks that are authentic and engaging for these students in an accountability context. This approach highlights how teachers need to distinguish the ‘funds of knowledge’ (González, Moll, Floyd Tenery, Rivera, Rendón, Gonzales & Amanti, 2008) that Indigenous students draw on and how teachers need to be culturally responsive in their pedagogy to open up curriculum and assessment practice to allow for different ways of knowing and being

Incorporating authentic assessment into different university learning scenarios

There is a current requirement for universities to prepare graduates who are skilled in practical as well as theoretical knowledge of the workplace. It is argued in this paper that assessment, as integral to the teaching/learning process, should also relate to the real world context of the workplace, in that students are able to transform, use and apply the knowledge that they learn into these contexts. While assessment authentic for students in a university setting is often a difficult task for lecturers. This paper discusses three different learning contexts that involved different assessment experiences linked in some way to real world learning and application of the theory. The results of the trial indicated that as contexts became close to a real world experience, the sustainability of the assessment became more problematic. While acknowledging the difficulty of these practices, it is suggested that there is a need for a continuous cycle of evaluation amid some creative and innovative approaches to assessment practice.

Effectiveness of nurse-led preoperative assessment services for elective surgery : a systematic review

Background--The admission and assessment of patients for elective procedures is a task faced by all healthcare organisations that provide elective surgical services. Several different strategies have been used to facilitate the management of these tasks. Nurse-led preadmission clinics or services have been implemented in many health services as one of these management strategies; however their effectiveness has not been established. Objectives--The objective of this review was to examine the available research on the effectiveness of nurse-led elective surgery preoperative assessment clinics or services on patient outcomes.--Results--Of the 19 included articles, there were 10 audits of patient and hospital data, 3 surveys or questionnaires, 3 descriptive studies, 1 action research design, 1 prospective observational study and 1 RCT. Five of ten studies reporting data on cancellations rates found that nurse-led preadmission services reduced the number of day-of-surgery cancellations. Non-attendance for surgery was also reduced, with nine studies reporting decreases in the number of patients failing to attend. Eight studies reporting data on patient or parent satisfaction found high levels of satisfaction with nurse-led preadmission services. Three of four studies investigating the effect of the nurse-led preadmission service on patient anxiety found a reduction in reported anxiety levels. Three studies found that preoperative preparation was enhanced by the use of a nurse-led preadmission service.--Conclusions--While all included studies reported evidence of effectiveness for nurse-led preadmission services on a wide range of outcomes for elective surgery patients, the lack of experimental trials means that the level of evidence is low, and further research is needed.--Implications for practice--Nurse-led preadmission services may be an effective strategy for reducing procedural cancellations, failure to attend for procedures, and patient anxiety, however currently the evidence level is low.

Assessment of the influence of cultural barriers to HDR supervision of non-English speaking background (NESD) students in engineering and information technology (IT) disciplines

The paper details the results of the first phase of an on-going research into the sociocultural factors that influence the supervision of higher degrees research (HDR) engineering students in the Faculty of Built Environment and Engineering (BEE) and Faculty of Science and Technology (FaST) at Queensland University of Technology. A quantitative analysis was performed on the results from an online survey that was administered to 179 engineering students. The study reveals that cultural barriers impact their progression and developing confidence in their research programs. We argue that in order to assist international and non-English speaking background (NESB) research students to triumph over such culturally embedded challenges in engineering research, it is important for supervisors to understand this cohort's unique pedagogical needs and develop intercultural sensitivity in their pedagogical practice in postgraduate research supervision. To facilitate this, the governing body (Office of Research) can play a vital role in not only creating the required support structures but also their uniform implementation across the board.

Talking the talk : oracy demands in first year university assessment tasks

With more constructivist approaches to learning in higher education and more value on teamwork skills, students’ oracy (speaking and listening) features more prominently in curriculum, pedagogy and assessment. The paper reports on a study of two first-year Australian university courses in disciplines with explicit industry orientations and high proportions of international students. Drawing on classroom observations and interviews with the lecturers, this paper investigates their pedagogical designs on oracy and the oracy demands of their assessment tasks. The study found that talk-based assessment tasks (a group project and a group oral presentation) featured in both courses but the two courses treated students’ oracy differently: as product or process. The contrast between the two assessment designs explicates issues around EAL student needs, authentic links to industry, the provenance of criteria used to assess performance, perceptions about the relevance of talk and the ‘hidden assessment’ of oracy.

Environmental health risk assessment of dioxin exposure through foods in a Dioxin hot spot—Bien Hoa City, Vietnam

This study used the Australian Environmental Health Risk Assessment Framework to assess the human health risk of dioxin exposure through foods for local residents in two wards of Bien Hoa City, Vietnam. These wards are known hot-spots for dioxin and a range of stakeholders from central government to local levels were involved in this process. Publications on dioxin characteristics and toxicity were reviewed and dioxin concentrations in local soil, mud, foods, milk and blood samples were used as data for this risk assessment. A food frequency survey of 400 randomly selected households in these wards was conducted to provide data for exposure assessment. Results showed that local residents who had consumed locally cultivated foods, especially fresh water fish and bottom-feeding fish, free-ranging chicken, duck, and beef were at a very high risk, with their daily dioxin intake far exceeding the tolerable daily intake recommended by the WHO. Based on the results of this assessment, a multifaceted risk management program was developed and has been recognized as the first public health program ever to have been implemented in Vietnam to reduce the risks of dioxin exposure at dioxin hot-spots.

Assessment of commercial network RTK user positioning performance over long inter-station distances

The paper provides an assessment of the performance of commercial Real Time Kinematic (RTK) systems over longer than recommended inter-station distances. The experiments were set up to test and analyse solutions from the i-MAX, MAX and VRS systems being operated with three triangle shaped network cells, each having an average inter-station distance of 69km, 118km and 166km. The performance characteristics appraised included initialization success rate, initialization time, RTK position accuracy and availability, ambiguity resolution risk and RTK integrity risk in order to provide a wider perspective of the performance of the testing systems. ----- ----- The results showed that the performances of all network RTK solutions assessed were affected by the increase in the inter-station distances to similar degrees. The MAX solution achieved the highest initialization success rate of 96.6% on average, albeit with a longer initialisation time. Two VRS approaches achieved lower initialization success rate of 80% over the large triangle. In terms of RTK positioning accuracy after successful initialisation, the results indicated a good agreement between the actual error growth in both horizontal and vertical components and the accuracy specified in the RMS and part per million (ppm) values by the manufacturers. ----- ----- Additionally, the VRS approaches performed better than the MAX and i-MAX when being tested under the standard triangle network with a mean inter-station distance of 69km. However as the inter-station distance increases, the network RTK software may fail to generate VRS correction and then may turn to operate in the nearest single-base RTK (or RAW) mode. The position uncertainty reached beyond 2 meters occasionally, showing that the RTK rover software was using an incorrect ambiguity fixed solution to estimate the rover position rather than automatically dropping back to using an ambiguity float solution. Results identified that the risk of incorrectly resolving ambiguities reached 18%, 20%, 13% and 25% for i-MAX, MAX, Leica VRS and Trimble VRS respectively when operating over the large triangle network. Additionally, the Coordinate Quality indicator values given by the Leica GX1230 GG rover receiver tended to be over-optimistic and not functioning well with the identification of incorrectly fixed integer ambiguity solutions. In summary, this independent assessment has identified some problems and failures that can occur in all of the systems tested, especially when being pushed beyond the recommended limits. While such failures are expected, they can offer useful insights into where users should be wary and how manufacturers might improve their products. The results also demonstrate that integrity monitoring of RTK solutions is indeed necessary for precision applications, thus deserving serious attention from researchers and system providers.

Assessment of critical constructability activities among Malaysian building contractors

After the primary researches on constructability issue which were implemented in United States, United Kingdom and Australia, more explorations were applied on that in order to assess this unique scientific fact in East Asian country of Malaysia. Based on the latest researches done on constructability concept in Malaysia, the most Critical Constructability Activities (CCAs) are defined according to amount of contractors’ participation in each activity and amount of gap between actual and potential effects of each of them on achieving the overall objectives of the construction projects with more cost and time savings and better quality which is the whole aim of a beneficial constructability activity. The present research aims to assess the current findings on CCAs in order to identify the types of contractors and projects which these CCAs are getting performed in and also the types of contracts is used in these CCAs. Finally it was found that there are some significant differences in amount of contractors’ involvement in CCAs among various considered independent variables. This study uses the former researches to help Malaysian construction stakeholders to find out the barriers of constructability implementation in building projects via giving more details on application of CCAs among different IVs.

Ways of telling : research methodology for fashion textiles design

Research methodology in the discipline of Art & Design has been a topic for much debate in the academic community. The result of such avid and ongoing discussion appears to be a disciplinary obsession with research methodologies and a culture of adopting and adapting existing methodologies from more established disciplines. This has eventuated as a means of coping with academic criticism and as an attempt to elevate Art & Design to a ‘real academic status’. Whilst this adoption has had some effect in tempering the opinion of Art & Design research from more ‘serious’ academics the practice may be concealing a deeper problem for this discipline. Namely, that knowledge transfer within creative practice, particularly in fashion textiles design practice, is largely tacit in nature and not best suited to dissemination through traditional means of academic writing and publication. ----- ----- There is an opportunity to shift the academic debate away from appropriate (or inappropriate) use of methodologies and theories to demonstrate the existence (or absence) of rigor in creative practice research. In particular, the changing paradigms for the definitions of research to support new models for research quality assessment (such as the RAE in the United Kingdom and ERA in Australia) require a re-examination of the traditions of academic writing and publication in relation to this form of research. It is now appropriate to test the limits of tacit knowledge. It has been almost half a century since Michael Polanyi wrote “we know more than we can tell” (Polanyi, 1967 p.4) at a time when the only means of ‘telling’ was through academic writing and publishing in hardcopy format. ----- ----- This paper examines the academic debate surrounding research methodologies for fashion textiles design through auto-ethnographic case study and object analysis. The author argues that, while this debate is interesting, the focus should be to ask: are there more effective ways for creative practitioner researchers to disseminate their research? The aim of this research is to examine the possibilities of developing different, more effective methods of ‘telling’ to support the transfer of tacit knowledge inherent in the discipline of Fashion Textiles Design.

An assessment system for evaluation of driving competencies

Automobiles have deeply impacted the way in which we travel but they have also contributed to many deaths and injury due to crashes. A number of reasons for these crashes have been pointed out by researchers. Inexperience has been identified as a contributing factor to road crashes. Driver’s driving abilities also play a vital role in judging the road environment and reacting in-time to avoid any possible collision. Therefore driver’s perceptual and motor skills remain the key factors impacting on road safety. Our failure to understand what is really important for learners, in terms of competent driving, is one of the many challenges for building better training programs. Driver training is one of the interventions aimed at decreasing the number of crashes that involve young drivers. Currently, there is a need to develop comprehensive driver evaluation system that benefits from the advances in Driver Assistance Systems. A multidisciplinary approach is necessary to explain how driving abilities evolves with on-road driving experience. To our knowledge, driver assistance systems have never been comprehensively used in a driver training context to assess the safety aspect of driving. The aim and novelty of this thesis is to develop and evaluate an Intelligent Driver Training System (IDTS) as an automated assessment tool that will help drivers and their trainers to comprehensively view complex driving manoeuvres and potentially provide effective feedback by post processing the data recorded during driving. This system is designed to help driver trainers to accurately evaluate driver performance and has the potential to provide valuable feedback to the drivers. Since driving is dependent on fuzzy inputs from the driver (i.e. approximate distance calculation from the other vehicles, approximate assumption of the other vehicle speed), it is necessary that the evaluation system is based on criteria and rules that handles uncertain and fuzzy characteristics of the driving tasks. Therefore, the proposed IDTS utilizes fuzzy set theory for the assessment of driver performance. The proposed research program focuses on integrating the multi-sensory information acquired from the vehicle, driver and environment to assess driving competencies. After information acquisition, the current research focuses on automated segmentation of the selected manoeuvres from the driving scenario. This leads to the creation of a model that determines a “competency” criterion through the driving performance protocol used by driver trainers (i.e. expert knowledge) to assess drivers. This is achieved by comprehensively evaluating and assessing the data stream acquired from multiple in-vehicle sensors using fuzzy rules and classifying the driving manoeuvres (i.e. overtake, lane change, T-crossing and turn) between low and high competency. The fuzzy rules use parameters such as following distance, gaze depth and scan area, distance with respect to lanes and excessive acceleration or braking during the manoeuvres to assess competency. These rules that identify driving competency were initially designed with the help of expert’s knowledge (i.e. driver trainers). In-order to fine tune these rules and the parameters that define these rules, a driving experiment was conducted to identify the empirical differences between novice and experienced drivers. The results from the driving experiment indicated that significant differences existed between novice and experienced driver, in terms of their gaze pattern and duration, speed, stop time at the T-crossing, lane keeping and the time spent in lanes while performing the selected manoeuvres. These differences were used to refine the fuzzy membership functions and rules that govern the assessments of the driving tasks. Next, this research focused on providing an integrated visual assessment interface to both driver trainers and their trainees. By providing a rich set of interactive graphical interfaces, displaying information about the driving tasks, Intelligent Driver Training System (IDTS) visualisation module has the potential to give empirical feedback to its users. Lastly, the validation of the IDTS system’s assessment was conducted by comparing IDTS objective assessments, for the driving experiment, with the subjective assessments of the driver trainers for particular manoeuvres. Results show that not only IDTS was able to match the subjective assessments made by driver trainers during the driving experiment but also identified some additional driving manoeuvres performed in low competency that were not identified by the driver trainers due to increased mental workload of trainers when assessing multiple variables that constitute driving. The validation of IDTS emphasized the need for an automated assessment tool that can segment the manoeuvres from the driving scenario, further investigate the variables within that manoeuvre to determine the manoeuvre’s competency and provide integrated visualisation regarding the manoeuvre to its users (i.e. trainers and trainees). Through analysis and validation it was shown that IDTS is a useful assistance tool for driver trainers to empirically assess and potentially provide feedback regarding the manoeuvres undertaken by the drivers.

Assessment for learning in the accountability era : Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers' assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.

Structural dynamics research and applications

Research in structural dynamics has received considerable attention due to problems associated with emerging slender structures, increased vulnerability of structures to random loads and aging infrastructure. This paper briefly describes some such research carried out on i) dynamics of composite floor structure, ii) dynamics of cable supported footbridge, iii) seismic mitigation of frame-shear wall structure using passive dampers and iv) development of a damage assessment model for use in structural health modelling.

Development of an automated safety assessment framework for construction activities

This paper presents an ongoing research project concerning the development of an automated safety assessment framework for earthmoving and surface mining activities. This research seeks to determine data needs for safety assessment and investigates how to utilize collected data to promote more informed and efficient safety decision-making. The research first examined accidents and fatalities involved with earthmoving and surface mining activities—more specifically, those involving loading, hauling, and dumping operations,—investigated risk factors involved with the accidents, and finally identified data needs for safety assessment based on safety regulations and practices. An automated safety assessment method was then developed using the data needs that had been identified. This research is expected to contribute to the introduction of a fundamental framework for automated safety assessment and the systematic collection of safety-related data from construction activities. Implementation of the entire safety assessment process on actual construction sites remains a task for future research.