…Where did I lose you? Accessing the literacy demands of assessment

In this study we sought to find out how teachers could make assessment fairer for Indigenous students in learning mathematics, given the context of the high stakes of the National Assessment Program Literacy and Numeracy (NAPLAN). Today, teachers are experiencing the full range of demands from their own students who require individual attention, through to system level expectations of improved performances for all students. Many staff experience reform fatigue with limited time for critical reflection and a reduction in support for the use and the analysis of the overwhelming amount of data that has become available in recent years. Over the past three years we worked with teachers in seven schools to gradually refine our research focus to centre on how we might best support teachers in this demanding context with the important outcome of improved teaching and learning of mathematics with particular consideration of how to respond to the cultural needs of Indigenous (Aboriginal and Torres Strait Islander) students.

Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Teaching design and emotion in the foundation year : an industrial design approach

This paper showcases two design tools; the ‘storyboard’ and ‘a day in the life’ demonstrated to design students in their foundational year (first year) of study. By employing these tools during the design process the aim was to provoke students to consider and design for emotional experiences for potential users. The assessment asked students to design an MP3 player using these tools. This is demonstrated through a student project that successfully used the tools and method introduced. The teaching theory, project context, student outcome as well as challenges faced by students using this approach are discussed. The paper concludes with implications for teaching emotion theory at an undergraduate level and potential future directions.

Performance evaluation of onsite sewage treatment : results of soil investigations

Background The onsite treatment of sewage and effluent disposal is widely prevalent in rural and urban fringe areas due to the general unavailability of reticulated wastewater collection systems. Despite the low technology of the systems, failure is common and in many cases leading to adverse public health and environmental consequences. It is important therefore that careful consideration is given to the design and location of onsite sewage treatment systems. This requires an understanding of the factors that influence treatment performance. The use of subsurface absorption systems is the most common form of effluent disposal for onsite sewage treatment, particularly for septic tanks. Also, in the case of septic tanks, a subsurface disposal system is generally an integral component of the sewage treatment process. Site specific factors play a key role in the onsite treatment of sewage. The project The primary aims of the research project were: • to relate treatment performance of onsite sewage treatment systems to soil conditions at site; • to evaluate current research relating to onsite sewage treatment; and, • to identify key issues where currently there is a lack of relevant research. These tasks were undertaken with the objective of facilitating the development of performance based planning and management strategies for onsite sewage treatment. The primary focus of this research project has been on septic tanks. By implication, the investigation has been confined to subsurface soil absorption systems. The design and treatment processes taking place within the septic tank chamber itself did not form a part of the investigation. Five broad categories of soil types prevalent in the Brisbane region have been considered in this project. The number of systems investigated was based on the proportionate area of urban development within the Brisbane region located on each of the different soil types. In the initial phase of the investigation, the majority of the systems evaluated were septic tanks. However, a small number of aerobic wastewater treatment systems (AWTS) were also included. The primary aim was to compare the effluent quality of systems employing different generic treatment processes. It is important to note that the number of each different type of system investigated was relatively small. Consequently, this does not permit a statistical analysis to be undertaken of the results obtained for comparing different systems. This is an important issue considering the large number of soil physico-chemical parameters and landscape factors that can influence treatment performance and their wide variability. The report This report is the last in a series of three reports focussing on the performance evaluation of onsite treatment of sewage. The research project was initiated at the request of the Brisbane City Council. The project component discussed in the current report outlines the detailed soil investigations undertaken at a selected number of sites. In the initial field sampling, a number of soil chemical properties were assessed as indicators to investigate the extent of effluent flow and to help understand what soil factors renovate the applied effluent. The soil profile attributes, especially texture, structure and moisture regime were examined more in an engineering sense to determine the effect of movement of water into and through the soil. It is important to note that it is not only the physical characteristics, but also the chemical characteristics of the soil as well as landscape factors play a key role in the effluent renovation process. In order to understand the complex processes taking place in a subsurface effluent disposal area, influential parameters were identified using soil chemical concepts. Accordingly, the primary focus of this final phase of the research project was to identify linkages between various soil chemical parameters and landscape patterns and their contribution to the effluent renovation process. The research outcomes will contribute to the development of robust criteria for evaluating the performance of subsurface effluent disposal systems. The outcomes The key findings from the soil investigations undertaken are: • Effluent renovation is primarily undertaken by a combination of various soil physico-chemical parameters and landscape factors, thereby making the effluent renovation processes strongly site dependent. • Decisions regarding site suitability for effluent disposal should not be based purely in terms of the soil type. A number of other factors such as the site location in the catena, the drainage characteristics and other physical and chemical characteristics, also exert a strong influence on site suitability. • Sites, which are difficult to characterise in terms of suitability for effluent disposal, will require a detailed soil physical and chemical analysis to be undertaken to a minimum depth of at least 1.2 m. • The Ca:Mg ratio and Exchangeable Sodium Percentage are important parameters in soil suitability assessment. A Ca:Mg ratio of less than 0.5 would generally indicate a high ESP. This in turn would mean that Na and possibly Mg are the dominant exchangeable cations, leading to probable clay dispersion. • A Ca:Mg ratio greater than 0.5 would generally indicate a low ESP in the profile, which in turn indicates increased soil stability. • In higher clay percentage soils, low ESP can have a significant effect. • The presence of high exchangeable Na can be counteracted by the presence of swelling clays, and an exchange complex co-dominated by exchangeable Ca and exchangeable Mg. This aids absorption of cations at depth, thereby reducing the likelihood of dispersion. • Salt is continually added to the soil by the effluent and problems may arise if the added salts accumulate to a concentration that is harmful to the soil structure. Under such conditions, good drainage is essential in order to allow continuous movement of water and salt through the profile. Therefore, for a site to be sustainable, it would have a maximum application rate of effluent. This would be dependent on subsurface characteristics and the surface area available for effluent disposal. • The dosing regime for effluent disposal can play a significant role in the prevention of salt accumulation in the case of poorly draining sites. Though intermittent dosing was not considered satisfactory for the removal of the clogging mat layer, it has positive attributes in the context of removal of accumulated salts in the soil.

An assessment tool for selection of appropriate daylighting solutions for buildings in tropical and subtropical regions : Validation using radiance simulation

A new decision-making tool that will assist designers in the selection of appropriate daylighting solutions for buildings in tropical locations has been previously proposed by the authors. Through an evaluation matrix that prioritizes the parameters that best respond to the needs of tropical climates (e.g. reducing solar gain and protection from glare) the tool determines the most appropriate devices for specific climate and building inputs. The tool is effective in demonstrating the broad benefits and limitations of the different daylight strategies for buildings in the tropics. However for thorough analysis and calibration of the tool, validation is necessary. This paper presents a first step in the validation process. RADIANCE simulations were conducted to compare simulation performance with the performance predicted by the tool. To this end, an office building case study in subtropical Brisbane, Australia, and five different daylighting devices including openings, light guiding systems and light transport systems were simulated. Illuminance, light uniformity, daylight penetration and glare analysis were assessed for each device. The results indicate the tool can appropriately rank and recommend daylighting strategies based on specific building inputs for tropical and subtropical regions, making it a useful resource for designers.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Evaluation of screening tests for predicting older driver performance and safety assessed by an on-road test

A number of tests and test batteries are available for the prediction of older driver safety, but many of these have not been validated against standardized driving outcome measures. The aim of this study was to evaluate a series of previously described screening tests in terms of their ability to predict the potential for safe and unsafe driving. Participants included 79 community-dwelling older drivers (M=72.16 years, SD=5.46; range 65-88 years; 57 males and 22 females) who completed a previously validated multi-disciplinary driving assessment, a hazard perception test, a hazard change detection test and a battery of vision and cognitive tests. Participants also completed a standardized on-road driving assessment. The multi-disciplinary test battery had the highest predictive ability with a sensitivity of 80% and a specificity of 73%, followed by the hazard perception test which demonstrated a sensitivity of 75% and a specificity of 61%. These findings suggest that a relatively simple and practical battery of tests from a range of domains has the capacity to predict safe and unsafe driving in older adults.

Metacognitive strategy instruction in English as a Foreign Language (EFL) listening skill

Listening skill is allocated inadequate consideration in English language instruction and learning in Iran. At the school level, listening skill is not taught but reading and writing skills are taught traditionally. At the college level, reading skill is emphasised. For students seeking IELTS certification, institutes teach listening skill within the framework of a Communicative Language Teaching (CLT) approach. Nonetheless, despite the official syllabus, many teachers tend to test rather than teach listening skill. Currently, listening skill in the curriculum is embedded in an oral comprehension teaching approach through multiple choice written responses in the institutes. Therefore, the process of explicitly teaching listening is overlooked with a strong emphasis on the post hoc assessment of the products of listening. This study used a mixed methods approach to investigate the relationship between metacognitive strategy instruction and listening performance, metacognitive awareness and use of metacognitive strategies in listening. Three research questions were addressed in this study: - Is there a relationship between metacognitive strategy instruction (planning, monitoring and evaluation) and Iranian High Intermediate students¡¦ listening? „ - Is there a relationship between metacognitive strategy instruction and Iranian High Intermediate students¡¦ metacognitive awareness of listening? - Does metacognitive strategy instruction help Iranian High Intermediate students¡¦ use of metacognitive strategies during listening? A single group (N = 30) of High Intermediate level tertiary students in Iran were guided through a metacognitive strategy instruction over one semester (10 weeks). The first research question was measured through IELTS listening tests, which tracked any change of students’ listening performance. The second research question was analysed through results of a Metacognitive Awareness Listening Questionnaire (MALQ) to survey students’ awareness of metacognitive strategies in listening. Finally, the third research question was analysed through interviews, which explored students’ use of metacognitive strategies in listening. Results indicate that High Intermediate students developed listening performance, but there were no significant changes in metacognitive awareness in listening. Students reported in the interviews that they used multiple strategies (cognitive and metacognitive) to approach listening. Implications for English teaching in Iran and other contexts are discussed.

Security assessment of code refactoring rules

Refactoring is a common approach to producing better quality software. Its impact on many software quality properties, including reusability, maintainability and performance, has been studied and measured extensively. However, its impact on the information security of programs has received relatively little attention. In this work, we assess the impact of a number of the most common code-level refactoring rules on data security, using security metrics that are capable of measuring security from the viewpoint of potential information flow. The metrics are calculated for a given Java program using a static analysis tool we have developed to automatically analyse compiled Java bytecode. We ran our Java code analyser on various programs which were refactored according to each rule. New values of the metrics for the refactored programs then confirmed that the code changes had a measurable effect on information security.

Quantitative assessment of fault tolerant precision timing for electricity substations

Advanced substation applications, such as synchrophasors and IEC 61850-9-2 sampled value process buses, depend upon highly accurate synchronizing signals for correct operation. The IEEE 1588 Precision Timing Protocol (PTP) is the recommended means of providing precise timing for future substations. This paper presents a quantitative assessment of PTP reliability using Fault Tree Analysis. Two network topologies are proposed that use grandmaster clocks with dual network connections and take advantage of the Best Master Clock Algorithm (BMCA) from IEEE 1588. The cross-connected grandmaster topology doubles reliability, and the addition of a shared third grandmaster gives a nine-fold improvement over duplicated grandmasters. The performance of BMCA mediated handover of the grandmaster role during contingencies in the timing system was evaluated experimentally. The 1 µs performance requirement of sampled values and synchrophasors are met, even during network or GPS antenna outages. Slave clocks are shown to synchronize to the backup grandmaster in response to degraded performance or loss of the main grandmaster. Slave disturbances are less than 350 ns provided the grandmaster reference clocks are not offset from one another. A clear understanding of PTP reliability and the factors that affect availability will encourage the adoption of PTP for substation time synchronization.

Learning and teaching reflection : developing capacities for lifelong learning

Reflection is an essential part of being an effective learner and working as a productive teacher. It enables the learner or teacher to deliberate about the factors that lead to successful learning and teaching for them and/or their students, in a particular place and for a specific purpose, so they can make reasoned and effective choices. This chapter introduces important frameworks that cover a century of thinking around reflection in education, and illustrates how preservice teachers can use these ideas across three phases. First, becoming a reflective learner as a university student to enhance learning and assessment outcomes; second, becoming a reflective teacher to improve classroom teaching and learning outcomes; and third, developing the reflective capacities of primary students so they can enhance their skills for lifelong learning.

Dr. Seuss and the "Great Balancing Act" : Exploring the Ethical Places You’ll Go Within Australian Sport, Exercise, and Performance Psychology

Stories by children’s writer Dr. Seuss have often been utilised as non-traditional narrative reflections regarding the issues of ethics and morality (Greenwood, 2000). Such case studies are viewed as effective teaching and learning tools due to the associated analytical and decision-making frameworks that are represented within the texts, and focus upon the exploration of universally general virtues and approaches to ethics (Hankes, 2012). Whilst Dr. Seuss did not create a story directly related to the sport, exercise or performance domains, many of his narratives possess psychological implications that are applicable in any situation that requires ethical consideration of the thinking and choices people make. The following exploration of the ‘ethical places you’ll go’ draws upon references to his work as a guide to navigating this interesting and sometimes challenging landscape for sport, exercise, and performance psychologists (SEPP).

A conceptual model for reflecting on expected learning vs. demonstrated student performance

Educators are faced with many challenging questions in designing an effective curriculum. What prerequisite knowledge do students have before commencing a new subject? At what level of mastery? What is the spread of capabilities between bare-passing students vs. the top performing group? How does the intended learning specification compare to student performance at the end of a subject? In this paper we present a conceptual model that helps in answering some of these questions. It has the following main capabilities: capturing the learning specification in terms of syllabus topics and outcomes; capturing mastery levels to model progression; capturing the minimal vs. aspirational learning design; capturing confidence and reliability metrics for each of these mappings; and finally, comparing and reflecting on the learning specification against actual student performance. We present a web-based implementation of the model, and validate it by mapping the final exams from four programming subjects against the ACM/IEEE CS2013 topics and outcomes, using Bloom's Taxonomy as the mastery scale. We then import the itemised exam grades from 632 students across the four subjects and compare the demonstrated student performance against the expected learning for each of these. Key contributions of this work are the validated conceptual model for capturing and comparing expected learning vs. demonstrated performance, and a web-based implementation of this model, which is made freely available online as a community resource.

Establishing virtual production as a research and teaching activity at QUT

Located within the Creative Industries Faculty, the Animation team at the Queensland University of Technology (QUT) recently acquired a full-body inertial motion capture system. Our research to date has been predominantly concerned with interdisciplinary practice and the benefits this could bring to undergraduate teaching. From early experimental tests it was identified that there was a need to develop a framework for best practice and an efficient production workflow to ensure the system was being used to its full potential. Through our ongoing investigation we have identified at least three areas that stand to have long-term benefits from universities engaging in motion capture related research activity. This includes interdisciplinary collaborative research, undergraduate teaching and improved production processes. The following paper reports the early stages of our research, which explores the use of a full-body inertial motion capture (MoCap) solution in collaboration with performing artists.

Revealing performance heterogeneity through knowledge management maturity evaluation : a capability-based approach

The dynamic capabilities view (DCV) focuses on renewal of firms’ strategic knowledge resources so as to sustain competitive advantage within turbulent markets. Within the context of the DCV, the focus of knowledge management (KM) is to develop the KMC through deploying knowledge governance mechanisms that are conducive to facilitating knowledge processes so as to produce superior business performance over time. The essence of KM performance evaluation is to assess how well the KMC is configured with knowledge governance mechanisms and processes that enable a firm to achieve superior performance through matching its knowledge base with market needs. However, little research has been undertaken to evaluate KM performance from the DCV perspective. This study employed a survey study design and adopted hypothesis-testing approaches to develop a capability-based KM evaluation framework (CKMEF) that upholds the basic assertions of the DCV. Under the governance of the framework, a KM index (KMI) and a KM maturity model (KMMM) were derived not only to indicate the extent to which a firm’s KM implementations fulfill its strategic objectives, and to identify the evolutionary phase of its KMC, but also to bench-mark the KMC in the research population. The research design ensured that the evaluation framework and instruments have statistical significance and good generalizabilty to be applied in the research population, namely construction firms operating in the dynamic Hong Kong construction market. The study demonstrated the feasibility of quantitatively evaluating the development of the KMC and revealing the performance heterogeneity associated with the development.