Towards learner autonomy : an assessment for learning approach

Using Assessment for Learning (AfL) may develop learner autonomy however, very often AfL is reduced to a set of strategies that do not always achieve the desired outcome. This research adopted a different approach that examined AfL as a cultural practice, situated within influential social relationships that shape learner identity. The study addressed the question “What are the qualities of the teacher-student relationship that support student learning autonomy in an AfL context?” Three case studies of the interactions of Queensland middle school teachers and their classes of Year 7, 8 and 9 were developed over one year. Data were collected from field notes and video recordings of classroom interactions and individual and focus group interviews with teachers and students. The analysis began with a close look at the field data. Interpretations that emerged from a sociocultural theoretical understanding were helpful in informing the process of analysis. Themes and patterns of interrelationships were identified through thematic coding using a constant comparative approach. Validation was achieved through methodological triangulation. Four findings that inform an understanding of AfL and the development of learner autonomy emerged. Firstly, autonomy is theorised as a context-specific identity mediated through the teacher-student relationship. Secondly, it was observed that learners negotiated their identities as knowers through AfL practices in various tacit, explicit, group and individual ways in a ‘generative dance’ of knowing in action (Cook & Brown, 2005). Thirdly, teachers and learners negotiated their participation by drawing from identities in multiple communities of practice. Finally it is proposed that a new participative identity or narrative for assessment is needed. This study contributes to understandings about teacher AfL practices that can help build teacher assessment capacity. Importantly, autonomy is understood as an identity that is available to all learners. This study is also significant as it affirms the importance of teacher assessment to support learners in developing autonomy, a focus that challenges the singular assessment policy focus on measuring performance. Finally this study contributes to a sociocultural theoretical understanding of AfL.

Integration of CENA practice standards for postgraduate emergency nursing assessment

The use of professional competency standards to assess postgraduate nursing student’s clinical performance has been in place since 2004, at the Queensland University of Technology, School of Nursing & Midwifery (SONAM) when the Graduate Certificate in Emergency Nursing degree commenced. Emergency nursing students were assessed in their workplace, using a Clinical Performance Appraisal Tool or CPAT which was based on the Australian College of Critical Care Nurses (ACCCN) Competency Standards. With the subsequent formation of a separate Emergency Nursing Course advisory group in 2007, there was a review of clinical assessment course component. The release of the 2008 CENA revised Practice Standards for the Emergency Nursing Specialist’s, led to the emergency nursing course advisory committee supporting the integration of the CENA practice standards for assessment of emergency nurses in preference to the less relevant ACCCN competency standards. The SONAM emergency nursing study area team commenced the phasing in and progression of the CENA practice standards across the two Graduate Certificate units, and Graduate Diploma and Master of Nursing (emergency) clinical major options in 2009. As some units undertaken in the degree are available to nurses in other disciplines a separate CPAT was devised for the clinical assessments according to speciality context. The team has had to carefully consider how the professional standards are integrated into the teaching and assessment of the unit and not just applied instead of the ACCCN competency standards. Professional standards for the emergency context has also helped tailor course content and learning outcomes to be relevant across a number of emergency nursing contexts in Australia. The assessment of the CPAT is undertaken at the workplace by QUT appointed clinical lecturers. Clinical lecturers need to apply and have suitable postgraduate qualification to undertake the position. The clinical lecturer support role is well established at QUT. The integration of the new CENA practice standards has necessitated a review of the postgraduate assessment of emergency nurses. A clinical lecturer workshop has been organised to review role, scope and how to utilise the new look CENA based CPAT, clinical assessment format.

Measuring neighbourhood sustainability performance: an indexing model for Gold Coast City, Australia

The aim of this research is to develop an indexing model to evaluate sutainability performance of urban settings, in order to assess environmental impacts of urban development and to provide planning agencies an indexing model as a decision support tool to be used in curbing negative impacts of urban development. Indicator-based sustainability assessment is embraced as the method. Neigbourhood-level urban form and transport related indicators are derived from the literature by conducting a content analysis and finalised via a focus group meeting. The model is piloted on three suburbs of Gold Coast City, Australia. Final neighbourhood level sustainability index score was calculated by employing equal weighting schema. The results of the study show that indexing modelling is a reasonably practical method to measure and visualise local sustainability performance, which can be employed as an effective communication and decision making tool.

Assessing performance capability in the work place

As universities worldwide begin to appreciate the value of authentic learning experiences, so they struggle with methods of assessing the outcomes from such experiences. This chapter describes the application of an assessment matrix developed by Queensland University of Technology(QUT) in Australia, to the assessment requirements and practices relating to work integrated learning at the University of Surrey in the UK. Despite the very different institutional contexts and independent way in which the assessment regimes have developed, it was found that the values and outcomes being assessed and the methods used to assess them were similar. The most important feature of assessing work integrated learning experiences is fitness for purpose, hence the learning objectives and assessment of outcomes for a WIL experience must be explicitly aligned to this objective.As universities worldwide begin to appreciate the value of authentic learning experiences, so they struggle with methods of assessing the outcomes from such experiences. This chapter describes the application of an assessment matrix developed by Queensland University of Technology (QUT) in Australia, to the assessment requirements and practices relating to work integrated learning at the University of Surrey in the UK. Despite the very different institutional contexts and independent way in which the assessment regimes have developed, it was found that the values and outcomes being assessed and the methods used to assess them were similar. The most important feature of assessing work integrated learning experiences is fitness for purpose, hence the learning objectives and assessment of outcomes for a WIL experience must be explicitly aligned to this objective.

Developing the Pattern and Structure Assessment (PASA) interview to inform early mathematics learning

The Pattern and Structure Mathematical Awareness Program(PASMAP) stems from a 2-year longitudinal study on students’ early mathematical development. The paper outlines the interview assessment the Pattern and Structure Assessment(PASA) designed to describe students’ awareness of mathematical pattern and structure across a range of concepts. An overview of students’ performance across items and descriptions of their structural development are described.

Closing the loop 21st century style : providing feedback on written assessment via MP3 recordings

Feedback on student performance, whether in the classroom or on written assignments, enables them to reflect on their understandings and restructure their thinking in order to develop more powerful ideas and capabilities. Research has identified a number of broad principles of good feedback practice. These include the provision of feedback that facilitates the development of reflection in learning; helps clarify what good performance is in terms of goals, criteria and expected standards; provides opportunities to close the gap between current and desired performance; delivers high quality information to students about their learning; and encourages positive motivational beliefs and self-esteem. However, high staff–student ratios and time pressures often result in a gulf between this ideal and reality. Whilst greater use of criteria referenced assessment has enabled an improvement in the extent of feedback being provided to students, this measure alone does not go far enough to satisfy the requirements of good feedback practice. Technology offers an effective and efficient means by which personalised feedback may be provided to students. This paper presents the findings of a trial of the use of the freely available Audacity program to provide individual feedback via MP3 recordings to final year Media Law students at the Queensland University of Technology on their written assignments. The trial has yielded wide acclaim by students as an effective means of explaining the exact reasons why they received the marks they were awarded, the things they did well and the areas needing improvement. It also showed that good feedback practice can be achieved without the burden of an increase in staff workload.

Enhancing Chinese TEFL academics' research performance : necessity and urgency

China’s increasing participation in world affairs and the growing popularity of English as a lingua franca have made significant impact on Chinese society, culture and education. As such, considerable research topics in relation to English require TEFL researchers’ attentions. Additionally, higher education reform in China has created higher demand on academics by stressing research as an important element in academics’ assessment. Recurrent rhetoric in the field of TEFL also calls on practitioners to theorise their practice. All these practical needs and theoretical arguments point to the necessity and significance of TEFL academics’ engagement in research. To find out whether Chinese TEFL academics’ research meet the new demand on them, a survey of TEFL academics at three Chinese higher institutions was conducted. One hundred eighty two of them provided valid responses which were analysed using SPSS. It was found that TEFL academics’ research productivity in each category of research products was quite low. Large percentages of them did not produce any item in the investigated categories of research. They were least productive in conference papers and research products at the national level. However for these least productive categories, there were highly-productive TEFL academics. The categories of research where the TEFL academics were found relatively productive were non-core journal articles and provincial projects. The findings suggest that it is necessary and urgent for Chinese TEFL academics to enhance their research productivity to be able to meet the demand that new era has rendered.

A longitudinal assessment of chronic wound fluid to detect biochemical indicators of healing

Chronic venous leg ulcers are a detrimental health issue plaguing our society, resulting in long term pain, immobility and decreased quality of life for a large proportion of sufferers. The frequency of these chronic wounds has led current research to focus on the wound environment to provide important information regarding the prolonged, fluctuated or static healing patterns of these wounds. Disruption to the normal wound healing process results in release of multiple factors in the wound environment that could correlate to wound chronicity. These biochemical factors can often be detected through non-invasively sampling chronic wound fluid (CWF) from the site of injury. Of note, whilst there are numerous studies comparing acute and chronic wound fluids, there have not been any reports in the literature employing a longitudinal study in order to track biochemical changes in wound fluid as patients transition from a non-healing to healed state. Initially the objective of this study was to identify biochemical changes in CWF associated with wound healing using a proteomic approach. The proteomic approach incorporated a multi-dimensional liquid chromatography fractionation technique coupled with mass spectrometry (MS) to enable identification of proteins present in lower concentrations in CWF. Not surprisingly, many of the proteins identified in wound fluid were acute phase proteins normally expressed during the inflammatory phase of healing. However, the number of proteins positively identified by MS was quite low. This was attributed to the diverse range in concentration of protein species in CWF making it challenging to detect the diagnostically relevant low molecular weight proteins. In view of this, SELDI-TOF MS was also explored as a means to target low molecular weight proteins in sequential patient CWF samples during the course of healing. Unfortunately, the results generated did not yield any peaks of interest that were altered as wounds transitioned to a healed state. During the course of proteomic assessment of CWF, it became evident that a fraction of non-proteinaceous compounds strongly absorbed at 280 nm. Subsequent analyses confirmed that most of these compounds were in fact part of the purine catabolic pathway, possessing distinctive aromatic rings and which results in high absorbance at 254 nm. The accumulation of these purinogenic compounds in CWF suggests that the wound bed is poorly oxygenated resulting in a switch to anaerobic metabolism and consequently ATP breakdown. In addition, the presence of the terminal purine catabolite, uric acid (UA), indicates that the enzyme xanthine oxidoreductase (XOR) catalyses the reaction of hypoxanthine to xanthine and finally to UA. More importantly, the studies provide evidence for the first time of the exogenous presence of XOR in CWF. XOR is the only enzyme in humans capable of catalysing the production of UA in conjunction with a burst of the highly reactive superoxide radical and other oxidants like H2O2. Excessive release of these free radicals in the wound environment can cause cellular damage disrupting the normal wound healing process. In view of this, a sensitive and specific assay was established for monitoring low concentrations of these catabolites in CWF. This procedure involved combining high performance liquid chromatography (HPLC) with tandem mass spectrometry and multiple reaction monitoring (MRM). This application was selective, using specific MRM transitions and HPLC separations for each analyte, making it ideal for the detection and quantitation of purine catabolites in CWF. The results demonstrated that elevated levels of UA were detected in wound fluid obtained from patients with clinically worse ulcers. This suggests that XOR is active in the wound site generating significant amounts of reactive oxygen species (ROS). In addition, analysis of the amount of purine precursors in wound fluid revealed elevated levels of purine precursors in wound fluid from patients with less severe ulcers. Taken together, the results generated in this thesis suggest that monitoring changes of purine catabolites in CWF is likely to provide valuable information regarding the healing patterns of chronic venous leg ulcers. XOR catalysis of purine precursors not only provides a method for monitoring the onset, prognosis and progress of chronic venous leg ulcers, but also provides a potential therapeutic target by inhibiting XOR, thus blocking UA and ROS production. Targeting a combination of these purinogenic compounds and XOR could lead to the development of novel point of care diagnostic tests. Therefore, further investigation of these processes during wound healing will be worthwhile and may assist in elucidating the pathogenesis of this disease state, which in turn may lead to the development of new diagnostics and therapies that target these processes.

Understanding graphicacy : students’ making sense of graphics in mathematics assessment tasks

The ability to decode graphics is an increasingly important component of mathematics assessment and curricula. This study examined 50, 9- to 10-year-old students (23 male, 27 female), as they solved items from six distinct graphical languages (e.g., maps) that are commonly used to convey mathematical information. The results of the study revealed: 1) factors which contribute to success or hinder performance on tasks with various graphical representations; and 2) how the literacy and graphical demands of tasks influence the mathematical sense making of students. The outcomes of this study highlight the changing nature of assessment in school mathematics and identify the function and influence of graphics in the design of assessment tasks.

When non-significance maybe significant: lessons learned from a study into the development, implementation and evaluation of a risk assessment tool for fleet settings

Introduction This study reports on the development of a self report assessment tool to increase the efficacy of crash prediction within Australian Fleet settings Over last 20 years an array of measures have been produced (Driver anger scale, Driving Skill Inventory, Manchester Driver Behaviour Questionnaire, Driver Attitude Questionnaire, Driver Stress Inventory, Safety Climate Questionnaire) While these tools are useful, research has demonstrated limited ability to accurately identify individuals most likely to be involved in a crash. Reasons cited include; - Crashes are relatively rare - Other competing factors may influence crash event - Ongoing questions regarding the validity of self report measures (common method variance etc) - Lack of contemporary issues relating to fleet driving performance

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

Not all older adults have insight into their driving abilities : evidence from an on-road assessment and implications for policy

Purpose To compare self-reported driving ability with objective measures of on-road driving performance in a large cohort of older drivers. Methods 270 community-living adults aged 70 – 88 years recruited via the electoral roll completed a standardized assessment of on-road driving performance and questionnaires determining perceptions of their own driving ability, confidence and driving difficulties. Retrospective self-reported crash data over the previous five years were recorded. Results Participants reported difficulty with only selected driving situations, including driving into the sun, in unfamiliar areas, in wet conditions, and at night or dusk. The majority of participants rated their own driving as good to excellent. Of the 47 (17%) of drivers who were rated as potentially unsafe to drive, 66% rated their own driving as good to excellent. Drivers who made critical errors, where the driving instructor had to take control of the vehicle, had no lower self-rating of driving ability then the rest of the group. The discrepancy in self-perceptions of driving and participants’ safety rating on the on-road assessment was significantly associated with self-reported retrospective crash rates, where those drivers who displayed greater overconfidence in their own driving were significantly more likely to report a crash. Conclusions This study demonstrates that older drivers with the greatest mismatch between actual and self-rated driving ability pose the greatest risk to road safety. Therefore licensing authorities should not assume that when older individuals’ driving abilities begin to decline they will necessarily be aware of these changes and adopt appropriate compensatory driving behaviours; rather, it is essential that evidence-based assessments are adopted.

Analysis of acoustic emission data for accurate damage assessment for structural health monitoring applications

Structural health monitoring (SHM) refers to the procedure used to assess the condition of structures so that their performance can be monitored and any damage can be detected early. Early detection of damage and appropriate retrofitting will aid in preventing failure of the structure and save money spent on maintenance or replacement and ensure the structure operates safely and efficiently during its whole intended life. Though visual inspection and other techniques such as vibration based ones are available for SHM of structures such as bridges, the use of acoustic emission (AE) technique is an attractive option and is increasing in use. AE waves are high frequency stress waves generated by rapid release of energy from localised sources within a material, such as crack initiation and growth. AE technique involves recording these waves by means of sensors attached on the surface and then analysing the signals to extract information about the nature of the source. High sensitivity to crack growth, ability to locate source, passive nature (no need to supply energy from outside, but energy from damage source itself is utilised) and possibility to perform real time monitoring (detecting crack as it occurs or grows) are some of the attractive features of AE technique. In spite of these advantages, challenges still exist in using AE technique for monitoring applications, especially in the area of analysis of recorded AE data, as large volumes of data are usually generated during monitoring. The need for effective data analysis can be linked with three main aims of monitoring: (a) accurately locating the source of damage; (b) identifying and discriminating signals from different sources of acoustic emission and (c) quantifying the level of damage of AE source for severity assessment. In AE technique, the location of the emission source is usually calculated using the times of arrival and velocities of the AE signals recorded by a number of sensors. But complications arise as AE waves can travel in a structure in a number of different modes that have different velocities and frequencies. Hence, to accurately locate a source it is necessary to identify the modes recorded by the sensors. This study has proposed and tested the use of time-frequency analysis tools such as short time Fourier transform to identify the modes and the use of the velocities of these modes to achieve very accurate results. Further, this study has explored the possibility of reducing the number of sensors needed for data capture by using the velocities of modes captured by a single sensor for source localization. A major problem in practical use of AE technique is the presence of sources of AE other than crack related, such as rubbing and impacts between different components of a structure. These spurious AE signals often mask the signals from the crack activity; hence discrimination of signals to identify the sources is very important. This work developed a model that uses different signal processing tools such as cross-correlation, magnitude squared coherence and energy distribution in different frequency bands as well as modal analysis (comparing amplitudes of identified modes) for accurately differentiating signals from different simulated AE sources. Quantification tools to assess the severity of the damage sources are highly desirable in practical applications. Though different damage quantification methods have been proposed in AE technique, not all have achieved universal approval or have been approved as suitable for all situations. The b-value analysis, which involves the study of distribution of amplitudes of AE signals, and its modified form (known as improved b-value analysis), was investigated for suitability for damage quantification purposes in ductile materials such as steel. This was found to give encouraging results for analysis of data from laboratory, thereby extending the possibility of its use for real life structures. By addressing these primary issues, it is believed that this thesis has helped improve the effectiveness of AE technique for structural health monitoring of civil infrastructures such as bridges.

The future of sustainable building assessment tools : a case study in Australia

Sustainability issues in built environment have attracted an increasingly level of attention from both the general public and the industry. As a result, a number of green building assessment tools have been developed such as the Leadership in Energy and Environmental Design (LEED) and the BRE Environmental Assessment Method (BREEAM), etc. This paper critically reviewed the assessment tools developed in Australian context, i.e. the Green Star rating tools developed by the Green Building Council of Australia. A particular focus is given to the recent developments of these assessment tools. The results showed that the office buildings take the biggest share of Green Star rated buildings. Similarly, sustainable building assessments seem to be more performance oriented which focuses on the operation stage of buildings. In addition, stakeholder engagement during the decision making process is encouraged. These findings provide useful references to the development of next generation of sustainable building assessment tools.

When non-significance may be significant : lessons learned from a study of the development, implementation and evaluation of a fleet risk assessment tool

This paper reports on the development and implementation of a self-report risk assessment tool that was developed in an attempt to increase the efficacy of crash prediction within Australian fleet settings. This study forms a part of a broader program of research into work related road safety and identification of driving risk. The first phase of the study involved a series of focus groups being conducted with 217 professional drivers which revealed that the following factors were proposed to influence driving performance: Fatigue, Knowledge of risk, Mood, Impatience and frustration, Speed limits, Experience, Other road users, Passengers, Health, and Culture. The second phase of the study involved piloting the newly developed 38 item Driving Risk Assessment Scale - Work Version (DRAS-WV) with 546 professional drivers. Factor analytic techniques identified a 9 factor solution that was comprised of speeding, aggression, time pressure, distraction, casualness, awareness, maintenance, fatigue and minor damage. Speeding and aggressive driving manoeuvres were identified to be the most frequent aberrant driving behaviours engaged in by the sample. However, a series of logistic regression analyses undertaken to determine the DRAS-WV scale’s ability to predict self-reported crashes revealed limited predictive efficacy e.g., 10% of crashes. This paper outlines proposed reasons for this limited predictive ability of the DRAS-WV as well as provides suggestions regarding the future of research that aims to develop methods to identify “at risk” drivers.