Assessment for learning - Why the theory needs the practice

Assessment for Learning is a pedagogical practice with anticipated gains of increased student motivation, mastery and autonomy as learners develop their capacity to monitor and plan their own learning progress. Assessment for Learning (AfL) differs from Assessment of learning in its timing, occurring within the regular flow of learning rather than end point, in its purpose of improving student learning rather than summative grading and in the ownership of the learning where the student voice is heard in judging quality. Since Black and Wiliam (1998) highlighted the achievement gains that AfL practices seem to bring to all learners in classrooms, it has become part of current educational policy discourse in Australia, yet teacher adoption of the practices is not a straightforward implementation of techniques within an existing classroom repertoire. As can be seen from the following meta-analysis, recent research highlights a more complex interrelationship between teacher and student beliefs about learning and assessment, and the social and cultural interactions in and contexts of the classroom. More research is needed from a sociocultural perspective that allows meaning to emerge from practice. Before another policy push, we need to understand better the many factors within the assessment relationship. We need to hear from teachers and students through long-term AfL case studies both to inform AfL theory and to shed light on the complexities of pedagogical change for enhancing learner autonomy.

Towards learner autonomy : an assessment for learning approach

Using Assessment for Learning (AfL) may develop learner autonomy however, very often AfL is reduced to a set of strategies that do not always achieve the desired outcome. This research adopted a different approach that examined AfL as a cultural practice, situated within influential social relationships that shape learner identity. The study addressed the question “What are the qualities of the teacher-student relationship that support student learning autonomy in an AfL context?” Three case studies of the interactions of Queensland middle school teachers and their classes of Year 7, 8 and 9 were developed over one year. Data were collected from field notes and video recordings of classroom interactions and individual and focus group interviews with teachers and students. The analysis began with a close look at the field data. Interpretations that emerged from a sociocultural theoretical understanding were helpful in informing the process of analysis. Themes and patterns of interrelationships were identified through thematic coding using a constant comparative approach. Validation was achieved through methodological triangulation. Four findings that inform an understanding of AfL and the development of learner autonomy emerged. Firstly, autonomy is theorised as a context-specific identity mediated through the teacher-student relationship. Secondly, it was observed that learners negotiated their identities as knowers through AfL practices in various tacit, explicit, group and individual ways in a ‘generative dance’ of knowing in action (Cook & Brown, 2005). Thirdly, teachers and learners negotiated their participation by drawing from identities in multiple communities of practice. Finally it is proposed that a new participative identity or narrative for assessment is needed. This study contributes to understandings about teacher AfL practices that can help build teacher assessment capacity. Importantly, autonomy is understood as an identity that is available to all learners. This study is also significant as it affirms the importance of teacher assessment to support learners in developing autonomy, a focus that challenges the singular assessment policy focus on measuring performance. Finally this study contributes to a sociocultural theoretical understanding of AfL.

Learning object dynamics for smooth tracking of moving lip contours

A new technique is proposed for learning the dynamic characteristics of a deformable object, applied in particular to the problem of lip-tracking. Experimental results are given which demonstrate that the use of dynamic models allows the system to track more robustly under adverse conditions and to correct spurious, poorly tracked frames

An analysis of schema change intervention

Successful organizational transformation relies on being able to achieve paradigm or collective schema change, and more particularly, the ability to manage the interplay between pre-existing schemas and alternative schemas required for new environments. This conceptual paper presents an analysis and critique of collective schema change dynamics. Two schema change pathways are reflected in the literature: frame-juxtapose-transition and frame-disengage-learning. Research findings in each pathway are limited and/or contradictory. Moreover, research on schema change focuses primarily on social dynamics and less on the relationship between social schema change dynamics and individual schema change dynamics. One implication of this lack of focus on individual schema change dynamics is the masking of the high level of cognitive processing and cognitive effort required by individuals to effect schema change. The capacity to achieve organizational transformation requires that more attention is given to managing these dynamics, which, in turn, requires significant investment in developing the change leadership capabilities of managers and the organizations they manage.

Reflections on music therapy with Indigenous families : cultural learning put into practice

This paper will describe the process of learning and development that occurred when the Sing & Grow prevention and early intervention project began to provide services to Indigenous families, a relatively new area or music therapy, particularly in Brisbane. The first attempt at establishing a weekly group music therapy program for Indigenous families was not as successful as anticipated; however through analysis of the contributing factors, guidelines were developed and implemented in the following program, which resulted in a positive learning experience for the families and therapists involved.

Assessment policy change in relation to English language teaching and learning in China : a study of perspectives from two universities

In response to concerns about the quality of English Language Learning (ELL) education at tertiary level, the Chinese Ministry of Education (CMoE) launched the College English Reform Program (CERP) in 2004. By means of a press release (CMoE, 2005) and a guideline document titled College English Curriculum Requirements (CECR) (CMoE, 2007), the CERP proposed two major changes to the College English assessment policy, which were: (1) the shift to optional status for the compulsory external test, the College English Test Band 4 (CET4); and (2) the incorporation of formative assessment into the existing summative assessment framework. This study investigated the interactions between the College English assessment policy change, the theoretical underpinnings, and the assessment practices within two Chinese universities (one Key University and one Non-Key University). It adopted a sociocultural theoretical perspective to examine the implementation process as experienced by local actors of institutional and classroom levels. Systematic data analysis using a constant comparative method (Merriam, 1998) revealed that contextual factors and implementation issues did not lead to significant differences in the two cases. Lack of training in assessment and the sociocultural factors such as the traditional emphasis on the product of learning and hierarchical teacher/students relationship are decisive and responsible for the limited effect of the reform.

Moral and social development : teachers’ knowledge of learning and teaching strategies in the early years

The intention of the analysis in this paper was to determine, from interviews with eleven early years’ teachers, what knowledge guided their teaching of moral behaviour. Six of the teachers defined moral behaviour in terms of social conventions only. Children’s learning was attributed by five of the teachers to incidental/contextual issues. Nine of the teachers used discussion of issues, in various contexts, as a way of teaching about social and moral issues. The majority of the teachers (n=7) gave the source of their knowledge of pedagogy as practical as opposed to theoretically informed. There was no clear relationship between their definitions, understanding of children’s learning, pedagogy or source of knowledge. Most of the teachers were using discussion, negotiation and reflection to develop the children’s moral and social behaviour. This is probably effective; however, it suggests a strong need for teaching of moral development to be given more prominence and addressed directly in in-service courses so that teachers are clear about their intentions and the most effective ways of achieving them.

Leveraging Web 2.0 data for scalable semi-supervised learning of domain-specific sentiment lexicons

Since manually constructing domain-specific sentiment lexicons is extremely time consuming and it may not even be feasible for domains where linguistic expertise is not available. Research on the automatic construction of domain-specific sentiment lexicons has become a hot topic in recent years. The main contribution of this paper is the illustration of a novel semi-supervised learning method which exploits both term-to-term and document-to-term relations hidden in a corpus for the construction of domain specific sentiment lexicons. More specifically, the proposed two-pass pseudo labeling method combines shallow linguistic parsing and corpusbase statistical learning to make domain-specific sentiment extraction scalable with respect to the sheer volume of opinionated documents archived on the Internet these days. Another novelty of the proposed method is that it can utilize the readily available user-contributed labels of opinionated documents (e.g., the user ratings of product reviews) to bootstrap the performance of sentiment lexicon construction. Our experiments show that the proposed method can generate high quality domain-specific sentiment lexicons as directly assessed by human experts. Moreover, the system generated domain-specific sentiment lexicons can improve polarity prediction tasks at the document level by 2:18% when compared to other well-known baseline methods. Our research opens the door to the development of practical and scalable methods for domain-specific sentiment analysis.

Managing the project learning paradox : a set-theoretic approach toward project knowledge transfer

Managing project-based learning is becoming an increasingly important part of project management. This article presents a comparative case study of 12 cases of knowledge transfer between temporary inter-organizational projects and permanent parent organizations. Our set-theoretic analysis of these data yields two major findings. First, a high level of absorptive capacity of the project owner is a necessary condition for successful project knowledge transfer, which implies that the responsibility for knowledge transfer seems to in the first place lie with the project parent organization, not with the project manager. Second, none of the factors are sufficient by themselves. This implies that successful project knowledge transfer is a complex process always involving configurations of multiple factors. We link these implications with the view of projects as complex temporary organizational forms in which successful project managers need to cope with complexity by simultaneously paying attention to both relational and organizational processes.

The current context of Queensland primary teacher engagement with professional learning through professional associations

Engaging Queensland primary teachers in professional associations can be a challenge, particularly for subject-specific associations. Professional associations are recognised providers of professional learning. By not being involved in professional associations primary teachers are missing potential quality professional learning opportunities that can impact the results of their students. The purpose of the research is twofold: Firstly, to provide a thorough understanding of the current context in order to assist professional associations who wish to change from their current level of primary teacher engagement; and secondly, to contribute to the literature in the area of professional learning for primary teachers within professional associations. Using a three part research design, interviews of primary teachers and focus groups of professional association participants and executives were conducted and themed to examine the current context of engagement. Force field analysis was used to provide the framework to identify the driving and restraining forces for primary teacher engagement in professional learning through professional associations. Communities of practice and professional learning communities were specifically examined as potential models for professional associations to consider. The outcome is a diagrammatic framework outlining the current context of primary teacher engagement, specifically the driving and restraining forces of primary teacher engagement with professional associations. This research also identifies considerations for professional associations wishing to change their level of primary teacher engagement. The results of this research show that there are key themes that provide maximum impact if wishing to increase engagement of primary teachers in professional associations. However the implications of this lies with professional associations and their alignment between intent and practice dedicated to this change.

Aerial image analysis using spiking neural networks with application to power line corridor monitoring

Trees, shrubs and other vegetation are of continued importance to the environment and our daily life. They provide shade around our roads and houses, offer a habitat for birds and wildlife, and absorb air pollutants. However, vegetation touching power lines is a risk to public safety and the environment, and one of the main causes of power supply problems. Vegetation management, which includes tree trimming and vegetation control, is a significant cost component of the maintenance of electrical infrastructure. For example, Ergon Energy, the Australia’s largest geographic footprint energy distributor, currently spends over $80 million a year inspecting and managing vegetation that encroach on power line assets. Currently, most vegetation management programs for distribution systems are calendar-based ground patrol. However, calendar-based inspection by linesman is labour-intensive, time consuming and expensive. It also results in some zones being trimmed more frequently than needed and others not cut often enough. Moreover, it’s seldom practicable to measure all the plants around power line corridors by field methods. Remote sensing data captured from airborne sensors has great potential in assisting vegetation management in power line corridors. This thesis presented a comprehensive study on using spiking neural networks in a specific image analysis application: power line corridor monitoring. Theoretically, the thesis focuses on a biologically inspired spiking cortical model: pulse coupled neural network (PCNN). The original PCNN model was simplified in order to better analyze the pulse dynamics and control the performance. Some new and effective algorithms were developed based on the proposed spiking cortical model for object detection, image segmentation and invariant feature extraction. The developed algorithms were evaluated in a number of experiments using real image data collected from our flight trails. The experimental results demonstrated the effectiveness and advantages of spiking neural networks in image processing tasks. Operationally, the knowledge gained from this research project offers a good reference to our industry partner (i.e. Ergon Energy) and other energy utilities who wants to improve their vegetation management activities. The novel approaches described in this thesis showed the potential of using the cutting edge sensor technologies and intelligent computing techniques in improve power line corridor monitoring. The lessons learnt from this project are also expected to increase the confidence of energy companies to move from traditional vegetation management strategy to a more automated, accurate and cost-effective solution using aerial remote sensing techniques.

Dichotomy in the design studio : adapting to new blended learning environments

In a study aimed at better understanding how staff and students adapt to new blended studio learning environments (BSLE’s), a group of 165 second year architecture students at a large school of architecture in Australia were separated into two different design studio learning environments. 70% of students were allocated to a traditional studio design learning environment (TSLE) and 30% to a new, high technology embedded, prototype digital learning laboratory. The digital learning laboratory was purpose designed for the case-study users, adapted Student-Centred Active Learning Environment for Undergraduate Programs (SCALE-UP) principles, and built as part of a larger university research project. The architecture students attended the same lectures, followed the same studio curriculum and completed the same pieces of assessment; the only major differences were the teaching staff and physical environment within which the studios were conducted. At the end of the semester, the staff and students were asked to complete a questionnaire about their experiences and preferences within the two respective learning environments. Following this, participants were invited to participate in focus groups, where a synergistic approach was effected. Using a dual method qualitative approach, the questionnaire and survey data were coded and extrapolated using both thematic analysis and grounded theory methodology. The results from these two different approaches were compared, contrasted and finally merged, to reveal six distinct emerging themes, which were instrumental in offering resistance or influencing adaptation to, the new BLSE. This paper reports on the study, discusses the major contributors to negative resistance and proposes points for consideration, when transitioning from a TSLE to a BLSE.

How design of the physical environment impacts early learning : educators and parents perspectives

This research explores the quality and importance of the physical environment of two early learning centres on the Sunshine Coast in Queensland, utilising qualitative interviews with parents (n=4) and educators (n=4) to understand how design might impact on children’s development and a quantitative rating (the Early Childhood Physical Environment Rating Scale; ECPERS) to assess the quality of the physical built environment and infrastructure. With an average ECPERS quality rating, thematic analysis of the interviews revealed that educators and parents viewed the physical environment as important to a child’s development, although the quality of staff was predominant. Early learning centres should be ‘homely’, inviting, bright and linked to the outdoors, with participants describing how space “welcomes the child, makes them feel safe and encourages learning”. Four key themes characterised views: Emotional Connection (quality of staff and physical environment), Experiencing Design (impact of design on child development), Hub for Community Integration (relationships and resources) and Future Vision (ideal physical environment, technology and ratings). With participants often struggling to clearly articulate their thoughts on design issues, a collaborative and jargon-free approach to designing space is required. These findings will help facilitate discussion about the role and design of the physical environment in early childhood centres, with the tangible examples of ‘ideal space’ enhancing communication between architects and educators about how best to design and reconfigure space to enhance learning outcomes.

Affiliation, autonomy and assessment for learning

Assessment for Learning (AfL) is an international assessment area of interest, yet, during 20 years of AfL research, the desired outcome of increased learner autonomy remains elusive. This article analyses AfL practices in classrooms as students negotiated identities as autonomous learners within a classroom community of practice. A sociocultural theoretical framework in formed the analysis of three case studies conducted in Queensland middle school classrooms. Key findings include the importance of the teacher–student relationship, viewing AfL as patterns of participation that develop expertise, and learner autonomy as a negotiated learner identity within each classroom context.

A formative evaluation of the Stronger Smarter Learning Communities Project. 2011 report.

This report is a formative evaluation of the operations of the DEEWR funded Stronger Smarter Learning Community (SSLC) project from September 2009 to July 2011. It is undertaken by an independent team of researchers from Queensland University of Technology, the University of Newcastle and Harvard University. It reports on findings from: documentary analysis; qualitative case studies of SSLC Hub schools; descriptive, multivariate and multilevel analysis of survey data from school leaders and teachers from SSLC Hub and Affiliate schools and from a control group of non-SSLC schools; and multilevel analysis of school-level data on SSLC Hubs, Affiliates and ACARA like-schools. Key findings from this work are that: • SSLC school leaders and teachers are reporting progress in changing school ethos around issues of: recognition of Indigenous identity, Indigenous leadership, innovative approaches to staffing and school models, Indigenous community engagement and high expectations leadership; • Many Stronger Smarter messages are reportedly having better uptake in schools with high percentages of Indigenous students; • There are no major or consistent patterns of differences between SSLC and non-SSLC schools in teacher and school leader self-reports of curriculum and pedagogy practices; and • There is no evidence to date that SSLC Hubs and Affiliates have increased attendance or increased achievement gains compared to ACARA like-schools. Twenty-one months is relatively early in this school reform project. Hence the major focus of subsequent reports will be on the documentation of comparative longitudinal gains in achievement tests and improved attendance. The 2011 and 2012 research also will model the relationships between change in school ethos/climate, changed Indigenous community relations, improved curriculum/pedagogy, and gains in Indigenous student achievement, attendance and outcomes. The key challenge for SSLC and the Stronger Smarter approach will be whether it can systematically generate change and reform in curriculum and pedagogy practices that can be empirically linked to improved student outcomes.