Consulting pupils in Assessment for Learning classrooms: the twists and turns of working with students as co-researchers

This is an invited paper to a special issue on pupil voice focusing on methodological issues arising from the ESRC/TLRP project on consulting pupils about assessment practices in their classrooms. The issue of consulting pupils about assessment has rarely been researched before but what this article illustrates are some of the difficulties, tensions and positive outcomes of engaging with students as researchers within a nationally funded (and therefore externally driven), university-based project. This study adds considerably to the body of knowledge in this area by engaging students in the process as researchers in different capacities within the project. Issues discussed include the use of student advisory groups, ethical negotiation, students undertaking videotaped classroom observations and their subsequent role in co-interpreting video excerpts and visual images. The paper has attracted considerable interest already through the ESRC pupil seminar series forum and also from a prior paper presentation to the European Educational Research Association in September 2006 in Switzerland to the Childrens' Rights SIG becasue of researchers' current interests in embedding democratic principles and practices within research with children and young people.

At-risk students and classroom engagement : listening to “voices of possibility and hope"

In my work with secondary school students who have disengaged from mainstream classrooms, I have often been surprised at the ways they enthusiastically engage with the projects on offer. They have demonstrated that, in apparent contradiction of their classroom behaviour, they still maintain hope in achieving a positive outcome from education. In a long-running schools-university project employing a “students-as-researchers” approach to investigating educational disadvantage, “at-risk” students have produced high quality results. Naturally, I wanted to know what it was about this sort of pedagogy that seemed to work for them. In this chapter, then, I outline the project and discuss some reasons for disengagement. I then address the features of the project that the participants themselves have identified as being instrumental in their re-engagement with formal education. Finally, I consider how these features may be transposed to maintaining the educational engagement of at-risk students in mainstream classrooms.

Marginalised students and insider knowledge

One of the claims made for valuing the voices of marginalised students is that an insider perspective can be revealed on student issues and the ways in which education policies and systems impact on them. This chapter examines the ways in which participants in an Australian ‘students-as-researchers’ (SaR) project were able to raise knowledge of and address, to some extent, long-standing issues of racism in their schools. The SaR project has operated in more than thirty schools for periods of one to five years. Based on a participatory action research model, groups of secondary school students from schools serving socio-economically disadvantaged communities have worked with nominated teachers and university researchers to identify and research local issues relating to low academic outcomes and to develop and enact responses to the identified concerns. The voices of marginalised students quoted in this chapter illustrate that important insider knowledge can be revealed through the SaR process. Where student views have been acknowledged and acted on by the schools, significant change to student-teacher relationships and school culture has been achieved; the participants have been personally empowered and academic improvements across the schools have been noted. For such change to occur, however, a culture of mutual respect must be created in which teachers and school administrators value students’ views and are open to the possibility of unfavourable criticism.

Education for social responsibility: Ethics and imagination for engaging students and teachers in educational reform

In this chapter we make assumptions about the primary role of education for the life of its beneficiaries and for society. Undoubtedly, formal education plays an important role in enhancing the likelihood for participation in future social life, including enjoyment and employment, by the student as well as the development of the well being of society in general. Similarly, education is often seen as a main means for intergenerational transmission of knowledge and culture. However, as Dewey (1916) argues, in liberal societies, education has the capacity of enhancing democratic participation in society that goes beyond passive participation by its members. One can argue that the achievement of the ideals of democracy demands a free and strong education system. In other words, while education can function as an instrument to integrate students into the present society, it also has the potential to become an instrument for its transformation by means of which citizens can develop an understanding of how their society functions and a sense of agency towards its transformation. Arguably, this is what Freire (1985) meant when he talked about the role of education to “read and write” the world. A stream of progressive educators (e.g., Apple (2004), Freire, (1985), Giroux (2001) and McLaren (2002)) taught us that the reading of the world that is capable of leading into writing the world is a critical reading; i.e., a reading that poses “Why” questions and imagines “What else can be” (Carr & Kemmis, 1987).

Using automated text analysis to evaluate students’ conceptual understanding

Background: A major challenge for assessing students’ conceptual understanding of STEM subjects is the capacity of assessment tools to reliably and robustly evaluate student thinking and reasoning. Multiple-choice tests are typically used to assess student learning and are designed to include distractors that can indicate students’ incomplete understanding of a topic or concept based on which distractor the student selects. However, these tests fail to provide the critical information uncovering the how and why of students’ reasoning for their multiple-choice selections. Open-ended or structured response questions are one method for capturing higher level thinking, but are often costly in terms of time and attention to properly assess student responses. Purpose: The goal of this study is to evaluate methods for automatically assessing open-ended responses, e.g. students’ written explanations and reasoning for multiple-choice selections. Design/Method: We incorporated an open response component for an online signals and systems multiple-choice test to capture written explanations of students’ selections. The effectiveness of an automated approach for identifying and assessing student conceptual understanding was evaluated by comparing results of lexical analysis software packages (Leximancer and NVivo) to expert human analysis of student responses. In order to understand and delineate the process for effectively analysing text provided by students, the researchers evaluated strengths and weakness for both the human and automated approaches. Results: Human and automated analyses revealed both correct and incorrect associations for certain conceptual areas. For some questions, that were not anticipated or included in the distractor selections, showing how multiple-choice questions alone fail to capture the comprehensive picture of student understanding. The comparison of textual analysis methods revealed the capability of automated lexical analysis software to assist in the identification of concepts and their relationships for large textual data sets. We also identified several challenges to using automated analysis as well as the manual and computer-assisted analysis. Conclusions: This study highlighted the usefulness incorporating and analysing students’ reasoning or explanations in understanding how students think about certain conceptual ideas. The ultimate value of automating the evaluation of written explanations is that it can be applied more frequently and at various stages of instruction to formatively evaluate conceptual understanding and engage students in reflective

Decolonising the concept of knowledge

Controlling the definition of what was essentially a subjugated culture, the colonisers reserve the power to distinguish authentic aspects of the living traditions of the colonised. If the colonised argue political demands by reference to their culture, the colonisers are quick to adjudicate what is genuine in such claims. (Fannon, 1967) Since colonial invasions, Australia’s Indigenous people have weathered rapid change. While the origins of Australia’s Indigenous peoples continues to be an archaeological interest for many, how Indigenous cultures have survived, transformed and retained a sense of ‘difference’ is fundamental to understanding the diversity of Aboriginal and Torres Strait Islander cultures within this continent as both contemporaneous and historical. It is important that teachers, students and researchers within Indigenous studies remind themselves that much of the literature on Aboriginal and Torres Strait Islanders can be ideologically traced back to the emergence of ‘knowledge’ about native peoples in the context of European imperialism and expansion from the fifteenth century. Care must therefore be taken in not conveying ‘scientific’ rational knowledge as perhaps the hidden agenda or notion of assumptions of European ‘superiority’ and non-European inferiority. The recognition by the High Court of Australia (1992) abandoned the legal myth of terra nullius which based the dispossession of Indigenous land on the basis of it being considered an empty land. It could also be argued that this decision recognised that distinct customs and traditions continue to exist within the social and cultural ‘knowledge’ of Indigenous peoples of Australia. General issues and concerns relating to research design, methodology and articulation within QUT are not just confined to this university and the research project presented as a case study but are important in dealing with how Aboriginal and Torres Strait Islander students and academics participate or are employed within the university. We feel that the design and methodology of research that either covertly or overtly focuses on Indigenous Australians can no longer presume that all research will naturally follow protocols that are culturally appropriate as this appropriateness is usually defined by the institution. By no means do we feel that research should be debilitated as a result of raising these issues, but that collaborative approaches within the ‘process’ of research will address Aboriginal and Torres Strait Islander people and communities as much as the intended outcomes of research itself.

Visuacy, imagination, and engagement

Australia’s National Review of Visual Education (DEEWR, 2009) asserts the primacy of visual language ability, or ‘visuacy” in problem-solving. This paper reports on a recent university/schools research project with ‘at risk’ middle school students in which visuacy was promoted as a primary medium for obtaining data relating to issues of immediate concern to the students. Using a students-as-researchers approach, the project investigated middle school students’ perspectives on school engagement and disengagement. In this project, novice researchers used a variety of data gathering methods including photography, video interviews and drawn images as well as more traditional verbal methods, such as interviews, and quantitative methods, such as questionnaires. Engaging student imagination was a key focus of the approach taken by the project, acknowledging that student participants may be reluctant to enter dialogue with teachers and researchers on matters to which they have previously had little input. Students who have previously been marginalized and prevented from contributing their voices to educational forums often have difficulty in adjusting to the novelty of collaborative research with adults (Rudduck, 2003) and may be uncertain of their own place in the relationship that defines teacher/student interactions. It is argued that the project’s promotion of visuacy, alongside more traditional literacies and numeracy in education research, helped to overcome these concerns, engaged the imaginations of the student researchers, and provided a medium for the expression of the voices of marginalised young people.

Young people, imagination and re-engagement in the middle years

This article reports on the first stage of a study that uses Young People as Researchers methodology to investigate the phenomenon of middle-year student disengagement. The study obtains student perspectives on the meanings of engagement and disengagement using a variety of innovative research methods. The first stage of the study focused on a two-day workshop giving students and teachers an overview of the project and providing training and experience in conducting research in their schools. The process employed by the study provides spaces and resources for critical thinking and encourages imaginative responses to the real life problems confronting the students and their peers and affecting their educational engagement. This article describes ways in which engagement is viewed both theoretically and through the empirical work of the student researchers, and how various applications of ‘disciplined imagination’ connect with methods of investigating and understanding engagement.

Destination brand positions of a competitive set of near-home destinations

Although the branding literature commenced during the 1940s, the first publications related to destination branding did not emerge until half a century later. A review of 74 destination branding publications by 102 authors from the first 10 years of destination branding literature (1998-2007) found at least nine potential research gaps warranting attention by researchers. In particular, there has been a lack of research examining the extent to which brand positioning campaigns have been successful in enhancing brand equity in the manner intended in the brand identity. The purpose of this paper is to report the results of an investigation of brand equity tracking for a competitive set of destinations in Queensland, Australia between 2003 and 2007. A hierarchy of consumer-based brand equity (CBBE) provided an effective means to monitor destination brand positions over time. A key implication of the results was the finding that there was no change in brand positions for any of the five destinations over the four year period. This leads to the proposition that destination position change within a competitive set will only occur slowly over a long period of time. The tabulation of 74 destination branding case studies, research papers, conceptual papers and web content analyses provides students and researchers with a useful resource on the current state of the field.

Tow Takes on the Critical

This important volume on the critical pedagogical approach addresses such topics as critical multiculturalism, gender and language learning, and popular culture. Critical pedagogies are instructional approaches aimed at transforming existing social relations in the interest of greater equity in schools and communities. This paperback edition on the pedagogical approach addresses such topics as critical multiculturalism, gender and language learning, and popular culture. Committed to language education that contributes to social justice - and the political, economic, and sociocultural changes such justice requires - the contributors explore the meaning of creating equitable and critical instructional practices, by exploring diverse representations of knowledge. In addition, recommendations are made for further research, teacher education, and critical testing. Graduate students and researchers in TESOL, applied linguistics, and education will find this volume a thought-provoking and comprehensive presentation of theory and practice in this important new area of scholarship.

Preface [From The Third Knowledge City World Summit 2010 proceedings]

‘Knowledge’ is a resource, which relies on the past for a better future. In the 21st century, more than ever before, cities around the world depend on the knowledge of their citizens, their institutions and their firms and enterprises. The knowledge image, the human competence and the reputation of their public and private institutions and corporations profiles a city. It attracts investment, qualified labour and professionals, as well as students and researchers. And it creates local life spaces and professional milieus, which offer the quality of life to the citizens that are seeking to cope with the challenges of modern life in a competitive world. Integrating knowledge-based development in urban strategies and policies, beyond the provision of schools and locations for higher education, has become a new ambitious arena of city politics. Coming from theory to practice, and bringing together the manifold knowledge stakeholders in a city and preparing joint visions for the knowledge city is a new challenge for city managers, urban planners and leaders of the civic society . It requires visionary power, creativity, holistic thinking, the willingness to cooperate with all groups of the local civil society, and the capability to moderate communication processes to overcome conflicts and to develop joint action for a sustainable future.

From classroom resistance to school reform

In the project described in this chapter, a group of educationally disengaged high school students investigated their peers' perspectives of factors related to low aspiration for and access to university. On the basis of their findings, they created an informative DVD to address the student needs.

Reshaping Doctoral Education : International Approaches and Pedagogies

The number of doctorates being awarded around the world has almost doubled over the last ten years, propelling it from a small elite enterprise into a large and ever growing international market. Within the context of increasing numbers of doctoral students this book examines the new doctorate environment and the challenges it is starting to face. Drawing on research from around the world the individual authors contribute to a previously under-represented focus of theorising the emerging practices of doctoral education and the shape of change in this arena. Key aspects, expertly discussed by contributors from the UK, USA, Australia, New Zealand, China, South Africa, Sweden and Denmark include: -the changing nature of doctoral education -the need for systematic and principled accounts of doctoral pedagogies -the importance of disciplinary specificity -the relationship between pedagogy and knowledge generation -issues of transdisciplinarity. Reshaping Doctoral Education provides rich accounts of traditional and more innovative pedagogical practices within a range of doctoral systems in different disciplines, professional fields and geographical locations, providing the reader with a trustworthy and scholarly platform from which to design the doctoral experience. It will prove an essential resource for anyone involved in doctorate studies, whether as students, supervisors, researchers, administrators, teachers or mentors.

Imagination for re-engagement from the margins of education

For marginalised secondary school students, mainstream education may no longer appear to be an inviting place. While proposed solutions to problems of disengagement and marginalisation appear to concentrate on finding ways to coerce students back to mainstream education through, for example, ‘learning or earning’ legislation, this article suggests that more effective solutions may be found by engaging with the students in the margins that they occupy. Following discussion of key influences on student disengagement and a theory of imaginations, a ‘students-as-researchers’ (SaR) model of working with young people is discussed to demonstrate that, through the scaffolded application of active imagination, it is possible for such students to identify and create their own connections to the mainstream. The SaR model is illustrated through reference to groups of disaffected high school students who participated in an action research project to investigate apparent low aspiration for tertiary education among their peers at schools serving low-income communities in Queensland, Australia.

Transforming habitus: Changing self, changing school

Since 2004, Australian Indigenous (Aboriginal and Torres Strait Islander) students at a low socioeconomic area Australian urban secondary school have used participatory action research to investigate issues of disengagement and absenteeism among their peers. Their research revealed that Indigenous students, who made up about 8% to 10% of the school’s population lacked a sense of belonging to the school. The researchers also revealed an apparent official disregard of the academic or sporting achievements of Indigenous students and, more disturbingly, their presence within the school. The young researchers followed up their findings with action to address the issues. These actions have resulted in a positive change of culture across the whole school, with Indigenous students now able to express pride in their heritage and feel some degree of ownership of the school.