Global and local challenges for best practices in assessment. The 9th Conference on the International Test Commission. Book of abstracts

The 9th International Test Commission Conference (ITC) took place at the Miramar Palace in San Sebastian, Spain, between the 2nd and 5th of July, 2014. The Conference was titled, “Global and Local Challenges for Best Practices in Assessment.” The International Test Commission, ITC (www.intestcom.org), is an association of national psychological associations, test commissions, publishers, and other organizations, as well as individuals who are committed to the promotion of effective testing and assessment policies and to the proper development, evaluation, and uses of educational and psychological instruments. The ITC facilitates the exchange of information among members and stimulates their cooperation on problems related to the construction, distribution, and uses of psychological and educational tests and other psychodiagnostic tools. This volume contains the abstracts of the contributions presented at the 9th International Test Commission Conference. The four themes of the Conference were closely linked to the goals of the ITC: - Challenges and Opportunities in International Assessment. - Application of New Technoloogies and New Psychometric Models in Testing. - Standards and Guidelines for Best Testing Practices. - Testing in Multilingual and Multicultural Contexts.

Team-teaching for inclusive learning: Purposes, practices and perceptions of a team-teaching initiative in Irish post-primary schools

Background. Schools unequivocally privilege solo-teaching. This research seeks to enhance our understanding of team-teaching by examining how two teachers, working in the same classroom at the same time, might or might not contribute to the promotion of inclusive learning. There are well-established policy statements that encourage change and moves towards the use of team-teaching to promote greater inclusion of students with special educational needs in mainstream schools and mainstream classrooms. What is not so well established is the practice of team-teaching in post-primary settings, with little research conducted to date on how it can be initiated and sustained, and a dearth of knowledge on how it impacts upon the students and teachers involved. Research questions and aims. In light of the paucity and inconclusive nature of the research on team-teaching to date (Hattie, 2009), the orientating question in this study asks ‘To what extent, can the introduction of a formal team-teaching initiative enhance the quality of inclusive student learning and teachers’ learning at post-primary level?’ The framing of this question emerges from ongoing political, legal and educational efforts to promote inclusive education. The study has three main aims. The first aim of this study is to gather and represent the voices and experiences of those most closely involved in the introduction of team-teaching; students, teachers, principals and administrators. The second aim is to generate a theory-informed understanding of such collaborative practices and how they may best be implemented in the future. The third aim is to advance our understandings regarding the day-to-day, and moment-to-moment interactions, between teachers and students which enable or inhibit inclusive learning. Sample. In total, 20 team-teaching dyads were formed across seven project schools. The study participants were from two of the seven project schools, Ash and Oak. It involved eight teachers and 53 students, whose age ranged from 12-16 years old, with 4 teachers forming two dyads per school. In Oak there was a class of first years (n=11) with one dyad and a class of transition year students (n=24) with the other dyad. In Ash one class group (n=18) had two dyads. The subjects in which the dyads engaged were English and Mathematics. Method. This research adopted an interpretive paradigm. The duration of the fieldwork was from April 2007 to June 2008. Research methodologies included semi-structured interviews (n=44), classroom observation (n=20), attendance at monthly teacher meetings (n=6), questionnaires and other data gathering practices which included school documentation, assessment findings and joint examination of student work samples (n=4). Results. Team-teaching involves changing normative practices, and involves placing both demands and opportunities before those who occupy classrooms (teachers and students) and before those who determine who should occupy these classrooms (principals and district administrators). This research shows how team-teaching has the potential to promote inclusive learning, and when implemented appropriately, can impact positively upon the learning experiences of both teachers and students. The results are outlined in two chapters. In chapter four, Social Capital Theory is used in framing the data, the change process of bonding, bridging and linking, and in capturing what the collaborative action of team-teaching means, asks and offers teachers; within classes, between classes, between schools and within the wider educational community. In chapter five, Positioning Theory deductively assists in revealing the moment-to-moment, dynamic and inclusive learning opportunities, that are made available to students through team-teaching. In this chapter a number of vignettes are chosen to illustrate such learning opportunities. These two theories help to reveal the counter-narrative that team-teaching offers, regarding how both teachers and students teach and learn. This counter-narrative can extend beyond the field of special education and include alternatives to the manner in which professional development is understood, implemented, and sustained in schools and classrooms. Team-teaching repositions teachers and students to engage with one another in an atmosphere that capitalises upon and builds relational trust and shared cognition. However, as this research study has found, it is wise that the purposes, processes and perceptions of team-teaching are clear to all so that team-teaching can be undertaken by those who are increasingly consciously competent and not merely accidentally adequate. Conclusions. The findings are discussed in the context of the promotion of effective inclusive practices in mainstream settings. I believe that such promotion requires more nuanced understandings of what is being asked of, and offered to, teachers and students. Team-teaching has, and I argue will increasingly have, its place in the repertoire of responses that support effective inclusive learning. To capture and extend such practice requires theoretical frameworks that facilitate iterative journeys between research, policy and practice. Research to date on team-teaching has been too focused on outcomes over short timeframes and not focused enough on the process that is team-teaching. As a consequence team-teaching has been under-used, under-valued, under-theorised and generally not very well understood. Moving from classroom to staff room and district board room, theoretical frameworks used in this research help to travel with, and understand, the initiation, engagement and early consequences of team-teaching within and across the educational landscape. Therefore, conclusions from this study have implications for the triad of research, practice and policy development where efforts to change normative practices can be matched by understandings associated with what it means to try something new/anew, and what it means to say it made a positive difference.

Form-focused instruction in Irish-medium immersion education: a critical examination of teachers' perspectives and practices. A small-scale qualitative case study

It has been suggested that the less than optimal levels of students’ immersion language “persist in part because immersion teachers lack systematic approaches for integrating language into their content instruction” (Tedick, Christian and Fortune, 2011, p.7). I argue that our current lack of knowledge regarding what immersion teachers think, know and believe and what immersion teachers’ actual ‘lived’ experiences are in relation to form-focused instruction (FFI) prevents us from fully understanding the key issues at the core of experiential immersion pedagogy and form-focused integration. FFI refers to “any planned or incidental instructional activity that is intended to induce language learners to pay attention to linguistic form” (Ellis, 2001b, p.1). The central aim of this research study is to critically examine the perspectives and practices of Irish-medium immersion (IMI) teachers in relation to FFI. The study ‘taps’ into the lived experiences of three IMI teachers in three different IMI school contexts and explores FFI from a classroom-based, teacher-informed perspective. Philosophical underpinnings of the interpretive paradigm and critical hermeneutical principles inform and guide the study. A multi-case study approach was adopted and data was gathered through classroom observation, video-stimulated recall and semistructured interviews. Findings revealed that the journey of ‘becoming’ an IMI teacher is shaped by a vast array of intricate variables. IMI teacher identity, implicit theories, stated beliefs, educational biographies and experiences, IMI school cultures and contexts as well as teacher knowledge and competence impacted on IMI teachers’ FFI perspectives and practices. An IMI content teacher identity reflected the teachers’ priorities as shaped by pedagogical challenges and their educational backgrounds. While research participants had clearly defined instructional beliefs and goals, their roadmap of how to actually accomplish these goals was far from clear. IMI teachers described the multitude of choices and pedagogical dilemmas they faced in integrating FFI into experiential pedagogy. Significant gaps in IMI teachers’ declarative knowledge about and competence in the immersion language were also reported. This research study increases our understanding of the complexity of the processes underlying and shaping FFI pedagogy in IMI education. Innovative FFI opportunities for professional development across the continuum of teacher education are outlined, a comprehensive evaluation of IMI is called for and areas for further research are delineated.

Community workers' understandings and practices of resistance

This research is focused on Community Workers located in Southern Ireland, and their understandings and practices of resistance. It is an attempt to explore the ways in which community workers’ understandings and practices of resistance are formed and, in turn, inform their sense of identity and their responses to the wider context of community development work in Ireland today. This study is specifically located but also has wider application and relevance because of the extended international reach of neo-liberal and managerial rationalities, and their implications for politics, policy and practice. The study considers resistance in a number of inter-related ways: as a collective oppositional position (with negative and positive dimensions); a personal and/or professional value (associated with the ‘expansion of contention’); a strategy for negotiating unequal power relations (in a range of levels and spaces of power); an identity (in relation to the sustaining of ‘reflexive subjectivities’); a set of practices, (which take into account the interplay between economic, political and cultural influences); and an educational process through which practitioners assess and enact personal and professional agency. Critical theorisations of community development and of the Irish state over time, trace the ways in which neo-liberalism and managerialism has inflected community development practice and the positions of community workers and communities in that process. The study draws on James C. Scott, Gramsci, Barnes and Prior, among others, which enabled the interrogation of resistance in relation to everyday practices through engaging with ‘hidden transcripts’ and spaces. The method chosen was focus group discussions with three groups of community workers located in different counties in Southern Ireland. This method facilitated a deep discourse analysis of practitioners’ encounters with resistance in the field of community work. Key findings relate to the various interpretations of the role of resistance, practices of resistance (including current restrictions), the value of resistance work and the conditions that may be conducive to practising resistance.

Reception and schooling of children in schools in Catalonia: Beyond Educational Welcome Facilities

The ways of incorporating newcoming students into schools and colleges have been at the center of debate in most OECD countries in recent years. In Spain, the set of measures developed for the reception of immigrant pupils in different Autonomous Communities has also been the subject of specific research, pointing out the similarities and contradictions between pedagogic discourses and school practices. This article takes into account these considerations and presents the reflections from the results of research on the Educational Welcome Facilities (and specifically the EBE) conducted during the school years 2008-2010. This device was created in Catalonia to attend newcomers before enrolling them in the school. It was a pilot project which took place in Vic and Reus for two consecutive years. The research of the EBE has enabled us to explain the relationship between educational assessment that schools made about this facility and reception processes that schools were implementing. The conclusions that emerge from this analysis allowed us to establish relationships between educational host practices of the seven centers analyzed with three different conceptual and educational frameworks of reception.

Pupil participation in school life: an approach from the educational community

The Convention on the Rights of the Child (CRC, 1989) is currently the most ratified international treaty. Several authors have highlighted its potential for both a moral education and citizenship. However, paradoxically, different studies report its limited or occasional incorporation into school practices. This article explores experiences of participation in schools,the third P of the CRC, from the plurality of voices and actors of the educational community,by means of 14 discussion groups in 11 autonomous communities in Spain. Discourse analysis evidence low levels of student participation in school life. But, at the same time, a favorable educational environment for the development of projects that contribute to child participation is found, as well as for the incorporation of the CRC as a mover and a referential integrator of the different schools projects. However, it is also an educational background conductive to projects for its development, such as the incorporation of the CRC as a referential integrator of the schools projects.

How secure is a Newtonian paradigm for psychological and educational measurement?

From the early 1900s, some psychologists have attempted to establish their discipline as a quantitative science. In using quantitative methods to investigate their theories, they adopted their own special definition of measurement of attributes such as cognitive abilities, as though they were quantities of the type encountered in Newtonian science. Joel Michell has presented a carefully reasoned argument that psychological attributes lack additivity, and therefore cannot be quantities in the same way as the attributes of classical Newtonian physics. In the early decades of the 20th century, quantum theory superseded Newtonian mechanics as the best model of physical reality. This paper gives a brief, critical overview of the evolution of current measurement practices in psychology, and suggests the need for a transition from a Newtonian to a quantum theoretical paradigm for psychological measurement. Finally, a case study is presented that considers the implications of a quantum theoretical model for educational measurement. In particular, it is argued that, since the OECD’s Programme for International Student Assessment (PISA) is predicated on a Newtonian conception of measurement, this may constrain the extent to which it can make accurate comparisons of the achievements of different education systems.

A quantum measurement paradigm for educational predicates: Implications for validity in educational measurement

The outcomes of educational assessments undoubtedly have real implications for students, teachers, schools and education in the widest sense. Assessment results are, for example, used to award qualifications that determine future educational or vocational pathways of students. The results obtained by students in assessments are also used to gauge individual teacher quality, to hold schools to account for the standards achieved by their students, and to compare international education systems. Given the current high-stakes nature of educational assessment, it is imperative that the measurement practices involved have stable philosophical foundations. However, this paper casts doubt on the theoretical underpinnings of contemporary educational measurement models. Aspects of Wittgenstein’s later philosophy and Bohr’s philosophy of quantum theory are used to argue that a quantum theoretical rather than a Newtonian model is appropriate for educational measurement, and the associated implications for the concept of validity are elucidated. Whilst it is acknowledged that the transition to a quantum theoretical framework would not lead to the demise of educational assessment, it is argued that, where practical, current high-stakes assessments should be reformed to become as ‘low-stakes’ as possible. The paper also undermines some of the pro high-stakes testing rhetoric that has a tendency to afflict education.

Educational characteristics of adult students in portuguese technological schools

Despite a massive expansion of education in Portugal, since the 1970’s, educational attainment of the adult population in the country remains low. The numbers of working-age people in some form of continuing education are among the lowest, according to the OECD and EU-27 statistics. Technological Schools(TS), initially created in the 1990’s, under the umbrella of the Ministry of Economy in partnership with industry and industrial associations, aimed to prepare qualified staff for industries and services in the country, particularly in the engineering sector, through the provision of post secondary non-university programmes of studies, the CET (Technological Specialization Courses). Successful CET students are awarded a DET(Diploma of Technological Specialization), which corresponds to Vocational Qualification level IV of the EU, according to the latest alteration (2005) of the Education Systems Act (introduced in 1986). In this, CET’s are also clearly defined as one of the routes for access to Higher Education (HE), in Portugal. The PRILHE (Promoting Reflective and Independent Learning in Higher Education) multinational project, funded by the European Socrates Grundtvig Programme, aimed to identify the learning processes which enable adult students in higher education to become autonomous reflective learners and search best practices to support these learning processes. During this research, both quantitative and qualitative methods were used to determine how students organise their studies and develop their learning skills. The Portuguese partner in the project’ consortium used a two case studies approach, one with students of Higher Education Institutions and other with students of TS. This paper only applies to students of TS, as these have a predominant bias towards engineering. Results show that student motivation and professional teaching support contribute equally to the development of an autonomous and reflective approach to learning in adult students; this is essential for success in a knowledge economy, where lifelong learning is the key to continuous employment.

Educational issues perceived by expectant lesbian couples /

Despite the increasing public profile of lesbian childbearing, public health resources for expectant women often bear heterosexist assumptions and create barriers to accessing information relevant to lesbian mothering experiences. This descriptive, exploratory study examined one lesbian couple's perceived educational needs for effective support, barriers to access, strategies for locating care, and the impact of childbearing on their lives, as well as their reflections on inviting ways to offer supportive practices in a public health context. A case study approach used feminist ethnographic methodology and purposeful convenience sampling. A prenatal and a postnatal open-ended interview were completed with 1 white, middle-class, able, lesbian childbearing couple, each ofwhom has birthed as coparent and biological mother in this couple relationship. Despite this couple's immense situated privilege, they struggled to locate the support they sought for childbearing in a way that offered optimal emotional and physical care from the preconceptual to postpartum stages and which maintained confidentiality or anonymity as desired. They created meaningful care through personal networks. The findings were framed using invitational and feminist theories: how people, places, programs, processes, policies, and politics contributed to educational support. A three part conceptual framework emerged which identified components of access to support: perceived safety of resources, disclosure status, situated privilege, and public or private availability of information. The consequences of lack of public access to comprehensive childbearing care for lesbian women and their communities are described. Educational possibilities addressed systemic heterosexism through the development of sensitive educators, meaningful curriculum, program planning, explicit policies, community partnerships, and political leadership with respect to both institutional and research venues.

Examining current facilitative practices and projections of activity-based physical education degree programs regarding the participation of individuals with disabilties /

Individuals with disabiliiies are increasingly accessing post secondary education opportunities to further develop their educational and career goals. This study examines the current facilitative practices of Canadian university activity-based physical education degree programs on the participation of individuals with disabilities. A critical orientation and descriptive/interpretative approach allows insight into unique stories and experiences of physical education practitioners and special needs professionals as they attempt to provide equitable educational experiences within a least restrictive environment. Leading practitioners are used to triangulate and strengthen the validity of the data while providing direction and advocacy for future development and inclusion of individuals with disabilities. The study concludes with seven recommendations, each providing university activity-based physical education degree programs with viable opportunities for helping create equitable opportunities for individuals with disabilities.

Opening a can of worms : perceptions and practices of teachers in Newfoundland and Labrador incorporating the role of a therapist

Educational trends of inclusion and collaboration have led to changing roles of teachers, including an emphasis on personal support. To provide for social, emotional, and behavioural needs, teachers may adopt a therapeutic role. Many models for such support are proposed, with most models including the importance of student-teacher relationships, a focus on social, emotional, and behavioural development, and direct instruction of related skills. This study includes 20 interview participants. In addition, 4 of the 20 interview participants also took part in a case study. It examines whether participants adopt a therapeutic role, their beliefs about student-teacher relationships, whether they provide interventions in personal issues, and instructed social, emotional, and behaviour skills. Findings show that teachers adopt an academic role as well as a therapeutic role, believe student-teacher relationships are important, are approached about personal issues, and instruct social, emotional, and behavioural skills. Talking and listening are commonly used to provide support, typically exclusive of formal curricular goals. The challenges in providing front-line support issues that may be shared within an established student-teacher relationship are considered. Support in turn for teachers who choose to provide support for personal issues in the classroom within a therapeutic role are suggested, including recommendations for support and referral related to specific social, emotional, or behavioural scenarios that may arise in the school community.

A study on the role of the parent in educational decision making from the perspective of parents and teachers

ADeweyan (1916) democratic theoty ofeducation called for the participation ofall citizens in deliberating important educational issues to improve overall student learning. Thus, the move to include parents in educational decision making can be considered to be rooted in democratic principles. To gain greater insight into the issue ofparent involvement in educational decision making, one elementary school was studied and a triangulization method was employed in an attempt to clarify the important issues surrolUlding the move to include parents in the governance ofschools. The three methods to gain information included surveys, interviews, and documentation ofsignificant school events and related work. All ofthe parents and teachers ofthe school were surveyed, 10 parents and 6teachers were interviewed, and related school events were recorded. The survey design was modeled on the Parent Involvement Questionnaire (PIQ) created and reported on by Chavkin and Williams (1987). The results ofthe surveys were used as a guide for the interview questions. An interview outline was developed based on Seidman's (1991) open-ended approach and Patton's (1980) standardized open-ended interview style in which parents and teachers were asked about their experiences and opinions on anmnber ofparent involvement issues. Parents and teachers in this school indicated agreater interest in becoming more aware ofeducational issues such as school budget and school discipline policies. Although the parents indicated agreater interest in school matters and the teachers indicated awillingness to include parents in school matters, both the parents and teachers in this study perceived the role ofthe parent as advisory, not decision making. It was concluded that to ensure ameaningful and functional role for parellts as tlleir p811icipatioll ill educational matters evolves, SCllools must have a clear vision ofthe primary goal ofall schools, namely, to foster and nourish democratic citizens for ademocratic society (Glickman, 1993). Furthennore, intentional practices such as Purkey's (ad) 5-P Relay approach, based on a democratic theory and practice of education, will have to be employed in order to give parents an authentic voice in educational matters and provide an avenue for parents to acquire the necessary skills and lmowledge needed to do so. As schools, school boards, and the Ministry ofEducation implement parent involvement guidelines and policies, developmental needs ofeach school need to be considered to ensure the employment ofdemocratic practices not authoritarian mandates. Parent interest and involvement, at whatever level, should be an important element in the overall move to make schools part ofthe democratic society they were meant to be.