Predictability in high-stakes examinations: students' perspectives on a perennial assessment dilemma

Key debates within educational assessment continuously encourage us to reflect on the design, delivery and implementation of examination systems as well as their relevance to students. In more recent times, such reflections have also required a rethinking of who is authoritative about assessment issues and whose views we seek in order to better understand these perennial assessment dilemmas. This paper considers one such dilemma, predictability in high-stakes assessment, and presents students’ perspectives on this issue. The context is the Irish Leaving Certificate (LC) taken by upper secondary students (aged between 16 and 18) in order (mainly) to enter tertiary-level education. The data come from 13 group interviews with 81 students across a range of schools in Ireland. Listening to students about complex, high-stakes examining problems has a limited history within the educational assessment literature. The findings from the study address this shortcoming and depict how students’ insightful reflections can improve our understanding of these dilemmas. Further, students are more than able to reflect on their own situations with regard to high stakes examining contexts and have important contributions to make to our fuller understanding of those elements that will promote high quality and fair assessment.

Indoor air quality in elementary schools of Lisbon and Aveiro

Tem havido uma preocupação crescente com a qualidade do ar interior (QAI) nas escolas em muitos países. Muitos estudos epidemiológicos têm encontrado diferenças regionais entre ambientes interiores. Apesar da elevada incidência de asma e rinite na população infantil, praticamente nada se sabia sobre a QAI em escolas portuguesas. A percepção dos problemas de QAI é crucial para avaliar os riscos para a saúde e rendimento dos estudantes, e para sugerir meios de reduzir a exposição a poluentes indesejáveis. Neste estudo procurou-se obter as concentrações de poluentes de interesse em estabelecimentos de ensino do 1º ciclo de Lisboa e Aveiro, estimar o estado atual de casos de asma e rinite em escolas primárias da capital, avaliar a influência de diferentes materiais das salas de aula/construção e hábitos escolares na QAI, identificar potenciais fontes de poluentes nos interiores e exteriores das salas de aula e propor medidas mitigadoras. Catorze escolas de Lisboa foram visitadas para obter a caracterização física das construções em termos de estrutura, ventilação, materiais de acabamento, produtos de limpeza, densidade de ocupação e potenciais fontes interiores de poluição. Os estudantes foram questionados sobre os seus hábitos e sintomas respiratórios através de inquéritos do modelo ISAAC (International Study of Asthma and Allergies in Childhood). Durante a primavera, outono e inverno (2008-2010), nas salas de aula e pátios, foram monitorizados, por amostragem passiva, compostos orgânicos voláteis (COVs), carbonilos e dióxido de azoto (NO2). Foram também medidos parâmetros de conforto e níveis de microrganismos. Duas escolas localizadas, uma no centro da cidade e outra na região suburbana, em Aveiro foram estudadas em 2010. Parâmetros de conforto, microrganismos, COVs, NO2, material particulado (PM10) foram medidos no interior e no exterior de ambas escolas. Os iões solúveis, carbono orgânico e elementar (OC e EC), e compostos orgânicos presentes no material particulado foram subsequentemente analisados em laboratório. Uma medida mitigadora - fitoremediação - foi avaliada na escola do centro da cidade de Aveiro em 2011. Os resultados do estudo mostraram que a QAI é pior do que a do ar exterior. Em geral, os níveis de CO2 e dos bioaerosóis excederam os níveis máximos aceitáveis para o conforto dos ocupantes estipulado pelas regulamentações portuguesas. Quase todos os COVs e carbonilos identificados mostraram razões interior/exterior (I/E) maiores que uma unidade, o que demonstra a importante contribuição de fontes interiores em todas as escolas. As razões I/E das concentrações de NO2 nunca excederam a unidade. Os níveis interiores diários de PM10 foram sempre maiores que os exteriores, exceto nos fins de semana. Após a colocação de plantas numa das salas de aula, observou-se uma redução estatisticamente significativa nos níveis de CO2, COVs, carbonilos, PM10, OC, e dos iões nitrato, sulfato, amónia, cálcio e carbonato. A possível redução dos níveis de poluentes no interior após a colocação de plantas pode representar uma solução de baixo custo para reduzir a exposição a muitos compostos, melhorar o rendimento e aumentar o bem estar dos alunos e professores em sala de aula.

The Educational and Employment Aspirations of Adolescents from Areas of High Deprivation in London

Adolescents from areas of high deprivation are often assumed to have low aspirations for the future. However, recent research has suggested otherwise and there have been calls for more substantial investigation into the relationship between poverty and aspiration. This article reports levels and variation in aspiration from 1,214 adolescents (49.5% male; 50.5% female) living in areas of high deprivation across 20 London boroughs. A strength of this study is our large and diverse population of low socio-economic status (SES) adolescents, comprising of white British (22%), black African (21%), black Caribbean (9%), Indian/Pakistani/Bangladeshi/Other Asian (24%), mixed ethnicity (9%), and 15% defining themselves as Other. Our measures indicated a high group level of reported aspiration with notable variations. Females reported higher educational (but not occupational) aspirations than males; white British students reported lower educational and occupational aspirations than other ethnic groups; and black African children reported the highest educational aspirations. Perceived parental support for education had the largest positive association with aspirations. In contrast to previous findings from studies carried out in the United States, aspirations were found to be negatively associated with perceptions of school and school peer environment. These measures explored feelings of safety, happiness and belonging within the school environment and school peer group. We discuss possible explanations for this unexpected finding within our population of adolescents from UK state schools and how it might affect future policy interventions. This study makes an important contribution to the literature on adolescent aspirations because of the unique nature of the data sample and the multiple domains of functioning and aspiration measured.

An Exploration of the Use of Coaching and Mentoring in the Supervision of Doctoral Students in UK University Business Schools

Purpose: to consider and evaluate the student and supervisor experience of doctoral supervision (dyadic and triadic) and specifically the value of using coaching and mentoring approaches (process and relationship) in supervisory practice. Design/methodology/approach: phase one is a mixed methods study exploring the use of coaching and mentoring in doctoral supervision on traditional and taught doctoral programmes in one UK university business school. The focus is on developing a conceptual model for doctoral supervisory practice for the transfer of learning and the improvement of practice. Phase two will be a collaborative action research study in a range of UK university business schools to use, reflect on and refine the conceptual model of supervision. Findings: the initial findings from phase one will be reported on at the conference presentation. Research limitations/implications: we have tentative agreements from four UK university business schools for phase two (subject to ethics approval). Practical implications: students and supervisors participating in the research will benefit from having the opportunity to review and improve their practice; the participating business schools will have the opportunity to review and potentially revise their doctoral student and supervisor training; and a business school’s reputation for high quality doctoral supervision could be enhanced. Social implications: could potentially benefit numerous future students and supervisors across a wide range of UK university business schools. Originality/value: there does not appear to be any previously published research on the use of coaching and mentoring in doctoral supervision in UK university business schools for the transfer of learning and improvement of practice.

Quality time: exploring meaningful mandatory community involvement programs in secondary schools /

The purpose of this study was to explore the experiences of 5 stakeholder groups—students, parents, community organization representatives, guidance counsellors, and secondary school principals—in dealing with a mandatory secondary school graduation requirement in Ontario. The requirement is that students must complete 40 hours of eligible community involvement activities during their high school years in order to graduate. Ten stakeholders were interviewed regarding the nature of the community involvement program, what makes it work, and suggestions for improvement. The study found that although this program has the potential to provide a meaningful experience for students, and students are seen to gain from their experience in multiple ways, it depends substantially on the commitment of students, educators, and community organizations to make it worthwhile. Stakeholders recommended changes to the current program, which included making it a more structured process that would increase the consistency ofhow this program is implemented, finding ways to curb cheating and to reduce the administrative burden on schools, having more support from the Ontario provincial government and Ontario Ministry of Education and Training in the promotion and communication of this program, and developing partnerships between community organizations and schools to enrich the application of this program. This study concludes with a recommendation that the Ontario Ministry of Education and Training consider introducing Service-Learning, a curriculum-based experiential service and learning process, as an enhancement to the current community involvement program.

A cognitive schematic paradigm for expository essay writing in secondary schools

The methodology outlined in this study for teaching exposit ory writing to advanced (five year phase) grade eleven students is based on the assumption that writing as a problem solving strategy is a high level cognitive skill . In adhering to this assumption, a cognitively based schematic organizer known as a cross-classification chart was tested for its effectiveness a t the planning stage of the writing process . Results were not significant in any of the three components that were evaluated; however , a post- hoc analysis undertaken because of recorded observed data indicated a significant difference in the mean score on the Organization component for the treatment subgroup using the cross- classification organizer . Furthermore, the treatment group's positive response from the attitude survey towards planning writing is encouraging enough that replication and extension of the application of schema theory to wri ting should be pursued in cross-section and longitud i nal studies.

Participation factors in optional high school health and physical education

Student enrolment rates in optional health and physical education (HPE) classes have been steadily declining, to the point where most Ontario students stop taking HPE after completion of their one required credit, typically taken in grade nine. This study looked at factors that could contribute to HPE enrolment, sampling 227 grade ten students from five schools. These factors included selfefficacy (SE), perceived autonomy support (PAS), task value (TV), motivational regulation (autonomous, AR; controlled, CR), HPE grade average and body size discrepancy (BSD). Qualitative information was also gathered from students regarding likes and dislikes ofHPE, as well as reasons for their HPE enrolment choice. Cronbach Alpha values of each scale fell within acceptable values. ANOVA analysis revealed differences between enrolment groups in SE, TV, AR, HPE grade average, and BSD (p < .05). Reasons students reported for not taking HPE included a dislike of health classes, scheduling challenges, not needing HPE for future endeavors, concerns about social self-presentation, and a dislike of sports and/or competition. This research shows important differences between students and their HPE class choices and calls for a re-evaluation of how HPE classes are structured, advertised and scheduled by high school practitioners. Future works should look toward what other factors could be at play in students' decisions for or against optional HPE and how those factors interact with the constructs that were found to be of significance in this study. Keywords: Health and physical education, high school students, participation.

Creating a Generation of Upstanders: Curriculum Resource to Help Ontario Educators Build Safe Schools

This project focuses on the bullying found in the 21st century elementary classrooms, more specifically in grades 4-8. These grades were found to have high levels of bullying because of major shifts in a student’s life that may place a student of this age at risk for problems with their peer relationships (Totura et al., 2009). Supporting the findings in the literature review, this handbook was created for Ontario grade 4-8 classroom teachers. The resource educates teachers on current knowledge of classroom bullying, and provides them with information and resources to share with their students so that they can create a culture of upstanders. Upstanders are students who stand up for the victims of bullying, and have the self-esteem and strategies to stand up to classroom bullies. These upstanders, with the support of their classroom teachers and their peers, will be a force strong enough to build the government-mandated Safe School environment.

Creating a Generation of Upstanders: Curriculum Resource to Help Ontario Educators Build Safe Schools

This project focuses on the bullying found in the 21st century elementary classrooms, more specifically in grades 4-8. These grades were found to have high levels of bullying because of major shifts in a student’s life that may place a student of this age at risk for problems with their peer relationships (Totura et al., 2009). Supporting the findings in the literature review, this handbook was created for an Ontario grade 4-8 classroom teachers. The resource educates teachers on current knowledge of classroom bullying, and provides them with information and resources to share with their students so that they can create a culture of upstanders. Upstanders are students who stand up for the victims of bullying, and have the self-esteem and strategies to stand up to classroom bullies. These upstanders, with the support of their classroom teachers and their peers, will be a force strong enough to build the government-mandated Safe School environment.

A qualitative study of curriculum and instructional efforts in relation to high stakes federal and district policies in one low-performing elementary school

Les enjeux liés aux politiques éducatives ont considérablement changé au cours des dernières décennies. Ces changements sont liés, entre autres, à l’accroissement de l’imputabilité et de la reddition de compte qui est devenue une caractéristique importante des réformes curriculaires et pédagogiques. Les politiques à enjeux élevés exercent une pression énorme sur les districts et les écoles états-unienne afin qu’ils augmentent le rendement des élèves en utilisant des systèmes de conséquences (Hall & Ryan, 2011; Loeb & Strunk, 2007). Ces politiques envoient de puissants messages sur l'importance de certaines matières scolaires au détriment d'autres - circonscrivant les exigences en termes de compétences et de connaissances. La langue maternelle d’enseignement et les mathématiques sont devenues des mesures centrales sur lesquelles reposent l’évaluation et le degré de performance des districts et des écoles. Conséquemment, les administrateurs de districts et les directions d’écoles ont souvent recours à des réformes curriculaires et pédagogiques comme moyen d'augmenter le rendement des élèves dans les matières scolaires visées par ces politiques. Les politiques contraignent les acteurs scolaires de concentrer les ressources sur les programmes curriculaires et les évaluations, le développement professionnel, et la prise de décision pilotée par les données (Anagnostopoulos & Ruthledge, 2007; Honig & Hatch, 2004; Spillane, Diamond, et al., 2002; Weitz White & Rosenbaum, 2008). Cette thèse examine la manière dont les politiques à enjeux élevés opèrent quotidiennement dans les interactions et les pratiques au sein des écoles. Nous analysons plus particulièrement les différents messages provenant de la politique transmis aux acteurs scolaires sur les manières d'apporter des changements substantiels dans le curriculum et l'enseignement. Nous élargissons l’analyse en prenant en compte le rôle des administrateurs de district ainsi que des partenaires universitaires qui façonnent également la manière dont certains aspects des messages provenant des politiques sont transmis, négociés et/ou débattus et d’autres sont ignorés (Coburn & Woulfin, 2012). En utilisant l’analyse de discours, nous examinons le rôle du langage comme constituant et médiateur des interactions sociales entre les acteurs scolaires et d’autres parties prenantes. De telles analyses impliquent une investigation approfondie d’un nombre d’étude de cas limité. Les données utilisées dans cette thèse ont été colligées dans une école primaire états-unienne du mid-West. Cette étude de cas fait partie d’une étude longitudinale de quatre ans qui comprenait huit écoles dans les milieux urbains entre 1999 et 2003 (Distributed Leadership Studies, http://www.distributedleadership.org). La base de données analysée inclut des observations de réunions formelles et des entrevues auprès des administrateurs du district, des partenaires universitaires, de la direction d’école et des enseignants. En plus de l’introduction et de la problématique (chapitre 1) et de discussion et conclusion (chapitre 5), cette thèse comprend un ensemble de trois articles interdépendants. Dans le premier article (chapitre 2), nous effectuons une recension des écrits portant sur le domaine de l’implantation de politiques (policy implementation) et la complexité des relations locales, nationales et internationales dans les systèmes éducatifs. Pour démystifier cette complexité, nous portons une attention particulière à la construction de sens des acteurs scolaires comme étant une dimension clé du processus de mise en œuvre des réformes. Dans le deuxième article (chapitre 3), nous cherchons à comprendre les processus sociaux qui façonnent les réponses stratégiques des acteurs scolaires à l’égard des politiques du district et de l’état et en lien avec la mise en œuvre d’un curriculum prescrit en mathématiques. Plus particulièrement, nous explorons les différentes situations dans lesquelles les acteurs scolaires argumentent au sujet des changements curriculaires et pédagogiques proposés par les administrateurs de district et des partenaires universitaires afin d’augmenter les résultats scolaires en mathématiques dans une école à faible performance. Dans le troisième article (chapitre 4), nous cherchons à démystifier les complexités liées à l’amélioration de l’enseignement dans un environnement de politiques à enjeux élevés. Pour ce faire, nous utilisons l'interaction entre les notions d'agentivité et la structure afin d'analyser la manière dont les conceptions d’imputabilité et les idées qui découlent de l'environnement politique et les activités quotidiennes jouent dans les interactions entre les acteurs scolaires concernant sur l’enseignement de la langue maternelle. Nous explorons trois objectifs spécifiques : 1) la manière dont les politiques à enjeux élevés façonnent les éléments de l’enseignement qui sont reproduits et ceux qui sont transformés au fil du temps ; 2) la manière dont la compréhension des leaders de l’imputabilité façonne les aspects des messages politiques que les acteurs scolaires remarquent à travers les interactions et les conversations et 3) la manière les acteurs scolaires portent une attention particulière à certaines messages au détriment d’autres. Dans le dernier chapitre de cette thèse, nous discutons les forces et les limites de l’analyse secondaire de données qualitatives, les implications des résultats pour le domaine d’études de l’implantation de politiques et les pistes futures de recherches.

The differential effect on dropout of increasing grades' supply by integrating or expanding schools: evidence from a quasi-experiment in Bogotá

En el año 2002, la Secretaría de Educación de Bogotá estipuló la Resolución 2101 que tenía por objeto asegurar el ciclo de la educación completo en los colegios públicos. El propósito de este trabajo es evaluar el impacto de los mecanismos seguidos a la aplicación de esta política sobre la tasa de deserción escolar. Las escuelas tenían tres mecanismos diferentes para alcanzar el objetivo de la presente resolución: expandir los grados escolares ofertados, integrarse con otros colegios de la zona, o ambos. Para ello, utilizo variables instrumentales para resolver el sesgo causado por el hecho de que los colegios que siguen determinada estrategia eran los que tenían altas tasas de deserción inicialmente. Usando datos sobre las características institucionales y las características socio-demográficas de la población cerca del colegio, evalúo el impacto de estos tres mecanismos sobre las tasas de deserción escolar. Los resultados sugieren que las instituciones que aumentaron los grados experimentan un aumento en el número de estudiantes que abandonan el colegio en 12.1 puntos porcentuales, mientras que las instituciones que complementaron este mecanismo con la integración de un colegio próximo pre existente mostraron una reducción en la tasa de deserción escolar de 9.8 puntos porcentuales.

Impact on the quality of learning as a result of the use of computers in schools

The educational software and computer assisted learning has been used in schools to promote the interest of students in new ways of thinking and learning so it can be useful in the reading learning process. Experimental studies performed in preschool and school age population have shown a better yield and a positive effect in reading, mathematics and cognitive skills in children who use educative software for fi fteen to twenty minutes a day periods. The goal of this study was to evaluate the progression in verbal, visual-motor integration and reading skills in children who were using educational software to compare them with a group in traditional pedagogic methodology. Results: All children were evaluated before using any kind of pedagogic approach. Initial evaluation revealed a lower–age score in all applied test. 11% of them were at high risk for learning disorders. There was a second evaluation that showed a significant positive change compared with the fi rst one. Nevertheless, despite some items, there were no general differences comparing the groups according if they were using or not a computer. In conclusion, policies on using educational software and computers must be revaluated due to the fact that children in our public schools come from a deprived environment with a lack of opportunities to use technologies.

Habilidades sociales y acoso escolar : un estudio en centros de Enseñanza Secundaria de Madrid. 'Social skills and school bullyng : a study in Secondary Schools in Madrid'.

Resumen tomado de la publicación. Con el apoyo económico del departamento MIDE de la UNED

Ventilation rates in schools and pupil’s performance using computerized assessment tests

Research shows that poor indoor air quality (IAQ) in school buildings can cause a reduction in the students’ performance assessed by short-term computer-based tests; whereas good air quality in classrooms can enhance children's concentration and also teachers’ productivity. Investigation of air quality in classrooms helps us to characterise pollutant levels and implement corrective measures. Outdoor pollution, ventilation equipment, furnishings, and human activities affect IAQ. In school classrooms, the occupancy density is high (1.8–2.4 m2/person) compared to offices (10 m2/person). Ventilation systems expend energy and there is a trend to save energy by reducing ventilation rates. We need to establish the minimum acceptable level of fresh air required for the health of the occupants. This paper describes a project, which will aim to investigate the effect of IAQ and ventilation rates on pupils’ performance and health using psychological tests. The aim is to recommend suitable ventilation rates for classrooms and examine the suitability of the air quality guidelines for classrooms. The air quality, ventilation rates and pupils’ performance in classrooms will be evaluated in parallel measurements. In addition, Visual Analogue Scales will be used to assess subjective perception of the classroom environment and SBS symptoms. Pupil performance will be measured with Computerised Assessment Tests (CAT), and Pen and Paper Performance Tasks while physical parameters of the classroom environment will be recorded using an advanced data logging system. A total number of 20 primary schools in the Reading area are expected to participate in the present investigation, and the pupils participating in this study will be within the age group of 9–11 years. On completion of the project, based on the overall data recommendations for suitable ventilation rates for schools will be formulated.

Ventilation rates in schools

Research shows that poor indoor air quality in school buildings can cause a reduction in the students' performance assessed by short term computer based tests; whereas good air quality in classrooms can enhance children's concentration and also teachers' productivity. Investigation of air quality in classrooms helps us to characterise pollutant levels and implement corrective measures. Outdoor pollution, ventilation equipment, furnishings, and human activities affect indoor air quality. In school classrooms the occupancy density is high (1.8 to 2.4 m(2)/person) compared to offices (10 m(2) /person). Ventilation systems expend energy and there is a trend to save energy by reducing ventilation rates. We need to establish the minimum acceptable level of fresh air required for the health of the occupants. This paper describes a project which will aim to investigate the effect of indoor air quality and ventilation rates on pupils' performance and health using psychological tests. The aim is to recommend suitable ventilation rates for classrooms and examine the suitability of the air quality guidelines for classrooms.