Validation of the Item-Attribute Matrix in TIMSS-Mathematics Using Multiple Regression and the LSDM

The purposes of this study were (1) to validate of the item-attribute matrix using two levels of attributes (Level 1 attributes and Level 2 sub-attributes), and (2) through retrofitting the diagnostic models to the mathematics test of the Trends in International Mathematics and Science Study (TIMSS), to evaluate the construct validity of TIMSS mathematics assessment by comparing the results of two assessment booklets. Item data were extracted from Booklets 2 and 3 for the 8th grade in TIMSS 2007, which included a total of 49 mathematics items and every student's response to every item. The study developed three categories of attributes at two levels: content, cognitive process (TIMSS or new), and comprehensive cognitive process (or IT) based on the TIMSS assessment framework, cognitive procedures, and item type. At level one, there were 4 content attributes (number, algebra, geometry, and data and chance), 3 TIMSS process attributes (knowing, applying, and reasoning), and 4 new process attributes (identifying, computing, judging, and reasoning). At level two, the level 1 attributes were further divided into 32 sub-attributes. There was only one level of IT attributes (multiple steps/responses, complexity, and constructed-response). Twelve Q-matrices (4 originally specified, 4 random, and 4 revised) were investigated with eleven Q-matrix models (QM1 ~ QM11) using multiple regression and the least squares distance method (LSDM). Comprehensive analyses indicated that the proposed Q-matrices explained most of the variance in item difficulty (i.e., 64% to 81%). The cognitive process attributes contributed to the item difficulties more than the content attributes, and the IT attributes contributed much more than both the content and process attributes. The new retrofitted process attributes explained the items better than the TIMSS process attributes. Results generated from the level 1 attributes and the level 2 attributes were consistent. Most attributes could be used to recover students' performance, but some attributes' probabilities showed unreasonable patterns. The analysis approaches could not demonstrate if the same construct validity was supported across booklets. The proposed attributes and Q-matrices explained the items of Booklet 2 better than the items of Booklet 3. The specified Q-matrices explained the items better than the random Q-matrices.

Are systemizing and autistic traits related to talent and interest in mathematics and engineering? Testing some of the central claims of the empathizing-systemizing theory.

In two experiments, we tested some of the central claims of the empathizing-systemizing (E-S) theory. Experiment 1 showed that the systemizing quotient (SQ) was unrelated to performance on a mathematics test, although it was correlated with statistics-related attitudes, self-efficacy, and anxiety. In Experiment 2, systemizing skills, and gender differences in these skills, were more strongly related to spatial thinking styles than to SQ. In fact, when we partialled the effect of spatial thinking styles, SQ was no longer related to systemizing skills. Additionally, there was no relationship between the Autism Spectrum Quotient (AQ) and the SQ, or skills and interest in mathematics and mechanical reasoning. We discuss the implications of our findings for the E-S theory, and for understanding the autistic cognitive profile.

The effect of the use of computer assisted instruction (CAI) on attitudes and computational scores of developmental mathematics students at two inner city schools with predominantly Black enrollment

This study examined the effects of computer assisted instruction (CAI) 1 hour per week for 18 weeks on changes in computational scores and attitudes of developmental mathematics students at schools with predominantly Black enrollment. Comparisons were made between students using CAI with differing software--PLATO, CSR or both together--and students using traditional instruction (TI) only.^ This study was conducted in the Dade County Public School System from February through June 1991, at two senior high schools. The dependent variables, the State Student Assessment Test (SSAT), and the School Subjects Attitude Scales (SSAS), measured students' computational scores and attitudes toward mathematics in 3 categories: interest, usefulness, and difficulty, respectively.^ Univariate analyses of variance were performed on the least squares mean differences from pretest to posttest for testing main effects and interactions. A t-test measured significant main effects and interactions. Results were interpreted at the.01 level of significance.^ Null hypotheses 1, 2, and 3 compared versions of CAI with the control group, for changes in mathematical computation scores measured with the SSAT. It could not be concluded that changes in standardized mathematics test scores of students using CAI with differing software 1 hour per week for 18 class hours combined with TI were significantly higher than changes in test scores for students receiving TI only.^ Null hypotheses 4, 5, and 6 tested the effects of CAI for attitudes toward mathematics for experimental groups against control groups measured with the SSAS. Changes in attitudes toward mathematics of students using CAI with differing software 1 hour per week for 18 class hours combined with TI were not significantly higher than attitude changes for students receiving TI only.^ Teacher effect on students' computational scores was a more influential variable than CAI. No interaction was found between gender and learning method on standardized mathematics test scores (null hypothesis 7). ^

The effects of the use of technology in mathematics instruction on student achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

The Effects of the Use of Technology In Mathematics Instruction on Student Achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

Understanding Parental Influence on Educational Outcomes Among 9 Year Olds in Ireland: The Mediating Role of Resources, Attitudes and Children's Own Perspectives

The relationship between parental background and children's educational outcomes has been a dominant theme within the sociology of education. There has been an on-going debate as to the relative merits of explanations which focus on the role of socio-cultural reproduction and those which focus on rational choice. However, many empirical studies within the social stratification tradition fail to allow for children's own agency in shaping the relationship between social background and schooling outcomes. This paper draws on the first wave of a large-scale longitudinal study of over 8,000 nine-year-old children in Ireland, which combines information from parents, school principals, teachers and children themselves. Both social class and parental education are found to have significant effects on reading and mathematics test scores among nine year olds. These effects are partly mediated by home-based educational resources and activities, parents' educational expectations for their child, and parents' formal involvement in the school. More importantly, children's own engagement with, and attitudes to, school significantly influence their academic performance. The influence of children's own attitudes and actions can thus reinforce or mitigate the effect of social background factors. The analysis therefore provides a bridge between the large body of research on the intergenerational transmission of inequality and the emerging research and policy literature on children's rights.

A Pilot Study of Reciprocal Peer Tutoring in Irish Medium Schools

A pilot study to investigate the effects of mathematics peer tutoring in Irish medium primary schools was undertaken. Five schools and 90 students took part in the pilot. Materials and resources that had previously been shown to work in English medium Scottish schools were translated into Irish by CCEA. Irish medium teachers attended three professional development days. Teachers implemented the peer tutoring techniques during mathematics lessons during a period of 16 weeks. Changes in attainment were measures with an Irish translation of the Scottish Survey of Achievement Mathematics Test. Results were positive. Student attainment was significantly raised during the 16-week implementation period by over one standard deviation. This equated to one-year’s worth of mathematics development during this time period. Results must be treated with caution. No control group was used in the pilot study. However, results are very promising and indicate that reciprocal role peer tutoring may be a useful pedagogy in Irish medium education. Further work would be required to establish this definitively.

Effect of providing free glasses on children's educational outcomes in China: cluster randomized controlled trial

Objective: To assess the effect of provision of free glasses on academic performance in rural Chinese children with myopia. Design: Cluster randomized, investigator masked, controlled trial.Setting 252 primary schools in two prefectures in western China, 2012-13. Participants: 3177 of 19 934 children in fourth and fifth grades (mean age 10.5 years) with visual acuity <6/12 in either eye without glasses correctable to >6/12 with glasses. 3052 (96.0%) completed the study.Interventions Children were randomized by school (84 schools per arm) to one of three interventions at the beginning of the school year: prescription for glasses only (control group), vouchers for free glasses at a local facility, or free glasses provided in class. Main outcome measures: Spectacle wear at endline examination and end of year score on a specially designed mathematics test, adjusted for baseline score and expressed in standard deviations. Results: Among 3177 eligible children, 1036 (32.6%) were randomized to control, 988 (31.1%) to vouchers, and 1153 (36.3%) to free glasses in class. All eligible children would benefit from glasses, but only 15% wore them at baseline. At closeout glasses wear was 41% (observed) and 68% (self reported) in the free glasses group, and 26% (observed) and 37% (self reported) in the controls. Effect on test score was 0.11 SD (95% confidence interval 0.01 to 0.21) when the free glasses group was compared with the control group. The adjusted effect of providing free glasses (0.10, 0.002 to 0.19) was greater than parental education (0.03, −0.04 to 0.09) or family wealth (0.01, −0.06 to 0.08). This difference between groups was significant, but was smaller than the prespecified 0.20 SD difference that the study was powered to detect. Conclusions: The provision of free glasses to Chinese children with myopia improves children’s performance on mathematics testing to a statistically significant degree, despite imperfect compliance, although the observed difference between groups was smaller than the study was originally designed to detect. Myopia is common and rarely corrected in this setting. Trial Registration: Current Controlled Trials ISRCTN03252665.

Canad?? : informe de evaluaci??n nacional

Resumen del autor. Resumen en castellano y en ingl??s. Este art??culo se incluye en el monogr??fico 'Sistemas nacionales de evaluaci??n'

Um estudo sobre as relações entre atitudes, gênero e desempenho de alunos do ensino médio em atividades envolvendo frações

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Effects of academic integration on the persistence and achievement of under-prepared college students

The purpose of this dissertation was to examine the effect of academic integration, defined in terms of instructor/student contact, on the persistence of under-prepared college students and the achievement of those who persist. The overall design of this study compared instructor-initiated contact with conventional contact. The dependent variables were persistence, achievement, motivation and anxiety. Information was collected by administering the College-Level Mathematics Test (CLM), the Perceived Affective Contact Questionnaire (PAC), the expectancy and anxiety components of the Motivated Strategies for Learning Questionnaire (MSLQ), a departmental final examination, and by accessing university records. The sample consisted of 130 college algebra students at a large, public university with a Hispanic majority. The main analyses consisted of a 2 x 2 x 2 ANOVA (treatment by ethnicity by gender) to test for differences in achievement, t-tests to compare motivation, anxiety and perceived affective contact scores for the two groups, Chi-square tests to assess differences in persistence, and Pearson Product-Moment Correlation to determine the relationship between pretest scores and achievement variables. Results indicated that neither instructor-initiated contact, gender nor ethnicity is related to persistence, motivation or anxiety. A significant disordinal interaction of treatment and ethnicity was observed, with Hispanic experimental students scoring significantly higher on a test of algebra achievement than Hispanic control students. ^ Academic integration, defined in terms of instructor/student contact, has a positive influence on the achievement of Hispanic students. This may imply their positive responsiveness to the relational aspect of contact due to traditional cultural values of interdependence, acquiescence to authority and physical closeness. Such interactive feedback is a means by which students with these values are recognized as members of the university academic community, prompting increased academic effort. Training in contact initiation to promote academic integration is implied, by the results of this study, for instructors dealing with first year students, especially instructors at institutions accommodating instructional methods to the needs of diverse groups. ^

Effects of academic integration on the persistence and achievement of under-prepared college students

The purpose of this dissertation was to examine the effect of academic integration, defined in terms of instructor/student contact, on the persistence of under-prepared college students and the achievement of those who persist. The overall design of this study compared instructor-initiated contact with conventional contact. The dependent variables were persistence, achievement, motivation and anxiety. Information was collected by administering the College-Level Mathematics Test (CLM), the Perceived Affective Contact Questionnaire (PAC), the expectancy and anxiety components of the Motivated Strategies for Learning Questionnaire (MSLQ), a departmental final examination, and by accessing university records. The sample consisted of 130 college algebra students at a large, public university with a Hispanic majority. The main analyses consisted of a 2x2x2 ANOVA (treatment by ethnicity by gender) to test for differences in achievement, t-tests to compare motivation, anxiety and perceived affective contact scores for the two groups, Chi-square tests to assess differences in persistence, and Pearson Product-Moment Correlation to determine the relationship between pretest scores and achievement variables. Results indicated that neither instructor-initiated contact, gender nor ethnicity is related to persistence, motivation or anxiety. A significant disordinal interaction of treatment and ethnicity was observed, with Hispanic experimental students scoring significantly higher on a test of algebra achievement than Hispanic control students. Academic integration, defined in terms of instructor/student contact, has a positive influence on the achievement of Hispanic students. This may imply their positive responsiveness to the relational aspect of contact due to traditional cultural values of interdependence, acquiescence to authority and physical closeness. Such interactive feedback is a means by which students with these values are recognized as members of the university academic community, prompting increased academic effort. Training in contact initiation to promote academic integration is implied, by the results of this study, for instructors dealing with first year students, especially instructors at institutions accommodating instructional methods to the needs of diverse groups.

The inclusion of geography in TIMSS: Can consensus be reached?

An initial call by the editors of International Research in Geographical and Environmental Education (IRGEE) prompted a study about the inclusion of geography in the Trends in International Mathematics and Science Study (TIMSS) tests. This study found that the geography education community were overwhelmingly in favour of such a move, believing that the information collected would be valuable in enhancing learning outcomes through its impact on research, policy and teaching practice (Lane & Bourke, 2016). However, a number of questions about the development and implementation of this assessment were posed. This paper addresses two of these questions: (1) What is the global geographical education community’s views about Grades 4 and 8 as target year levels for the assessment?; and, (2) What types of knowledge and cognitive dimensions would they like to see assessed? Based on these findings, the overarching key question that requires further discussion is: Can there be some degree of consensus in terms of what should be assessed and how the test should be implemented?

Proyecto "mete" (mathematics education traditions of europe): el foco matemático

Este artículo presenta los resultados de un estudio sobre las tradiciones de enseñanza en cuatro países europeos: Bélgica (Flandes), Inglaterra, Hungría y España. Se trata de un estudio a pequeña escala en el que se emplean métodos cuantitativos y cualitativos, y que, en lugar de pretender obtener generalizaciones, está orientado a arrojar alguna luz que posibilite la mejora de la enseñanza y el aprendizaje de las matemáticas. Establece comparaciones con los resultados de los test TIMSS y PISA y extrae alguna conclusión para la formación inicial de maestros y profesores de matemáticas. Extraemos de éste los resultados relativos a los datos cuantitativos y nos centramos en el foco matemático.

Calibration of assessment instruments – classification in mathematics at the Universidad Jorge Tadeo Lozano

Item Response Theory, IRT, is a valuable methodology for analyzing the quality of the instruments utilized in assessment of academic achievement. This article presents an implementation of the mentioned theory, particularly of the Rasch model, in order to calibrate items and the instrument used in the classification test for the Basic Mathematics subject at Universidad Jorge Tadeo Lozano. 509 responses chains of students, obtained in the june 2011 application, were analyzed with a set of 45 items, through eight case studies that are showing progressive steps of calibration. Criteria of validity of items and of whole instrument were defined and utilized, to select groups of responses chains and items that were finally used in the determination of parameters which then allowed the classification of assessed students by the test.