Validation of the Item-Attribute Matrix in TIMSS-Mathematics Using Multiple Regression and the LSDM

The purposes of this study were (1) to validate of the item-attribute matrix using two levels of attributes (Level 1 attributes and Level 2 sub-attributes), and (2) through retrofitting the diagnostic models to the mathematics test of the Trends in International Mathematics and Science Study (TIMSS), to evaluate the construct validity of TIMSS mathematics assessment by comparing the results of two assessment booklets. Item data were extracted from Booklets 2 and 3 for the 8th grade in TIMSS 2007, which included a total of 49 mathematics items and every student's response to every item. The study developed three categories of attributes at two levels: content, cognitive process (TIMSS or new), and comprehensive cognitive process (or IT) based on the TIMSS assessment framework, cognitive procedures, and item type. At level one, there were 4 content attributes (number, algebra, geometry, and data and chance), 3 TIMSS process attributes (knowing, applying, and reasoning), and 4 new process attributes (identifying, computing, judging, and reasoning). At level two, the level 1 attributes were further divided into 32 sub-attributes. There was only one level of IT attributes (multiple steps/responses, complexity, and constructed-response). Twelve Q-matrices (4 originally specified, 4 random, and 4 revised) were investigated with eleven Q-matrix models (QM1 ~ QM11) using multiple regression and the least squares distance method (LSDM). Comprehensive analyses indicated that the proposed Q-matrices explained most of the variance in item difficulty (i.e., 64% to 81%). The cognitive process attributes contributed to the item difficulties more than the content attributes, and the IT attributes contributed much more than both the content and process attributes. The new retrofitted process attributes explained the items better than the TIMSS process attributes. Results generated from the level 1 attributes and the level 2 attributes were consistent. Most attributes could be used to recover students' performance, but some attributes' probabilities showed unreasonable patterns. The analysis approaches could not demonstrate if the same construct validity was supported across booklets. The proposed attributes and Q-matrices explained the items of Booklet 2 better than the items of Booklet 3. The specified Q-matrices explained the items better than the random Q-matrices.

The effect of the use of computer assisted instruction (CAI) on attitudes and computational scores of developmental mathematics students at two inner city schools with predominantly Black enrollment

This study examined the effects of computer assisted instruction (CAI) 1 hour per week for 18 weeks on changes in computational scores and attitudes of developmental mathematics students at schools with predominantly Black enrollment. Comparisons were made between students using CAI with differing software--PLATO, CSR or both together--and students using traditional instruction (TI) only.^ This study was conducted in the Dade County Public School System from February through June 1991, at two senior high schools. The dependent variables, the State Student Assessment Test (SSAT), and the School Subjects Attitude Scales (SSAS), measured students' computational scores and attitudes toward mathematics in 3 categories: interest, usefulness, and difficulty, respectively.^ Univariate analyses of variance were performed on the least squares mean differences from pretest to posttest for testing main effects and interactions. A t-test measured significant main effects and interactions. Results were interpreted at the.01 level of significance.^ Null hypotheses 1, 2, and 3 compared versions of CAI with the control group, for changes in mathematical computation scores measured with the SSAT. It could not be concluded that changes in standardized mathematics test scores of students using CAI with differing software 1 hour per week for 18 class hours combined with TI were significantly higher than changes in test scores for students receiving TI only.^ Null hypotheses 4, 5, and 6 tested the effects of CAI for attitudes toward mathematics for experimental groups against control groups measured with the SSAS. Changes in attitudes toward mathematics of students using CAI with differing software 1 hour per week for 18 class hours combined with TI were not significantly higher than attitude changes for students receiving TI only.^ Teacher effect on students' computational scores was a more influential variable than CAI. No interaction was found between gender and learning method on standardized mathematics test scores (null hypothesis 7). ^

The effects of the use of technology in mathematics instruction on student achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

The Effects of the Use of Technology In Mathematics Instruction on Student Achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

Coneixement lingüístic i matemàtic d'escolars de nivel sociocultural baix en programes d'immersió = Linguistic and mathematic knowledge in pupils of low sociocultural level in immersiom programmes

This piece of research compares knowledge of Catalan, Castilian and mathematics, as well as the attitudes to these two languages, of a sample of non-Catalan speaking pupils of low sociocultural level in their fourth year of primary school. Some of the pupils had followed an immersion programme in Catalan, whereas others had approached Catalan through their habitual language (Castilian). The findings show that not only did the immersion pupils obtain significantly better results in L2 (Catalan), but their mother tongue (Castilian) competence was undiminished and their performance on the mathematics test was superior to that of the other group. Moreover, the findings indicate that in pupils starting out from less favourable conditions (a low sociocultural level and a low I.Q.) the effect of the educational approach variable is greater than in other cases

Canad?? : informe de evaluaci??n nacional

Resumen del autor. Resumen en castellano y en ingl??s. Este art??culo se incluye en el monogr??fico 'Sistemas nacionales de evaluaci??n'

Um estudo sobre as relações entre atitudes, gênero e desempenho de alunos do ensino médio em atividades envolvendo frações

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Effects of academic integration on the persistence and achievement of under-prepared college students

The purpose of this dissertation was to examine the effect of academic integration, defined in terms of instructor/student contact, on the persistence of under-prepared college students and the achievement of those who persist. The overall design of this study compared instructor-initiated contact with conventional contact. The dependent variables were persistence, achievement, motivation and anxiety. Information was collected by administering the College-Level Mathematics Test (CLM), the Perceived Affective Contact Questionnaire (PAC), the expectancy and anxiety components of the Motivated Strategies for Learning Questionnaire (MSLQ), a departmental final examination, and by accessing university records. The sample consisted of 130 college algebra students at a large, public university with a Hispanic majority. The main analyses consisted of a 2 x 2 x 2 ANOVA (treatment by ethnicity by gender) to test for differences in achievement, t-tests to compare motivation, anxiety and perceived affective contact scores for the two groups, Chi-square tests to assess differences in persistence, and Pearson Product-Moment Correlation to determine the relationship between pretest scores and achievement variables. Results indicated that neither instructor-initiated contact, gender nor ethnicity is related to persistence, motivation or anxiety. A significant disordinal interaction of treatment and ethnicity was observed, with Hispanic experimental students scoring significantly higher on a test of algebra achievement than Hispanic control students. ^ Academic integration, defined in terms of instructor/student contact, has a positive influence on the achievement of Hispanic students. This may imply their positive responsiveness to the relational aspect of contact due to traditional cultural values of interdependence, acquiescence to authority and physical closeness. Such interactive feedback is a means by which students with these values are recognized as members of the university academic community, prompting increased academic effort. Training in contact initiation to promote academic integration is implied, by the results of this study, for instructors dealing with first year students, especially instructors at institutions accommodating instructional methods to the needs of diverse groups. ^

Effects of academic integration on the persistence and achievement of under-prepared college students

The purpose of this dissertation was to examine the effect of academic integration, defined in terms of instructor/student contact, on the persistence of under-prepared college students and the achievement of those who persist. The overall design of this study compared instructor-initiated contact with conventional contact. The dependent variables were persistence, achievement, motivation and anxiety. Information was collected by administering the College-Level Mathematics Test (CLM), the Perceived Affective Contact Questionnaire (PAC), the expectancy and anxiety components of the Motivated Strategies for Learning Questionnaire (MSLQ), a departmental final examination, and by accessing university records. The sample consisted of 130 college algebra students at a large, public university with a Hispanic majority. The main analyses consisted of a 2x2x2 ANOVA (treatment by ethnicity by gender) to test for differences in achievement, t-tests to compare motivation, anxiety and perceived affective contact scores for the two groups, Chi-square tests to assess differences in persistence, and Pearson Product-Moment Correlation to determine the relationship between pretest scores and achievement variables. Results indicated that neither instructor-initiated contact, gender nor ethnicity is related to persistence, motivation or anxiety. A significant disordinal interaction of treatment and ethnicity was observed, with Hispanic experimental students scoring significantly higher on a test of algebra achievement than Hispanic control students. Academic integration, defined in terms of instructor/student contact, has a positive influence on the achievement of Hispanic students. This may imply their positive responsiveness to the relational aspect of contact due to traditional cultural values of interdependence, acquiescence to authority and physical closeness. Such interactive feedback is a means by which students with these values are recognized as members of the university academic community, prompting increased academic effort. Training in contact initiation to promote academic integration is implied, by the results of this study, for instructors dealing with first year students, especially instructors at institutions accommodating instructional methods to the needs of diverse groups.

Gender bias in the Trends in Mathematics and Science Study 2003 (TIMMS) for Canadian students /

This study is a secondary data analysis of the Trends in Mathematics and Science Study 2003 (TIMSS) to determine if there is a gender bias, unbalanced number of items suited to the cognitive skill of one gender, and to compare performance by location. Results of the Grade 8, math portion of the test were examined. Items were coded as verbal, spatial, verbal /spatial or neither and as conventional or unconventional. A Kruskal- Wallis was completed for each category, comparing performance of students from Ontario, Quebec, and Singapore. A Factor Analysis was completed to determine if there were item categories with similar characteristics. Gender differences favouring males were found in the verbal conventional category for Canadian students and in the spatial conventional category for students in Quebec. The greatest differences were by location, as students in Singapore outperformed students from Canada in all areas except for the spatial unconventional category. Finally, whether an item is conventional or unconventional is more important than whether the item is verbal or spatial. Results show the importance of fair assessment for the genders in both the classroom and on standardized tests.

A Model of a Diagnostic Test for Controlling the Results of a Computer Based Education in Applied Mathematics at the University of Ruse

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2015

A relationship between the Florida Comprehensive Assessment Test 2.0 mathematics scores and racial and ethnic concentration when considering socio-economic status, ESOL student population, and school climate

From the moment children are born, they begin a lifetime journey of learning about themselves and their surroundings. With the establishment of the No Child Left Behind Act of 2001, it mandates that all children receive a high-quality education in a positive school climate. Regardless of the school the child attends or the neighborhood in which the child lives, proper and quality education and resources must be provided and made available in order for the child to be academically successful. The purpose of this ex post facto study was to investigate the relationship between the FCAT 2.0 mathematics scores of public middle school students in Miami-Dade County, Florida and the concentrations of a school's racial and ethnic make-up (Whites, Blacks, and Hispanics), English for Speakers of other Languages (ESOL) population, socio-economic status (SES), and school climate. The research question of this study was: Is there a significant relationship between the FCAT 2.0 Mathematics scores and racial and ethnic concentration of public middle school students in Miami-Dade County when controlling SES, ESOL student population, and school climate for the 2010-2011 school year? The instruments used to collect the data were the FCAT 2.0 and Miami-Dade County Public Schools (M-DCPS) School Climate Survey. The study found that Economically Disadvantaged (SES) students socio-economic status had the strongest correlation with the FCAT 2.0 mathematics scores (r = -.830). The next strongest correlation was with the number of students who agreed that their school climate was positive and helped them learn (r = .741) and the third strongest correlation was a school percentage of White students (r = .668). The study concluded that the FCAT 2.0 mathematics scores of M-DCPS middle school students have a significant relationship with socio-economic status, school climate, and racial concentration.

Dissimilitudes entre les contenus géométriques du manuel scolaire mathématiques de 8e année en Iran et le test international du TIMSS 2011

Les résultats de la cinquième réalisation de l’étude de TIMSS en 2011 montrent la présence d’un faible rendement des élèves iraniens en mathématiques par rapport à la moyenne internationale. Plusieurs facteurs peuvent être à la source de ce faible rendement : programmes d’études, caractéristiques de l’école, qualité des ressources éducatives fournies à l’école ou accessibles aux élèves hors de l’école, etc. (Mullis et coll., 2009; 2012; Coleman et coll., 1966). Ce mémoire est une tentative d’identifier les points faibles probables du contenu géométrique du manuel scolaire de mathématiques de 8e année de l’Iran, en considérant les exigences de TIMSS 2011. Dans cette perspective, cette recherche se focalise sur trois axes d’analyse : la répartition des contenus géométriques dans le manuel des mathématiques, la manière de présenter les concepts et les niveaux de raisonnement exigés par les problèmes du test et par les activités du manuel. L’analyse des résultats obtenus nous a permis de constater plusieurs divergences. Au niveau de la présence des connaissances géométriques, 9 % des connaissances nécessaires à la résolution des questions de TIMSS 2011 sont absentes du manuel. Quant à la présentation des connaissances, 27 % des connaissances sont présentées implicitement dans les manuels. L’utilisation de la grille d’analyse du niveau de raisonnement exigé par les tâches géométriques (Tanguay, 2000), montre que le manuel manque d’exercices mettant en jeu le développement des expériences mentales (35 %). Selon la théorie de Van Hiele (1959), l’insuffisance d’expériences nécessaires pour le développement de la pensée géométrique aux niveaux visuel, descriptif et analytique influencera la construction des concepts et la réussite dans la résolution des problèmes.

Investigating problem-based learning in Saudi Arabian mathematics education: a TIMSS-related study

The aim of this study is to investigate the effectiveness of problem-based learning (PBL) on students’ mathematical performance. This includes mathematics achievement and students’ attitudes towards mathematics for third and eighth grade students in Saudi Arabia. Mathematics achievement includes, knowing, applying, and reasoning domains, while students’ attitudes towards mathematics covers, ‘Like learning mathematics’, ‘value mathematics’, and ‘a confidence to learn mathematics’. This study goes deeper to examine the interaction of a PBL teaching strategy, with trained face-to-face and self-directed learning teachers, on students’ performance (mathematics achievement and attitudes towards mathematics). It also examines the interaction between different ability levels of students (high and low levels) with a PBL teaching strategy (with trained face-to-face or self-directed learning teachers) on students’ performance. It draws upon findings and techniques of the TIMSS international benchmarking studies. Mixed methods are used to analyse the quasi-experimental study data. One -way ANOVA, Mixed ANOVA, and paired t-tests models are used to analyse quantitative data, while a semi-structured interview with teachers, and author’s observations are used to enrich understanding of PBL and mathematical performance. The findings show that the PBL teaching strategy significantly improves students’ knowledge application, and is better than the traditional teaching methods among third grade students. This improvement, however, occurred only with the trained face-to-face teacher’s group. Furthermore, there is robust evidence that using a PBL teaching strategy could raise significantly students’ liking of learning mathematics, and confidence to learn mathematics, more than traditional teaching methods among third grade students. Howe ver, there was no evidence that PBL could improve students’ performance (mathematics achievement and attitudes towards mathematics), more than traditional teaching methods, among eighth grade students. In 8th grade, the findings for low achieving students show significant improvement compared to high achieving students, whether PBL is applied or not. However, for 3th grade students, no significant difference in mathematical achievement between high and low achieving students was found. The results were not expected for high achieving students and this is also discussed. The implications of these findings for mathematics education in Saudi Arabia are considered.