Collaborative design of assessment criteria to improve undergraduate student engagement and performance

Student engagement is vital in enhancing the student experience and encouraging deeper learning. Involving students in the design of assessment criteria is one way in which to increase student engagement. In 2011, a marking matrix was used at Aston University (UK) for logbook assessment (Group One) in a project-based learning module. The next cohort of students in 2012 (Group Two) were asked to collaboratively redesign the matrix and were given a questionnaire about the exercise. Group Two initially scored a lower average logbook mark than Group One. However, Group Two showed the greatest improvement between assessments, and the quality of, and commitment to, logbooks was noticeably improved. Student input resulted in a more defined, tougher mark scheme. However, this provided an improved feedback system that gave more scope for self-improvement. The majority of students found the exercise incorporated their ideas, enhanced their understanding, and was useful in itself.

Class placement and academic and behavioral variables as predictors of graduation for students with disabilities

Dropout rates impacting students with high-incidence disabilities in American schools remain staggering (Bost, 2006; Hehir, 2005). Of this group, students with Emotional Behavioral Disorders (EBD) are at greatest risk. Despite the mandated national propagation of inclusion, students with EBD remain the least included and the least successful when included (Bost). Accordingly, this study investigated the potential significance of inclusive settings and other school-related variables within the context of promoting the graduation potential of students with Specific Learning Disabilities (SLD) or EBD. This mixed-methods study investigated specified school-related variables as likely dropout predictors, as well as the existence of first-order interactions among some of the variables. In addition, it portrayed the perspectives of students with SLD or EBD on the school-related variables that promote graduation. Accordingly, the sample was limited to students with SLD or EBD who had graduated or were close to graduation. For the quantitative component the numerical data were analyzed using linear and logistic regressions. For the qualitative component guided student interviews were conducted. Both strands were subsequently analyzed using Ridenour and Newman’s (2008) model where the quantitative hypotheses are tested and are later built-upon by the related qualitative meta-themes. Results indicated that a successful academic history, or obtaining passing grades was the only significant predictor of graduation potential when statistically controlling all the other variables. While at a marginal significance, results also yielded that students with SLD or EBD in inclusive settings experienced better academic results and behavioral outcomes than those in self-contained settings. Specifically, students with SLD or EBD in inclusive settings were found to be more likely to obtain passing grades and less likely to be suspended from school. Generally, the meta-themes yielded during the student interviews corroborated these findings as well as provided extensive insights on how students with disabilities view school within the context of promoting graduation. Based on the results yielded, provided the necessary academic accommodations and adaptations are in place, along with an effective behavioral program, inclusive settings can be utilized as drop-out prevention tools in special education.

A retrospective-longitudinal examination of the relationship between apportionment of seat time in community-college algebra courses and student academic performance

During the past decade, there has been a dramatic increase by postsecondary institutions in providing academic programs and course offerings in a multitude of formats and venues (Biemiller, 2009; Kucsera & Zimmaro, 2010; Lang, 2009; Mangan, 2008). Strategies pertaining to reapportionment of course-delivery seat time have been a major facet of these institutional initiatives; most notably, within many open-door 2-year colleges. Often, these enrollment-management decisions are driven by the desire to increase market-share, optimize the usage of finite facility capacity, and contain costs, especially during these economically turbulent times. So, while enrollments have surged to the point where nearly one in three 18-to-24 year-old U.S. undergraduates are community college students (Pew Research Center, 2009), graduation rates, on average, still remain distressingly low (Complete College America, 2011). Among the learning-theory constructs related to seat-time reapportionment efforts is the cognitive phenomenon commonly referred to as the spacing effect, the degree to which learning is enhanced by a series of shorter, separated sessions as opposed to fewer, more massed episodes. This ex post facto study explored whether seat time in a postsecondary developmental-level algebra course is significantly related to: course success; course-enrollment persistence; and, longitudinally, the time to successfully complete a general-education-level mathematics course. Hierarchical logistic regression and discrete-time survival analysis were used to perform a multi-level, multivariable analysis of a student cohort (N = 3,284) enrolled at a large, multi-campus, urban community college. The subjects were retrospectively tracked over a 2-year longitudinal period. The study found that students in long seat-time classes tended to withdraw earlier and more often than did their peers in short seat-time classes (p < .05). Additionally, a model comprised of nine statistically significant covariates (all with p-values less than .01) was constructed. However, no longitudinal seat-time group differences were detected nor was there sufficient statistical evidence to conclude that seat time was predictive of developmental-level course success. A principal aim of this study was to demonstrate—to educational leaders, researchers, and institutional-research/business-intelligence professionals—the advantages and computational practicability of survival analysis, an underused but more powerful way to investigate changes in students over time.

A relationship between the Florida Comprehensive Assessment Test 2.0 mathematics scores and racial and ethnic concentration when considering socio-economic status, ESOL student population, and school climate

From the moment children are born, they begin a lifetime journey of learning about themselves and their surroundings. With the establishment of the No Child Left Behind Act of 2001, it mandates that all children receive a high-quality education in a positive school climate. Regardless of the school the child attends or the neighborhood in which the child lives, proper and quality education and resources must be provided and made available in order for the child to be academically successful. The purpose of this ex post facto study was to investigate the relationship between the FCAT 2.0 mathematics scores of public middle school students in Miami-Dade County, Florida and the concentrations of a school's racial and ethnic make-up (Whites, Blacks, and Hispanics), English for Speakers of other Languages (ESOL) population, socio-economic status (SES), and school climate. The research question of this study was: Is there a significant relationship between the FCAT 2.0 Mathematics scores and racial and ethnic concentration of public middle school students in Miami-Dade County when controlling SES, ESOL student population, and school climate for the 2010-2011 school year? The instruments used to collect the data were the FCAT 2.0 and Miami-Dade County Public Schools (M-DCPS) School Climate Survey. The study found that Economically Disadvantaged (SES) students socio-economic status had the strongest correlation with the FCAT 2.0 mathematics scores (r = -.830). The next strongest correlation was with the number of students who agreed that their school climate was positive and helped them learn (r = .741) and the third strongest correlation was a school percentage of White students (r = .668). The study concluded that the FCAT 2.0 mathematics scores of M-DCPS middle school students have a significant relationship with socio-economic status, school climate, and racial concentration.

The Effects of the Use of Technology In Mathematics Instruction on Student Achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

Class Placement and Academic and Behavioral Variables as Predictors of Graduation for Students with Disabilities

Dropout rates impacting students with high-incidence disabilities in American schools remain staggering (Bost, 2006; Hehir, 2005). Of this group, students with Emotional Behavioral Disorders (EBD) are at greatest risk. Despite the mandated national propagation of inclusion, students with EBD remain the least included and the least successful when included (Bost). Accordingly, this study investigated the potential significance of inclusive settings and other school-related variables within the context of promoting the graduation potential of students with Specific Learning Disabilities (SLD) or EBD. This mixed-methods study investigated specified school-related variables as likely dropout predictors, as well as the existence of first-order interactions among some of the variables. In addition, it portrayed the perspectives of students with SLD or EBD on the school-related variables that promote graduation. Accordingly, the sample was limited to students with SLD or EBD who had graduated or were close to graduation. For the quantitative component the numerical data were analyzed using linear and logistic regressions. For the qualitative component guided student interviews were conducted. Both strands were subsequently analyzed using Ridenour and Newman’s (2008) model where the quantitative hypotheses are tested and are later built-upon by the related qualitative meta-themes. Results indicated that a successful academic history, or obtaining passing grades was the only significant predictor of graduation potential when statistically controlling all the other variables. While at a marginal significance, results also yielded that students with SLD or EBD in inclusive settings experienced better academic results and behavioral outcomes than those in self-contained settings. Specifically, students with SLD or EBD in inclusive settings were found to be more likely to obtain passing grades and less likely to be suspended from school. Generally, the meta-themes yielded during the student interviews corroborated these findings as well as provided extensive insights on how students with disabilities view school within the context of promoting graduation. Based on the results yielded, provided the necessary academic accommodations and adaptations are in place, along with an effective behavioral program, inclusive settings can be utilized as drop-out prevention tools in special education.

Is Our Students Learning - QuestionMark: Extending E-Assessment Systems for Adapative Marking and Feedback

Our key contribution is a flexible, automated marking system that adds desirable functionality to existing E-Assessment systems. In our approach, any given E-Assessment system is relegated to a data-collection mechanism, whereas marking and the generation and distribution of personalised per-student feedback is handled separately by our own system. This allows content-rich Microsoft Word feedback documents to be generated and distributed to every student simultaneously according to a per-assessment schedule.

The feedback is adaptive in that it corresponds to the answers given by the student and provides guidance on where they may have gone wrong. It is not limited to simple multiple choice which are the most prescriptive question type offered by most E-Assessment Systems and as such most straightforward to mark consistently and provide individual per-alternative feedback strings. It is also better equipped to handle the use of mathematical symbols and images within the feedback documents which is more flexible than existing E-Assessment systems, which can only handle simple text strings.

As well as MCQs the system reliably and robustly handles Multiple Response, Text Matching and Numeric style questions in a more flexible manner than Questionmark: Perception and other E-Assessment Systems. It can also reliably handle multi-part questions where the response to an earlier question influences the answer to a later one and can adjust both scoring and feedback appropriately.

New question formats can be added at any time provided a corresponding marking method conforming to certain templates can also be programmed. Indeed, any question type for which a programmatic method of marking can be devised may be supported by our system. Furthermore, since the student’s response to each is question is marked programmatically, our system can be set to allow for minor deviations from the correct answer, and if appropriate award partial marks.

The Hidden benefits of “poster presentation assessment”: Skill acquirement and learning; evaluated from the nursing students perspective

Introduction
This paper reports to an exercise in evaluating poster group work and poster presentation and the extra learning and skill acquisition that this can provide to nursing students, through a creative and stimulating assessment method. Much had been written about the benefits of using posters as an assessment method, yet there appears to be a lack of research that captures the student experience.
Aim
This evaluative study sought to evaluate the student experience by using a triangulation approach to evaluation:
Methodology
All students from the February 2015 nursing intake, were eligible to take part (80 students) of which 71 participated (n=71). The poster group presentations took place at the end of their first phase of year one teaching and the evaluation took place at the end of their first year as undergraduate. Evaluation involved;
1. Quantitative data by questionnaires
2. Qualitative data from focus group discussions
Results
A number of key themes emerged from analysis of the data which captured the “added value” of learning from the process of poster assessment including:
 Professionalism: developing time keeping skills, presenting skills.
 Academic skills: developing literature search, critic and reporting
 Team building and collaboration
Overall 88% agreed that the process furnished them with additional skills and benefits above the actual production of the poster, with 97% agreeing that these additional skills are important skills for a nurse.
Conclusion
These results would suggest that the process of poster development and presentation furnish student nurses with many additional skills that they may not acquire through other types of assessment and are therefore beneficial. The structure of the assessment encourages a self-directed approach so students take control of the goals and purposes of learning. The sequential organization of the assessment guides students in the transition from dependent to self-directed learners.

Reliability assessment of a peer evaluation instrument in a team-based learning course

Objective: To evaluate the reliability of a peer evaluation instrument in a longitudinal team-based learning setting. Methods: Student pharmacists were instructed to evaluate the contributions of their peers. Evaluations were analyzed for the variance of the scores by identifying low, medium, and high scores. Agreement between performance ratings within each group of students was assessed via intra-class correlation coefficient (ICC). Results: We found little variation in the standard deviation (SD) based on the score means among the high, medium, and low scores within each group. The lack of variation in SD of results between groups suggests that the peer evaluation instrument produces precise results. The ICC showed strong concordance among raters. Conclusions: Findings suggest that our student peer evaluation instrument provides a reliable method for peer assessment in team-based learning settings.

Assessment of student engagement among junior high school students and associations with self-esteem, burnout, and academic achievement

The aim of the study was to investigate the structure of affective and cognitive engagement using the Student Engagement Instrument (SEI; Appleton, Christenson, Kim, & Reschly, 2006) and to examine the associations to behavioral engagement, as well as student-reported self-esteem, burnout, and academic achievement among Finnish junior high school students. The analyses were carried out in the main sample of 2,485 students, as well as in an independent sample of 821 students. The results showed that the original five-factor structure of the SEI construed along three affective and two cognitive engagement factors fit the current data relatively well. Affective and cognitive student engagement correlated positively with an independent measure of behavioral engagement. Furthermore, affective and cognitive engagement were positively associated with student-reported self-esteem and academic achievement, and negatively with school burnout. The findings provided corroborating evidence for the psychometric properties and utilization of the SEI instrument for assessing the engagement of junior high school students. (DIPF/Orig.)

A Retrospective-Longitudinal Examination of the Relationship between Apportionment of Seat Time in Community-College Algebra Courses and Student Academic Performance

During the past decade, there has been a dramatic increase by postsecondary institutions in providing academic programs and course offerings in a multitude of formats and venues (Biemiller, 2009; Kucsera & Zimmaro, 2010; Lang, 2009; Mangan, 2008). Strategies pertaining to reapportionment of course-delivery seat time have been a major facet of these institutional initiatives; most notably, within many open-door 2-year colleges. Often, these enrollment-management decisions are driven by the desire to increase market-share, optimize the usage of finite facility capacity, and contain costs, especially during these economically turbulent times. So, while enrollments have surged to the point where nearly one in three 18-to-24 year-old U.S. undergraduates are community college students (Pew Research Center, 2009), graduation rates, on average, still remain distressingly low (Complete College America, 2011). Among the learning-theory constructs related to seat-time reapportionment efforts is the cognitive phenomenon commonly referred to as the spacing effect, the degree to which learning is enhanced by a series of shorter, separated sessions as opposed to fewer, more massed episodes. This ex post facto study explored whether seat time in a postsecondary developmental-level algebra course is significantly related to: course success; course-enrollment persistence; and, longitudinally, the time to successfully complete a general-education-level mathematics course. Hierarchical logistic regression and discrete-time survival analysis were used to perform a multi-level, multivariable analysis of a student cohort (N = 3,284) enrolled at a large, multi-campus, urban community college. The subjects were retrospectively tracked over a 2-year longitudinal period. The study found that students in long seat-time classes tended to withdraw earlier and more often than did their peers in short seat-time classes (p < .05). Additionally, a model comprised of nine statistically significant covariates (all with p-values less than .01) was constructed. However, no longitudinal seat-time group differences were detected nor was there sufficient statistical evidence to conclude that seat time was predictive of developmental-level course success. A principal aim of this study was to demonstrate—to educational leaders, researchers, and institutional-research/business-intelligence professionals—the advantages and computational practicability of survival analysis, an underused but more powerful way to investigate changes in students over time.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning learning performance and academic achievement in Physical Education. A quantitative methodology was implemented, comprising a sample of 447 students attending a school grouping located in the coastal region of central Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students’ ability to understand the gains and the effort made in learning.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

Problem Statement: This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning the learning performance and academic achievement in physical education. Research Questions: Are the teacher leadership style and the teacher-student and student-student pedagogical interaction related to the learning performance and academic achievement in physical education in basic schooling? Purpose of Study: There are several factors that contribute for the explanation of learning outcomes, namely teacher leadership styles in the classroom, as well as teacher-student and student-student pedagogical interactions. These factors are considered to be essential in the teaching-learning process and in the subsequent improvement of educational outcomes. Research Methods: A quantitative methodology was implemented, comprising a sample of 447 students attending a School Grouping located in the Central Region of Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. Findings: The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. Conclusions: This study sought to deepen the understanding of the explanatory factors of academic success concerning the teaching-learning process in physical education. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students' ability to understand the gains and the effort made in learning.

Shaping the future of learning using the student voice: we’re listening but are we hearing clearly?

Student voice data is a key factor as Manchester Metropolitan University strives to continually improve institutional technology enhanced learning (TEL) infrastructure. A bi-annual Institutional Student Survey enables students to communicate their experience of learning, teaching and assessment on programmes and specific units studied. Each cycle of the survey contains approximately 40–50,000 free text comments from students pertaining to what they appreciate and what they would like to see improved. A detailed thematic analysis of this data has identified 18 themes, arranged into six categories relating to the ‘Best’ aspects of courses, and 25 themes, arranged in seven categories in relation to aspects of courses considered to be ‘in need of improvement’. This student data was then used as a basis for semi-structured interviews with staff. Anecdotally, evidence suggested that student expectations and staff expectations around TEL and the virtual learning environment (VLE) differed. On-going evaluation of this work has highlighted a disconnect. In significant instances, academic colleagues seemingly misinterpret the student voice analysis and consequently struggle to respond effectively. In response to the analysis, the learning technologist's role has been to re-interpret the analysis and redevelop TEL staff development and training activities. The changes implemented have focused on: contextualising resources in VLE; making lectures more interactive; enriching the curriculum with audio–visual resources; and setting expectations around communications.

Development, implementation, and assessment of a distance module in endocrine physiology

Rangel EM, Mendes IA, Carnio EC, Marchi Alves LM, Godoy S, Crispim JA. Development, implementation, and assessment of a distance module in endocrine physiology. Adv Physiol Educ 34: 70-74, 2010; doi: 10.1152/advan.00070.2009.-This study aimed to develop, implement, and assess a distance module in endocrine physiology in TelEduc for undergraduate nursing students from a public university in Brazil, with a sample size of 44 students. Stage 1 consisted of the development of the module, through the process of creating a distance course by means of the Web. Stage 2 was the planning of the module's practical functioning, and stage 3 was the planning of student evaluations. In the experts' assessment, the module complied with pedagogical and technical requirements most of the time. In the practical functioning stage, 10 h were dedicated for on-site activities and 10 h for distance activities. Most students (93.2%) were women between 19 and 23 yr of age (75%). The internet was the most used means to remain updated for 23 students (59.0%), and 30 students (68.2%) accessed it from the teaching institution. A personal computer was used by 23 students (56.1%), and most of them (58.1%) learned to use it alone. Access to a forum was more dispersed (variation coefficient: 86.80%) than access to chat (variation coefficient: 65.14%). Average participation was 30 students in forums and 22 students in the chat. Students' final grades in the module averaged 8.5 (SD: 1.2). TelEduc was shown to be efficient in supporting the teaching- learning process of endocrine physiology.