A conceptual model for reflecting on expected learning vs. demonstrated student performance

Educators are faced with many challenging questions in designing an effective curriculum. What prerequisite knowledge do students have before commencing a new subject? At what level of mastery? What is the spread of capabilities between bare-passing students vs. the top performing group? How does the intended learning specification compare to student performance at the end of a subject? In this paper we present a conceptual model that helps in answering some of these questions. It has the following main capabilities: capturing the learning specification in terms of syllabus topics and outcomes; capturing mastery levels to model progression; capturing the minimal vs. aspirational learning design; capturing confidence and reliability metrics for each of these mappings; and finally, comparing and reflecting on the learning specification against actual student performance. We present a web-based implementation of the model, and validate it by mapping the final exams from four programming subjects against the ACM/IEEE CS2013 topics and outcomes, using Bloom's Taxonomy as the mastery scale. We then import the itemised exam grades from 632 students across the four subjects and compare the demonstrated student performance against the expected learning for each of these. Key contributions of this work are the validated conceptual model for capturing and comparing expected learning vs. demonstrated performance, and a web-based implementation of this model, which is made freely available online as a community resource.

The effects of linguistic factors on student performance on economics multiple choice questions

This paper proposes a framework to analyse performance on multiple choice questions with the focus on linguistic factors. Item Response Theory (IRT) is deployed to estimate ability and question difficulty levels. A logistic regression model is used to detect Differential Item Functioning questions. Probit models testify relationships between performance and linguistic factors controlling the effects of question construction and students’ background. Empirical results have important implications. The lexical density of stems affects performance. The use of non-Economics specialised vocabulary has differing impacts on the performance of students with different language backgrounds. The IRT-based ability and difficulty help explain performance variations.

Feedback on student performance in the workplace: The role of workplace supervisors

This chapter highlights the im portance of feedback in work - integrated learning (WIL) , the key role of workplace supervisors, and the importance of continuous improvement in systems to support feedback processes. The paper proposes a definition of feedback and formative feedback, as well as approaches for providing industry feedback in W I L . It further reports on a case analysis based on workplace supervisors providing feedback to students in engineering and urban development , yielding certain insights into student pe rformance in the workplace, and m ore importantly, hi ghlighting the need to enhance the use of feedback processes. This is requir ed in a context where delivering feedback in WIL is generally acknowledge d to be complex, and where the role of the industry supervisor in appraising the performance of the student in the workplace needs to be very c learly defined in order for supervisor s ’ feedback to have optimal impact. F eedback in WIL i s set against the bac kdrop of recognizing the importance and complexity of stakeholder engagement in WIL in general, and the intricacy associated with the provision of feedback from industry supervisors in particular. Student self - assessment is briefly considered as a fu rther dimension of their participation in providing feedback on their own performance in the workplace . ( Asia - Pacific Journal of Cooperative Education, Special Issue, 2014, 15 (3 ), 241 - 25 2

Student performance in field education placements: The findings of a 6-year Australian study of admissions data

This article reports on a 6-year study that examined the association between pre-admission variables and field placement performance in an Australian bachelor of social work program (N=463). Very few of the pre-admission variables were found to be significantly associated with performance. These findings and the role of the admissions process are discussed. In addition to the usual academic criteria, the authors urge schools to include a focus on nonacademic criteria during the admissions process and the ongoing educational program.

Subsethood-based Fuzzy Rule Models and their Application to Student Performance

K. Rasmani and Q. Shen. Subsethood-based Fuzzy Rule Models and their Application to Student Performance Classification. Proceedings of the 14th International Conference on Fuzzy Systems, pages 755-760, 2005.

Making geography mobile: using location aware technology to improve student performance in physical geography

With the increased availability of new technologies, geography educators are revisiting their pedagogical approaches to teaching and calling for opportunities to share local and international practices which will enhance the learning experience and improve students’ performance. This paper reports on the use of handheld mobile devices, fitted with GPS, by secondary (high) school pupils in geography. Two location-aware activities were completed over one academic year (one per semester) and pre-test and post-test scores for both topics revealed a statistically significant increase in pupils’ performance as measured by the standard national assessments. A learner centred educational approach was adopted with the first mobile learning activity being created by the teacher as an exemplar of effective mobile learning design. Pupils built on their experiences of using mobile learning when they were required to created their own location aware learning task for peer use. An analysis of the qualitative data from the pupils’ journals, group diaries and focus group interviews revealed the five pillars of learner centred education are addressed when using location aware technologies and the use of handheld mobile devices offered greater flexibility and autonomy to the pupils thus altering the level of power and control away from the teacher. Due to the relatively small number of participants in the study, the results are more informative than generalisable however in light of the growing interest in geo-spatial technologies in geography education, this paper offers encouragement and insight into the use of location aware technology in a compulsory school context

Student performance analysis under different moodle course designs

This work extends a recent comparative study covering four different courses lectured at the Polytechnic of Porto - School of Engineering, in respect to the usage of a particular Learning Management System, i.e. Moodle, and its impact on students' results. A fifth course, which includes a number of resources especially supporting laboratory classes, is now added to the analysis. This particular course includes a number of remote experiments, made available through VISIR (Virtual Instrument Systems in Reality) and directly accessible through links included in the Moodle course page. We have analyzed the students' behavior in following these links and in effectively running experiments in VISIR (and also using other lab related resources, in Moodle). This data have been correlated with students' classifications in the lab component and in the exam, each one weighting 50% of their final marks. We aimed to compare students' performance in a richly Moodle-supported environment (with lab component) and in a poorly Moodle-supported environment (with only theoretical component). This question followed from conclusions drawn in the above referred comparative study, where it was shown that even though a positive correlation factor existed between the number of Moodle accesses and the final exam grade obtained by each student, its explanation behind was not straightforward, as the quality of the resources was preponderant over its quantity.

Statistical monitoring of student performance: an early warning system

Weekly monitoring of profiles of student performances on formative and summative coursework throughout the year can be used to quickly identify those who need additional help, possibly due to acute and sudden-onset problems. Such an early-warning system can help retention, but also assist students in overcoming problems early on, thus helping them fulfil their potential in the long run. We have developed a simple approach for the automatic monitoring of student mark profiles for individual modules, which we intend to trial in the near future. Its ease of implementation means that it can be used for very large cohorts with little additional effort when marks are already collected and recorded on a spreadsheet.

Improving on- and off-campus student performance in structural mechanics

This paper investigates the performance of 329 (173 on- and 186  off-campus) students enrolled in two structural mechanics units at Deakin University, a leader in engineering distance-education in Australia. The two units experience unacceptably high rates of failure. An analysis of the assignment, laboratory and examination marks is presented. Consideration is also given to the total marks. The results show that on-campus students perform better in structural mechanics than their off-campus counterparts. Plots of the student performance distributions for the three assessment methods are provided (for each unit) and high failure rates are linked to low examination marks. Students tend to perform best in assignments and worst in examinations. Parametric statistical tests show a correlation between the continuous assessment and examination marks. To motivate students to fully participate in continuous assessment tasks the authors therefore propose several changes to the assessment criteria and marking schemes.