Time Efficient Assessment and Feedback Methods for Large Computer-Aided-Design Cohorts

Timely and individualized feedback on coursework is desirable from a student perspective as it facilitates formative development and encourages reflective learning practice. Faculty however are faced with a significant and potentially time consuming challenge when teaching larger cohorts if they are to provide feedback which is timely, individualized and detailed. Additionally, for subjects which assess non-traditional submissions, such as Computer-Aided-Design (CAD), the methods for assessment and feedback tend not to be so well developed or optimized. Issues can also arise over the consistency of the feedback provided. Evaluations of Computer-Assisted feedback in other disciplines (Denton et al, 2008), (Croft et al, 2001) have shown students prefer this method of feedback to traditional “red pen” marking and also that such methods can be more time efficient for faculty.
Herein, approaches are described which make use of technology and additional software tools to speed up, simplify and automate assessment and the provision of feedback for large cohorts of first and second year engineering students studying modules where CAD files are submitted electronically. A range of automated methods are described and compared with more “manual” approaches. Specifically one method uses an application programming interface (API) to interrogate SolidWorks models and extract information into an Excel spreadsheet, which is then used to automatically send feedback emails. Another method describes the use of audio recordings made during model interrogation which reduces the amount of time while increasing the level of detail provided as feedback.
Limitations found with these methods and problems encountered are discussed along with a quantified assessment of time saving efficiencies made.

Machine learning for transient discovery in Pan-STARRS1 difference imaging

Efficient identification and follow-up of astronomical transients is hindered by the need for humans to manually select promising candidates from data streams that contain many false positives. These artefacts arise in the difference images that are produced by most major ground-based time-domain surveys with large format CCD cameras. This dependence on humans to reject bogus detections is unsustainable for next generation all-sky surveys and significant effort is now being invested to solve the problem computationally. In this paper, we explore a simple machine learning approach to real-bogus classification by constructing a training set from the image data of similar to 32 000 real astrophysical transients and bogus detections from the Pan-STARRS1 Medium Deep Survey. We derive our feature representation from the pixel intensity values of a 20 x 20 pixel stamp around the centre of the candidates. This differs from previous work in that it works directly on the pixels rather than catalogued domain knowledge for feature design or selection. Three machine learning algorithms are trained (artificial neural networks, support vector machines and random forests) and their performances are tested on a held-out subset of 25 per cent of the training data. We find the best results from the random forest classifier and demonstrate that by accepting a false positive rate of 1 per cent, the classifier initially suggests a missed detection rate of around 10 per cent. However, we also find that a combination of bright star variability, nuclear transients and uncertainty in human labelling means that our best estimate of the missed detection rate is approximately 6 per cent.

Learning, fatigue and preference formation in discrete choice experiments

While the repeated nature of Discrete Choice Experiments is advantageous from a sampling efficiency perspective, patterns of choice may differ across the tasks, due, in part, to learning and fatigue. Using probabilistic decision process models, we find in a field study that learning and fatigue behavior may only be exhibited by a small subset of respondents. Most respondents in our sample show preference and variance stability consistent with rational pre-existent and
well formed preferences. Nearly all of the remainder exhibit both learning and fatigue effects. An important aspect of our approach is that it enables learning and fatigue effects to be explored, even though they were not envisaged during survey design or data collection.

Standardizing the assessment of clinical competence: an overview of intensive care course design.

Rationale for the development of the Certificate in Health Studies: Intensive Care and High Dependency for Adults course developed at Queens University Belfast, Northern Ireland. Structure and content of clinical module reviewed. Clinical assessment strategy discussed. Focus on the utilization of a standardized portfolio, individualized learning contract and objective structured clinical examination (OSCE) to evaluate clinical competence. Evaluation of OSCE as an assessment tool and of the course provision.

Think, code, succeed: The Programming Studio as a games-based collaboration:Paper published in the Proceedings of the Association for Teacher Education in Europe conference: Teacher Education through Partnerships and Collaborative Learning Communities, Glasgow, UK. ATEE, 2015

This paper investigates the profile of teachers in the island of Ireland who declared themselves willing to undertake professional development activities in programming, in particular to master programming by taking on-line courses involving the design of computer games. Using the Technology Acceptance Model (TAM), it compares scores for teachers “willing” to undertake the courses with scores for those who declined, and examines other differences between the groups of respondents. Findings reflect the perceived difficulties of programming and the current low status accorded to the subject in Ireland. The paper also reviews the use of games-based learning as a “hook” to engage learners in programming and discusses the role of gamification as a tool for motivating learners in an on-line course. The on-line course focusing on games design was met with enthusiasm, and there was general consensus that gamification was appropriate for motivating learners in structured courses such as those provided.

The influence of experimental design on the magnitude of the effect size -peer tutoring for elementary, middle and high school settings: A meta-analysis

A meta-analysis was undertaken on a form of cooperative learning, peer tutoring. The effects of experimental design on outcomes were explored, as measured by Effect Size (ES). Forty three articles with 82 effect size studies were included in the meta-analysis. Highest ES were reported for quasi-experimental studies. ES reduced as experimental design moved from single pre-test factor matched, to multiple-factor matched randomized controlled trials. ES reduced when designs used standardised, rather than self-designed measures. The implications for future meta-analyses and research in cooperative learning are explored.

An Automated Design Framework for Assembly Task Simulation

This paper presents an automated design framework for the development of individual part forming tools for a composite stiffener. The framework uses parametrically developed design geometries for both the part and its layup tool. The framework has been developed with a functioning user interface where part / tool combinations are passed to a virtual environment for utility based assessment of their features and assemblability characteristics. The work demonstrates clear benefits in process design methods with conventional design timelines reduced from hours and days to minutes and seconds. The methods developed here were able to produce a digital mock up of a component with its associated layup tool in less than 3 minutes. The virtual environment presenting the design to the designer for interactive assembly planning was generated in 20 seconds. Challenges still exist in determining the level of reality required to provide an effective learning environment in the virtual world. Full representation of physical phenomena such as gravity, part clashes and the representation of standard build functions require further work to represent real physical phenomena more accurately.

Learning about probability from text and tables: Do color coding and labeling through an interactive-user interface help?

Learning from visual representations is enhanced when learners appropriately integrate corresponding visual and verbal information. This study examined the effects of two methods of promoting integration, color coding and labeling, on learning about probabilistic reasoning from a table and text. Undergraduate students (N = 98) were randomly assigned to learn about probabilistic reasoning from one of 4 computer-based lessons generated from a 2 (color coding/no color coding) by 2 (labeling/no labeling) between-subjects design. Learners added the labels or color coding at their own pace by clicking buttons in a computer-based lesson. Participants' eye movements were recorded while viewing the lesson. Labeling was beneficial for learning, but color coding was not. In addition, labeling, but not color coding, increased attention to important information in the table and time with the lesson. Both labeling and color coding increased looks between the text and corresponding information in the table. The findings provide support for the multimedia principle, and they suggest that providing labeling enhances learning about probabilistic reasoning from text and tables

Can Future Managers and Business Executives be Influenced to Behave more Ethically in the Workplace? The Impact of Approaches to Learning on Business Students’ Cheating Behavior

This study considers the potential for influencing business students to become ethical managers by directing their undergraduate learning environment. In particular, the relationship between business students’ academic cheating, as a predictor of workplace ethical behavior, and their approaches to learning is explored. The three approaches to learning identified from the students’ approaches to learning literature are deep approach, represented by an intrinsic interest in and a desire to understand the subject, surface approach, characterized by rote learning and memorization without understanding, and strategic approach, associated with competitive students whose motivation is the achievement of good grades by adopting either a surface or deep approach. Consistent with the hypothesized theoretical model, structural equation modeling revealed that the surface approach is associated with higher levels of cheating, while the deep approach is related to lower levels. The strategic approach was also associated with less cheating and had a statistically stronger influence than the deep approach. Further, a significantly positive relationship reported between deep and strategic approaches suggests that cheating is reduced when deep and strategic approaches are paired. These findings suggest that future managers and business executives can be influenced to behave more ethically in the workplace by directing their learning approaches. It is hoped that the evidence presented may encourage those involved in the design of business programs to implement educational strategies which optimize students’ approaches to learning towards deep and strategic characteristics, thereby equipping tomorrow’s managers and business executives with skills to recognize and respond appropriately to workplace ethical dilemmas.