Is Our Students Learning - QuestionMark: Extending E-Assessment Systems for Adapative Marking and Feedback

Our key contribution is a flexible, automated marking system that adds desirable functionality to existing E-Assessment systems. In our approach, any given E-Assessment system is relegated to a data-collection mechanism, whereas marking and the generation and distribution of personalised per-student feedback is handled separately by our own system. This allows content-rich Microsoft Word feedback documents to be generated and distributed to every student simultaneously according to a per-assessment schedule.

The feedback is adaptive in that it corresponds to the answers given by the student and provides guidance on where they may have gone wrong. It is not limited to simple multiple choice which are the most prescriptive question type offered by most E-Assessment Systems and as such most straightforward to mark consistently and provide individual per-alternative feedback strings. It is also better equipped to handle the use of mathematical symbols and images within the feedback documents which is more flexible than existing E-Assessment systems, which can only handle simple text strings.

As well as MCQs the system reliably and robustly handles Multiple Response, Text Matching and Numeric style questions in a more flexible manner than Questionmark: Perception and other E-Assessment Systems. It can also reliably handle multi-part questions where the response to an earlier question influences the answer to a later one and can adjust both scoring and feedback appropriately.

New question formats can be added at any time provided a corresponding marking method conforming to certain templates can also be programmed. Indeed, any question type for which a programmatic method of marking can be devised may be supported by our system. Furthermore, since the student’s response to each is question is marked programmatically, our system can be set to allow for minor deviations from the correct answer, and if appropriate award partial marks.

Investigating high-achieving sixth grade students' erroneous answers on the angle concept in Yozgat

The angle concept is a multifaceted concept having static and dynamic definitions. The static definition of the angle refers to “the space between two rays” or “the intersection of two rays at the same end point” (Mitchelmore & White, 1998), whereas the dynamic definition of the angle concept highlights that the size of angle is the amount of rotation in direction (Fyhn, 2006). Since both definitions represent two diverse situations and have unique limitations (Henderson & Taimina, 2005), students may hold misconceptions about the angle concept. In this regard, the aim of this research was to explore high achievers’ knowledge regarding the definition of the angle concept as well as to investigate their erroneous answers on the angle concept.

104 grade 6 students drawn from four well-established elementary schools of Yozgat, Turkey were participated in this research. All participants were selected via a purposive sampling method and their mathematics grades were 4 or 5 out of 5, and. Data were collected through four questions prepared by considering the learning competencies set out in the grade 6 curriculum in Turkey and the findings of previous studies whose purposes were to identify students’ misconceptions of the angle concept. The findings were analyzed by two researchers, and their inter-rater agreement was calculated as 0.91, or almost perfect. Thereafter, coding discrepancies were resolved, and consensus was established.

The angle concept is a multifaceted concept having static and dynamic definitions.The static definition of the angle refers to “the space between two rays” or“the intersection of two rays at the same end point” (Mitchelmore & White, 1998), whereas the dynamicdefinition of the angle concept highlights that the size of angle is the amountof rotation in direction (Fyhn, 2006). Since both definitionsrepresent two diverse situations and have unique limitations (Henderson & Taimina, 2005), students may holdmisconceptions about the angle concept. In this regard, the aim of thisresearch was to explore high achievers’ knowledge regarding the definition ofthe angle concept as well as to investigate their erroneous answers on theangle concept.

Beam division multiple access for massive MIMO downlink transmission

We study a multiuser multicarrier downlink communication system in which the base station (BS) employs a large number of antennas. By assuming frequency-division duplex operation, we provide a beam domain channel model as the number of BS antennas grows asymptotically large. With this model, we first derive a closed-form upper bound on the achievable ergodic sum-rate before developing necessary conditions to asymptotically maximize the upper bound, with only statistical channel state information at the BS. Inspired by these conditions, we propose a beam division multiple access (BDMA) transmission scheme, where the BS communicates with users via different beams. For BDMA transmission, we design user scheduling to select users within non-overlapping beams, work out an optimal pilot design under a minimum mean square error criterion, and provide optimal pilot sequences by utilizing the Zadoff-Chu sequences. The proposed BDMA scheme reduces significantly the pilot overhead, as well as, the processing complexity at transceivers. Simulations demonstrate the high spectral efficiency of BDMA transmission and the advantages in the bit error rate performance of the proposed pilot sequences.

Joint Analysis of Multiple Algorithms and Performance Measures

There has been an increasing interest in the development of new methods using Pareto optimality to deal with multi-objective criteria (for example, accuracy and time complexity). Once one has developed an approach to a problem of interest, the problem is then how to compare it with the state of art. In machine learning, algorithms are typically evaluated by comparing their performance on different data sets by means of statistical tests. Standard tests used for this purpose are able to consider jointly neither performance measures nor multiple competitors at once. The aim of this paper is to resolve these issues by developing statistical procedures that are able to account for multiple competing measures at the same time and to compare multiple algorithms altogether. In particular, we develop two tests: a frequentist procedure based on the generalized likelihood-ratio test and a Bayesian procedure based on a multinomial-Dirichlet conjugate model. We further extend them by discovering conditional independences among measures to reduce the number of parameters of such models, as usually the number of studied cases is very reduced in such comparisons. Data from a comparison among general purpose classifiers is used to show a practical application of our tests.

Perception of Filtered Speech by Children with Developmental Dyslexia and Children with Specific Language Impairments

Here we use two filtered speech tasks to investigate children’s processing of slow (<4 Hz) versus faster (∼33 Hz) temporal modulations in speech. We compare groups of children with either developmental dyslexia (Experiment 1) or speech and language impairments (SLIs, Experiment 2) to groups of typically-developing (TD) children age-matched to each disorder group. Ten nursery rhymes were filtered so that their modulation frequencies were either low-pass filtered (<4 Hz) or band-pass filtered (22 – 40 Hz). Recognition of the filtered nursery rhymes was tested in a picture recognition multiple choice paradigm. Children with dyslexia aged 10 years showed equivalent recognition overall to TD controls for both the low-pass and band-pass filtered stimuli, but showed significantly impaired acoustic learning during the experiment from low-pass filtered targets. Children with oral SLIs aged 9 years showed significantly poorer recognition of band pass filtered targets compared to their TD controls, and showed comparable acoustic learning effects to TD children during the experiment. The SLI samples were also divided into children with and without phonological difficulties. The children with both SLI and phonological difficulties were impaired in recognizing both kinds of filtered speech. These data are suggestive of impaired temporal sampling of the speech signal at different modulation rates by children with different kinds of developmental language disorder. Both SLI and dyslexic samples showed impaired discrimination of amplitude rise times. Implications of these findings for a temporal sampling framework for understanding developmental language disorders are discussed.

Applied behavior analysis: What do teachers of students with autism spectrum disorder know?

With rising numbers of school-aged children with autism educated in mainstream classroomsand applied behavior analysis (ABA) considered the basis of best practice, teachers’ knowledgein this field has become a key concern for inclusion. Self-reported knowledge of ABA of specialneeds teachers (n=165) was measured and compared to their actual knowledge of ABAdemonstrated in accurate responses to a multiple-choice test. Findings reported here show thatteachers’ self-perceived knowledge exceeded actual knowledge and that actual knowledge ofABA was not

Factors affecting transition to second year of an engineering degree

Much research has focused on students’ transition from secondary school to university. Less is known about the transition from first to second year of a university degree programme. Given the difficulties that many students face at this stage of their education, research into the relevant factors is required. Through questionnaires and focus groups, views of second- and third-year aerospace and mechanical engineering students in our university have been gathered. A large majority believed that both the volume and difficulty of work increased in second year. Many stated that first year was slightly too trivial and could have been made more challenging to prepare them better for second year. Different teaching and assessment styles in second year were considered to affect attendance and performance. The survey revealed that students were generally very well settled into university life by the end of first year and were happy with their choice of course and only 23% reported that financial responsibilities have had a negative effect on their academic performance. Differences were observed between male and female students. Male students believed that transition was helped by having regular assessments and by worked examples in lectures. Females found the teaching staff were the most helpful factor for a successful transition. The results indicate that males require more structure and guidance whereas females are more independent and settle in better.

A literature review to Examine the Validity and Reliability of group poster presentations as an assessment method of a module in an undergraduate nursing degree programme

The introduction of a poster presentation as a formative assessment method over a multiple choice examination after the first phase of a three phase “health and well-being” module in an undergraduate nursing degree programme was greeted with a storm of criticism from fellow lecturers stating that poster presentations are not valid or reliable and totally irrelevant to the assessment of learning in the module. This paper seeks to investigate these criticisms by investigating the literature regarding producing nurses fit for practice, nurse curriculum development and wider nurse education, the purpose of assessment, validity and reliability to critically evaluate the poster presentation as a legitimate assessment method for these aims.

Bayesian Dependence Tests for Continuous, Binary and Mixed Continuous-Binary Variables

Tests for dependence of continuous, discrete and mixed continuous-discrete variables are ubiquitous in science. The goal of this paper is to derive Bayesian alternatives to frequentist null hypothesis significance tests for dependence. In particular, we will present three Bayesian tests for dependence of binary, continuous and mixed variables. These tests are nonparametric and based on the Dirichlet Process, which allows us to use the same prior model for all of them. Therefore, the tests are “consistent” among each other, in the sense that the probabilities that variables are dependent computed with these tests are commensurable across the different types of variables being tested. By means of simulations with artificial data, we show the effectiveness of the new tests.