Adaptive integral assessment package for the A2UN@ project

This paper presents a first approach of Evaluation Engine Architecture (EEA) as proposal to support adaptive integral assessment, in the context of a virtual learning environment. The goal of our research is design an evaluation engine tool to assist in the whole assessment process within the A2UN@ project, linking that tool with the other key elements of a learning design (learning task, learning resources and learning support). The teachers would define the relation between knowledge, competencies, activities, resources and type of assessment. Providing this relation is possible obtain more accurate estimations of student's knowledge for adaptive evaluations and future recommendations. The process is supported by usage of educational standards and specifications and for an integral user modelling

Using video markschemes to support self-assessment in Chemistry

A video markscheme was created using a combination of Camtasia screen capture (on a Tablet PC) and 'live action' video taken with a camcorder. The resulting video supported students in the self-assessment of an organic chemistry exercise which had been set over the Easter vacation break. Feedback was collected from the students after the exercise and was overwhelmingly positive. The video won the 2010 award for 'Most Effective Use of Video in an Educational Context' from the Assocation for Learning Technology. DOWNLOAD THE ZIP FOLDER AND EXTRACT THE FILES TO ACCESS THEM.

Social skills of children with different disabilities: Assessment and implications for interventions

This study characterizes the differences and similarities in the repertoire of social skills of children from 12 different categories of special educational needs: autism, hearing impairment, mild intellectual disabilities, moderate intellectual disabilities, visual impairment, phonological disorder, learning disabilities, giftedness and talent, externalizing behavior problems, internalizing behavior problems, internalizing and externalizing behavior problems and attention deficit hyperactivity disorder. Teachers of 120 students in regular and special schools, aged between 6 and 14 years old, from four Brazilian states, responded to the Social Skills Rating System. Children with ADHD, autism, internalizing and externalizing behavior problems and externalizing behavior problems presented comparatively lower frequency of social skills. The intervention needs of each evaluated category are discussed.

A comparison of social-emotional patterns of day versus residential students enrolled in an oral educational setting

This paper reviews a study of CID students and their scores on the Meadow-Kendall Social-Emotional Assessment Inventory test (SEAI).

Evaluating and re-developing a more comprehensive and useful needs based assessment tool for parents and teachers of newly-diagnosed deaf and hard of hearing children

The purpose of this study was to redevelop a needs assessment inventory for use by caregivers and professionals engaging in educational services for children who are newly-diagnosed as deaf or hard of hearing.

Educational participation post-16: a longitudinal analysis of intentions and outcomes

The issue of levels of participation in post-compulsory education has been emphasised by the current policy initiatives to increase the age to which some form of participation is compulsory. One of the acknowledged weaknesses of research in the field of children's intentions with regard to participation is the lack of longitudinal data. This paper offers a longitudinal analysis using the Youth Survey from the British Household Panel Survey. The results show that most children can express intentions with regard to future participation very early in their secondary school careers and that these intentions are good predictors of actual behaviour five years later. Intentions to stay on are more consistent than intentions to leave and most children who finally leave at 16 have at some point said they want to remain in education post-16. The strongest association with participation levels is attainment at GCSE. However, there are also influences of gender and parental background and these remain, even after attainment is held constant. The results show the value of focusing on intentions for participation at a very early stage of children's school careers and also the importance of current attempts to reform curriculum and assessment for the 14-19 age group.

Formative assessment in teacher education: the development of a diagnostic language test for trainee teachers of German

This article describes the development and validation of a diagnostic test of German and its integration in a programme of formative assessment during a one-year initial teacher-training course. The test focuses on linguistic aspects that cause difficulty for trainee teachers of German as a foreign language and assesses implicit and explicit grammatical knowledge as well as students' confidence in this knowledge. Administration of the test to 57 German speakers in four groups (first-year undergraduates, fourth-year undergraduates, postgraduate trainees, and native speakers) provided evidence of its reliability and validity.

Students' assessment of immersive virtual reality as a pedagogic medium

Over the past few years a number of research studies, mainly involving desktop-based or head-mounted Virtual Reality (VR) systems, have been undertaken to determine what VR can contribute to the education process. In our study we have used the findings from a number of these studies to help in formulating a new study into the perceived merits and limitations of using VR in general, and immersive CAVE-like systems in particular, as an education tool. We conducted our study with a group of final year undergraduate students who were registered on a module that described VR in terms of the scientific issues, application areas, and strengths and weaknesses of the technology.

A vector approach to the assessment of undergraduate engineering courses

In any undergraduate engineering programme there is a need to assess the balance and flavour of the various educational strands. In order for a quality assurance of these programmes to be met there is a need to evaluate the course load, academic content and the assessment marks of each course in the undergraduate programme. The existing ranges of QA methods for these programmes are focused on one or two of these issues and do not provide a comprehensive assessment procedure. Following a review of the existing QA methods, this paper will define a three-dimensional approach to the assessment of the educational aspects of an undergraduate course. Various features of this method will be described and potential benefits explained.

Training pharmacists to deliver a complex information technology intervention (PINCER) using the principles of educational outreach and root cause analysis

Objective: To describe the training undertaken by pharmacists employed in a pharmacist-led information technology-based intervention study to reduce medication errors in primary care (PINCER Trial), evaluate pharmacists’ assessment of the training, and the time implications of undertaking the training. Methods: Six pharmacists received training, which included training on root cause analysis and educational outreach, to enable them to deliver the PINCER Trial intervention. This was evaluated using self-report questionnaires at the end of each training session. The time taken to complete each session was recorded. Data from the evaluation forms were entered onto a Microsoft Excel spreadsheet, independently checked and the summary of results further verified. Frequencies were calculated for responses to the three-point Likert scale questions. Free-text comments from the evaluation forms and pharmacists’ diaries were analysed thematically. Key findings: All six pharmacists received 22 hours of training over five sessions. In four out of the five sessions, the pharmacists who completed an evaluation form (27 out of 30 were completed) stated they were satisfied or very satisfied with the various elements of the training package. Analysis of free-text comments and the pharmacists’ diaries showed that the principles of root cause analysis and educational outreach were viewed as useful tools to help pharmacists conduct pharmaceutical interventions in both the study and other pharmacy roles that they undertook. The opportunity to undertake role play was a valuable part of the training received. Conclusions: Findings presented in this paper suggest that providing the PINCER pharmacists with training in root cause analysis and educational outreach contributed to the successful delivery of PINCER interventions and could potentially be utilised by other pharmacists based in general practice to deliver pharmaceutical interventions to improve patient safety.

Measuring the value of “all play and no work”: can rigorous assessment of simulation games drive innovative teaching in construction?

The construction field is dynamic and dominated by complex, ill-defined problems for which myriad possible solutions exist. Teaching students to solve construction-related problems requires an understanding of the nature of these complex problems as well as the implementation of effective instructional strategies to address them. Traditional approaches to teaching construction planning and management have long been criticized for presenting students primarily with well-defined problems - an approach inconsistent with the challenges encountered in the industry. However, growing evidence suggests that employing innovative teaching approaches, such as interactive simulation games, offers more active, hands-on and problem-based learning opportunities for students to synthesize and test acquired knowledge more closely aligned with real-life construction scenarios. Simulation games have demonstrated educational value in increasing student problem solving skills and motivation through critical attributes such as interaction and feedback-supported active learning. Nevertheless, broad acceptance of simulation games in construction engineering education remains limited. While recognizing benefits, research focused on the role of simulation games in educational settings lacks a unified approach to developing, implementing and evaluating these games. To address this gap, this paper provides an overview of the challenges associated with evaluating the effectiveness of simulation games in construction education that still impede their wide adoption. An overview of the current status, as well as the results from recently implemented Virtual Construction Simulator (VCS) game at Penn State provide lessons learned, and are intended to guide future efforts in developing interactive simulation games to reach their full potential.

Assessment for Learning in teaching English to Young Learners: teachers’ understanding, classroom practice and impact on interactions

It has been suggested that Assessment for Learning (AfL) plays a significant role in enhancing teaching and learning in mainstream educational contexts. However, little empirical evidence can support these claims. As AfL has been shown to be enacted predominantly through interactions in primary classes, there is a need to understand if it is appropriate, whether it can be efficiently used in teaching English to Young Learners (TEYL) and how it can facilitate learning in such a context. This emerging research focus gains currency especially in the light of SLA research, which suggests the important role of interactions in foreign language learning. This mixed-method, descriptive and exploratory study aims to investigate how teachers of learners aged 7-11 understand AfL; how they implement it; and the impact that such implementation could have on interactions which occur during lessons. The data were collected through lesson observations, scrutiny of school documents, semi-structured interviews and a focus group interview with teachers. The findings indicate that fitness for purpose guides the implementation of AfL in TEYL classrooms. Significantly, the study has revealed differences in the implementation of AfL between classes of 7-9 and 10-11 year olds within each of the three purposes (setting objectives and expectations; monitoring performance; and checking achievement) identified through the data. Another important finding of this study is the empirical evidence suggesting that the use of AfL could facilitate creating conditions conducive to learning in TEYL classes during collaborative and expert/novice interactions. The findings suggest that teachers’ understanding of AfL is largely aligned with the theoretical frameworks (Black & Wiliam, 2009; Swaffield, 2011) already available. However, they also demonstrate that there are TEYL specific characteristics. This research has important pedagogical implications and indicates a number of areas for further research.

Solar Energy assessment based on weather station data for direct site monitoring in Indonesia

This thesis evaluates different sites for a weather measurement system and a suitable PV- simulation for University of Surabaya (UBAYA) in Indonesia/Java. The weather station is able to monitor all common weather phenomena including solar insolation. It is planned to use the data for scientific and educational purposes in the renewable energy studies. During evaluation and installation it falls into place that official specifications from global meteorological organizations could not be meet for some sensors caused by the conditions of UBAYA campus. After arranging the hardware the weather at the site was monitored for period of time. A comparison with different official sources from ground based and satellite bases measurements showed differences in wind and solar radiation. In some cases the monthly average solar insolation was deviating 42 % for satellite-based measurements. For the ground based it was less than 10 %. The average wind speed has a difference of 33 % compared to a source, which evaluated the wind power in Surabaya. The wind direction shows instabilities towards east compared with data from local weather station at the airport. PSET has the chance to get some investments to investigate photovoltaic on there own roof. With several simulations a suitable roof direction and the yearly and monthly outputs are shown. With a 7.7 kWpeak PV installation with the latest crystalline technology on the market 8.82 MWh/year could be achieved with weather data from 2012. Thin film technology could increase the value up to 9.13 MWh/year. However, the roofs have enough area to install PV. Finally the low price of electricity in Indonesia makes it not worth to feed in the energy into the public grid.

An assessment of criteria to evaluate the graduate education program in Brazil

This study sought to identify criteria adequate for the evaluation of graduate programs in Brazil. A survey was the means for collecting the ratings and rankings given by faculty members at selected Brazilian graduate programs. A questionnaire using Likerttype and ranking items asked the importance attributed by each respondent to each of the 109 items listed. The data analysis reported in this dissertation indicates that the most highly rated criteria and indicators were: (1) Library: current periodicals; (2) Facilities: classrooms and laboratories; (3) Library: books and monographs; (4) Academic Environment: discussion, investigation, and expression; and (5) Facilities: research space and equipment. The study presents the means and standard deviations obtained for each indicator and also includes some figures obtained for a relational analysis. This dissertation was developed to provide useful information to educational planners, policy makers, administrators, and evaluators involved in Brazilian higher education or comparative studies. It is suggested that additional investigations concentrate on more specific and in-depth analysis and interpretation of the policymaking processes, i.e., on the study of social facts or organizational and academic variables in their relationships with aspects of the educational system. The appendices section includes a facsimile of the questionnaire and additional data.

Reading comprehension in primary school: textbooks, curriculum and assessment

This study describes the reading comprehension processes present in the most widely sold textbooks at the fourth grade level in Portugal and discusses how they compare to international assessments of reading literacy. We adopted the Progress of International Reading Literacy Study framework to categorize the questions in the textbooks. Our analyses revealed that they focus heavily on the retrieval of explicitly stated information to the detriment of higher level comprehension skills. Portuguese fourth grade textbooks rarely challenge students to make connections between their knowledge and the ideas in the texts and to adopt a critical and evaluative reading stance. This is in sharp contrast to what students are asked to do in the Progress of International Reading Literacy Study, conducted every five years since 2001, and it may help explain the poor results Portuguese students have in national assessment and in PISA. The findings are discussed in light of the curriculum frameworks currently adopted in Portugal and suggestions are made as to how we can improve reading literacy achievement.