e-CAF: flexible marking schemes for electronic coursework assessment and feedback

Recent surveys reveal that many university students in the U.K. are not satisfied with the timeliness and usefulness of the feedback given by their tutors. Ensuring timeliness in marking can result in a reduction in the quality of feedback. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments are inadequate to support detailed marking scheme creation and they provide little support for giving detailed feedback. This paper describes a unique new web-based tool called e-CAF for facilitating coursework assessment and feedback management directed by marking schemes. Using e-CAF, tutors can create or reuse detailed marking schemes efficiently without sacrificing the accuracy or thoroughness in marking. The flexibility in marking scheme design also makes it possible for tutors to modify a marking scheme during the marking process without having to reassess the students’ submissions. The resulting marking process will become more transparent to students.

Can computer-based testing achieve quality and efficiency in assessment?

This paper reports findings of a two year study concerning the development and implementation of a general-purpose computer-based assessment (CBA) system at a UK University. Data gathering took place over a period of nineteen months, involving a number of formative and summative assessments. Approximately 1,000 students, drawn from undergraduate courses, were involved in the exercise. The techniques used in gathering data included questionnaires, observation, interviews and an analysis of student scores in both conventional examinations and computer-based assessments. Comparisons with conventional assessment methods suggest that the use of CBA techniques may improve the overall performance of students. However it is clear that the technique must not be seen as a "quick fix" for problems such as rising student numbers. If one accepts that current systems test only a relatively narrow range of skills, then the hasty implementation of CBA systems will result in a distorted and inaccurate view of student performance. In turn, this may serve to reduce the overall quality of courses and - ultimately - detract from the student learning experience. On the other hand, if one adopts a considered and methodical approach to computer-based assessment, positive benefits might include increased efficiency and quality, leading to improved student learning.

Educational Objectives and Evaluation of Student's Internship and Practice in Informatics

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2014

Collaborative Learning and Assessment in e-Learning

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2016

An assessment of legal knowledge of preservice teachers completing accredited teacher education programs in South Florida

The purpose of the study was to assess the legal knowledge of preservice teachers completing their educational training at accredited South Florida universities. The population consisted of 372 preservice kindergarten through twelfth grade teachers completing their educational training in any area of public school education.^ The researcher selected areas of school law to assess based on nationwide studies of litigation involving teachers and school boards, the areas most pertinent to the teachers' daily activities and responsibilities. A forty-item instrument was developed and administered to preservice teachers at six South Florida public and private universities. The areas of school law surveyed were tort liability, teachers' rights as instructors and employees, and students' rights. The research questions asked if preservice teachers possess a fundamental knowledge of school law in any of the identified areas and if a significant difference of legal knowledge existed when comparing preservice teachers by university and comparing preservice elementary and preservice secondary teachers. The criteria for a fundamental knowledge of school law was established as scoring 80% or above on the total survey or any area of school law.^ Conclusions. (1) On the overall survey, the preservice teachers did not exhibit a fundamental knowledge of school law. The mean score was 64.2%, with 11.6% of the respondents scoring at or above the 80% level. (2) The preservice teachers did not possess a fundamental knowledge of school law in any of the three areas of school law, though the survey revealed a difference in the preservice teachers' knowledge in the specific areas. The scores were tort liability, 71.9%; teachers' rights, 65%; and students' rights, 52.3%. (3) A significant difference did not exist between elementary and secondary preservice teachers' knowledge of school law. (4) A significant difference did not exist among the preservice teachers' knowledge of school law when compared by university.^ The study suggested a need for increased instruction in these areas of school law to preservice teachers prior to the beginning of their teaching careers. ^

An assessment of computer usage within the Bahamian public school system and recommended guidelines towards the development of a strategic national computer plan

Computers have dramatically changed the way we live, conduct business, and deliver education. They have infiltrated the Bahamian public school system to the extent that many educators now feel the need for a national plan. The development of such a plan is a challenging undertaking, especially in developing countries where physical, financial, and human resources are scarce. This study assessed the situation with regard to computers within the Bahamian public school system, and provided recommended guidelines to the Bahamian government based on the results of a survey, the body of knowledge about trends in computer usage in schools, and the country's needs. ^ This was a descriptive study for which an extensive review of literature in areas of computer hardware, software, teacher training, research, curriculum, support services and local context variables was undertaken. One objective of the study was to establish what should or could be relative to the state-of-the-art in educational computing. A survey was conducted involving 201 teachers and 51 school administrators from 60 randomly selected Bahamian public schools. A random stratified cluster sampling technique was used. ^ This study used both quantitative and qualitative research methodologies. Quantitative methods were used to summarize the data about numbers and types of computers, categories of software available, peripheral equipment, and related topics through the use of forced-choice questions in a survey instrument. Results of these were displayed in tables and charts. Qualitative methods, data synthesis and content analysis, were used to analyze the non-numeric data obtained from open-ended questions on teachers' and school administrators' questionnaires, such as those regarding teachers' perceptions and attitudes about computers and their use in classrooms. Also, interpretative methodologies were used to analyze the qualitative results of several interviews conducted with senior public school system's officials. Content analysis was used to gather data from the literature on topics pertaining to the study. ^ Based on the literature review and the data gathered for this study a number of recommendations are presented. These recommendations may be used by the government of the Commonwealth of The Bahamas to establish policies with regard to the use of computers within the public school system. ^

Authentic Experiences Assessment Instrument: The Case of Millennial Students and Cultural Attractions in Central Florida

Three types of authenticity were chosen to analyze cultural attractions—they were: staged or real authenticity, sensory authenticity, and existential authenticity. A group of millennium students that visited Orlando’s cultural attractions from the University of Central Florida were part of this study. Results show that the term “culture” is unclear among students. Also gender might play a role in determining what is perceived as “authenticity.” In general the focus group discussion had a consensus that these three types of authenticity were the right ones to measured cultural attractions, people, and behaviors.

The *validation of an instrument for the assessment of study behaviors of high school students

The purpose of this study is to validate the Study Behavior Inventory-High School, an instrument designed to measure study behaviors of high school students and to determine the stability of its scores across populations and across grades. Numerous studies have shown the relationship between the level of students' use of appropriate study behaviors and their levels of academic achievement and this is particularly relevant at a time of increasing demands for school and teacher accountability for their students' academic achievement. ^ The instrument was administered to 3,336 students in grades 9 through 12 in four high schools in diverse parts of the United States. Factor analysis yielded a four factor structure for the instrument and evidence for its construct validity was obtained using convergent and discriminant methods. The four factors include academic self-perception and feelings of low self-efficacy, academic preparation behaviors, time management, and the social nature of taking tests and studying. Internal consistency reliability for the scores on each of the four factors was calculated and found to range between .68 and .87. Finally, confirmatory factor analysis indicated acceptable levels of fit between the factor structure obtained in this study and an earlier one obtained during a pilot study using 800 participants. ^ The SBI-HS appears to be a valid and reliable instrument for the measure of study behaviors in high school students. ^

The effects of school mobility in pre -assessment grade levels on student performance and school accountability in urban Title I schools

This study examined the effects of student mobility and educational enrollment experiences on academic achievement. The educational progress, school enrollments and transfers of inner-city elementary students were tracked over a four-year period. Student achievement was measured by criterion-referenced reading tests administered in the second semester of the third grade. It further analyzed the degree to which the switch to different basal reading textbooks interrupted the continuity of education thereby contributing to the detrimental effects of intra-district mobility. ^ Mobility histories of 2,913 third grade students were collected to evaluate the number of times each student entered or withdrew from a Miami-Dade County Public School beginning in August 2000 through March 2004, and distinguished between transfers that occurred during the academic school year and those that occurred during summer months. Data were analyzed using Pearson correlations and multiple regressions to determine if school mobility contributed to performance on the Florida Comprehensive Assessment Third Grade Reading Test (FCAT). Transferring from one school to another was found to have a significant negative impact on student test scores. Transfers within the academic school year were more detrimental than transfers that occurred during the summer months. Third grade students who transferred into schools that used the same reading textbook series were found to have significantly higher FCAT reading scores than third graders who transferred into schools that used different reading textbooks. ^ The effects of mobility rates on overall school performance were also examined. Data was collected on 124 Title I elementary schools to determine the degree to which mobility affected school accountability scores. Title I schools with high student mobility rates had significantly lower accountability scores than schools with lower student mobility rates. ^ The results of this study highlight the impact of education and housing policy and imply a need for programs and practices that promote stability in the early elementary years. ^

Increasing nurse's knowledge of neonatal pain assessment through inservice education program

Recognizing neonatal pain is a challenge for nurses working with newborns due to the complexity of the pain phenomenon. Pain is subjective, and infants lack the ability to communicate, and their pain is difficult to recognize. The purpose of this study is to determine the effectiveness of education on the NICU nurses' ability to assess neonatal pain. With a better understanding of pain theory and the effects of pain on the newborn the nurse will be better able to assess newborns with pain. Designed as a quasi-experimental one-group pretest and posttest study, the data was collected on a convenience sample of 49 registered nurses employed in the neonatal and special care nursery units at a Childrens Hospital in the Miami area. The nurses were surveyed on the assessment of neonatal pain using the General Information and Pain Sensitivity Questionnaire. After the initial survey, the nurses were inserviced on neonatal pain assessment using a one hour inservice education program. One week after the intervention the nurse was asked to complete the questionnaire again. Data analysis involved comparision of pre and post intervention findings using descriptive methods, t test, correlation coefficients, and ANOVA , where applicable. Findings revealed a significant ( p=.006) increase in nurse's knowledge of neonatal pain assessment after completing the educational inservice when comparing the pre-test and post-test results.

A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

OBJECTIVE: To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education. METHODS: In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. RESULTS: Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. CONCLUSIONS: Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.

Digital and Social Inequalities : A Qualitative Assessment of the Impact of the Connecting Equality Program on Argentinean Youth

This paper focuses on the ties between social and digital inequalities among Argentinean youth. It uses a qualitative approach to explore different aspects of the everyday lives of adolescents, such as sociability, leisure time and family use of Information and Communication Technologies (ICTs), in order to assess the impact of the Connecting Equality Program (Programa Conectar Igualdad, PCI) on reducing digital inequalities and fostering social inclusion. What were the existing conditions of access for students and their families when the PCI was first implemented? What influence does the implementation of the PCI have on the individual, family and scholastic appropriation of ICTs? How does the use of computers and the Internet vary among youth? Has this large-scale incorporation of netbooks in schools, and especially homes and free time changed it in any way? Does the appropriation of ICTs through student participation in the PCI contribute to material and symbolic social inclusion? In order to answer these questions, we compare the processes of ICT appropriation among lower and middle class adolescents, focusing on the distinctive uses and meanings assigned to computers and the Internet by boys and girls in their daily lives. For this purpose we analyze data collected through semi-structured interviews in two schools in Greater La Plata, Argentina during 2012. The main findings show that in terms of access, skills and types of use, the implementation of the PCI has had a positive impact among lower class youth, guaranteeing access to their first computers and promoting the sharing of knowledge and digital skills with family members. Moreover, evidence of more diverse and intense use of ICTs among lower class students reveals the development of digital skills related to educational activities. Finally, in terms of sociability, having a personal netbook enables access to information and cultural goods which are very significant in generating ties and strengthening identities and social integration