Do Proctored Exams Matter In Online Classes?

Does the format of assessment (proctored or un-proctored exams) affect test scores in online principles of economics classes? This study uses data from two courses of principles of economics taught by the same instructor to gain some insight into this issue. When final exam scores are regressed against human capital factors, the R-squared statistic is 61.6% for the proctored format exams while it is only 12.2% for the un-proctored format. Three other exams in the class that had the proctored final were also un-proctored and also produced lower R-squared values, averaging 30.5%. These two findings suggest that some cheating may have taken place in the un-proctored exams. Although it appears some cheating took place, the results suggest that cheating did not pay for these students since the proctored exam grades were 4.9 points higher than the un-proctored exam grades although this difference was significantly different at only the 10% level. One possible explanation for this is that there was slightly higher human capital in the class that had the proctored exam although this must have occurred by chance since the students did not know if the exams were going to be proctored in advance so there is no issue of selection bias. A Oaxaca decomposition of this difference in grades was conducted to see how much was due to human capital and how much was due to the differences in the rates of return to human capital. This analysis reveals that 17% of the difference was due to the higher human capital with the remaining 83% due to differences in the returns to human capital. It is possible that the un-proctored exam format does not encourage as much studying as the proctored format reducing both the returns to human capital and the exam scores.

Student Performance in Traditional vs. Online Format: Evidence from an MBA Level Introductory Economics Class

All previous studies comparing online and face-to-face format for instruction of economics compared courses that were either online or face-to-face format and regressed exam scores on selected student characteristics. This approach is subject to the econometric problems of self-selection omitted unobserved variables. Our study uses two methods to deal with these problems. First we eliminate self-selection bias by using students from a course that uses both instruction formats. Second, we use the exam questions as the unit of observation, and eliminate omitted variable bias by using an indicator variable for each student to capture the effect of differences in unobserved student characteristics on learning outcomes. We report the finding that students had a significantly greater chance of answering a question correctly if it came from a chapter covered online.

Predictive validity of the personal background and preparation survey and effectiveness of targeted interventions among health science community college students

Existing data, collected from 1st-year students enrolled in a major Health Science Community College in the south central United States, for Fall 2010, Spring 2011, Fall 2011 and Spring 2012 semesters as part of the "Online Navigational Assessment Vehicle, Intervention Guidance, and Targeting of Risks (NAVIGATOR) for Undergraduate Minority Student Success" with CPHS approval number HSC-GEN-07-0158, was used for this thesis. The Personal Background and Preparation Survey (PBPS) and a two-question risk self-assessment subscale were administered to students during their 1st-year orientation. The PBPS total risk score, risk self-assessment total and overall scores, and Under Representative Minority Student (URMS) status were recorded. The purpose of this study is to evaluate and report the predictive validity of the indicators identified above for Adverse Academic Status Events (AASE) and Nonadvancement Adverse Academic Status Events (NAASE) as well as the effectiveness of interventions targeted using the PBPS among a diverse population of health science community college students. The predictive validity of the PBPS for AASE has previously been demonstrated among health science professions and graduate students (Johnson, Johnson, Kim, & McKee, 2009a; Johnson, Johnson, McKee, & Kim, 2009b). Data will be analyzed using binary logistic regression and correlation using SPSS 19 statistical package. Independent variables will include baseline- versus intervention-year treatments, PBPS, risk self-assessment, and URMS status. The dependent variables will be binary AASE and NAASE status. ^ The PBPS was the first reliable diagnostic and prescriptive instrument to establish documented predictive validity for student Adverse Academic Status Events (AASE) among students attending health science professional schools. These results extend the documented validity for the PBPS in predicting AASE to a health science community college student population. Results further demonstrated that interventions introduced using the PBPS were followed by approximately one-third reduction in the odds of Nonadvancement Adverse Academic Status Events (NAASE), controlling for URMS status and risk self-assessment scores. These results indicate interventions introduced using the PBPS may have potential to reduce AASE or attrition among URMS and nonURMS attending health science community colleges on a broader scale; positively impacting costs, shortages, and diversity of health science professionals.^

The impact of communication and cultural diversity in utilizing dental services among Saudi Arabian students in U.S.A.

Objectives: The purpose of this study is to understand the perceived effects of patient-dental staff communication and cultural diversity on the utilization of dental services in the U.S. by Saudi Arabian students who live in the U.S. and enrolled into the King Abdullah Scholarship program. Methods: The study design was an analytical cross-sectional study. Data for this study was obtained from the Saudi Dental Servicers Utilization Survey, a voluntary internet survey available online for one month through Facebook. Ordered logistic regression analyses and multinomial logistic regression analyses were used to measure the relationships between patient-dental staff communication and cultural diversity on the utilization of dental services. Results: Eight hundred and forty-seven responses were analyzed for this study. Overall, the majority of Saudi students reported having excellent communication experience with dental providers in the U.S. More than 58% of respondents reported at least one regular dental visit last year. Factors that influenced the use of regular dental care were: dentist's explanation of treatment plan, response of dental staff to patient's needs, respectful and polite dental staff, dental staff kindness, availability of up-to-date equipment, and overall communication with dentist. However, the utilization of emergency dental care was not associated with any measurement of patient-dental provider communication. Overall future utilization of dental care is associated with all aspects of patient-dental staff communication measured in this survey. Furthermore, more utilization of regular dental care was related to respondent's perception of the importance of trustworthiness dental staff and the importance of a dentist's reputation was only marginally associated. Respondent's perception of dentist's reputation was associated with more use of emergency dental services. Respondents are more likely to anticipate using dental care in the future if they perceived trustworthiness dental staff, and the dentist's reputation as influencing factors to their usage of dental services. Conclusions: Patient-dental staff communication was partially associated with utilization of regular dental care, not associated with utilization of emergency dental care, and broadly associated with anticipated future utilization of dental care. In addition, trustworthy dental staff, and a dentist's reputation were considered to be strong influencing factors towards utilization of dental services.^

Cuestionarios online como herramienta de aprendizaje: comparación de resultados con diversos modelos de cuestionarios.

En este trabajo se comparan dos estrategias de evaluación a través de cuestionarios online: i) realizar un cuestionario de evaluación sumativa al final de cada bloque temático del curso o ii) permitir que, para cada bloque temático, el alumno pueda repetir varias veces un test (con realimentación de las respuestas correctas) y realizar un test similar después de esta fase de aprendizaje. Los resultados muestran varios beneficios de la segunda estrategia: una mayor participación de los alumnos hasta el final del semestre, una menor tasa de abandono de la asignatura y una mejor nota en los test. Sin embargo, para que el aprendizaje sea efectivo en el caso de repetir varias veces un test, se necesita un banco de preguntas suficientemente amplio para que exista una probabilidad baja de que las preguntas no se repitan. Este problema se ha resuelto utilizando la posibilidad que presentan algunas plataformas de gestión del aprendizaje de generar automáticamente variantes numéricas de una misma pregunta. Por último se observa un grado de acuerdo muy elevado por parte de los alumnos con el peso que los resultados de los tests tienen en la nota final del curso, en el caso bajo estudio. Abstract: This work compares two different assessment strategies through online tests: i) summative assessment tests at the end of each part of the course or ii) the students can do selfassessment tests (with feedback) prior to a summative assessment test at the end of each part of the course. Results show that the second strategy yields several benefits: an increment in student participation till the end of the semester, a reduction in the drop-out rate and an increase in the mean test marks. However, a large item bank is necessary to effectively implement this second strategy. This problem has been addressed by using the automatic item generation facility offered by several learning management systems. Finally, a high proportion of the students agree with the weight proposed for these tests in the final course mark.

Using online presence to improve online collaborative learning

Social software tools have become an integral part of students? personal lives and their primary communication medium. Likewise, these tools are increasingly entering the enterprise world (within the recent trend known as Enterprise 2.0) and becoming a part of everyday work routines. Aiming to keep the pace with the job requirements and also to position learning as an integral part of students? life, the field of education is challenged to embrace social software. Personal Learning Environments (PLEs) emerged as a concept that makes use of social software to facilitate collaboration, knowledge sharing, group formation around common interests, active participation and reflective thinking in online learning settings. Furthermore, social software allows for establishing and maintaining one?s presence in the online world. By being aware of a student's online presence, a PLE is better able to personalize the learning settings, e.g., through recommendation of content to use or people to collaborate with. Aiming to explore the potentials of online presence for the provision of recommendations in PLEs, in the scope of the OP4L project, we have develop a software solution that is based on a synergy of Semantic Web technologies, online presence and socially-oriented learning theories. In this paper we present the current results of this research work.

Online games for the teaching of mathematics

In this article we present a didactic experience developed by the GIE (Group of Educational Innovation) “Pensamiento Matemático” of the Polytechnics University of Madrid (UPM), in order to bring secondary students and university students closer to Mathematics. It deals with the development of a virtual board game called Mate-trivial. The mechanics of the game is to win points by going around the board which consists of four types of squares identified by colours: “Statistics and Probability”, “Calculus and Analysis”, “Algebra and Geometry” and “Arithmetic and Number Theory ”. When landing on a square, a question of its category is set out: a correct answer wins 200 points, if wrong it loses 100 points, and not answering causes no effect on the points, but all the same, two minutes out of the 20 minutes that each game lasts are lost. For the game to be over it is necessary, before those 20 minutes run out, to reach the central square and succeed in the final task: four chained questions, one of each type, which must be all answered correctly. It is possible to choose between two levels to play: Level 1, for pre-university students and Level 2 for university students. A prototype of the game is available at the website “Aula de Pensamiento Matemático” developed by the GIE: http://innovacioneducativa.upm.es/pensamientomatematico/. This activity lies within a set of didactic actions which the GIE is developing in the framework of the project “Collaborative Strategies between University and Secondary School Education for the teaching and learning of Mathematics: An Application to solve problems while playing”, a transversal project financed by the UPM.

Actividades online de vocabulario y pronunciación para el nivel de la lengua inglesa A2

El objetivo del presente proyecto es proporcionar una actividad de la pronunciación y repaso de vocabulario en lengua inglesa para la plataforma Moodle alojada en la página web de Integrated Language Learning Lab (ILLLab). La página web ILLLab tiene el objetivo de que los alumnos de la EUIT de Telecomunicación de la UPM con un nivel de inglés A2 según el Marco Común Europeo de Referencia para las Lenguas (MCERL), puedan trabajar de manera autónoma para avanzar hacia el nivel B2 en inglés. La UPM exige estos conocimientos de nivel de inglés para cursar la asignatura English for Professional and Academic Communication (EPAC) de carácter obligatorio e impartida en el séptimo semestre del Grado en Ingeniería de Telecomunicaciones. Asimismo, se persigue abordar el problema de las escasas actividades de expresión oral de las plataformas de autoaprendizaje se dedican a la formación en idiomas y, más concretamente, al inglés. Con ese fin, se proporciona una herramienta basada en sistemas de reconocimiento de voz para que el usuario practique la pronunciación de las palabras inglesas. En el primer capítulo del trabajo se introduce la aplicación Traffic Lights, explicando sus orígenes y en qué consiste. En el segundo capítulo se abordan aspectos teóricos relacionados con el reconocimiento de voz y se comenta sus funciones principales y las aplicaciones actuales para las que se usa. El tercer capítulo ofrece una explicación detallada de los diferentes lenguajes utilizados para la realización del proyecto, así como de su código desarrollado. En el cuarto capítulo se plantea un manual de usuario de la aplicación, exponiendo al usuario cómo funciona la aplicación y un ejemplo de uso. Además, se añade varias secciones para el administrador de la aplicación, en las que se especifica cómo agregar nuevas palabras en la base de datos y hacer cambios en el tiempo estimado que el usuario tiene para acabar una partida del juego. ABSTRACT: The objective of the present project is to provide an activity of pronunciation and vocabulary review in English language within the platform Moodle hosted at the Integrated Language Learning Lab (ILLLab) website. The ILLLab website has the aim to provide students at the EUIT of Telecommunication in the UPM with activities to develop their A2 level according to the Common European Framework of Reference for Languages (CEFR). In the platform, students can work independently to advance towards a B2 level in English. The UPM requires this level of English proficiency for enrolling in the compulsory subject English for Professional and Academic Communication (EPAC) taught in the seventh semester of the Degree in Telecommunications Engineering. Likewise, this project tries to provide alternatives to solve the problem of scarce speaking activities included in the learning platforms that offer language courses, and specifically, English language courses. For this purpose, it provides a tool based on speech recognition systems so that the user can practice the pronunciation of English words. The first chapter of the project introduces the application Traffic Lights, explaining its origins and what it is. The second chapter deals with theoretical aspects related with speech recognition and comments their main features and current applications for which it is generally used. The third chapter provides a detailed explanation of the different programming languages used for the implementation of the project and reviews its code development. The fourth chapter presents an application user manual, exposing to the user how the application works and an example of use. Also, several sections are added addressed to the application administrator, which specify how to add new words to the database and how to make changes in the original stings as could be the estimated time that the user has to finish the game.

An online e-Learning authoring tool to create interactive multi-device learning objects using e-Infrastructure resources

Education can take advantage of e-Infrastructures to provide teachers with new opportunities to increase students' motivation and engagement while they learn. Nevertheless, teachers need to find, integrate and customize the resources provided by e-Infrastructures in an easy way. This paper presents ViSH Editor, an innovative web-based e-Learning authoring tool that aims to allow teachers to create new learning objects using e-Infrastructure resources. These new learning objects are called Virtual Excursions and are created as reusable, granular and interoperable learning objects. This way they can be reused to build new ones and they can be integrated in websites or Learning Management Systems. Details about the design, development and the tool itself are explained in this paper as well as the concept, structure and metadata of the new learning objects. Lastly, some real examples of how to enrich learning using Virtual Excursions are exposed.

The online case study development for the teaching of building structures reinforcement

The Reinforcement of Building Structures is one of the topics of the Master in Building Innovation Technology (MBIT) of Universidad Politécnica de Madrid (UPM). Since the beginning of the delivery of this master, case studies have been chosen as the teaching methodology. For the 2011-2012 course the online education of this subject was implemented, instead of the classical learning based on attendance. Through ICT’s (Information and Communication Technologies) students are provided with much more and more selective information than through the classical learning. ICT’s can be used for search, enquiries and reporting. Using the online tools has been proved, through the results obtained and based on the surveys made amongst students, to be a successful experience.

An Online Course on the History of Algorithms.

This paper describes the objectives, content, learning methodology and results of an online course on the History of Algorithms for engineering students at Polytechnic University of Madrid (UPM). This course is conducted in a virtual environment based on Moodle, with a student-centred educational model which includes a detailed planning of learning activities. Our experience indicates that this subject is highly motivating for students and the virtual environment facilitates competencies development

Stoichiometry in Context: Inquiry-Guided Problems of Chemistry for Encouraging Critical Thinking in Engineering Students

This paper focuses on examples of educational tools concerning the learning of chemistry for engineering students through different daily life cases. These tools were developed during the past few years for enhancing the active role of students. They refer to cases about mineral water, medicaments, dentifrices and informative panels about solar power, where an adequate quantitative treatment through stoichiometry calculations allows the interpretation of data and values announced by manufacturers. These cases were developed in the context of an inquiry-guided instruction model. By bringing tangible chemistry examples into the classroom we provide an opportunity for engineering students to apply this science to familiar products in hopes that they will appreciate chemistry more, will be motivated to study concepts in greater detail, and will connect the relevance of chemistry to everyday life.

Evaluación para el aprendizaje en la asignatura sistemas operativos en modalidad online: un estudio cualitativo basado en la taxonomía de Bloom

La asignatura Sistemas Operativos presenta dificultades para su aprendizaje, pero poco se conoce acerca de las mismas, ya que no han sido determinadas ni estudiadas por la literatura. Asimismo, los trabajos existentes sobre la enseñanza y aprendizaje de Sistemas Operativos se limitan a proponer distintos enfoques para impartir la asignatura y en general no evalúan el aprendizaje de los estudiantes para comprobar la eficacia del método propuesto ni usan metodologías de investigación rigurosas. Por otra parte, la impartición de la asignatura Sistemas Operativos en modalidad online ha sido escasamente estudiada y podría tener dificultades adicionales a las de la modalidad presencial, ya que el contexto online impone una serie de restricciones tanto para el profesor como para el estudiante. En la presente tesis se ha llevado a cabo una evaluación formativa en la asignatura Sistemas Operativos, perteneciente al Grado de Ingeniería Informática de una universidad online. El objetivo inicial de la evaluación era descubrir las dificultades de los estudiantes para la comprensión de los conceptos de la asignatura. Posteriormente y, dada la buena aceptación de la evaluación por parte de los estudiantes, se ampliaron los objetivos del trabajo para explorar los efectos de la evaluación realizada sobre el aprendizaje. La evaluación formativa diseñada está basada en la taxonomía revisada de Bloom y sus principales objetivos son: (a) promover el aprendizaje significativo y (b) hacer a los estudiantes conscientes de su proceso de aprendizaje. La metodología de investigación utilizada es el estudio de caso cualitativo y la muestra está constituida por 9 estudiantes del total de 13 matriculados en la asignatura. Los datos cualitativos analizados proceden de las pruebas de evaluación formativa llevadas a cabo por los estudiantes durante la impartición de la asignatura. Los conceptos de sistemas operativos que han resultado más difíciles de comprender en el curso online estudiado han sido las interrupciones y los semáforos. Además, alrededor de estos conceptos se han identificado las dificultades específicas y sus posibles causas. Las dificultades descubiertas acerca de los semáforos corroboran las investigaciones existentes en el área de programación concurrente. El resto de las dificultades identificadas no habían sido determinadas por la literatura existente. En cuanto a los efectos de la evaluación formativa sobre el aprendizaje, la evidencia empírica muestra que ésta ha provocado en los estudiantes una reflexión profunda sobre los conceptos de la asignatura y sobre su propio proceso de aprendizaje. El estudio de caso presentado puede ayudar a los profesores del área de ingeniería a crear evaluaciones formativas en cursos online. La tesis, por tanto, realiza aportaciones relevantes en las áreas de enseñanza y aprendizaje de sistemas operativos, evaluación formativa, metodologías cualitativas y educación online. ABSTRACT Operating Systems is a difficult subject to learn; however little is known about said difficulties, as they have not been studied nor determined by the relevant literature. Existing studies on teaching and learning the subject of operating systems are limited to presenting different approaches for teaching the subject and generally do not evaluate students’ learning to verify the effectiveness of the proposed methods, nor do they use rigorous research methodologies. On the other hand, there are very few studies on teaching operating systems online, which may inherently present more difficulties than the in-person format, since an online context imposes a series of restrictions on both professors and students, such as not having face-to-face interaction for communications. This thesis studies a formative assessment of the subject of operating systems, as part of the Degree in Information Technology Engineering for an online university. The initial objective of this assessment was to determine the students’ difficulties in conceptual comprehension for this subject. Once students had accepted the assessment, the study’s objectives were expanded to include an investigation of the effects of the assessment on learning. The designed formative assessment was based on Revised Bloom’s Taxonomy with the following main objectives: (a) to promote meaningful learning and (b) (b) to make students aware of their learning process. The research methodology involves a qualitative case study with a sample consisting of 9 of the total 13 students registered for this course. The qualitative data analyzed comes from the formative assessment tests taken by these students during the course. The most difficult operating systems concepts for students in the online course were interrupts and semaphores. Additionally, the specific difficulties and their possible causes have been identified. The students’ comprehension difficulties with semaphores corroborate the existing research in the area of concurrent programming. The other identified difficulties were not discussed in the existing literature. Regarding the effects of the formative assessment on learning, the empirical evidence shows that it causes students to reflect carefully on the subject’s concepts as well as their own learning process. The presented case study can help professors in the area of engineering to create formative assessments for online courses. This thesis, therefore, makes relevant contributions to the areas of teaching and learning operating systems, formative assessment, qualitative methodologies, and online education.

Assessing Creativity In Engineering Students: A Comparative Between Degrees and Sudents In First And Last Year

An online open access test (CREAX self-assessment) has been used in this work so that students from degrees in engineering in the Universidad Polite¿cnica of Madrid (UPM) could self-assess their creative competence after several classroom activities. Different groups from the first year course have been statistically compared using data from their assessment. These first year students had different professors in the subject ?Technical Drawing? and belonged to several degrees in the UPM. They were as well compared regarding sex and a group of first year students was also compared to another last year group of the degree so as to observe possible differences in the achievement of this competence. Only one difference was detected concerning sex in one of the degrees. Among degrees, the higher marks obtained by students who had done specific exercises for the development of creativity in class is highlighted. Finally, a significantly high mark was observed in students during their last year of degree with respect to first year students. The tool CREAX has become very useful in the assessment of this competence in the UPM degrees in which it has been implemented.

Soft Skills: A Comparative Analysis Between Online and Classroom Teaching

Currently the Spanish universities are making a great effort to effectively incorporate the development and assessment of generic skills in their training programs. Information and communications technologies (ICT) offer a wide range of possibilities but create uncertainty among teachers about the process and results. It is considered of interest to conduct a study to analyze the extent to which social skills like commitment, communication and teamwork are acquired by students and teachers. It seeks to ascertain the influence of the learning context, online or classroom training, in the development of these personal skills among the participants in the sample. For this study two universities have been chosen, Universidad a Distancia de Madrid (UDIMA) offering online training environment, and Universidad Politécnica de Madrid (UPM) with classroom training modality. A total of 257 individuals, 230 students and 27 teachers have answered the survey called Evalsoft. This instrument was designed in the project with the same name by a research team from Universidad Complutense of Madrid (UCM). Some interesting conclusions can be highlighted: it is in the online context where there are higher levels of commitment and teamwork than in the classroom modality; teachers have higher social skills that students and these improve with age. Sex and the training program appear to influence these social skills.