Development of a new student evaluation instrument of instructor effectiveness in online courses

The purpose of this study was to (a) develop an evaluation instrument capable of rating students' perceptions of the instructional quality of an online course and the instructor’s performance, and (b) validate the proposed instrument with a study conducted at a major public university. The instrument was based upon the Seven Principles of Good Practice for Undergraduate Education (Chickering & Gamson, 1987). The study examined four specific questions. 1. Is the underlying factor structure of the new instrument consistent with Chickering and Gamson's Seven Principles? 2. Is the factor structure of the new instrument invariant for male and female students? 3. Are the scores on the new instrument related students’ expected grades? 4. Are the scores on the new instrument related to the students' perceived course workload? ^ The instrument was designed to measure students’ levels of satisfaction with their instruction, and also gathered information concerning the students’ sex, the expected grade in the course, and the students’ perceptions of the amount of work required by the course. A cluster sample consisting of an array of online courses across the disciplines yielded a total 297 students who responded to the online survey. The students for each course selected were asked to rate their instructors with the newly developed instrument. ^ Question 1 was answered using exploratory factor analysis, and yielded a factor structure similar to the Seven Principles.^ Question 2 was answered by separately factor-analyzing the responses of male and female students and comparing the factor structures. The resulting factor structures for men and women were different. However, 14 items could be realigned under five factors that paralleled some of the Seven Principles. When the scores of only those 14 items were entered in two principal components factor analyses using only men and only women, respectively and restricting the factor structure to five factors, the factor structures were the same for men and women.^ A weak positive relationship between students’ expected grades and their scores on the instrument was found (Question 3). There was no relationship between students’ perceived workloads for the course and their scores on the instrument (Question 4).^

Planejamento de cursos online para professores de alemão: parâmetros em mapa conceitual

Distance-learning language courses are gaining ground because they meet contemporary social demands and expand opportunities for access to new knowledge. They also favor interaction among people with similar goals but who live in places where no live learning arrangements are available. Taking Valente (2002), Garrison and Anderson (2000), and other authors for theoretical bases, this paper reflects on the criteria and aspects to be considered when one plans and ministers online teacher training courses. The data were taken from a distance-based university extension course offered on the Moodle learning platform by a university in the State of São Paulo, Brazil. The objective was to encourage German language teachers to further develop their own language skills, reflect on aspects of inter-culturality in teaching the target language, and provide experience with current technological resources. This paper describes the elements that proved to be relevant in the creation and planning of the course, based on authors who deal with characteristics of computer-mediated teaching. The importance of this study is related to the fact that little information is available on the planning of courses in online formats.

Planning lessons and courses : designing sequences of work for the language classroom.

Recurso sobre la planificación de clases y cursos para estudiantes de inglés como lengua extranjera. La mayoría de los capítulos están organizados alrededor de preguntas que el profesor se podría hacer al planificar una lección o un curso. Cada capítulo ofrece respuestas a las preguntas planteadas o implícitas en el título del capítulo como: quiénes son los estudiantes; cuál es la lección; cómo se aprende; cómo puedo enseñar; qué materiales se pueden seleccionar; cómo empezar a trabajar en la planificación; qué actividades se pueden utilizar y adaptar.

The Impact of Teaching Presence in Intensive Online Courses on Perceived Learning and Sense of Community: A Mixed Methods Study

This mixed methods concurrent triangulation design study was predicated upon two models that advocated a connection between teaching presence and perceived learning: the Community of Inquiry Model of Online Learning developed by Garrison, Anderson, and Archer (2000); and the Online Interaction Learning Model by Benbunan-Fich, Hiltz, and Harasim (2005). The objective was to learn how teaching presence impacted students’ perceptions of learning and sense of community in intensive online distance education courses developed and taught by instructors at a regional comprehensive university. In the quantitative phase online surveys collected relevant data from participating students (N = 397) and selected instructional faculty (N = 32) during the second week of a three-week Winter Term. Student information included: demographics such as age, gender, employment status, and distance from campus; perceptions of teaching presence; sense of community; perceived learning; course length; and course type. The students claimed having positive relationships between teaching presence, perceived learning, and sense of community. The instructors showed similar positive relationships with no significant differences when the student and instructor data were compared. The qualitative phase consisted of interviews with 12 instructors who had completed the online survey and replied to all of the open-response questions. The two phases were integrated using a matrix generation, and the analysis allowed for conclusions regarding teaching presence, perceived learning, and sense of community. The findings were equivocal with regard to satisfaction with course length and the relative importance of the teaching presence components. A model was provided depicting relationships between and among teaching presence components, perceived learning, and sense of community in intensive online courses.

Key Aspects Affecting Students’ Perception Regarding the Instructional Quality of Online and Web Based Courses

This study assessed the perceptions of college students regarding the instructional quality of online and web based courses via a content management system. [See PDF for complete abstract]

Student perceptions of the impact of online discussion forum participation on learning outcomes

Choosing the “right” type of technology, either synchronous or asynchronous, to facilitate learning outcomes is a new challenge as the pace of emerging technologies increases and diversifies. Teachers are encouraged to design courses that require collaboration in online learning communities to facilitate the development of higher order thinking skills for life long learning. It is therefore important to gather evidence of the kinds of opportunities afforded to students and whether the students themselves endorse collaborative online tools as a legitimate method of assisting in their learning. This paper outlines the way in which one secondary school has used an online discussion forum to support students in the International Baccalaureate (IB) Diploma Program in enhancing research skills and skills for lifelong learning. The paper considers whether online collaborative tools are perceived by students as a positive way to improve learning outcomes.

A Freirian reading of online writing workshops

Online writing workshops provide educational spaces within which writers can learn and refine their craft. In order to better understand the dialogic mechanisms behind that learning, this paper examines ways in which online writing workshops might be described as functioning in manners akin to Freirian culture circles. This paper identifies several key characteristics that define Paulo Freire’s concept of the culture circle. It compares these characteristics to the structure of and interactive practices within an online writing workshop. It unpacks some of Freire’s ideas about codification and decodification of situated problems and about achieving critical consciousness, and examines how exemplars of this can be found in online writing workshops.

Online and Traditional Lectures: Evaluating Effects of Social Presence and Learner Control

Online courses are rapidly replacing traditional, face-to-face lectures in American universities (Allen & Seaman, 2011). As technology improves, this trend will likely continue and accelerate. Researchers must evaluate the impact of online courses compared to their traditional counterparts. This two-part study quantifies the effect of two variables – social presence and learner control – on students’ recall, application and perceived learning levels in different lecture formats. Students in introductory courses at a four-year, public, American university were randomly assigned into three groups to view distinct lecture formats, one in a traditional classroom and two via the Internet. Upon viewing the single lecture, the students were asked to fill out a test and survey to quantify teacher immediacy, recall and application, and perceived learning levels across lecture formats. The study found that different levels of social presence and learner control affected students’ perceived learning levels but did not impact recall or application.

Research in statistical education — planning of an international survey

As announced in the November 2000 issue of MathStats&OR [1], one of the projects supported by the Maths, Stats & OR Network funds is an international survey of research into pedagogic issues in statistics and OR. I am taking the lead on this and report here on the progress that has been made during the first year. A paper giving some background to the project and describing initial thinking on how it might be implemented was presented at the 53rd session of the International Statistical Institute in Seoul, Korea, in August 2001 in a session on The future of statistics education research [2]. It sounded easy. I considered that I was something of an expert on surveys having lectured on the topic for many years and having helped students and others who were doing surveys, particularly with the design of their questionnaires. Surely all I had to do was to draft a few questions, send them electronically to colleagues in statistical education who would be only to happy to respond, and summarise their responses? I should have learnt from my experience of advising all those students who thought that doing a survey was easy and to whom I had to explain that their ideas were too ambitious. There are several inter-related stages in survey research and it is important to think about these before rushing into the collection of data. In the case of the survey in question, this planning stage revealed several challenges. Surveys are usually done for a purpose so even before planning how to do them, it is advisable to think about the final product and the dissemination of results. This is the route I followed.

Making the law accessible to non-lawyers: effects of different kinds of expertise on perceived usability of online legal information services

To help design an environment in which professionals without legal training can make effective use of public sector legal information on planning and the environment - for Add-Wijzer, a European e-government project - we evaluated their perceptions of usefulness and usability. In concurrent think-aloud usability tests, lawyers and non-lawyers carried out information retrieval tasks on a range of online legal databases. We found that non-lawyers reported twice as many difficulties as those with legal training (p = 0.001), that the number of difficulties and the choice of database affected successful completion, and that the non-lawyers had surprisingly few problems understanding legal terminology. Instead, they had more problems understanding the syntactical structure of legal documents and collections. The results support the constraint attunement hypothesis (CAH) of the effects of expertise on information retrieval, with implications for the design of systems to support the effective understanding and use of information.

The importance of online tourism demand

In recent decades, the combination of tourism and Information and Communication Technologies (ICT), has originated considerable changes in tourists’ behaviour. The analysis of tourism demand resulting from the Internet is of growing importance, given the increasing number of online reservations observed in recent years. However, in order to analyse the new trends caused by online bookings, the availability of data enabling the measurement and characterization of this phenomenon is essential. This has, however, been a considerable limitation, given that either no data on key variables is available or the available data is sometimes of questionable quality. For professionals and researchers in the area of tourism, the high volume of tourists who use the Internet to make hotel and travel reservations is worth of consideration, given that it may potentiate the discovery of new source markets, the identification of clients with different characteristics and may help explain the dynamics between suppliers or countries. The existence of predictive studies to support decision-making and planning, by professionals of the tourism sector, is of great importance. Panel data models are a useful and appropriate method for the analysis and modelling of tourism demand. These models consider both the time series and the cross-sectional dimensions of the data and allow for the inclusion of social variables. The results of estimation of tourism demand, through panel data models, show that the Internet and the sharp technological development have encouraged the increasing demand for tourism. The growing number of tourism companies online will naturally promote or potentiate an increase of tourism demand.

Design a computer programming learning environment for Massive Open Online Courses

Teaching and learning computer programming is as challenging as difficult. Assessing the work of students and providing individualised feedback to all is time-consuming and error prone for teachers and frequently involves a time delay. The existent tools and specifications prove to be insufficient in complex evaluation domains where there is a greater need to practice. At the same time Massive Open Online Courses (MOOC) are appearing revealing a new way of learning, more dynamic and more accessible. However this new paradigm raises serious questions regarding the monitoring of student progress and its timely feedback. This paper provides a conceptual design model for a computer programming learning environment. This environment uses the portal interface design model gathering information from a network of services such as repositories and program evaluators. The design model includes also the integration with learning management systems, a central piece in the MOOC realm, endowing the model with characteristics such as scalability, collaboration and interoperability. This model is not limited to the domain of computer programming and can be adapted to any complex area that requires systematic evaluation with immediate feedback.

Guidelines for strategic national planning of training and education for museums, cultural heritage and related fields in Sweden and in international co-operation

The guidelines presented in this document are a preliminary strategy for establishing a comprehensive policy for the needs of training and education wiyhin the sector and adjoining areas, across fields of knowledge and professions concerned, on relevant levels and for the varies institutions and operators. The objective of these guidelines is to analysis the problems, objectives and goals for development of a far reaching system of educational and training programs and courses for museums, cultural heritage and related fields of activities. This objective comprises a close collaboration between museum, cultural heritage organizations and educating organizations, notably within universities and colleges, but also other kinds of educating bodies.

Massive Open Online Courses on health and medicine: review

Background: Massive Open Online Courses (MOOCs) have become immensely popular in a short span of time. However, there is very little research exploring MOOCs in the discipline of Health and Medicine. This paper is aimed to fill this void by providing a review of Health and Medicine related MOOCs. Objective: Provide a review of Health and Medicine related MOOCs offered by various MOOC platforms within the year 2013. Analyze and compare the various offerings, their target audience, typical length of a course and credentials offered. Discuss opportunities and challenges presented by MOOCs in the discipline of Health and Medicine. Methods: Health and Medicine related MOOCs were gathered using several methods to ensure the richness and completeness of data. Identified MOOC platform websites were used to gather the lists of offerings. In parallel, these MOOC platforms were contacted to access official data on their offerings. Two MOOC aggregator sites (Class Central and MOOC List) were also consulted to gather data on MOOC offerings. Eligibility criteria were defined to concentrate on the courses that were offered in 2013 and primarily on the subject ‘Health and Medicine’. All language translations in this paper were achieved using Google Translate. Results: The search identified 225 courses out of which 98 were eligible for the review (n = 98). 58% (57) of the MOOCs considered were offered on the Coursera platform and 94% (92) of all the MOOCs were offered in English. 90 MOOCs were offered by universities and the John Hopkins University offered the largest number of MOOCs (12). Only three MOOCs were offered by developing countries (China, West Indies, and Saudi Arabia). The duration of MOOCs varied from three weeks to 20 weeks with an average length of 6.7 weeks. On average MOOCs expected a participant to work on the material for 4.2 hours a week. Verified Certificates were offered by 14 MOOCs while three others offered other professional recognition. Conclusions: The review presents evidence to suggest that MOOCs can be used as a way to provide continuous medical education. It also shows the potential of MOOCs as a means of increasing health literacy among the public.