Development and validation of an instrument to predict online student success using faculty perceptions

Distance learning is growing and transforming educational institutions. The increasing use of distance learning by higher education institutions and particularly community colleges coupled with the higher level of student attrition in online courses than in traditional classrooms suggests that increased attention should be paid to factors that affect online student course completion. The purpose of the study was to develop and validate an instrument to predict community college online student course completion based on faculty perceptions, yielding a prediction model of online course completion rates. Social Presence and Media Richness theories were used to develop a theoretically-driven measure of online course completion. This research study involved surveying 311 community college faculty who taught at least one online course in the past 2 years. Email addresses of participating faculty were provided by two south Florida community colleges. Each participant was contacted through email, and a link to an Internet survey was given. The survey response rate was 63% (192 out of 303 available questionnaires). Data were analyzed through factor analysis, alpha reliability, and multiple regression. The exploratory factor analysis using principal component analysis with varimax rotation yielded a four-factor solution that accounted for 48.8% of the variance. Consistent with Social Presence theory, the factors with their percent of variance in parentheses were: immediacy (21.2%), technological immediacy (11.0%), online communication and interactivity (10.3%), and intimacy (6.3%). Internal consistency of the four factors was calculated using Cronbach's alpha (1951) with reliability coefficients ranging between .680 and .828. Multiple regression analysis yielded a model that significantly predicted 11% of the variance of the dependent variable, the percentage of student who completed the online course. As indicated in the literature (Johnson & Keil, 2002; Newberry, 2002), Media Richness theory appears to be closely related to Social Presence theory. However, elements from this theory did not emerge in the factor analysis.

New media data to identify student training needs

The main objective is to exhibit how usage data from new media can be used to assess areas where students need more help in creating their ETDs. After attending this session, attendees will be able to use usage data from new media, in conjunction with traditional assessment data, to identify strengths and weaknesses in ETD training and resources. The burgeoning ETD program at Florida International University (FIU) has provided many opportunities to experiment with assessment strategies and new media. The usage statistics from YouTube and the ETD LibGuide revealed areas of strength and weakness in the training resources and the overall ETD training initiative. With the ability to assess these materials, they have been updated to better meet student needs. In addition to these assessment tools, there are opportunities to connect these statistics with data from a common error checklist, student feedback from ETD workshops, and final ETD submission surveys to create a full-fledged outcome based assessment program for the ETD initiative.

Development of a new student evaluation instrument of instructor effectiveness in online courses

The purpose of this study was to (a) develop an evaluation instrument capable of rating students' perceptions of the instructional quality of an online course and the instructor’s performance, and (b) validate the proposed instrument with a study conducted at a major public university. The instrument was based upon the Seven Principles of Good Practice for Undergraduate Education (Chickering & Gamson, 1987). The study examined four specific questions. 1. Is the underlying factor structure of the new instrument consistent with Chickering and Gamson's Seven Principles? 2. Is the factor structure of the new instrument invariant for male and female students? 3. Are the scores on the new instrument related students’ expected grades? 4. Are the scores on the new instrument related to the students' perceived course workload? ^ The instrument was designed to measure students’ levels of satisfaction with their instruction, and also gathered information concerning the students’ sex, the expected grade in the course, and the students’ perceptions of the amount of work required by the course. A cluster sample consisting of an array of online courses across the disciplines yielded a total 297 students who responded to the online survey. The students for each course selected were asked to rate their instructors with the newly developed instrument. ^ Question 1 was answered using exploratory factor analysis, and yielded a factor structure similar to the Seven Principles.^ Question 2 was answered by separately factor-analyzing the responses of male and female students and comparing the factor structures. The resulting factor structures for men and women were different. However, 14 items could be realigned under five factors that paralleled some of the Seven Principles. When the scores of only those 14 items were entered in two principal components factor analyses using only men and only women, respectively and restricting the factor structure to five factors, the factor structures were the same for men and women.^ A weak positive relationship between students’ expected grades and their scores on the instrument was found (Question 3). There was no relationship between students’ perceived workloads for the course and their scores on the instrument (Question 4).^

Online Education, Accrediting Standards, and Student Success: An Examination of the Relationship Between the Southern Association of Colleges and Schools Commission on Colleges Standards for Online Education and Student Success

Prior to 2000, there were less than 1.6 million students enrolled in at least one online course. By fall 2010, student enrollment in online distance education showed a phenomenal 283% increase to 6.1 million. Two years later, this number had grown to 7.1 million. In light of this significant growth and skepticism about quality, there have been calls for greater oversight of this format of educational delivery. Accrediting bodies tasked with this oversight have developed guidelines and standards for online education. There is a lack of empirical studies that examine the relationship between accrediting standards and student success. The purpose of this study was to examine the relationship between the presence of Southern Association of Colleges and Schools Commission on College (SACSCOC) standards for online education in online courses, (a) student support services and (b) curriculum and instruction, and student success. An original 24-item survey with an overall reliability coefficient of .94 was administered to students (N=464) at Florida International University, enrolled in 24 university-wide undergraduate online courses during fall 2014, who rated the presence of these standards in their online courses. The general linear model was utilized to analyze the data. The results of the study indicated that the two standards, student support services and curriculum and instruction were both significantly and positively correlated with student success but with small R2 and strengths of association less than .35 and .20 respectively. Mixed results were produced from Chi-square tests for differences in student success between higher and lower rated online courses when controlling for various covariates such as discipline, gender, race/ethnicity, GPA, age, and number of online courses previously taken. A multiple linear regression analysis revealed that the curriculum and instruction standard was the only variable that accounted for a significant amount of unique variance in student success. Another regression test revealed that no significant interaction effect exists between the two SACSCOC standards and GPA in predicting student success. The results of this study are useful for administrators, faculty, and researchers who are interested in accreditation standards for online education and how these standards relate to student success.

Toward an Understanding of Faculty Perceptions about Factors that Influence Student Success in Online Education

This paper explores factors that faculty perceive as significant in influencing student success in online education. Technological support, degree of comfort with technology and a student’s personal characteristics were deemed by faculty as critical to success. Understanding these key factors could help to improve student success in online education.

Accountability, Quality, and Student Success in Online Education: A Literature Review of Empirical Studies

This paper examines empirical studies on accountability, quality, and student success in online education. It advances that accountability and quality are critical components for student success in online education. It concludes that there is a lack of empirical studies that examine the effects of these measures on student success.

Online education, accrediting standards, and student success: An examination of the relationship between the southern association of colleges and schools commission on colleges standards for online education and student success

Prior to 2000, there were less than 1.6 million students enrolled in at least one online course. By fall 2010, student enrollment in online distance education showed a phenomenal 283% increase to 6.1 million. Two years later, this number had grown to 7.1 million. In light of this significant growth and skepticism about quality, there have been calls for greater oversight of this format of educational delivery. Accrediting bodies tasked with this oversight have developed guidelines and standards for online education. ^ There is a lack of empirical studies that examine the relationship between accrediting standards and student success. The purpose of this study was to examine the relationship between the presence of Southern Association of Colleges and Schools Commission on College (SACSCOC) standards for online education in online courses, (a) student support services and (b) curriculum and instruction, and student success. An original 24-item survey with an overall reliability coefficient of .94 was administered to students (N=464) at Florida International University, enrolled in 24 university-wide undergraduate online courses during fall 2014, who rated the presence of these standards in their online courses. The general linear model was utilized to analyze the data. The results of the study indicated that the two standards, student support services and curriculum and instruction were both significantly and positively correlated with student success but with small R2 and strengths of association less than .35 and .20 respectively. Mixed results were produced from Chi-square tests for differences in student success between higher and lower rated online courses when controlling for various covariates such as discipline, gender, race/ethnicity, GPA, age, and number of online courses previously taken. A multiple linear regression analysis revealed that the curriculum and instruction standard was the only variable that accounted for a significant amount of unique variance in student success. Another regression test revealed that no significant interaction effect exists between the two SACSCOC standards and GPA in predicting student success. ^ The results of this study are useful for administrators, faculty, and researchers who are interested in accreditation standards for online education and how these standards relate to student success.^

The effect of mentoring electronic mail on student achievement and attitudes in a graduate course in educational research

This exploratory study of a classroom with mentoring and neutral e-mail was conducted in a public commuter state university in South Florida between January 1996 and April 1996. Sixteen males and 83 females from four graduate level educational research classes participated in the study.^ Two main hypotheses were tested. Hypothesis One was that those students receiving mentoring e-mail messages would score significantly higher on an instrument measuring attitude toward educational research (ATERS) than those not receiving mentoring e-mail messages. Hypothesis Two was that those students receiving mentoring e-mail would score significantly higher on objective exams covering the educational research material than those not receiving mentoring e-mail.^ Results of factorial analyses of variance showed no significant differences between the treatment groups in achievement or in attitudes toward educational research. Introverts had lower attitudes and lower final exam grades in both groups, although introverts in the mentored group scored higher than those introverts in the neutral group.^ A t test of the means of total response to e-mail from the researcher showed a significant difference between the mentored and neutral e-mail groups. Introverts responded more often than extraverts in both groups.^ Teacher effect was significant in determining class response to e-mail messages. Responses were most frequent in the researcher's classes.^ Qualitative analyses of the e-mail and course evaluation survey and of the content of e-mail messages received by the researcher were then grouped into basic themes and discussed.^ A qualitative analysis of an e-mail and course evaluation survey revealed that students from both the neutral and mentoring e-mail groups appreciated teacher feedback. A qualitative analysis of the mentoring and neutral e-mail replies divided the responses into those pertaining to the class, such as test and research paper questions, and more personal items, such as problems in the class and personal happenings.^ At this point in time, e-mail is not a standard way of communicating in classes in the college of education at this university. As this technology tool of communication becomes more popular, it is anticipated that replications of this study will be warranted. ^

Academic and nonacademic experiences that affect first-generation college student attrition

The purpose of this qualitative study was to explore the academic and nonacademic experiences of self-identified first-generation college students who left college before their second year. The study sought to find how the experiences might have affected the students' decision to depart. The case study method was used to investigate these college students who attended Florida International University. Semi-structured interviews were conducted with six ex-students who identified themselves as first-generation college students. The narrative data from the interviews were transcribed, coded, and analyzed. Analysis was informed by Pascarella, Pierson, Wolniak, and Terenzini's (2004) theoretical framework of important college academic and nonacademic experiences. An audit trail was kept and the data was triangulated by using multiple sources to establish certain findings. The most critical tool for enhancing trustworthiness was the use of member checking. I also received ongoing feedback from my major professor and committee throughout the dissertation process. The participants reported the following academic experiences: (a) patterns of coursework; (b) course-related interactions with peers; (c) relationships with faculty; (d) class size; (e) academic advisement; (f) orientation and peer advisors; and (e) financial aid. The participants reported the following nonacademic experiences; (f) on- or off- campus employment; (g) on- or off-campus residence; (h) participation in extracurricular activities; (i) noncourse-related peer relationships; (j) commuting and parking; and (k) FIU as an HSI. Isolationism and poor fit with the university were the most prevalent reasons for departure. The reported experiences of these first-generation college students shed light on those experiences that contributed to their departure. University administrators should give additional attention to these stories in an effort to improve retention strategies for this population. All but two of the participants went on to enroll in other institutions and reported good experiences with their new institutions. Recommendations are provided for continued research concerning how to best meet the needs of college students like the participants; students who have not learned from their parents about higher education financial aid, academic advisement, and orientation.

The examination of the relationships among secondary principals' leadership behaviors, school climate, and student achievement in an urban context

School principals' leadership is key to successful school reform, as is increased student achievement. This nonexperimental ex post facto study tested relationships among secondary school principals' leadership behaviors, school climate, and student achievement. Of 165 secondary school principals from the three largest school districts in South Florida, 58 completed three online survey instruments: the Leadership Practices Inventory, School Climate Inventory-Revised, and researcher-designed Demographic Questionnaire. Student achievement was measured by students' scores on the reading and mathematics Florida Comprehensive Assessment Tests. Three null hypotheses tested relationships among (a) five principals' leadership behaviors and seven domains of school climate; (b) principals' leadership behaviors and student achievement; and (c) principals' leadership behaviors, school climate, and student achievement. Multiple linear regressions were used to determine the degree to which the independent variables predicted the dependent variables for the first two hypotheses. ANOVAs tested possible group differences between the demographic and research variables as controls for the third hypothesis. Partial correlational analyses tested the strength and direction of relationships among leadership behaviors, climate, and achievement. Results revealed partial support of the hypotheses. None of the leadership variables significantly predicted school climate. No significant relationships were found among the five leadership behaviors and student achievement. Demographic group differences in school climate and student achievement were marginally significant. The leadership behaviors of Inspiring a Shared Vision and Enabling Others to Act were positively linked to reading achievement. Partial correlations were found (r .27 to −.35) among school climate variables of Order, Involvement, and Expectation and achievement variables. The Modeling the Way leadership variable was negatively associated with reading achievement. After controlling for gender, years at current school, and years in the district, partial positive correlations were found among leadership, school climate, and student achievement. Inspiring a Shared Vision, Enabling Others to Act, Encouraging the Heart, and Challenging the Process leadership variables were partially correlated to Order, Leadership (Instructional), and Expectation climate variables. Study results should provide policymakers and educators with a leadership profile for school leaders challenging the status quo who can create schools for enhanced student learning and relevance to the needs of students, families, and society.

Online News Media Impact on Disaster Response: October 26, 2010 Indonesian Disaster Case Study

This paper reflects a research project on the influence of online news media (from print, radio, and televised outlets) on disaster response. Coverage on the October 2010 Indonesian tsunami and earthquake was gathered from 17 sources from October 26 through November 30. This data was analyzed quantitatively with respect to coverage intensity over time and among outlets. Qualitative analyses were also conducted using keywords and value scale that assessed the degree of positivity or negativity associated with that keyword in the context of accountability. Results yielded insights into the influence of online media on actors' assumption of accountability and quality of response. It also provided information as to the optimal time window in which advocates and disaster management specialists can best present recommendations to improve policy and raise awareness. Coverage of outlets was analyzed individually, in groups, and as a whole, in order to discern behavior patterns for a better understanding of media interdependency. This project produced analytical insights but is primarily intended as a prototype for more refined and extensive research.

The relationship between faculty perceptions and implementation of elements of transactional distance theory and online web-based course completion rates

The purpose of this study was to explore the relationship between faculty perceptions, selected demographics, implementation of elements of transactional distance theory and online web-based course completion rates. This theory posits that the high transactional distance of online courses makes it difficult for students to complete these courses successfully; too often this is associated with low completion rates. Faculty members play an indispensable role in course design, whether online or face-to-face. They also influence course delivery format from design through implementation and ultimately to how students will experience the course. This study used transactional distance theory as the conceptual framework to examine the relationship between teaching and learning strategies used by faculty members to help students complete online courses. Faculty members' sex, number of years teaching online at the college, and their online course completion rates were considered. A researcher-developed survey was used to collect data from 348 faculty members who teach online at two prominent colleges in the southeastern part of United States. An exploratory factor analysis resulted in six factors related to transactional distance theory. The factors accounted for slightly over 65% of the variance of transactional distance scores as measured by the survey instrument. Results provided support for Moore's (1993) theory of transactional distance. Female faculty members scored higher in all the factors of transactional distance theory when compared to men. Faculty number of years teaching online at the college level correlated significantly with all the elements of transactional distance theory. Regression analysis was used to determine that two of the factors, instructor interface and instructor-learner interaction, accounted for 12% of the variance in student online course completion rates. In conclusion, of the six factors found, the two with the highest percentage scores were instructor interface and instructor-learner interaction. This finding, while in alignment with the literature concerning the dialogue element of transactional distance theory, brings a special interest to the importance of instructor interface as a factor. Surprisingly, based on the reviewed literature on transactional distance theory, faculty perceptions concerning learner-learner interaction was not an important factor and there was no learner-content interaction factor.

Users Acceptance of Online Enrollment Processes in a Higher Education Institution

Little is known about students’ perceptions of online enrollment processes. Student satisfaction is part of the assessment required for accreditation, but evidence suggests that college administrators are oriented to retention and graduation rates rather than to consumer perception. The purpose of this descriptive quantitative study was to develop and validate a model that enables the measurement of online enrollment processes by the analysis of the students’ perceptions. The theoretical framework used to support this study was the process virtualization theory while the conceptual framework was based on Technology Acceptance Model (TAM). TAM is the most valid framework for studying user acceptance of technology and virtual processes. The model was modified, adding a new variable to fit this study. Research questions were used to determine if an institution knows how its students perceive online enrollment processes and how they can become more efficient and effective, improving usage and satisfaction. Descriptive data were collected and analyzed in phases: the pilot study phase, data collection phase, and analysis phases. Inferential statistics were used to draw information from sampled observations of the population; a Cronbach Alpha was conducted to determine the reliability and validity of the model. The study demonstrated that the modified TAM is valid, reliable, and fit to assess the perceptions of the users of online enrollment processes. This study will effect positive social change by providing enrollment managers and administrators information on how to analyze the acceptance their online enrollment processes from the perspective of their students as customers of an institution of higher learning.

The relationship between socioeconomic status, course delivery method, and student success at a state college: A single institution analysis

In an effort to improve instruction and better accommodate the needs of students, community colleges are offering courses delivered in a variety of delivery formats that require students to have some level of technology fluency to be successful in the course. This study was conducted to investigate the relationship between student socioeconomic status (SES), course delivery method, and course type on enrollment, final course grades, course completion status, and course passing status at a state college. ^ A dataset for 20,456 students of low and not low SES enrolled in science, technology, engineering, and mathematics (STEM) course types delivered using traditional, online, blended, and web enhanced course delivery formats at Miami Dade College, a large open access 4-year state college located in Miami-Dade County, Florida, was analyzed. A factorial ANOVA using course type, course delivery method, and student SES found no significant differences in final course grades when used to determine if course delivery methods were equally effective for students of low and not low SES taking STEM course types. Additionally, three chi-square goodness-of-fit tests were used to investigate for differences in enrollment, course completion and course passing status by SES, course type, and course delivery method. The findings of the chi-square tests indicated that: (a) there were significant differences in enrollment by SES and course delivery methods for the Engineering/Technology, Math, and overall course types but not for the Natural Science course type and (b) there were no significant differences in course completion status and course passing status by SES and course types overall and SES and course delivery methods overall. However, there were statistically significant but weak relationships between course passing status, SES and the math course type as well as between course passing status, SES, and online and traditional course delivery methods. ^ The mixed findings in the study indicate that strides have been made in closing the theoretical gap in education and technology skills that may exist for students of different SES levels. MDC's course delivery and student support models may assist other institutions address student success in courses that necessitate students having some level of technology fluency. ^

A Basic Interpretive Study of the Experiences of University Students Who Have Dropped or Failed an Online Course

Online courses have increased in enrollments over the past few decades. As the number of students taking online courses have increased, so has the number of students who have dropped or failed an online course. According to the literature, online courses may have higher drop rates than traditional, face-to-face courses. The number of students who fail an online course is, also, of concern. As online courses may continue to grow over the next few decades, studies on persistence in online courses may benefit students, administrators, instructional designers, educators, and researchers. Although previous research studies have addressed persistence in online courses, very few examine it from the perspectives of students who were unsuccessful in their courses. These students may have unique insights about the online experience that may have related to their lack of success. The purpose of this study was to understand the experiences of university students who have failed or dropped an online course through the lenses of transactional distance theory and Kember’s model of dropout in distance education. Transactional distance theory discusses the dialog, structure, and learner autonomy involved in an online course, while, Kember’s model presents categories that may relate to dropping an online course. Together, the theory and model may help in understanding the experiences of students who have dropped or failed an online course. In this study, semi-structured interviews were conducted with 20 participants from a large Southeastern university in the United States. Based on the participants’ responses, the data was sorted and ranked according to the amount of transactional distance in their courses, as well as the categories of Kember’s model. Many of the participants who experienced low or high transactional distance have, also, expressed an issue with the goal commitment category of Kember’s model. Additionally, there were important differences in the student characteristics of those who dropped or failed an online course. Furthermore, suggestions for improving online courses were given by the participants. Some of these suggestions included more student-instructor interactions, the use of more technology tools in their online course, and for orientations to the online environment to be offered.