A study of learners' perceived value and satisfaction for implied effectiveness of online learning systems

Online learning systems (OLS) have become center stage for corporations and educational institutions as a competitive tool in the knowledge economy. The satisfaction construct has received extensive coverage in information systems literature as an indicator of effectiveness but has been criticized for lack of validity; yet, the value construct has been largely ignored, although it has a long history in psychology, sociology, and behavioral science. The purpose of this dissertation is to investigate the value and satisfaction constructs in the context of OLS, and their perceived by learners relationship for implied effectiveness of OLS. ^ First, a qualitative phase is employed to gather OLS values from learners' focus groups, followed by a pilot phase to refine a proposed instrument, and a main phase to validate the survey. Responses were received from 75 students in four focus groups, 141 in the pilot, and 207 the main survey. Extensive data cleaning and exploratory factor analysis were done to identify factors of learners' perceived value and satisfaction of OLS. Then, Value-Satisfaction grids and the Learners' Value Index of Satisfaction (LeVIS) were developed as benchmarking tools of OLS. Moreover, Multicriteria Decision Analysis (MCDA) techniques were employed to impute value from satisfaction scores in order to reduce survey response time. ^ The results provided four satisfaction and four value factors with high reliability (Cronbach's α). Moreover, value and satisfaction were found to have low linear and nonlinear correlations, indicating that they are two distinct uncorrelated constructs. This is consistent with the literature. Value-Satisfaction grids and the LeVIS index indicated relatively high effectiveness for technology and support characteristics, relatively low effectiveness for professor's characteristics, while course and learner characteristics indicated average effectiveness. ^ The main contributions of this study include identifying, defining, and articulating the relationship between value and satisfaction constructs as assessment of users' implied IS effectiveness, as well as assessing the accuracy of MCDA procedures to predict value scores, thus reducing by half the survey questionnaire size. ^

The effects of a professional development course on the teaching practices of P--12 classroom teachers

This follow-up study examined the long term effects of a staff development model on P–12 classroom teachers' instructional practices and dispositions regarding a curricular innovation. The sample, 44 private school practitioners who participated in the staff development program that used the model, was administered a survey at three checkpoints over a three year period to gather quantitative data regarding the participants' concerns about the curricular innovation. A comparison group of 19 practitioners also completed the survey. Qualitative data, gathered through interviews conducted with ten of the 44 participants, contributed to understanding the participants' perspectives on changes they perceived in their teaching practices as a result of the staff development. Elements of the model that were most instrumental in effecting those changes were identified. ^ The findings indicated that the participants demonstrated changes in the quality of their concerns, moving from self concerns and task concerns to impact concerns immediately following the training. The decrease in self concerns was sustained three years after the staff development, while task concerns increased and impact concerns returned to pre staff development levels. A significant difference in stages of concern between the participant and the comparison groups was noted at self and impact stages. ^ Findings revealed that participants changed their teaching practices and beliefs about instructional processes as a result of the staff development, becoming more collaborative and confident in implementing innovative approaches; they were perceived as leaders among their peers. Elements of the staff development model that participants identified as being influential in the change process included the opportunity for collaboration, authenticity of the training activities, and ongoing and comprehensive nature of the training. ^

Anxiety disorders and depression and risk for drug use disorders across the life course: Sex and ethnic contrasts

The present study examined the linkage between mental (i.e., anxiety disorders and depression) and drug use disorders in a multi-ethnic (i.e., 25% Euro-American, 38% Hispanic/Latino, 33% African American, 4% other) sample of adults (N = 1638, age 18–93 years old). Risk for drug use disorders was examined, while attending to methodological issues of prior research including (1) psychiatric comorbidity, (2) variations in risk associated with sex, ethnicity, and age, and (3) temporal order between mental and drug use disorders. ^ Participants were assessed using the Composite International Diagnostic Interview (CIDI; World Health Organization, 1990). A life history calendar (Freedman et al., 1988) was used to aid the ordering of onsets of all disorders assessed. ^ Preliminary analysis indicated anxiety disorders and depression were significant predictors of drug use disorders, but after controlling for comorbidity and temporal order, anxiety disorders and depression were no longer predictive of drug use disorders. Findings are discussed in terms of their usefulness for prevention and treatment of drug use disorders. ^

Supplemental instruction, study habits, and the community college student

The purpose of this study was to demonstrate if the academic assistance program Supplemental Instruction (SI) facilitates the acquisition of effective study behaviors through strategies that transcend simple double-exposure to the course material. Its advocates claim it increases academic achievement using learner-centered knowledge and acquisition of effective study behaviors. SI sessions are specifically related to particular courses that students are taking. Sessions are facilitated by the SI leader who has taken the subject matter course in the past. Students review the content of the previous subject matter class using collaborative learning strategies coordinated by a SI leader. In addition, the SI leader models appropriate study behaviors in his or her interactions with the students. ^ An instructor at a large Florida community college who taught five classes of an Anatomy & Physiology I course (traditionally supported by SI) was identified. Two of the classes were randomly selected to participate in SI activities, and two classes were random chosen to participate in alternate, computer-based activities that dealt with the course content, but did not include work in developing students' study behaviors. These treatments were carried out over the course of an entire semester. Participation was mandatory. ^ Data were collected on two variables. Academic achievement in anatomy and physiology content was measured both pre- and post-treatment using an instructor developed examination. Student study behaviors were measured using pre- and post-treatment administration of the Study Behavior Inventory, a valid and reliable instrument that provides scores on three categories of study behaviors: (a) Academic self-efficacy, (b) Preparation for routine academic tasks, and (c) Preparation for long range academic tasks. Measures obtained at the end of the semester of treatment revealed no significant differences between the SI and alternative treatment groups in post-treatment achievement test score and the post-treatment scores on the three study behaviors categories when adjusted for pre-treatment scores. ^ These results suggest that the development of appropriate study behaviors requires more time than SI, as it is now implemented, can provide. In addition, results indicate that improved academic achievement may be attained through any number of means that include repeated exposure to course material. ^

A comparative study of block scheduling and traditional scheduling on academic achievement

The purpose of this study was to evaluate the effectiveness of an alternate day block schedule design (n = 419) versus a traditional six-period schedule design (n = 623) on the academic achievement of the graduating classes in two schools in which the design was used respectively. Academic achievement was measured by (a) two standardized tests: the Florida Comprehensive Assessment Test Sunshine State Standards (FCAT-SSS) in mathematics and reading for 9th and 10th grade and the Scholastic Reading Inventory Test (SRI) for 9 th, 10th, and 11th grade; (b) three school grades: the mathematics final course grades for 9th, 10th, and 11th grade, the English final course grades for 9th, 10th, 11th, and 12th grade and the graduating GPA. A total of five repeated measure analyses of variance (ANOVAs) were conducted to analyze the difference between the two schools (representing the two designs) with respect to five achievement indicators (FCAT-SSS mathematics scores, FCAT-SSS reading scores, SRI scores, mathematics final course grades, and English final course grades). The between-subject factor for the five ANOVAs was the schedule design and the within-subject factor was the time the tests were taken or the time the course grades were issued. T-tests were performed on all eighth grade achievement indicators to ensure there were no significant differences in achievement between the two cohorts prior to entering high school. An independent samples t-test was conducted to analyze the difference between the two schedule designs with respect to graduating GPA. Achievement in the alternate day block schedule design was significantly higher than in the traditional six-period schedule design for some of the locally assigned school grades. The difference between the two types of schedule designs was not significant for the standardized measures (the FCAT-SSS in reading and mathematics and the SRI). This study concludes that the use of an alternate day block schedule design can be considered an educational tool that can help improve the academic achievement of students as measured by local indicators of achievement; but, apparently the design is not an important factor in achievement as measured by state examinations such as the FCAT-SSS or the SRI.

A mixed method study of organizational culture dimensions of community college faculty library use and perceptions

Because past research has shown faculty as the driving force affecting student academic library use, librarians have tried for decades to engage classroom faculty in library activities. Nevertheless, a low rate of library use by faculty on behalf of their students persists. This study investigated the organizational culture dimensions affecting library faculty demand at a community college. The study employed a sequential quantitative-qualitative research design. A random sample of full-time faculty at a large urban community college responded to a 46-item survey. The survey data showed strong espoused support (84%) for the use of library-based materials but a much lower incidence of putting this construct into practice (46%). Interviews were conducted with 11 full-time faculty from two academic groups, English-Humanities and Engineering-Math-Science. These groups were selected because the survey data resulted in statistically significant differences between the groups pertaining to several key variables. These variables concerned the professors' perceptions of the importance of library research in their discipline, the amount of time spent on the course textbook during a term, the frequency of conversations about the library in the academic department, and the professors' ratings of the librarians' skill in instruction related to the academic discipline. All interviewees described the student culture as the predominant organizational culture at Major College. Although most interview subjects held to high information literacy standards in their courses, others were less convinced these could be realistically practiced, based on a perception of students' poor academic skills, lack of time for students to complete assignments due to their commuter and family responsibilities, and the need to focus on textbook content. Recommended future research would involve investigation of methods to bridge the gap between high espoused value toward information literacy and implementation of information-literate coursework.

The effect of instruction on the study behaviors and academic achievement of community college students

The purpose of this study was twofold. It was designed to determine (a) the efficacy of an intervention designed to increase the frequencies of appropriate study behaviors on the part of community college students who were preparing for academic mathematics activities and (b) whether any increase in appropriate study behavior frequency was accompanied by increased academic achievement in college preparatory mathematics classes. A total of 126 Miami Dade College students participated in this study. Two developmental (remedial) mathematics classes were randomly assigned as the experimental group, and two others were assigned as the control group. All students also took a College Survival (SLS) class. The Study Behavior Inventory (SBI) and the Computerized Placement Test (CPT) were administered to the four classes. The SBI was used as a pre- and post-test. The SLS curriculum and classroom time were the same for both groups. However, students in the treatment groups received instruction designed to increase the frequency of effective study behaviors associated with the three factors identified in the SBI, while the students in the control group participated in activities that did not emphasize study behaviors. A series of analysis of covariance procedures were used to analyze four hypotheses. The first three hypotheses proposed that students who were instructed in the use of appropriate study behaviors would score higher on the three factors of the Study Behavior Inventory than those who were not. The fourth hypothesis proposed that a greater proportion of mathematics students who were instructed in the use of appropriate study behaviors would receive a passing grade in their course than students who were in the control group. The four hypotheses were tested at the .05 level of significance. This study revealed that students who received instruction in appropriate study behaviors scored higher in the use of appropriate study behaviors and in mathematics achievement than students who did not. Additional research is needed to investigate whether these effects would persist over time, or be found in subjects other than mathematics.

The effects of a General Instructional Strategies course on the utilization of effective instructional strategies by teachers

The focus of this study was to explain the extent to which theoretically effective teaching strategies taught in a course on generic instructional strategies are being implemented by teachers in their actual teaching practice. ^ A multivariate causal-comparative (ex-post-facto) design was used to answer the research question. A teacher observation protocol, the General Instructional Strategies Analysis (GISA) was constructed and used to assess the utilization of instructional strategies in the classroom. The data of this study also included open-ended field notes taken during observations. ^ Multivariate Analyses of Variance (MANOVA) was used to compare the teaching strategies (set, effective explanation, hands-on activity, cooperative learning activity, higher order questioning, closure) of the group who had taken a general instructional strategies course (N=36) and the group who had not (N=36). Results showed a statistically significant difference between the two groups. The group who had taken the course implemented these strategies more effectively in almost all categories of effective teaching. Follow-up univariate tests of the dependent variables showed significant differences between the two groups in five of the six areas (hands-on activity being an exception). A second MANOVA compared the two groups on the effective use of attending behaviors (teacher movement/eye contact/body language/physical space, brief verbal acknowledgements/voice inflection/modulation/pitch, use of visuals, prompting/probing, praise/feedback/rewards, wait-time I and II). Results also showed a multivariate difference between the two groups. Follow-up univariate tests on the related dependent variables showed that five of the six were significantly different between the two groups. The group who had taken the course implemented the strategies more effectively. An analysis of the field notes provided further evidence regarding the pervasiveness of these differences between the teaching practices of the two groups. ^ It was concluded that taking a course in general instructional strategies increases the utilization of effective strategies in the classroom by teachers. ^

Extending the Theory of Planned Behavior in the exercise domain: A study of community college students in an urban multicultural setting

The purpose of this study was to assess the intention to exercise among ethnically and racially diverse community college students using the Theory of Planned Behavior (TPB). In addition to identifying the variables associated with motivation or intention of college students to engage in physical activity, this study tested the model of the Theory of Planned Behavior, asking: Does the TPB model explain intention to exercise among a racially/ethnically diverse group of college students? ^ The relevant variables were the TPB constructs (behavioral beliefs, normative beliefs, and control beliefs), which combined to form a measure of intention to exercise. Structural Equation Modeling was used to test the predictive power of the TPB constructs for predicting intention to exercise. Following procedures described by Ajzen (2002), the researcher developed a questionnaire encompassing the external variables of student demographics (age, gender, work status, student status, socio-economic status, access to exercise facilities, and past behavior), major constructs of the TPB, and two questions from the Godin Leisure Time Questionnaire (GLTQ; Godin & Shephard, 1985). Participants were students (N = 255) who enrolled in an on-campus wellness course at an urban community college. ^ The demographic profile of the sample revealed a racially/ethnically diverse study population. The original model that was used to reflect the TPB as developed by Ajzen was not supported by the data analyzed using SEM; however, a revised model that the researcher thought was theoretically a more accurate reflection of the causal relations between the TPB constructs was supported. The GLTQ questions were problematic for some students; those data could not be used in the modeling efforts. The GLTQ measure, however, revealed a significant correlation with intention to exercise (r = .27, p = .001). Post-hoc comparisons revealed significant differences in normative beliefs and attitude toward exercising behavior between Black students and Hispanic students. Compared to Black students, Hispanic students were more likely to (a) perceive “friends” as approving of them being physically active and (b) rate being physically active for 30 minutes per day as “beneficial”. No statistically significant difference was found among groups on overall intention to exercise. ^

Does hope matter? The influence of dispositional hope on persistence in a developmental writing course

The purpose of this study was to determine hope’s unique role, if any, in predicting persistence in a developmental writing course. Perceived academic self-efficacy was also included as a variable of interest for comparison because self-efficacy has been more widely studied than hope in terms of its non-cognitive role in predicting academic outcomes. A significant body of research indicates that self-efficacy influences academic motivation to persist and academic performance. Hope, however, is an emerging psychological construct in the study of non-cognitive factors that influence college outcomes and warrants further exploration in higher education. This study examined the predictive value of hope and self-efficacy on persistence in a developmental writing course. The research sample was obtained from a community college in the southeastern United States. Participants were 238 students enrolled in developmental writing courses during their first year of college. Participants were given a questionnaire that included measures for perceived academic self-efficacy and hope. The self-efficacy scale asked participants to self-report on their beliefs about how they cope with different academic tasks in order to be successful. The hope scale asked students to self-report on their beliefs about their capability to initiate action towards a goal (“agency”) and create a plan to attain these goals (“pathways”). This study utilized a correlational research design. A statistical association was estimated between hope and self-efficacy as well as the unique variance contributed by each on course persistence. Correlational analysis confirmed a significant relationship between hope and perceived academic self-efficacy, and a Fisher’s z-transformation confirmed a stronger relationship between the agency component of hope and perceived academic self-efficacy than for the pathways component. A series of multinomial logistic regression analyses were conducted to assess if (a) perceived self-efficacy and hope predict course persistence, (b) hope independent of self-efficacy predicts course persistence, and (c) if including the interaction of perceived self-efficacy and hope predicts course persistence. It was found that hope was only significant independent of self-efficacy. Some implications for future research are drawn for those who lead and coordinate academic support initiatives in student and academic affairs.

Exploring the goals, content, and methods of entrepreneurship professors: A multiple case study

Along with the accumulation of evidence supporting the role of entrepreneurship in economic development (Acs & Armington, 2006; Kuratko, 2005, Reynolds, 2007), governments have persisted in encouraging people to become entrepreneurs (Acs & Stough, 2008; Brannback & Carsrud, 2008). These efforts have tried to reproduce the conditions under which entrepreneurship emerges. One of these conditions is to develop entrepreneurial skills among students and scientists (Fan & Foo, 2004). Entrepreneurship education within higher education has experienced a remarkable expansion in the last 20 years (Green, 2008). To develop entrepreneurial skills among students, scholars have proposed different teaching approaches. However, no clear relationship has been demonstrated between entrepreneurship education, learning outcomes, and business creation (Hostager & Decker, 1999). Despite policy makers demands for more accountability from educational institutions (Klimoski, 2007) and entrepreneurship instructors demands for consistency about what should be taught and how (Maidment, 2009), the appropriate content for entrepreneurship programs remains under constant discussion (Solomon, 2007). Entrepreneurship education is still in its infancy, professors propose diverse teaching goals and radically different teaching methods. This represents an obstacle to development of foundational and consistent curricula across the board (Cone, 2008). Entrepreneurship education is in need of a better conceptualization of the learning outcomes pursued in order to develop consistent curriculum. Many schools do not have enough qualified faculty to meet the growing student demand and a consistent curriculum is needed for faculty development. Entrepreneurship instructors and their teaching practices are of interest because they have a role in producing the entrepreneurs needed to grow the economy. This study was designed to understand instructors’ perspectives and actions related to their teaching. The sample studied consisted of eight college and university entrepreneurship instructors. Cases met predetermined criteria of importance followed maximum variation strategies. Results suggest that teaching content were consistent across participants while different teaching goals were identified: some instructors inspire and develop general skills of students while others envision the creation of a real business as the major outcome of their course. A relationship between methods reported by instructors and their disciplinary background, teaching perspective, and entrepreneurial experience was found.

Swimming against the tide: A study of a youth enrichment program seeking to empower inner-city Black youth

Serious inequities in our K-12 public education system, particularly in regard to the quality of education in predominately Black inner-city schools, are well-documented in the literature (Freeman, 1998; Ross, 1998). Moreover, there is general agreement that the most effective means of ameliorating that situation is through well-thought-out after-school programs and partnership initiatives (Beck, 1993; Gardner et al., 2001). ^ The purpose of this qualitative study was to examine the programmatic interventions of a youth enrichment program for inner-city Black youth currently in place at the Overtown Youth Center (OYC) in Miami, Florida, in order to: (a) discern those factors that support its claim that it is making a difference in students’ lives, (b) explore how any such factors are implemented, and (c) determine whether its interventions have served to equalize the playing field for these youth. ^ Two primary methods of data collection were used for this study. The first was participant observation conducted over the course of two years through a partnership initiative established and led by this author. The second was through in-depth interviews of the Center’s founder, staff, and students. Secondary methods used were the recording of informal conversations and the analysis of written documents. ^ Analysis of the data yielded four features of the Center that are indispensible to the students’ growth. The center provides the youth with (a) physical and psychological safety, (b) supportive relationships, (c) exposure to cultural and educational opportunities, and (d) assistance in building self-esteem. ^ The most significant finding of the study was that OYC has been successful at making a difference in students’ lives and at increasing their aspirations to attend college. By addressing the full spectrum of their needs, the Center has given them many of the necessary tools with which to compete and thereby helped equalize their opportunities to succeed in school and in life. ^ The study also noted a number of challenges for the Center to examine. The main issues that need to be addressed more seriously are staff turnover, staff indifference, nepotism, inconsistent student attendance, and insufficient focus on racial issues and African-American-centered education. Meeting those challenges would engender even greater positive outcomes.^

A gender study investigating physics self-efficacy

The underrepresentation of women in physics has been well documented and a source of concern for both policy makers and educators. My dissertation focuses on understanding the role self-efficacy plays in retaining students, particularly women, in introductory physics. I use an explanatory mixed methods approach to first investigate quantitatively the influence of self-efficacy in predicting success and then to qualitatively explore the development of self-efficacy. In the initial quantitative studies, I explore the utility of self-efficacy in predicting the success of introductory physics students, both women and men. Results indicate that self-efficacy is a significant predictor of success for all students. I then disaggregate the data to examine how self-efficacy develops differently for women and men in the introductory physics course. Results show women rely on different sources of self-efficacy than do men, and that a particular instructional environment, Modeling Instruction, has a positive impact on these sources of self-efficacy. In the qualitative phase of the project, this dissertation focuses on the development of self-efficacy. Using the qualitative tool of microanalysis, I introduce a methodology for understanding how self-efficacy develops moment-by-moment using the lens of self-efficacy opportunities. I then use the characterizations of self-efficacy opportunities to focus on a particular course environment and to identify and describe a mechanism by which Modeling Instruction impacts student self-efficacy. Results indicate that the emphasizing the development and deployment of models affords opportunities to impact self-efficacy. The findings of this dissertation indicate that introducing key elements into the classroom, such as cooperative group work, model development and deployment, and interaction with the instructor, create a mechanism by which instructors can impact the self-efficacy of their students. Results from this study indicate that creating a model to impact the retention rates of women in physics should include attending to self-efficacy and designing activities in the classroom that create self-efficacy opportunities.

The development of rubrics to measure undergraduate students' global awareness and global perspective: A validity study

Higher education institutions across the United States have developed global learning initiatives to support student achievement of global awareness and global perspective, but assessment options for these outcomes are extremely limited. A review of research for a global learning initiative at a large, Hispanic-serving, urban, public, research university in South Florida found a lack of instruments designed to measure global awareness and global perspective in the context of an authentic performance assessment. This quasi-experimental study explored the development of two rubrics for the global learning initiative and the extent to which evidence supported the rubrics' validity and reliability. One holistic rubric was developed to measure students' global awareness and the second to measure their global perspective. The study utilized a pretest/posttest nonequivalent group design. Multiple linear regression was used to ascertain the rubrics' ability to discern and compare average learning gains of undergraduate students enrolled in two global learning courses and students enrolled in two non-global learning courses. Parallel pretest/posttest forms of the performance task required students to respond to two open-ended questions, aligned with the learning outcomes, concerning a complex case narrative. Trained faculty raters read responses and used the rubrics to measure students' global awareness and perspective. Reliability was tested by calculating the rates of agreement among raters. Evidence supported the finding that the global awareness and global perspective rubrics yielded scores that were highly reliable measures of students' development of these learning outcomes. Chi-square tests of frequency found significant rates of inter-rater agreement exceeding the study's .80 minimum requirement. Evidence also supported the finding that the rubrics yielded scores that were valid measures of students' global awareness and global perspective. Regression analyses found little evidence of main effects; however, post hoc analyses revealed a significant interaction between global awareness pretest scores and the treatment, the global learning course. Significant interaction was also found between global perspective pretest scores and the treatment. These crossover interactions supported the finding that the global awareness and global perspective rubrics could be used to detect learning differences between the treatment and control groups as well as differences within the treatment group.

Microteaching Lesson Study: Mentor interaction structure and its relation to elementary preservice mathematics teacher knowledge development

This study investigated Microteaching Lesson Study (MLS) and three possible MLS mentor interaction structures during the debriefing sessions in relation to elementary preservice teacher development of knowledge for teaching. One hundred three elementary preservice teachers enrolled in five different sections of a mathematics methods course at a southern urban university were part of the study. This included 72 participants who completed MLS across three different mentor interaction structures as part of their course requirements and 31 elementary preservice teachers who did not complete MLS as part of their methods course and served as a comparison group for a portion of the study. A sequential mixed-methods research design was used to analyze the relationship between MLS mentor interaction structure and growth in preservice teachers' mathematics teacher knowledge. Data sources included pre and post assessments, group developed lesson plans and final reports, a feedback survey with Likert-type and open-ended questions, and transcripts of audio-recorded debriefing sessions. The pre and post assessments were analyzed using Analysis of Variance (ANOVA) and descriptive statistics were used to analyze the Likert-type feedback survey questions. Group MLS lesson plans, final reports, and transcripts of debriefing sessions along with the open-ended questions from the feedback survey were coded in a three-step process as described by Miles and Huberman (1994). In alignment with findings from M. Fernandez (2005, 2010), elementary preservice teachers participating in MLS grew in content knowledge related to MLS topics taught by one another. Results from the analysis of pre and post content knowledge assessments revealed that participants grew in their understanding of the mathematics topics taught during MLS irrespective of their mentor interaction structure and when compared to the participants who did not complete MLS in their methods course. Findings from the analysis of lesson plans for growth in pedagogical content knowledge revealed the most growth in this area occurred for participants assigned to the interaction structure in which the MLS mentor participated in the first two debriefing sessions. Analysis of the transcripts of the discourse during the debriefing sessions and the feedback surveys support the finding that the elementary preservice teachers assigned to the interaction structure in which the MLS mentor participated in the first and second debriefing sessions benefited more from the MLS experience when compared to elementary preservice teachers assigned to the other two interaction structures (MLS mentor participated in only the first debriefing session and MLS mentor participated in only the last debriefing session).