Action Research and Learning Analytics in Higher Education

Teaching is a dynamic activity. It can be very effective, if its impact is constantly monitored and adjusted to the demands of changing social contexts and needs of learners. This implies that teachers need to be aware about teaching and learning processes. Moreover, they should constantly question their didactical methods and the learning resources, which they provide to their students. They should reflect if their actions are suitable, and they should regulate their teaching, e.g., by updating learning materials based on new knowledge about learners, or by motivating learners to engage in further learning activities. In the last years, a rising interest in ‘learning analytics’ is observable. This interest is motivated by the availability of massive amounts of educational data. Also, the continuously increasing processing power, and a strong motivation for discovering new information from these pools of educational data, is pushing further developments within the learning analytics research field. Learning analytics could be a method for reflective teaching practice that enables and guides teachers to investigate and evaluate their work in future learning scenarios. However, this potentially positive impact has not yet been sufficiently verified by learning analytics research. Another method that pursues these goals is ‘action research’. Learning analytics promises to initiate action research processes because it facilitates awareness, reflection and regulation of teaching activities analogous to action research. Therefore, this thesis joins both concepts, in order to improve the design of learning analytics tools. Central research question of this thesis are: What are the dimensions of learning analytics in relation to action research, which need to be considered when designing a learning analytics tool? How does a learning analytics dashboard impact the teachers of technology-enhanced university lectures regarding ‘awareness’, ‘reflection’ and ‘action’? Does it initiate action research? Which are central requirements for a learning analytics tool, which pursues such effects? This project followed design-based research principles, in order to answer these research questions. The main contributions are: a theoretical reference model that connects action research and learning analytics, the conceptualization and implementation of a learning analytics tool, a requirements catalogue for useful and usable learning analytics design based on evaluations, a tested procedure for impact analysis, and guidelines for the introduction of learning analytics into higher education.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: The design of Virtual Patients (VPs) is essential. So far there are no validated evaluation instruments for VP design published. Summary of work: We examined three sources of validity evidence of an instrument to be filled out by students aimed at measuring the quality of VPs with a special emphasis on fostering clinical reasoning: (1) Content was examined based on theory of clinical reasoning and an international VP expert team. (2) Response process was explored in think aloud pilot studies with students and content analysis of free text questions accompanying each item of the instrument. (3) Internal structure was assessed by confirmatory factor analysis (CFA) using 2547 student evaluations and reliability was examined utilizing generalizability analysis. Summary of results: Content analysis was supported by theory underlying Gruppen and Frohna’s clinical reasoning model on which the instrument is based and an international VP expert team. The pilot study and analysis of free text comments supported the validity of the instrument. The CFA indicated that a three factor model comprising 6 items showed a good fit with the data. Alpha coefficients per factor were 0,74 - 0,82. The findings of the generalizability studies indicated that 40-200 student responses are needed in order to obtain reliable data on one VP. Conclusions: The described instrument has the potential to provide faculty with reliable and valid information about VP design. Take-home messages: We present a short instrument which can be of help in evaluating the design of VPs.

Food Fury: Online Casual Game Development for Nutrition Education

Introduction: The United States is currently experiencing increased prevalence of obesity. This is a particular problem amongst children who require dietary and activity behavioral change to mitigate this problem. The use of computer games as channels to motivate health behavior in children is increasing. Casual games are a subset of computer games that are simple in design, easy to access and play, popular with children, and have the potential to be effective for drill and practice learning. [See PDF for complete abstract]

Master of Education in Teaching Program with an Emphasis in the Health Sciences

Introduction: Concerns about the quality of physician education have changed current medical education practices. Learners must demonstrate competency in core areas, rather than solely participating in educational activities. Academic medical institutions are challenged with identifying leaders to direct curricular and evaluation reforms. An innovative partnership between the University of Houston College of Education and Baylor College of Medicine, the University of Texas Medical School at Houston, and the University of Texas Dental Branch at Houston offers a Masters of Education in Teaching degree with an emphasis in Health Sciences. Courses encompass fundamental areas including curriculum, instruction, technology, measurement, research design and statistics. [See PDF for complete abstract]

Design and analysis for three level hierarchical structures with count response

In numerous intervention studies and education field trials, random assignment to treatment occurs in clusters rather than at the level of observation. This departure of random assignment of units may be due to logistics, political feasibility, or ecological validity. Data within the same cluster or grouping are often correlated. Application of traditional regression techniques, which assume independence between observations, to clustered data produce consistent parameter estimates. However such estimators are often inefficient as compared to methods which incorporate the clustered nature of the data into the estimation procedure (Neuhaus 1993).1 Multilevel models, also known as random effects or random components models, can be used to account for the clustering of data by estimating higher level, or group, as well as lower level, or individual variation. Designing a study, in which the unit of observation is nested within higher level groupings, requires the determination of sample sizes at each level. This study investigates the design and analysis of various sampling strategies for a 3-level repeated measures design on the parameter estimates when the outcome variable of interest follows a Poisson distribution. ^ Results study suggest that second order PQL estimation produces the least biased estimates in the 3-level multilevel Poisson model followed by first order PQL and then second and first order MQL. The MQL estimates of both fixed and random parameters are generally satisfactory when the level 2 and level 3 variation is less than 0.10. However, as the higher level error variance increases, the MQL estimates become increasingly biased. If convergence of the estimation algorithm is not obtained by PQL procedure and higher level error variance is large, the estimates may be significantly biased. In this case bias correction techniques such as bootstrapping should be considered as an alternative procedure. For larger sample sizes, those structures with 20 or more units sampled at levels with normally distributed random errors produced more stable estimates with less sampling variance than structures with an increased number of level 1 units. For small sample sizes, sampling fewer units at the level with Poisson variation produces less sampling variation, however this criterion is no longer important when sample sizes are large. ^ 1Neuhaus J (1993). “Estimation efficiency and Tests of Covariate Effects with Clustered Binary Data”. Biometrics , 49, 989–996^

Culturally sensitive cancer education: Effect on knowledge, cancer fatalism, and participation in mobile mammography screening among African-American women

Purpose. To evaluate the effectiveness of a culturally sensitive educational intervention that used an African American lay survivor of breast cancer to increase knowledge of breast cancer, decrease cancer fatalism, and increase participation in mobile mammography screening among African American women. ^ Design. Experimental pretest/posttest design. ^ Setting. Two predominantly African American churches in a large southwestern metropolitan city. ^ Sample. Participants included 93 African American women, 40 years of age and older. Participants were randomly assigned to an intervention group (n = 48) or a control group (n = 45). ^ Methods. Pretest and post-test measures included the Breast Cancer Knowledge Test and the Powe Fatalism Inventory. In addition, demographic and breast screening practices were collected by questionnaire. The intervention group received a breast cancer educational testimonial from an African American lay survivor of breast cancer, who answered questions and addressed concerns, while stressing the importance of taking responsibility for one's own health and spreading disease prevention messages throughout the African American community. The control group viewed the American Cancer Society “Keep In Touch” video prepared specifically for African American women. Participants in both groups were given culturally sensitive educational materials designed to increase knowledge about breast cancer, and were instructed on breast self-examination by an African American registered nurse, using ethnically appropriate breast models. In addition, after the post-test, all eligible participants were given an opportunity to have a free mammogram via a mobile mammography unit parked at the church. ^ Findings. Participants in the intervention group had a significant increase (p = .03) in knowledge of breast cancer and a significant decrease (p = .000) in fatalism scores compared to those individuals in the control group. The intervention group had a 61% participation rate in screening, while the control group had a 39% participation rate in screening. However, the difference was not statistically significant at the .05 level (p = .07). ^ Conclusions. Results demonstrate that culturally sensitive breast cancer education is successful in increasing knowledge and decreasing cancer fatalism. While there was a trend toward behavior change in the intervention group, more research needs to be done in this area. ^

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.

Oral Health Education Program on Dental Caries Incidence for School Children.

OBJECTIVE This 3-year retrospective controlled clinical trial assessed the effect of a school-based oral health education program on caries incidence in children. STUDY DESIGN A total of 240 students, aged 5 to 7 years, from two public schools in Monte Sião, Brazil, were included in this study. A school-based oral health education program was developed in one of the schools (experimental group), including 120 students, while the 120 students from the other school did not participate in the program (control group). All children were initially examined for dental caries (dmf-t), and after 3 years, 98 children from the experimental group and 96 from the control group were again examined and answered a questionnaire on oral health issues. The between-groups difference in caries incidence on permanent teeth was calculated using Poisson regression analyses. Logistic regression was used to observe the association between caries incidence and other variables. RESULTS More students from the experimental group stated knowing what was dental caries and declared that they use dental floss daily, but no significant differences in caries incidence was observed between the experimental and control groups. CONCLUSION The school-based oral health education program is not adequately efficient to decrease caries incidence after three years, but some issues about oral health knowledge could be slightly improved.

A summative evaluation of a HIV/AIDS Early Childhood Care, Education and Development Teacher Training Workshop in Mongu, Zambia

Objective. To conduct a summative evaluation of an Early Childhood Care, Education and Development (ECCED) Teacher Training Workshop in Mongu, Zambia by assessing changes in knowledge, attitudes and intent to use the information. ^ Study design. A matched cohort survey design was used with additional qualitative data collected by structured observation of workshop sessions, daily facilitator and participant debriefs and participant interviews. ^ Results. Matching pre and post tests were completed by 27 individuals in addition to daily debriefs, structured workshop observation and participant interviews with 22% of the group. The participant population was predominantly female individuals aged 15-44 years old that had completed high school and additional post-secondary training, been teaching children aged 0 – 8 years for 2-5 years in the Western Province and received other HIV/AIDS and ECCED education. Pre-tests indicated a strong understanding of ECCED principles and misconceptions regarding HIV transmission, prevention and the disease's impact on early childhood development. The workshop was found to significantly increase the participants' knowledge of topics covered by the curriculum (paired t-test, N=27, p = 0.004, 95% CI 1.8, 8.6). Participants began with a more limited understanding of HIV/AIDS than ECCED, but the mean gain was much greater at 7.4 +/- 12.3 points. Significantly more participants believed at post-test that HIV/AIDS education should increase for future educators. The 77.8% of participants that increased their knowledge scores at post-test expressed significantly less fear of having a child with HIV/AIDS in the classroom (Independent Samples t-test, N= 27, p = 0.011). Overall participant fear decreased 15.5%. 92.6% and 88.9% of participants planned at post-test to respectively use and share the taught information in their daily professional lives and reported on innovative strategies to communicate with the community. ^ Conclusions. Teacher training workshops can significantly increase HIV/AIDS awareness and promote positive attitudes in educators working with children affected by HIV/AIDS. Using participant suggested teaching techniques such as poems and songs and translating the materials to the local language could assist future facilitators to both culturally and professionally relate to the workshop audience as well as increase participant capacity to share the information with the local community. ^

A practice-based culminating experience: Writing a HRSA grant application with Texas Organ Sharing Alliance for public education efforts to increase solid organ donation

In November 2010, nearly 110,000 people in the United States were waiting for organs for transplantation. Despite the fact that the organ donor registration rate has doubled in the last year, Texas has the lowest registration rate in the nation. Due to the need for improved registration rates in Texas, this practice-based culminating experience was to write an application for federal funding for the central Texas organ procurement organization, Texas Organ Sharing Alliance. The culminating experience has two levels of significance for public health – (1) to engage in an activity to promote organ donation registration, and (2) to provide professional experience in grant writing. ^ The process began with a literature review. The review was to identify successful intervention activities in motivating organ donation registration that could be used in intervention design for the grant application. Conclusions derived from the literature review included (1) the need to specifically encourage family discussions, (2) religious and community leaders can be leveraged to facilitate organ donation conversations in families, (3) communication content must be culturally sensitive and (4) ethnic disparities in transplantation must be acknowledged and discussed.^ Post the literature review; the experience followed a five step process of developing the grant application. The steps included securing permission to proceed, assembling a project team, creation of a project plan and timeline, writing each element of the grant application including the design of proposed intervention activities, and completion of the federal grant application. ^ After the grant application was written, an evaluation of the grant writing process was conducted. Opportunities for improvement were identified. The first opportunity was the need for better timeline management to allow for review of the application by an independent party, iterative development of the budget proposal, and development of collaborative partnerships. Another improvement opportunity was the management of conflict regarding the design of the intervention that stemmed from marketing versus evidence-based approaches. The most important improvement opportunity was the need to develop a more exhaustive evaluation plan.^ Eight supplementary files are attached to appendices: Feasibility Discussion in Appendix 1, Grant Guidance and Workshop Notes in Appendix 2, Presentation to Texas Organ Sharing Alliance in Appendix 3, Team Recruitment Presentation in Appendix 5, Grant Project Narrative in Appendix 7, Federal Application Form in Appendix 8, and Budget Workbook with Budget Narrative in Appendix 9.^

The role of a nursing home administrator's education in influencing quality of care in US nursing homes

Nursing home literature links poor management practices to poor quality of care and resident outcomes. Since Nursing Home Administrators (NHAs) require an array of skills to perform their role, it is important to explore what makes a NHA effective. This research fills a gap in the literature and provides a possible option to improve the quality of care in nursing homes. Purpose of the study. The study examines whether NHAs with advanced education (defined as a Masters degree or more) are associated with better quality of care in licensed nursing homes (NHs). Design and Methods. Data was derived from the CDC’s 2004 National Nursing Home Survey, which is a representative sample of NHs across the US. A Donabedian- inspired structure-process-outcomes study model was created to explain how education relates to quality of care. Quality of care was defined as onsite oral care, employee influenza vaccination rates and staff recognition programs. Statistical analyses included multivariate logistic regression; covariates included facility-level variables used in similar peer-reviewed research but also included select measures from the Area Resource File to control for county-level factors. Results. Descriptive and analytical analyses confirm that NHAs with a Bachelor’s degree, Associate degree or high school diploma perform less well than NHAs with a Masters degree or more. NHAs with advanced education are more likely to have onsite dental care and recognition programs for staff than NHAs with a Bachelor’s degree (or less). Also NHAs with less than graduate education are more likely to provide off-site dental care. Employee vaccination rates are not impacted by education. Adding certification, tenure or years of experience to a NHA with advanced education gives them an advantage. In fact, certification and experience alone do not have a positive relationship to care indicators; however adding these to advanced education produces a significant result. Implications. This research provides preliminary evidence that advanced education for the NHA is associated with better quality of care. If future research can confirm these findings, there is merit in revisiting the qualifications. Education can be a legitimate option to support quality improvement efforts in US nursing homes. ^

Effectiveness of a nutrition education program for women in a residential program after incarceration

Background: The number of incarcerated women has increased dramatically over the past two decades. During their stay in prison, the medical and nutritional needs of these women are frequently ignored. Overweight or obesity related to poor dietary habits and low-income status are important risk factors for health inequities. Women in this population are at risk for dietary-related chronic diseases such as hypertension, diabetes, and cardiovascular diseases. This is an indication that there is a need for nutrition education in this population. ^ Purpose: The purpose of this study was to provide an evidence-based nutrition education program at a facility for previously incarcerated women in Downtown Houston, Texas (Brigid's Hope). This nutrition education program focused on promoting better health and prevention of chronic diseases by increasing fruit and vegetable (FV) intake and healthy eating on a limited budget. Constructs such as knowledge, skills, self-efficacy, and perceived barriers were evaluated as well as acceptability, feasibility, and sustainability of the program. ^ Methods: The Hope for Health Nutrition Education Program occurred in four weekly sessions at Brigid's Hope. The evaluation design was a one-group quasi-experimental design with pre- and post-test measures. Identical pre- and post-tests were administered before and after the intervention. A total of 11 residents and 2 staff members participated in the study. Results: After four nutrition education sessions, post-tests revealed an overall increase in knowledge, skills, and self-efficacy scores, and decrease in perceived barrier scores towards FV consumption. Changes in skills, self-efficacy, and perceived barriers scores were found to be statistically significant. Participant satisfaction surveys revealed overall high satisfaction of the program and that continuing the program in the future would be possible with support from staff member and mentors. ^ Conclusions: Results from this study show that a nutrition education program can have positive effects towards knowledge, skills, self-efficacy, and perceived barriers towards FV consumption for previously incarcerated women. The high satisfaction for this program shows that a health promotion program with focus on diet and nutrition can play an important role in helping this unique population of women re-enter society.^

Health outcomes, quality improvement and cost-effectiveness of the Community Diabetes Education (CoDE) program: Results of a randomized controlled trial

The objectives of this dissertation were to evaluate health outcomes, quality improvement measures, and the long-term cost-effectiveness and impact on diabetes-related microvascular and macrovascular complications of a community health worker-led culturally tailored diabetes education and management intervention provided to uninsured Mexican Americans in an urban faith-based clinic. A prospective, randomized controlled repeated measures design was employed to compare the intervention effects between: (1) an intervention group (n=90) that participated in the Community Diabetes Education (CoDE) program along with usual medical care; and (2) a wait-listed comparison group (n=90) that received only usual medical care. Changes in hemoglobin A1c (HbA1c) and secondary outcomes (lipid status, blood pressure and body mass index) were assessed using linear mixed-models and an intention-to-treat approach. The CoDE group experienced greater reduction in HbA1c (-1.6%, p<.001) than the control group (-.9%, p<.001) over the 12 month study period. After adjusting for group-by-time interaction, antidiabetic medication use at baseline, changes made to the antidiabetic regime over the study period, duration of diabetes and baseline HbA1c, a statistically significant intervention effect on HbA1c (-.7%, p=.02) was observed for CoDE participants. Process and outcome quality measures were evaluated using multiple mixed-effects logistic regression models. Assessment of quality indicators revealed that the CoDE intervention group was significantly more likely to have received a dilated retinal examination than the control group, and 53% achieved a HbA1c below 7% compared with 38% of control group subjects. Long-term cost-effectiveness and impact on diabetes-related health outcomes were estimated through simulation modeling using the rigorously validated Archimedes Model. Over a 20 year time horizon, CoDE participants were forecasted to have less proliferative diabetic retinopathy, fewer foot ulcers, and reduced numbers of foot amputations than control group subjects who received usual medical care. An incremental cost-effectiveness ratio of $355 per quality-adjusted life-year gained was estimated for CoDE intervention participants over the same time period. The results from the three areas of program evaluation: impact on short-term health outcomes, quantification of improvement in quality of diabetes care, and projection of long-term cost-effectiveness and impact on diabetes-related health outcomes provide evidence that a community health worker can be a valuable resource to reduce diabetes disparities for uninsured Mexican Americans. This evidence supports formal integration of community health workers as members of the diabetes care team.^

Vocational guidance in people with special educational needs as the result of visual impairment during the transition stage from high school to advanced education

This work proposes to seek for the factors related to the choices that people with special educational needs make as the result of the visual impairment, during the transition stage from high school to advanced education. Therefore, we have taken into consideration that Vocational Guidance and the transition towards adulthood get specific characteristics in case of visually impaired young people, particularly in what's related to continue with advanced education. The focus of this work is to be able to clarify the existence of factors that make this transition stage easier or harder, through the observation of visually impaired and blind people who complete high school. This matter has aroused interest and concern about the strategies to follow to ensure the successful entrance and remaining in the selected advanced education. However, if we don?t know the factors involved in the described fact, it's difficult to design an appropriate intervention strategy. Then, in order to take acknowledge about the specific issues of visually impaired young people who complete high school, we chose a special school for this disability and some students who will join this project

Vocational guidance in people with special educational needs as the result of visual impairment during the transition stage from high school to advanced education

This work proposes to seek for the factors related to the choices that people with special educational needs make as the result of the visual impairment, during the transition stage from high school to advanced education. Therefore, we have taken into consideration that Vocational Guidance and the transition towards adulthood get specific characteristics in case of visually impaired young people, particularly in what's related to continue with advanced education. The focus of this work is to be able to clarify the existence of factors that make this transition stage easier or harder, through the observation of visually impaired and blind people who complete high school. This matter has aroused interest and concern about the strategies to follow to ensure the successful entrance and remaining in the selected advanced education. However, if we don?t know the factors involved in the described fact, it's difficult to design an appropriate intervention strategy. Then, in order to take acknowledge about the specific issues of visually impaired young people who complete high school, we chose a special school for this disability and some students who will join this project