Assessing fun in serious games: Formative evaluation of games from two diabetes prevention interventions

Purpose. To determine the usability of two video games to prevent type 2 diabetes and obesity among youth through analysis of data collected during alpha-testing. ^ Subjects. Ten children aged 9 to 12 were selected for three 2-hour alpha testing sessions.^ Methods. "Escape from Diab" and "Nanoswarm" were designed to change dietary and physical inactivity behaviors, based on a theoretical framework of mediating variables obtained from social cognitive theory, self-determination theory, elaboration likelihood model, and behavioral inoculation theory. Thirteen mini-games developed by the software company were divided into 3 groups based on completion date. Children tested 4-5 mini-games in each of three sessions. Observed game play was followed by a scripted interview. Results from observation forms and interview transcripts were tabulated and coded to determine usability. Suggestions for game modifications were delivered to the software design firm, and a follow-up table reports rationale for inclusion or exclusion of such modifications.^ Results. Participants were 50% frequent video game players and 20% non game-players. Most (60%) were female. The mean grade (indicating likeability as a subset of usability) across all games given by children was significantly greater than a neutral grade of 80% (89%, p < 0.01), indicating a positive likeability score. The games on average also received positive ratings for fun, helpfulness of instructions and length compared to neutral values (midpoint on likert scales) (all p < 0.01). Observation notes indicated that participants paid attention to the instructions, did not appear to have much difficulty with the games, and were "not frustrated", "not bored", "very engaged", "not fidgety" and "very calm" (all p < 0.01). The primary issues noted in observations and interviews were unclear instructions and unclear purpose of some games. Player suggestions primarily involved ways to make on screen cues more visible or noticeable, instructions more clear, and games more elaborate or difficult.^ Conclusions. The present study highlights the importance of alpha testing video game components for usability prior to completion to enhance usability and likeability. Results indicate that creating clear instructions, making peripheral screen cues more eye-catching or noticeable, and vigorously stating the purpose of the game to improve understandability are important elements. However, future interventions will each present unique materials and user-interfaces and should therefore also be thoroughly alpha-tested. ^

Adherence to HIV /AIDS therapies among low -literacy populations: The ALP project

Adherence to HIV/AIDS therapies has been an important health problem since the early 1980s when AZT was first prescribed as a therapy for HIV/AIDS. It became particularly important between 1995 and 1997 with the advent of protease inhibitors (Chesney, Ickovics, Hecht, Sikipa, & Rabkin J., 1999) and became even more significant as persons with HIV/AIDS began to develop resistance to medications. Low-literacy populations have poorer health (Brez & Taylor, 1997) and higher AIDS rates (Simon, Hu, Diaz, & Kerndt, 1995), than their higher literacy counterparts due to delayed treatment (Baker, Parker, Williams, Clark, & Nurss, 1997), shame of literacy skills (Parikh, 1996), and poor access to care (Williams, et al., 1995). Poorer health and higher AIDS rates can also be attributed to poor patient-provider relationships (Crespo-Fierro, 1997; Eldred, Wu, Chaisson, & Moore, 1998) to a poorer understanding of medical protocols (Murphy, 1997), and inadequate patient education (Ungvarski, 1997; Davis, Michielutte, Askov, Williams, & Weiss, 1998, Doak, Doak, & Root, 1996). ^ The ALP intervention was developed for HIV positive low-literacy populations of African American women in Houston, Texas. The intervention was based on a needs assessment, using the PRECEDE model, an innovative process referred to as Intervention Mapping, and validated using formative evaluation methods with 54 individuals. The needs assessment resulted in a list of behavioral, environmental, predisposing, enabling, and reinforcing determinants of adherence. The Intervention Mapping framework was used to refine these determinants and develop a list of objectives describing what must be learned or changed to for the target population to adhere to HIV/AIDS therapies. Methods and strategies, were developed using theoretical constructs from the Health Belief Model (Rosenstock, 1974) and Social Cognitive Theory (Bandura, 1986). These theories, empirical evidence, and information from the target population indicated that perceived susceptibility, perceived severity, outcome expectations, and self-efficacy were important and changeable determinants of adherence to HIV/AIDS therapies for this population. ^ These components were brought together in the form of a theory-based color cartoon book and 10-minute cassette tape. The book was developed for people with 2.9 years of U.S. education as measured with the Flesch-Kincaid Grade Level method and the script was recorded onto a cassette tape to make it suitable for populations with even lower-literacy skills. A formative evaluation was conducted to ensure that the content and structure were accurate, clear, realistic, readable, appropriate, and likely to be used as intended. ^

Dispelling the Myth: What Parents Really Think about Sex Education in Schools

Background: School-based sex education is effective in reducing risky sexual behavior among adolescents that may lead to unintended pregnancies and sexually transmitted infections. However, most sex education policies in the US do not support evidence-based programs. Understanding parental attitudes around sex education is crucial to overcoming perceived barriers to implementing school-based sex education. Little research has been published on the opinions of parents in Texas, which accounts for 12% of the nation’s teen births. Purpose: The purpose of this study was to examine whether Texas parents favor teaching sex education in schools, in what grades they think sex education should be taught, what content they think should be taught, and who they think should make decisions regarding sex education. Methods: We commissioned a telephone survey of parents of children 18 years or younger in Harris County, Texas. Survey questions assessed demographic characteristics and opinions about sex education. We used chi-square tests to examine differences across sociodemographic characteristics. Results: 1,201 parents completed the survey. The majority of parents (80%) responded that sex education should begin in middle school or earlier, and two-thirds said that it should include information about condoms and contraception. Hispanic parents showed the highest support for teaching sex education and providing medically accurate information on condoms and contraception in middle school or earlier. Conclusion: Parents in Harris County overwhelmingly support sex education that includes medically accurate information about condoms and contraception beginning before high school. These data provide evidence to change sex education policies to better reflect parental opinions.

A multi-site pilot test study to measure safety climate in the university work setting

Next to leisure, sport, and household activities, the most common activity resulting in medically consulted injuries and poisonings in the United States is work, with an estimated 4 million workplace related episodes reported in 2008 (U.S. Department of Health and Human Services, 2009). To address the risks inherent to various occupations, risk management programs are typically put in place that include worker training, engineering controls, and personal protective equipment. Recent studies have shown that such interventions alone are insufficient to adequately manage workplace risks, and that the climate in which the workers and safety program exist (known as the "safety climate") is an equally important consideration. The organizational safety climate is so important that many studies have focused on developing means of measuring it in various work settings. While safety climate studies have been reported for several industrial settings, published studies on assessing safety climate in the university work setting are largely absent. Universities are particularly unique workplaces because of the potential exposure to a diversity of agents representing both acute and chronic risks. Universities are also unique because readily detectable health and safety outcomes are relatively rare. The ability to measure safety climate in a work setting with rarely observed systemic outcome measures could serve as a powerful means of measure for the evaluation of safety risk management programs. ^ The goal of this research study was the development of a survey tool to measure safety climate specifically in the university work setting. The use of a standardized tool also allows for comparisons among universities throughout the United States. A specific study objective was accomplished to quantitatively assess safety climate at five universities across the United States. At five universities, 971 participants completed an online questionnaire to measure the safety climate. The average safety climate score across the five universities was 3.92 on a scale of 1 to 5, with 5 indicating very high perceptions of safety at these universities. The two lowest overall dimensions of university safety climate were "acknowledgement of safety performance" and "department and supervisor's safety commitment". The results underscore how the perception of safety climate is significantly influenced at the local level. A second study objective regarding evaluating the reliability and validity of the safety climate questionnaire was accomplished. A third objective fulfilled was to provide executive summaries resulting from the questionnaire to the participating universities' health & safety professionals and collect feedback on usefulness, relevance and perceived accuracy. Overall, the professionals found the survey and results to be very useful, relevant and accurate. Finally, the safety climate questionnaire will be offered to other universities for benchmarking purposes at the annual meeting of a nationally recognized university health and safety organization. The ultimate goal of the project was accomplished and was the creation of a standardized tool that can be used for measuring safety climate in the university work setting and can facilitate meaningful comparisons amongst institutions.^

Randomized comparisons among health informatics students identify hypertutorial features as improving web-based instruction.

Hypertutorials optimize five features - presentation, learner control, practice, feedback, and elaborative learning resources. Previous research showed graduate students significantly and overwhelmingly preferred Web-based hypertutorials to conventional "Book-on-the-Web" statistics or research design lessons. The current report shows that the source of hypertutorials' superiority in student evaluations of instruction lies in their hypertutorial features. Randomized comparisons between the two methodologies were conducted in two successive iterations of a graduate level health informatics research design and evaluation course. The two versions contained the same text and graphics, but differed in the presence or absence of hypertutorial features: Elaborative learning resources, practice, feedback, and amount of learner control. Students gave high evaluations to both Web-based methodologies, but consistently rated the hypertutorial lessons as superior. Significant differences localized in the hypertutorial subscale that measured student responses to hypertutorial features.

Effect of maternal weight status on the relationship between prenatal smoking and infant birth weight

The purpose of this study was to assess the effect of maternal pre-pregnancy weight status on the relationship between prenatal smoking and infant birth weight (IBW). Prenatal cigarette smoking and maternal weight exert opposing effects on IBW; smoking decreases birth weight while maternal pre-pregnancy weight is positively correlated with birth weight. As such, mutual effect modification may be sufficiently significant to alter the independent effects of these two birth weight correlates. Finding of such an effect has implications of prenatal smoking cessation education. Perception of risk is an important determinant of smoking cessation, and reduced or low birth weight (LBW) as a smoking-associated risk predominates prenatal smoking counseling and education. In a population such as the US, where obesity is becoming epidemic, particularly among minority and low-income groups, perception of risk may be lowered should increased maternal size attenuate the effect of smoking. Previous studies have not found a significant interaction effect of prenatal smoking and maternal pre-pregnancy weight on IBW; however, use of self-reported smoking status may have biased findings. Reliability of self-reported smoking status reported in the literature is variable, with deception rates ranging from a low of 5% to as high as 16%. This study, using data from a prenatal smoking cessation project, in which smoking status was validated by saliva cotinine, was an opportunity to assess effect modification of smoking and maternal weight using biochemically determined smoking status in lieu of self report. Stratified by saliva cotinine, 151 women from a prenatal smoking cessation cohort, who were 18 years and older and had full-term, singleton births, were included in this study. The effect of smoking in terms of mean birth weight across three levels of maternal pre-pregnancy weight was assessed by general linear modeling procedures, adjusting for other known correlates of IBW. Effect modification was marginally significant, p = .104, but only with control for differential effects among racial/ethnic groups. A smaller than planned sample of nonsmokers, or women who quit smoking during the pregnancy, prohibited rejection of the null hypothesis of no difference in the effect of smoking across levels of pre-pregnancy weight. ^

Validity and reliability of using MVP 4 Function Walk4Life digital pedometers to assess physical activity levels among preschool-aged Head Start children

The Surgeon General recommends preschoolers 3-5 years old accumulate 60 minutes of moderate-to-vigorous physical activity (MVPA) per day. However, there is limited data measuring physical activity (PA) and MVPA amongst this population. The purpose of this cross-sectional study is to determine the validity, reliability, and feasibility of using MVP 4 Function Walk4Life digital pedometers (MVP-4) in measuring MVPA among preschoolers using the newly modified direct observational technique, System for Observing Fitness Instruction Time-Preschool Version (SOFIT-P) as the gold standard. An ethnically diverse population of 3-5 year old underserved children were recruited from two Harris County Department of Education (HCDE) Head Start centers. For 2 days at baseline and 2 days at post-test, 75 children enrolled wore MVP-4 pedometers for approximately 6-hours per observation day and were observed using SOFIT-P during predominantly active times. Statistical analyses used Pearson "r" correlation coefficients to determine mean minutes of PA and MVPA, convergent and criterion validity, and reliability. Significance was set at p = <0.05. Feasibility was determined through process evaluation information collected during this study via observations from data collectors and teacher input. Results show mean minutes of PA and MVPA ranged between 30-42 and 11-14 minutes, respectively. Convergent validity comparing BMI percentiles with MVP-4 PA outcomes show no significance at pre-test; however, each measurement at post-test showed significance for MVPA (p = 0.0247, p = 0.0056), respectively. Criterion validity comparing percent MVPA time between SOFIT-P and MVP-4 pedometers was determined; however, results deemed insufficient due to inconsistency in observation times while using the newly developed SOFIT-P. Reliability measures show no significance at pre-test, yet show significant results for all PA outcomes at post-test (p = 0.001, p = 0.001, p = 0.0010, p = 0.003), respectively. Finally, MVP-4 pedometers lacked feasibility due to logistical barriers in design. Researchers feel the significant results at post-test are secondary to increased familiarity and more accurate placement of pedometers across time. Researchers suggest manufacturers of MVP-4 pedometers further modify the instrument for ease of use with this population, following which future studies ought to determine validity using objective measures or all-day direct observation techniques.^

A descriptive and exploratory analysis of occupational injuries at a chemical manufacturing facility

A retrospective study of 1353 occupational injuries occurring at a chemical manufacturing facility in Houston, Texas from January, 1982 through May, 1988 was performed to investigate the etiology of the occupational injury process. Injury incidence rates were calculated for various sub-populations of workers to determine differences in the risk of injury for various groups. Linear modeling techniques were used to determine the association between certain collected independent variables and severity of an injury event. Finally, two sub-groups of the worker population, shiftworkers and injury recidivists, were examined. An injury recidivist as defined is any worker experiencing one or more injury per year. Overall, female shiftworkers evidenced the highest average injury incidence rate compared to all other worker groups analyzed. Although the female shiftworkers were younger and less experienced, the etiology of their increased risk of injury remains unclear, although the rigors of performing shiftwork itself or ergonomic factors are suspect. In general, females were injured more frequently than males, but they did not incur more severe injuries. For all workers, many injuries were caused by erroneous or foregone training, and risk taking behaviors. Injuries of these types are avoidable. The distribution of injuries by severity level was bimodal; either injuries were of minor or major severity with only a small number of cases falling in between. Of the variables collected, only the type of injury incurred and the worker's titlecode were statistically significantly associated with injury severity. Shiftworkers did not sustain more severe injuries than other worker groups. Injury to shiftworkers varied as a 24-hour pattern; the greatest number occurred between 1200-1230 hours, (p = 0.002) by Cosinor analysis. Recidivists made up 3.3% of the population (23 males and 10 females), yet suffered 17.8% of the injuries. Although past research suggests that injury recidivism is a random statistical event, analysis of the data by logistic regression implicates gender, area worked, age and job titlecode as being statistically significantly related to injury recidivism at this facility. ^

Planning and implementation efficacy as a determinant of health risk communication outcomes: Case studies of the U.S. Public Health Service (PHS)

This study was conducted under the auspices of the Subcommittee on Risk Communication and Education of the Committee to Coordinate Environmental Health and Related Programs (CCEHRP) to determine how Public Health Service (PHS) agencies are communicating information about health risk, what factors contributed to effective communication efforts, and what specific principles, strategies, and practices best promote more effective health risk communication outcomes.^ Member agencies of the Subcommittee submitted examples of health risk communication activities or decisions they perceived to be effective and some examples of cases they thought had not been as effective as desired. Of the 10 case studies received, 7 were submitted as examples of effective health risk communication, and 3, as examples of less effective communication.^ Information contained in the 10 case studies describing the respective agencies' health risk communication strategies and practices was compared with EPA's Seven Cardinal Rules of Risk Communication, since similar rules were not found in any PHS agency. EPA's rules are: (1) Accept and involve the public as a legitimate partner. (2) Plan carefully and evaluate your efforts. (3) Listen to the public's specific concerns. (4) Be honest, frank, and open. (5) Coordinate and collaborate with other credible sources. (6) Meet the needs of the media. (7) Speak clearly and with compassion.^ On the basis of case studies analysis, the Subcommittee, in their attempts to design and implement effective health risk communication campaigns, identified a number of areas for improvement among the agencies. First, PHS agencies should consider developing a focus specific to health risk communication (i.e., office or specialty resource). Second, create a set of generally accepted practices and guidelines for effective implementation and evaluation of PHS health risk communication activities and products. Third, organize interagency initiatives aimed at increasing awareness and visibility of health risk communication issues and trends within and between PHS agencies.^ PHS agencies identified some specific implementation strategies the CCEHRP might consider pursuing to address the major recommendations. Implementation strategies common to PHS agencies emerged in the following five areas: (1) program development, (2) building partnerships, (3) developing training, (4) expanding information technologies, and (5) conducting research and evaluation. ^

Behavioral risk profile of marathon runners

Although long distance running clearly has benefits--as witnessed by its popularity--it also has risks of injury and death. Little is known, however, about the prevalence of potentially dangerous training habits in long distance runners, although anecdotal information suggests that many runners have erroneous beliefs about risks and benefits of marathon running. We conducted a cross-sectional survey to estimate the prevalence of 19 potentially dangerous training habits (risky behaviors) among marathon runners. A 66-item self-administered questionnaire was mailed to a stratified random sample of runners who finished of the 1992 Houston-Tenneco Marathon and were 21-71 years of age. Responses were obtained from 508 runners (83%) with approximately equal representation in four age-gender groups: men $<$40 years, men $\ge$40 years, women $<$40 years, and women $\ge$40 years.^ Prevalences of risky behaviors were high. 50% or more ran in dangerously hot and humid conditions, did not cool down or stretch after running, did not wear proper running gear, or ran when injured or ill; 25-49% did not warm up, ran on dangerous surfaces, did not drink sufficient water during training, increased weekly mileage too quickly, and ran during lightning storms; 10-24% ran daily, ran in areas with high pollution, ran in the same direction as traffic, did hard runs frequently, ran more than 60 miles per week, or ran against the advice of a physician.^ Positive associations were found between the practice of risky behaviors and self-reported prevalence of musculoskeletal injuries, heat-related injuries, noncompliance with recommendations for preventive health examinations, and noncompliance with positive health habits.^ These results indicate that many marathon runners engage in training habits that may increase risk of substantial injury or illness. Further studies are needed to explore the association of risky training behaviors on the incidence of injuries, and to determine reasons for noncompliance with recommendations from sports medicine specialists. ^

Perceived risk and outcome expectancy on the practice of home infusion technique in a hemophilia population

This study described home infusion techniques and practices, measured the perceived risk of HIV and hepatitis transmission to self and others, and measured the outcome expectancy of following risk reduction guidelines for 90 hemophilia patients and/or their infusion assistants. It also assessed general knowledge of HIV and hepatitis information for the same population.^ The study subjects were hemophilia patients or their infusion assistants from the Gulf States Hemophilia Center in Houston, the El Paso Satellite Hemophilia Clinic in El Paso, or Texas members of the Women Outreach Network of the National Hemophilia Foundation (WONN) group. Each subject was interviewed either by telephone or in person. The questionnaire used was developed for the study and consisted of 60 items. These items assessed general demographics for the patients and assistants, including questions about their training to do infusions as well as the actual practices, measured perceived personal risk for the transmission of HIV or hepatitis to the assistants, perceived risk of transmission of HIV or hepatitis to others for assistants and self-infusers, and the outcome expectancy for following recommended risk reduction guidelines also for both groups.^ The theoretical framework used assumed that perceived risk and outcome expectancy would be predictive of behavior. The findings did not support this theory. Instead, the findings suggest that infusion behavior is habitual in nature; most respondents perform exactly the same behavior for every infusion. Since none of the variables selected were predictive of the compliance behavior for home infusion the teaching method should be directed towards mastery learning, or learning that will incorporate the correct behavior into a habitual pattern of home infusion. ^

Correlates of prenatal care initiation among low -income Hispanic women

Because Hispanic women are even less likely than women of other ethnic groups to receive early prenatal care, the purpose of this study was to identify factors that may influence these women to initiate care. After giving consent, 300 Hispanic women (100 who initiated first trimester care, 100 who initiated second trimester care, and 100 who initiated third trimester care or received no care) were interviewed in the post partum unit of a local public hospital. The interview included recollection of events leading to the first prenatal appointment, including first physical indicators of pregnancy, confirmation of pregnancy, feelings about the pregnancy, appointment making behavior, and system barriers encountered. The Health Belief Model was used as the theoretical framework for determining psychosocial variables. Using this model, perceived susceptibility to problems during pregnancy, perceived seriousness of possible problems, perceived benefits of prenatal care, perceived barriers to care, and cues to action were assessed. Time of entry into prenatal care was assessed by interview.^ In this sample of low-income Hispanic women, a higher perception of barriers to care was associated with later initiation of care and non-use of care, higher perceived benefits of care for the baby were associated with earlier care, especially in women without a card to access hospital district services, and having a card to access hospital district services was associated with earlier care. Several barriers to care were mentioned by women on open-ended questioning including long waiting times, embarrassment, and lack of transportation.^ Recommendations for practice included decreasing the number of visits for low-risk women while increasing the time spent with the provider, decreasing the number of vaginal exams for low-risk women, increasing the use of midwives, training lay workers to do risk assessment, giving specific messages about benefits of care to baby, and increasing general health motivation through community intervention methods. More research on the psychosocial and cultural factors associated with initiation of care is needed. In the meantime, the recommendations for practice can be implemented now to increase the use of prenatal care by low-income Hispanic women. ^