Assessing fun in serious games: Formative evaluation of games from two diabetes prevention interventions

Purpose. To determine the usability of two video games to prevent type 2 diabetes and obesity among youth through analysis of data collected during alpha-testing. ^ Subjects. Ten children aged 9 to 12 were selected for three 2-hour alpha testing sessions.^ Methods. "Escape from Diab" and "Nanoswarm" were designed to change dietary and physical inactivity behaviors, based on a theoretical framework of mediating variables obtained from social cognitive theory, self-determination theory, elaboration likelihood model, and behavioral inoculation theory. Thirteen mini-games developed by the software company were divided into 3 groups based on completion date. Children tested 4-5 mini-games in each of three sessions. Observed game play was followed by a scripted interview. Results from observation forms and interview transcripts were tabulated and coded to determine usability. Suggestions for game modifications were delivered to the software design firm, and a follow-up table reports rationale for inclusion or exclusion of such modifications.^ Results. Participants were 50% frequent video game players and 20% non game-players. Most (60%) were female. The mean grade (indicating likeability as a subset of usability) across all games given by children was significantly greater than a neutral grade of 80% (89%, p < 0.01), indicating a positive likeability score. The games on average also received positive ratings for fun, helpfulness of instructions and length compared to neutral values (midpoint on likert scales) (all p < 0.01). Observation notes indicated that participants paid attention to the instructions, did not appear to have much difficulty with the games, and were "not frustrated", "not bored", "very engaged", "not fidgety" and "very calm" (all p < 0.01). The primary issues noted in observations and interviews were unclear instructions and unclear purpose of some games. Player suggestions primarily involved ways to make on screen cues more visible or noticeable, instructions more clear, and games more elaborate or difficult.^ Conclusions. The present study highlights the importance of alpha testing video game components for usability prior to completion to enhance usability and likeability. Results indicate that creating clear instructions, making peripheral screen cues more eye-catching or noticeable, and vigorously stating the purpose of the game to improve understandability are important elements. However, future interventions will each present unique materials and user-interfaces and should therefore also be thoroughly alpha-tested. ^

Impact of real time polymerase chain reaction technology on the therapeutic approach to treatment of staphylococcal infections

Can the early identification of the species of staphylococcus responsible for infection by the use of Real Time PCR technology influence the approach to the treatment of these infections? ^ This study was a retrospective cohort study in which two groups of patients were compared. The first group, ‘Physician Aware’ consisted of patients in whom physicians were informed of specific staphylococcal species and antibiotic sensitivity (using RT-PCR) at the time of notification of the gram stain. The second group, ‘Physician Unaware’ consisted of patients in whom treating physicians received the same information 24–72 hours later as a result of blood culture and antibiotic sensitivity determination. ^ The approach to treatment was compared between ‘Physician Aware’ and ‘Physician Unaware’ groups for three different microbiological diagnoses—namely MRSA, MSSA and no-SA (or coagulase negative Staphylococcus). ^ For a diagnosis of MRSA, the mean time interval to the initiation of Vancomycin therapy was 1.08 hours in the ‘Physician Aware’ group as compared to 5.84 hours in the ‘Physician Unaware’ group (p=0.34). ^ For a diagnosis of MSSA, the mean time interval to the initiation of specific anti-MSSA therapy with Nafcillin was 5.18 hours in the ‘Physician Aware’ group as compared to 49.8 hours in the ‘Physician Unaware’ group (p=0.007). Also, for the same diagnosis, the mean duration of empiric therapy in the ‘Physician Aware’ group was 19.68 hours as compared to 80.75 hours in the ‘Physician Unaware’ group (p=0.003) ^ For a diagnosis of no-SA or coagulase negative staphylococcus, the mean duration of empiric therapy was 35.65 hours in the ‘Physician Aware’ group as compared to 44.38 hours in the ‘Physician Unaware’ group (p=0.07). However, when treatment was considered a categorical variable and after exclusion of all cases where anti-MRS therapy was used for unrelated conditions, only 20 of 72 cases in the ‘Physician Aware’ group received treatment as compared to 48 of 106 cases in the ‘Physician Unaware’ group. ^ Conclusions. Earlier diagnosis of MRSA may not alter final treatment outcomes. However, earlier identification may lead to the earlier institution of measures to limit the spread of infection. The early diagnosis of MSSA infection, does lead to treatment with specific antibiotic therapy at an earlier stage of treatment. Also, the duration of empiric therapy is greatly reduced by early diagnosis. The early diagnosis of coagulase negative staphylococcal infection leads to a lower rate of unnecessary treatment for these infections as they are commonly considered contaminants. ^

Penetrating injuries of the thorax and abdomen: Type of medical-care institution and case fatality

The purpose of this study was to determine, for penetrating injuries (gunshot, stab) of the chest/abdomen, the impact on fatality of treatment in trauma centers and shock trauma units compared with general hospitals. Medical records of all cases of penetrating injury limited to chest/abdomen and admitted to and discharged from 7 study facilities in Baltimore city 1979-1980 (n = 581) were studied: 4 general hospitals (n = 241), 2 area-wide trauma centers (n = 298), and a shock trauma unit (n = 42). Emergency center and transferred cases were not studied. Anatomical injury severity, measured by modified Injury Severity Score (mISS), was a significant prognostic factor for death, as were cardiovascular shock (SBP $\le$ 70), injury type (gunshot vs stab), and ambulance/helicopter (vs other) transport. All deaths occurred in cases with two or more prognostic factors. Unadjusted relative risks of death compared with general hospitals were 4.3 (95% confidence interval = 2.2, 8.4) for shock trauma and 0.8 (0.4, 1.7) for trauma centers. Controlling for prognostic factors by logistic regression resulted in these relative risks: shock trauma 4.0 (0.7, 22.2), and trauma centers 0.8 (0.2, 3.2). Factors significantly associated with increased risk had the following relative risks by multiple logistic regression: SBP $\le$ 70 (RR = 40.7 (11.0, 148.7)), highest mISS (42 (7.7, 227)), gunshot (8.4 (2.1, 32.6)), and ambulance/helicopter transport (17.2 (1.3, 228.1)). Controlling for age, race, and gender did not alter results significantly. Actual deaths compared with deaths predicted from a multivariable model of general-hospital cases showed 3.7 more than predicted deaths in shock trauma (SMR = 1.6 (0.8, 2.9)) and 0.7 more than predicted deaths in area-wide trauma centers (SMR = 1.05 (0.6, 1.7)). Selection bias due to exclusion of transfers and emergency center cases, and residual confounding due to insufficient injury information, may account for persistence of adjusted high case fatality in shock trauma. Studying all cases prospectively, including emergency center and transferred cases, is needed. ^

THE RELATIONSHIP BETWEEN SERUM CHOLESTEROL AND CANCER INCIDENCE IN THE POPULATION OF THE HYPERTENSION DETECTION AND FOLLOW-UP PROGRAM

The relationship between serum cholesterol and cancer incidence was investigated in the population of the Hypertension Detection and Follow-up Program (HDFP). The HDFP was a multi-center trial designed to test the effectiveness of a stepped program of medication in reducing mortality associated with hypertension. Over 10,000 participants, ages 30-69, were followed with clinic and home visits for a minimum of five years. Cancer incidence was ascertained from existing study documents, which included hospitalization records, autopsy reports and death certificates. During the five years of follow-up, 286 new cancer cases were documented. The distribution of sites and total number of cases were similar to those predicted using rates from the Third National Cancer Survey. A non-fasting baseline serum cholesterol level was available for most participants. Age, sex, and race specific five-year cancer incidence rates were computed for each cholesterol quartile. Rates were also computed by smoking status, education status, and percent ideal weight quartiles. In addition, these and other factors were investigated with the use of the multiple logistic model.^ For all cancers combined, a significant inverse relationship existed between baseline serum cholesterol levels and cancer incidence. Previously documented associations between smoking, education and cancer were also demonstrated but did not account for the relationship between serum cholesterol and cancer. The relationship was more evident in males than females but this was felt to represent the different distribution of occurrence of specific cancer sites in the two sexes. The inverse relationship existed for all specific sites investigated (except breast) although a level of statistical significance was reached only for prostate carcinoma. Analyses after exclusion of cases diagnosed during the first two years of follow-up still yielded an inverse relationship. Life table analysis indicated that competing risks during the period of follow-up did not account for the existence of an inverse relationship. It is concluded that a weak inverse relationship does exist between serum cholesterol for many but not all cancer sites. This relationship is not due to confounding by other known cancer risk factors, competing risks or persons entering the study with undiagnosed cancer. Not enough information is available at the present time to determine whether this relationship is causal and further research is suggested. ^

Estimates of hospital and physician costs of epilepsy in the United States for 1995 comparing the provider -based survey method and a patient -based medical charts and billing method

This investigation compares two different methodologies for calculating the national cost of epilepsy: provider-based survey method (PBSM) and the patient-based medical charts and billing method (PBMC&BM). The PBSM uses the National Hospital Discharge Survey (NHDS), the National Hospital Ambulatory Medical Care Survey (NHAMCS) and the National Ambulatory Medical Care Survey (NAMCS) as the sources of utilization. The PBMC&BM uses patient data, charts and billings, to determine utilization rates for specific components of hospital, physician and drug prescriptions. ^ The 1995 hospital and physician cost of epilepsy is estimated to be $722 million using the PBSM and $1,058 million using the PBMC&BM. The difference of $336 million results from $136 million difference in utilization and $200 million difference in unit cost. ^ Utilization. The utilization difference of $136 million is composed of an inpatient variation of $129 million, $100 million hospital and $29 million physician, and an ambulatory variation of $7 million. The $100 million hospital variance is attributed to inclusion of febrile seizures in the PBSM, $−79 million, and the exclusion of admissions attributed to epilepsy, $179 million. The former suggests that the diagnostic codes used in the NHDS may not properly match the current definition of epilepsy as used in the PBMC&BM. The latter suggests NHDS errors in the attribution of an admission to the principal diagnosis. ^ The $29 million variance in inpatient physician utilization is the result of different per-day-of-care physician visit rates, 1.3 for the PBMC&BM versus 1.0 for the PBSM. The absence of visit frequency measures in the NHDS affects the internal validity of the PBSM estimate and requires the investigator to make conservative assumptions. ^ The remaining ambulatory resource utilization variance is $7 million. Of this amount, $22 million is the result of an underestimate of ancillaries in the NHAMCS and NAMCS extrapolations using the patient visit weight. ^ Unit cost. The resource cost variation is $200 million, inpatient is $22 million and ambulatory is $178 million. The inpatient variation of $22 million is composed of $19 million in hospital per day rates, due to a higher cost per day in the PBMC&BM, and $3 million in physician visit rates, due to a higher cost per visit in the PBMC&BM. ^ The ambulatory cost variance is $178 million, composed of higher per-physician-visit costs of $97 million and higher per-ancillary costs of $81 million. Both are attributed to the PBMC&BM's precise identification of resource utilization that permits accurate valuation. ^ Conclusion. Both methods have specific limitations. The PBSM strengths are its sample designs that lead to nationally representative estimates and permit statistical point and confidence interval estimation for the nation for certain variables under investigation. However, the findings of this investigation suggest the internal validity of the estimates derived is questionable and important additional information required to precisely estimate the cost of an illness is absent. ^ The PBMC&BM is a superior method in identifying resources utilized in the physician encounter with the patient permitting more accurate valuation. However, the PBMC&BM does not have the statistical reliability of the PBSM; it relies on synthesized national prevalence estimates to extrapolate a national cost estimate. While precision is important, the ability to generalize to the nation may be limited due to the small number of patients that are followed. ^

Analysis of interval -censored events in hypertension studies: Evaluation of treatment of coronary heart disease

Many statistical studies feature data with both exact-time and interval-censored events. While a number of methods currently exist to handle interval-censored events and multivariate exact-time events separately, few techniques exist to deal with their combination. This thesis develops a theoretical framework for analyzing a multivariate endpoint comprised of a single interval-censored event plus an arbitrary number of exact-time events. The approach fuses the exact-time events, modeled using the marginal method of Wei, Lin, and Weissfeld, with a piecewise-exponential interval-censored component. The resulting model incorporates more of the information in the data and also removes some of the biases associated with the exclusion of interval-censored events. A simulation study demonstrates that our approach produces reliable estimates for the model parameters and their variance-covariance matrix. As a real-world data example, we apply this technique to the Systolic Hypertension in the Elderly Program (SHEP) clinical trial, which features three correlated events: clinical non-fatal myocardial infarction, fatal myocardial infarction (two exact-time events), and silent myocardial infarction (one interval-censored event). ^

TIME SERIES ANALYSIS AS INPUT FOR PREDICTIVE MODELING: PREDICTING CARDIAC ARREST IN A PEDIATRIC INTENSIVE CARE UNIT

The first manuscript, entitled "Time-Series Analysis as Input for Clinical Predictive Modeling: Modeling Cardiac Arrest in a Pediatric ICU" lays out the theoretical background for the project. There are several core concepts presented in this paper. First, traditional multivariate models (where each variable is represented by only one value) provide single point-in-time snapshots of patient status: they are incapable of characterizing deterioration. Since deterioration is consistently identified as a precursor to cardiac arrests, we maintain that the traditional multivariate paradigm is insufficient for predicting arrests. We identify time series analysis as a method capable of characterizing deterioration in an objective, mathematical fashion, and describe how to build a general foundation for predictive modeling using time series analysis results as latent variables. Building a solid foundation for any given modeling task involves addressing a number of issues during the design phase. These include selecting the proper candidate features on which to base the model, and selecting the most appropriate tool to measure them. We also identified several unique design issues that are introduced when time series data elements are added to the set of candidate features. One such issue is in defining the duration and resolution of time series elements required to sufficiently characterize the time series phenomena being considered as candidate features for the predictive model. Once the duration and resolution are established, there must also be explicit mathematical or statistical operations that produce the time series analysis result to be used as a latent candidate feature. In synthesizing the comprehensive framework for building a predictive model based on time series data elements, we identified at least four classes of data that can be used in the model design. The first two classes are shared with traditional multivariate models: multivariate data and clinical latent features. Multivariate data is represented by the standard one value per variable paradigm and is widely employed in a host of clinical models and tools. These are often represented by a number present in a given cell of a table. Clinical latent features derived, rather than directly measured, data elements that more accurately represent a particular clinical phenomenon than any of the directly measured data elements in isolation. The second two classes are unique to the time series data elements. The first of these is the raw data elements. These are represented by multiple values per variable, and constitute the measured observations that are typically available to end users when they review time series data. These are often represented as dots on a graph. The final class of data results from performing time series analysis. This class of data represents the fundamental concept on which our hypothesis is based. The specific statistical or mathematical operations are up to the modeler to determine, but we generally recommend that a variety of analyses be performed in order to maximize the likelihood that a representation of the time series data elements is produced that is able to distinguish between two or more classes of outcomes. The second manuscript, entitled "Building Clinical Prediction Models Using Time Series Data: Modeling Cardiac Arrest in a Pediatric ICU" provides a detailed description, start to finish, of the methods required to prepare the data, build, and validate a predictive model that uses the time series data elements determined in the first paper. One of the fundamental tenets of the second paper is that manual implementations of time series based models are unfeasible due to the relatively large number of data elements and the complexity of preprocessing that must occur before data can be presented to the model. Each of the seventeen steps is analyzed from the perspective of how it may be automated, when necessary. We identify the general objectives and available strategies of each of the steps, and we present our rationale for choosing a specific strategy for each step in the case of predicting cardiac arrest in a pediatric intensive care unit. Another issue brought to light by the second paper is that the individual steps required to use time series data for predictive modeling are more numerous and more complex than those used for modeling with traditional multivariate data. Even after complexities attributable to the design phase (addressed in our first paper) have been accounted for, the management and manipulation of the time series elements (the preprocessing steps in particular) are issues that are not present in a traditional multivariate modeling paradigm. In our methods, we present the issues that arise from the time series data elements: defining a reference time; imputing and reducing time series data in order to conform to a predefined structure that was specified during the design phase; and normalizing variable families rather than individual variable instances. The final manuscript, entitled: "Using Time-Series Analysis to Predict Cardiac Arrest in a Pediatric Intensive Care Unit" presents the results that were obtained by applying the theoretical construct and its associated methods (detailed in the first two papers) to the case of cardiac arrest prediction in a pediatric intensive care unit. Our results showed that utilizing the trend analysis from the time series data elements reduced the number of classification errors by 73%. The area under the Receiver Operating Characteristic curve increased from a baseline of 87% to 98% by including the trend analysis. In addition to the performance measures, we were also able to demonstrate that adding raw time series data elements without their associated trend analyses improved classification accuracy as compared to the baseline multivariate model, but diminished classification accuracy as compared to when just the trend analysis features were added (ie, without adding the raw time series data elements). We believe this phenomenon was largely attributable to overfitting, which is known to increase as the ratio of candidate features to class examples rises. Furthermore, although we employed several feature reduction strategies to counteract the overfitting problem, they failed to improve the performance beyond that which was achieved by exclusion of the raw time series elements. Finally, our data demonstrated that pulse oximetry and systolic blood pressure readings tend to start diminishing about 10-20 minutes before an arrest, whereas heart rates tend to diminish rapidly less than 5 minutes before an arrest.

Indeterminate QunatiFERON-TB Gold In-Tube assay results in association with procedural specimen collection in children

BACKGROUND. The development of interferon-gamma release assays (IGRA) has introduced powerful tools in diagnosing latent tuberculosis infection (LTBI) and may play a critical role in the future of tuberculosis diagnosis. However, there have been reports of high indeterminate results in young patient populations (0-18 years). This study investigated results of the QunatiFERON-TB Gold In-Tube (QFT-GIT) IGRA in a population of children (0-18 years) at Texas Children's Hospital in association with specimen collection procedures using surrogate variables. ^ METHODS. A retrospective case-control study design was used for this investigation. Cases were defined as having QFT-GIT indeterminate results. Controls were defined as having either positive or negative results (determinates). Patients' admission status, staff performing specimen collection, and specific nurse performing specimen collection were used as surrogates to measure specimen collection procedures. ^ To minimize potential confounding, abstraction of patients' electronic medical records was performed. Abstracted data included patients' medications and evaluation at the time of QFT-GIT specimen collection in addition to their medical history. QFT-GIT related data was also abstracted. Cases and controls were characterized using chi-squared tests or Fisher's exact tests across categorical variables. Continuous variables were analyzed using one-way ANOVA and t-tests for continuous variables. A multivariate model was constructed by backward stepwise removal of statistically significant variables from univariate analysis. ^ RESULTS. Patient data was abstracted from 182 individuals aged 0-18 years from July 2010 to August 2011 at Texas Children's Hospital. 56 cases (indeterminates) and 126 controls (determinates) were enrolled. Cancer was found to be an effect modifier with subsequent stratification resulting in a cancer patient population too small to analyze (n=13). Subsequent analyses excluded these patients. ^ The exclusion of cancer patients resulted in a population of 169 patients with 49 indeterminates (28.99%) and 120 determinates (71.01%), with mean ages of 9.73 (95% CI: 8.03, 11.43) years and 11.66 (95% CI: 10.75, 12.56) years (p = 0.033), respectively. Median age of patients who were indeterminates and determinates were 12.37 and 12.87 years, respectively. Lack of data for our specific nurse surrogate (QFTNurse) resulted in its exclusion from analysis. The final model included only our remaining surrogate variables (QFTStaff and QFTInpatientOutpatient). The staff collecting surrogate (QFTStaff) was found to be modestly associated with indeterminates when nurses collected the specimen (OR = 1.54, 95% CI: 0.51, 4.64, p = 0.439) in the final model. Inpatients were found to have a strong and statistically significant association with indeterminates (OR = 11.65, 95% CI: 3.89, 34.9, p < 0.001) in the final model. ^ CONCLUSION. Inpatient status was used as a surrogate for indication of nurse drawn blood specimens. Nurses have had little to no training regarding shaking of tubes versus phlebotomists regarding QFT-GIT testing procedures. This was also measured by two other surrogates; specifically a medical note stating whether a nurse or phlebotomist collected the specimen (QFTStaff) and the name and title of the specific nurse if collection was performed by a nurse (QFTNurse). Results indicated that inpatient status was a strong and statistically significant factor for indeterminates, however, nurse collected specimens and indeterminate results had no statistically significant association in non-cancer patients. The lack of data denoting the specific nurse performing specimen collection excluded the QFTNurse surrogate in our analysis. ^ Findings suggests training of staff personnel in specimen procedures may have little effect on the number of indeterminates while inpatient status and thus possibly illness severity may be the most important factor for indeterminate results in this population. The lack of congruence between our surrogate measures may imply that our inpatient surrogate gauged illness severity rather than collection procedures as intended. ^ Despite the lack of clear findings, our analysis indicated that more than half of indeterminates were found in specimens drawn by nurses and as such staff training may be explored. Future studies may explore methods in measuring modifiable variables during pre-analytical QFT-GIT procedures that can be discerned and controlled. Identification of such measures may provide insight into ways to lowering indeterminate QFT-GIT rates in children.^