Controlled Software Evaluation Methodology: Case Simulation and Cognitive User Analysis

Software for use with patient records is challenging to design and difficult to evaluate because of the tremendous variability of patient circumstances. A method was devised by the authors to overcome a number of difficulties. The method evaluates and compares objectively various software products for use in emergency departments and compares software to conventional methods like dictation and templated chart forms. The technique utilizes oral case simulation and video recording for analysis. The methodology and experiences of executing a study using this case simulation are discussed in this presentation.

Application of Cognitive Engineering Principles to the Redesign of a Dichotomous Identification Key for Parasitology

Dichotomous identification keys are used throughout biology for identification of plants, insects, and parasites. However, correct use of identification keys can be difficult as they are not usually intended for novice users who may not be familiar with the terminology used or with the morphology of the organism being identified. Therefore, we applied cognitive engineering principles to redesign a parasitology identification key for the Internet. We addressed issues of visual clutter and spatial distance by displaying a single question couplet at a time and by switching to the appropriate next couplet after the user made a choice. Our analysis of the original paper-based key versus the Web-based approach found that of 26 applicable cognitive engineering principles, the paper key did not meet 4 (15%) and partially met 11 (42%). In contrast, the redesigned key met 100% of 32 applicable cognitive engineering principles.

Association of coping styles & adolescent substance use

Adolescent substance use is a serious public health concern with long-lasting consequences. Although specific coping behaviors have been associated with adolescent substance use, less is known about the role of multidimensional coping styles that account for both positive and negative coping behaviors. This study examined the association of coping styles and substance use (alcohol, marijuana, and other illicit drugs) of 1,019 ethnically diverse high school students. Coping styles were categorized by high or low negative coping behaviors (e.g. distraction, social withdrawal, self-criticism, blame others, wishful thinking, resignation, and negative emotional regulation) and high or low positive coping behaviors (e.g. cognitive restructuring, problem-solving, social support, and positive emotional regulation). My hypothesis that high positive coping, regardless of the use of negative coping behaviors, would be protective against substance use was rejected. Logistic regression analyses controlling for age, gender, race, and parent education indicated that adolescents who relied primarily on adaptive coping were 45-67% less likely to report lifetime or past year substance use than any other coping style. However, mixed copers (i.e. high in both positive and negative coping behaviors) were 2 to 3 times as likely to report substance use than their adaptive coping counterparts.^

Translating knowledge into action: Information needs of decision-makers in healthcare

Purpose: The purpose of this study was to assess the healthcare information needs of decision-makers in a local US healthcare setting in efforts to promote the translation of knowledge into action. The focus was on the perceptions and preferences of decision-makers regarding usable information in making decisions as to identify strategies to maximize the contribution of healthcare findings to policy and practice. Methods: This study utilized a qualitative data collection and analysis strategy. Data was collected via open-ended key-informant interviews from a sample of 37 public and private-sector healthcare decision-makers in the Houston/Harris County safety net. The sample was comprised of high-level decision-makers, including legislators, executive managers, service providers, and healthcare funders. Decision-makers were asked to identify the types of information, the level of collaboration with outside agencies, useful attributes of information, and the sources, formats/styles, and modes of information preferred in making important decisions and the basis for their preferences. Results: Decision-makers report acquiring information, categorizing information as usable knowledge, and selecting information for use based on the application of four cross-cutting thought processes or cognitive frameworks. In order of apparent preference, these are time orientation, followed by information seeking directionality, selection of validation processes, and centrality of credibility/reliability. In applying the frameworks, decision-makers are influenced by numerous factors associated with their perceptions of the utility of information and the importance of collaboration with outside agencies in making decisions as well as professional and organizational characteristics. Conclusion: An approach based on the elucidated cognitive framework may be valuable in identifying the reported contextual determinants of information use by decision-makers in US healthcare settings. Such an approach can facilitate active producer/user collaborations and promote the production of mutually valued, comprehensible, and usable findings leading to sustainable knowledge translation efforts long-term.^

UNDERSTANDING NURSE CREATED COGNITIVE ARTIFACTS: PERSONALLY-CREATED-COGNITIVE-ARTIFACTS AS EXTERNAL REPRESENTATIONS OF DISTRIBUTED COGNITION

Manuscript 1: “Conceptual Analysis: Externalizing Nursing Knowledge” We use concept analysis to establish that the report tool nurses prepare, carry, reference, amend, and use as a temporary data repository are examples of cognitive artifacts. This tool, integrally woven throughout the work and practice of nurses, is important to cognition and clinical decision-making. Establishing the tool as a cognitive artifact will support new dimensions of study. Such studies can characterize how this report tool supports cognition, internal representation of knowledge and skills, and external representation of knowledge of the nurse. Manuscript 2: “Research Methods: Exploring Cognitive Work” The purpose of this paper is to describe a complex, cross-sectional, multi-method approach to study of personal cognitive artifacts in the clinical environment. The complex data arrays present in these cognitive artifacts warrant the use of multiple methods of data collection. Use of a less robust research design may result in an incomplete understanding of the meaning, value, content, and relationships between personal cognitive artifacts in the clinical environment and the cognitive work of the user. Manuscript 3: “Making the Cognitive Work of Registered Nurses Visible” Purpose: Knowledge representations and structures are created and used by registered nurses to guide patient care. Understanding is limited regarding how these knowledge representations, or cognitive artifacts, contribute to working memory, prioritization, organization, cognition, and decision-making. The purpose of this study was to identify and characterize the role a specific cognitive artifact knowledge representation and structure as it contributed to the cognitive work of the registered nurse. Methods: Data collection was completed, using qualitative research methods, by shadowing and interviewing 25 registered nurses. Data analysis employed triangulation and iterative analytic processes. Results: Nurse cognitive artifacts support recall, data evaluation, decision-making, organization, and prioritization. These cognitive artifacts demonstrated spatial, longitudinal, chronologic, visual, and personal cues to support the cognitive work of nurses. Conclusions: Nurse cognitive artifacts are an important adjunct to the cognitive work of nurses, and directly support patient care. Nurses need to be able to configure their cognitive artifact in ways that are meaningful and support their internal knowledge representations.