Webinar Training: an acceptable, feasible and effective approach for multi-site medical record abstraction: the BOWII experience

Background Abstractor training is a key element in creating valid and reliable data collection procedures. The choice between in-person vs. remote or simultaneous vs. sequential abstractor training has considerable consequences for time and resource utilization. We conducted a web-based (webinar) abstractor training session to standardize training across six individual Cancer Research Network (CRN) sites for a study of breast cancer treatment effects in older women (BOWII). The goals of this manuscript are to describe the training session, its participants and participants' evaluation of webinar technology for abstraction training. Findings A webinar was held for all six sites with the primary purpose of simultaneously training staff and ensuring consistent abstraction across sites. The training session involved sequential review of over 600 data elements outlined in the coding manual in conjunction with the display of data entry fields in the study's electronic data collection system. Post-training evaluation was conducted via Survey Monkey©. Inter-rater reliability measures for abstractors within each site were conducted three months after the commencement of data collection. Ten of the 16 people who participated in the training completed the online survey. Almost all (90%) of the 10 trainees had previous medical record abstraction experience and nearly two-thirds reported over 10 years of experience. Half of the respondents had previously participated in a webinar, among which three had participated in a webinar for training purposes. All rated the knowledge and information delivered through the webinar as useful and reported it adequately prepared them for data collection. Moreover, all participants would recommend this platform for multi-site abstraction training. Consistent with participant-reported training effectiveness, results of data collection inter-rater agreement within sites ranged from 89 to 98%, with a weighted average of 95% agreement across sites. Conclusions Conducting training via web-based technology was an acceptable and effective approach to standardizing medical record review across multiple sites for this group of experienced abstractors. Given the substantial time and cost savings achieved with the webinar, coupled with participants' positive evaluation of the training session, researchers should consider this instructional method as part of training efforts to ensure high quality data collection in multi-site studies.

Internet information and medical consultations: experiences from patients' and physicians' perspectives

OBJECTIVE: Many patients use the Internet to obtain health-related information. It is assumed that health-related Internet information (HRII) will change the consultation practice of physicians. This article explores the strategies, benefits and difficulties from the patients' and physicians' perspective. METHODS: Semi-structured interviews were conducted independently with 32 patients and 20 physicians. Data collection, processing and analysis followed the core principles of Grounded Theory. RESULTS: Patients experienced difficulties in the interpretation of the personal relevance and the meaning of HRII. Therefore they relied on their physicians' interpretation and contextualisation of this information. Discussing patients' concerns and answering patients' questions were important elements of successful consultations with Internet-informed patients to achieve clarity, orientation and certainty. Discussing HRII with patients was appreciated by most of the physicians but misleading interpretations by patients and contrary views compared to physicians caused conflicts during consultations. CONCLUSION: HRII is a valuable source of knowledge for an increasing number of patients. Patients use the consultation to increase their understanding of health and illness. Determinants such as a patient-centred consultation and timely resources are decisive for a successful, empowering consultation with Internet-informed patients. PRACTICAL IMPLICATIONS: If HRII is routinely integrated in the anamnestic interview as a new source of knowledge, the Internet can be used as a link between physicians' expertise and patient knowledge. The critical appraisal of HRII during the consultation is becoming a new field of work for physicians.

The James Lind Library: explaining and illustrating the evolution of fair tests of medical treatments

The James Lind Library (www.jameslindlibrary.org) has been established to improve public and professional general knowledge about fair tests of treatments in healthcare and their history. Its foundation was laid ten years ago at the Royal College of Physicians of Edinburgh, and its administrative centre is in the College's Sibbald Library, one of the most important collections of historic medical manuscripts, papers and books in the world. The James Lind Library is a website that introduces visitors to the principles of fair tests of treatments, with a series of short, illustrated essays, which are currently available in English, Arabic, Chinese, French, Portuguese, Russian and Spanish. A 100-page book-- Testing Treatments--is now available free through the website, both in English and in Arabic and Spanish translations. To illustrate the evolution of ideas related to fair tests of treatments from 2000 BC to the present, the James Lind Library contains key passages and images from manuscripts, books and journal articles, many of them accompanied by commentaries, biographies, portraits and other relevant documents and images, including audio and video files. New material is being added to the website continuously, as relevant new records are identified and as methods for testing treatments evolve. A multinational, multilingual editorial team oversees the development of the website, which currently receives tens of thousands of visitors every month.

Learner preferences regarding integrating, sequencing and aligning virtual patients with other activities in the undergraduate medical curriculum: A focus group study

CONTEXT: E-learning resources, such as virtual patients (VPs), can be more effective when they are integrated in the curriculum. To gain insights that can inform guidelines for the curricular integration of VPs, we explored students' perceptions of scenarios with integrated and non-integrated VPs aimed at promoting clinical reasoning skills. METHODS: During their paediatric clerkship, 116 fifth-year medical students were given at least ten VPs embedded in eight integrated scenarios and as non-integrated add-ons. The scenarios differed in the sequencing and alignment of VPs and related educational activities, tutor involvement, number of VPs, relevance to assessment and involvement of real patients. We sought students' perceptions on the VP scenarios in focus group interviews with eight groups of 4-7 randomly selected students (n = 39). The interviews were recorded, transcribed and analysed qualitatively. RESULTS: The analysis resulted in six themes reflecting students' perceptions of important features for effective curricular integration of VPs: (i) continuous and stable online access, (ii) increasing complexity, adapted to students' knowledge, (iii) VP-related workload offset by elimination of other activities, (iv) optimal sequencing (e.g.: lecture--1 to 2 VP(s)--tutor-led small group discussion--real patient) and (V) optimal alignment of VPs and educational activities, (vi) inclusion of VP topics in assessment. CONCLUSIONS: The themes appear to offer starting points for the development of a framework to guide the curricular integration of VPs. Their impact needs to be confirmed by studies using quantitative controlled designs.

Tailored instructional methods for students with diverse levels of computer knowledge and skills

The purpose of this online course is to ensure new nursing graduate students know how to use computer technologies required to complete academic and research activities. Powerful computers, high speed internet, digitalized resources and databases are widely available in educational institutes. New renovation and updates are being released at faster pace than ever. All these developments are necessary for a student to utilize computer programs and synthesize large amount of data in a limited time for any given academic research project. [See PDF for complete abstract]

Using Blackboard Administered Precourse and Post course Tests to Assess Student Readiness to Learn and Change in Knowledge

Students arrive at classes with a varying social situations and course subject knowledge. Blackboard is a web based course delivery program that permits testing of students before arriving at the first class. A pretest was used to assess preexisting subject knowledge(S) and a survey was used to assess non-subject (N) factors that might impact the student’s final grade. A posttest was administered after all content was delivered and used to access change in S. [See PDF for complete abstract]

A Web Services architecture for UMLS Knowledge Sources.

A web service is a collection of industry standards to enable reusability of services and interoperability of heterogeneous applications. The UMLS Knowledge Source (UMLSKS) Server provides remote access to the UMLSKS and related resources. We propose a Web Services Architecture that encapsulates UMLSKS-API and makes it available in distributed and heterogeneous environments. This is the first step towards intelligent and automatic UMLS services discovery and invocation by computer systems in distributed environments such as web.

Medical Error: Is the Solution Medical or Cognitive?

Is the solution for medical errors medical or cognitive? In this AMIA2001 panel on medical error, we argued that medical error is primarily an issue for cognitive science and engineering, not for medicine, although the knowledge of the practice of medicine is essential for the research and prevention of medical errors. The three panelists presented studies that demonstrate that cognitive research is the foundation for theories of medical errors and interventions of error reductions.

Knowledge and Perception of the Role of Targeted Ultrasound in Detecting Down Syndrome Among a High Risk Population

The purpose of this study was to determine the perception and knowledge of targeted ultrasound in women who screen positive for Down syndrome in the first or second trimester, and to assess the perceived detection rate of Down syndrome by targeted ultrasound in this population. While several studies have reported patient perceptions’ of routine ultrasound, no study has specifically examined knowledge regarding the targeted ultrasound and its role in detecting Down syndrome. A targeted ultrasound is a special ultrasound during the second trimester offered to women who may be at a higher-than-average risk of having a baby with some type of birth defect or complication. The purpose of the ultrasound is to evaluate the overall growth and development of the baby as well as screen for birth defects and genetic conditions. Women under the age of 35 referred for an abnormal first or second trimester maternal serum screen to several Houston area clinics were asked to complete a questionnaire to obtain demographic and ultrasound knowledge information as well as assess perceived detection rate of Down syndrome by ultrasound. Seventy-seven women completed the questionnaire and participated in the study. Our findings revealed that women have limited background knowledge about the targeted ultrasound and its role in detecting Down syndrome. These findings are consistent with other studies that have reported a lack of understanding about the purpose of ultrasound examinations. One factor that seems to increase background knowledge about the targeted ultrasound is individuals having a higher level of education. However, most participants regardless of race, education, income, and exposure to targeted ultrasound information did not know the capabilities of a targeted ultrasound. This study confirmed women lack background knowledge about the targeted ultrasound and do not know enough about the technology to form a perception regarding its ability to detect Down syndrome. Additional studies to identify appropriate education techniques are necessary to determine how to best inform our patient population about targeted ultrasound.

Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health records.

BACKGROUND: We have carried out an extensive qualitative research program focused on the barriers and facilitators to successful adoption and use of various features of advanced, state-of-the-art electronic health records (EHRs) within large, academic, teaching facilities with long-standing EHR research and development programs. We have recently begun investigating smaller, community hospitals and out-patient clinics that rely on commercially-available EHRs. We sought to assess whether the current generation of commercially-available EHRs are capable of providing the clinical knowledge management features, functions, tools, and techniques required to deliver and maintain the clinical decision support (CDS) interventions required to support the recently defined "meaningful use" criteria. METHODS: We developed and fielded a 17-question survey to representatives from nine commercially available EHR vendors and four leading internally developed EHRs. The first part of the survey asked basic questions about the vendor's EHR. The second part asked specifically about the CDS-related system tools and capabilities that each vendor provides. The final section asked about clinical content. RESULTS: All of the vendors and institutions have multiple modules capable of providing clinical decision support interventions to clinicians. The majority of the systems were capable of performing almost all of the key knowledge management functions we identified. CONCLUSION: If these well-designed commercially-available systems are coupled with the other key socio-technical concepts required for safe and effective EHR implementation and use, and organizations have access to implementable clinical knowledge, we expect that the transformation of the healthcare enterprise that so many have predicted, is achievable using commercially-available, state-of-the-art EHRs.

Taxonomy development and knowledge representation of nurses' personal cognitive artifacts.

Nurses prepare knowledge representations, or summaries of patient clinical data, each shift. These knowledge representations serve multiple purposes, including support of working memory, workload organization and prioritization, critical thinking, and reflection. This summary is integral to internal knowledge representations, working memory, and decision-making. Study of this nurse knowledge representation resulted in development of a taxonomy of knowledge representations necessary to nursing practice.This paper describes the methods used to elicit the knowledge representations and structures necessary for the work of clinical nurses, described the development of a taxonomy of this knowledge representation, and discusses translation of this methodology to the cognitive artifacts of other disciplines. Understanding the development and purpose of practitioner's knowledge representations provides important direction to informaticists seeking to create information technology alternatives. The outcome of this paper is to suggest a process template for transition of cognitive artifacts to an information system.

The Role of Consistency and Diversity in Building Knowledge in Family Preservation

Family preservation has been criticized for implementing programs that are not theoretically founded. One result of this circumstance is a lack of information regarding processes and outcomes of family preservation services. The knowledge base of family preservation is thus rather limited at present and will remain limited unless theory is consistently integrated within individual programs. A model for conceptualizing how theoretical consistency may be implemented within programs is presented and applied to family preservation. It is also necessary for programs to establish theoretical consistency before theoretical diversity, both within individual and across multiple programs, in order to advance the field in meaningful ways. A developmental cycle of knowledge generation is presented and applied to family preservation.

Knowledge, beliefs, risk behaviors, and social skills for HIV/STD prevention in junior college students (grades 11--12) in Bombay, India

1230 year 11 and 12 college students, modal age 16 and 17, in three colleges in Bombay, India, were studied on sexual behaviors or risk of sexual behaviors, beliefs about sex, HIV/STD knowledge, perceived norms regarding sexual behaviors, and the relationships between social skills/anxieties in HIV/STD prevention and actual and anticipated sexual behaviors. A quantitative questionnaire examining HIV/STD risk behaviors, knowledge, attitudes and beliefs, and the AIDS Social Assertiveness Scale (ASAS) were administered to these 1230 college students. Data indicated that 8% of males and 1% of females had had sexual experience, but over one third were not sure at all of being able to abstain from sexual activity with either steady or casual partners. Perceived norms were slanted toward sexual abstinence for the majority of the sample. Knowledge of protective effects of condoms was high, although half of those who had had sex did not use condoms. Logistic regression showed knowledge was higher among males, those who believed it was OK to have sex with a steady partner and that they should not wait until they were older, those who believed that condoms should be used even if the partner is known, and those who believed it was acceptable to have multiple partners. Gender differences in sexual activity and beliefs about sexual activity showed males were less likely to believe in abstaining from sexual activity. The 5 scales of the ASAS were scored and compared on ANOVA on: those who had had sexual experience (HS), those who anticipated being unable to refuse sex (AS), and those who did not anticipate problems in refusing sex (DS). Those in the AS group had greater anxieties about refusing sexual or other risk behaviors than HS and DS groups. There were greater anxieties about dealing with condoms in the AS and DS groups compared with the HS group. Confiding sexual or HIV/STD-related problems to significant others was more anxiety-provoking for the AS group compared with the HS group, and the AS group were more anxious about interactions with people with HIV. Factor analysis produced the same 5 factors as those found in previous studies. Of these, condom interactions and confiding in significant others were most anxiety provoking, and condom interactions most variable based on demographic and attitudinal factors.^ This age group is appropriate for HIV/STD reduction education given the low rate of sexual activity but despite knowledge of the importance of condom use, social skills to apply this knowledge are lacking. Social skills training in sexual negotiations, condom negotiations, and confiding HIV/STD-related concerns to significant others should reduce the risks of Indian college students having unwanted or unprotected sex. ^