UNSUPERVISED INDEXING OF MEDLINE ARTICLES THROUGH GRAPH-BASED RANKING

The biomedical literature is extensively catalogued and indexed in MEDLINE. MEDLINE indexing is done by trained human indexers, who identify the most important concepts in each article, and is expensive and inconsistent. Automating the indexing task is difficult: the National Library of Medicine produces the Medical Text Indexer (MTI), which suggests potential indexing terms to the indexers. MTI’s output is not good enough to work unattended. In my thesis, I propose a different way to approach the indexing task called MEDRank. MEDRank creates graphs representing the concepts in biomedical articles and their relationships within the text, and applies graph-based ranking algorithms to identify the most important concepts in each article. I evaluate the performance of several automated indexing solutions, including my own, by comparing their output to the indexing terms selected by the human indexers. MEDRank outperformed all other evaluated indexing solutions, including MTI, in general indexing performance and precision. MEDRank can be used to cluster documents, index any kind of biomedical text with standard vocabularies, or could become part of MTI itself.

Efficacy of quality criteria to identify potentially harmful information: a cross-sectional survey of complementary and alternative medicine web sites.

BACKGROUND: Many users search the Internet for answers to health questions. Complementary and alternative medicine (CAM) is a particularly common search topic. Because many CAM therapies do not require a clinician's prescription, false or misleading CAM information may be more dangerous than information about traditional therapies. Many quality criteria have been suggested to filter out potentially harmful online health information. However, assessing the accuracy of CAM information is uniquely challenging since CAM is generally not supported by conventional literature. OBJECTIVE: The purpose of this study is to determine whether domain-independent technical quality criteria can identify potentially harmful online CAM content. METHODS: We analyzed 150 Web sites retrieved from a search for the three most popular herbs: ginseng, ginkgo and St. John's wort and their purported uses on the ten most commonly used search engines. The presence of technical quality criteria as well as potentially harmful statements (commissions) and vital information that should have been mentioned (omissions) was recorded. RESULTS: Thirty-eight sites (25%) contained statements that could lead to direct physical harm if acted upon. One hundred forty five sites (97%) had omitted information. We found no relationship between technical quality criteria and potentially harmful information. CONCLUSIONS: Current technical quality criteria do not identify potentially harmful CAM information online. Consumers should be warned to use other means of validation or to trust only known sites. Quality criteria that consider the uniqueness of CAM must be developed and validated.

Breast cancer on the world wide web: cross sectional survey of quality of information and popularity of websites.

OBJECTIVES: To determine the characteristics of popular breast cancer related websites and whether more popular sites are of higher quality. DESIGN: The search engine Google was used to generate a list of websites about breast cancer. Google ranks search results by measures of link popularity---the number of links to a site from other sites. The top 200 sites returned in response to the query "breast cancer" were divided into "more popular" and "less popular" subgroups by three different measures of link popularity: Google rank and number of links reported independently by Google and by AltaVista (another search engine). MAIN OUTCOME MEASURES: Type and quality of content. RESULTS: More popular sites according to Google rank were more likely than less popular ones to contain information on ongoing clinical trials (27% v 12%, P=0.01 ), results of trials (12% v 3%, P=0.02), and opportunities for psychosocial adjustment (48% v 23%, P<0.01). These characteristics were also associated with higher number of links as reported by Google and AltaVista. More popular sites by number of linking sites were also more likely to provide updates on other breast cancer research, information on legislation and advocacy, and a message board service. Measures of quality such as display of authorship, attribution or references, currency of information, and disclosure did not differ between groups. CONCLUSIONS: Popularity of websites is associated with type rather than quality of content. Sites that include content correlated with popularity may best meet the public's desire for information about breast cancer.

Evaluating the prevalence, content and readability of complementary and alternative medicine (CAM) web pages on the internet.

Complementary and alternative medicine (CAM) use is growing rapidly. As CAM is relatively unregulated, it is important to evaluate the type and availability of CAM information. The goal of this study is to deter-mine the prevalence, content and readability of online CAM information based on searches for arthritis, diabetes and fibromyalgia using four common search engines. Fifty-eight of 599 web pages retrieved by a "condition search" (9.6%) were CAM-oriented. Of 216 CAM pages found by the "condition" and "condition + herbs" searches, 78% were authored by commercial organizations, whose pur-pose involved commerce 69% of the time and 52.3% had no references. Although 98% of the CAM information was intended for consumers, the mean read-ability was at grade level 11. We conclude that consumers searching the web for health information are likely to encounter consumer-oriented CAM advertising, which is difficult to read and is not supported by the conventional literature.

Comparing communication technology on Chinese, English, and Spanish diabetes web sites.

Technological and cultural factors influence access to health information on the web in multifarious ways. We evaluated structural differences and availability of communication services on the web in three diverse language and cultural groups: Chinese, English, and Spanish. A total of 382 web sites were analyzed: 144 were English language sites (38%), 129 were Chinese language sites (34%), and 108 were Spanish language sites (28%). We did not find technical differences in the number of outgoing links per domain or the total availability of communication services between the three groups. There were differences in the distribution of available services between Chinese and English sites. In the Chinese sites, there were more communication services between consumers and health experts. Our results suggest that the health-related web presence of these three cultural groups is technologically comparable, but reflects differences that may be attributable to cultural factors.

Evaluation of web-based resources for pregnant and parenting teens

Current teen pregnancy and repeat pregnancy rates reveal that there is a pressing need for comprehensive care for pregnant and parenting teens to address their unique needs. The Internet has become a source of various types of information and as a result, several efforts have begun to assess the quality of health information provided on websites. The objective of this study was to assess the functionality and quality of websites containing health information and resources for pregnant and parenting teens. The three most widely used search engines currently: Google, MSN, and Yahoo were searched using three general search terms “teen pregnancy”, “pregnant teen”, and “teen parent”. The first 5 pages of each search were reviewed and categorized to yield 12 websites which met inclusion criteria for content evaluation. The 12 websites were rated using a pre-existing instrument encompassing two domains: functionality and content analysis. Within the functionality domain, this sample highlighted the need to improve accessibility and credibility for the target population. The content analysis revealed that among the topics which are recommended for pregnant and parenting teens, the topics most commonly covered were mental health and primary and preventive health care. The majority of websites neglected sexual health topics including STI’s and family planning. This study provides the first glimpse into health information and resources for pregnant and parenting teens on the Internet. Researchers, health care providers, social workers, health educators, and website sponsors can use these results to maintain and recommend websites which offer easily accessible, accurate, and practical information for pregnant and parenting teens.^

Evaluation of web-based resources for HIV+ youth

Given current rates of the Human Immunodeficiency Virus (HIV) in youth ages 15–24, comprehensive care is imperative in order to manage the virus and to prevent further transmission. In the past decade, the Internet has become an immensely popular source for information, including health information. Due to the increase in Internet use for this purpose, the assessment of the quality, accuracy, and timeliness of health information on the Internet is necessary since the information delivered may not be current or accurate. The purpose of this study was to determine the quantity and quality of websites containing health information and resources directed specifically towards HIV positive youth. Three general search terms, “HIV + teens”, “HIV teens info”, and “HIV infected teens,” were searched using the current top three search engines: Google, Yahoo!, and MSN/Bing. The first hundred hits of each search were then categorized by type of website. The examination of the search results yielded 7 sites that met the inclusion criteria. These sites were consequently evaluated on functionality and content using an adapted version of a pre-existing instrument. The functionality analysis revealed that no websites that contained self management information were dedicated specifically to HIV positive youth. The content analysis showed that the sites chosen for evaluation were mostly consistent with the guidelines provided by the Department of Health and Human Services. The most discussed topics in the sites included the importance of safer sexual behavior, HIV counseling, partner notification, safer behavior choices, such as condom use, and mental health. These results highlight the need for the development of accessible websites that contain accurate information targeting youth infected with HIV. This study provides a snapshot of the available web-based resources and health information for HIV positive youth, and is relevant for health educators, care providers, researchers, and others intervening with HIV+ youth. ^

Implementing and evaluating a Web -based close call reporting system at an urban hospital

Medical errors and close calls are pervasive in health care. It is hypothesized that the causes of close calls are the same as for medical errors; therefore learning about close calls can help prevent errors and increase patient safety. Yet despite efforts to encourage close call reporting, close calls as well as medical errors are under-reported in health care. The purpose of this dissertation was to implement and evaluate a web-based anonymous close call reporting system in three units at an urban hospital. ^ The study participants were physicians, nurses and medical technicians (N = 187) who care for patients in the Medical Intermediate Care Unit, the Surgical Intermediate Care Unit, and the Coronary Catheterization Laboratory in the hospital. We provided educational information to the participants on how to use the system and e-mailed and delivered paper reminders to report to the participants throughout the 19-month project. We surveyed the participants at the beginning and at the end of the study to assess their attitudes and beliefs regarding incident reporting. We found that the majority of the health care providers in our study are supportive of incident reporting in general but in practice very few had actually reported an error or a close call, semi-structured interview 20 weeks after we made the close call reporting system available. The purpose of the interviews was to further assess the participants' attitudes regarding incident reporting and the reporting system. Our findings suggest that the health care providers are supportive of medical error reporting in general, but are not convinced of the benefit of reporting close calls. Barriers to close call reporting cited include lack of time, heavy workloads, preferring to take care of close calls "on the spot", and not seeing the benefits of close call reporting. Consequently only two = close calls were reported via the system by two separate caregivers during the project. ^ The findings suggest that future efforts to increase close call reporting must address barriers to reporting, especially the belief among care givers that it is not worth taking time from their already busy schedules to report close calls. ^