Automatic indexing and retrieval of encounter-specific evidence for point-of-care support

Evidence-based medicine relies on repositories of empirical research evidence that can be used to support clinical decision making for improved patient care. However, retrieving evidence from such repositories at local sites presents many challenges. This paper describes a methodological framework for automatically indexing and retrieving empirical research evidence in the form of the systematic reviews and associated studies from The Cochrane Library, where retrieved documents are specific to a patient-physician encounter and thus can be used to support evidence-based decision making at the point of care. Such an encounter is defined by three pertinent groups of concepts - diagnosis, treatment, and patient, and the framework relies on these three groups to steer indexing and retrieval of reviews and associated studies. An evaluation of the indexing and retrieval components of the proposed framework was performed using documents relevant for the pediatric asthma domain. Precision and recall values for automatic indexing of systematic reviews and associated studies were 0.93 and 0.87, and 0.81 and 0.56, respectively. Moreover, precision and recall for the retrieval of relevant systematic reviews and associated studies were 0.89 and 0.81, and 0.92 and 0.89, respectively. With minor modifications, the proposed methodological framework can be customized for other evidence repositories. © 2010 Elsevier Inc.

Automatic indexing in information retrieval

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

Capturing strategy as an everyday practice:quantitative methodologies for analysing practice data

Few works address methodological issues of how to conduct strategy-as-practice research and even fewer focus on how to analyse the subsequent data in ways that illuminate strategy as an everyday, social practice. We address this gap by proposing a quantitative method for analysing observational data, which can complement more traditional qualitative methodologies. We propose that rigorous but context-sensitive coding of transcripts can render everyday practice analysable statistically. Such statistical analysis provides a means for analytically representing patterns and shifts within the mundane, repetitive elements through which practice is accomplished. We call this approach the Event Database (EDB) and it consists of five basic coding categories that help us capture the stream of practice. Indexing codes help to index or categorise the data, in order to give context and offer some basic information about the event under discussion. Indexing codes are descriptive codes, which allow us to catalogue and classify events according to their assigned characteristics. Content codes are to do with the qualitative nature of the event; this is the essence of the event. It is a description that helps to inform judgements about the phenomenon. Nature codes help us distinguish between discursive and tangible events. We include this code to acknowledge that some events differ qualitatively from other events. Type events are codes abstracted from the data in order to help us classify events based on their description or nature. This involves significantly more judgement than the index codes but consequently is also more meaningful. Dynamics codes help us capture some of the movement or fluidity of events. This category has been included to let us capture the flow of activity over time.

Recent developments in information retrieval:preface

This paper summarizes the scientific work presented at the 32nd European Conference on Information Retrieval. It demonstrates that information retrieval (IR) as a research area continues to thrive with progress being made in three complementary sub-fields, namely IR theory and formal methods together with indexing and query representation issues, furthermore Web IR as a primary application area and finally research into evaluation methods and metrics. It is the combination of these areas that gives IR its solid scientific foundations. The paper also illustrates that significant progress has been made in other areas of IR. The keynote speakers addressed three such subject fields, social search engines using personalization and recommendation technologies, the renewed interest in applying natural language processing to IR, and multimedia IR as another fast-growing area.

Capturing strategy as an everyday practice:quantitative methodologies for analysing practice data

Few works address methodological issues of how to conduct strategy-as-practice research and even fewer focus on how to analyse the subsequent data in ways that illuminate strategy as an everyday, social practice. We address this gap by proposing a quantitative method for analysing observational data, which can complement more traditional qualitative methodologies. We propose that rigorous but context-sensitive coding of transcripts can render everyday practice analysable statistically. Such statistical analysis provides a means for analytically representing patterns and shifts within the mundane, repetitive elements through which practice is accomplished. We call this approach the Event Database (EDB) and it consists of five basic coding categories that help us capture the stream of practice. Indexing codes help to index or categorise the data, in order to give context and offer some basic information about the event under discussion. Indexing codes are descriptive codes, which allow us to catalogue and classify events according to their assigned characteristics. Content codes are to do with the qualitative nature of the event; this is the essence of the event. It is a description that helps to inform judgements about the phenomenon. Nature codes help us distinguish between discursive and tangible events. We include this code to acknowledge that some events differ qualitatively from other events. Type events are codes abstracted from the data in order to help us classify events based on their description or nature. This involves significantly more judgement than the index codes but consequently is also more meaningful. Dynamics codes help us capture some of the movement or fluidity of events. This category has been included to let us capture the flow of activity over time.

Editorial

Readers may have noted that a short but very important announcement was made in the last issue of CLAE, at the top of the contents page. CLAE has been accepted by Thomson Reuters for abstracting and indexing in its SciSearch, Journal Citation Reports, and Current Contents services. This will ensure a greater visibility to the international research community. In addition, in June 2012 CLAE will receive its very first official Impact Factor – a measure of journal influence of importance to authors and readers alike. The impact factor value has not yet been decided but internal estimates by Elsevier estimate it will be around 1, and it will be applied to all CLAE issue back to January 2009 (volume 32). I would guess readers at this stage would have one of two responses – either ‘that's good news’ or perhaps ‘what's an impact factor?’ If you are in the latter camp then allow me to try and explain. Basically the impact factor or citation index of a journal is based on how many times in the previous year papers published in that journal in the previous two years were cited by authors publishing in other journals. So the 2012 impact factor for CLAE is calculated on how many times in 2011 papers that were published in CLAE in 2010 and 2009 were cited in other journals in 2011, divided by the number of papers published in CLAE 2010 and 2009. Essentially authors will try and get their work published in journals with a higher impact factor as it is thought that the paper will be cited more by other authors or the paper will have higher visibility in the arena. For universities having its published output in higher journals is one of the markers used to judge esteem. For individual authors publishing in journals with a higher impact factor or the number of times one of their papers is published is something that they are likely to add to their CVs or demonstrate the importance of their work. Journals with higher impact factors tend to be more review journals or journals with a wider spectrum so for a relatively small journal with a specialised field like CLAE it is great to be listed with a citation index. The awarding of a citation index crowns many changes that CLAE has undergone since the current Editor took the reins in 2005. CLAE has increased from four issues (in 2004) to six issues per year with at least one review article per issue and one article with continuing education per issue. The rejection rate has gone up significantly meaning that only best papers are published (currently it stands at 37%). CLAE has been Medline/Pubmed indexed for a few years now which is also a very important factor in improving visibility of the journal. The submission and reviewing process for CLAE in now entirely online and finally the editorial board has changed from being merely a list of keynote people to being an active group of keynote people who are enthusiastically involved with the journal. From the editorial board one person is appointed as a Reviews Editor plus we have two additional editors who work as Regional Editors. As ever, on behalf of CLAE I would like to thank the BCLA Council for their continued support (especially Vivien Freeman) and Elsevier for their continuing guidance (in particular Andrew Miller and Rosie Davey) and the excellent Editorial Board (Christopher Snyder, Pauline Cho, Eric Papas, Jan Bergmanson, Roger Buckley, Patrick Caroline, Dwight Cavanagh, Robin Chalmers, Michael Doughty, Nathan Efron, Michel Guillon, Nizar Hirji, Meng Lin, Florence Malet, Philip Morgan, Deborah Sweeney, Brian Tighe, Eef van Der Worp, Barry Weissman, Mark Willcox, James Wolffsohn and Craig Woods). And finally, a big thanks to the authors and reviewers who work tirelessly putting manuscripts together for publication in CLAE. Copyright © 2012 Published by Elsevier Ltd.

Finding qualitative research: an evaluation of search strategies

Background Qualitative research makes an important contribution to our understanding of health and healthcare. However, qualitative evidence can be difficult to search for and identify, and the effectiveness of different types of search strategies is unknown. Methods Three search strategies for qualitative research in the example area of support for breast-feeding were evaluated using six electronic bibliographic databases. The strategies were based on using thesaurus terms, free-text terms and broad-based terms. These strategies were combined with recognised search terms for support for breast-feeding previously used in a Cochrane review. For each strategy, we evaluated the recall (potentially relevant records found) and precision (actually relevant records found). Results A total yield of 7420 potentially relevant records was retrieved by the three strategies combined. Of these, 262 were judged relevant. Using one strategy alone would miss relevant records. The broad-based strategy had the highest recall and the thesaurus strategy the highest precision. Precision was generally poor: 96% of records initially identified as potentially relevant were deemed irrelevant. Searching for qualitative research involves trade-offs between recall and precision. Conclusions These findings confirm that strategies that attempt to maximise the number of potentially relevant records found are likely to result in a large number of false positives. The findings also suggest that a range of search terms is required to optimise searching for qualitative evidence. This underlines the problems of current methods for indexing qualitative research in bibliographic databases and indicates where improvements need to be made.

Representing clinical documents to support automatic retrieval of evidence from the Cochrane Library

The overall aim of our research is to develop a clinical information retrieval system that retrieves systematic reviews and underlying clinical studies from the Cochrane Library to support physician decision making. We believe that in order to accomplish this goal we need to develop a mechanism for effectively representing documents that will be retrieved by the application. Therefore, as a first step in developing the retrieval application we have developed a methodology that semi-automatically generates high quality indices and applies them as descriptors to documents from The Cochrane Library. In this paper we present a description and implementation of the automatic indexing methodology and an evaluation that demonstrates that enhanced document representation results in the retrieval of relevant documents for clinical queries. We argue that the evaluation of information retrieval applications should also include an evaluation of the quality of the representation of documents that may be retrieved. ©2010 IEEE.