Diagnostic accuracy of the Eurotest for dementia: a naturalistic, multicenter phase II study

BACKGROUND Available screening tests for dementia are of limited usefulness because they are influenced by the patient's culture and educational level. The Eurotest, an instrument based on the knowledge and handling of money, was designed to overcome these limitations. The objective of this study was to evaluate the diagnostic accuracy of the Eurotest in identifying dementia in customary clinical practice. METHODS A cross-sectional, multi-center, naturalistic phase II study was conducted. The Eurotest was administered to consecutive patients, older than 60 years, in general neurology clinics. The patients' condition was classified as dementia or no dementia according to DSM-IV diagnostic criteria. We calculated sensitivity (Sn), specificity (Sp) and area under the ROC curves (aROC) with 95% confidence intervals. The influence of social and educational factors on scores was evaluated with multiple linear regression analysis, and the influence of these factors on diagnostic accuracy was evaluated with logistic regression. RESULTS Sixteen neurologists recruited a total of 516 participants: 101 with dementia, 380 without dementia, and 35 who were excluded. Of the 481 participants who took the Eurotest, 38.7% were totally or functionally illiterate and 45.5% had received no formal education. Mean time needed to administer the test was 8.2+/-2.0 minutes. The best cut-off point was 20/21, with Sn = 0.91 (0.84-0.96), Sp = 0.82 (0.77-0.85), and aROC = 0.93 (0.91-0.95). Neither the scores on the Eurotest nor its diagnostic accuracy were influenced by social or educational factors. CONCLUSION This naturalistic and pragmatic study shows that the Eurotest is a rapid, simple and useful screening instrument, which is free from educational influences, and has appropriate internal and external validity.

Impactia: automating the study of the scientific production

Introduction The Andalusian Public Health System Virtual Library (Biblioteca Virtual del Sistema Sanitario Público de Andalucía, BV-SSPA) was set up in June 2006. It consists of a regional government action with the aim of democratizing the health professional access to quality scientific information, regardless of the professional workplace. Andalusia is a region with more than 8 million inhabitants, with 100,000 health professionals for 41 hospitals, 1,500 primary healthcare centres, and 28 centres for non-medical attention purposes (research, management, and educational centres). Objectives The Department of Development, Research and Investigation (R+D+i) of the Andalusian Regional Government has, among its duties, the task of evaluating the hospitals and centres of the Andalusian Public Health System (SSPA) in order to distribute its funding. Among the criteria used is the evaluation of the scientific output, which is measured using bibliometry. It is well-known that the bibliometry has a series of limitations and problems that should be taken into account, especially when it is used for non-information sciences, such us career, funding, etc. A few years ago, the bibliometric reports were done separately in each centre, but without using preset and well-defined criteria, elements which are basic when we need to compare the results of the reports. It was possible to find some hospitals which were including Meeting Abstracts in their figures, while others do not, and the same was happening with Erratum and many other differences. Therefore, the main problem that the Department of R+D+i had to deal with, when they were evaluating the health system, was that bibliometric data was not accurate and reports were not comparable. With the aim of having an unified criteria for the whole system, the Department of R+D+i ordered the BV-SSPA to do the year analysis of the scientific output of the system, using some well defined criteria and indicators, among whichstands out the Impact Factor. Materials and Methods As the Impact Factor is the bibliometric indicator that the virtual library is asked to consider, it is necessary to use the database Web of Science (WoS), since it is its owner and editor. The WoS includes the databases Science Citation Index (SCI), Social Sciences Citation Index (SSCI) and Arts & Humanities Citation Index. To gather all the documents, SCI and SSCI are used; to obtain the Impact Factor and quartils, it is used the Journal Citation Reports, JCR. Unlike other bibliographic databases, such us MEDLINE, the bibliometric database WoS includes the address of all the authors. In order to retrieve all the scientific output of the SSPA, we have done general searches, which are afterwards processed by a tool developed by our library. We have done nine different searches using the field ‘address’; eight of them including ‘Spain’ and each one of the eight Andalusian Regions, and the other one combining ‘Spain’ with all those cities where there are health centres, since we have detected that there are some authors that do not use the region in their signatures. These are some of the search strategies: AD=Malaga and AD=Spain AD=Sevill* and AD=Spain AD=SPAIN AND (AD=GUADIX OR AD=BAZA OR AD=MOTRIL) Further more, the field ‘year’ is used to determine the period. To exploit the data, the BV-SSPA has developed a tool called Impactia. It is a web application which uses a database to store the information of the documents generated by the SSPA. Impactia allows the user to automatically process the retrieved documents, assigning them to their correspondent centres. In order to do the classification of documents automaticaly, it was necessary to detect the huge variability of names of the centres that the authors use in their signatures. Therefore, Impactia knows that if an author signs as “Hospital Universitario Virgen Macarena”, “HVM” or “Hosp. Virgin Macarena”, he belongs to the same centre. The figure attached shows the variability found for the Empresa Publica Hospital de Poniente. Besides the documents from WoS, Impactia includes the documents indexed in Scopus and in other databases, where we do bibliographic searches using similar strategies to the later ones. Aware that in the health centres and hospitals there is a lot of grey literature that is not gathered in databases, Impactia allows the centres to feed the application with these documents, so that all the SSPA scientific output is gathered and organised in a centralized place. The ones responsible of localizing this gray literature are the librarians of each one of the centres. They can also do statements to the documents and indicators that are collected and calculated by Impactia. The bulk upload of documents from WoS and Scopus into Impactia is monthly done. One of the main issues that we found during the development of Impactia was the need of dealing with duplicated documents obtained from different sources. Taking into account that sometimes titles might be written differently, with slashes, comas, and so on, Impactia detects the duplicates using the field ‘DOI’ if it is available or comparing the fields: page start, page end and ISSN. Therefore it is possible to guarantee the absence of duplicates. Results The data gathered in Impactia becomes available to the administrative teams and hospitals managers, through an easy web page that allows them to know at any moment, and with just one click, the detailed information of the scientific output of their hospitals, including useful graphs such as percentage of document types, journals where their scientists usually publish, annual comparatives, bibliometric indicators and so on. They can also compare the different centres of the SSPA. Impactia allows the user to download the data from the application, so that he can work with this information or include them in their centres’ reports. This application saves the health system many working hours. It was previously done manually by forty one librarians, while now it is done by only one person in the BV-SSPA during two days a month. To sum up, the benefits of Impactia are: It has shown its effectiveness in the automatic classification, treatment and analysis of the data. It has become an essential tool for all managers to evaluate quickly and easily the scientific production of their centers. It optimizes the human resources of the SSPA, saving time and money. It is the reference point for the Department of R+D+i to do the scientific health staff evaluation.

How to manage a virtual library?

Introduction. The Andalusian Public Health System Virtual Library (Biblioteca Virtual del Sistema Sanitario Público de Andalucía, BV-SSPA) was created in June 2006, after being determined by the II Quality Plan in the key process Guarantee the Knowledge Exchange into the Health System which was established by the Strategy IV, Knowledge Management, 2005-2008. It is a government strategy with its own budget and management with the aim of rationalizing the subscriptions into the Andalusian Health System and democratizing the health professional access to qualify scientific information, regardless of the professional workplace. Andalusia is a wide region with more than 8 million inhabitants, more than 90,000 health professionals for 41 hospitals, 1,500 primary healthcare centres, and 12 centres for non-medical attention purposes, and the Virtual Library was created to cover all this Health Services. Before the creation of the BV-SSPA every centre had its own budget and management decisions concerning scientific resources, with the creation of the BV-SSPA both management and budget were centralized. Objectives. With this work we pretend to analyze if the results after these five years have reached the expectations from an economic point of view and determine if really we can offer a benefit to the Andalusian Professional and Society in general. We will demonstrate the following: - The BV-SSPA supposed a cost reduction. It meant cost-effectiveness. - It resulted in Economics of Scale, as we have every year more resources and services investing a minor proportional amount of money. - In terms of Efficiency it implemented more services than the System had before its creation, we a lower budget. Methods. The BV-SSPA was appointed the only intermediary for contracting electronic resources destined to the Andalusian Health System. This had some consequences which should be analyzed: - Hospitals were not allowed to subscribe any resources. - Services offered for the whole System. - A remote access system was created. - Tools to give more visibility to the Public Health System were developed. - Negotiations techniques changed as the BV-SSPA is stronger than individual hospitals. Results. - The amount of 2,431 electronic reviews, 8 data bases and other scientific information resources at the disposal of the Andalusian Health System Professionals and available worldwide requiring only an internet connection. Before the BV-SSPA, 5,267 titles were subscribed by hospital and 2,967 of them were subscribed repeatedly (by two or more hospitals), this represented more than 55%. The rationalization of the subscription investment has been reached. - The establishment of several important scientific services for the whole territory of Andalusia, not only big hospitals. - The use of appropriate tools through a Web 2.0 and Social Media to be acknowledged by most National Health Professionals. Conclusions. It has been demonstrated that the BV-SSPA has become the Central Unit for purchasing, offering librarian services and a reference for users in terms of knowledge management, but from the point of view of business it has also obtained the following results: - Cost-Effectiveness: Its budget for subscriptions is lower than the hospital former one in a 30% and now more electronic resources are available. - Economics of Scale: Near 95,000 health professionals can access this Virtual Library in 2010. Before its creation Professionals for small hospital and Primary Care centres were not able to access to scientific information subscribed by big hospitals. - Efficiency Besides the central electronic purchasing, services were created for the System, without increasing the expenses: - Remote access to all the library resources independent of the user’s location. The BV-SSPA usage increased in a 147% in 2008, when it was installed. - The Document Supply Service implemented in 2009. - The Institutional Repository which contains the whole intellectual, scientific production generated by the Andalusian Public Health Professionals as a result of their healthcare, research or managing activity. - The creation of an application developed by the BV-SSPA to study the Andalusian Health System Scientific Production. - The visibility of the Andalusian Health System reached thanks to the BV-SSPA, through the numerous events in which it participates and organizes such as the 2nd. European National Digital Libraries of Health Conferences and the National Conference of Health Science Information and Documentation held in Cadiz in 2010; and its profile in social media where it can be contacted by citizens and health professionals all over the world. - Negotiation with electronic resource suppliers is much more advantageous as the BV-SSPA is stronger to deal with them thanks to its consolidated budget, its managing independence and its visibility.