La valutazione della ricerca scientifica: Uno studio empirico nelle Scienze umane

Nel corso degli ultimi anni si è assistito ad un ampio dibattito sull’uso della valutazione della ricerca nelle università e nelle strutture di ricerca. Nell’ambito di tale dibattito, nella presente tesi, vengono analizzate le più importanti metodologie per la valutazione della ricerca presenti a livello internazionale, i principali strumenti qualitativi di valutazione della ricerca (in particolare la peer review), gli strumenti quantitativi, quali la bibliometria, e le caratteristiche dei più importanti archivi bibliografici citazionali (es. Scopus, Web of Science), approfondendo i principali indicatori citazionali utilizzati nelle scienze umane e sociali (es. Indice H). Inoltre la tesi affronta il tema dell’impatto socio-economico della ricerca e le principali criticità di questo innovativo strumento, attraverso uno studio di caso realizzato nel Regno Unito. Una successiva analisi empirica riguarda le principali liste di riviste realizzate a livello internazionale e nazionale, nel settore scientifico di Storia e Filosofia della scienza. I risultati degli studi mostrano che le liste internazionali di riviste possono rappresentare, un punto di partenza a cui devono necessariamente essere affiancati altri strumenti di valutazione (peer review, analisi citazionali, etc); mentre le liste nazionali rischiano, invece, di essere uno strumento poco utile ed in alcuni casi inadeguato al fine di una corretta valutazione della ricerca, a causa della scarsa internazionalizzazione dei repertori e dei giudizi generalmente troppo elevati attribuiti alle riviste. Un ulteriore risultato raggiunto nella presente tesi riguarda la valutazione della ricerca nelle diverse discipline scientifiche: nelle Scienze umane e sociali risulta esserci uno scarso grado di presenza di pubblicazioni scientifiche nei principali archivi bibliografici e citazionali internazionali. Questa situazione limita fortemente l’attendibilità delle analisi statistiche basate su indici e indicatori quantitativi, per valutare la produttività scientifica di un ricercatore, oppure di una istituzione di ricerca.

Uses and misuses of the STROBE statement: bibliographic study

Objectives Appropriate reporting is central to the application of findings from research to clinical practice. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) recommendations consist of a checklist of 22 items that provide guidance on the reporting of cohort, case-control and cross-sectional studies, in order to facilitate critical appraisal and interpretation of results. STROBE was published in October 2007 in several journals including The Lancet, BMJ, Annals of Internal Medicine and PLoS Medicine. Within the framework of the revision of the STROBE recommendations, the authors examined the context and circumstances in which the STROBE statement was used in the past. Design The authors searched the Web of Science database in August 2010 for articles which cited STROBE and examined a random sample of 100 articles using a standardised, piloted data extraction form. The use of STROBE in observational studies and systematic reviews (including meta-analyses) was classified as appropriate or inappropriate. The use of STROBE to guide the reporting of observational studies was considered appropriate. Inappropriate uses included the use of STROBE as a tool to assess the methodological quality of studies or as a guideline on how to design and conduct studies. Results The authors identified 640 articles that cited STROBE. In the random sample of 100 articles, about half were observational studies (32%) or systematic reviews (19%). Comments, editorials and letters accounted for 15%, methodological articles for 8%, and recommendations and narrative reviews for 26% of articles. Of the 32 observational studies, 26 (81%) made appropriate use of STROBE, and three uses (10%) were considered inappropriate. Among 19 systematic reviews, 10 (53%) used STROBE inappropriately as a tool to assess study quality. Conclusions The STROBE reporting recommendations are frequently used inappropriately in systematic reviews and meta-analyses as an instrument to assess the methodological quality of observational studies.

Cardiovascular safety of non-steroidal anti-inflammatory drugs: network meta-analysis

Objective To analyse the available evidence on cardiovascular safety of non-steroidal anti-inflammatory drugs. Design Network meta-analysis. Data sources Bibliographic databases, conference proceedings, study registers, the Food and Drug Administration website, reference lists of relevant articles, and reports citing relevant articles through the Science Citation Index (last update July 2009). Manufacturers of celecoxib and lumiracoxib provided additional data. Study selection All large scale randomised controlled trials comparing any non-steroidal anti-inflammatory drug with other non-steroidal anti-inflammatory drugs or placebo. Two investigators independently assessed eligibility. Data extraction The primary outcome was myocardial infarction. Secondary outcomes included stroke, death from cardiovascular disease, and death from any cause. Two investigators independently extracted data. Data synthesis 31 trials in 116 429 patients with more than 115 000 patient years of follow-up were included. Patients were allocated to naproxen, ibuprofen, diclofenac, celecoxib, etoricoxib, rofecoxib, lumiracoxib, or placebo. Compared with placebo, rofecoxib was associated with the highest risk of myocardial infarction (rate ratio 2.12, 95% credibility interval 1.26 to 3.56), followed by lumiracoxib (2.00, 0.71 to 6.21). Ibuprofen was associated with the highest risk of stroke (3.36, 1.00 to 11.6), followed by diclofenac (2.86, 1.09 to 8.36). Etoricoxib (4.07, 1.23 to 15.7) and diclofenac (3.98, 1.48 to 12.7) were associated with the highest risk of cardiovascular death. Conclusions Although uncertainty remains, little evidence exists to suggest that any of the investigated drugs are safe in cardiovascular terms. Naproxen seemed least harmful. Cardiovascular risk needs to be taken into account when prescribing any non-steroidal anti-inflammatory drug.

Defining new criteria for selection of cell-based intestinal models using publicly available databases

The criteria for choosing relevant cell lines among a vast panel of available intestinal-derived lines exhibiting a wide range of functional properties are still ill-defined. The objective of this study was, therefore, to establish objective criteria for choosing relevant cell lines to assess their appropriateness as tumor models as well as for drug absorption studies.

Can level of education, accreditation and use of databases in cardiac rehabilitation be improved? Results from the European Cardiac Rehabilitation Inventory Survey

Professional skills, education and accreditation, along with clinical outcome assessment, are considered important factors to achieve comprehensive delivery and quality of cardiac rehabilitation (CR). This study assessed professional educational programmes, accreditation and use of databases in CR across the European countries.

Bioinformatics tools and databases for the study of human growth hormone

Advances in novel molecular biological diagnostic methods are changing the way of diagnosis and study of metabolic disorders like growth hormone deficiency. Faster sequencing and genotyping methods require strong bioinformatics tools to make sense of the vast amount of data generated by modern laboratories. Advances in genome sequencing and computational power to analyze the whole genome sequences will guide the diagnostics of future. In this chapter, an overview of some basic bioinformatics resources that are needed to study metabolic disorders are reviewed and some examples of bioinformatics analysis of human growth hormone gene, protein and structure are provided.

Screening for Chlamydia trachomatis: a systematic review of the economic evaluations and modelling

OBJECTIVE: To review systematically and critically, evidence used to derive estimates of costs and cost effectiveness of chlamydia screening. METHODS: Systematic review. A search of 11 electronic bibliographic databases from the earliest date available to August 2004 using keywords including chlamydia, pelvic inflammatory disease, economic evaluation, and cost. We included studies of chlamydia screening in males and/or females over 14 years, including studies of diagnostic tests, contact tracing, and treatment as part of a screening programme. Outcomes included cases of chlamydia identified and major outcomes averted. We assessed methodological quality and the modelling approach used. RESULTS: Of 713 identified papers we included 57 formal economic evaluations and two cost studies. Most studies found chlamydia screening to be cost effective, partner notification to be an effective adjunct, and testing with nucleic acid amplification tests, and treatment with azithromycin to be cost effective. Methodological problems limited the validity of these findings: most studies used static models that are inappropriate for infectious diseases; restricted outcomes were used as a basis for policy recommendations; and high estimates of the probability of chlamydia associated complications might have overestimated cost effectiveness. Two high quality dynamic modelling studies found opportunistic screening to be cost effective but poor reporting or uncertainty about complication rates make interpretation difficult. CONCLUSION: The inappropriate use of static models to study interventions to prevent a communicable disease means that uncertainty remains about whether chlamydia screening programmes are cost effective or not. The results of this review can be used by health service managers in the allocation of resources, and health economists and other researchers who are considering further research in this area.

Placebo-controlled trials of Chinese herbal medicine and conventional medicine - comparative study

BACKGROUND: Chinese herbal medicine (CHM) is increasingly used in the West, but the evidence on its effectiveness is a matter of debate. We compared the characteristics, study quality and results of clinical trials of CHM and conventional medicine. METHODS: Comparative study of placebo-controlled trials of CHM and conventional medicine. Eleven bibliographic databases and searches by hand of 48 Chinese-language journals. Conventional medicine trials matched for condition and type of outcome were randomly selected from the Cochrane Controlled Trials Register (issue 1, 2003). Trials described as double-blind, with adequate generation of allocation sequence and adequate concealment of allocation, were assumed to be of high quality. Data were analysed using funnel plots and multivariable meta-regression models. RESULTS: 136 CHM trials (119 published in Chinese, 17 published in English) and 136 matched conventional medicine trials (125 published in English) were analysed. The quality of Chinese-language CHM trials tended to be lower than that of English-language CHM trials and conventional medicine trials. Three (2%) CHM trials and 10 (7%) conventional medicine trials were of high quality. In all groups, smaller trials showed more beneficial treatment effects than larger trials. CHM trials published in Chinese showed considerably larger effects than CHM trials published in English (adjusted ratio of ORs 0.29, 95% confidence intervals 0.17-0.52). CONCLUSIONS: Biases are present both in placebo-controlled trials of CHM and conventional medicine, but may be most pronounced in CHM trials published in Chinese-language journals. Only few CHM trials of adequate methodology exist and the effectiveness of CHM therefore remains poorly documented.

Antiretroviral therapy for prevention of HIV transmission in HIV-discordant couples

BACKGROUND Antiretroviral drugs have been shown to reduce risk of mother-to-child transmission of human immunodeficiency virus (HIV) and are also widely used for post-exposure prophylaxis for parenteral and sexual exposures. Sexual transmission may be lower in couples in which one partner is infected with HIV and the other is not and the infected partner is on antiretroviral therapy (ART). OBJECTIVES To determine if ART use in an HIV-infected member of an HIV-discordant couple is associated with lower risk of HIV transmission to the uninfected partner compared to untreated discordant couples. SEARCH METHODS We used standard Cochrane methods to search electronic databases and conference proceedings with relevant search terms without limits to language. SELECTION CRITERIA Randomised controlled trials (RCT), cohort studies and case-control studies of HIV-discordant couples in which the HIV-infected member of the couple was being treated or not treated with ART DATA COLLECTION AND ANALYSIS: Abstracts of all trials identified by electronic or bibliographic scanning were examined independently by two authors. We initially identified 3,833 references and examined 87 in detail for study eligibility. Data were abstracted independently using a standardised abstraction form. MAIN RESULTS One RCT and nine observational studies were included in the review. These ten studies identified 2,112 episodes of HIV transmission, 1,016 among treated couples and 1,096 among untreated couples. The rate ratio for the single randomised controlled trial was 0.04 [95% CI 0.00, 0.27]. All index partners in this study had CD4 cell counts at baseline of 350-550 cells/µL. Similarly, the summary rate ratio for the nine observational studies was 0.58 [95% CI 0.35, 0.96], with substantial heterogeneity (I(2)=64%). After excluding two studies with inadequate person-time data, we estimated a summary rate ratio of 0.36 [95% CI 0.17, 0.75] with substantial heterogeneity (I(2)=62%). We also performed subgroup analyses among the observational studies to see if the effect of ART on prevention of HIV differed by the index partner's CD4 cell count. Among couples in which the infected partner had ≥350 CD4 cells/µL, we estimated a rate ratio of 0.12 [95% CI 0.01, 1.99]. In this subgroup, there were 247 transmissions in untreated couples and 30 in treated couples. AUTHORS' CONCLUSIONS ART is a potent intervention for prevention of HIV in discordant couples in which the index partner has ≤550 CD4 cells/µL. A recent multicentre RCT confirms the suspected benefit seen in earlier observational studies and reported in more recent ones. Questions remain about durability of protection, the balance of benefits and adverse events associated with earlier therapy, long-term adherence and transmission of ART-resistant strains to partners. Resource limitations and implementation challenges must also be addressed.Counselling, support, and follow up, as well as mutual disclosure, may have a role in supporting adherence, so programmes should be designed with these components. In addition to ART provision, the operational aspects of delivering such programmes must be considered.

A survey of paediatric HIV programmatic and clinical management practices in Asia and sub-Saharan Africa--the International epidemiologic Databases to Evaluate AIDS (IeDEA)

INTRODUCTION There are limited data on paediatric HIV care and treatment programmes in low-resource settings. METHODS A standardized survey was completed by International epidemiologic Databases to Evaluate AIDS paediatric cohort sites in the regions of Asia-Pacific (AP), Central Africa (CA), East Africa (EA), Southern Africa (SA) and West Africa (WA) to understand operational resource availability and paediatric management practices. Data were collected through January 2010 using a secure, web-based software program (REDCap). RESULTS A total of 64,552 children were under care at 63 clinics (AP, N=10; CA, N=4; EA, N=29; SA, N=10; WA, N=10). Most were in urban settings (N=41, 65%) and received funding from governments (N=51, 81%), PEPFAR (N=34, 54%), and/or the Global Fund (N=15, 24%). The majority were combined adult-paediatric clinics (N=36, 57%). Prevention of mother-to-child transmission was integrated at 35 (56%) sites; 89% (N=56) had access to DNA PCR for infant diagnosis. African (N=40/53) but not Asian sites recommended exclusive breastfeeding up until 4-6 months. Regular laboratory monitoring included CD4 (N=60, 95%), and viral load (N=24, 38%). Although 42 (67%) sites had the ability to conduct acid-fast bacilli (AFB) smears, 23 (37%) sites could conduct AFB cultures and 18 (29%) sites could conduct tuberculosis drug susceptibility testing. Loss to follow-up was defined as >3 months of lost contact for 25 (40%) sites, >6 months for 27 sites (43%) and >12 months for 6 sites (10%). Telephone calls (N=52, 83%) and outreach worker home visits to trace children lost to follow-up (N=45, 71%) were common. CONCLUSIONS In general, there was a high level of patient and laboratory monitoring within this multiregional paediatric cohort consortium that will facilitate detailed observational research studies. Practices will continue to be monitored as the WHO/UNAIDS Treatment 2.0 framework is implemented.