Measuring the promise of open data: Development of the Impact Monitoring Framework

It is a challenge to measure the impact of releasing data to the public since the effects may not be directly linked to particular open data activities or substantial impact may only occur several years after publishing the data. This paper proposes a framework to assess the impact of releasing open data by applying the Social Return on Investment (SROI) approach. SROI was developed for organizations intended to generate social and environmental benefits thus fitting the purpose of most open data initiatives. We link the four steps of SROI (input, output, outcome, impact) with the 14 high-value data categories of the G8 Open Data Charter to create a matrix of open data examples, activities, and impacts in each of the data categories. This Impact Monitoring Framework helps data providers to navigate the impact space of open data laying out the conceptual basis for further research.

Does published orthodontic research account for clustering effects during statistical data analysis?

In orthodontics, multiple site observations within patients or multiple observations collected at consecutive time points are often encountered. Clustered designs require larger sample sizes compared to individual randomized trials and special statistical analyses that account for the fact that observations within clusters are correlated. It is the purpose of this study to assess to what degree clustering effects are considered during design and data analysis in the three major orthodontic journals. The contents of the most recent 24 issues of the American Journal of Orthodontics and Dentofacial Orthopedics (AJODO), Angle Orthodontist (AO), and European Journal of Orthodontics (EJO) from December 2010 backwards were hand searched. Articles with clustering effects and whether the authors accounted for clustering effects were identified. Additionally, information was collected on: involvement of a statistician, single or multicenter study, number of authors in the publication, geographical area, and statistical significance. From the 1584 articles, after exclusions, 1062 were assessed for clustering effects from which 250 (23.5 per cent) were considered to have clustering effects in the design (kappa = 0.92, 95 per cent CI: 0.67-0.99 for inter rater agreement). From the studies with clustering effects only, 63 (25.20 per cent) had indicated accounting for clustering effects. There was evidence that the studies published in the AO have higher odds of accounting for clustering effects [AO versus AJODO: odds ratio (OR) = 2.17, 95 per cent confidence interval (CI): 1.06-4.43, P = 0.03; EJO versus AJODO: OR = 1.90, 95 per cent CI: 0.84-4.24, non-significant; and EJO versus AO: OR = 1.15, 95 per cent CI: 0.57-2.33, non-significant). The results of this study indicate that only about a quarter of the studies with clustering effects account for this in statistical data analysis.

Investigation of a unique short open reading frame within the 3' untranslated region of the canine distemper virus matrix messenger RNA

Increasing evidence suggest that the long "untranslated" region (UTR) between the matrix (M) and the fusion (F) proteins of morbilliviruses has a functional role. In canine distemper virus (CDV), the F 5' UTR was recently shown to code for a long F signal peptide (Fsp). Subsequently, it was reported that the M/F UTRs combined with the long Fsp were synergistically regulating the F mRNA and protein expression, thereby modulating virulence. Unique to CDV, a short putative open reading frame (ORF) has been identified within the wild-type CDV-M 3' UTR (termed M2). Here, we investigated whether M2 was expressed from the genome of the virulent and demyelinating A75/17-CDV strain. An expression plasmid encoding the M2 ORF tagged both at its N-terminal (HA) and C-terminal domains (RFP), was first constructed. Then, a recombinant virus with its putative M2 ORF replaced by HA-M2-RFP was successfully recovered from cDNA (termed recA75/17(green)-HA-M2-RFP). M2 expression in cells transfected or infected with these mutants was studied by immunoprecipitation, immunofluorescence, immunoblot and flow cytometry analyses. Although fluorescence was readily detected in HA-M2-RFP-transfected cells, absence of red fluorescence emission in several recA75/17(green)-HA-M2-RFP-infected cell types suggested lack of M2 biosynthesis, which was confirmed by the other techniques. Consistent with these data, no functional role of the short polypeptide was revealed by infecting various cell types with HA-M2-RFP over-expressing or M2-knockout recombinant viruses. Thus, in sharp contrast to the CDV-F 5' UTR reported to translate a long Fsp, our data provided evidence that the CDV-M 3' UTR does not express any polypeptides.

Selecting control genes for RT-QPCR using public microarray data

BACKGROUND: Gene expression analysis has emerged as a major biological research area, with real-time quantitative reverse transcription PCR (RT-QPCR) being one of the most accurate and widely used techniques for expression profiling of selected genes. In order to obtain results that are comparable across assays, a stable normalization strategy is required. In general, the normalization of PCR measurements between different samples uses one to several control genes (e.g. housekeeping genes), from which a baseline reference level is constructed. Thus, the choice of the control genes is of utmost importance, yet there is not a generally accepted standard technique for screening a large number of candidates and identifying the best ones. RESULTS: We propose a novel approach for scoring and ranking candidate genes for their suitability as control genes. Our approach relies on publicly available microarray data and allows the combination of multiple data sets originating from different platforms and/or representing different pathologies. The use of microarray data allows the screening of tens of thousands of genes, producing very comprehensive lists of candidates. We also provide two lists of candidate control genes: one which is breast cancer-specific and one with more general applicability. Two genes from the breast cancer list which had not been previously used as control genes are identified and validated by RT-QPCR. Open source R functions are available at http://www.isrec.isb-sib.ch/~vpopovic/research/ CONCLUSION: We proposed a new method for identifying candidate control genes for RT-QPCR which was able to rank thousands of genes according to some predefined suitability criteria and we applied it to the case of breast cancer. We also empirically showed that translating the results from microarray to PCR platform was achievable.

Proposal for an International Molybdenum Isotope Measurement Standard and Data Representation

Molybdenum isotopes are increasingly widely applied in Earth Sciences. They are primarily used to investigate the oxygenation of Earth's ocean and atmosphere. However, more and more fields of application are being developed, such as magmatic and hydrothermal processes, planetary sciences or the tracking of environmental pollution. Here, we present a proposal for a unifying presentation of Mo isotope ratios in the studies of mass-dependent isotope fractionation. We suggest that the δ98/95Mo of the NIST SRM 3134 be defined as +0.25‰. The rationale is that the vast majority of published data are presented relative to reference materials that are similar, but not identical, and that are all slightly lighter than NIST SRM 3134. Our proposed data presentation allows a direct first-order comparison of almost all old data with future work while referring to an international measurement standard. In particular, canonical δ98/95Mo values such as +2.3‰ for seawater and −0.7‰ for marine Fe–Mn precipitates can be kept for discussion. As recent publications show that the ocean molybdenum isotope signature is homogeneous, the IAPSO ocean water standard or any other open ocean water sample is suggested as a secondary measurement standard, with a defined δ98/95Mo value of +2.34 ± 0.10‰ (2s). Les isotopes du molybdène (Mo) sont de plus en plus largement utilisés dans les sciences de la Terre. Ils sont principalement utilisés pour étudier l'oxygénation de l'océan et de l'atmosphère de la Terre. Cependant, de plus en plus de domaines d'application sont en cours de développement, tels que ceux concernant les processus magmatiques et hydrothermaux, les sciences planétaires ou encore le suivi de la pollution environnementale. Ici, nous présentons une proposition de présentation unifiée des rapports isotopiques du Mo dans les études du fractionnement isotopique dépendant de la masse. Nous suggérons que le δ98/95Mo du NIST SRM 3134 soit définit comme étant égal à +0.25 ‰. La raison est que la grande majorité des données publiées sont présentés par rapport à des matériaux de référence qui sont similaires, mais pas identiques, et qui sont tous légèrement plus léger que le NIST SRM 3134. Notre proposition de présentation des données permet une comparaison directe au premier ordre de presque toutes les anciennes données avec les travaux futurs en se référant à un standard international. En particulier, les valeurs canoniques du δ98/95Mo comme celle de +2,3 ‰ pour l'eau de mer et de -0,7 ‰ pour les précipités de Fe-Mn marins peuvent être conservés pour la discussion. Comme les publications récentes montrent que la signature isotopique moyenne du molybdène de l'océan est homogène, le standard de l'eau océanique IAPSO ou tout autre échantillon d'eau provenant de l'océan ouvert sont proposé comme standards secondaires, avec une valeur définie du δ98/95 Mo de 2.34 ± 0.10 ‰ (2s).

Upper ocean vertical supply: A neglected primary factor controlling the distribution of neodymium concentrations of open ocean surface waters?

Neodymium (Nd) isotopes are an important geochemical tool to trace the present and past water mass mixing as well as continental inputs. The distribution of Nd concentrations in open ocean surface waters (0�100 m) is generally assumed to be controlled by lateral mixing of Nd from coastal surface currents and by removal through reversible particle scavenging. However, using 228Ra activity as an indicator of coastal water mass influence, surface water Nd concentration data available on key oceanic transects as a whole do not support the above scenario. From a global compilation of available data, we find that more stratified regions are generally associated with low surface Nd concentrations. This implies that upper ocean vertical supply may be an as yet neglected primary factor in determining the basin-scale variations of surface water Nd concentrations. Similar to the mechanism of nutrients supply, it is likely that stratification inhibits vertical supply of Nd from the subsurface thermocline waters and thus the magnitude of Nd flux to the surface layer. Consistently, the estimated required input flux of Nd to the surface layer to maintain the observed concentrations could be nearly two orders of magnitudes larger than riverine/dust flux, and also larger than the model-based estimation on shelf-derived coastal flux. In addition, preliminary results from modeling experiments reveal that the input from shallow boundary sources, riverine input, and release from dust are actually not the primary factors controlling Nd concentrations most notably in the Pacific and Southern Ocean surface waters.

Validation and reclassification of MGAP and GAP in hospital settings using data from the Trauma Audit and Research Network.

BACKGROUND Recently, two simple clinical scores were published to predict survival in trauma patients. Both scores may successfully guide major trauma triage, but neither has been independently validated in a hospital setting. METHODS This is a cohort study with 30-day mortality as the primary outcome to validate two new trauma scores-Mechanism, Glasgow Coma Scale (GCS), Age, and Pressure (MGAP) score and GCS, Age and Pressure (GAP) score-using data from the UK Trauma Audit and Research Network. First, an assessment of discrimination, using the area under the receiver operating characteristic (ROC) curve, and calibration, comparing mortality rates with those originally published, were performed. Second, we calculated sensitivity, specificity, predictive values, and likelihood ratios for prognostic score performance. Third, we propose new cutoffs for the risk categories. RESULTS A total of 79,807 adult (≥16 years) major trauma patients (2000-2010) were included; 5,474 (6.9%) died. Mean (SD) age was 51.5 (22.4) years, median GCS score was 15 (interquartile range, 15-15), and median Injury Severity Score (ISS) was 9 (interquartile range, 9-16). More than 50% of the patients had a low-risk GAP or MGAP score (1% mortality). With regard to discrimination, areas under the ROC curve were 87.2% for GAP score (95% confidence interval, 86.7-87.7) and 86.8% for MGAP score (95% confidence interval, 86.2-87.3). With regard to calibration, 2,390 (3.3%), 1,900 (28.5%), and 1,184 (72.2%) patients died in the low, medium, and high GAP risk categories, respectively. In the low- and medium-risk groups, these were almost double the previously published rates. For MGAP, 1,861 (2.8%), 1,455 (15.2%), and 2,158 (58.6%) patients died in the low-, medium-, and high-risk categories, consonant with results originally published. Reclassifying score point cutoffs improved likelihood ratios, sensitivity and specificity, as well as areas under the ROC curve. CONCLUSION We found both scores to be valid triage tools to stratify emergency department patients, according to their risk of death. MGAP calibrated better, but GAP slightly improved discrimination. The newly proposed cutoffs better differentiate risk classification and may therefore facilitate hospital resource allocation. LEVEL OF EVIDENCE Prognostic study, level II.

Outcomes after endovascular or open repair for degenerative descending thoracic aortic aneurysm using linked hospital data.

BACKGROUND The population-based effectiveness of thoracic endovascular aortic repair (TEVAR) versus open surgery for descending thoracic aortic aneurysm remains in doubt. METHODS Patients aged over 50 years, without a history of aortic dissection, undergoing repair of a thoracic aortic aneurysm between 2006 and 2011 were assessed using mortality-linked individual patient data from Hospital Episode Statistics (England). The principal outcomes were 30-day operative mortality, long-term survival (5 years) and aortic-related reinterventions. TEVAR and open repair were compared using crude and multivariable models that adjusted for age and sex. RESULTS Overall, 759 patients underwent thoracic aortic aneurysm repair, mainly for intact aneurysms (618, 81·4 per cent). Median ages of TEVAR and open cohorts were 73 and 71 years respectively (P < 0·001), with more men undergoing TEVAR (P = 0·004). For intact aneurysms, the operative mortality rate was similar for TEVAR and open repair (6·5 versus 7·6 per cent; odds ratio 0·79, 95 per cent confidence interval (c.i.) 0·41 to 1·49), but the 5-year survival rate was significantly worse after TEVAR (54·2 versus 65·6 per cent; adjusted hazard ratio 1·45, 95 per cent c.i. 1·08 to 1·94). After 5 years, aortic-related mortality was similar in the two groups, but cardiopulmonary mortality was higher after TEVAR. TEVAR was associated with more aortic-related reinterventions (23·1 versus 14·3 per cent; adjusted HR 1·70, 95 per cent c.i. 1·11 to 2·60). There were 141 procedures for ruptured thoracic aneurysm (97 TEVAR, 44 open), with TEVAR showing no significant advantage in terms of operative mortality. CONCLUSION In England, operative mortality for degenerative descending thoracic aneurysm was similar after either TEVAR or open repair. Patients who had TEVAR appeared to have a higher reintervention rate and worse long-term survival, possibly owing to cardiopulmonary morbidity and other selection bias.

Immediate versus deferred chemotherapy after radical cystectomy in patients with pT3-pT4 or N+ M0 urothelial carcinoma of the bladder (EORTC 30994): an intergroup, open-label, randomised phase 3 trial

BACKGROUND Patients with muscle-invasive urothelial carcinoma of the bladder have poor survival after cystectomy. The EORTC 30994 trial aimed to compare immediate versus deferred cisplatin-based combination chemotherapy after radical cystectomy in patients with pT3-pT4 or N+ M0 urothelial carcinoma of the bladder. METHODS This intergroup, open-label, randomised, phase 3 trial recruited patients from hospitals across Europe and Canada. Eligible patients had histologically proven urothelial carcinoma of the bladder, pT3-pT4 disease or node positive (pN1-3) M0 disease after radical cystectomy and bilateral lymphadenectomy, with no evidence of any microscopic residual disease. Within 90 days of cystectomy, patients were centrally randomly assigned (1:1) by minimisation to either immediate adjuvant chemotherapy (four cycles of gemcitabine plus cisplatin, high-dose methotrexate, vinblastine, doxorubicin, and cisplatin [high-dose MVAC], or MVAC) or six cycles of deferred chemotherapy at relapse, with stratification for institution, pT category, and lymph node status according to the number of nodes dissected. Neither patients nor investigators were masked. Overall survival was the primary endpoint; all analyses were by intention to treat. The trial was closed after recruitment of 284 of the planned 660 patients. This trial is registered with ClinicalTrials.gov, number NCT00028756. FINDINGS From April 29, 2002, to Aug 14, 2008, 284 patients were randomly assigned (141 to immediate treatment and 143 to deferred treatment), and followed up until the data cutoff of Aug 21, 2013. After a median follow-up of 7·0 years (IQR 5·2-8·7), 66 (47%) of 141 patients in the immediate treatment group had died compared with 82 (57%) of 143 in the deferred treatment group. No significant improvement in overall survival was noted with immediate treatment when compared with deferred treatment (adjusted HR 0·78, 95% CI 0·56-1·08; p=0·13). Immediate treatment significantly prolonged progression-free survival compared with deferred treatment (HR 0·54, 95% CI 0·4-0·73, p<0·0001), with 5-year progression-free survival of 47·6% (95% CI 38·8-55·9) in the immediate treatment group and 31·8% (24·2-39·6) in the deferred treatment group. Grade 3-4 myelosuppression was reported in 33 (26%) of 128 patients who received treatment in the immediate chemotherapy group versus 24 (35%) of 68 patients who received treatment in the deferred chemotherapy group, neutropenia occurred in 49 (38%) versus 36 (53%) patients, respectively, and thrombocytopenia in 36 (28%) versus 26 (38%). Two patients died due to toxicity, one in each group. INTERPRETATION Our data did not show a significant improvement in overall survival with immediate versus deferred chemotherapy after radical cystectomy and bilateral lymphadenectomy for patients with muscle-invasive urothelial carcinoma. However, the trial is limited in power, and it is possible that some subgroups of patients might still benefit from immediate chemotherapy. An updated individual patient data meta-analysis and biomarker research are needed to further elucidate the potential for survival benefit in subgroups of patients. FUNDING Lilly, Canadian Cancer Society Research.