Experimental design for acquiring relevant data to address the issue of comparing consecutively manufactured tools and firearms

The comparison of consecutively manufactured tools and firearms has provided much, but not all, of the basis for the profession of firearm and toolmark examination. The authors accept the fundamental soundness of this approach but appeal to the experimental community to close two minor gaps in the experimental procedure. We suggest that "blinding" and attention to appropriateness of other experimental conditions that would consolidate the foundations of our profession. We do not suggest that previous work is unsound.

Cost-effective experimental design to support modeling of concentration-response functions

Modeling concentration-response function became extremely popular in ecotoxicology during the last decade. Indeed, modeling allows determining the total response pattern of a given substance. However, reliable modeling is consuming in term of data, which is in contradiction with the current trend in ecotoxicology, which aims to reduce, for cost and ethical reasons, the number of data produced during an experiment. It is therefore crucial to determine experimental design in a cost-effective manner. In this paper, we propose to use the theory of locally D-optimal designs to determine the set of concentrations to be tested so that the parameters of the concentration-response function can be estimated with high precision. We illustrated this approach by determining the locally D-optimal designs to estimate the toxicity of the herbicide dinoseb on daphnids and algae. The results show that the number of concentrations to be tested is often equal to the number of parameters and often related to the their meaning, i.e. they are located close to the parameters. Furthermore, the results show that the locally D-optimal design often has the minimal number of support points and is not much sensitive to small changes in nominal values of the parameters. In order to reduce the experimental cost and the use of test organisms, especially in case of long-term studies, reliable nominal values may therefore be fixed based on prior knowledge and literature research instead of on preliminary experiments

The mzTab Data Exchange Format: Communicating Mass-spectrometry-based Proteomics and Metabolomics Experimental Results to a Wider Audience.

The HUPO Proteomics Standards Initiative has developed several standardized data formats to facilitate data sharing in mass spectrometry (MS)-based proteomics. These allow researchers to report their complete results in a unified way. However, at present, there is no format to describe the final qualitative and quantitative results for proteomics and metabolomics experiments in a simple tabular format. Many downstream analysis use cases are only concerned with the final results of an experiment and require an easily accessible format, compatible with tools such as Microsoft Excel or R. We developed the mzTab file format for MS-based proteomics and metabolomics results to meet this need. mzTab is intended as a lightweight supplement to the existing standard XML-based file formats (mzML, mzIdentML, mzQuantML), providing a comprehensive summary, similar in concept to the supplemental material of a scientific publication. mzTab files can contain protein, peptide, and small molecule identifications together with experimental metadata and basic quantitative information. The format is not intended to store the complete experimental evidence but provides mechanisms to report results at different levels of detail. These range from a simple summary of the final results to a representation of the results including the experimental design. This format is ideally suited to make MS-based proteomics and metabolomics results available to a wider biological community outside the field of MS. Several software tools for proteomics and metabolomics have already adapted the format as an output format. The comprehensive mzTab specification document and extensive additional documentation can be found online.

Is accountability a double-edged sword? Experimental evidence on the effectiveness of internal controls to prevent fraud

Recent legislations oblige organizations to monitor the effectiveness of internal control mechanisms that are necessary to prevent fraud. However, little is known about the effectiveness of different internal controls. We investigate whether the duty to sign work results-one of the most prominent internal control mechanisms-is effective to prevent fraud under different superior instructions. We use a 2×2 between-subjects experimental design with accountability (duty to sign work results vs. no duty to sign) and superior instructions (with vs. without profit maximization cue) as independent variables. Both manipulations of superior instructions reminded people to respect accounting standards and principles but in one condition, an instruction to increase revenues was integrated as profit maximization cue. We expected this cue to trigger a profit maximization decision frame that increases the likelihood for fraudulent revenue recording. 58 managers from an executive MBA class participated in the experiment. We find that superior instructions interact with accountability. Fraudulent revenue recording was particularly observed when people received instructions to increase revenues and had to sign their work results. Consequently, fraudulent behavior can occur without pressure to commit fraud due to profit maximization cues that are communicated by a superior and despite implemented internal control mechanisms. We discuss possible implications of our results for the prevention of fraudulent behavior.

Harmonization guidelines for HLA-peptide multimer assays derived from results of a large scale international proficiency panel of the Cancer Vaccine Consortium.

PURPOSE: The Cancer Vaccine Consortium of the Cancer Research Institute (CVC-CRI) conducted a multicenter HLA-peptide multimer proficiency panel (MPP) with a group of 27 laboratories to assess the performance of the assay. EXPERIMENTAL DESIGN: Participants used commercially available HLA-peptide multimers and a well characterized common source of peripheral blood mononuclear cells (PBMC). The frequency of CD8+ T cells specific for two HLA-A2-restricted model antigens was measured by flow cytometry. The panel design allowed for participants to use their preferred staining reagents and locally established protocols for both cell labeling, data acquisition and analysis. RESULTS: We observed significant differences in both the performance characteristics of the assay and the reported frequencies of specific T cells across laboratories. These results emphasize the need to identify the critical variables important for the observed variability to allow for harmonization of the technique across institutions. CONCLUSIONS: Three key recommendations emerged that would likely reduce assay variability and thus move toward harmonizing of this assay. (1) Use of more than two colors for the staining (2) collect at least 100,000 CD8 T cells, and (3) use of a background control sample to appropriately set the analytical gates. We also provide more insight into the limitations of the assay and identified additional protocol steps that potentially impact the quality of data generated and therefore should serve as primary targets for systematic analysis in future panels. Finally, we propose initial guidelines for harmonizing assay performance which include the introduction of standard operating protocols to allow for adequate training of technical staff and auditing of test analysis procedures.

Influence of local environmental olfactory cues on place learning in rats

The aim of the present study was to assess the influence of local environmental olfactory cues on place learning in rats. We developed a new experimental design allowing the comparison of the use of local olfactory and visual cues in spatial and discrimination learning. We compared the effect of both types of cues on the discrimination of a single food source in an open-field arena. The goal was either in a fixed or in a variable location, and could be indicated by local olfactory and/or visual cues. The local cues enhanced the discrimination of the goal dish, whether it was in a fixed or in a variable location. However, we did not observe any overshadowing of the spatial information by the local olfactory or visual cue. Rats relied primarily on distant visuospatial information to locate the goal, neglecting local information when it was in conflict with the spatial information.

Outcome of Patients with Platelet-Derived Growth Factor Receptor Alpha-Mutated Gastrointestinal Stromal Tumors in the Tyrosine Kinase Inhibitor Era.

PURPOSE: Platelet-derived growth factor receptor-alpha (PDGFRA) mutations are found in approximately 5% to 7% of advanced gastrointestinal stromal tumors (GIST). We sought to extensively assess the activity of imatinib in this subgroup. EXPERIMENTAL DESIGN: We conducted an international survey among GIST referral centers to collect clinical data on patients with advanced PDGFRA-mutant GISTs treated with imatinib for advanced disease. RESULTS: Fifty-eight patients were included, 34 were male (59%), and median age at treatment initiation was 61 (range, 19-83) years. The primary tumor was gastric in 40 cases (69%). Thirty-two patients (55%) had PDGFRA-D842V substitutions whereas 17 (29%) had mutations affecting other codons of exon 18, and nine patients (16%) had mutation in other exons. Fifty-seven patients were evaluable for response, two (4%) had a complete response, eight (14%) had a partial response, and 23 (40%) had stable disease. None of 31 evaluable patients with D842V substitution had a response, whereas 21 of 31 (68%) had progression as their best response. Median progression-free survival was 2.8 [95% confidence interval (CI), 2.6-3.2] months for patients with D842V substitution and 28.5 months (95% CI, 5.4-51.6) for patients with other PDGFRA mutations. With 46 months of follow-up, median overall survival was 14.7 months for patients with D842V substitutions and was not reached for patients with non-D842V mutations. CONCLUSIONS: This study is the largest reported to date on patients with advanced PDGFRA-mutant GISTs treated with imatinib. Our data confirm that imatinib has little efficacy in the subgroup of patients with D842V substitution in exon 18, whereas other mutations appear to be sensitive to imatinib. Clin Cancer Res; 18(16); 4458-64. ©2012 AACR.

TIE-2 and VEGFR Kinase Activities Drive Immunosuppressive Function of TIE-2-Expressing Monocytes in Human Breast Tumors.

PURPOSE: Tumor-associated TIE-2-expressing monocytes (TEM) are highly proangiogenic cells critical for tumor vascularization. We previously showed that, in human breast cancer, TIE-2 and VEGFR pathways control proangiogenic activity of TEMs. Here, we examine the contribution of these pathways to immunosuppressive activity of TEMs. EXPERIMENTAL DESIGN: We investigated the changes in immunosuppressive activity of TEMs and gene expression in response to specific kinase inhibitors of TIE-2 and VEGFR. The ability of tumor TEMs to suppress tumor-specific T-cell response mediated by tumor dendritic cells (DC) was measured in vitro. Characterization of TEM and DC phenotype in addition to their interaction with T cells was done using confocal microscopic images analysis of breast carcinomas. RESULTS: TEMs from breast tumors are able to suppress tumor-specific immune responses. Importantly, proangiogenic and suppressive functions of TEMs are similarly driven by TIE-2 and VEGFR kinase activity. Furthermore, we show that tumor TEMs can function as antigen-presenting cells and elicit a weak proliferation of T cells. Blocking TIE-2 and VEGFR kinase activity induced TEMs to change their phenotype into cells with features of myeloid dendritic cells. We show that immunosuppressive activity of TEMs is associated with high CD86 surface expression and extensive engagement of T regulatory cells in breast tumors. TIE-2 and VEGFR kinase activity was also necessary to maintain high CD86 surface expression levels and to convert T cells into regulatory cells. CONCLUSIONS: These results suggest that TEMs are plastic cells that can be reverted from suppressive, proangiogenic cells into cells that are able to mediate an antitumoral immune response. Clin Cancer Res; 19(13); 3439-49. ©2013 AACR.

A dendritic cell vaccine pulsed with autologous hypochlorous Acid-oxidized ovarian cancer lysate primes effective broad antitumor immunity: from bench to bedside.

PURPOSE: Whole tumor lysates are promising antigen sources for dendritic cell (DC) therapy as they contain many relevant immunogenic epitopes to help prevent tumor escape. Two common methods of tumor lysate preparations are freeze-thaw processing and UVB irradiation to induce necrosis and apoptosis, respectively. Hypochlorous acid (HOCl) oxidation is a new method for inducing primary necrosis and enhancing the immunogenicity of tumor cells. EXPERIMENTAL DESIGN: We compared the ability of DCs to engulf three different tumor lysate preparations, produce T-helper 1 (TH1)-priming cytokines and chemokines, stimulate mixed leukocyte reactions (MLR), and finally elicit T-cell responses capable of controlling tumor growth in vivo. RESULTS: We showed that DCs engulfed HOCl-oxidized lysate most efficiently stimulated robust MLRs, and elicited strong tumor-specific IFN-γ secretions in autologous T cells. These DCs produced the highest levels of TH1-priming cytokines and chemokines, including interleukin (IL)-12. Mice vaccinated with HOCl-oxidized ID8-ova lysate-pulsed DCs developed T-cell responses that effectively controlled tumor growth. Safety, immunogenicity of autologous DCs pulsed with HOCl-oxidized autologous tumor lysate (OCDC vaccine), clinical efficacy, and progression-free survival (PFS) were evaluated in a pilot study of five subjects with recurrent ovarian cancer. OCDC vaccination produced few grade 1 toxicities and elicited potent T-cell responses against known ovarian tumor antigens. Circulating regulatory T cells and serum IL-10 were also reduced. Two subjects experienced durable PFS of 24 months or more after OCDC. CONCLUSIONS: This is the first study showing the potential efficacy of a DC vaccine pulsed with HOCl-oxidized tumor lysate, a novel approach in preparing DC vaccine that is potentially applicable to many cancers. Clin Cancer Res; 19(17); 4801-15. ©2013 AACR.

Multiple imputations applied to the DREAM3 phosphoproteomics challenge: a winning strategy.

DREAM is an initiative that allows researchers to assess how well their methods or approaches can describe and predict networks of interacting molecules [1]. Each year, recently acquired datasets are released to predictors ahead of publication. Researchers typically have about three months to predict the masked data or network of interactions, using any predictive method. Predictions are assessed prior to an annual conference where the best predictions are unveiled and discussed. Here we present the strategy we used to make a winning prediction for the DREAM3 phosphoproteomics challenge. We used Amelia II, a multiple imputation software method developed by Gary King, James Honaker and Matthew Blackwell[2] in the context of social sciences to predict the 476 out of 4624 measurements that had been masked for the challenge. To chose the best possible multiple imputation parameters to apply for the challenge, we evaluated how transforming the data and varying the imputation parameters affected the ability to predict additionally masked data. We discuss the accuracy of our findings and show that multiple imputations applied to this dataset is a powerful method to accurately estimate the missing data. We postulate that multiple imputations methods might become an integral part of experimental design as a mean to achieve cost savings in experimental design or to increase the quantity of samples that could be handled for a given cost.

Melan-A-specific cytotoxic T cells are associated with tumor regression and autoimmunity following treatment with anti-CTLA-4.

PURPOSE: Ipilimumab is a monoclonal antibody that blocks the immune-inhibitory interaction between CTL antigen 4 (CTLA-4) and its ligands on T cells. Clinical trials in cancer patients with ipilimumab have shown promising antitumor activity, particularly in patients with advanced melanoma. Often, tumor regressions in these patients are correlated with immune-related side effects such as dermatitis, enterocolitis, and hypophysitis. Although these reactions are believed to be immune-mediated, the antigenic targets for the cellular or humoral immune response are not known. EXPERIMENTAL DESIGN: We enrolled patients with advanced melanoma in a phase II study with ipilimumab. One of these patients experienced a complete remission of his tumor. The specificity and functional properties of CD8-positive T cells in his peripheral blood, in regressing tumor tissue, and at the site of an immune-mediated skin rash were investigated. RESULTS: Regressing tumor tissue was infiltrated with CD8-positive T cells, a high proportion of which were specific for Melan-A. The skin rash was similarly infiltrated with Melan-A-specific CD8-positive T cells, and a dramatic (>30-fold) increase in Melan-A-specific CD8-positive T cells was apparent in peripheral blood. These cells had an effector phenotype and lysed Melan-A-expressing tumor cells. CONCLUSIONS: Our results show that Melan-A may be a major target for both the autoimmune and antitumor reactions in patients treated with anti-CTLA-4, and describe for the first time the antigen specificity of CD8-positive T cells that mediate tumor rejection in a patient undergoing treatment with an anti-CTLA-4 antibody. These findings may allow a better integration of ipilimumab into other forms of immunotherapy.

Active antiviral T-lymphocyte response can be redirected against tumor cells by antitumor antibody x MHC/viral peptide conjugates.

PURPOSE: To redirect an ongoing antiviral T-cell response against tumor cells in vivo, we evaluated conjugates consisting of antitumor antibody fragments coupled to class I MHC molecules loaded with immunodominant viral peptides. EXPERIMENTAL DESIGN: First, lymphochoriomeningitis virus (LCMV)-infected C57BL/6 mice were s.c. grafted on the right flank with carcinoembryonic antigen (CEA)-transfected MC38 colon carcinoma cells precoated with anti-CEA x H-2D(b)/GP33 LCMV peptide conjugate and on the left flank with the same cells precoated with control anti-CEA F(ab')(2) fragments. Second, influenza virus-infected mice were injected i.v., to induce lung metastases, with HER2-transfected B16F10 cells, coated with either anti-HER2 x H-2D(b)/NP366 influenza peptide conjugates, or anti-HER2 F(ab')(2) fragments alone, or intact anti-HER2 monoclonal antibody. Third, systemic injections of anti-CEA x H-2D(b) conjugates with covalently cross-linked GP33 peptides were tested for the growth inhibition of MC38-CEA(+) cells, s.c. grafted in LCMV-infected mice. RESULTS: In the LCMV-infected mice, five of the six grafts with conjugate-precoated MC38-CEA(+) cells did not develop into tumors, whereas all grafts with F(ab')(2)-precoated MC38-CEA(+) cells did so (P = 0.0022). In influenza virus-infected mice, the group injected with cells precoated with specific conjugate had seven times less lung metastases than control groups (P = 0.0022 and P = 0.013). Most importantly, systemic injection in LCMV-infected mice of anti-CEA x H-2D(b)/cross-linked GP33 conjugates completely abolished tumor growth in four of five mice, whereas the same tumor grew in all five control mice (P = 0.016). CONCLUSION: The results show that a physiologic T-cell antiviral response in immunocompetent mice can be redirected against tumor cells by the use of antitumor antibody x MHC/viral peptide conjugates.

Efficacy of cetuximab in metastatic castration-resistant prostate cancer might depend on EGFR and PTEN expression: results from a phase II trial (SAKK 08/07).

PURPOSE: The EGF receptor (EGFR) is overexpressed in the majority of metastatic castration-resistant prostate cancers (mCRPC) and might represent a valid therapeutic target. The combination of docetaxel and cetuximab, the monoclonal antibody against EGFR, has not been tested in patients with prostate cancer. EXPERIMENTAL DESIGN: Patients with mCRPC progressing during or within 90 days after at least 12 weeks of docetaxel were included in this phase II trial. Treatment consisted of docetaxel (75 mg/m(2) every 3 weeks or 35 mg/m(2) on days 1, 8, 15 every 4 weeks) in combination with cetuximab (400 mg/m(2) on day 1 and then 250 mg/m(2) weekly). The primary endpoint was progression-free survival (PFS) at 12 weeks defined as the absence of prostate-specific antigen (PSA), radiographic, or clinical progression. Evaluation of known biomarkers of response and resistance to cetuximab (EGFR, PTEN, amphiregulin, epiregulin) was conducted. RESULTS: Thirty-eight patients were enrolled at 15 Swiss centers. Median age was 68 years and median PSA was 212 ng/mL. PFS at 12 weeks was 34% [95% confidence interval (CI), 19%-52%], PFS at 24 weeks was 20%, and median overall survival (OS) was 13.3 months (95% CI, 7.3-15.4). Seven patients (20%) had a confirmed ≥ 50% and 11 patients (31%) a confirmed ≥ 30% PSA decline. About 47% of enrolled patients experienced grade 3 and 8% grade 4 toxicities. A significantly improved PFS was found in patients with overexpression of EGFR and persistent activity of PTEN. CONCLUSIONS: EGFR inhibition with cetuximab might improve the outcome of patients with mCRPC. A potential correlation between EGFR overexpression, persistent expression of PTEN, and EGFR inhibition should be investigated further.

Characterization and clinical evaluation of CD10+ stroma cells in the breast cancer microenvironment.

PURPOSE: There is growing evidence that interaction between stromal and tumor cells is pivotal in breast cancer progression and response to therapy. Based on earlier research suggesting that during breast cancer progression, striking changes occur in CD10(+) stromal cells, we aimed to better characterize this cell population and its clinical relevance. EXPERIMENTAL DESIGN: We developed a CD10(+) stroma gene expression signature (using HG U133 Plus 2.0) on the basis of the comparison of CD10 cells isolated from tumoral (n = 28) and normal (n = 3) breast tissue. We further characterized the CD10(+) cells by coculture experiments of representative breast cancer cell lines with the different CD10(+) stromal cell types (fibroblasts, myoepithelial, and mesenchymal stem cells). We then evaluated its clinical relevance in terms of in situ to invasive progression, invasive breast cancer prognosis, and prediction of efficacy of chemotherapy using publicly available data sets. RESULTS: This 12-gene CD10(+) stroma signature includes, among others, genes involved in matrix remodeling (MMP11, MMP13, and COL10A1) and genes related to osteoblast differentiation (periostin). The coculture experiments showed that all 3 CD10(+) cell types contribute to the CD10(+) stroma signature, although mesenchymal stem cells have the highest CD10(+) stroma signature score. Of interest, this signature showed an important role in differentiating in situ from invasive breast cancer, in prognosis of the HER2(+) subpopulation of breast cancer only, and potentially in nonresponse to chemotherapy for those patients. CONCLUSIONS: Our results highlight the importance of CD10(+) cells in breast cancer prognosis and efficacy of chemotherapy, particularly within the HER2(+) breast cancer disease.

Complete longitudinal analyses of the randomized, placebo-controlled, phase III trial of sunitinib in patients with gastrointestinal stromal tumor following imatinib failure.

PURPOSE: To analyze final long-term survival and clinical outcomes from the randomized phase III study of sunitinib in gastrointestinal stromal tumor patients after imatinib failure; to assess correlative angiogenesis biomarkers with patient outcomes. EXPERIMENTAL DESIGN: Blinded sunitinib or placebo was given daily on a 4-week-on/2-week-off treatment schedule. Placebo-assigned patients could cross over to sunitinib at disease progression/study unblinding. Overall survival (OS) was analyzed using conventional statistical methods and the rank-preserving structural failure time (RPSFT) method to explore cross-over impact. Circulating levels of angiogenesis biomarkers were analyzed. RESULTS: In total, 243 patients were randomized to receive sunitinib and 118 to placebo, 103 of whom crossed over to open-label sunitinib. Conventional statistical analysis showed that OS converged in the sunitinib and placebo arms (median 72.7 vs. 64.9 weeks; HR, 0.876; P = 0.306) as expected, given the cross-over design. RPSFT analysis estimated median OS for placebo of 39.0 weeks (HR, 0.505, 95% CI, 0.262-1.134; P = 0.306). No new safety concerns emerged with extended sunitinib treatment. No consistent associations were found between the pharmacodynamics of angiogenesis-related plasma proteins during sunitinib treatment and clinical outcome. CONCLUSIONS: The cross-over design provided evidence of sunitinib clinical benefit based on prolonged time to tumor progression during the double-blind phase of this trial. As expected, following cross-over, there was no statistical difference in OS. RPSFT analysis modeled the absence of cross-over, estimating a substantial sunitinib OS benefit relative to placebo. Long-term sunitinib treatment was tolerated without new adverse events.