Bayesian generalized linear models for meta-analysis of diagnostic tests

With the recognition of the importance of evidence-based medicine, there is an emerging need for methods to systematically synthesize available data. Specifically, methods to provide accurate estimates of test characteristics for diagnostic tests are needed to help physicians make better clinical decisions. To provide more flexible approaches for meta-analysis of diagnostic tests, we developed three Bayesian generalized linear models. Two of these models, a bivariate normal and a binomial model, analyzed pairs of sensitivity and specificity values while incorporating the correlation between these two outcome variables. Noninformative independent uniform priors were used for the variance of sensitivity, specificity and correlation. We also applied an inverse Wishart prior to check the sensitivity of the results. The third model was a multinomial model where the test results were modeled as multinomial random variables. All three models can include specific imaging techniques as covariates in order to compare performance. Vague normal priors were assigned to the coefficients of the covariates. The computations were carried out using the 'Bayesian inference using Gibbs sampling' implementation of Markov chain Monte Carlo techniques. We investigated the properties of the three proposed models through extensive simulation studies. We also applied these models to a previously published meta-analysis dataset on cervical cancer as well as to an unpublished melanoma dataset. In general, our findings show that the point estimates of sensitivity and specificity were consistent among Bayesian and frequentist bivariate normal and binomial models. However, in the simulation studies, the estimates of the correlation coefficient from Bayesian bivariate models are not as good as those obtained from frequentist estimation regardless of which prior distribution was used for the covariance matrix. The Bayesian multinomial model consistently underestimated the sensitivity and specificity regardless of the sample size and correlation coefficient. In conclusion, the Bayesian bivariate binomial model provides the most flexible framework for future applications because of its following strengths: (1) it facilitates direct comparison between different tests; (2) it captures the variability in both sensitivity and specificity simultaneously as well as the intercorrelation between the two; and (3) it can be directly applied to sparse data without ad hoc correction. ^

Skeletal abnormalities in mice lacking extracellular matrix proteins, thrombospondin-1, thrombospondin-3, thrombospondin-5, and type IX collagen.

Thrombospondin-5 (TSP5) is a large extracellular matrix glycoprotein found in musculoskeletal tissues. TSP5 mutations cause two skeletal dysplasias, pseudoachondroplasia and multiple epiphyseal dysplasia; both show a characteristic growth plate phenotype with retention of TSP5, type IX collagen (Col9), and matrillin-3 in the rough endoplasmic reticulum. Whereas most studies focus on defining the disease process, few functional studies have been performed. TSP5 knockout mice have no obvious skeletal abnormalities, suggesting that TSP5 is not essential in the growth plate and/or that other TSPs may compensate. In contrast, Col9 knockout mice have diminished matrillin-3 levels in the extracellular matrix and early-onset osteoarthritis. To define the roles of TSP1, TSP3, TSP5, and Col9 in the growth plate, all knockout and combinatorial strains were analyzed using histomorphometric techniques. While significant alterations in growth plate organization were found in certain single knockout mouse strains, skeletal growth was only mildly disturbed. In contrast, dramatic changes in growth plate organization in TSP3/5/Col9 knockout mice resulted in a 20% reduction in limb length, corresponding to similar short stature in humans. These studies show that type IX collagen may regulate growth plate width; TSP3, TSP5, and Col9 appear to contribute to growth plate organization; and TSP1 may help define the timing of growth plate closure when other extracellular proteins are absent.

RNAi reduces expression and intracellular retention of mutant cartilage oligomeric matrix protein.

Mutations in cartilage oligomeric matrix protein (COMP), a large extracellular glycoprotein expressed in musculoskeletal tissues, cause two skeletal dysplasias, pseudoachondroplasia and multiple epiphyseal dysplasia. These mutations lead to massive intracellular retention of COMP, chondrocyte death and loss of growth plate chondrocytes that are necessary for linear growth. In contrast, COMP null mice have only minor growth plate abnormalities, normal growth and longevity. This suggests that reducing mutant and wild-type COMP expression in chondrocytes may prevent the toxic cellular phenotype causing the skeletal dysplasias. We tested this hypothesis using RNA interference to reduce steady state levels of COMP mRNA. A panel of shRNAs directed against COMP was tested. One shRNA (3B) reduced endogenous and recombinant COMP mRNA dramatically, regardless of expression levels. The activity of the shRNA against COMP mRNA was maintained for up to 10 weeks. We also demonstrate that this treatment reduced ER stress. Moreover, we show that reducing steady state levels of COMP mRNA alleviates intracellular retention of other extracellular matrix proteins associated with the pseudoachondroplasia cellular pathology. These findings are a proof of principle and the foundation for the development of a therapeutic intervention based on reduction of COMP expression.

Protein quaternary structure determination using matrix-assisted laser desorption/ionization time-of-flight mass spectrometry and chemical crosslinking

A means of analyzing protein quaternary structure using matrix-assisted laser desorption ionization time-of-flight mass spectrometry (MALDI MS) and chemical crosslinking was evaluated. Proteins of known oligomeric structure, as well as monomeric proteins, were analyzed to evaluate the method. The quaternary structure of proteins of unknown or uncertain structure was investigated using this technique. The stoichiometry of recombinant E. coli carbamoyl phosphate synthetase and recombinant human farnesyl protein transferase were determined to be heterodimers using glutaraldehyde crosslinking, agreeing with the stoichiometry found for the wild type proteins. The stoichiometry of the gamma subunit of E. coli DNA polymerase III holoenzyme was determined in solution without the presence of other subunits to be a homotetramer using glutaraldehyde crosslinking and MALDI MS analysis. Chi and psi subunits of E. coli DNA polymerase III subunits appeared to form a heterodimer when crosslinked with heterobifunctional photoreactive crosslinkers.^ Comparison of relative % peak areas obtained from MALDI MS analysis of crosslinked proteins and densitometric scanning of silver stained sodium dodecyl sulfate polyacrylamide gel electrophoresis (SDS-PAGE) gels showed excellent qualitative agreement for the two techniques, but the quantitative analyses differed, sometimes significantly. This difference in quantitation could be due to SDS-PAGE conditions (differential staining, loss of sample) or to MALDI MS conditions (differences in ionization and/or detection). Investigation of pre-purified crosslinked monomers and dimers recombined in a specific ratio revealed the presence of mass discrimination in the MALDI MS process. The calculation of mass discrimination for two different MALDI time-of-flight instruments showed the loss of a factor of approximately 2.6 in relative peak area as the m/z value doubles over the m/z range from 30,000 to 145,000 daltons.^ Indirect symmetry was determined for tetramers using glutaraldehyde crosslinking with MALDI MS analysis. Mathematical modelling and simple graphing allowed the determination of the symmetry for several tetramers known to possess isologous D2 symmetry. These methods also distinguished tetramers that did not fit D2 symmetry such as apo-avidin. The gamma tetramer of E. coli DNA polymerase III appears to have isologous D2 symmetry. ^

Assessment of cone beam computed tomography techniques for imaging lung damage in mice in vivo

Lung damage is a common side effect of chemotherapeutic drugs such as bleomycin. This study used a bleomycin mouse model which simulates the lung damage observed in humans. Noninvasive, in vivo cone-beam computed tomography (CBCT) was used to visualize and quantify fibrotic and inflammatory damage over the entire lung volume of mice. Bleomycin was used to induce pulmonary damage in vivo and the results from two CBCT systems, a micro-CT and flat panel CT (fpCT), were compared to histologic measurements, the standard method of murine lung damage quantification. Twenty C57BL/6 mice were given either 3 U/kg of bleomycin or saline intratracheally. The mice were scanned at baseline, before the administration of bleomycin, and then 10, 14, and 21 days afterward. At each time point, a subset of mice was sacrificed for histologic analysis. The resulting CT images were used to assess lung volume. Percent lung damage (PLD) was calculated for each mouse on both the fpCT (PLDfpcT) and the micro-CT (PLDμCT). Histologic PLD (PLDH) was calculated for each histologic section at each time point (day 10, n = 4; day 14, n = 4; day 21, n = 5; control group, n = 5). A linear regression was applied to the PLDfpCT vs. PLDH, PLDμCT vs. PLDH and PLDfpCT vs. PLDμCT distributions. This study did not demonstrate strong correlations between PLDCT and PLDH. The coefficient of determination, R, was 0.68 for PLDμCT vs. PLDH and 0.75 for the PLD fpCT vs. PLDH. The experimental issues identified from this study were: (1) inconsistent inflation of the lungs from scan to scan, (2) variable distribution of damage (one histologic section not representative of overall lung damage), (3) control mice not scanned with each group of bleomycin mice, (4) two CT systems caused long anesthesia time for the mice, and (5) respiratory gating did not hold the volume of lung constant throughout the scan. Addressing these issues might allow for further improvement of the correlation between PLDCT and PLDH. ^

Assessment of the effect on statistical power of regression model misspecification by using techniques of mathematical statistics and simulation study

Objectives. This paper seeks to assess the effect on statistical power of regression model misspecification in a variety of situations. ^ Methods and results. The effect of misspecification in regression can be approximated by evaluating the correlation between the correct specification and the misspecification of the outcome variable (Harris 2010).In this paper, three misspecified models (linear, categorical and fractional polynomial) were considered. In the first section, the mathematical method of calculating the correlation between correct and misspecified models with simple mathematical forms was derived and demonstrated. In the second section, data from the National Health and Nutrition Examination Survey (NHANES 2007-2008) were used to examine such correlations. Our study shows that comparing to linear or categorical models, the fractional polynomial models, with the higher correlations, provided a better approximation of the true relationship, which was illustrated by LOESS regression. In the third section, we present the results of simulation studies that demonstrate overall misspecification in regression can produce marked decreases in power with small sample sizes. However, the categorical model had greatest power, ranging from 0.877 to 0.936 depending on sample size and outcome variable used. The power of fractional polynomial model was close to that of linear model, which ranged from 0.69 to 0.83, and appeared to be affected by the increased degrees of freedom of this model.^ Conclusion. Correlations between alternative model specifications can be used to provide a good approximation of the effect on statistical power of misspecification when the sample size is large. When model specifications have known simple mathematical forms, such correlations can be calculated mathematically. Actual public health data from NHANES 2007-2008 were used as examples to demonstrate the situations with unknown or complex correct model specification. Simulation of power for misspecified models confirmed the results based on correlation methods but also illustrated the effect of model degrees of freedom on power.^

Evaluation of PRESAGE® dosimeters for brachytherapy sources and the 3D dosimetry and characterization of the new AgX100 125I seed model

With continuous new improvements in brachytherapy source designs and techniques, method of 3D dosimetry for treatment dose verifications would better ensure accurate patient radiotherapy treatment. This study was aimed to first evaluate the 3D dose distributions of the low-dose rate (LDR) Amersham 6711 OncoseedTM using PRESAGE® dosimeters to establish PRESAGE® as a suitable brachytherapy dosimeter. The new AgX100 125I seed model (Theragenics Corporation) was then characterized using PRESAGE® following the TG-43 protocol. PRESAGE® dosimeters are solid, polyurethane-based, 3D dosimeters doped with radiochromic leuco dyes that produce a linear optical density response to radiation dose. For this project, the radiochromic response in PRESAGE® was captured using optical-CT scanning (632 nm) and the final 3D dose matrix was reconstructed using the MATLAB software. An Amersham 6711 seed with an air-kerma strength of approximately 9 U was used to irradiate two dosimeters to 2 Gy and 11 Gy at 1 cm to evaluate dose rates in the r=1 cm to r=5 cm region. The dosimetry parameters were compared to the values published in the updated AAPM Report No. 51 (TG-43U1). An AgX100 seed with an air-kerma strength of about 6 U was used to irradiate two dosimeters to 3.6 Gy and 12.5 Gy at 1 cm. The dosimetry parameters for the AgX100 were compared to the values measured from previous Monte-Carlo and experimental studies. In general, the measured dose rate constant, anisotropy function, and radial dose function for the Amersham 6711 showed agreements better than 5% compared to consensus values in the r=1 to r=3 cm region. The dose rates and radial dose functions measured for the AgX100 agreed with the MCNPX and TLD-measured values within 3% in the r=1 to r=3 cm region. The measured anisotropy function in PRESAGE® showed relative differences of up to 9% with the MCNPX calculated values. It was determined that post-irradiation optical density change over several days was non-linear in different dose regions, and therefore the dose values in the r=4 to r=5 cm regions had higher uncertainty due to this effect. This study demonstrated that within the radial distance of 3 cm, brachytherapy dosimetry in PRESAGE® can be accurate within 5% as long as irradiation times are within 48 hours.