Automatic Labeling of Software Components and their Evolution using Log-Likelihood Ratio of Word Frequencies in Source Code

As more and more open-source software components become available on the internet we need automatic ways to label and compare them. For example, a developer who searches for reusable software must be able to quickly gain an understanding of retrieved components. This understanding cannot be gained at the level of source code due to the semantic gap between source code and the domain model. In this paper we present a lexical approach that uses the log-likelihood ratios of word frequencies to automatically provide labels for software components. We present a prototype implementation of our labeling/comparison algorithm and provide examples of its application. In particular, we apply the approach to detect trends in the evolution of a software system.

Multinomial goodness-of-fit: large sample tests with survey design correction and exact tests for small samples

I introduce the new mgof command to compute distributional tests for discrete (categorical, multinomial) variables. The command supports largesample tests for complex survey designs and exact tests for small samples as well as classic large-sample x2-approximation tests based on Pearson’s X2, the likelihood ratio, or any other statistic from the power-divergence family (Cressie and Read, 1984, Journal of the Royal Statistical Society, Series B (Methodological) 46: 440–464). The complex survey correction is based on the approach by Rao and Scott (1981, Journal of the American Statistical Association 76: 221–230) and parallels the survey design correction used for independence tests in svy: tabulate. mgof computes the exact tests by using Monte Carlo methods or exhaustive enumeration. mgof also provides an exact one-sample Kolmogorov–Smirnov test for discrete data.

MGOF: Stata module to perform goodness-of-fit tests for multinomial data

mgof computes goodness-of-fit tests for the distribution of a discrete (categorical, multinomial) variable. The default is to perform classical large sample chi-squared approximation tests based on Pearson's X2 statistic and the log likelihood ratio (G2) statistic or a statistic from the Cressie-Read family. Alternatively, mgof computes exact tests using Monte Carlo methods or exhaustive enumeration. A Kolmogorov-Smirnov test for discrete data is also provided. The moremata package, also available from SSC, is required.

Multinomial goodness-of-fit: large sample tests with survey design correction and exact tests for small samples

A new Stata command called -mgof- is introduced. The command is used to compute distributional tests for discrete (categorical, multinomial) variables. Apart from classic large sample $\chi^2$-approximation tests based on Pearson's $X^2$, the likelihood ratio, or any other statistic from the power-divergence family (Cressie and Read 1984), large sample tests for complex survey designs and exact tests for small samples are supported. The complex survey correction is based on the approach by Rao and Scott (1981) and parallels the survey design correction used for independence tests in -svy:tabulate-. The exact tests are computed using Monte Carlo methods or exhaustive enumeration. An exact Kolmogorov-Smirnov test for discrete data is also provided.

What does local tenderness say about the origin of pain? An investigation of cervical zygapophysial joint pain

BACKGROUND: Mechanical pain sensitivity is assessed in every patient with pain, either by palpation or by quantitative pressure algometry. Despite widespread use, no studies have formally addressed the usefulness of this practice for the identification of the source of pain. We tested the hypothesis that assessing mechanical pain sensitivity distinguishes damaged from healthy cervical zygapophysial (facet) joints. METHODS: Thirty-three patients with chronic unilateral neck pain were studied. Pressure pain thresholds (PPTs) were assessed bilaterally at all cervical zygapophysial joints. The diagnosis of zygapophysial joint pain was made by selective nerve blocks. Primary analysis was the comparison of the PPT between symptomatic and contralateral asymptomatic joints. The secondary end points were as follows: differences in PPT between affected and asymptomatic joints of the same side of patients with zygapophysial joint pain; differences in PPT at the painful side between patients with and without zygapophysial joint pain; and sensitivity and specificity of PPT for 2 different cutoffs (difference in PPT between affected and contralateral side by 1 and 30 kPa, meaning that the test was considered positive if the difference in PPT between painful and contralateral side was negative by at least 1 and 30 kPa, respectively). The PPT of patients was also compared with the PPT of 12 pain-free subjects. RESULTS: Zygapophysial joint pain was present in 14 patients. In these cases, the difference in mean PPT between affected and contralateral side (primary analysis) was −6.2 kPa (95% confidence interval: −19.5 to 7.2, P = 0.34). In addition, the secondary analyses yielded no statistically significant differences. For the cutoff of 1 kPa, sensitivity and specificity of PPT were 67% and 16%, respectively, resulting in a positive likelihood ratio of 0.79 and a diagnostic confidence of 38%. When the cutoff of 30 kPa was considered, the sensitivity decreased to only 13%, whereas the specificity increased to 95%, resulting in a positive likelihood ratio of 2.53 and a diagnostic confidence of 67%. The PPT was significantly lower in patients than in pain-free subjects (P < 0.001). CONCLUSIONS: Assessing mechanical pain sensitivity is not diagnostic for cervical zygapophysial joint pain. The finding should stimulate further research into a diagnostic tool that is widely used in the clinical examination of patients with pain.

Comparison of inversion recovery and contrast-enhanced T1-weighted fat-suppressed sequences for the staging of cervical lymphoma

In a retrospective analysis with two readers blinded to the clinical information, coronal short tau inversion recovery (STIR) images were compared to contrast-enhanced fat-saturated T1-weighted imaging (T1 CEfs) in 51 cases of cervical lymphoma. Interrater reliability was good to excellent. Although sensitivity and subjective quality of the STIR sequence were higher than those of the T1 CEfs sequence (sensitivity 85%/72%, respectively), specificity (82%/95%) as well as positive likelihood ratio (4.65/15.93) was much lower. Therefore, contrast-enhanced sequences should be included in the primary staging of lymphoma.

Sensitivity and specificity of fluorescence microlymphography for detecting lymphedema of the lower extremity

Fluorescence microlymphography (FML) is used to visualize the lymphatic capillaries. A maximum spread of the fluorescence dye of ≥ 12 mm has been suggested for the diagnosis of lymphedema. However, data on sensitivity and specificity are lacking. The aim of this study was to investigate the accuracy of FML for diagnosing lymphedema in patients with leg swelling. Patients with lower extremity swelling were clinically assessed and separated into lymphedema and non-lymphatic edema groups. FML was studied in all affected legs and the maximum spread of lymphatic capillaries was measured. Test accuracy and receiver operator characteristic (ROC) analysis was performed to assess possible threshold values that predict lymphedema. Between March 2008 and August 2011 a total of 171 patients (184 legs) with a median age of 43.5 (IQR 24, 54) years were assessed. Of those, 94 (51.1%) legs were diagnosed with lymphedema. The sensitivity, specificity, positive and negative likelihood ratio and positive and negative predictive value were 87%, 64%, 2.45, 0.20, 72% and 83% for the 12-mm cut-off level and 79%, 83%, 4.72, 0.26, 83% and 79% for the 14-mm cut-off level, respectively. The area under the ROC curve was 0.82 (95% CI: 0.76, 0.88). Sensitivity was higher in the secondary versus primary lymphedema (95.0% vs 74.3%, p = 0.045). No major adverse events were observed. In conclusion, FML is a simple and safe technique for detecting lymphedema in patients with leg swelling. A cut-off level of ≥ 14-mm maximum spread has a high sensitivity and high specificity of detecting lymphedema and should be chosen.

Accuracy of B-type natriuretic peptide tests to exclude congestive heart failure: systematic review of test accuracy studies

BACKGROUND: Congestive heart failure (CHF) is a major public health problem. The use of B-type natriuretic peptide (BNP) tests shows promising diagnostic accuracy. Herein, we summarize the evidence on the accuracy of BNP tests in the diagnosis of CHF and compare the performance of rapid enzyme-linked immunosorbent assay (ELISA) and standard radioimmunosorbent assay (RIA) tests. METHODS: We searched electronic databases and the reference lists of included studies, and we contacted experts. Data were extracted on the study population, the type of test used, and methods. Receiver operating characteristic (ROC) plots and summary ROC curves were produced and negative likelihood ratios pooled. Random-effect meta-analysis and metaregression were used to combine data and explore sources of between-study heterogeneity. RESULTS: Nineteen studies describing 22 patient populations (9 ELISA and 13 RIA) and 9093 patients were included. The diagnosis of CHF was verified by echocardiography, radionuclide scan, or echocardiography combined with clinical criteria. The pooled negative likelihood ratio overall from random-effect meta-analysis was 0.18 (95% confidence interval [CI], 0.13-0.23). It was lower for the ELISA test (0.12; 95% CI, 0.09-0.16) than for the RIA test (0.23; 95% CI, 0.16-0.32). For a pretest probability of 20%, which is typical for patients with suspected CHF in primary care, a negative result of the ELISA test would produce a posttest probability of 2.9%; a negative RIA test, a posttest probability of 5.4%. CONCLUSIONS: The use of BNP tests to rule out CHF in primary care settings could reduce demand for echocardiography. The advantages of rapid ELISA tests need to be balanced against their higher cost.

Accuracy of magnetic resonance imaging for the diagnosis of multiple sclerosis: systematic review

OBJECTIVE: To determine the accuracy of magnetic resonance imaging criteria for the early diagnosis of multiple sclerosis in patients with suspected disease. DESIGN: Systematic review. DATA SOURCES: 12 electronic databases, citation searches, and reference lists of included studies. Review methods Studies on accuracy of diagnosis that compared magnetic resonance imaging, or diagnostic criteria incorporating such imaging, to a reference standard for the diagnosis of multiple sclerosis. RESULTS: 29 studies (18 cohort studies, 11 other designs) were included. On average, studies of other designs (mainly diagnostic case-control studies) produced higher estimated diagnostic odds ratios than did cohort studies. Among 15 studies of higher methodological quality (cohort design, clinical follow-up as reference standard), those with longer follow-up produced higher estimates of specificity and lower estimates of sensitivity. Only two such studies followed patients for more than 10 years. Even in the presence of many lesions (> 10 or > 8), magnetic resonance imaging could not accurately rule multiple sclerosis in (likelihood ratio of a positive test result 3.0 and 2.0, respectively). Similarly, the absence of lesions was of limited utility in ruling out a diagnosis of multiple sclerosis (likelihood ratio of a negative test result 0.1 and 0.5). CONCLUSIONS: Many evaluations of the accuracy of magnetic resonance imaging for the early detection of multiple sclerosis have produced inflated estimates of test performance owing to methodological weaknesses. Use of magnetic resonance imaging to confirm multiple sclerosis on the basis of a single attack of neurological dysfunction may lead to over-diagnosis and over-treatment.

Accuracy of electrocardiography in diagnosis of left ventricular hypertrophy in arterial hypertension: systematic review

OBJECTIVE: To review the accuracy of electrocardiography in screening for left ventricular hypertrophy in patients with hypertension. DESIGN: Systematic review of studies of test accuracy of six electrocardiographic indexes: the Sokolow-Lyon index, Cornell voltage index, Cornell product index, Gubner index, and Romhilt-Estes scores with thresholds for a positive test of > or =4 points or > or =5 points. DATA SOURCES: Electronic databases ((Pre-)Medline, Embase), reference lists of relevant studies and previous reviews, and experts. STUDY SELECTION: Two reviewers scrutinised abstracts and examined potentially eligible studies. Studies comparing the electrocardiographic index with echocardiography in hypertensive patients and reporting sufficient data were included. DATA EXTRACTION: Data on study populations, echocardiographic criteria, and methodological quality of studies were extracted. DATA SYNTHESIS: Negative likelihood ratios, which indicate to what extent the posterior odds of left ventricular hypertrophy is reduced by a negative test, were calculated. RESULTS: 21 studies and data on 5608 patients were analysed. The median prevalence of left ventricular hypertrophy was 33% (interquartile range 23-41%) in primary care settings (10 studies) and 65% (37-81%) in secondary care settings (11 studies). The median negative likelihood ratio was similar across electrocardiographic indexes, ranging from 0.85 (range 0.34-1.03) for the Romhilt-Estes score (with threshold > or =4 points) to 0.91 (0.70-1.01) for the Gubner index. Using the Romhilt-Estes score in primary care, a negative electrocardiogram result would reduce the typical pre-test probability from 33% to 31%. In secondary care the typical pre-test probability of 65% would be reduced to 63%. CONCLUSION: Electrocardiographic criteria should not be used to rule out left ventricular hypertrophy in patients with hypertension.

Predictive value of known and novel alleles of CYP2B6 for efavirenz plasma concentrations in HIV-infected individuals

To assess the association of CYP2B6 allelic diversity with efavirenz (EFV) pharmacokinetics, we performed extensive genotyping of 15 relevant single nucleotide polymorphism in 169 study participants, and full resequencing of CYP2B6 in individuals with abnormal EFV plasma levels. Seventy-seven (45.5%) individuals carried a known (CYP2B6*6, *11, *15, or *18) or new loss/diminished-function alleles. Resequencing defined two new loss-of-function alleles: allele *27 (marked by 593T>C [M198T]), that results in 85% decrease in enzyme activity and allele *28 (marked by 1132C>T), that results in protein truncation at arginine 378. Median AUC levels were 188.5 microg h/ml for individuals homozygous for a loss/diminished-function allele, 58.6 microg h/ml for carriers, and 43.7 microg h/ml for noncarriers (P<0.0001). Individuals with a poor metabolizer genotype had a likelihood ratio of 35 (95% CI, 11-110) of presenting very high EFV plasma levels. CYP2B6 poor metabolizer genotypes explain to a large extent EFV pharmacokinetics and identify individuals at risk of extremely elevated EFV plasma levels.

Performance of fluorescence methods, radiographic examination and ICDAS II on occlusal surfaces in vitro

This study compared the performance of fluorescence-based methods, radiographic examination, and International Caries Detection and Assessment System (ICDAS) II on occlusal surfaces. One hundred and nineteen permanent human molars were assessed twice by 2 experienced dentists using the laser fluorescence (LF and LFpen) and fluorescence camera (FC) devices, ICDAS II and bitewing radiographs (BW). After measuring, the teeth were histologically prepared and assessed for caries extension. The sensitivities for dentine caries detection were 0.86 (FC), 0.78 (LFpen), 0.73 (ICDAS II), 0.51 (LF) and 0.34 (BW). The specificities were 0.97 (BW), 0.89 (LF), 0.65 (ICDAS II), 0.63 (FC) and 0.56 (LFpen). BW presented the highest values of likelihood ratio (LR)+ (12.47) and LR- (0.68). Rank correlations with histology were 0.53 (LF), 0.52 (LFpen), 0.41 (FC), 0.59 (ICDAS II) and 0.57 (BW). The area under the ROC curve varied from 0.72 to 0.83. Inter- and intraexaminer intraclass correlation values were respectively 0.90 and 0.85 (LF), 0.93 and 0.87 (LFpen) and 0.85 and 0.76 (FC). The ICDAS II kappa values were 0.51 (interexaminer) and 0.61 (intraexaminer). The BW kappa values were 0.50 (interexaminer) and 0.62 (intraexaminer). The Bland and Altman limits of agreement were 46.0 and 38.2 (LF), 55.6 and 40.0 (LFpen) and 1.12 and 0.80 (FC), for intra- and interexaminer reproducibilities. The posttest probability for dentine caries detection was high for BW and LF. In conclusion, LFpen, FC and ICDAS II presented better sensitivity and LF and BW better specificity. ICDAS II combined with BW showed the best performance and is the best combination for detecting caries on occlusal surfaces.

Stability of coagulation assays performed in plasma from citrated whole blood transported at ambient temperature

Many preanalytical variables affect the results of coagulation assays. A possible way to control some of them would be to accept blood specimens shipped in the original collection tube. The aim of our study was to investigate the stability of coagulation assays in citrated whole blood transported at ambient temperature for up to two days after specimen collection. Blood samples from 59 patients who attended our haematology outpatient ward for thrombophilia screening were transported at ambient temperature (outdoor during the day, indoor overnight) for following periods of time: <1 hour, 4-6, 8-12, 24-28 and 48-52 hours prior to centrifugation and plasma-freezing. The following coagulation tests were performed: PT, aPTT, fibrinogen, FII:C, FV:C, FVII:C, FVIII:C, FIX:C, FX:C, FXI:C, VWF:RCo, VWF:Ag, AT, PC activity, total and free PS antigen, modified APC-sensitivity-ratio, thrombin-antithrombin-complex and D-dimer. Clinically significant changes, defined as a percentage change of more than 10% from the initial value, were observed for FV:C, FVIII:C and total PS antigen starting at 24-28 hours, and for PT, aPTT and FVII:C at 48-52 hours. No statistically significant differences were seen for fibrinogen, antithrombin, or thrombin-antithrombin complexes (Friedman repeated measures analysis of variance). The present data suggest that the use of whole blood samples transported at ambient temperature may be an acceptable means of delivering specimens for coagulation analysis. With the exception of factor V and VIII coagulant activity, and total PS antigen all investigated parameters can be measured 24-28 hours after specimen collection without observing clinically relevant changes.

Changing epidemiology of HIV anonymous testing in Switzerland for 1996-2006

QUESTIONS UNDER STUDY: To assess whether the prevalence of HIV positive tests in clients at five anonymous testing sites in Switzerland had increased since the end of the 1990s, and ascertain whether there had been any concurrent change in the proportions of associated risk factors. METHODS: Baseline characteristics were analysed, by groups of years, over the eleven consecutive years of data collected from the testing sites. Numbers of HIV positive tests were presented as prevalence/1000 tests performed within each category. Multivariable analyses, stratified by African nationality and risk group of heterosexuals or men who have sex with men (MSM), were done controlling simultaneously for a series of variables. Odds ratios (ORs) were reported together with their 95% confidence intervals (CI). P values were calculated from likelihood ratio tests. RESULTS: There was an increase in the prevalence of positive tests in African heterosexuals between 1996-1999 and 2004-2006, rising from 54.2 to 86.4/1000 and from 5.6 to 25.2/1000 in females and males respectively. The proportion of MSM who knew that one or more of their sexual partners was infected with HIV increased from 2% to 17% and the proportion who reported having more than five sexual partners in the preceding two years increased from 44% to 51%. CONCLUSIONS: Surveillance data from anonymous testing sites continue to provide useful information on the changing epidemiology of HIV and thus inform public health strategies against HIV.

Is perioperative point-of-care prothrombin time testing accurate compared to the standard laboratory test?

There is no accepted way of measuring prothrombin time without time loss for patients undergoing major surgery who are at risk of intraoperative dilution and consumption coagulopathy due to bleeding and volume replacement with crystalloids or colloids. Decisions to transfuse fresh frozen plasma and procoagulatory drugs have to rely on clinical judgment in these situations. Point-of-care devices are considerably faster than the standard laboratory methods. In this study we assessed the accuracy of a Point-of-care (PoC) device measuring prothrombin time compared to the standard laboratory method. Patients undergoing major surgery and intensive care unit patients were included. PoC prothrombin time was measured by CoaguChek XS Plus (Roche Diagnostics, Switzerland). PoC and reference tests were performed independently and interpreted under blinded conditions. Using a cut-off prothrombin time of 50%, we calculated diagnostic accuracy measures, plotted a receiver operating characteristic (ROC) curve and tested for equivalence between the two methods. PoC sensitivity and specificity were 95% (95% CI 77%, 100%) and 95% (95% CI 91%, 98%) respectively. The negative likelihood ratio was 0.05 (95% CI 0.01, 0.32). The positive likelihood ratio was 19.57 (95% CI 10.62, 36.06). The area under the ROC curve was 0.988. Equivalence between the two methods was confirmed. CoaguChek XS Plus is a rapid and highly accurate test compared with the reference test. These findings suggest that PoC testing will be useful for monitoring intraoperative prothrombin time when coagulopathy is suspected. It could lead to a more rational use of expensive and limited blood bank resources.