An approach to verifying and debugging simulation models governed by ordinary differential equations: Part 1. Methodology for residual generation

For dynamic simulations to be credible, verification of the computer code must be an integral part of the modelling process. This two-part paper describes a novel approach to verification through program testing and debugging. In Part 1, a methodology is presented for detecting and isolating coding errors using back-to-back testing. Residuals are generated by comparing the output of two independent implementations, in response to identical inputs. The key feature of the methodology is that a specially modified observer is created using one of the implementations, so as to impose an error-dependent structure on these residuals. Each error can be associated with a fixed and known subspace, permitting errors to be isolated to specific equations in the code. It is shown that the geometric properties extend to multiple errors in either one of the two implementations. Copyright (C) 2003 John Wiley Sons, Ltd.

An approach to verifying and debugging simulation models governed by ordinary differential equations: Part 2. Residuals analysis and a case study

In Part 1 of this paper a methodology for back-to-back testing of simulation software was described. Residuals with error-dependent geometric properties were generated. A set of potential coding errors was enumerated, along with a corresponding set of feature matrices, which describe the geometric properties imposed on the residuals by each of the errors. In this part of the paper, an algorithm is developed to isolate the coding errors present by analysing the residuals. A set of errors is isolated when the subspace spanned by their combined feature matrices corresponds to that of the residuals. Individual feature matrices are compared to the residuals and classified as 'definite', 'possible' or 'impossible'. The status of 'possible' errors is resolved using a dynamic subset testing algorithm. To demonstrate and validate the testing methodology presented in Part 1 and the isolation algorithm presented in Part 2, a case study is presented using a model for biological wastewater treatment. Both single and simultaneous errors that are deliberately introduced into the simulation code are correctly detected and isolated. Copyright (C) 2003 John Wiley Sons, Ltd.

Computational methods for prediction of T-cell epitopes - a framework for modelling, testing, and applications

Computational models complement laboratory experimentation for efficient identification of MHC-binding peptides and T-cell epitopes. Methods for prediction of MHC-binding peptides include binding motifs, quantitative matrices, artificial neural networks, hidden Markov models, and molecular modelling. Models derived by these methods have been successfully used for prediction of T-cell epitopes in cancer, autoimmunity, infectious disease, and allergy. For maximum benefit, the use of computer models must be treated as experiments analogous to standard laboratory procedures and performed according to strict standards. This requires careful selection of data for model building, and adequate testing and validation. A range of web-based databases and MHC-binding prediction programs are available. Although some available prediction programs for particular MHC alleles have reasonable accuracy, there is no guarantee that all models produce good quality predictions. In this article, we present and discuss a framework for modelling, testing, and applications of computational methods used in predictions of T-cell epitopes. (C) 2004 Elsevier Inc. All rights reserved.

Consensus neuropathological diagnosis of common dementia syndromes: testing and standardising the use of multiple diagnostic criteria

The aim of this study was to assess the variation between neuropathologists in the diagnosis of common dementia syndromes when multiple published protocols are applied. Fourteen out of 18 Australian neuropathologists participated in diagnosing 20 cases (16 cases of dementia, 4 age-matched controls) using consensus diagnostic methods. Diagnostic criteria, clinical synopses and slides from multiple brain regions were sent to participants who were asked for case diagnoses. Diagnostic sensitivity, specificity, predictive value, accuracy and variability were determined using percentage agreement and kappa statistics. Using CERAD criteria, there was a high inter-rater agreement for cases with probable and definite Alzheimer's disease but low agreement for cases with possible Alzheimer's disease. Braak staging and the application of criteria for dementia with Lewy bodies also resulted in high inter-rater agreement. There was poor agreement for the diagnosis of frontotemporal dementia and for identifying small vessel disease. Participants rarely diagnosed more than one disease in any case. To improve efficiency when applying multiple diagnostic criteria, several simplifications were proposed and tested on 5 of the original 210 cases. Inter-rater reliability for the diagnosis of Alzheimer's disease and dementia with Lewy bodies significantly improved. Further development of simple and accurate methods to identify small vessel lesions and diagnose frontotemporal dementia is warranted.

Aberrant protective force generation during neural provocation testing and the effect of treatment in patients with neurogenic cervicobrachial pain

Background: Observation of the occurrence of protective muscle activity is advocated in assessment of the peripheral nervous system by means of neural provocation tests. However, no studies have yet demonstrated abnormal force generation in a patient population. Objectives: To analyze whether aberrations in shoulder girdle-elevation force during neural tissue provocation testing for the median nerve (NTPTI) can be demonstrated, and whether possible aberrations can be normalized following cervical mobilization. Study Design: A single-blind randomized comparative controlled study. Setting: Laboratory setting annex in a manual therapy teaching practice. Participants: Twenty patients with unilateral or bilateral neurogenic cervicobrachial pain. Methods: During the NTPTI, we used a load cell and electrogoniometer to record continuously the shoulder-girdle elevation force in relation to the available range of elbow extension. Following randomization, we analyzed the immediate treatment effects of a cervical contralateral lateral glide mobilization technique (experimental group) and therapeutic ultrasound (control group). Results: On the involved side, the shoulder-girdle elevation force occur-red earlier, and the amount of force at the end of the test was substantially, though not significantly, greater than that on the uninvolved side at the corresponding range of motion. Together with a significant reduction in pain perception after cervical mobilization, a clear tendency toward normalization of the force curve could be observed, namely, a significant decrease in force generation and a delayed onset. The control group demonstrated no differences. Conclusions: Aberrations in force generation during neural, provocation testing are present in patients with neurogenic pain and can be normalized with appropriate treatment modalities.

A framework for specification-based testing

Test templates and a test template framework are introduced as useful concepts in specification-based testing. The framework can be defined using any model-based specification notation and used to derive tests from model-based specifications-in this paper, it is demonstrated using the Z notation. The framework formally defines test data sets and their relation to the operations in a specification and to other test data sets, providing structure to the testing process. Flexibility is preserved, so that many testing strategies can be used. Important application areas of the framework are discussed, including refinement of test data, regression testing, and test oracles.

Immunohistochemistry versus microsatellite instability testing in phenotyping colorectal tumors

Purpose: To compare microsatellite instability (MSI) testing with immunohistochemical (IHC) detection of hMLH1 and hMSH2 in colorectal cancer. Patients and Methods: Colorectal cancers from 1, 144 patients were assessed for DNA mismatch repair deficiency by two methods: MSI testing and IHC detection of hMLH1 and hMSH2 gene products. High-frequency MSI (MSI-H) was defined as more than 30% instability of at least five markers; low-level MSI (MSI-L) was defined as 1% to 29% of loci unstable. Results: Of 1, 144 tumors tested, 818 showed intact expression of hMLH1 and hMSH2. Of these, 680 were microsatellite stable (MSS), 27 were MSI-H, and 111 were MSI-L. In all, 228 tumors showed absence of hMLH1 expression and 98 showed absence of hMSH2 expression: all were MSI-H. Conclusion: IHC in colorectal tumors for protein products hMLH1 and hMSH2 provides a rapid, cost-effective, sensitive (92.3%), and extremely specific (100%) method for screening for DNA mismatch repair defects. The predictive value of normal IHC for an MSS/MSI-L phenotype was 96.7%, and the predictive value of abnormal IHC was 100% for an MSI-H phenotype. Testing strategies must take into account acceptability of missing some cases of MSI-H tumors if only IHC is performed. (C) 2002 by American Society of Clinical Oncology.

Benefits, harms and costs of screening mammography in women 70 years and over: a systematic review

Objective: To assess the (i) benefits, (ii) harms and (iii) costs of continuing mammographic screening for women 70 years and over. Data sources and synthesis: (i) We conducted a MEDLINE search (1966 - July 2000) for decision-analytic models estimating life-expectancy gains from screening in older women. The five studies meeting the inclusion criteria were critically appraised using standard criteria. We estimated relative benefit from each model's estimate of effectiveness of screening in older women relative to that in women aged 50-69 years using the same model. (ii) With data from BreastScreen Queensland, we constructed balance sheets of the consequences of screening for women in 10-year age groups (40-49 to 80-89 years), and (iii) we used a validated model to estimate the marginal cost-effectiveness of extending screening to women 70 years and over. Results: For women aged 70-79 years, the relative benefit was estimated as 40%-72%, and 18%-62% with adjustment for the impact of screening on quality of life. For women over 80 years the relative benefit was about a third, and with quality-of-life adjustment only 14%, that in women aged 50-69 years. (ii) Of 10 000 Australian women participating in ongoing screening, about 400 are recalled for further testing, and, depending on age, about 70-112 undergo biopsy and about 19-80 cancers are detected. (iii) Cost-effectiveness estimates for extending the upper age limit for mammographic screening from 69 to 79 years range from $8119 to $27 751 per quality-adjusted life-year saved, which compares favourably with extending screening to women aged 40-49 years (estimated at between $24 000 and $65 000 per life-year saved). Conclusions: Women 70 years and over, in consultation with their healthcare providers, may want to decide for themselves whether to continue mammographic screening. Decision-support materials are needed for women in this age group.

Mapping hippocampal and ventricular change in Alzheimer disease

We developed an anatomical mapping technique to detect hippocampal and ventricular changes in Alzheimer disease (AD). The resulting maps are sensitive to longitudinal changes in brain structure as the disease progresses. An anatomical surface modeling approach was combined with surface-based statistics to visualize the region and rate of atrophy in serial MRI scans and isolate where these changes link with cognitive decline. Fifty-two high-resolution MRI scans were acquired from 12 AD patients (age: 68.4 +/- 1.9 years) and 14 matched controls (age: 71.4 +/- 0.9 years), each scanned twice (2.1 +/- 0.4 years apart). 3D parametric mesh models of the hippocampus and temporal horns were created in sequential scans and averaged across subjects to identify systematic patterns of atrophy. As an index of radial atrophy, 3D distance fields were generated relating each anatomical surface point to a medial curve threading down the medial axis of each structure. Hippocampal atrophic rates and ventricular expansion were assessed statistically using surface-based permutation testing and were faster in AD than in controls. Using color-coded maps and video sequences, these changes were visualized as they progressed anatomically over time. Additional maps localized regions where atrophic changes linked with cognitive decline. Temporal horn expansion maps were more sensitive to AD progression than maps of hippocampal atrophy, but both maps correlated with clinical deterioration. These quantitative, dynamic visualizations of hippocampal atrophy and ventricular expansion rates in aging and AD may provide a promising measure to track AD progression in drug trials. (C) 2004 Elsevier Inc. All rights reserved.

Using pharmacogenetics and pharmacogenomics in the treatment of psychiatric disorders: some ethical and economic considerations"

Current pharmacotherapies for psychiatric disorders are generally incompletely effective. Many patients do not respond well or suffer adverse reactions to these drugs, which can result in poor patient compliance and poor treatment outcome. Adverse drug reactions and non-response are likely to be influenced by genetic polymorphisms. Pharmacogenetics holds some promise for improving the treatment of mood disorders by utilising information about genetic polymorphisms to match patients to the drug therapy that is the most effective with the fewest side effects. Pharmacogenomics promises to facilitate the development of new drugs for treatment. However, these technologies raise many ethical, economic and regulatory issues that need to be addressed before they can be integrated into psychiatry, and medicine more generally. We discuss ethical and policy issues arising from pharmacogenetic testing and pharmacogenomics research, such as informed consent, privacy and confidentiality, research on vulnerable persons and discrimination; and economic viability of pharmacogenetics and pharmacogenomics. We conclude with recommendations for the regulation and distribution of pharmacogenetic testing services and pharmacogenomic drugs.