Three-dimensional imaging core laboratory of the endovascular aneurysm repair trials: validation of methodology

OBJECTIVE: The aim of this study was to establish and validate a three-dimensional imaging protocol for the assessment of Computed Tomography (CT) scans of abdominal aortic aneurysms in UK EVAR trials patients. Quality control and repeatability of anatomical measurements is important for the validity of any core laboratory. METHODS: Three different observers performed anatomical measurements on 50 preoperative CT scans of aortic aneurysms using the Vitrea 2 three-dimensional post-imaging software in a core laboratory setting. We assessed the accuracy of intra and inter observer repeatability of measurements, the time required for collection of measurements, 3 different levels of automation and 3 different automated criteria for measurement of neck length. RESULTS: None of the automated neck length measurements demonstrated sufficient accuracy and it was necessary to perform checking of the important automated landmarks. Good intra and limited inter observer agreement were achieved with three-dimensional assessment. Complete assessment of the aneurysm and iliacs took an average (SD) of 17.2 (4.1) minutes. CONCLUSIONS: Aortic aneurysm anatomy can be assessed reliably and quickly using three-dimensional assessment but for scans of limited quality, manual checking of important landmarks remains necessary. Using a set protocol, agreement between observers is satisfactory but not as good as within observers.

Validation of the LittlEARS((R)) Auditory Questionnaire in children with normal hearing

OBJECTIVES: With more children receiving cochlear implants during infancy, there is a need for validated assessments of pre-verbal and early verbal auditory skills. The LittlEARS Auditory Questionnaire is presented here as the first module of the LittlEARS test battery. The LittlEARS Auditory Questionnaire was developed and piloted to assess the auditory behaviour of normal hearing children and hearing impaired children who receive a cochlear implant or hearing aid prior to 24 months of age. This paper presents results from two studies: one validating the LittlEARS Auditory Questionnaire on children with normal hearing who are German speaking and a second validating the norm curves found after adaptation and administration of the questionnaire to children with normal hearing in 15 different languages. METHODS: Scores from a group of 218 German and Austrian children with normal hearing between 5 days and 24 months of age were used to create a norm curve. The questionnaire was adapted from the German original into English and then 15 other languages to date. Regression curves were found based on parental responses from 3309 normal hearing infants and toddlers. Curves for each language were compared to the original German validation curve. RESULTS: The results of the first study were a norm curve which reflects the age-dependence of auditory behaviour, reliability and homogeneity as a measure of auditory behaviour, and calculations of expected and critical values as a function of age. Results of the second study show that the regression curves found for all the adapted languages are essentially equal to the German norm curve, as no statistically significant differences were found. CONCLUSIONS: The LittlEARS Auditory Questionnaire is a valid, language-independent tool for assessing the early auditory behaviour of infants and toddlers with normal hearing. The results of this study suggest that the LittlEARS Auditory Questionnaire could also be very useful for documenting children's progress with their current amplification, providing evidence of the need for implantation, or highlighting the need for follow-up in other developmental areas.

The SAKK cancer-specific geriatric assessment (C-SGA): a pilot study of a brief tool for clinical decision-making in older cancer patients

BACKGROUND Recommendations from international task forces on geriatric assessment emphasize the need for research including validation of cancer-specific geriatric assessment (C-SGA) tools in oncological settings. The objective of this study was to evaluate the feasibility of the SAKK Cancer-Specific Geriatric Assessment (C-SGA) in clinical practice. METHODS A cross sectional study of cancer patients >=65 years old (N = 51) with pathologically confirmed cancer presenting for initiation of chemotherapy treatment (07/01/2009-03/31/2011) at two oncology departments in Swiss canton hospitals: Kantonsspital Graubunden (KSGR N = 25), Kantonsspital St. Gallen (KSSG N = 26). Data was collected using three instruments, the SAKK C-SGA plus physician and patient evaluation forms. The SAKK C-SGA includes six measures covering five geriatric assessment domains (comorbidity, function, psychosocial, nutrition, cognition) using a mix of medical record abstraction (MRA) and patient interview. Five individual domains and one overall SAKK C-SGA score were calculated and dichotomized as below/above literature-based cut-offs. The SAKK C-SGA was evaluated by: patient and physician estimated time to complete, ease of completing, and difficult or unanswered questions. RESULTS Time to complete the patient questionnaire was considered acceptable by almost all (>=96%) patients and physicians. Patients reported slightly shorter times to complete the questionnaire than physicians (17.33 +/- 7.34 vs. 20.59 +/- 6.53 minutes, p = 0.02). Both groups rated the patient questionnaire as easy/fairly easy to complete (91% vs. 84% respectively, p = 0.14) with few difficult or unanswered questions. The MRA took on average 8.32 +/- 4.72 minutes to complete. Physicians (100%) considered time to complete MRA acceptable, 96% rated it as easy/fairly easy to complete. Individual study site populations differed on health-related characteristics (excellent/good physician-rated general health KSGR 71% vs. KSSG 32%, p = 0.007). The overall mean C-SGA score was 2.4 +/- 1.12. Patients at KSGR had lower C-SGA scores (2.00 +/- 1.19 vs. 2.81 +/- 0.90, p = 0.009) and a smaller proportion (28% vs.65%, p = 0.008) was above the C-SGA cut-off score compared to KSSG. CONCLUSIONS These results suggest the SAKK C-SGA is a feasible practical tool for use in clinical practice. It demonstrated discriminative ability based on objective geriatric assessment measures, but additional investigations on use for clinical decision-making are warranted. The SAKK C-SGA also provides important usable domain information for intervention to optimize outcomes in older cancer patients.

A simple asthma prediction tool for preschool children with wheeze or cough

BACKGROUND Many preschool children have wheeze or cough, but only some have asthma later. Existing prediction tools are difficult to apply in clinical practice or exhibit methodological weaknesses. OBJECTIVE We sought to develop a simple and robust tool for predicting asthma at school age in preschool children with wheeze or cough. METHODS From a population-based cohort in Leicestershire, United Kingdom, we included 1- to 3-year-old subjects seeing a doctor for wheeze or cough and assessed the prevalence of asthma 5 years later. We considered only noninvasive predictors that are easy to assess in primary care: demographic and perinatal data, eczema, upper and lower respiratory tract symptoms, and family history of atopy. We developed a model using logistic regression, avoided overfitting with the least absolute shrinkage and selection operator penalty, and then simplified it to a practical tool. We performed internal validation and assessed its predictive performance using the scaled Brier score and the area under the receiver operating characteristic curve. RESULTS Of 1226 symptomatic children with follow-up information, 345 (28%) had asthma 5 years later. The tool consists of 10 predictors yielding a total score between 0 and 15: sex, age, wheeze without colds, wheeze frequency, activity disturbance, shortness of breath, exercise-related and aeroallergen-related wheeze/cough, eczema, and parental history of asthma/bronchitis. The scaled Brier scores for the internally validated model and tool were 0.20 and 0.16, and the areas under the receiver operating characteristic curves were 0.76 and 0.74, respectively. CONCLUSION This tool represents a simple, low-cost, and noninvasive method to predict the risk of later asthma in symptomatic preschool children, which is ready to be tested in other populations.

Accuracy and reproducibility of aortic annulus sizing using a dedicated three-dimensional computed tomography reconstruction tool in patients evaluated for transcatheter aortic valve replacement

Aims: To evaluate the accuracy and reproducibility of aortic annulus sizing using a multislice computed tomography (MSCT) based aortic root reconstruction tool compared with conventional imaging among patients evaluated for transcatheter aortic valve replacement (TAVR). Methods and results: Patients referred for TAVR underwent standard preprocedural assessment of aortic annulus parameters using MSCT, angiography and transoesophageal echocardiography (TEE). Three-dimensional (3-D) reconstruction of MSCT images of the aortic root was performed using 3mensio (3mensio Medical Imaging BV, Bilthoven, The Netherlands), allowing for semi-automated delineation of the annular plane and assessment of annulus perimeter, area, maximum, minimum and virtual diameters derived from area and perimeter (aVD and pVD). A total of 177 patients were enrolled. We observed a good inter-observer variability of 3-D reconstruction assessments with concordance coefficients for agreement of 0.91 (95% CI: 0.87-0.93) and 0.91 (0.88-0.94) for annulus perimeter and area assessments, respectively. 3-D derived pVD and aVD correlated very closely with a concordance coefficient of 0.97 (0.96-0.98) with a mean difference of 0.5±0.3 mm (pVD-aVD). 3-D derived pVD showed the best, but moderate concordance with diameters obtained from coronal MSCT (0.67, 0.56-0.75; 0.3±1.8 mm), and the lowest concordance with diameters obtained from TEE (0.42, 0.31-0.52; 1.9±1.9 mm). Conclusions: MSCT-based 3-D reconstruction of the aortic annulus using the 3mensio software enables accurate and reproducible assessment of aortic annulus dimensions.

Validation of novel 3-dimensional electrocardiographic mapping of atrial tachycardias by invasive mapping and ablation: a multicenter study

OBJECTIVES This study prospectively evaluated the role of a novel 3-dimensional, noninvasive, beat-by-beat mapping system, Electrocardiographic Mapping (ECM), in facilitating the diagnosis of atrial tachycardias (AT). BACKGROUND Conventional 12-lead electrocardiogram, a widely used noninvasive tool in clinical arrhythmia practice, has diagnostic limitations. METHODS Various AT (de novo and post-atrial fibrillation ablation) were mapped using ECM followed by standard-of-care electrophysiological mapping and ablation in 52 patients. The ECM consisted of recording body surface electrograms from a 252-electrode-vest placed on the torso combined with computed tomography-scan-based biatrial anatomy (CardioInsight Inc., Cleveland, Ohio). We evaluated the feasibility of this system in defining the mechanism of AT-macro-re-entrant (perimitral, cavotricuspid isthmus-dependent, and roof-dependent circuits) versus centrifugal (focal-source) activation-and the location of arrhythmia in centrifugal AT. The accuracy of the noninvasive diagnosis and detection of ablation targets was evaluated vis-à-vis subsequent invasive mapping and successful ablation. RESULTS Comparison between ECM and electrophysiological diagnosis could be accomplished in 48 patients (48 AT) but was not possible in 4 patients where the AT mechanism changed to another AT (n = 1), atrial fibrillation (n = 1), or sinus rhythm (n = 2) during the electrophysiological procedure. ECM correctly diagnosed AT mechanisms in 44 of 48 (92%) AT: macro-re-entry in 23 of 27; and focal-onset with centrifugal activation in 21 of 21. The region of interest for focal AT perfectly matched in 21 of 21 (100%) AT. The 2:1 ventricular conduction and low-amplitude P waves challenged the diagnosis of 4 of 27 macro-re-entrant (perimitral) AT that can be overcome by injecting atrioventricular node blockers and signal averaging, respectively. CONCLUSIONS This prospective multicenter series shows a high success rate of ECM in accurately diagnosing the mechanism of AT and the location of focal arrhythmia. Intraprocedural use of the system and its application to atrial fibrillation mapping is under way.

Patient-specific finite-element simulation of the human cornea: A clinical validation study on cataract surgery

The planning of refractive surgical interventions is a challenging task. Numerical modeling has been proposed as a solution to support surgical intervention and predict the visual acuity, but validation on patient specific intervention is missing. The purpose of this study was to validate the numerical predictions of the post-operative corneal topography induced by the incisions required for cataract surgery. The corneal topography of 13 patients was assessed preoperatively and postoperatively (1-day and 30-day follow-up) with a Pentacam tomography device. The preoperatively acquired geometric corneal topography – anterior, posterior and pachymetry data – was used to build patient-specific finite element models. For each patient, the effects of the cataract incisions were simulated numerically and the resulting corneal surfaces were compared to the clinical postoperative measurements at one day and at 30-days follow up. Results showed that the model was able to reproduce experimental measurements with an error on the surgically induced sphere of 0.38D one day postoperatively and 0.19D 30 days postoperatively. The standard deviation of the surgically induced cylinder was 0.54D at the first postoperative day and 0.38D 30 days postoperatively. The prediction errors in surface elevation and curvature were below the topography measurement device accuracy of ±5μm and ±0.25D after the 30-day follow-up. The results showed that finite element simulations of corneal biomechanics are able to predict post cataract surgery within topography measurement device accuracy. We can conclude that the numerical simulation can become a valuable tool to plan corneal incisions in cataract surgery and other ophthalmosurgical procedures in order to optimize patients' refractive outcome and visual function.

Software Engineering for Self-Adaptive Systems: A Second Research Roadmap

The goal of this roadmap paper is to summarize the state-of-the-art and identify research challenges when developing, deploying and managing self-adaptive software systems. Instead of dealing with a wide range of topics associated with the field, we focus on four essential topics of self-adaptation: design space for self-adaptive solutions, software engineering processes for self-adaptive systems, from centralized to decentralized control, and practical run-time verification & validation for self-adaptive systems. For each topic, we present an overview, suggest future directions, and focus on selected challenges. This paper complements and extends a previous roadmap on software engineering for self-adaptive systems published in 2009 covering a different set of topics, and reflecting in part on the previous paper. This roadmap is one of the many results of the Dagstuhl Seminar 10431 on Software Engineering for Self-Adaptive Systems, which took place in October 2010.

C-14 Measurements of Ice Samples from the Juvfonne Ice Tunnel, Jotunheimen, Southern Norway-Validation of a C-14 Dating Technique for Glacier Ice

Establishing precise age-depth relationships of high-alpine ice cores is essential in order to deduce conclusive paleoclimatic information from these archives. Radiocarbon dating of carbonaceous aerosol particles incorporated in such glaciers is a promising tool to gain absolute ages, especially from the deepest parts where conventional methods are commonly inapplicable. In this study, we present a new validation for a published C-14 dating method for ice cores. Previously C-14-dated horizons of organic material from the Juvfonne ice patch in central southern Norway (61.676 degrees N, 8.354 degrees E) were used as reference dates for adjacent ice layers, which were C-14 dated based on their particulate organic carbon (POC) fraction. Multiple measurements were carried out on 3 sampling locations within the ice patch featuring modern to multimillennial ice. The ages obtained from the analyzed samples were in agreement with the given age estimates. In addition to previous validation work, this independent verification gives further confidence that the investigated method provides the actual age of the ice.

Design of SOA services: experiences from industry

Because of the unknown usage scenarios, designing the elementary services of a service-oriented architecture (SOA), which form the basis for later composition, is rather difficult. Various design guide lines have been proposed by academia, tool vendors and consulting companies, but they differ in the rigor of validation and are often biased toward some technology. For that reason a multiple-case study was conducted in five large organizations that successfully introduced SOA in their daily business. The observed approaches are contrasted with the findings from a literature review to derive some recommendations for SOA service design.

Software-based detection of atrial fibrillation in long-term ECGs

Background Atrial fibrillation (AF) is common and may have severe consequences. Continuous long-term electrocardiogram (ECG) is widely used for AF screening. Recently, commercial ECG analysis software was launched, which automatically detects AF in long-term ECGs. It has been claimed that such tools offer reliable AF screening and save time for ECG analysis. However, this has not been investigated in a real-life patient cohort. Objective To investigate the performance of automatic software-based screening for AF in long-term ECGs. Methods Two independent physicians manually screened 22,601 hours of continuous long-term ECGs from 150 patients for AF. Presence, number, and duration of AF episodes were registered. Subsequently, the recordings were screened for AF by an established ECG analysis software (Pathfinder SL), and its performance was validated against the thorough manual analysis (gold standard). Results Sensitivity and specificity for AF detection was 98.5% (95% confidence interval 91.72%–99.96%) and 80.21% (95% confidence interval 70.83%–87.64%), respectively. Software-based AF detection was inferior to manual analysis by physicians (P < .0001). Median AF duration was underestimated (19.4 hours vs 22.1 hours; P < .001) and median number of AF episodes was overestimated (32 episodes vs 2 episodes; P < .001) by the software. In comparison to extensive quantitative manual ECG analysis, software-based analysis saved time (2 minutes vs 19 minutes; P < .001). Conclusion Owing to its high sensitivity and ability to save time, software-based ECG analysis may be used as a screening tool for AF. An additional manual confirmatory analysis may be required to reduce the number of false-positive findings.

Validation of stress magnetic resonance imaging of the canine stifle joint with and without an intact cranial cruciate ligament.

OBJECTIVE To validate use of stress MRI for evaluation of stifle joints of dogs with an intact or deficient cranial cruciate ligament (CrCL). SAMPLE 10 cadaveric stifle joints from 10 dogs. PROCEDURES A custom-made limb-holding device and a pulley system linked to a paw plate were used to apply axial compression across the stifle joint and induce cranial tibial translation with the joint in various degrees of flexion. By use of sagittal proton density-weighted MRI, CrCL-intact and deficient stifle joints were evaluated under conditions of loading stress simulating the tibial compression test or the cranial drawer test. Medial and lateral femorotibial subluxation following CrCL transection measured under a simulated tibial compression test and a cranial drawer test were compared. RESULTS By use of tibial compression test MRI, the mean ± SD cranial tibial translations in the medial and lateral compartments were 9.6 ± 3.7 mm and 10 ± 4.1 mm, respectively. By use of cranial drawer test MRI, the mean ± SD cranial tibial translations in the medial and lateral compartments were 8.3 ± 3.3 mm and 9.5 ± 3.5 mm, respectively. No significant difference in femorotibial subluxation was found between stress MRI techniques. Femorotibial subluxation elicited by use of the cranial drawer test was greater in the lateral than in the medial compartment. CONCLUSIONS AND CLINICAL RELEVANCE Both stress techniques induced stifle joint subluxation following CrCL transection that was measurable by use of MRI, suggesting that both methods may be further evaluated for clinical use.

BrainCheck - a very brief tool to detect incipient cognitive decline: optimized case-finding combining patient- and informant-based data.

INTRODUCTION Optimal identification of subtle cognitive impairment in the primary care setting requires a very brief tool combining (a) patients' subjective impairments, (b) cognitive testing, and (c) information from informants. The present study developed a new, very quick and easily administered case-finding tool combining these assessments ('BrainCheck') and tested the feasibility and validity of this instrument in two independent studies. METHODS We developed a case-finding tool comprised of patient-directed (a) questions about memory and depression and (b) clock drawing, and (c) the informant-directed 7-item version of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). Feasibility study: 52 general practitioners rated the feasibility and acceptance of the patient-directed tool. Validation study: An independent group of 288 Memory Clinic patients (mean ± SD age = 76.6 ± 7.9, education = 12.0 ± 2.6; 53.8% female) with diagnoses of mild cognitive impairment (n = 80), probable Alzheimer's disease (n = 185), or major depression (n = 23) and 126 demographically matched, cognitively healthy volunteer participants (age = 75.2 ± 8.8, education = 12.5 ± 2.7; 40% female) partook. All patient and healthy control participants were administered the patient-directed tool, and informants of 113 patient and 70 healthy control participants completed the very short IQCODE. RESULTS Feasibility study: General practitioners rated the patient-directed tool as highly feasible and acceptable. Validation study: A Classification and Regression Tree analysis generated an algorithm to categorize patient-directed data which resulted in a correct classification rate (CCR) of 81.2% (sensitivity = 83.0%, specificity = 79.4%). Critically, the CCR of the combined patient- and informant-directed instruments (BrainCheck) reached nearly 90% (that is 89.4%; sensitivity = 97.4%, specificity = 81.6%). CONCLUSION A new and very brief instrument for general practitioners, 'BrainCheck', combined three sources of information deemed critical for effective case-finding (that is, patients' subject impairments, cognitive testing, informant information) and resulted in a nearly 90% CCR. Thus, it provides a very efficient and valid tool to aid general practitioners in deciding whether patients with suspected cognitive impairments should be further evaluated or not ('watchful waiting').

Two-dimensional and three-dimensional oxygen mapping by 3He-MRI validation in a lung phantom

The aim of this study was to validate oxygen-sensitive 3He-MRI in noninvasive determination of the regional, two- and three-dimensional distribution of oxygen partial pressure. In a gas-filled elastic silicon ventilation bag used as a lung phantom, oxygen sensitive two- and three-dimensional 3He-MRI measurements were performed at different oxygen concentrations which had been equilibrated in a range of normal and pathologic values. The oxygen partial pressure distribution was determined from 3He-MRI using newly developed software allowing for mapping of oxygen partial pressure. The reference bulk oxygen partial pressure inside the phantom was measured by conventional respiratory gas analysis. In two-dimensional measurements, image-based and gas-analysis results correlated with r=0.98; in three-dimensional measurements the between-methods correlation coefficient was r=0.89. The signal-to-noise ratio of three-dimensional measurements was about half of that of two-dimensional measurements and became critical (below 3) in some data sets. Oxygen-sensitive 3He-MRI allows for noninvasive determination of the two- and three-dimensional distribution of oxygen partial pressure in gas-filled airspaces.

How Do Software Architects Specify and Validate Quality Requirements?

Software architecture is the result of a design effort aimed at ensuring a certain set of quality attributes. As we show, quality requirements are commonly specified in practice but are rarely validated using automated techniques. In this paper we analyze and classify commonly specified quality requirements after interviewing professionals and running a survey. We report on tools used to validate those requirements and comment on the obstacles encountered by practitioners when performing such activity (e.g., insufficient tool-support; poor understanding of users needs). Finally we discuss opportunities for increasing the adoption of automated tools based on the information we collected during our study (e.g., using a business-readable notation for expressing quality requirements; increasing awareness by monitoring non-functional aspects of a system).