Pre-validation methods for developing a patient reported outcome instrument

BACKGROUND: Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology.

METHODS: The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains.

RESULTS: The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items.

CONCLUSIONS: This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.

Multiscale simulation of nanometric cutting of single crystal copper and its experimental validation

In this paper a multiscale simulation study was carried out in order to gain in-depth understanding of machining mechanism of nanometric cutting of single crystal copper. This study was focused on the effects of crystal orientation and cutting direction on the attainable machined surface quality. The machining mechanics was analyzed through cutting forces, chip formation morphology, generation and evolution of defects and residual stresses on the machined surface. The simulation results showed that the crystal orientation of the copper material and the cutting direction significantly influenced the deformation mechanism of the workpiece materials during the machining process. Relatively lower cutting forces were experienced while selecting crystal orientation family {1 1 1}. Dislocation movements were found to concentrate in front of the cutting chip while cutting on the (1 1 1) surface along the View the MathML source cutting direction thus, resulting in much smaller damaged layer on the machined surface, compared to other orientations. This crystal orientation and cutting direction therefore recommended for nanometric cutting of single crystal copper in practical applications. A nano-scratching experiment was performed to validate the above findings.

Development and Validation of a PulseNet Standardized Protocol for Subtyping Isolates of Cronobacter Species

Cronobacter (formerly known as Enterobacter sakazakii) is a genus comprising seven species regarded as opportunistic pathogens that can be found in a wide variety of environments and foods, including powdered infant formula (PIF). Cronobacter sakazakii, the major species of this genus, has been epidemiologically linked to cases of bacteremia, meningitis in neonates, and necrotizing enterocolitis, and contaminated PIF has been identified as an important source of infection. Robust and reproducible subtyping methods are required to aid in the detection and investigation, of foodborne outbreaks. In this study, a pulsed-field gel electrophoresis (PFGE) protocol was developed and validated for subtyping Cronobacter species. It was derived from an existing modified PulseNet protocol, wherein XbaI and SpeI were the primary and secondary restriction enzymes used, generating an average of 14.7 and 20.3 bands, respectively. The PFGE method developed was both reproducible and discriminatory for subtyping Cronobacter species.

Nakagami-m Phase Model: Further Results and Validation

This paper contributes to and expands on the Nakagami-m phase model. It derives exact, closed-form expressions for both the phase cumulative distribution function and its inverse. In addition, empirical first- and second-order statistics obtained from measurements conducted in a body-area network scenario were used to fit the phase probability density function, the phase cumulative distribution function, and the phase crossing rate expressions. Remarkably, the unlikely shapes of the phase statistics, as predicted by the theoretical formulations, are actually encountered in practice.

Validation of Next Generation Sequencing Technologies in Comparison to Current Diagnostic Gold Standards for BRAF, EGFR and KRAS Mutational Analysis

Next Generation Sequencing (NGS) has the potential of becoming an important tool in clinical diagnosis and therapeutic decision-making in oncology owing to its enhanced sensitivity in DNA mutation detection, fast-turnaround of samples in comparison to current gold standard methods and the potential to sequence a large number of cancer-driving genes at the one time. We aim to test the diagnostic accuracy of current NGS technology in the analysis of mutations that represent current standard-of-care, and its reliability to generate concomitant information on other key genes in human oncogenesis. Thirteen clinical samples (8 lung adenocarcinomas, 3 colon carcinomas and 2 malignant melanomas) already genotyped for EGFR, KRAS and BRAF mutations by current standard-of-care methods (Sanger Sequencing and q-PCR), were analysed for detection of mutations in the same three genes using two NGS platforms and an additional 43 genes with one of these platforms. The results were analysed using closed platform-specific proprietary bioinformatics software as well as open third party applications. Our results indicate that the existing format of the NGS technology performed well in detecting the clinically relevant mutations stated above but may not be reliable for a broader unsupervised analysis of the wider genome in its current design. Our study represents a diagnostically lead validation of the major strengths and weaknesses of this technology before consideration for diagnostic use.

Development and Validation of a Compact Thermal Model for an Aircraft Compartment

The development of accurate structural/thermal numerical models of complex systems, such as aircraft fuselage barrels, is often limited and determined by the smallest scales that need to be modelled. The development of reduced order models of the smallest scales and consequently their integration with higher level models can be a way to minimise the bottle neck present, while still having efficient, robust and accurate numerical models. In this paper a methodology on how to develop compact thermal fluid models (CTFMs) for compartments where mixed convection regimes are present is demonstrated. Detailed numerical simulations (CFD) have been developed for an aircraft crown compartment and validated against experimental data obtained from a 1:1 scale compartment rig. The crown compartment is defined as the confined area between the upper fuselage and the passenger cabin in a single aisle commercial aircraft. CFD results were utilised to extract average quantities (temperature and heat fluxes) and characteristic parameters (heat transfer coefficients) to generate CTFMs. The CTFMs have then been compared with the results obtained from the detailed models showing average errors for temperature predictions lower than 5%. This error can be deemed acceptable when compared to the nominal experimental error associated with the thermocouple measurements.

The CTFMs methodology developed allows to generate accurate reduced order models where accuracy is restricted to the region of Boundary Conditions applied. This limitation arises from the sensitivity of the internal flow structures to the applied boundary condition set. CTFMs thus generated can be then integrated in complex numerical modelling of whole fuselage sections.

Further steps in the development of an exhaustive methodology would be the implementation of a logic ruled based approach to extract directly from the CFD simulations numbers and positions of the nodes for the CTFM.

Molecular Validation of the Schizophrenia Spectrum

Background: Early descriptive work and controlled family and adoption studies support the hypothesis that a range of personality and nonschizophrenic psychotic disorders aggregate in families of schizophrenic probands. Can we validate, using molecular polygene scores from genome-wide association studies (GWAS), this schizophrenia spectrum? Methods: The predictive value of polygenic findings reported by the Psychiatric GWAS Consortium (PGC) was applied to 4 groups of relatives from the Irish Study of High-Density Schizophrenia Families (ISHDSF; N = s) differing on their assignment within the schizophrenia spectrum. Genome-wide single nucleotide polymorphism data for affected and unaffected relatives were used to construct per-individual polygene risk scores based on the PGC stage-I results. We compared mean polygene scores in the ISHDSF with mean scores in ethnically matched population controls (N = 929). Results: The schizophrenia polygene score differed significantly across diagnostic categories and was highest in those with narrow schizophrenia spectrum, lowest in those with no psychiatric illness, and in-between in those classified in the intermediate, broad, and very broad schizophrenia spectrum. Relatives of all of these groups of affected subjects, including those with no diagnosis, had schizophrenia polygene scores significantly higher than the control sample. Conclusions: In the relatives of high-density families, the observed pattern of enrichment of molecular indices of schizophrenia risk suggests an underlying, continuous liability distribution and validates, using aggregate common risk alleles, a genetic basis for the schizophrenia spectrum disorders. In addition, as predicted by genetic theory, nonpsychotic members of multiply-affected schizophrenia families are significantly enriched for replicated, polygenic risk variants compared with the general population.

Validation study to compare effects of processing protocols on measured Nε_(carboxymethyl)lysine and Nε_(carboxyethyl)lysine in blood.

Epidemiological studies show that elevated plasma levels of advanced glycation end products (AGEs) are associated with diabetes, kidney disease, and heart disease. Thus AGEs have been used as disease progression markers. However, the effects of variations in biological sample processing procedures on the level of AGEs in plasma/serum samples have not been investigated. The objective of this investigation was to assess the effect of variations in blood sample collection on measured Ne_(carboxy-methyl)lysine (CML), the best characterised AGE, and its homolog, Ne_(carboxyethyl)lysine (CEL). The investigation examined the effect on CML and CEL of different blood collection tubes, inclusion of a stabilising cocktail, effect of freeze thaw cycles, different storage times and temperatures, and effects of delaying centrifugation on a pooled sample from healthy volunteers. CML and CEL were measured in extracted samples by ultra_performance liquid chromatography-tandem mass spectrometry. Median CML and CEL ranged from 0.132 to 0.140 mM/M lys and from 0.053 to 0.060 mM/M lys, respectively. No significant difference was shown CML or CEL in plasma/serum samples. Therefore samples collected as part of epidemiological studies that do not undergo specific sample treatment at collection are suitable for measuring CML and CEL.

Single-laboratory validation of a multiplex flow cytometric immunoassay for the simultaneous detection of coccidiostats in eggs and feed

Coccidiostats are authorized in the European Union (EU) to be used as poultry feed additives. Maximum (residue) levels (M(R)Ls) have been set within the EU for consumer and animal protection against unintended carry-over, and monitoring is compulsory. This paper describes the single-laboratory validation of a previously developed multiplex flow cytometric immunoassay (FCIA) as screening method for coccidiostats in eggs and feed and provides and compares different approaches for the calculation of the cut-off levels which are not described in detail within Commission Decision 2002/657/EC. Comparable results were obtained between the statistical (reference) approach and the rapid approaches. With the most rapid approach, the cut-off levels for narasin/salinomycin, lasalocid, diclazuril, nicarbazin (DNC) and monensin in egg, calculated as percentages of inhibition (%B/B0), were 60, 32, 76, 80 and 84, respectively. In feed, the cut-off levels for narasin/salinomycin, lasalocid, nicarbazin (DNC) and monensin were 70, 64, 72 and 78, respectively, and could not be determined for diclazuril. For all analytes, except for diclazuril in feed, the rate of false positives (false non-compliant) in blank samples was lower than 1 %, and the rate of false negatives (false compliant) at the M(R)Ls was below 5 %. Additionally, very good correlations (r ranging from 0.994 to 0.9994) were observed between two different analysers, a sophisticated flow cytometer (FlexMAP 3D(®)) and a more cost-efficient and transportable planar imaging detector (MAGPIX(®)), hence demonstrating adequate transferability.

Development and single laboratory validation of an optical biosensor assay for tetrodotoxin detection as a tool to combat emerging risks in European seafood

Tetrodotoxin (TTX) is a potent neurotoxin emerging in European waters due to increasing ocean temperatures. Its detection in seafood is currently performed as a consequence of using the Association of Analytical Communities (AOAC) mouse bioassay (MBA) for paralytic shellfish poisoning (PSP) toxins, but TTX is not monitored routinely in Europe. Due to ethical and performance-related issues associated with this bioassay, the European Commission has recently published directives extending procedures that may be used for official PSP control. An AOAC-accredited high-performance liquid chromatography (HPLC) method has now been accepted by the European Union as a first action screening method for PSP toxins to replace the MBA. However, this AOAC HPLC method is not capable of detecting TTX, so this potent toxin would be undetected; thereby, a separate method of analysis is required. Surface plasmon resonance (SPR) optical biosensor technology has been proven as a potential alternative screening method to detect PSP toxins in seafood. The addition of a similar SPR inhibition assay for TTX would complement the PSP assay in removing the MBA. The present report describes the development and single laboratory validation in accordance with AOAC and IUPAC guidelines of an SPR method to be used as a rapid screening tool to detect TTX in the sea snail Charonia lampas lampas, a species which has been implicated in 2008 in the first case of human TTX poisoning in Europe. As no current regulatory limits are set for TTX in Europe, single laboratory validation was undertaken using those for PSP toxins at 800 µg/kg. The decision limit (CCa) was 100 µg/kg, with the detection capability (CCß) found to be =200 µg/kg. Repeatability and reproducibility were assessed at 200, 400, and 800 µg/kg and showed relative standard deviations of 8.3, 3.8, and 5.4 % and 7.8, 8.3, and 3.7 % for both parameters at each level, respectively. At these three respective levels, the recovery of the assay was 112, 98, and 99 %.

Comparison of sample preparation methods, validation of an UPLC-MS/MS procedure for the quantification of tetrodotoxin present in marine gastropods and analysis of pufferfish

Tetrodotoxin (TTX) is one of the most potent marine neurotoxins reported. The global distribution of this toxin is spreading with the European Atlantic coastline now being affected. Climate change and increasing pollution have been suggested as underlying causes for this. In the present study, two different sample preparation techniques were used to extract TTX from Trumpet shells and pufferfish samples. Both extraction procedures (accelerated solvent extraction (ASE) and a simple solvent extraction) were shown to provide good recoveries (80-92%). A UPLC-MS/MS method was developed for the analysis of TTX and validated following the guidelines contained in the Commission Decision 2002/657/EC for chemical contaminant analysis. The performance of this procedure was demonstrated to be fit for purpose. This study is the first report on the use of ASE as a mean for TTX extraction, the use of UPLC-MS/MS for TTX analysis, and the validation of this method for TTX in gastropods.

Development and validation of the first high performance-lateral flow immunoassay (HP-LFIA) for the rapid screening of domoic acid from shellfish extracts

A lateral flow immunoassay (LFIA) has been developed and fully validated to detect the primary amnesic shellfish poisoning (ASP) toxin, domoic acid (DA). The performance characteristics of two versions of the test were investigated using spiked and naturally contaminated shellfish (mussels, scallops, oysters, clams, and cockles). The tests provide a qualitative result, to indicate the absence or presence of DA in extracts of shellfish tissues, at concentrations that are relevant to regulatory limits. The new rapid assay (LFIA version 2) was designed to overcome the performance limitations identified in the first version of the assay. The improved test uses an electronic reader to remove the subjective nature of the generated results, and the positive cut-off for screening of DA in shellfish was increased from 10 ppm (version 1) to 17.5 ppm (version 2). A simple extraction and test procedure was employed, which required minimal equipment and materials; results were available 15 min after sample preparation. Stability of the aqueous extracts at room temperature (22 C) at four time points (up to 245 min after extraction) and across a range of DA concentrations was 100.3±1.3% and 98.8±2.4% for pre- and post-buffered extracts, respectively. The assay can be used both within laboratory settings and in remote locations. The accuracy of the new assay, to indicate negative results at or below 10 ppm DA, and positive results at or above 17.5 ppm, was 99.5% (n=216 tests). Validation data were obtained from a 2-day, randomised, blind study consisting of multiple LFIA lots (n=3), readers (n=3) and operators (n=3), carrying out multiple extractions of mussel tissue (n=3) at each concentration (0, 10, 17.5, and 20 ppm). No matrix effects were observed on the performance of the assay with different species (mussels, scallops, oysters, clams, and cockles). There was no impact on accuracy or interference from other phycotoxins, glutamic acid or glutamine with various strip incubations (8, 10, and 12 min). The accuracy of the assay, using naturally contaminated samples to indicate negative results at or below 12.5 ppm and positive results at or above 17.5 ppm, was 100%. Variability between three LFIA lots across a range of DA concentrations, expressed as coefficient of variation (% CV), was 1.1±0.4% (n=2 days) based on quantitative readings from the electronic reader. During an 8 week stability study, accuracy of the method with test strips stored at various temperatures (6, 22, 37 and 50 C) was 100%. Validation for both versions included comparisons with results obtained using reference LC-UV methods. © 2013 Elsevier B.V.

Nanoindentation of polysilicon and single crystal silicon: Molecular dynamics simulation and experimental validation

This paper presents novel advances on the deformation behaviour of polycrystalline and single crystal silicon using molecular dynamics (MD) simulation and validation of the same via nanoindentation experiments. In order to unravel the mechanism of deformation, four simulations were performed: Indentation of polycrystalline silicon substrate with a (i) Berkovich pyramidal and a (ii) spherical (arc) indenter, and indentation of a single crystal silicon substrate with these two indenters. The simulation results reveal that high pressure phase transformation (HPPT) in silicon (Si-I to Si-II phase transformation) occurred in all cases, however, its extent and the manner in which it occurred differed significantly between polycrystalline silicon and single crystal silicon, and was the main driver of differences in nanoindentation deformation behaviour between the two types of silicon. An interesting observation was that in polycrystalline silicon, the HPPT was observed to occur preferentially along the grain boundaries than across the grain boundaries. An automated dislocation extraction algorithm (DXA) revealed no dislocations in the deformation zone, suggesting HPPT to be the primary mechanism in inducing plasticity in silicon.

Development and validation of a rapid multiplex ELISA for pyrrolizidine alkaloids and their N-oxides in honey and feed Rapid Detection in Food and Feed

Pyrrolizidine alkaloids (PAs) are a group of plant secondary metabolites with carcinogenic and hepatotoxic properties. When PA-producing plants contaminate crops, toxins can be transferred through the food chain and cause illness in humans and animals, most notably hepatic veno-occlusive disease. Honey has been identified as a direct risk of human exposure. The European Food Safety Authority has recently identified four groups of PAs that are of particular importance for food and feed: senecionine-type, lycopsamine-type, heliotrine-type and monocrotaline-type. Liquid or gas chromatography methods are currently used to detect PAs but there are no rapid screening assays available commercially. Therefore, the aim of this study was to develop a rapid multiplex ELISA test for the representatives of three groups of alkaloids (senecionine, lycopsamine and heliotrine types) that would be used as a risk-management tool for the screening of these toxic compounds in food and feed. The method was validated for honey and feed matrices and was demonstrated to have a detection capability less than 25 µg/kg for jacobine, lycopsamine, heliotrine and senecionine. The zinc reduction step introduced to the extraction procedure allows for the additional detection of the presence of N-oxides of PAs. This first multiplex immunoassay for PA detection with N-oxide reduction can be used for the simultaneous screening of 21 samples for >12 PA analytes. Honey samples (n?=?146) from various origins were analysed for PA determination. Six samples were determined to contain measurable PAs >25 µg/kg by ELISA which correlated to >10 µg/kg by LC-MS/MS.

External validation of the OHTS-EGPS model for predicting the 5-year risk of open-angle glaucoma in ocular hypertensives

To independently evaluate and compare the performance of the Ocular Hypertension Treatment Study-European Glaucoma Prevention Study (OHTS-EGPS) prediction equation for estimating the 5-year risk of open-angle glaucoma (OAG) in four cohorts of adults with ocular hypertension.