Precision-recall operating characteristic (P-ROC) curves in imprecise environments

Traditionally, machine learning algorithms have been evaluated in applications where assumptions can be reliably made about class priors and/or misclassification costs. In this paper, we consider the case of imprecise environments, where little may be known about these factors and they may well vary significantly when the system is applied. Specifically, the use of precision-recall analysis is investigated and compared to the more well known performance measures such as error-rate and the receiver operating characteristic (ROC). We argue that while ROC analysis is invariant to variations in class priors, this invariance in fact hides an important factor of the evaluation in imprecise environments. Therefore, we develop a generalised precision-recall analysis methodology in which variation due to prior class probabilities is incorporated into a multi-way analysis of variance (ANOVA). The increased sensitivity and reliability of this approach is demonstrated in a remote sensing application.

Intercepting a moving target: effects of temporal precision constraints and movement amplitude

The effects of temporal precision constraints and movement amplitude on performance of an interceptive aiming task were examined. Participants were required to strike a moving target object with a 'bat' by moving the bat along a straight path (constrained by a linear slide) perpendicular to the path of the target. Temporal precision constraints were defined in terms of the time period (or window) within which contact with the target was possible. Three time windows were used (approx. 35, 50 and 65 ms) and these were achieved either by manipulating the size of the bat (experiment 1a), the size of the target (experiment 1b) or the speed of the target (experiment 2). In all experiments, movement time (MT) increased in proportion to movement amplitude but was only affected by differences in the temporal precision constraint if this was achieved by variation in the target's speed. In this case the MT was approximately inversely proportional to target speed. Peak movement speed was affected by temporal accuracy constraints in all three experiments: participants reached higher speeds when the temporal precision required was greater. These results are discussed with reference to the speed-accuracy trade-off observed for temporally constrained aiming movements. It is suggested that the MT and speed of interceptive aiming movements may be understood as responses to the spatiotemporal constraints of the task.

Compact tiled display with uniform illumination

The demand for more pixels is beginning to be met as manufacturers increase the native resolution of projector chips. Tiling several projectors still offers a solution to augment the pixel capacity of a display. However, problems of color and illumination uniformity across projectors need to be addressed as well as the computer software required to drive such devices. We present the results obtained on a desktop-size tiled projector array of three D-ILA projectors sharing a common illumination source. A short throw lens (0.8:1) on each projector yields a 21-in. diagonal for each image tile; the composite image on a 3×1 array is 3840×1024 pixels with a resolution of about 80 dpi. The system preserves desktop resolution, is compact, and can fit in a normal room or laboratory. The projectors are mounted on precision six-axis positioners, which allow pixel level alignment. A fiber optic beamsplitting system and a single set of red, green, and blue dichroic filters are the key to color and illumination uniformity. The D-ILA chips inside each projector can be adjusted separately to set or change characteristics such as contrast, brightness, or gamma curves. The projectors were then matched carefully: photometric variations were corrected, leading to a seamless image. Photometric measurements were performed to characterize the display and are reported here. This system is driven by a small PC cluster fitted with graphics cards and running Linux. It can be scaled to accommodate an array of 2×3 or 3×3 projectors, thus increasing the number of pixels of the final image. Finally, we present current uses of the display in fields such as astrophysics and archaeology (remote sensing).

Creating proactive interference in immediate recall: Building a DOG from a DART, a MOP, and a FIG

Phonemic codes are accorded a privileged role in most current models of immediate serial recall, although their effects are apparent in short-term proactive interference (PI) effects as well. The present research looks at how assumptions concerning distributed representation and distributed storage involving both semantic and phonemic codes might be operationalized to produce PI in a short-term cued recall task. The four experiments reported here attempted to generate the phonemic characteristics of a nonrhyming, interfering foil from unrelated filler items in the same list. PI was observed when a rhyme of the foil was studied or when the three phonemes of the foil were distributed across three studied filler items. The results suggest that items in short-term memory are stored in terms of feature bundles and that all items are simultaneously available at retrieval.

Extended delayed recall of AVLT word lists: Effects of age and sex on adult performance

An extension of a previous study of age and sex effects on verbal recall (Geffen, Moar, O'Hanlon, lark, & Geffen, 1990) examined forgetting of words over extended delays. The AVLT was administered to 201 normal adults (99 males, 102 females) ranging in age between 20 and 59 years. Recall was tested at intervals of 30 minutes, 24 hours, and 7 days after acquisition. Testing of the latter two intervals was conducted by telephone (Experiment 1, N = 177). After 30 minutes there was no significant loss of the 10 to 11 words retained from five acquisition trials. However, an overall mean of about one word was forgotten after 1 day and a further word after 7 days. The oldest age group (50-59 years) acquired fewer words and forgot more words than the younger groups. Females of all age groups performed slightly better than males at acquisition, at retention, and at recall after longer delays. A second experiment showed that telephone testing at the longer delay intervals was equivalent to testing face to face. These results extend the use of the AVLT by assessing memory decay beyond the immediate testing period. Telephone follow-up is a convenient and economical method of testing delayed recall.

Calcium accretion in girls and boys during puberty: A longitudinal analysis

The primary purpose of this study was to estimate the magnitude and variability of peak calcium accretion rates in the skeletons of healthy white adolescents. Total-body bone mineral content (BMC) was measured annually on six occasions by dual-energy X-ray absorptiometry (DXA; Hologic 2000, array mode), a BMC velocity curve was generated for each child by a cubic spline fit, and peak accretion rates were determined. Anthropometric measures were collected every 6 months and a 24-h dietary recall was recorded two to three times per year. Of the 113 boys and 115 girls initially enrolled in the study, 60 boys and 53 girls who had peak height velocity (PHV) and peak BMC velocity values were used in this longitudinal analysis. When the individual BR IC velocity curves were aligned on the age of peak bone mineral velocity, the resulting mean peak bone mineral accrual rate was 407 g/year for boys (SD, 92 g/year; range, 226-651 g/year) and 322 g/year for girls (SD, 66 g/year; range, 194-520 g/year). Using 32.2% as the fraction of calcium in bone mineral, as determined by neutron activation analysis (Ellis et al., J Bone Miner Res 1996;11:843-848), these corresponded to peak calcium accretion rates of 359 mg/day for boys (81 mg/day; 199-574 mg/day) and 284 mg/day for girls (58 mg/day; 171-459 mg/day). These longitudinal results are 27-34% higher than our previous cross-sectional analysis in which we reported mean values of 282 mg/day for boys and 212 mg/day for girls (Martin et al., Am J Clin Nutr 1997;66:611-615). Mean age of peak calcium accretion was 14.0 years for the boys (1.0 years; 12.0-15.9 years), and 12.5 years for the girls (0.9 years; 10.5-14.6 years). Dietary calcium intake, determined as the mean of all assessments up to the age of peak accretion was 1140 mg/day (SD, 392 mg/day) for boys and 1113 mg/day (SD, 378 mg/day) for girls. We estimate that 26% of adult calcium is laid down during the 2 adolescent years of peak skeletal growth. This period of rapid growth requires high accretion rates of calcium, achieved in part by increased retention efficiency of dietary calcium.

The Las Campanas/AAT rich cluster survey - I. Precision and reliability of the photometric catalogue

The Las Campanas Observatory and Anglo-Australian Telescope Rich Cluster Survey (LARCS) is a panoramic imaging and spectroscopic survey of an X-ray luminosity-selected sample of 21 clusters of galaxies at 0.07 < z < 0.16. Charge-coupled device (CCD) imaging was obtained in B and R of typically 2 degrees wide regions centred on the 21 clusters, and the galaxy sample selected from the imaging is being used for an on-going spectroscopic survey of the clusters with the 2dF spectrograph on the Anglo-Australian Telescope. This paper presents the reduction of the imaging data and the photometric analysis used in the survey. Based on an overlapping area of 12.3 deg(2) we compare the CCD-based LARCS catalogue with the photographic-based galaxy catalogue used for the input to the 2dF Galaxy Redshift Survey (2dFGRS) from the APM, to the completeness of the GRS/APM catalogue, b(J) = 19.45. This comparison confirms the reliability of the photometry across our mosaics and between the clusters in our survey. This comparison also provides useful information concerning the properties of the GRS/APM. The stellar contamination in the GRS/APM galaxy catalogue is confirmed as around 5-10 per cent, as originally estimated. However, using the superior sensitivity and spatial resolution in the LARCS survey evidence is found for four distinct populations of galaxies that are systematically omitted from the GRS/APM catalogue. The characteristics of the 'missing' galaxy populations are described, reasons for their absence examined and the impact they will have on the conclusions drawn from the 2dF Galaxy Redshift Survey are discussed.

Time evolution in the unimolecular master equation at low temperatures: full spectral solution with scalable iterative methods and high precision

A new method is presented to determine an accurate eigendecomposition of difficult low temperature unimolecular master equation problems. Based on a generalisation of the Nesbet method, the new method is capable of achieving complete spectral resolution of the master equation matrix with relative accuracy in the eigenvectors. The method is applied to a test case of the decomposition of ethane at 300 K from a microcanonical initial population with energy transfer modelled by both Ergodic Collision Theory and the exponential-down model. The fact that quadruple precision (16-byte) arithmetic is required irrespective of the eigensolution method used is demonstrated. (C) 2001 Elsevier Science B.V. All rights reserved.

Analytical validation for a series of marker compounds used to assess renal drug elimination processes

Renal drug elimination is determined by glomerular filtration, tubular secretion, and tubular reabsorption. Changes in the integrity of these processes influence renal drug clearance, and these changes may not be detected by conventional measures of renal function such as creatinine clearance. The aim of the current study was to examine the analytic issues needed to develop a cocktail of marker drugs (fluconazole, rac-pindolol, para-aminohippuric acid, sinistrin) to measure simultaneously the mechanisms contributing to renal clearance. High-performance liquid chromatographic methods of analysis for fluconazole, pindolol, para-aminohippuric acid, and creatinine and an enzymatic assay for sinistrin were developed or modified and then validated to allow determination of each of the compounds in both plasma and urine in the presence of all other marker drugs. A pilot clinical study in one volunteer was conducted to ensure that the assays were suitable for quantitating all the marker drugs to the sensitivity and specificity needed to allow accurate determination of individual renal clearances. The performance of all assays (plasma and urine) complied with published validation criteria. All standard curves displayed linearity over the concentration ranges required, with coefficients of correlation greater than 0.99. The precision of the interday and intraday variabilities of quality controls for each marker in plasma and urine were all less than 11.9% for each marker. Recoveries of markers (and internal standards) in plasma and urine were all at least 90%. All markers investigated were shown to be stable when plasma or urine was frozen and thawed. For all the assays developed, there were no interferences from other markers or endogenous substances. In a pilot clinical study, concentrations of all markers could be accurately and reproducibly determined for a sufficient duration of time after administration to calculate accurate renal clearance for each marker. This article presents details of the analytic techniques developed for measuring concentrations of marker drugs for different renal elimination processes administered as a single dose to define the processes contributing to renal drug elimination.

The number of rational points of a class of Artin-Schreier curves

We determine the number of F-q-rational points of a class of Artin-Schreier curves by using recent results concerning evaluations of some exponential sums. In particular, we determine infinitely many new examples of maximal and minimal plane curves in the context of the Hasse-Weil bound. (C) 2002 Elsevier Science (USA).

Applications of accurate, high-precision Pb isotope ratio measurement by multi-collector ICP-MS

The isotope composition of Ph is difficult to determine accurately due to the lack of a stable normalisation ratio. Double and triple-spike addition techniques provide one solution and presently yield the most accurate measurements. A number of recent studies have claimed that improved accuracy and precision could also be achieved by multi-collector ICP-MS (MC-ICP-MS) Pb-isotope analysis using the addition of Tl of known isotope composition to Pb samples. In this paper, we verify whether the known isotope composition of Tl can be used for correction of mass discrimination of Pb with an extensive dataset for the NIST standard SRM 981, comparison of MC-ICP-MS with TIMS data, and comparison with three isochrons from different geological environments. When all our NIST SRM 981 data are normalised with one constant Tl-205/Tl-203 of 2.38869, the following averages and reproducibilities were obtained: Pb-207/Pb-206=0.91461+/-18; Pb-208/Ph-206 = 2.1674+/-7; and (PbPh)-Pb-206-Ph-204 = 16.941+/-6. These two sigma standard deviations of the mean correspond to 149, 330, and 374 ppm, respectively. Accuracies relative to triple-spike values are 149, 157, and 52 ppm, respectively, and thus well within uncertainties. The largest component of the uncertainties stems from the Ph data alone and is not caused by differential mass discrimination behaviour of Ph and Tl. In routine operation, variation of sample introduction memory and production of isobaric molecular interferences in the spectrometer's collision cell currently appear to be the ultimate limitation to better reproducibility. Comparative study of five different datasets from actual samples (bullets, international rock standards, carbonates, metamorphic minerals, and sulphide minerals) demonstrates that in most cases geological scatter of the sample exceeds the achieved analytical reproducibility. We observe good agreement between TIMS and MC-ICP-MS data for international rock standards but find that such comparison does not constitute the ultimate. test for the validity of the MC-ICP-MS technique. Two attempted isochrons resulted in geological scatter (in one case small) in excess of analytical reproducibility. However, in one case (leached Great Dyke sulphides) we obtained a true isochron (MSWD = 0.63) age of 2578.3 +/- 0.9 Ma, which is identical to and more precise than a recently published U-Pb zircon age (2579 3 Ma) for a Great Dyke websterite [Earth Planet. Sci. Lett. 180 (2000) 1-12]. Reproducibility of this age by means of an isochron we regard as a robust test of accuracy over a wide dynamic range. We show that reliable and accurate Pb-isotope data can be obtained by careful operation of second-generation MC-ICP magnetic sector mass spectrometers. (C) 2002 Elsevier Science B.V. All rights reserved.

Temporal precision of interceptive action: differential effects of target size and speed

The duration of movements made to intercept moving targets decreases and movement speed increases when interception requires greater temporal precision. Changes in target size and target speed can have the same effect on required temporal precision, but the response to these changes differs: changes in target speed elicit larger changes in response speed. A possible explanation is that people attempt to strike the target in a central zone that does not vary much with variation in physical target size: the effective size of the target is relatively constant over changes in physical size. Three experiments are reported that test this idea. Participants performed two tasks: (1) strike a moving target with a bat moved perpendicular to the path of the target; (2) press on a force transducer when the target was in a location where it could be struck by the bat. Target speed was varied and target size held constant in experiment 1. Target speed and size were co-varied in experiment 2, keeping the required temporal precision constant. Target size was varied and target speed held constant in experiment 3 to give the same temporal precision as experiment 1. Duration of hitting movements decreased and maximum movement speed increased with increases in target speed and/or temporal precision requirements in all experiments. The effects were largest in experiment 1 and smallest in experiment 3. Analysis of a measure of effective target size (standard deviation of strike locations on the target) failed to support the hypothesis that performance differences could be explained in terms of effective size rather than actual physical size. In the pressing task, participants produced greater peak forces and shorter force pulses when the temporal precision required was greater, showing that the response to increasing temporal precision generalizes to different responses. It is concluded that target size and target speed have independent effects on performance.

Verbal recall after mild traumatic brain injury: Sensitivity of the rapid screen of concussion

The present study aimed to determine whether including a sensitive test of immediate and delayed recall would improve the diagnostic validity of the Rapid Screen of Concussion (RSC) in mild Traumatic Brain Injury (mTBI) versus orthopaedic clinical samples. Two studies were undertaken. In Study 1, the performance of 156 mTBI and 145 orthopaedic participants was analysed to identify the number of individuals who performed at ceiling on the verbal memory subtest of the RSC, as this test required immediate and delayed recall of only five words. A second aim was to determine the sensitivity and specificity levels of the RSC. Study 2 aimed to examine whether replacement of the verbal memory subtest with the 12-word Hopkins Verbal Learning Test (HVLT) could improve the sensitivity of the RSC in a new sample of 26 mTBI and 30 orthopaedic participants. Both studies showed that orthopaedic participants outperformed mTBI participants on each of the selected measures. Study 1 showed that 14% of mTBI participants performed at ceiling on the immediate and 21.2% on delayed recall test. Performance on the original battery yielded a sensitivity of 82%, specificity of 80% and overall correct classification of 81.5% participants. In Study 2, inclusion of the HVLT improved sensitivity to a level of 88.5%, decreased specificity to a level of 70% and resulted in an overall classification rate of 80%. It was concluded that although inclusion of the five-word subtest in the RSC can successfully distinguish concussed from non-concussed individuals, use of the HVLT in this protocol yields a more sensitive measure of subtle cognitive deficits following mTBI.