Problems with binary pattern measures for flood model evaluation

As the calibration and evaluation of flood inundation models are a prerequisite for their successful application, there is a clear need to ensure that the performance measures that quantify how well models match the available observations are fit for purpose. This paper evaluates the binary pattern performance measures that are frequently used to compare flood inundation models with observations of flood extent. This evaluation considers whether these measures are able to calibrate and evaluate model predictions in a credible and consistent way, i.e. identifying the underlying model behaviour for a number of different purposes such as comparing models of floods of different magnitudes or on different catchments. Through theoretical examples, it is shown that the binary pattern measures are not consistent for floods of different sizes, such that for the same vertical error in water level, a model of a flood of large magnitude appears to perform better than a model of a smaller magnitude flood. Further, the commonly used Critical Success Index (usually referred to as F<2 >) is biased in favour of overprediction of the flood extent, and is also biased towards correctly predicting areas of the domain with smaller topographic gradients. Consequently, it is recommended that future studies consider carefully the implications of reporting conclusions using these performance measures. Additionally, future research should consider whether a more robust and consistent analysis could be achieved by using elevation comparison methods instead.

Evaluation of reach and grasp robot-assisted therapy suggests similar functional recovery patterns on proximal and distal arm segments in sub-acute hemiplegia

This paper provides some additional evidence in support of the hypothesis that robot therapies are clinically beneficial in neurorehabilitation. Although only 4 subjects were included in the study, the design of the intervention and the measures were done so as to minimise bias. The results are presented as single case studies, and can only be interpreted as such due to the study size. The intensity of intervention was 16 hours and the therapy philosophy (based on Carr and Shepherd) was that coordinated movements are preferable to joint based therapies, and that coordinating distal movements (in this case grasps) helps not only to recover function in these areas, but has greater value since the results are immediately transferable to daily skills such as reach and grasp movements.

Evaluation of seven European aerosol optical depth retrieval algorithms for climate analysis

Satellite data are increasingly used to provide observation-based estimates of the effects of aerosols on climate. The Aerosol-cci project, part of the European Space Agency's Climate Change Initiative (CCI), was designed to provide essential climate variables for aerosols from satellite data. Eight algorithms, developed for the retrieval of aerosol properties using data from AATSR (4), MERIS (3) and POLDER, were evaluated to determine their suitability for climate studies. The primary result from each of these algorithms is the aerosol optical depth (AOD) at several wavelengths, together with the Ångström exponent (AE) which describes the spectral variation of the AOD for a given wavelength pair. Other aerosol parameters which are possibly retrieved from satellite observations are not considered in this paper. The AOD and AE (AE only for Level 2) were evaluated against independent collocated observations from the ground-based AERONET sun photometer network and against “reference” satellite data provided by MODIS and MISR. Tools used for the evaluation were developed for daily products as produced by the retrieval with a spatial resolution of 10 × 10 km2 (Level 2) and daily or monthly aggregates (Level 3). These tools include statistics for L2 and L3 products compared with AERONET, as well as scoring based on spatial and temporal correlations. In this paper we describe their use in a round robin (RR) evaluation of four months of data, one month for each season in 2008. The amount of data was restricted to only four months because of the large effort made to improve the algorithms, and to evaluate the improvement and current status, before larger data sets will be processed. Evaluation criteria are discussed. Results presented show the current status of the European aerosol algorithms in comparison to both AERONET and MODIS and MISR data. The comparison leads to a preliminary conclusion that the scores are similar, including those for the references, but the coverage of AATSR needs to be enhanced and further improvements are possible for most algorithms. None of the algorithms, including the references, outperforms all others everywhere. AATSR data can be used for the retrieval of AOD and AE over land and ocean. PARASOL and one of the MERIS algorithms have been evaluated over ocean only and both algorithms provide good results.

An introduction to the Chinese Evaluation Standard for the indoor thermal environment

Designing for indoor thermal environmental conditions is one of the key elements in the energy efficient building design process. This paper introduces a development of the Chinese national Evaluation Standard for indoor thermal environments (Evaluation Standard). International standards including the ASHRAE55, ISO7730, DIN EN, and CIBSE Guide-A have been reviewed and referenced for the development of the Evaluation Standard. In addition, over 28,000 subjects participated in the field study from different climate zones in China and over 500 subjects have been involved in laboratory studies. The research findings reveal that there is a need to update the Chinese thermal comfort standard based on local climates and people's habitats. This paper introduces in detail the requirements for the thermal environment for heated and cooled buildings and free-running buildings in China.

Statistical-dynamical downscaling for wind energy potentials: evaluation and applications to decadal hindcasts and climate change projections

A statistical–dynamical downscaling (SDD) approach for the regionalization of wind energy output (Eout) over Europe with special focus on Germany is proposed. SDD uses an extended circulation weather type (CWT) analysis on global daily mean sea level pressure fields with the central point being located over Germany. Seventy-seven weather classes based on the associated CWT and the intensity of the geostrophic flow are identified. Representatives of these classes are dynamically downscaled with the regional climate model COSMO-CLM. By using weather class frequencies of different data sets, the simulated representatives are recombined to probability density functions (PDFs) of near-surface wind speed and finally to Eout of a sample wind turbine for present and future climate. This is performed for reanalysis, decadal hindcasts and long-term future projections. For evaluation purposes, results of SDD are compared to wind observations and to simulated Eout of purely dynamical downscaling (DD) methods. For the present climate, SDD is able to simulate realistic PDFs of 10-m wind speed for most stations in Germany. The resulting spatial Eout patterns are similar to DD-simulated Eout. In terms of decadal hindcasts, results of SDD are similar to DD-simulated Eout over Germany, Poland, Czech Republic, and Benelux, for which high correlations between annual Eout time series of SDD and DD are detected for selected hindcasts. Lower correlation is found for other European countries. It is demonstrated that SDD can be used to downscale the full ensemble of the Earth System Model of the Max Planck Institute (MPI-ESM) decadal prediction system. Long-term climate change projections in Special Report on Emission Scenarios of ECHAM5/MPI-OM as obtained by SDD agree well to the results of other studies using DD methods, with increasing Eout over northern Europe and a negative trend over southern Europe. Despite some biases, it is concluded that SDD is an adequate tool to assess regional wind energy changes in large model ensembles.

Evaluation of boundary-layer type in a weather forecast model utilising long-term Doppler lidar observations

Many studies evaluating model boundary-layer schemes focus either on near-surface parameters or on short-term observational campaigns. This reflects the observational datasets that are widely available for use in model evaluation. In this paper we show how surface and long-term Doppler lidar observations, combined in a way to match model representation of the boundary layer as closely as possible, can be used to evaluate the skill of boundary-layer forecasts. We use a 2-year observational dataset from a rural site in the UK to evaluate a climatology of boundary layer type forecast by the UK Met Office Unified Model. In addition, we demonstrate the use of a binary skill score (Symmetric Extremal Dependence Index) to investigate the dependence of forecast skill on season, horizontal resolution and forecast leadtime. A clear diurnal and seasonal cycle can be seen in the climatology of both the model and observations, with the main discrepancies being the model overpredicting cumulus capped and decoupled stratocumulus capped boundary-layers and underpredicting well mixed boundary-layers. Using the SEDI skill score the model is most skillful at predicting the surface stability. The skill of the model in predicting cumulus capped and stratocumulus capped stable boundary layer forecasts is low but greater than a 24 hr persistence forecast. In contrast, the prediction of decoupled boundary-layers and boundary-layers with multiple cloud layers is lower than persistence. This process based evaluation approach has the potential to be applied to other boundary-layer parameterisation schemes with similar decision structures.

Intercomparison and evaluation of global aerosol microphysical properties among AeroCom models of a range of complexity

Many of the next generation of global climate models will include aerosol schemes which explicitly simulate the microphysical processes that determine the particle size distribution. These models enable aerosol optical properties and cloud condensation nuclei (CCN) concentrations to be determined by fundamental aerosol processes, which should lead to a more physically based simulation of aerosol direct and indirect radiative forcings. This study examines the global variation in particle size distribution simulated by 12 global aerosol microphysics models to quantify model diversity and to identify any common biases against observations. Evaluation against size distribution measurements from a new European network of aerosol supersites shows that the mean model agrees quite well with the observations at many sites on the annual mean, but there are some seasonal biases common to many sites. In particular, at many of these European sites, the accumulation mode number concentration is biased low during winter and Aitken mode concentrations tend to be overestimated in winter and underestimated in summer. At high northern latitudes, the models strongly underpredict Aitken and accumulation particle concentrations compared to the measurements, consistent with previous studies that have highlighted the poor performance of global aerosol models in the Arctic. In the marine boundary layer, the models capture the observed meridional variation in the size distribution, which is dominated by the Aitken mode at high latitudes, with an increasing concentration of accumulation particles with decreasing latitude. Considering vertical profiles, the models reproduce the observed peak in total particle concentrations in the upper troposphere due to new particle formation, although modelled peak concentrations tend to be biased high over Europe. Overall, the multi-model-mean data set simulates the global variation of the particle size distribution with a good degree of skill, suggesting that most of the individual global aerosol microphysics models are performing well, although the large model diversity indicates that some models are in poor agreement with the observations. Further work is required to better constrain size-resolved primary and secondary particle number sources, and an improved understanding of nucleation and growth (e.g. the role of nitrate and secondary organics) will improve the fidelity of simulated particle size distributions.

Subjective evaluation of experimental dyspnoea: effects of isocapnia and repeated exposure

Resistive respiratory loading is an established stimulus for the induction of experimental dyspnoea. In comparison to unloaded breathing, resistive loaded breathing alters end-tidal CO2 (PETCO2), which has independent physiological effects (e.g. upon cerebral blood flow). We investigated the subjective effects of resistive loaded breathing with stabilized PETCO2 (isocapnia) during manual control of inspired gases on varying baseline levels of mild hypercapnia increased PETCO2). Furthermore, to investigate whether perceptual habituation to dyspnoea stimuli occurs, the study was repeated over four experimental sessions. Isocapnic hypercapnia did not affect dyspnoea unpleasantness during resistive loading. A post hoc analysis revealed a small increase of respiratory unpleasantness during unloaded breathing at +0.6 kPa, the level that reliably induced isocapnia. We didnot observe perceptual habituation over the four sessions. We conclude that isocapnic respiratory loading allows stable induction of respiratory unpleasantness, making it a good stimulus for multi-session studies of dyspnoea.

Stopping rules for phase II studies

This paper, the second in a series of three papers concerned with the statistical aspects of interim analyses in clinical trials, is concerned with stopping rules in phase II clinical trials. Phase II trials are generally small-scale studies, and may include one or more experimental treatments with or without a control. A common feature is that the results primarily determine the course of further clinical evaluation of a treatment rather than providing definitive evidence of treatment efficacy. This means that there is more flexibility available in the design and analysis of such studies than in phase III trials. This has led to a range of different approaches being taken to the statistical design of stopping rules for such trials. This paper briefly describes and compares the different approaches. In most cases the stopping rules can be described and implemented easily without knowledge of the detailed statistical and computational methods used to obtain the rules.

Evaluation of directional microphone drift in digital hearing aids

The occurrence of directional microphone drift following hearing aid use has been infrequently examined. This study uses the front-to-side ratio to evaluate changes in directional microphone output from new behind-the-ear hearing aids and following approximately three months of hearing aid use. Results indicate no overall significant differences in the front-to-side ratio between initial and follow-up measurements.

Evaluation of three indices for biofilm accumulation on complete dentures

Objectives: The objective of this study was to evaluate the accuracy and reproducibility of three complete denture biofilm indices (Prosthesis Hygiene Index; Jeganathan et al. Index; Budtz-J circle divide rgensen Index) by means of a computerised comparison method. Background: Clinical studies into denture hygiene have employed a large number of biofilm indices among their outcome variables. However, the knowledge about the validity of these indices is still scarce. Materials and methods: Sixty-two complete denture wearers were selected. The internal surfaces of the upper complete dentures were stained (5% erythrosine) and photographed. The slides were projected on paper, and the biofilm indices were applied over the photos by means of a scoring method. For the computerised method, the areas (total and biofilm-covered) were measured by dedicated software (Image Tool). In addition, to compare the results of the computerised method and Prosthetic Hygiene Index, a new scoring scale (including four and five graded) was introduced. For the Jeganathan et al. and Budtz-J circle divide rgensen indices, the original scales were used. Values for each index were compared with the computerised method by the Friedman test. Their reproducibility was measured by means of weighed kappa. Significance for both tests was set at 0.05. Results: The indices tested provided similar mean measures but they tended to overestimate biofilm coverage when compared with the computerised method (p < 0.001). Agreement between the Prosthesis Hygiene Index and the computerised method was not significant, regardless of the scale used. Jeghanathan et al. Index showed weak agreement, and consistent results were found for Budtz-Jorgensen Index (kappa = 0.19 and 0.39 respectively). Conclusion: Assessment of accuracy for the biofilm indices showed instrument bias that was similar among the tested methods. Weak inter-instrument reproducibility was found for the indices, except for the Budtz-J circle divide rgensen Index. This should be the method of choice for clinical studies when more sophisticated approaches are not possible.

Evaluation of Low Intensity Laser Therapy In Myofascial Pain Syndrome

Limited studies have demonstrated that low intensity laser therapy (LILT) may have a therapeutic effect on the treatment of myofascial pain syndrome (MPS). Sixty (60) patients with MPS and having one active trigger point in the anterior masseter and anterior temporal muscles were selected and assigned randomly to six groups (n=10): Groups I to III were treated with GaAIAS (780 nm) laser, applied in continuous mode and in a meticulous way, twice a week, for four weeks. Energy was set to 25 J/cm(2), 60 J/cm2 and 105 J/cm2, respectively. Groups IV to VI were treated with placebo applications, simulating the same parameters as the treated groups. Pain scores were assessed just before, then immediately after the fourth application, immediately after the eighth application, at 15 days and one month following treatment. A significant pain reduction was observed over time (p<0.001). The analgesic effect of the LILT was similar to the placebo groups. Using the parameters described in this experiment, LILT was effective in reducing pain experienced by patients with myofascial pain syndrome. Thus, it was not possible to establish a treatment protocol. Analyzing the analgesic effect of LILT suggests it as a possible treatment of MPS and may help to establish a clinical protocol for this therapeutic modality.

Histologic Evaluation of the Buccal and Lingual Bone Plates in Anterior Dog Teeth: Possible Influence on Implant Dentistry

Background: Recent studies in animals have shown pronounced resorption of buccal bone plate after immediate implantation. The sectioning of experimental material for histologic evaluation of the bone plates could provide valuable information about the possible effect of bone exposure in periodontal and implant surgeries. Methods: Twenty-four incisors were collected from dogs. After decalcification, the blocks were immersed in paraffin and bucco-lingual histologic sections were examined under light microscope. Some sections were reserved for immunohistochemical analysis. Results: The bone density, the width of the bone plates, and the percentage of vessels presented in the periodontal ligament and periosteum were analyzed in the buccal and lingual bone plates, which were divided corono-apically into thirds. The buccal bone plates showed statistically higher bone density compared to the lingual bone plates in the coronal thirds. The width of both bone plates increased from the coronal to the apical third, but all the buccal thirds were significantly thinner compared to the lingual thirds. No statistically significant differences were found between the bone plates for the percentage of area occupied by the blood vessels in the periodontal ligament or periosteum. Conclusion: It is reasonable to conclude that the higher bone density, represented by the lower number of marrow spaces, in association with the thinner aspect of the buccal bone plates made them more fragile to absorb compared to the lingual bone plates, especially during mucoperiosteal procedures. J Periodontol 2017;82:872-877.

Evaluation on the effectiveness of actions for controlling infestation by rodents in Campo Limpo region, Sao Paulo Municipality, Brazil

Rodents are responsible for the transmission of more than 60 diseases both to human beings and to domestic animals. The increase in rodent infestation in a given area brings several health problems to the nearby population. Thus, when infestation increases, it is time to take intervention measures. Although many countries have implemented programs aimed at controlling rodent infestation, literature on studies evaluating the effectiveness of intervention measures in urban areas is scarce. Aimed at contributing to the understanding of rodents` population dynamics in urban areas, the objective of this study was to evaluate the effectiveness of the control methods proposed by ""Programa de Vigilancia e Controle de Roedores do Municipio de Sao Paulo`` (Program for Rodents Surveillance and Control in Sao Paulo Municipality), conducted on Jardim Comercial District. As a first step, a survey to assess infestation rates was conducted in 1529 dwellings located in the area studied. After that, a chemical control upon rodents was accomplished in every dwelling infested. One week and six months after completion of control measures, a new evaluation on infestation rates was carried out, in order to verify the effectiveness of the procedures taken and to estimate the re-infestation capacity. Initial infestation rate was 40.0%, and the final infestation rate, 14.4%. Therefore, the effectiveness of the control methods utilized was 63.8%. It can thus be concluded that the control methods applied were quite effective.

Evaluation of Quantitative RT-PCR Using Nonamplified and Amplified RNA

Quantitative reverse-transcription polymerase chain reaction (qRT-PCR) is a standard assay in molecular medicine for gene expression analysis. Samples from incisional/needle biopsies, laser-microdissected tumor cells and other biologic sources, normally available in clinical cancer studies, generate very small amounts of RNA that are restrictive for expression analysis. As a consequence, an RNA amplification procedure is required to assess the gene expression levels of such sample types. The reproducibility and accuracy of relative gene expression data produced by sensitive methodology as qRT-PCR when cDNA converted from amplified (A) RNA is used as template has not yet been properly addressed. In this study, to properly evaluate this issue, we performed 1 round of linear RNA amplification in 2 breast cell lines (C5.2 and HB4a) and assessed the relative expression of 34 genes using cDNA converted from both nonamplified (NA) and A RNA. Relative gene expression was obtained from beta actin or glyceraldehyde 3-phosphate dehydrogenase normalized data using different dilutions of cDNA, wherein the variability and fold-change differences in the expression of the 2 methods were compared. Our data showed that 1 round of linear RNA amplification, even with suboptimal-quality RNA, is appropriate to generate reproducible and high-fidelity qRT-PCR relative expression data that have similar confidence levels as those from NA samples. The use of cDNA that is converted from both A and NA RNA in a single qRT-PCR experiment clearly creates bias in relative gene expression data.