A Survey on Graphical Methods for Classification Predictive Performance Evaluation

Predictive performance evaluation is a fundamental issue in design, development, and deployment of classification systems. As predictive performance evaluation is a multidimensional problem, single scalar summaries such as error rate, although quite convenient due to its simplicity, can seldom evaluate all the aspects that a complete and reliable evaluation must consider. Due to this, various graphical performance evaluation methods are increasingly drawing the attention of machine learning, data mining, and pattern recognition communities. The main advantage of these types of methods resides in their ability to depict the trade-offs between evaluation aspects in a multidimensional space rather than reducing these aspects to an arbitrarily chosen (and often biased) single scalar measure. Furthermore, to appropriately select a suitable graphical method for a given task, it is crucial to identify its strengths and weaknesses. This paper surveys various graphical methods often used for predictive performance evaluation. By presenting these methods in the same framework, we hope this paper may shed some light on deciding which methods are more suitable to use in different situations.

Adaptation of an apple sooty blotch and flyspeck warning system for the Upper Midwest United States

A warning system for sooty blotch and flyspeck (SBFS) of apple, developed in the southeastern United States, uses cumulative hours of leaf wetness duration (LWD) to predict the timing of the first appearance of signs. In the Upper Midwest United States, however, this warning system has resulted in sporadic disease control failures. The purpose of the present study was to determine whether the warning system`s algorithm could be modified to provide more reliable assessment of SBFS risk. Hourly LWD, rainfall, relative humidity (RH), and temperature data were collected from orchards in Iowa, North Carolina, and Wisconsin in 2005 and 2006. Timing of the first appearance of SBFS signs was determined by weekly scouting. Preliminary analysis using scatterplots and boxplots suggested that Cumulative hours of RH >= 97% could be a useful predictor of SBFS appearance. Receiver operating characteristic curve analysis was used to compare the predictive performance of cumulative LWD and cumulative hours of RH >= 97%. Cumulative hours of RH >= 97% was a more conservative and accurate predictor than cumulative LWD for 15 site years in the Upper Midwest, but not for four site years in North Carolina. Performance of the SBFS warning system in the Upper Midwest and climatically similar regions may be improved if cumulative hours of RH >= 97% were substituted for cumulative LWD to predict the first appearance of SBFS.

Evolutionary model trees for handling continuous classes in machine learning

Model trees are a particular case of decision trees employed to solve regression problems. They have the advantage of presenting an interpretable output, helping the end-user to get more confidence in the prediction and providing the basis for the end-user to have new insight about the data, confirming or rejecting hypotheses previously formed. Moreover, model trees present an acceptable level of predictive performance in comparison to most techniques used for solving regression problems. Since generating the optimal model tree is an NP-Complete problem, traditional model tree induction algorithms make use of a greedy top-down divide-and-conquer strategy, which may not converge to the global optimal solution. In this paper, we propose a novel algorithm based on the use of the evolutionary algorithms paradigm as an alternate heuristic to generate model trees in order to improve the convergence to globally near-optimal solutions. We call our new approach evolutionary model tree induction (E-Motion). We test its predictive performance using public UCI data sets, and we compare the results to traditional greedy regression/model trees induction algorithms, as well as to other evolutionary approaches. Results show that our method presents a good trade-off between predictive performance and model comprehensibility, which may be crucial in many machine learning applications. (C) 2010 Elsevier Inc. All rights reserved.

Optimizing model predictive control of an industrial distillation column

The main scope of this work is the implementation of an MPC that integrates the control and the economic optimization of the system. The two problems are solved simultaneously through the modification of the control cost function that includes an additional term related to the economic objective. The optimizing MPC is based on a quadratic program (QP) as the conventional MPC and can be solved with the available QP solvers. The method was implemented in an industrial distillation system, and the results show that the approach is efficient and can be used, in several practical cases. (C) 2011 Elsevier Ltd. All rights reserved.

Enlarging the domain of attraction of stable MPC controllers, maintaining the output performance

This work presents an alternative way to formulate the stable Model Predictive Control (MPC) optimization problem that allows the enlargement of the domain of attraction, while preserving the controller performance. Based on the dual MPC that uses the null local controller, it proposed the inclusion of an appropriate set of slacked terminal constraints into the control problem. As a result, the domain of attraction is unlimited for the stable modes of the system, and the largest possible for the non-stable modes. Although this controller does not achieve local optimality, simulations show that the input and output performances may be comparable to the ones obtained with the dual MPC that uses the LQR as a local controller. (C) 2009 Elsevier Ltd. All rights reserved.

Robust model predictive control with zone control

Model predictive control (MPC) is usually implemented as a control strategy where the system outputs are controlled within specified zones, instead of fixed set points. One strategy to implement the zone control is by means of the selection of different weights for the output error in the control cost function. A disadvantage of this approach is that closed-loop stability cannot be guaranteed, as a different linear controller may be activated at each time step. A way to implement a stable zone control is by means of the use of an infinite horizon cost in which the set point is an additional variable of the control problem. In this case, the set point is restricted to remain inside the output zone and an appropriate output slack variable is included in the optimisation problem to assure the recursive feasibility of the control optimisation problem. Following this approach, a robust MPC is developed for the case of multi-model uncertainty of open-loop stable systems. The controller is devoted to maintain the outputs within their corresponding feasible zone, while reaching the desired optimal input target. Simulation of a process of the oil re. ning industry illustrates the performance of the proposed strategy.

Diagnostic Performance of Coronary Angiography by 64-Row CT

Background: The accuracy of multidetector computed tomographic (CT) angiography involving 64 detectors has not been well established. Methods: We conducted a multicenter study to examine the accuracy of 64-row, 0.5-mm multidetector CT angiography as compared with conventional coronary angiography in patients with suspected coronary artery disease. Nine centers enrolled patients who underwent calcium scoring and multidetector CT angiography before conventional coronary angiography. In 291 patients with calcium scores of 600 or less, segments 1.5 mm or more in diameter were analyzed by means of CT and conventional angiography at independent core laboratories. Stenoses of 50% or more were considered obstructive. The area under the receiver-operating-characteristic curve (AUC) was used to evaluate diagnostic accuracy relative to that of conventional angiography and subsequent revascularization status, whereas disease severity was assessed with the use of the modified Duke Coronary Artery Disease Index. Results: A total of 56% of patients had obstructive coronary artery disease. The patient-based diagnostic accuracy of quantitative CT angiography for detecting or ruling out stenoses of 50% or more according to conventional angiography revealed an AUC of 0.93 (95% confidence interval [CI], 0.90 to 0.96), with a sensitivity of 85% (95% CI, 79 to 90), a specificity of 90% (95% CI, 83 to 94), a positive predictive value of 91% (95% CI, 86 to 95), and a negative predictive value of 83% (95% CI, 75 to 89). CT angiography was similar to conventional angiography in its ability to identify patients who subsequently underwent revascularization: the AUC was 0.84 (95% CI, 0.79 to 0.88) for multidetector CT angiography and 0.82 (95% CI, 0.77 to 0.86) for conventional angiography. A per-vessel analysis of 866 vessels yielded an AUC of 0.91 (95% CI, 0.88 to 0.93). Disease severity ascertained by CT and conventional angiography was well correlated (r=0.81; 95% CI, 0.76 to 0.84). Two patients had important reactions to contrast medium after CT angiography. Conclusions: Multidetector CT angiography accurately identifies the presence and severity of obstructive coronary artery disease and subsequent revascularization in symptomatic patients. The negative and positive predictive values indicate that multidetector CT angiography cannot replace conventional coronary angiography at present. (ClinicalTrials.gov number, NCT00738218.).

Diagnostic Performance of Combined Noninvasive Coronary Angiography and Myocardial Perfusion Imaging Using 320-MDCT: The CT Angiography and Perfusion Methods of the CORE320 Multicenter Multinational Diagnostic Study

OBJECTIVE. Coronary MDCT angiography has been shown to be an accurate noninvasive tool for the diagnosis of obstructive coronary artery disease (CAD). Its sensitivity and negative predictive value for diagnosing percentage of stenosis are unsurpassed compared with those of other noninvasive testing methods. However, in its current form, it provides no information regarding the physiologic impact of CAD and is a poor predictor of myocardial ischemia. CORE320 is a multicenter multinational diagnostic study with the primary objective to evaluate the diagnostic accuracy of 320-MDCT for detecting coronary artery luminal stenosis and corresponding myocardial perfusion deficits in patients with suspected CAD compared with the reference standard of conventional coronary angiography and SPECT myocardial perfusion imaging. CONCLUSION. We aim to describe the CT acquisition, reconstruction, and analysis methods of the CORE320 study.

PREDICTIVE FACTORS FOR GAIT IN FEMORAL TRANSTROCHANTERIC FRACTURES

Objective: The objective of this study was to identify variables that could predict the quality of gait in patients with transtrochanteric femoral fractures after treatment. Materials and Methods: Hospitalized patients diagnosed with transtrochanteric femoral fractures were selected between September/2005 and August/2006 and followed-up for 6 months after the trauma date. An observational prospective study was conducted to assess the quality of gait 3 and 6 months after fracture in 31 patients (13 males and 18 females). The mean age was 76 +/- 2,7. Results: Seven patients (22,6%) passed away during the follow-up period. The patients with associated fractures or with four or more co-morbidities showed a worse quality of gait after 6 months. Patients without orthopaedic complications or who got partial weight load prior to 30 days showed a better performance. Conclusion: The quantification of predictive gait indexes allows us to propose new treatment approaches consistently to the different realities showed by each group of patients.

Thermal performance of sisal fiber-cement roofing tiles for rural constructions

Roofing provides the main protection against direct solar radiation in animal housing. Appropriate thermal properties of roofing materials tend to improve the thermal comfort in the inner ambient. Nonasbestos fiber-cement roofing components reinforced with cellulose pulp from sisal (Agave sisalana) were produced by slurry and dewatering techniques, with an optional addition of polypropylene fibers. Nonasbestos tiles were evaluated and compared with commercially available asbestos-cement sheets and ceramic tiles (frequently chosen as roofing materials for animal housing). Thermal conductivity and thermal diffusivity of tiles were determined by the parallel hot-wire method, along with the evaluation of the downside surface temperature. Cement-based components reinforced with sisal pulp presented better thermal performance at room temperature (25ºC), while those reinforced with sisal pulp added by polypropylene fibers presented better thermal performance at 60ºC. Non-asbestos cement tiles provided more efficient protection against radiation than asbestos corrugated sheets.

Trade unions and the economic performance of brazilian establishments

Este artigo analisa, pela primeira vez na literatura, o impacto dos sindicatos de trabalhadores em vários indicadores de desempenho econômico de firmas industriais brasileiras. Realizou-se uma pesquisa retrospectiva sobre a densidade sindical de 1000 estabelecimentos industriais brasileiros e seus resultados foram combinados aos indicadores de desempenho econômico da Pesquisa Industrial Anual (PIA) de 1990 a 2000. Os resultados indicam que a relação entre a densidade sindical na firma e seus salários, emprego e produtividade, é não-linear, ou seja, um aumento no grau de sindicalização leva a um melhor desempenho, porém a taxas decrescentes. Observou-se, também, uma relação negativa entre sindicalização e rentabilidade. Finalmente, estabelecimentos que introduziram mecanismos de 'participação nos lucros' aumentaram sua produtividade e rentabilidade no período e pagaram maiores salários nas firmas onde o grau de sindicalização era maior.

The impact of spatial data redundancy on SOLAP query performance

Geographic Data Warehouses (GDW) are one of the main technologies used in decision-making processes and spatial analysis, and the literature proposes several conceptual and logical data models for GDW. However, little effort has been focused on studying how spatial data redundancy affects SOLAP (Spatial On-Line Analytical Processing) query performance over GDW. In this paper, we investigate this issue. Firstly, we compare redundant and non-redundant GDW schemas and conclude that redundancy is related to high performance losses. We also analyze the issue of indexing, aiming at improving SOLAP query performance on a redundant GDW. Comparisons of the SB-index approach, the star-join aided by R-tree and the star-join aided by GiST indicate that the SB-index significantly improves the elapsed time in query processing from 25% up to 99% with regard to SOLAP queries defined over the spatial predicates of intersection, enclosure and containment and applied to roll-up and drill-down operations. We also investigate the impact of the increase in data volume on the performance. The increase did not impair the performance of the SB-index, which highly improved the elapsed time in query processing. Performance tests also show that the SB-index is far more compact than the star-join, requiring only a small fraction of at most 0.20% of the volume. Moreover, we propose a specific enhancement of the SB-index to deal with spatial data redundancy. This enhancement improved performance from 80 to 91% for redundant GDW schemas.

Nanochromics: old materials, new structures and architectures for high performance devices

Due to the development of nanoscience, the interest in electrochromism has increased and new assemblies of electrochromic materials at nanoscale leading to higher efficiencies and chromatic contrasts, low switching times and the possibility of color tuning have been developed. These advantages are reached due to the extensive surface area found in nanomaterials and the large amount of organic electrochromic molecules that can be easily attached onto inorganic nanoparticles, as TiO2 or SiO2. Moreover, the direct contact between electrolyte and nanomaterials produces high ionic transfer rates, leading to fast charge compensation, which is essential for high performance electrochromic electrodes. Recently, the layer-by-layer technique was presented as an interesting way to produce different architectures by the combination of both electrochromic nanoparticles and polymers. The present paper shows some of the newest insights into nanochromic science.

Nursery performance of the pink shrimp Farfantepenaeus paulensis (Crustacea: Decapoda: Penaeidae) postlarvae in different salinities

Nursery performance, development, and RNA:DNA ratio were investigated in Farfantepenaeus paulensis (Pérez-Farfante, 1967) postlarvae acclimated from a salinity of 30‰ to higher (35‰) or lower (16, 22 and 29‰) salinities and reared for 20 days. Overall, higher final weight, yield and growth rate were observed at a salinity of 29‰. RNA:DNA ratio indicated reduced growth potential at a salinity of 35‰. Low salinities resulted in more developed individuals. Thus, early postlarval F. paulensis should not be stocked in salinities higher than that of the original hatchery, otherwise in lower salinities postlarvae should be older and/or have an extended nursery phase. Results may assist in the development of nursery rearing protocols for F. paulensis, an alternative species for aquaculture in subtropical areas.

Preditores sócio-demográficos, de estilo de vida e gineco-obstétricos das concentrações séricas ou plasmáticas de homocisteína, ácido fólico e vitaminas B12 e B6 em mulheres de baixa renda de São Paulo, Brasil

O presente estudo investigou fatores sócio-demográficos, de estilo de vida e gineco-obstétricos associados às concentrações séricas ou plasmáticas de homocisteína, ácido fólico, vitaminas B12 e B6 em mulheres de baixa renda de São Paulo, Brasil. Concentrações séricas de ácido fólico e vitamina B12 foram analisadas por fluoroimunoensaio; concentrações plasmáticas de homocisteína e vitamina B6, por cromatografia líquida de alta performance em fase reversa. Variáveis independentes foram inicialmente selecionadas segundo pressupostos teóricos, correlação de Pearson ou teste Kruskal-Wallis (p < 0,20). Concentrações alteradas segundo pontos de corte para homocisteína, ácido fólico, vitaminas B12 e B6 foram observadas em 20%, 6%, 11% e 67% das participantes, respectivamente. Idade foi positivamente correlacionada à vitamina B6 e homocisteína plasmáticas (p < 0,001). Índice de massa corporal foi positivamente correlacionado à vitamina B6 plasmática (p < 0,001). Modelos de regressão linear múltiplos explicaram 10,2%, 5,8%, 14,4% e 9,4% das concentrações de ácido fólico, vitamina B12, vitamina B6 e homocisteína, respectivamente. No presente estudo, variáveis sócio-demográficas, de estilo de vida e gineco-obstétricas apresentaram contribuição importante na variação das concentrações dos indicadores bioquímicos avaliados.