Modelo de data mining para detecção de tumores em exames de rastreio

Dissertação para obtenção do grau de Mestre em Engenharia Informática

An unsupervised approach to feature discretization and selection

Many learning problems require handling high dimensional datasets with a relatively small number of instances. Learning algorithms are thus confronted with the curse of dimensionality, and need to address it in order to be effective. Examples of these types of data include the bag-of-words representation in text classification problems and gene expression data for tumor detection/classification. Usually, among the high number of features characterizing the instances, many may be irrelevant (or even detrimental) for the learning tasks. It is thus clear that there is a need for adequate techniques for feature representation, reduction, and selection, to improve both the classification accuracy and the memory requirements. In this paper, we propose combined unsupervised feature discretization and feature selection techniques, suitable for medium and high-dimensional datasets. The experimental results on several standard datasets, with both sparse and dense features, show the efficiency of the proposed techniques as well as improvements over previous related techniques.

Price forecasting in the day-ahead Iberian electricity market using a conjectural variations Arima model

Price forecast is a matter of concern for all participants in electricity markets, from suppliers to consumers through policy makers, which are interested in the accurate forecast of day-ahead electricity prices either for better decisions making or for an improved evaluation of the effectiveness of market rules and structure. This paper describes a methodology to forecast market prices in an electricity market using an ARIMA model applied to the conjectural variations of the firms acting in an electricity market. This methodology is applied to the Iberian electricity market to forecast market prices in the 24 hours of a working day. The methodology was then compared with two other methodologies, one called naive and the other a direct forecast of market prices using also an ARIMA model. Results show that the conjectural variations price forecast performs better than the naive and that it performs slightly better than the direct price forecast.