Tool for discovering sequential patterns in financial markets

The goal of this thesis is the study of a tool that can help analysts in finding sequential patterns. This tool will have a focus on financial markets. A study will be made on how new and relevant knowledge can be mined from real life information, potentially giving investors, market analysts, and economists new basis to make informed decisions. The Ramex Forum algorithm will be used as a basis for the tool, due to its ability to find sequential patterns in financial data. So that it further adapts to the needs of the thesis, a study of relevant improvements to the algorithm will be made. Another important aspect of this algorithm is the way that it displays the patterns found, even with good results it is difficult to find relevant patterns among all the studied samples without a proper result visualization component. As such, different combinations of parameterizations and ways to visualize data will be evaluated and their influence in the analysis of those patterns will be discussed. In order to properly evaluate the utility of this tool, case studies will be performed as a final test. Real information will be used to produce results and those will be evaluated in regards to their accuracy, interest, and relevance.

A DSL for querying building data streams of energy, eeather and occupation data

The superfluous consumption of energy is faced by the modern society as a Socio-Economical and Environmental problem of the present days. This situation is worsening given that it is becoming clear that the tendency is to increase energy price every year. It is also noticeable that people, not necessarily proficient in technology, are not able to know where savings can be achieved, due to the absence of accessible awareness mechanisms. One of the home user concerns is to balance the need of reducing energy consumption, while producing the same activity with all the comfort and work efficiency. The common techniques to reduce the consumption are to use a less wasteful equipment, altering the equipment program to a more economical one or disconnecting appliances that are not necessary at the moment. However, there is no direct feedback from this performed actions, which leads to the situation where the user is not aware of the influence that these techniques have in the electrical bill. With the intension to give some control over the home consumption, Energy Management Systems (EMS) were developed. These systems allow the access to the consumption information and help understanding the energy waste. However, some studies have proven that these systems have a clear mismatch between the information that is presented and the one the user finds useful for his daily life, leading to demotivation of use. In order to create a solution more oriented towards the user’s demands, a specially tailored language (DSL) was implemented. This solution allows the user to acquire the information he considers useful, through the construction of questions about his energy consumption. The development of this language, following the Model Driven Development (MDD) approach, took into consideration the ideas of facility managers and home users in the phases of design and validation. These opinions were gathered through meetings with experts and a survey, which was conducted to the purpose of collecting statistics about what home users want to know.

Integrated data model and DSL modifications

Companies are increasingly more and more dependent on distributed web-based software systems to support their businesses. This increases the need to maintain and extend software systems with up-to-date new features. Thus, the development process to introduce new features usually needs to be swift and agile, and the supporting software evolution process needs to be safe, fast, and efficient. However, this is usually a difficult and challenging task for a developer due to the lack of support offered by programming environments, frameworks, and database management systems. Changes needed at the code level, database model, and the actual data contained in the database must be planned and developed together and executed in a synchronized way. Even under a careful development discipline, the impact of changing an application data model is hard to predict. The lifetime of an application comprises changes and updates designed and tested using data, which is usually far from the real, production, data. So, coding DDL and DML SQL scripts to update database schema and data, is the usual (and hard) approach taken by developers. Such manual approach is error prone and disconnected from the real data in production, because developers may not know the exact impact of their changes. This work aims to improve the maintenance process in the context of Agile Platform by Outsystems. Our goal is to design and implement new data-model evolution features that ensure a safe support for change and a sound migration process. Our solution includes impact analysis mechanisms targeting the data model and the data itself. This provides, to developers, a safe, simple, and guided evolution process.

Sistema de deteção de eventos adversos baseado num data warehouse

RESUMO - A Segurança do Doente tem assumido uma relevância crescente nas organizações de saúde, resultado da divulgação de diversos estudos que revelaram a magnitude deste problema e simultaneamente, de uma maior pressão por parte da opinião pública e da comunicação social. Este estudo pretende desenvolver e avaliar a performance de um sistema eletrónico de deteção de eventos adversos, baseado num Data Warehouse, por comparação com os resultados obtidos pela metodologia tradicional de revisão dos registos clínicos. O objetivo principal do trabalho consistiu em identificar um conjunto de triggers / indicadores de alerta que permitam detetar potenciais eventos adversos mais comuns. O sistema desenvolvido apresentou um Valor Preditivo Positivo de 18.2%, uma sensibilidade de 65.1% e uma especificidade de 68.6%, sendo constituído por nove indicadores baseados em informação clínica e 445 códigos do ICD-9-CM, relativos a diagnósticos e procedimentos. Apesar de terem algumas limitações, os sistemas eletrónicos de deteção de eventos adversos apresentam inúmeras potencialidades, nomeadamente a utilização em tempo real e em complemento a metodologias já existentes. Considerando a importância da problemática em análise e a necessidade de aprofundar os resultados obtidos neste trabalho de projeto, seria relevante a sua extensão a um universo mais alargado de instituições hospitalares, estando a sua replicabilidade facilitada, uma vez que o Data Warehouse tem por base um conjunto de aplicações disseminadas a nível nacional. O desenvolvimento e a consolidação dos sistemas eletrónicos de deteção de eventos adversos constitui inegavelmente uma área de futuro, com reflexos ao nível da melhoria da informação existente nas organizações e que contribuirá decisivamente para a melhoria dos cuidados de saúde prestados aos doentes.

SDAR: a package for plotting and analyzing stratigraphy data in R

Stratigraphic Columns (SC) are the most useful and common ways to represent the eld descriptions (e.g., grain size, thickness of rock packages, and fossil and lithological components) of rock sequences and well logs. In these representations the width of SC vary according to the grain size (i.e., the wider the strata, the coarser the rocks (Miall 1990; Tucker 2011)), and the thickness of each layer is represented at the vertical axis of the diagram. Typically these representations are drawn 'manually' using vector graphic editors (e.g., Adobe Illustrator®, CorelDRAW®, Inskape). Nowadays there are various software which automatically plot SCs, but there are not versatile open-source tools and it is very di cult to both store and analyse stratigraphic information. This document presents Stratigraphic Data Analysis in R (SDAR), an analytical package1 designed for both plotting and facilitate the analysis of Stratigraphic Data in R (R Core Team 2014). SDAR, uses simple stratigraphic data and takes advantage of the exible plotting tools available in R to produce detailed SCs. The main bene ts of SDAR are: (i) used to generate accurate and complete SC plot including multiple features (e.g., sedimentary structures, samples, fossil content, color, structural data, contacts between beds), (ii) developed in a free software environment for statistical computing and graphics, (iii) run on a wide variety of platforms (i.e., UNIX, Windows, and MacOS), (iv) both plotting and analysing functions can be executed directly on R's command-line interface (CLI), consequently this feature enables users to integrate SDAR's functions with several others add-on packages available for R from The Comprehensive R Archive Network (CRAN).

Analyzing Geospatial patterns of syrian refugee flows in southeastern Turkey by use of remote sensing and complementary data

Crisis-affected communities and global organizations for international aid are becoming increasingly digital as consequence geotechnology popularity. Humanitarian sector changed in profound ways by adopting new technical approach to obtain information from area with difficult geographical or political access. Since 2011, turkey is hosting a growing number of Syrian refugees along southeastern region. Turkish policy of hosting them in camps and the difficulty created by governors to international aid group expeditions to get information, made such international organizations to investigate and adopt other approach in order to obtain information needed. They intensified its remote sensing approach. However, the majority of studies used very high-resolution satellite imagery (VHRSI). The study area is extensive and the temporal resolution of VHRSI is low, besides it is infeasible only using these sensors as unique approach for the whole area. The focus of this research, aims to investigate the potentialities of mid-resolution imagery (here only Landsat) to obtain information from region in crisis (here, southeastern Turkey) through a new web-based platform called Google Earth Engine (GEE). Hereby it is also intended to verify GEE currently reliability once the Application Programming Interface (API) is still in beta version. The finds here shows that the basic functions are trustworthy. Results pointed out that Landsat can recognize change in the spectral resolution clearly only for the first settlement. The ongoing modifications vary for each case. Overall, Landsat demonstrated high limitations, but need more investigations and may be used, with restriction, as a support of VHRSI.

Identifying the urban communities of New York City using bikeshare data from NYC citibike

This study identifies a measure of the cultural importance of an area within a city. It does so by making use of origindestination trip data and the bike stations of the bike share system in New York City as a proxy to study the city. Rarely is movement in the city studied at such a small scale. The change in strength of the similarity of movement between each station is studied. It is the first study to provide this measure of importance for every point in the system. This measure is then related to the characteristics which make for vibrant city communities, namely highly mixed land use types. It reveals that the spatial pattern of important areas remains constant over differing time periods. Communities are then characterised by the land uses surrounding these stations with high measures of importance. Finally it identifies the areas of global cultural importance alongside the areas of local importance to the city.

Creation of a web application for smart park system and parking prediction study for system integration

In the last few years, we have observed an exponential increasing of the information systems, and parking information is one more example of them. The needs of obtaining reliable and updated information of parking slots availability are very important in the goal of traffic reduction. Also parking slot prediction is a new topic that has already started to be applied. San Francisco in America and Santander in Spain are examples of such projects carried out to obtain this kind of information. The aim of this thesis is the study and evaluation of methodologies for parking slot prediction and the integration in a web application, where all kind of users will be able to know the current parking status and also future status according to parking model predictions. The source of the data is ancillary in this work but it needs to be understood anyway to understand the parking behaviour. Actually, there are many modelling techniques used for this purpose such as time series analysis, decision trees, neural networks and clustering. In this work, the author explains the best techniques at this work, analyzes the result and points out the advantages and disadvantages of each one. The model will learn the periodic and seasonal patterns of the parking status behaviour, and with this knowledge it can predict future status values given a date. The data used comes from the Smart Park Ontinyent and it is about parking occupancy status together with timestamps and it is stored in a database. After data acquisition, data analysis and pre-processing was needed for model implementations. The first test done was with the boosting ensemble classifier, employed over a set of decision trees, created with C5.0 algorithm from a set of training samples, to assign a prediction value to each object. In addition to the predictions, this work has got measurements error that indicates the reliability of the outcome predictions being correct. The second test was done using the function fitting seasonal exponential smoothing tbats model. Finally as the last test, it has been tried a model that is actually a combination of the previous two models, just to see the result of this combination. The results were quite good for all of them, having error averages of 6.2, 6.6 and 5.4 in vacancies predictions for the three models respectively. This means from a parking of 47 places a 10% average error in parking slot predictions. This result could be even better with longer data available. In order to make this kind of information visible and reachable from everyone having a device with internet connection, a web application was made for this purpose. Beside the data displaying, this application also offers different functions to improve the task of searching for parking. The new functions, apart from parking prediction, were: - Park distances from user location. It provides all the distances to user current location to the different parks in the city. - Geocoding. The service for matching a literal description or an address to a concrete location. - Geolocation. The service for positioning the user. - Parking list panel. This is not a service neither a function, is just a better visualization and better handling of the information.

The role of qualitative data and systems thinking in addressing service decline in market towns

Retail services are a main contributor to municipal budget and are an activity that affects perceived quality-of-life, especially for those with mobility difficulties (e.g. the elderly, low income citizens). However, there is evidence of a decline in some of the services market towns provide to their citizens. In market towns, this decline has been reported all over the western world, from North America to Australia. The aim of this research was to understand retail decline and enlighten on some ways of addressing this decline, using a case study, Thornbury, a small town in the Southwest of England. Data collected came from two participatory approaches: photo-surveys and multicriteria mapping. The interpretation of data came from using participants as analysts, but also, using systems thinking (systems diagramming and social trap theory) for theory building. This research moves away from mainstream economic and town planning perspectives by making use of different methods and concepts used in anthropology and visual sociology (photo-surveys), decision-making and ecological economics (multicriteria mapping and social trap theory). In sum, this research has experimented with different methods, out of their context, to analyse retail decline in a small town. This research developed a conceptual model for retail decline and identified the existence of conflicting goals and interests and their implications for retail decline, as well as causes for these. Most of the potential causes have had little attention in the literature. This research also identified that some of the measures commonly used for dealing with retail decline may be contributing to the causes of retail decline itself. Additionally, this research reviewed some of the measures that can be used to deal with retail decline, implications for policy-making and reflected on the use of the data collection and analysis methods in the context of small to medium towns.

Walking Through the Revolution: A Spatial Reading of Literary Echoes

This paper presents an embryo of a literary guide on the Carnation Revolution to be explored for educational historical excursions other than leisure and tourism. We propose a historical trail through the centre of Lisbon, city of the Carnation Revolution, called Walk through the Revolution. The trail aims to reinforce collective memory about the major events that occurred in the early moments leading to the coup. The trail is made up by nine places of rememberance, for which literary excerpts are suggested and which are supported by a digital research procedure. A set of seven fixed and observer-independent categories are used to analyse the literary contents of 23 literary works published up to 2013. These literary works refer to events that happened between the eve of April 25 and May 1, 1974. At the same time, literary descriptions are explored using a spatial approach in order to define the literary geography of the most iconic military actions and popular demonstrations that occurred in Lisbon and the surroundings. The literary geography and the cartography of the historical events are then compared. Data analysis and visualization benefit from the use of standardised and quantitative methods, including basic statistics and geographic information systems.

Relationship between national culture, democracy and environmental performance: A panel data analysis

This paper demonstrates the significance of culture in examining the relationshipbetween democratic capital and environmental performance.The aim is to examine the relationship among scores on the Environmental Performance Index and the two dimensions of cross cultural variation suggested by Ronald Inglehart and Christian Welzel. Significantional interrelationships among democracy, cultural and environmental sustaintability measures could be found, following the regression results. Firstly, higher levels of democratic capital stock are associated with better environmental performance. Secondly importance to distinguish between cultural groups could be confirmed.

Análise da eficiência na gestão do risco de fornecedores: aplicação de um modelo Data Envelopment Analysis

Atualmente a tendência dos negócios leva a cadeias de abastecimento complexas e dinâmicas, que consequentemente levanta questões relativas ao aumento do risco de fornecimento em torno dessas mesmas cadeias; pelo que existe cada vez mais uma necessidade dos gestores identificarem e gerirem o risco de um modo mais diversificado. Associado às cadeias de abastecimento estão os fornecedores. A maioria dos riscos relativos a estes, está incluída no contexto de risco de fornecimento, resultando assim numa problemática de seleção e avaliação de fornecedores. Riscos como baixa qualidade, atrasos na entrega, falha ou interrupção de fornecimento, são exemplos de fatores de risco associados. Neste contexto, um dos maiores desafios para as organizações atualmente é trabalharem com os melhores fornecedores do mercado, procurando garantir a estabilidade em termos de fornecimento, com as melhores condições possíveis, quer a nível de preço, qualidade, entre outros, exigindo cada vez mais relações comerciais eficientes com os fornecedores. Assim, este trabalho tem como objetivo o desenvolvimento de um modelo baseado no método Data Envelopment Analysis (DEA), que permite às organizações avaliar e melhorar a eficiência das suas relações comerciais na gestão de risco de fornecimento nas suas cadeias de abastecimento. Como tal, o modelo proposto é divido em dois casos, que diferem pela origem da obtenção dos seus valores. Ou seja, num dos casos é aplicada uma avaliação externa à organização, e no outro é utilizada uma avaliação interna, o que permitirá discutir a sua utilização. Segundo o modelo proposto verificou-se que a eficiência média foi de 93% no caso I e 94% no caso II. Concluindo-se ainda ambos os casos necessitam de melhorias nos fornecimentos ao nível de: Qualidade, Logística e Tecnologia, ou seja, melhorar a qualidade dos serviços prestados, diminuir os seus prazos de execução dos serviços/fornecimento de material e aumento do conhecimento tecnológico.

Grande panorama de Lisboa em azulejo: Novos contributos para a fixação da data, encomenda e autoria

O Grande panorama de Lisboa, obra maior da azulejaria nacional e hoje à guarda do Museu Nacional do Azulejo, pertenceu outrora a um palácio situado na freguesia de Santiago, propriedade da família Ferreira de Macedo no final do século XVII. A investigação apresentada procura esclarecer alguns aspectos relacionados com a execução do grandioso painel e com o perfil sócio-cultural do encomendador. À luz de novos elementos documentais, o artigo discute ainda a questão da autoria do painel, dada há muito ao pintor barroco Gabriel del Barco.

Um modelo Data Envelopment Analysis para avaliação da eficiência dos terminais de contentores do grupo TERTIR

O transporte marítimo tem vindo a adquirir uma considerável importância na economia mundial desde o século XV. O transporte marítimo é visto como um dos meios de transporte mais viáveis, que engloba um largo número de destinos no mundo e representa, para uma determinada distância a percorrer, o menor custo por tonelada. É, também, comparativamente com o transporte aéreo e rodoviário, o meio de transporte menos poluente, tornando-o, assim, uma alternativa “amiga do ambiente”. Em particular, o transporte via contentores tem vindo a ser cada vez mais utilizado devido às suas inúmeras vantagens. O contentor permite o transporte de qualquer tipo de mercadoria em boas condições de acondicionamento e permitiu otimizar as operações efetuadas através da redução de tempo de trabalho, custos e espaço. Ademais, com a globalização, a evolução do mercado, a construção de navios de maiores dimensões e a maior tecnologia investida no setor, a competição entre os portos alcançou níveis que exigem uma maior eficiência de toda a estrutura portuária. Neste contexto, a presente dissertação visa avaliar a eficiência dos terminais de contentores do grupo TERTIR, nomeadamente os de Lisboa, Leixões e Setúbal, utilizando o método Data Envelopment Analaysis (DEA). De um modo geral, o método DEA avalia a capacidade dos terminais em converter inputs em outputs. Mais especificamente os inputs selecionados nesta dissertação dizem respeito às infraestruturas e equipamentos dos terminais em estudo, e o output considera a carga movimentada por cada terminal, sendo neste caso representada pelo número de TEUs movimentados. O modelo proposto é aplicado a um conjunto de 30 terminais de contentores Europeus de 6 países diferentes, nomeadamente, Alemanha, Bélgica, Espanha, França, Holanda e Portugal. De um modo geral, os terminais TERTIR apresentam níveis de eficiência baixos quando comparados com outros terminais Europeus. Os resultados contribuem, também, para auxiliar o grupo TERTIR no debate de algumas questões atuais com as autoridades portuárias, nomeadamente no que se refere à descida dos tarifários praticados aos seus clientes e à enunciada construção do terminal de contentores do Barreiro.

Genetic algorithm for shipping route estimation with long-range tracking data : automatic reconstruction of shipping routes based on the historical ship positions for maritime safety applications

Ship tracking systems allow Maritime Organizations that are concerned with the Safety at Sea to obtain information on the current location and route of merchant vessels. Thanks to Space technology in recent years the geographical coverage of the ship tracking platforms has increased significantly, from radar based near-shore traffic monitoring towards a worldwide picture of the maritime traffic situation. The long-range tracking systems currently in operations allow the storage of ship position data over many years: a valuable source of knowledge about the shipping routes between different ocean regions. The outcome of this Master project is a software prototype for the estimation of the most operated shipping route between any two geographical locations. The analysis is based on the historical ship positions acquired with long-range tracking systems. The proposed approach makes use of a Genetic Algorithm applied on a training set of relevant ship positions extracted from the long-term storage tracking database of the European Maritime Safety Agency (EMSA). The analysis of some representative shipping routes is presented and the quality of the results and their operational applications are assessed by a Maritime Safety expert.