Forecasting of wind speeds and directions with artificial neural networks

In this master’s thesis, wind speeds and directions were modeled with the aim of developing suitable models for hourly, daily, weekly and monthly forecasting. Artificial Neural Networks implemented in MATLAB software were used to perform the forecasts. Three main types of artificial neural network were built, namely: Feed forward neural networks, Jordan Elman neural networks and Cascade forward neural networks. Four sub models of each of these neural networks were also built, corresponding to the four forecast horizons, for both wind speeds and directions. A single neural network topology was used for each of the forecast horizons, regardless of the model type. All the models were then trained with real data of wind speeds and directions collected over a period of two years in the municipal region of Puumala in Finland. Only 70% of the data was used for training, validation and testing of the models, while the second last 15% of the data was presented to the trained models for verification. The model outputs were then compared to the last 15% of the original data, by measuring the mean square errors and sum square errors between them. Based on the results, the feed forward networks returned the lowest generalization errors for hourly, weekly and monthly forecasts of wind speeds; Jordan Elman networks returned the lowest errors when used for forecasting of daily wind speeds. Cascade forward networks gave the lowest errors when used for forecasting daily, weekly and monthly wind directions; Jordan Elman networks returned the lowest errors when used for hourly forecasting. The errors were relatively low during training of the models, but shot up upon simulation with new inputs. In addition, a combination of hyperbolic tangent transfer functions for both hidden and output layers returned better results compared to other combinations of transfer functions. In general, wind speeds were more predictable as compared to wind directions, opening up opportunities for further research into building better models for wind direction forecasting.

Pretraining Convolutional Neural Networks for Visual Recognition

Convolutional Neural Networks (CNN) have become the state-of-the-art methods on many large scale visual recognition tasks. For a lot of practical applications, CNN architectures have a restrictive requirement: A huge amount of labeled data are needed for training. The idea of generative pretraining is to obtain initial weights of the network by training the network in a completely unsupervised way and then fine-tune the weights for the task at hand using supervised learning. In this thesis, a general introduction to Deep Neural Networks and algorithms are given and these methods are applied to classification tasks of handwritten digits and natural images for developing unsupervised feature learning. The goal of this thesis is to find out if the effect of pretraining is damped by recent practical advances in optimization and regularization of CNN. The experimental results show that pretraining is still a substantial regularizer, however, not a necessary step in training Convolutional Neural Networks with rectified activations. On handwritten digits, the proposed pretraining model achieved a classification accuracy comparable to the state-of-the-art methods.

Modelling non-industrial private forest landowners' strategic decision making by using logistic regression and neural networks: case of predicting the choice of forest taxation basis

Summary

Use of neural networks in robot positioning of large flexible redundant manipulators

Deflection compensation of flexible boom structures in robot positioning is usually done using tables containing the magnitude of the deflection with inverse kinematics solutions of a rigid structure. The number of table values increases greatly if the working area of the boom is large and the required positioning accuracy is high. The inverse kinematics problems are very nonlinear, and if the structure is redundant, in some cases it cannot be solved in a closed form. If the structural flexibility of the manipulator arms is taken into account, the problem is almost impossible to solve using analytical methods. Neural networks offer a possibility to approximate any linear or nonlinear function. This study presents four different methods of using neural networks in the static deflection compensation and inverse kinematics solution of a flexible hydraulically driven manipulator. The training information required for training neural networks is obtained by employing a simulation model that includes elasticity characteristics. The functionality of the presented methods is tested based on the simulated and measured results of positioning accuracy. The simulated positioning accuracy is tested in 25 separate coordinate points. For each point, the positioning is tested with five different mass loads. The mean positioning error of a manipulator decreased from 31.9 mm to 4.1 mm in the test points. This accuracy enables the use of flexible manipulators in the positioning of larger objects. The measured positioning accuracy is tested in 9 separate points using three different mass loads. The mean positioning error decreased from 10.6 mm to 4.7 mm and the maximum error from 27.5 mm to 11.0 mm.

Deep convolutional neural networks for semantic video object segmentation

In this thesis, we propose to infer pixel-level labelling in video by utilising only object category information, exploiting the intrinsic structure of video data. Our motivation is the observation that image-level labels are much more easily to be acquired than pixel-level labels, and it is natural to find a link between the image level recognition and pixel level classification in video data, which would transfer learned recognition models from one domain to the other one. To this end, this thesis proposes two domain adaptation approaches to adapt the deep convolutional neural network (CNN) image recognition model trained from labelled image data to the target domain exploiting both semantic evidence learned from CNN, and the intrinsic structures of unlabelled video data. Our proposed approaches explicitly model and compensate for the domain adaptation from the source domain to the target domain which in turn underpins a robust semantic object segmentation method for natural videos. We demonstrate the superior performance of our methods by presenting extensive evaluations on challenging datasets comparing with the state-of-the-art methods.

Application of Neural Network Methods in the Prediction of Stock Markets

The purpose of the research is to define practical profit which can be achieved using neural network methods as a prediction instrument. The thesis investigates the ability of neural networks to forecast future events. This capability is checked on the example of price prediction during intraday trading on stock market. The executed experiments show predictions of average 1, 2, 5 and 10 minutes’ prices based on data of one day and made by two different types of forecasting systems. These systems are based on the recurrent neural networks and back propagation neural nets. The precision of the predictions is controlled by the absolute error and the error of market direction. The economical effectiveness is estimated by a special trading system. In conclusion, the best structures of neural nets are tested with data of 31 days’ interval. The best results of the average percent of profit from one transaction (buying + selling) are 0.06668654, 0.188299453, 0.349854787 and 0.453178626, they were achieved for prediction periods 1, 2, 5 and 10 minutes. The investigation can be interesting for the investors who have access to a fast information channel with a possibility of every-minute data refreshment.

Visual Measurement and Modelling of Tool Wear in Rough Turning

Huolimatta korkeasta automaatioasteesta sorvausteollisuudessa, muutama keskeinen ongelma estää sorvauksen täydellisen automatisoinnin. Yksi näistä ongelmista on työkalun kuluminen. Tämä työ keskittyy toteuttamaan automaattisen järjestelmän kulumisen, erityisesti viistekulumisen, mittaukseen konenäön avulla. Kulumisen mittausjärjestelmä poistaa manuaalisen mittauksen tarpeen ja minimoi ajan, joka käytetään työkalun kulumisen mittaukseen. Mittauksen lisäksi tutkitaan kulumisen mallinnusta sekä ennustamista. Automaattinen mittausjärjestelmä sijoitettiin sorvin sisälle ja järjestelmä integroitiin onnistuneesti ulkopuolisten järjestelmien kanssa. Tehdyt kokeet osoittivat, että mittausjärjestelmä kykenee mittaamaan työkalun kulumisen järjestelmän oikeassa ympäristössä. Mittausjärjestelmä pystyy myös kestämään häiriöitä, jotka ovat konenäköjärjestelmille yleisiä. Työkalun kulumista mallinnusta tutkittiin useilla eri menetelmillä. Näihin kuuluivat muiden muassa neuroverkot ja tukivektoriregressio. Kokeet osoittivat, että tutkitut mallit pystyivät ennustamaan työkalun kulumisasteen käytetyn ajan perusteella. Parhaan tuloksen antoivat neuroverkot Bayesiläisellä regularisoinnilla.

Speaker diarization: Segmentation and clustering of speeches

Speaker diarization is the process of sorting speeches according to the speaker. Diarization helps to search and retrieve what a certain speaker uttered in a meeting. Applications of diarization systemsextend to other domains than meetings, for example, lectures, telephone, television, and radio. Besides, diarization enhances the performance of several speech technologies such as speaker recognition, automatic transcription, and speaker tracking. Methodologies previously used in developing diarization systems are discussed. Prior results and techniques are studied and compared. Methods such as Hidden Markov Models and Gaussian Mixture Models that are used in speaker recognition and other speech technologies are also used in speaker diarization. The objective of this thesis is to develop a speaker diarization system in meeting domain. Experimental part of this work indicates that zero-crossing rate can be used effectively in breaking down the audio stream into segments, and adaptive Gaussian Models fit adequately short audio segments. Results show that 35 Gaussian Models and one second as average length of each segment are optimum values to build a diarization system for the tested data. Uniting the segments which are uttered by same speaker is done in a bottom-up clustering by a newapproach of categorizing the mixture weights.

Social networks and networking facilitating internationalization: Experiences of two Finnish fashion companies

Background: Fashion is a dynamic and creative industry where larger retailers are enjoying international success. Small businesses however are struggling in the face of international expansion, as they lack the necessary resources and managerial know-how. The Finnish fashion industry has neither been able to develop the industry environment to support small and micro firms nor has Finland relevant finance or public domains, such as, seen in other Nordic countries. Networking has been recognized to facilitate organizational growth and international expansion in industries such as manufacturing and high technology. It has enabled smaller companies to gain resources, knowledge and experiences otherwise unattainable. Objective: The purpose of this study was to explore how networking has been utilized in the Finnish fashion industry. Particularly social relationships and networks are examined, as they emphasize the importance of individuals. Exploration on the past actions should also provide insight how networks and networking could be utilized and developed in the future. Main findings: It was discovered that the Finnish fashion industry (social) network is rather dense. This was mainly due to the small size of the Finnish market. In the early years of the establishment of the company, close contacts seemed to be utilized. As a company expands and extends its business, the relationships tended to move towards more utilitarian in nature. However, in some cases, the long term relationships had also affectionate features, such as trust and commitment. International networking was found to have positive impact on business opportunities. Participation to events, such as trade shows, was perceived as one of the best ways to meet new international contacts and to develop ones network. Active networking in the Finnish market, however, created both domestic and international opportunities. Furthermore, cooperation and open communication were discovered to facilitate innovation and projects. The public sector seemed to lack the interest in supporting the fashion industry according to the interviewees. The major issues for the fashion industry still concerned, among others, funding, administrative guidance and public support for developing the industry as a whole.

Networks and partnerships in third party logistics service production

Third party logistics, and third party logistics providers and the services they offer have grown substantially in the last twenty years. Even though there has been extensive research on third party logistics providers, and regular industry reviews within the logistics industry, a closer research in the area of partner selection and network models in the third party logistics industry is missing. The perspective taken in this study was of expanding the network research into logistics service providers as the focal firm in the network. The purpose of the study is to analyze partnerships and networks in the third party logistics industry in order to define how networks are utilized in third party logistics markets, what have been the reasons for the partnerships, and whether there are benefits for the third party logistics provider that can be achieved through building networks and partnerships. The theoretical framework of this study was formed based on common theories in studying networks and partnerships in accordance with models of horizontal and vertical partnerships. The theories applied to the framework and context of this study included the strategic network view and the resource-based view. Applying these two network theories to the position and networks of third party logistics providers in an industrial supply chain, a theoretical model for analyzing the horizontal and vertical partnerships where the TPL provider is in focus was structured. The empirical analysis of TPL partnerships consisted of a qualitative document analysis of 33 partnership examples involving companies present in the Finnish TPL markets. For the research, existing documents providing secondary data on types of partnerships, reasons for the partnerships, and outcomes of the partnerships were searched from available online sources. Findings of the study revealed that third party logistics providers are evident in horizontal and vertical interactions varying in geographical coverage and the depth and nature of the relationship. Partnership decisions were found to be made on resource based reasons, as well as from strategic aspects. The discovered results of the partnerships in this study included cost reduction and effectiveness in the partnerships for improving existing services. In addition in partnerships created for innovative service extension, differentiation, and creation of additional value were discovered to have emerged as results of the cooperation. It can be concluded that benefits and competitive advantage can be created through building partnerships in order to expand service offering and seeking synergies.

Apply of energy storages in electricity distribution networks and reserve capacity applications

The Thesis is dedicated to development of an operative tool to support decision making of battery energy storages implementation in distribution networks. The basics of various battery technologies, their perspectives and challenges are represented in the Thesis. Mathematical equations that describe economic effect from battery energy storage installation are offered. The main factors that influence profitability of battery settings have been explored and mathematically defined. Mathematical model and principal trends of battery storage profitability under an impact of the major factors are determined. The meaning of annual net value was introduced to show the difference between savings and required costs. The model gives a clear vision for dependencies between annual net value and main factors. Proposals for optimal network and battery characteristics are suggested.