Indoor Localization Solutions for a Marine Industry Augmented Reality Tool

In this report are described means for indoor localization in special, challenging circum-stances in marine industry. The work has been carried out in MARIN project, where a tool based on mobile augmented reality technologies for marine industry is developed. The tool can be used for various inspection and documentation tasks and it is aimed for improving the efficiency in design and construction work by offering the possibility to visualize the newest 3D-CAD model in real environment. Indoor localization is needed to support the system in initialization of the accurate camera pose calculation and auto-matically finding the right location in the 3D-CAD model. The suitability of each indoor localization method to the specific environment and circumstances is evaluated.

Applying Augmented Reality to Outdoors Industrial Use

Augmented Reality (AR) is currently gaining popularity in multiple different fields. However, the technology for AR still requires development in both hardware and software when considering industrial use. In order to create immersive AR applications, more accurate pose estimation techniques to define virtual camera location are required. The algorithms for pose estimation often require a lot of processing power, which makes robust pose estimation a difficult task when using mobile devices or designated AR tools. The difficulties are even larger in outdoor scenarios where the environment can vary a lot and is often unprepared for AR. This thesis aims to research different possibilities for creating AR applications for outdoor environments. Both hardware and software solutions are considered, but the focus is more on software. The majority of the thesis focuses on different visual pose estimation and tracking techniques for natural features. During the thesis, multiple different solutions were tested for outdoor AR. One commercial AR SDK was tested, and three different custom software solutions were developed for an Android tablet. The custom software solutions were an algorithm for combining data from magnetometer and a gyroscope, a natural feature tracker and a tracker based on panorama images. The tracker based on panorama images was implemented based on an existing scientific publication, and the presented tracker was further developed by integrating it to Unity 3D and adding a possibility for augmenting content. This thesis concludes that AR is very close to becoming a usable tool for professional use. The commercial solutions currently available are not yet ready for creating tools for professional use, but especially for different visualization tasks some custom solutions are capable of achieving a required robustness. The panorama tracker implemented in this thesis seems like a promising tool for robust pose estimation in unprepared outdoor environments.

Applications of augmented reality for sales in apparel industry in Russia

The sustainable growth of video interactivity technologies on different platforms in the lasts years opens good prospects for augmented reality technology adoption on different markets. In the end of 2011 there was an improvement in technology which allows building the 3D model of human body. Such an improvement could be used in apparel industry. The main goal of the study is to understand the level of acceptance of augmented reality as a technology on the Russian apparel market. For a more accurate investigation, a new model accounting for augmented reality characteristics, as well as for similarities and differences between online and offline customer behavior in apparel industry, was developed. As a result of the survey, the weights of different purchase intention factors for Russian consumer were found, and the information about Russian consumers’ preferences towards the augmented reality features in apparel market, especially in fitting time, real-time interaction and fitting quality peculiarities, was presented.

Developing usability evaluation heuristics for augmented reality applications

There is no generic usability heuristics for Augmented Reality (AR) applications, thus, the aim of this thesis was to develop one. The development of the heuristics was carried out in phases. Based on a literature review, a preliminary version of the heuristics was developed, which was evaluated by four experts. As a result, six evaluation criteria were formed: 1) interaction methods and controls, 2) presentation of virtual objects, 3) relationship between virtual objects and real world, 4) information related to virtual objects, 5) suitability for the usage context and 6) physical comfort of use. The heuristics should be used with Nielsen's (1995) generic usability evaluation heuristics. The heuristics are not ready to be used as such, since it must still be tested in practice.

Novel Interaction Techniques for Mobile Augmented Reality applications. A Systematic Literature Review

This study reviews the research on interaction techniques and methods that could be applied in mobile augmented reality scenarios. The review is focused on themost recent advances and considers especially the use of head-mounted displays. Inthe review process, we have followed a systematic approach, which makes the reviewtransparent, repeatable, and less prone to human errors than if it was conducted in amore traditional manner. The main research subjects covered in the review are headorientation and gaze-tracking, gestures and body part-tracking, and multimodality– as far as the subjects are related to human-computer interaction. Besides these,also a number of other areas of interest will be discussed.

Formal development of resilient distributed systems

Resilience is the property of a system to remain trustworthy despite changes. Changes of a different nature, whether due to failures of system components or varying operational conditions, significantly increase the complexity of system development. Therefore, advanced development technologies are required to build robust and flexible system architectures capable of adapting to such changes. Moreover, powerful quantitative techniques are needed to assess the impact of these changes on various system characteristics. Architectural flexibility is achieved by embedding into the system design the mechanisms for identifying changes and reacting on them. Hence a resilient system should have both advanced monitoring and error detection capabilities to recognise changes as well as sophisticated reconfiguration mechanisms to adapt to them. The aim of such reconfiguration is to ensure that the system stays operational, i.e., remains capable of achieving its goals. Design, verification and assessment of the system reconfiguration mechanisms is a challenging and error prone engineering task. In this thesis, we propose and validate a formal framework for development and assessment of resilient systems. Such a framework provides us with the means to specify and verify complex component interactions, model their cooperative behaviour in achieving system goals, and analyse the chosen reconfiguration strategies. Due to the variety of properties to be analysed, such a framework should have an integrated nature. To ensure the system functional correctness, it should rely on formal modelling and verification, while, to assess the impact of changes on such properties as performance and reliability, it should be combined with quantitative analysis. To ensure scalability of the proposed framework, we choose Event-B as the basis for reasoning about functional correctness. Event-B is a statebased formal approach that promotes the correct-by-construction development paradigm and formal verification by theorem proving. Event-B has a mature industrial-strength tool support { the Rodin platform. Proof-based verification as well as the reliance on abstraction and decomposition adopted in Event-B provides the designers with a powerful support for the development of complex systems. Moreover, the top-down system development by refinement allows the developers to explicitly express and verify critical system-level properties. Besides ensuring functional correctness, to achieve resilience we also need to analyse a number of non-functional characteristics, such as reliability and performance. Therefore, in this thesis we also demonstrate how formal development in Event-B can be combined with quantitative analysis. Namely, we experiment with integration of such techniques as probabilistic model checking in PRISM and discrete-event simulation in SimPy with formal development in Event-B. Such an integration allows us to assess how changes and di erent recon guration strategies a ect the overall system resilience. The approach proposed in this thesis is validated by a number of case studies from such areas as robotics, space, healthcare and cloud domain.

Depth sensors in augmented reality solutions. Literature review

The emergence of depth sensors has made it possible to track – not only monocular cues – but also the actual depth values of the environment. This is especially useful in augmented reality solutions, where the position and orientation (pose) of the observer need to be accurately determined. This allows virtual objects to be installed to the view of the user through, for example, a screen of a tablet or augmented reality glasses (e.g. Google glass, etc.). Although the early 3D sensors have been physically quite large, the size of these sensors is decreasing, and possibly – eventually – a 3D sensor could be embedded – for example – to augmented reality glasses. The wider subject area considered in this review is 3D SLAM methods, which take advantage of the 3D information available by modern RGB-D sensors, such as Microsoft Kinect. Thus the review for SLAM (Simultaneous Localization and Mapping) and 3D tracking in augmented reality is a timely subject. We also try to find out the limitations and possibilities of different tracking methods, and how they should be improved, in order to allow efficient integration of the methods to the augmented reality solutions of the future.

A software engineering approach to distributed systems for composite modeling

The goal of this thesis is to define and validate a software engineering approach for the development of a distributed system for the modeling of composite materials, based on the analysis of various existing software development methods. We reviewed the main features of: (1) software engineering methodologies; (2) distributed system characteristics and their effect on software development; (3) composite materials modeling activities and the requirements for the software development. Using the design science as a research methodology, the distributed system for creating models of composite materials is created and evaluated. Empirical experiments which we conducted showed good convergence of modeled and real processes. During the study, we paid attention to the matter of complexity and importance of distributed system and a deep understanding of modern software engineering methods and tools.

Data-parallel computation in parallel and distributed environments

The past few decades have seen a considerable increase in the number of parallel and distributed systems. With the development of more complex applications, the need for more powerful systems has emerged and various parallel and distributed environments have been designed and implemented. Each of the environments, including hardware and software, has unique strengths and weaknesses. There is no single parallel environment that can be identified as the best environment for all applications with respect to hardware and software properties. The main goal of this thesis is to provide a novel way of performing data-parallel computation in parallel and distributed environments by utilizing the best characteristics of difference aspects of parallel computing. For the purpose of this thesis, three aspects of parallel computing were identified and studied. First, three parallel environments (shared memory, distributed memory, and a network of workstations) are evaluated to quantify theirsuitability for different parallel applications. Due to the parallel and distributed nature of the environments, networks connecting the processors in these environments were investigated with respect to their performance characteristics. Second, scheduling algorithms are studied in order to make them more efficient and effective. A concept of application-specific information scheduling is introduced. The application- specific information is data about the workload extractedfrom an application, which is provided to a scheduling algorithm. Three scheduling algorithms are enhanced to utilize the application-specific information to further refine their scheduling properties. A more accurate description of the workload is especially important in cases where the workunits are heterogeneous and the parallel environment is heterogeneous and/or non-dedicated. The results obtained show that the additional information regarding the workload has a positive impact on the performance of applications. Third, a programming paradigm for networks of symmetric multiprocessor (SMP) workstations is introduced. The MPIT programming paradigm incorporates the Message Passing Interface (MPI) with threads to provide a methodology to write parallel applications that efficiently utilize the available resources and minimize the overhead. The MPIT allows for communication and computation to overlap by deploying a dedicated thread for communication. Furthermore, the programming paradigm implements an application-specific scheduling algorithm. The scheduling algorithm is executed by the communication thread. Thus, the scheduling does not affect the execution of the parallel application. Performance results achieved from the MPIT show that considerable improvements over conventional MPI applications are achieved.

Map matching by using inertial sensors: literature review

This literature review aims to clarify what is known about map matching by using inertial sensors and what are the requirements for map matching, inertial sensors, placement and possible complementary position technology. The target is to develop a wearable location system that can position itself within a complex construction environment automatically with the aid of an accurate building model. The wearable location system should work on a tablet computer which is running an augmented reality (AR) solution and is capable of track and visualize 3D-CAD models in real environment. The wearable location system is needed to support the system in initialization of the accurate camera pose calculation and automatically finding the right location in the 3D-CAD model. One type of sensor which does seem applicable to people tracking is inertial measurement unit (IMU). The IMU sensors in aerospace applications, based on laser based gyroscopes, are big but provide a very accurate position estimation with a limited drift. Small and light units such as those based on Micro-Electro-Mechanical (MEMS) sensors are becoming very popular, but they have a significant bias and therefore suffer from large drifts and require method for calibration like map matching. The system requires very little fixed infrastructure, the monetary cost is proportional to the number of users, rather than to the coverage area as is the case for traditional absolute indoor location systems.

Ennakoivan Bluetooth -verkon hyödyntäminen paikkatietoon pohjautuvan opastusjärjestelmän toteutuksessa

Tekniikan kehitys ja elämänrytmin kiihtyminen ajaa eteenpäin sekä tarvetta että mahdollisuuksia toteuttaahenkilökohtaisia opastusjärjestelmiä. Lyhyen kantaman langattomat kommunikaatioteknologiat mahdollistavat erilaisten paikkasidonnaisten palveluiden, kuten opastusjärjestelmien toteuttamisen kohtuullisilla kustannuksilla. Markkinoilla olevista järjestelmistä sisätiloihin sijoittuvaan reaaliaikaiseen opastukseen soveltuvaa järjestelmää on vaikea löytää ja useimmat niistä hyödyntävät WLAN -tekniikkaa, joka ei ole kovin laajasti tuettuna matkapuhelimen kaltaisissa kannettavissa päätelaitteissa. Tässä työssä tuodaan esille Bluetooth -tekniikalla toteutettavien reaaliaikaisten järjestelmien ongelmia ja esitellään yksi ratkaisumalli. Toimintaa vaikeuttaa lähinnä pitkä yhteyden muodostumisaika, joka koostuu verkon laitteiden hakemiseen kuluvasta pitkästä vaikeasti kestoltaan arvioitavasta ajasta ja valittuun kohteeseen yhteyden muodostamiseen kuluneesta ajasta. Toteutetussa Bluetooth -opastusjärjestelmässä opastettavien laitteiden hakeminen liityntäpistettä vaihdettaessa on voitu jättää pois, koska yhteyden muodostamiseen vaaditut tiedot välitetään liityntäpisteille kiinteän Ethernet -verkon välityksellä. Työntuloksena syntyneen opastusjärjestelmän käyttökokemukset osoittavat opastusverkon suunnittelun olevan haastava tehtävä, mutta verkon toimintakuntoon saattamisen jälkeen järjestelmän suorituskykyyn saadaan huomattava parannus. Demonstraatiototeutus rajoittaa käytettävän laitteiston Linux-pohjaisiin järjestelmiin, vaikka laajemman käyttöönoton varmistamiseksi järjestelmä tulisi tehdä siirrettäväksiesimerkiksi Symbian -alustalle.

Paikkatiedon hyödyntäminen Jabber-pikaviestintäohjelmistossa

Työn teoriaosuudessa tutustutaan ensin paikkatiedon käsitteeseen ja paikkatietoa hyödyntäviin palveluihin. Lisäksi perehdytään paikannukseen langattomissa lähiverkoissa ja erityisesti paikannukseen tämän diplomityön osalta käytettävässä verkossa. Työn teoriaosuudessa tutustutaan myös paikkatietoa hyödyntävien palveluiden hyöty- sekä haittanäkökulmiin. Teoriaosuudessa käydään myös läpi tällä hetkellä yleisimmät pikaviestintäarkkitehtuurit ja tutustutaan tarkemmin Jabber–pikaviestintäohjelmiston käyttämään protokollaan. Lopuksi tarkastellaan paikkatiedon hyödyntämiseen liittyviä lakiteknisiä seikkoja ja henkilön yksityisyyden suojaa. Diplomityön käytännön osuudessa tutustutaan paikkatietoa hyödyntävän palvelinkomponentin toteutukseen Jabber–arkkitehtuuria hyväksikäyttäen. Jabber-palvelinohjelmisto ja tehty komponentti toimivat langattomassa lähiverkossa (WLPR.NET), jota ylläpitää Lappeenrannan teknillisen yliopiston tietoliikennetekniikan laitos. Verkon käyttäjät voivat rekisteröityä palvelun käyttäjiksi, jonka jälkeen palvelinkomponentti pitää kirjaa rekisteröityneiden käyttäjien paikkatiedosta ja sen muutoksista. Lisäksi käyttäjät voivat hakea muiden käyttäjien paikkatietoa asiakasohjelmistossa toimivan hakutoiminnon avulla. Käyttäjien paikkatieto saadaan käyttämällä jo olemassa olevaa tekniikkaa.

Building distributed high availability system

Today’s commercial web sites are under heavy user load and they are expected to be operational and available at all times. Distributed system architectures have been developed to provide a scalable and failure tolerant high availability platform for these web based services. The focus on this thesis was to specify and implement resilient and scalable locally distributed high availability system architecture for a web based service. Theory part concentrates on the fundamental characteristics of distributed systems and presents common scalable high availability server architectures that are used in web based services. In the practical part of the thesis the implemented new system architecture is explained. Practical part also includes two different test cases that were done to test the system's performance capacity.

Maito- ja maitotuotetilastointijärjestelmän kehittäminen

Työn tavoitteena oli toteuttaa tietojärjestelmä maito- ja maitotuotetilastoinnin tarpeisiin. Tietojärjestelmän tulee tukea lähes koko tilastotuotantoprosessia tallentamisesta raportointiin. Tietojärjestelmän tarpeet tulivat vaatimusmäärittelystä ja ne piti yhdistää tietohallinnon linjauksiin. Tietojärjestelmä tehdä kustannustehokkaasti tietyssä aikataulussa. Lisäksi tuli luoda käytäntöjä tuleville tilastotietojärjestelmille. Työn teoriaosan aluksi käsitellään tilastotutkimuksen perusteita ja tilastoviranomaisvaatimuksia. Tästä edetään käytännön tilastotuotantoprosessiin ja sen järjestelmävaatimuksiin. Teoriaosan loppupuoliskossa käydään läpi ohjelmistotuotantoprosessi ja tietojärjestelmän suunnittelun peruskäsitteitä. Käytännön osassa puretaan vaatimukset ja ongelma-alue. Sitten analysoidaan eri ratkaisuvaihtoehtoja. Niistä päädytään toteutusratkaisuun, jonka tuloksia tarkastellaan projektin lopputulosten ja kahden vuoden käyttökokemusten perusteella. Tietojärjestelmä toteutettiin onnistuneesti ja se mahdollistaa taloudellisen sekä laadukkaan maito- ja maitotuotetilastoinnin Suomessa.

Formal Power Analysis of Systems-on-Chip

The design methods and languages targeted to modern System-on-Chip designs are facing tremendous pressure of the ever-increasing complexity, power, and speed requirements. To estimate any of these three metrics, there is a trade-off between accuracy and abstraction level of detail in which a system under design is analyzed. The more detailed the description, the more accurate the simulation will be, but, on the other hand, the more time consuming it will be. Moreover, a designer wants to make decisions as early as possible in the design flow to avoid costly design backtracking. To answer the challenges posed upon System-on-chip designs, this thesis introduces a formal, power aware framework, its development methods, and methods to constraint and analyze power consumption of the system under design. This thesis discusses on power analysis of synchronous and asynchronous systems not forgetting the communication aspects of these systems. The presented framework is built upon the Timed Action System formalism, which offer an environment to analyze and constraint the functional and temporal behavior of the system at high abstraction level. Furthermore, due to the complexity of System-on-Chip designs, the possibility to abstract unnecessary implementation details at higher abstraction levels is an essential part of the introduced design framework. With the encapsulation and abstraction techniques incorporated with the procedure based communication allows a designer to use the presented power aware framework in modeling these large scale systems. The introduced techniques also enable one to subdivide the development of communication and computation into own tasks. This property is taken into account in the power analysis part as well. Furthermore, the presented framework is developed in a way that it can be used throughout the design project. In other words, a designer is able to model and analyze systems from an abstract specification down to an implementable specification.