Big Data: applicazione di una λ-Architecture alla gestione batch di dati climatici

L’avanzamento tecnologico degli ultimi anni ha portato ad un aumento sostanziale dei dati generati giornalmente. L’analisi di queste ingenti quantità di dati si è rivelata essere troppo complessa per i sistemi tradizionali ed è stato pertanto necessario sviluppare nuovi approcci basati sul calcolo distribuito. I nuovi strumenti sviluppati in seguito a queste nuove necessità sono framework di calcolo parallelo basati sul paradigma del MapReduce, un modello di programmazione sviluppato da Google, e sistemi di gestione di basi di dati fluidi, in grado di trattare rapidamente grandi quantità di dati non strutturati. Lo scopo alla base di entrambi è quello di costruire sistemi scalabili orizzontalmente e utilizzabili su hardware di largo consumo. L’utilizzo di questi nuovi strumenti può comunque portare alla creazione di sistemi poco ottimizzati e di difficile gestione. Nathan Marz propone un’architettura a livelli che utilizza i nuovi strumenti in maniera congiunta per creare sistemi semplici e robusti: questa prende il nome di Lambda-Architecture. In questa tesi viene introdotto brevemente il concetto di Big Data e delle nuove problematiche ad esso associate, si procede poi ad illustrare i principi su cui si basano i nuovi strumenti di calcolo distribuito sviluppati per affrontarle. Viene poi definita l’Architettura Lambda di Nathan Marz, ponendo particolare attenzione su uno dei livelli che la compone, chiamato Batch Layer. I principi della Lambda Architecture sono infine applicati nella costruzione di un Batch Layer, utilizzato per l’analisi e la gestione di dati climatici con fini statistici.

Elaborazione di Big Data: un’applicazione dello Speed Layer di Lambda Architecture

I Big Data hanno forgiato nuove tecnologie che migliorano la qualità della vita utilizzando la combinazione di rappresentazioni eterogenee di dati in varie discipline. Occorre, quindi, un sistema realtime in grado di computare i dati in tempo reale. Tale sistema viene denominato speed layer, come si evince dal nome si è pensato a garantire che i nuovi dati siano restituiti dalle query funcions con la rapidità in cui essi arrivano. Il lavoro di tesi verte sulla realizzazione di un’architettura che si rifaccia allo Speed Layer della Lambda Architecture e che sia in grado di ricevere dati metereologici pubblicati su una coda MQTT, elaborarli in tempo reale e memorizzarli in un database per renderli disponibili ai Data Scientist. L’ambiente di programmazione utilizzato è JAVA, il progetto è stato installato sulla piattaforma Hortonworks che si basa sul framework Hadoop e sul sistema di computazione Storm, che permette di lavorare con flussi di dati illimitati, effettuando l’elaborazione in tempo reale. A differenza dei tradizionali approcci di stream-processing con reti di code e workers, Storm è fault-tolerance e scalabile. Gli sforzi dedicati al suo sviluppo da parte della Apache Software Foundation, il crescente utilizzo in ambito di produzione di importanti aziende, il supporto da parte delle compagnie di cloud hosting sono segnali che questa tecnologia prenderà sempre più piede come soluzione per la gestione di computazioni distribuite orientate agli eventi. Per poter memorizzare e analizzare queste moli di dati, che da sempre hanno costituito una problematica non superabile con i database tradizionali, è stato utilizzato un database non relazionale: HBase.

L'abbazia di S. Andrea de Vercelli : studio storico /

Edizioni di 600 esemplari.

An expert system on design of liquid-retaining structures with blackboard architecture

The design of liquid-retaining structures involves many decisions to be made by the designer based on rules of thumb, heuristics, judgement, codes of practice and previous experience. Structural design problems are often ill structured and there is a need to develop programming environments that can incorporate engineering judgement along with algorithmic tools. Recent developments in artificial intelligence have made it possible to develop an expert system that can provide expert advice to the user in the selection of design criteria and design parameters. This paper introduces the development of an expert system in the design of liquid-retaining structures using blackboard architecture. An expert system shell, Visual Rule Studio, is employed to facilitate the development of this prototype system. It is a coupled system combining symbolic processing with traditional numerical processing. The expert system developed is based on British Standards Code of Practice BS8007. Explanations are made to assist inexperienced designers or civil engineering students to learn how to design liquid-retaining structures effectively and sustainably in their design practices. The use of this expert system in disseminating heuristic knowledge and experience to practitioners and engineering students is discussed.

A knowledge-based system for liquid retaining structure design with blackboard architecture

Owing to the high degree of vulnerability of liquid retaining structures to corrosion problems, there are stringent requirements in its design against cracking. In this paper, a prototype knowledge-based system is developed and implemented for the design of liquid retaining structures based on the blackboard architecture. A commercially available expert system shell VISUAL RULE STUDIO working as an ActiveX Designer under the VISUAL BASIC programming environment is employed. Hybrid knowledge representation approach with production rules and procedural methods under object-oriented programming are used to represent the engineering heuristics and design knowledge of this domain. It is demonstrated that the blackboard architecture is capable of integrating different knowledge together in an effective manner. The system is tailored to give advice to users regarding preliminary design, loading specification and optimized configuration selection of this type of structure. An example of application is given to illustrate the capabilities of the prototype system in transferring knowledge on liquid retaining structure to novice engineers. (C) 2004 Elsevier Ltd. All rights reserved.

The Architecture of Looking

In 2010 the architects of thebigairworld participated in the creation of a film about Marcel Duchamp's Etant donnes. The film stages two architectural doctors, Haralambidou and Watson discussing Duchamp's piece with images of the work running in parallel. Off camera but by no means absent from the production the Mobile Studio act as camera man, director and grip.

Architecture, Energy, Matter

This book comprises a collection of essays and an edited selection of the work produced by Design Studio 18 (DS18) tutored by Lindsay Bremner and Roberto Bottazzi, 2013-2016.

The design studio as liminal space

The context of this research focuses on the efficacy of design studio as a form of teaching and learning. The established model of project-based teaching makes simple parallels between studio and professional practice. However, through comparison of the discourses it is clear that they are of different character. The protocols of the tutorial tradition can act to position the tutor as a defender of the knowledge community rather than a discourse guide for the student. The question arises as to what constitutes the core knowledge that would enable better self-directed study. Rather than focus on key knowledge, there has been an attempt in other fields to agree and share ‘threshold concepts’ within disciplinary knowledge. Meyer and Land describe threshold concepts as representing “a transformed way of understanding, or interpreting or viewing something without which the learner cannot progress [1]. The tutor’s role should be to assist in transforming student’s understanding through the mastery of the ‘troublesome knowledge’ that threshold concepts may embody. Teaching and learning environments under such approaches have been described as ‘liminal’: holding the learner in an ‘in-between’ state new understanding may be difficult and involve identity shifts. Research on the consequence of pressures on facilities and studio space concur, and indicate that studio spaces can be much better used in assisting the path of learning [2]. Through an overview map of threshold concepts, the opportunities for blended learning in supporting student learning in the liminal space of the design studio become much clearer [3] Design studio needs to be recontextualised within the discourse of higher education scholarship, based on a clarified curriculum built from an understanding of what constitutes its threshold concepts. The studio needs to be reconsidered as a space quite unlike that of the practitioner, a liminal space. 1. Meyer, J.H.F. and R. Land, Threshold concepts and troublesome knowledge. Overcoming Barriers to Student Learning: Threshold concepts and troublesome knowledge., 2006: p. 19. 2. Cai, H. and S. Khan, The Common First Year Studio in a Hot-desking Age: An Explorative Study on the Studio Environment and Learning. Journal for Education in the Built Environment 2010. 5(2): p. 39-64. 3. Pektas, S.T., The Blended Design Studio: An Appraisal of New Delivery Modes in Design Education. Procedia - Social and Behavioral Sciences, 2012. 51(0): p. 692-697.

Learning Environments in Design Studio Culture

The paper reports on a study of design studio culture from a student perspective. Learning in design studio culture has been theorised variously as a signature pedagogy emulating professional practice models, as a community of practice and as a form of problem-based learning, all largely based on the study of teaching events in studio. The focus of this research has extended beyond formally recognized activities to encompass the student’s experience of their social and community networks, working places and study set-ups, to examine how these have contributed to studio culture and how there have been supported by studio teaching. Semi-structured interviews with final year undergraduate students of architecture formed the basis of the study using an interpretivist approach informed by Actor-network theory, with studio culture featured as the focal actor, enrolling students and engaging with other actors, together constituting an actor-network of studio culture. The other actors included social community patterns and activities; the numerous working spaces (including but not limited to the studio space itself); the equipment, tools of trade and material pre-requisites for working; the portfolio enrolling the other actors to produce work for it; and the various formal and informal events associated with the course itself. Studio culture is a highly charged social arena: The question is how, and in particular, which aspects of it support learning? Theoretical models of situated learning and communities of practice models have informed the analysis, with Bourdieu’s theory of practice, and his interrelated concepts of habitus, field and capital providing a means of relating individually acquired habits and modes of working to social contexts. Bourdieu’s model of habitus involves the externalisation through the social realm of habits and knowledge previously internalised. It is therefore a useful model for considering whole individual learning activities; shared repertoires and practices located in the social realm. The social milieu of the studio provides a scene for the exercise and display of ‘practicing’ and the accumulation of a form of ‘practicing-capital’. This capital is a property of the social milieu rather than the space, so working or practicing in the company of others (in space and through social media) becomes a more valued aspect of studio than space or facilities alone. This practicing-capital involves the acquisition of a habitus of studio culture, with the transformation of physical practices or habits into social dispositions, acquiring social capital (driving the social milieu) and cultural capital (practicing-knowledge) in the process. The research drew on students’ experiences, and their practicing ‘getting a feel for the game’ by exploring the limits or boundaries of the field of studio culture. The research demonstrated that a notional studio community was in effect a social context for supporting learning; a range of settings to explore and test out newly internalised knowledge, demonstrate or display ideas, modes of thinking and practicing. The study presents a nuanced interpretation of how students relate to a studio culture that involves a notional community, and a developing habitus within a field of practicing that extends beyond teaching scenarios.

Studio ed integrazione di Grafana per la visualizzazione di flussi di dati generati dalla piattaforma semantica SEPA

Questo elaborato mostra lo sviluppo di un plugin per la visualizzazione in Grafana di eventi provenienti dalla piattaforma semantica SEPA (SPARQL Event Processing Architecture). La principale funzione svolta dal SEPA è quella di notificare in modo asincrono i propri client rispetto al cambiamento dei risultati di una query che interroga il sottostante grafo RDF. La piattaforma trova il suo utilizzo in quei contesti caratterizzati da dati dinamici, eterogenei e non strutturati e viene impiegata principalmente come strumento per abilitare l’interoperabilità in domini come per esempio l’Internet of Things. Nasce quindi l’esigenza di disporre di strumenti per il monitoraggio e la visualizzazione di dati real-time. Grafana risulta in questo caso lo strumento ideale data la sua flessibilità, che affiancata alla sua natura open source, lo rende particolarmente interessante per lo sviluppo della soluzione proposta da VAIMEE, spinoff dell’Università di Bologna, ospitato presso il CesenaLab, luogo dove è stato svolto questo lavoro di tesi.

A study on tackling visual odometry by a transformer architecture

This dissertation describes a deepening study about Visual Odometry problem tackled with transformer architectures. The existing VO algorithms are based on heavily hand-crafted features and are not able to generalize well to new environments. To train them, we need carefully fine-tune the hyper-parameters and the network architecture. We propose to tackle the VO problem with transformer because it is a general-purpose architecture and because it was designed to transformer sequences of data from a domain to another one, which is the case of the VO problem. Our first goal is to create synthetic dataset using BlenderProc2 framework to mitigate the problem of the dataset scarcity. The second goal is to tackle the VO problem by using different versions of the transformer architecture, which will be pre-trained on the synthetic dataset and fine-tuned on the real dataset, KITTI dataset. Our approach is defined as follows: we use a feature-extractor to extract features embeddings from a sequence of images, then we feed this sequence of embeddings to the transformer architecture, finally, an MLP is used to predict the sequence of camera poses.

SmartForge: An event-driven architecture for simulator-based process optimization

In the metal industry, and more specifically in the forging one, scrap material is a crucial issue and reducing it would be an important goal to reach. Not only would this help the companies to be more environmentally friendly and more sustainable, but it also would reduce the use of energy and lower costs. At the same time, the techniques for Industry 4.0 and the advancements in Artificial Intelligence (AI), especially in the field of Deep Reinforcement Learning (DRL), may have an important role in helping to achieve this objective. This document presents the thesis work, a contribution to the SmartForge project, that was performed during a semester abroad at Karlstad University (Sweden). This project aims at solving the aforementioned problem with a business case of the company Bharat Forge Kilsta, located in Karlskoga (Sweden). The thesis work includes the design and later development of an event-driven architecture with microservices, to support the processing of data coming from sensors set up in the company's industrial plant, and eventually the implementation of an algorithm with DRL techniques to control the electrical power to use in it.

Energy consumption of parallel algorithms for solving linear systems on HPC architecture

Modern High-Performance Computing HPC systems are gradually increasing in size and complexity due to the correspondent demand of larger simulations requiring more complicated tasks and higher accuracy. However, as side effects of the Dennard’s scaling approaching its ultimate power limit, the efficiency of software plays also an important role in increasing the overall performance of a computation. Tools to measure application performance in these increasingly complex environments provide insights into the intricate ways in which software and hardware interact. The monitoring of the power consumption in order to save energy is possible through processors interfaces like Intel Running Average Power Limit RAPL. Given the low level of these interfaces, they are often paired with an application-level tool like Performance Application Programming Interface PAPI. Since several problems in many heterogeneous fields can be represented as a complex linear system, an optimized and scalable linear system solver algorithm can decrease significantly the time spent to compute its resolution. One of the most widely used algorithms deployed for the resolution of large simulation is the Gaussian Elimination, which has its most popular implementation for HPC systems in the Scalable Linear Algebra PACKage ScaLAPACK library. However, another relevant algorithm, which is increasing in popularity in the academic field, is the Inhibition Method. This thesis compares the energy consumption of the Inhibition Method and Gaussian Elimination from ScaLAPACK to profile their execution during the resolution of linear systems above the HPC architecture offered by CINECA. Moreover, it also collates the energy and power values for different ranks, nodes, and sockets configurations. The monitoring tools employed to track the energy consumption of these algorithms are PAPI and RAPL, that will be integrated with the parallel execution of the algorithms managed with the Message Passing Interface MPI.