56 resultados para ETL Systems

em Universidade do Minho


Relevância:

100.00% 100.00%

Publicador:

Resumo:

Usually, data warehousing populating processes are data-oriented workflows composed by dozens of granular tasks that are responsible for the integration of data coming from different data sources. Specific subset of these tasks can be grouped on a collection together with their relationships in order to form higher- level constructs. Increasing task granularity allows for the generalization of processes, simplifying their views and providing methods to carry out expertise to new applications. Well-proven practices can be used to describe general solutions that use basic skeletons configured and instantiated according to a set of specific integration requirements. Patterns can be applied to ETL processes aiming to simplify not only a possible conceptual representation but also to reduce the gap that often exists between two design perspectives. In this paper, we demonstrate the feasibility and effectiveness of an ETL pattern-based approach using task clustering, analyzing a real world ETL scenario through the definitions of two commonly used clusters of tasks: a data lookup cluster and a data conciliation and integration cluster.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

During the last few years many research efforts have been done to improve the design of ETL (Extract-Transform-Load) systems. ETL systems are considered very time-consuming, error-prone and complex involving several participants from different knowledge domains. ETL processes are one of the most important components of a data warehousing system that are strongly influenced by the complexity of business requirements, their changing and evolution. These aspects influence not only the structure of a data warehouse but also the structures of the data sources involved with. To minimize the negative impact of such variables, we propose the use of ETL patterns to build specific ETL packages. In this paper, we formalize this approach using BPMN (Business Process Modelling Language) for modelling more conceptual ETL workflows, mapping them to real execution primitives through the use of a domain-specific language that allows for the generation of specific instances that can be executed in an ETL commercial tool.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

ETL conceptual modeling is a very important activity in any data warehousing system project implementation. Owning a high-level system representation allowing for a clear identification of the main parts of a data warehousing system is clearly a great advantage, especially in early stages of design and development. However, the effort to model conceptually an ETL system rarely is properly rewarded. Translating ETL conceptual models directly into something that saves work and time on the concrete implementation of the system process it would be, in fact, a great help. In this paper we present and discuss a hybrid approach to this problem, combining the simplicity of interpretation and power of expression of BPMN on ETL systems conceptualization with the use of ETL patterns to produce automatically an ETL skeleton, a first prototype system, which has the ability to be executed in a commercial ETL tool like Kettle.

Relevância:

70.00% 70.00%

Publicador:

Resumo:

The MAP-i Doctoral Programme in Informatics, of the Universities of Minho, Aveiro and Porto

Relevância:

60.00% 60.00%

Publicador:

Resumo:

Today recovering urban waste requires effective management services, which usually imply sophisticated monitoring and analysis mechanisms. This is essential for the smooth running of the entire recycling process as well as for planning and control urban waste recovering. In this paper we present a business intelligence system especially designed and im- plemented to support regular decision-making tasks on urban waste management processes. The system provides a set of domain-oriented analytical tools for studying and characterizing poten- tial scenarios of collection processes of urban waste, as well as for supporting waste manage- ment in urban areas, allowing for the organization and optimization of collection services. In or- der to clarify the way the system was developed and the how it operates, particularly in process visualization and data analysis, we also present the organization model of the system, the ser- vices it disposes, and the interface platforms for exploring data.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Today it is easy to find a lot of tools to define data migration schemas among different types of information systems. Data migration processes use to be implemented on a very diverse range of applications, ranging from conventional operational systems to data warehousing platforms. The implementation of a data migration process often involves a serious planning, considering the development of conceptual migration schemas at early stages. Such schemas help architects and engineers to plan and discuss the most adequate way to migrate data between two different systems. In this paper we present and discuss a way for enriching data migration conceptual schemas in BPMN using a domain-specific language, demonstrating how to convert such enriched schemas to a first correspondent physical representation (a skeleton) in a conventional ETL implementation tool like Kettle.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Modeling Extract-Transform-Load (ETL) processes of a Data Warehousing System has always been a challenge. The heterogeneity of the sources, the quality of the data obtained and the conciliation process are some of the issues that must be addressed in the design phase of this critical component. Commercial ETL tools often provide proprietary diagrammatic components and modeling languages that are not standard, thus not providing the ideal separation between a modeling platform and an execution platform. This separation in conjunction with the use of standard notations and languages is critical in a system that tends to evolve through time and which cannot be undermined by a normally expensive tool that becomes an unsatisfactory component. In this paper we demonstrate the application of Relational Algebra as a modeling language of an ETL system as an effort to standardize operations and provide a basis for uncommon ETL execution platforms.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

Bioactive glasses, especially silica-based materials, are reported to pres- ent osteoconductive and osteoinductive properties, fundamental char- acteristics in bone regeneration [1,2]. Additionally, dexamethasone (Dex) is one of the bioactive agents able to induce the osteogenic differ- entiation of mesenchymal stem cells by increasing the alkaline phos- phatase activity, and the expression levels of Osteocalcin and Bone Sialoprotein [3]. Herein, we synthesised silica (SiO2) nanoparticles (that present inherent bioactivity and ability to act as a sustained drug delivery system), and coated their surface using poly-L-lysine (PLL) and hyaluronic acid (HA) using the layer-by-layer processing technique. Further on, we studied the influence of these new SiO2-polyelectrolyte coated nanoparticles as Dex sustained delivery systems. The SiO2 nanoparticles were loaded with Dex (SiO2-Dex) and coated with PLL and HA (SiO2-Dex-PLL-HA). Their Dex release profile was evaluated and a more sustained release was obtained with the SiO2-Dex-PLL-HA. All the particles were cultured with human bone marrow-derived mes- enchymal stem cells (hBMSCs) under osteogenic differentiation culture conditions. hBMSCs adhered, proliferated and differentiated towards the osteogenic lineage in the presence of SiO2 (DLS 174nm), SiO2-Dex (DLS 175nm) and SiO2-Dex-PLL-HA (DLS 679nm). The presence of these materials induced the overexpression of osteogenic transcripts, namely of Osteocalcin, Bone Sialoprotein and Runx2. Scanning Elec- tron Microscopy/Electron Dispersive Spectroscopy analysis demon- strated that hBMSCs synthesised calcium phosphates when cultured with SiO2-Dex and SiO2-Dex-PLL-HA nanoparticles. These results indi- cate the potential use of these SiO2-polyelectrolytes coated nanoparti- cles as dexamethasone delivery systems capable of promoting osteogenic differentiation of hBMSCs.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The development of organic materials displaying high two-photon absorption (TPA) has attracted much attention in recent years due to a variety of potential applications in photonics and optoelectronics, such as three-dimensional optical data storage, fluorescence imaging, two-photon microscopy, optical limiting, microfabrication, photodynamic therapy, upconverted lasing, etc. The most frequently employed structural motifs for TPA materials are donor–pi bridge–acceptor (D–pi–A) dipoles, donor–pi bridge–donor (D–pi–D) and acceptor–pi bridge-acceptor (A–pi–A) quadrupoles, octupoles, etc. In this work we present the synthesis and photophysical characterization of quadrupolar heterocyclic systems with potential applications in materials and biological sciences as TPA chromophores. Indole is a versatile building block for the synthesis of heterocyclic systems for several optoelectronic applications (chemosensors, nonlinear optical, OLEDs) due to its photophysical properties and donor electron ability and 4H-pyran-4-ylidene fragment is frequently used for the synthesis of red light-emitting materials. On the other hand, 2-(2,6-dimethyl-4H-pyran-4-ylidene)malononitrile (1) and 1,3-diethyl-dihydro-5-(2,6-dimethyl-4H-pyran-4-ylidene)-2-thiobarbituric (2) units are usually used as strong acceptor moieties for the preparation of π-conjugated systems of the push-pull type. These building blocks were prepared by Knoevenagel condensation of the corresponding ketone precursor with malononitrile or 1,3-diethyl-dihydro-2-thiobarbituric acid. The new quadrupolar 4H-pyran-4-ylidene fluorophores (3) derived from indole were prepared through condensation of 5-methyl-1H-indole-3-carbaldehyde with the acceptor precursors 1 and 2, in the presence of a catalytical amount of piperidine. The new compounds were characterized by the usual spectroscopic techniques (UV-vis., FT-IR and multinuclear NMR - 1H, 13C).

Relevância:

20.00% 20.00%

Publicador:

Resumo:

This paper presents a three-phase three-level fast battery charger for electric vehicles (EVs) based in a current-source converter (CSC). Compared with the traditional voltage-source converters used for fast battery chargers, the CSC can be seen as a natural buck-type converter, i.e., the output voltage can assume a wide range of values, which varies between zero and the maximum instantaneous value of the power grid phase-to-phase voltage. Moreover, using the CSC it is not necessary to use a dc-dc back-end converter in the battery side, and it is also possible to control the grid current in order to obtain a sinusoidal waveform, and in phase with the power grid voltage (unitary power factor). Along the paper is described in detail the proposed CSC for EVs fast battery charging systems: the circuit topology, the power control theory, the current control strategy and the grid synchronization algorithm. Several simulation results of the EV fast battery charger operating with a maximum power of 50 kW are presented.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

This paper assesses the feasibility of impregnation/encasement of phase change materials (PCMs) in lightweight aggregates (LWAs). An impregnation process was adopted to carry out the encasement study of two different PCMs in four different LWAs. The leakage of the impregnated/encased PCMs was studied when they were submitted to freeze/thawing and oven drying tests, separately. The results confirmed that, the impregnation/encasement method is effective with respect to the large thermal energy storage density, and can be suitable for applications were PCMs cannot be incorporated directly such as asphalt road pavements.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The Gibbs free energy of transfer of a methylene group, G*(CH2), is reported as a measure of the relative hydrophobicity of the equilibrium phases. Furthermore, G*(CH2) is a characteristic parameter of each tie-line, and for that reason can be used for comparing different tie-lines of a given aqueous two-phase system (ATPS) or even to establish comparisons among different ATPSs. In this work, the partition coefficients of a series of four dinitrophenylated-amino acids were experimentally determined, at 23 °C, in five different tie-lines of PEG8000(sodium or potassium) citrate ATPSs. G*(CH2) values were calculated from the partition coefficients and used to evaluate the relative hydrophobicity of the equilibrium phases. PEG8000potassium citrate ATPSs presented larger relative hydrophobicity than PEG8000sodium citrate ATPSs. Furthermore, the results obtained indicated that the PEG-rich phase (top phase) has higher affinity to participate in hydrophobic hydration interactions than the salt-rich phase (bottom phase).

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The acoustic emission (AE) technique is used for investigating the interfacial fracture and damage propagation in GFRP-and SRG-strengthened bricks during debonding tests. The bond behavior is investigated through single-lap shear bond tests and the fracture progress during the tests is recorded by means of AE sensors. The fracture progress and active debonding mechanisms are characterized in both specimen types with the aim of AE outputs. Moreover, a clear distinction between the AE outputs of specimens with different failure modes, in both SRG-and GFRP-strengthened specimens, is found which allows characterizing the debonding failure mode based on acoustic emission data.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

It is a difficult task to avoid the “smart systems” topic when discussing smart prevention and, similarly, it is a difficult task to address smart systems without focusing their ability to learn. Following the same line of thought, in the current reality, it seems a Herculean task (or an irreparable omission) to approach the topic of certified occupational health and safety management systems (OHSMS) without discussing the integrated management systems (IMSs). The available data suggest that seldom are the OHSMS operating as the single management system (MS) in a company so, any statement concerning OHSMS should mainly be interpreted from an integrated perspective. A major distinction between generic systems can be drawn between those that learn, i.e., those systems that have “memory” and those that have not. These former systems are often depicted as adaptive since they take into account past events to deal with novel, similar and future events modifying their structure to enable success in its environment. Often, these systems, present a nonlinear behavior and a huge uncertainty related to the forecasting of some events. This paper seeks to portray, for the first time as we were able to find out, the IMSs as complex adaptive systems (CASs) by listing their properties and dissecting the features that enable them to evolve and self-organize in order to, holistically, fulfil the requirements from different stakeholders and thus thrive by assuring the successful sustainability of a company. Based on the revision of literature carried out, this is the first time that IMSs are pointed out as CASs which may develop fruitful synergies both for the MSs and for CASs communities. By performing a thorough revision of literature and based on some concepts embedded in the “DNA” of the subsystems implementation standards it is intended, specifically, to identify, determine and discuss the properties of a generic IMS that should be considered to classify it as a CAS.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The MAP-i doctoral program of the Universities of Minho, Aveiro and Porto