Reusing repository data: migration of data between repositories

Presentation at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

ADAM: A Decentralized Parallel Computer Architecture Featuring Fast Thread and Data Migration and a Uniform Hardware Abstraction

The furious pace of Moore's Law is driving computer architecture into a realm where the the speed of light is the dominant factor in system latencies. The number of clock cycles to span a chip are increasing, while the number of bits that can be accessed within a clock cycle is decreasing. Hence, it is becoming more difficult to hide latency. One alternative solution is to reduce latency by migrating threads and data, but the overhead of existing implementations has previously made migration an unserviceable solution so far. I present an architecture, implementation, and mechanisms that reduces the overhead of migration to the point where migration is a viable supplement to other latency hiding mechanisms, such as multithreading. The architecture is abstract, and presents programmers with a simple, uniform fine-grained multithreaded parallel programming model with implicit memory management. In other words, the spatial nature and implementation details (such as the number of processors) of a parallel machine are entirely hidden from the programmer. Compiler writers are encouraged to devise programming languages for the machine that guide a programmer to express their ideas in terms of objects, since objects exhibit an inherent physical locality of data and code. The machine implementation can then leverage this locality to automatically distribute data and threads across the physical machine by using a set of high performance migration mechanisms. An implementation of this architecture could migrate a null thread in 66 cycles -- over a factor of 1000 improvement over previous work. Performance also scales well; the time required to move a typical thread is only 4 to 5 times that of a null thread. Data migration performance is similar, and scales linearly with data block size. Since the performance of the migration mechanism is on par with that of an L2 cache, the implementation simulated in my work has no data caches and relies instead on multithreading and the migration mechanism to hide and reduce access latencies.

Computational framework to support integration of biomolecular and clinical data within a translational approach

Background The use of the knowledge produced by sciences to promote human health is the main goal of translational medicine. To make it feasible we need computational methods to handle the large amount of information that arises from bench to bedside and to deal with its heterogeneity. A computational challenge that must be faced is to promote the integration of clinical, socio-demographic and biological data. In this effort, ontologies play an essential role as a powerful artifact for knowledge representation. Chado is a modular ontology-oriented database model that gained popularity due to its robustness and flexibility as a generic platform to store biological data; however it lacks supporting representation of clinical and socio-demographic information. Results We have implemented an extension of Chado – the Clinical Module - to allow the representation of this kind of information. Our approach consists of a framework for data integration through the use of a common reference ontology. The design of this framework has four levels: data level, to store the data; semantic level, to integrate and standardize the data by the use of ontologies; application level, to manage clinical databases, ontologies and data integration process; and web interface level, to allow interaction between the user and the system. The clinical module was built based on the Entity-Attribute-Value (EAV) model. We also proposed a methodology to migrate data from legacy clinical databases to the integrative framework. A Chado instance was initialized using a relational database management system. The Clinical Module was implemented and the framework was loaded using data from a factual clinical research database. Clinical and demographic data as well as biomaterial data were obtained from patients with tumors of head and neck. We implemented the IPTrans tool that is a complete environment for data migration, which comprises: the construction of a model to describe the legacy clinical data, based on an ontology; the Extraction, Transformation and Load (ETL) process to extract the data from the source clinical database and load it in the Clinical Module of Chado; the development of a web tool and a Bridge Layer to adapt the web tool to Chado, as well as other applications. Conclusions Open-source computational solutions currently available for translational science does not have a model to represent biomolecular information and also are not integrated with the existing bioinformatics tools. On the other hand, existing genomic data models do not represent clinical patient data. A framework was developed to support translational research by integrating biomolecular information coming from different “omics” technologies with patient’s clinical and socio-demographic data. This framework should present some features: flexibility, compression and robustness. The experiments accomplished from a use case demonstrated that the proposed system meets requirements of flexibility and robustness, leading to the desired integration. The Clinical Module can be accessed in http://dcm.ffclrp.usp.br/caib/pg=iptrans webcite.

Integração de informação entre Sistemas Geracionais distintos: uma experiência e sistematização na ITV

A natural evolução dos sistemas de informação nas organizações envolve por um lado a instalação de equipamentos actualizados, e por outro a adopção de novas aplicações de suporte ao negócio, acompanhando o desenvolvimento dos mercados, as mudanças no modelo de negócio e a maturação da organização num novo contexto. Muitas vezes esta evolução implica a preservação dos dados existentes e de funcionalidades não cobertas pelas novas aplicações. Este facto leva ao desenvolvimento e execução de processos de migração de dados, de aplicações, e de integração de sistemas legados. Estes processos estão condicionados ao meio tecnológico disponível e ao conhecimento existente sobre os sistemas legados, sendo sensíveis ao contexto em que se desenrolam. Esta dissertação apresenta um estado da arte das abordagens à migração e integração, descreve as diversas alternativas, e ilustra de uma forma sistematizada e comparativa os exercícios realizados usando diferentes abordagens, num ambiente real de migração e integração em mudança.

Conceptual-physical bridging – From BPMN models to physical implementations on kettle

Developing and implementing data-oriented workflows for data migration processes are complex tasks involving several problems related to the integration of data coming from different schemas. Usually, they involve very specific requirements - every process is almost unique. Having a way to abstract their representation will help us to better understand and validate them with business users, which is a crucial step for requirements validation. In this demo we present an approach that provides a way to enrich incrementally conceptual models in order to support an automatic way for producing their correspondent physical implementation. In this demo we will show how B2K (Business to Kettle) system works transforming BPMN 2.0 conceptual models into Kettle data-integration executable processes, approaching the most relevant aspects related to model design and enrichment, model to system transformation, and system execution.

Using a domain-specific language to enrich ETL schemas

Today it is easy to find a lot of tools to define data migration schemas among different types of information systems. Data migration processes use to be implemented on a very diverse range of applications, ranging from conventional operational systems to data warehousing platforms. The implementation of a data migration process often involves a serious planning, considering the development of conceptual migration schemas at early stages. Such schemas help architects and engineers to plan and discuss the most adequate way to migrate data between two different systems. In this paper we present and discuss a way for enriching data migration conceptual schemas in BPMN using a domain-specific language, demonstrating how to convert such enriched schemas to a first correspondent physical representation (a skeleton) in a conventional ETL implementation tool like Kettle.

Estudio de los modos de vida e historia biológica de las poblaciones humanas de la región central de argentina desde el registro bioarqueológico. Lifestyles and biological history of human populations of the central region of argentina from bioarchaeological record.

Se pretende aportar al estudio de la estructura, historia biológica y estilos de vida de las poblaciones que habitaron la región central de Argentina durante el Holoceno, desde una perspectiva que combina los aportes teóricos y metodológicos de la Genética del paisaje y la Bioarqueología. Interesa a) identificar barreras de diferenciación morfológica entre poblaciones, b) poner a prueba modelos poblacionales para explicar la variación observada e identificar las variables que contribuyan a dicha diferenciación, c) evaluar la congruencia de los resultados obtenidos, d) reconstruir los patrones de movilidad residencial de las poblaciones, e) estudiar sus patrones dietarios considerando diferencias temporales y espaciales, f) identificar indicadores de diversos tipos de estrés (nutricional, funcional), así como traumas, g) estudiar las historias tafonómicas del registro bioarqueológico regional, y h) proponer un modelo para explicar el poblamiento y la evolución local de las poblaciones que habitaron esta región, a partir de la información arqueológica y bioantropológica. Para el análisis de los patrones espaciales de variación biológica se trabajará a partir del registro de rasgos epigenéticos craneales, medidas lineales y datos obtenidos a partir de morfometría geométrica sobre fotografías en 2D sobre muestras arqueológicas procedentes de esta región y de otras regiones geográficas de la Argentina. Para el análisis de la estructura de la población se trabajará a partir del cálculo de la matriz R para datos morfológicos y sus estimaciones derivadas (distancia D², Fst, coordenadas principales) y la aplicación del modelo de Harpending y Ward. Desde la genética del paisaje, se realizarán análisis de autocorrelación espacial, barreras genéticas y análisis geoestadísticos (kriging). Para el estudio de los modos de vida a partir del registro bioarqueológico se relevarán patologías dento-alveolares y alteraciones vinculadas con la salud bucal tales como desgaste dental –a nivel micro y macroscópico- caries, abscesos, pérdidas dentales antemortem, cálculos, hipoplasias, marcadores esqueletales de salud y lesiones traumáticas. Se analizarán isótopos estables (δ13C, δ15N, 86Sr y 87Sr) en restos óseos humanos de diversos sitios arqueológicos con el objetivo de reconstruir patrones dietarios y analizar la movilidad residencial y migración de las poblaciones. Paralelamente, se establecerán procedimientos de control tafonómico de los restos óseos, y se harán análisis específicos para estudiar las historias tafonómicas y evaluar el grado de integridad de los contextos de depositación y de las colecciones en general. Estimamos que el análisis de los patrones espaciales y temporales de variabilidad morfológica craneofacial, así como el estudio de las dietas a partir de información isotópica y bioarqueológica, de las migraciones y la movilidad residencial de las poblaciones a partir de isótopos de estroncio, la reconstrucción de comportamientos y actividades cotidianas a partir de marcadores de estrés músculo-esqueletal, en un marco cronológico y espacial constituye un aporte novedoso y eficaz que permitirá incrementar de manera substancial la información sobre la evolución de las poblaciones originarias del centro del territorio argentino. The aim of this project is to study the structure, biological history and lifestyles of the people that inhabitated the central region of Argentina during the Holocene, from a perspective that combines theoretical and methodological contributions of Landscape Genetics and Bioarchaeology. To analyze the spatial patterns of biological variation we consider epigenetic cranial traits, linear measurements and data obtained from geometric morphometric on 2D photographs. Morphological variation will be focused on landscape genetics (autocorrelation, genetic barriers and geostatistical analysis –kriging-) and population structure (matrix R, D², Fst, principal coordinates, Harpendig and Ward model). For the study of lifestyles from bioarchaeological record we consider alveolar pathologies and disorders related to oral health such as tooth wear, micro and macroscopic level, caries, abscesses, antemortem tooth loss, hypoplasia, markers skeletal health and traumatic injuries, as well as taphonomic processes. Stable isotopes will be analyzed (δ13C, d15N, 86Sr and 87Sr) in human skeletal remains from various archaeological sites in order to reconstruct and analyze dietary patterns of residential mobility and migration of populations. It will be established procedures of taphonomic control on skeletal remains, analysis to study taphonomic histories and assess the degree of completeness of depositional context and collection, in general terms. We consider that analysis of spatial and temporal patterns of variability in craniofacial morphology and the study of health and diets from isotopic and bioarchaeological data, migration and residential mobility patterns from strontium isotopes, as well as activity patterns from stress markers is a novel and effective contribution that will substantially increase the information about the local evolution of populations that inhabitated the center of Argentina.

Juvenile Recidivism Report, December 2005

The following report contains district-level numbers for the percent of juveniles in Iowa’s Juvenile Court System and the number who re-offended (subsequent complaint/s). These numbers represent the data available in the ICIS system for initial complaints in 2002, an subsequent complaints. The report also includes recidivism numbers for those counties that had more than 180 initial complaints These numbers are representative, but are not state totals. All districts are represented, but no all counties. The 5th District only includes Polk County due to a data migration issue that, at this time, does not allow the remaining 5th District counties data to be analyzed.

Verkkonaapuruston valvontatehtävien siirto mobiililaitteelta kiinteälle laitteelle PeerHood -verkossa

PeerHood -verkon mobiililaitteiden akkutehon säästämiseksi siirretään mobiililaitteen verkkonaapuruston valvontatehtävät kiinteälle laitteelle. Valvontatehtävien siirto on tarkoitus tehdä silloin, kun laite pysyy paikallaan, esimerkiksi toimisto tiloissa. Laitteen pysyessä paikallaan voidaan verkkonaapurustoa seurata kiinteän laitteen resursseilla ja päivittää verkkomuutokset mobiililaitteelle tarvittaessa. Mobiililaitteen ollessa vain kuuntelutilassa laite säästää akkutehoa, koska sen ei tarvitse aktiivisesti lähettää dataa verkkolaitteillaan. Verkkolaitteet pysyvät lepotilassa ja odottavat vain tulevaa dataa. Verkkonaapuruston valvontatehtävien siirto ei kuitenkaan vaikuta käyttäjän palveluiden hyödyntämiseen, joten verkkolaitteen akkutehon säästö riippuu suuresti käyttäjän toimista, käyttäjä voi edelleen käyttää muiden PeerHood laitteiden palveluita tai tarjota omiaan.

Migració a programari lliure de la infraestructura de servidors de CETRAMSA

Aquest projecte s'emmarca dins el màster en Programari lliure de la UOC, en l'especialitat de xarxes i sistemes operatius. En ell he col·laborat amb CETRAMSA, empresa dedicada a la informació i difusió al ciutadà de l'oferta de transport públic en l'àmbit metropolità de Barcelona, per dur a terme la migració de la seva infraestructura de servidors a programari lliure.

Toiminnanohjausjärjestelmän käyttöönoton onnistuminen ja siihen vaikuttavat tekijät Pyrollsack Oy:ssä

Tämä diplomityö käsittelee toiminnanohjausjärjestelmän käyttöönottoa ja käyttöönoton kriittisten menestystekijöiden toteutumista. Työn tavoitteena oli tutkia kirjallisuudessa esiintyviä käyttöönoton kriittisiä menestystekijöitä ja verrata niitä Pyrollsack Oy:n käyttöönottoprosessista saatuihin kokemuksiin. Tuloksena voidaan havaita menestystekijät sekä esittää parannusehdotuksia havaittuihin heikkouksiin. Käyttöönottoprojektissa vahvuuksina nähtiin huolellinen valmistautuminen projektiin, uuden toiminnanohjausjärjestelmän strategisen merkityksen ymmärtäminen, nopea päätöksenteko sekä operatiivisen käyttöönoton ajoitus ja vaiheistus. Heikkouksina nähtiin liiallinen viive suunnittelun ja toteutuksen välillä, riittämättömät henkilöresurssit, ohjausryhmän toimimattomuus, viestintä, muutosjohtaminen, puutteellinen tietojen konversio, koulutus sekä toimittajan puutteellinen ymmärrys tehdystä vaatimusmäärittelystä. Käyttöönotto tulisi nähdä laajana projektina, joka koskee koko organisaatiota. Pienissä ja keskisuurissa yrityksissä erityistä huomiota tulee kiinnittää henkilöresurssien riittävyyteen. Uusi toiminnanohjausjärjestelmä saattaa aiheuttaa hetkellisen taantuman toiminnan sujuvuudessa. Toiminnanohjausjärjestelmän hyödyt toiminnalle ovat vaikeasti mitattavissa ja usein positiiviset vaikutukset havaitaan vasta vuosien päästä.

Fedora Commons as core repository of the EU legislation

Presentation at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

Ensaios em gestão de risco e regulação bancária

Esta tese é constituída por três ensaios. O primeiro ensaio analisa a informação pública disponível sobre o risco das carteiras de crédito dos bancos brasileiros, sendo dividido em dois capítulos. O primeiro analisa a limitação da informação pública disponibilizada pelos bancos e pelo Banco Central, quando comparada a informação gerencial disponível internamente pelos bancos. Concluiu-se que existe espaço para o aumento da transparência na divulgação das informações, fato que vem ocorrendo gradativamente no Brasil através de novas normas relacionadas ao Pilar 3 de Basileia II e à divulgação de informações mais detalhas pelo Bacen, como, por exemplo, aquelas do “Top50” . A segunda parte do primeiro ensaio mostra a discrepância entre o índice de inadimplência contábil (NPL) e a probabilidade de inadimplência (PD) e também discute a relação entre provisão e perda esperada. Através da utilização de matrizes de migração e de uma simulação baseada na sobreposição de safras de carteira de crédito de grandes bancos, concluiu-se que o índice de inadimplência subestima a PD e que a provisão constituída pelos bancos é menor que a perda esperada do SFN. O segundo ensaio relaciona a gestão de risco à discriminação de preço. Foi desenvolvido um modelo que consiste em um duopólio de Cournot em um mercado de crédito de varejo, em que os bancos podem realizar discriminação de terceiro grau. Neste modelo, os potenciais tomadores de crédito podem ser de dois tipos, de baixo ou de alto risco, sendo que tomadores de baixo risco possuem demanda mais elástica. Segundo o modelo, se o custo para observar o tipo do cliente for alto, a estratégia dos bancos será não discriminar (pooling equilibrium). Mas, se este custo for suficientemente baixo, será ótimo para os bancos cobrarem taxas diferentes para cada grupo. É argumentado que o Acordo de Basileia II funcionou como um choque exógeno que deslocou o equilíbrio para uma situação com maior discriminação. O terceiro ensaio é divido em dois capítulos. O primeiro discute a aplicação dos conceitos de probabilidade subjetiva e incerteza Knigthiana a modelos de VaR e a importância da avaliação do “risco de modelo”, que compreende os riscos de estimação, especificação e identificação. O ensaio propõe que a metodologia dos “quatro elementos” de risco operacional (dados internos, externos, ambiente de negócios e cenários) seja estendida à mensuração de outros riscos (risco de mercado e risco de crédito). A segunda parte deste último ensaio trata da aplicação do elemento análise de cenários para a mensuração da volatilidade condicional nas datas de divulgação econômica relevante, especificamente nos dias de reuniões do Copom.

Sistemas de gerenciamento de bibliotecas: riscos decorrentes do processo de migração de dados

This work aims to analyze risks related to information technology (IT) in procedures related to data migration. This is done considering ALEPH, Integrated Libray System (ILS) that migrated data to the Library Module present in the software called Sistema Integrado de Gestão de Atividades Acadêmicas (SIGAA) at the Zila Mamede Central Library at the Federal University of Rio Grande do Norte (UFRN) in Natal/Brazil. The methodological procedure used was of a qualitative exploratory research with the realization of case study at the referred library in order to better understand this phenomenon. Data collection was able once there was use of a semi-structured interview that was applied with (11) subjects that are employed at the library as well as in the Technology Superintendence at UFRN. In order to examine data Content analysis as well as thematic review process was performed. After data migration the results of the interview were then linked to both analysis units and their system register with category correspondence. The main risks detected were: data destruction; data loss; data bank communication failure; user response delay; data inconsistency and duplicity. These elements point out implication and generate disorders that affect external and internal system users and lead to stress, work duplicity and hassles. Thus, some measures were taken related to risk management such as adequate planning, central management support, and pilot test simulations. For the advantages it has reduced of: risk, occurrence of problems and possible unforeseen costs, and allows achieving organizational objectives, among other. It is inferred therefore that the risks present in data bank conversion in libraries exist and some are predictable, however, it is seen that librarians do not know or ignore and are not very worried in the identification risks in data bank conversion, their acknowledge would minimize or even extinguish them. Another important aspect to consider is the existence of few empirical research that deal specifically with this subject and thus presenting the new of new approaches in order to promote better understanding of the matter in the corporate environment of the information units

Conversão de registros em XML para MARC 21: um modelo baseado em folhas de estilo XSLT

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)