Data analytics in the cloud with flexible mapreduced workflows

Data analytic applications are characterized by large data sets that are subject to a series of processing phases. Some of these phases are executed sequentially but others can be executed concurrently or in parallel on clusters, grids or clouds. The MapReduce programming model has been applied to process large data sets in cluster and cloud environments. For developing an application using MapReduce there is a need to install/configure/access specific frameworks such as Apache Hadoop or Elastic MapReduce in Amazon Cloud. It would be desirable to provide more flexibility in adjusting such configurations according to the application characteristics. Furthermore the composition of the multiple phases of a data analytic application requires the specification of all the phases and their orchestration. The original MapReduce model and environment lacks flexible support for such configuration and composition. Recognizing that scientific workflows have been successfully applied to modeling complex applications, this paper describes our experiments on implementing MapReduce as subworkflows in the AWARD framework (Autonomic Workflow Activities Reconfigurable and Dynamic). A text mining data analytic application is modeled as a complex workflow with multiple phases, where individual workflow nodes support MapReduce computations. As in typical MapReduce environments, the end user only needs to define the application algorithms for input data processing and for the map and reduce functions. In the paper we present experimental results when using the AWARD framework to execute MapReduce workflows deployed over multiple Amazon EC2 (Elastic Compute Cloud) instances.

Cobalt complexes bearing scorpionate ligands: Synthesis, characterization, cytotoxicity and DNA cleavage

A number of novel, water-stable redox-active cobalt complexes of the C-functionalized tripodal ligands tris(pyrazolyl)methane XC(pz)(3) (X = HOCH2, CH2OCH2Py or CH2OSO2Me) are reported along with their effects on DNA. The compounds were isolated as air-stable solids and fully characterized by IR and FIR spectroscopies, ESI-MS(+/-), cyclic voltammetry, controlled potential electrolysis, elemental analysis and, in a number of cases, also by single-crystal X-ray diffraction. They showed moderate cytotoxicity in vitro towards HCT116 colorectal carcinoma and HepG2 hepatocellular carcinoma human cancer cell lines. This viability loss is correlated with an increase of tumour cell lines apoptosis. Reactivity studies with biomolecules, such as reducing agents, H2O2, plasmid DNA and UV-visible titrations were also performed to provide tentative insights into the mode of action of the complexes. Incubation of Co(II) complexes with pDNA induced double strand breaks, without requiring the presence of any activator. This pDNA cleavage appears to be mediated by O-centred radical species.

Catálise de hydrocraking baseado em zeólitos

Trabalho Final de Mestrado para obtenção do grau de Mestre em Engenharia Química

Probabilistic consensus clustering using evidence accumulation

Clustering ensemble methods produce a consensus partition of a set of data points by combining the results of a collection of base clustering algorithms. In the evidence accumulation clustering (EAC) paradigm, the clustering ensemble is transformed into a pairwise co-association matrix, thus avoiding the label correspondence problem, which is intrinsic to other clustering ensemble schemes. In this paper, we propose a consensus clustering approach based on the EAC paradigm, which is not limited to crisp partitions and fully exploits the nature of the co-association matrix. Our solution determines probabilistic assignments of data points to clusters by minimizing a Bregman divergence between the observed co-association frequencies and the corresponding co-occurrence probabilities expressed as functions of the unknown assignments. We additionally propose an optimization algorithm to find a solution under any double-convex Bregman divergence. Experiments on both synthetic and real benchmark data show the effectiveness of the proposed approach.

alpha-Co(OH)(2)/carbon nanofoam composite as electrochemical capacitor electrode operating at 2 V in aqueous medium

In this work, alpha-Co(OH)(2) is electrodeposited onto carbon nanofoam forming a composite electrode operating in a potential window of 2 V in aqueous medium. Prior to electrodeposition, the carbon nanofoam substrate is subjected to a functionalization process, which leads to an increase of about 40% in its specific capacitance value. Formation of cobalt hydroxide clusters onto the functionalized carbon nanofoam by pulse electrodeposition further enhances the specific capacitance of the electrode. The combination of these factors with an enlarged working potential window, results in a material with specific capacitance close to 300 F g(-1) at current density of 1 A g(-1), considering the total mass loading of the composite. This suggests the potential application of the prepared composites in high energy density electrochemical supercapacitors. (c) 2015 Elsevier B.V. All rights reserved.

Hydrogenating activity of Pt/zeolite catalysts focusing acid support and metal dispersion influence

Toluene hydrogenation was studied over catalysts based on Pt supported on large pore zeolites (HUSY and HBEA) with different metal/acid ratios. Acidity of zeolites was assessed by pyridine adsorption followed by FTIR showing only small changes before and after Pt introduction. Metal dispersion was determined by H2–O2 titration and verified by a linear correlation with the intensity of Pt0–CO band obtained by in situ FTIR. It was also observed that the electronic properties of Pt0 clusters were similar for the different catalysts. Catalytic tests showed rapid catalyst deactivation with an activity loss of 80–95% after 60 min of reaction. The turnover frequency of fresh catalysts depended both on metal dispersion and the support. For the same support, it changed by a 1.7-fold (HBEA) and 4.0-fold (HUSY) showing that toluene hydrogenation is structure-sensitive, i.e. hydrogenating activity is not a unique function of accessible metal. This was proposed to be due to the contribution to the overall activity of the hydrogenation of adsorbed toluene on acid sites via hydrogen spillover. Taking into account the role of zeolite acidity, the catalysts series were compared by the activity per total adsorbing sites which was observed to increase steadily with nPt/(nPt + nA). An increase of the accessible Pt atoms leads to an increase on the amount of spilled over hydrogen available in acid sites therefore increasing the overall activity. Pt/HBEA catalysts were found to be more active per total adsorbing site than Pt/HUSY which is proposed to be due to an augmentation in the efficiency of spilled over hydrogen diffusion related to the proximity between Pt clusters and acid sites. The intervention of Lewis acid sites in a greater extent than that measured by pyridine adsorption may also contribute to this higher activity of Pt/HBEA catalysts. These results reinforce the importance of model reactions as a closer perspective to the relevant catalyst properties in reaction conditions.

Temperature-induced structural transitions in self-assembling magnetic nanocolloids

With the help of a unique combination of density functional theory and computer simulations, we discover two possible scenarios, depending on concentration, for the hierarchical self-assembly of magnetic nanoparticles on cooling. We show that typically considered low temperature clusters, i.e. defect-free chains and rings, merge into more complex branched structures through only three types of defects: four-way X junctions, three-way Y junctions and two-way Z junctions. Our accurate calculations reveal the predominance of weakly magnetically responsive rings cross-linked by X defects at the lowest temperatures. We thus provide a strategy to fine-tune magnetic and thermodynamic responses of magnetic nanocolloids to be used in medical and microfluidics applications.

Enhancing the selection of a model-based clustering with external categorical variables

In cluster analysis, it can be useful to interpret the partition built from the data in the light of external categorical variables which are not directly involved to cluster the data. An approach is proposed in the model-based clustering context to select a number of clusters which both fits the data well and takes advantage of the potential illustrative ability of the external variables. This approach makes use of the integrated joint likelihood of the data and the partitions at hand, namely the model-based partition and the partitions associated to the external variables. It is noteworthy that each mixture model is fitted by the maximum likelihood methodology to the data, excluding the external variables which are used to select a relevant mixture model only. Numerical experiments illustrate the promising behaviour of the derived criterion.

A MAP approach to evidence accumulation clustering

The Evidence Accumulation Clustering (EAC) paradigm is a clustering ensemble method which derives a consensus partition from a collection of base clusterings obtained using different algorithms. It collects from the partitions in the ensemble a set of pairwise observations about the co-occurrence of objects in a same cluster and it uses these co-occurrence statistics to derive a similarity matrix, referred to as co-association matrix. The Probabilistic Evidence Accumulation for Clustering Ensembles (PEACE) algorithm is a principled approach for the extraction of a consensus clustering from the observations encoded in the co-association matrix based on a probabilistic model for the co-association matrix parameterized by the unknown assignments of objects to clusters. In this paper we extend the PEACE algorithm by deriving a consensus solution according to a MAP approach with Dirichlet priors defined for the unknown probabilistic cluster assignments. In particular, we study the positive regularization effect of Dirichlet priors on the final consensus solution with both synthetic and real benchmark data.

Earthquakes in western Iberia: improving the understanding of lithospheric deformation in a slowly deforming region

Mainland Portugal, on the southwestern edge of the European continent, is located directly north of the boundary between the Eurasian and Nubian plates. It lies in a region of slow lithospheric deformation (< 5 mm yr(-1)), which has generated some of the largest earthquakes in Europe, both intraplate (mainland) and interplate (offshore). Some offshore earthquakes are nucleated on old and cold lithospheric mantle, at depths down to 60 km. The seismicity of mainland Portugal and its adjacent offshore has been repeatedly classified as diffuse. In this paper, we analyse the instrumental earthquake catalogue for western Iberia, which covers the period between 1961 and 2013. Between 2010 and 2012, the catalogue was enriched with data from dense broad-band deployments. We show that although the plate boundary south of Portugal is diffuse, in that deformation is accommodated along several distributed faults rather than along one long linear plate boundary, the seismicity itself is not diffuse. Rather, when located using high-quality data, earthquakes collapse into well-defined clusters and lineations. We identify and characterize the most outstanding clusters and lineations of epicentres and correlate them with geophysical and tectonic features (historical seismicity, topography, geologically mapped faults, Moho depth, free-air gravity, magnetic anomalies and geotectonic units). Both onshore and offshore, clusters and lineations of earthquakes are aligned preferentially NNE-SSW and WNW-ESE. Cumulative seismic moment and epicentre density decrease from south to north, with increasing distance from the plate boundary. Only few earthquake lineations coincide with geologically mapped faults. Clusters and lineations that do not match geologically mapped faults may correspond to previously unmapped faults (e.g. blind faults), rheological boundaries or distributed fracturing inside blocks that are more brittle and therefore break more easily than neighbour blocks. The seismicity map of western Iberia presented in this article opens important questions concerning the regional seismotectonics. This work shows that the study of low-magnitude earthquakes using dense seismic deployments is a powerful tool to study lithospheric deformation in slowly deforming regions, such as western Iberia, where high-magnitude earthquakes occur with long recurrence intervals.

Spectral and dynamical invariants in a complete clustered network

The main result of this work is a new criterion for the formation of good clusters in a graph. This criterion uses a new dynamical invariant, the performance of a clustering, that characterizes the quality of the formation of clusters. We prove that the growth of the dynamical invariant, the network topological entropy, has the effect of worsening the quality of a clustering, in a process of cluster formation by the successive removal of edges. Several examples of clustering on the same network are presented to compare the behavior of other parameters such as network topological entropy, conductance, coefficient of clustering and performance of a clustering with the number of edges in a process of clustering by successive removal.

Comparing clustering solutions: the use of adjusted paired indices

In the present paper we compare clustering solutions using indices of paired agreement. We propose a new method - IADJUST - to correct indices of paired agreement, excluding agreement by chance. This new method overcomes previous limitations known in the literature as it permits the correction of any index. We illustrate its use in external clustering validation, to measure the accordance between clusters and an a priori known structure. The adjusted indices are intended to provide a realistic measure of clustering performance that excludes agreement by chance with ground truth. We use simulated data sets, under a range of scenarios - considering diverse numbers of clusters, clusters overlaps and balances - to discuss the pertinence and the precision of our proposal. Precision is established based on comparisons with the analytical approach for correction specific indices that can be corrected in this way are used for this purpose. The pertinence of the proposed correction is discussed when making a detailed comparison between the performance of two classical clustering approaches, namely Expectation-Maximization (EM) and K-Means (KM) algorithms. Eight indices of paired agreement are studied and new corrected indices are obtained.