Data-driven clustering : new methods and applications

Abstract : This work is concerned with the development and application of novel unsupervised learning methods, having in mind two target applications: the analysis of forensic case data and the classification of remote sensing images. First, a method based on a symbolic optimization of the inter-sample distance measure is proposed to improve the flexibility of spectral clustering algorithms, and applied to the problem of forensic case data. This distance is optimized using a loss function related to the preservation of neighborhood structure between the input space and the space of principal components, and solutions are found using genetic programming. Results are compared to a variety of state-of--the-art clustering algorithms. Subsequently, a new large-scale clustering method based on a joint optimization of feature extraction and classification is proposed and applied to various databases, including two hyperspectral remote sensing images. The algorithm makes uses of a functional model (e.g., a neural network) for clustering which is trained by stochastic gradient descent. Results indicate that such a technique can easily scale to huge databases, can avoid the so-called out-of-sample problem, and can compete with or even outperform existing clustering algorithms on both artificial data and real remote sensing images. This is verified on small databases as well as very large problems. Résumé : Ce travail de recherche porte sur le développement et l'application de méthodes d'apprentissage dites non supervisées. Les applications visées par ces méthodes sont l'analyse de données forensiques et la classification d'images hyperspectrales en télédétection. Dans un premier temps, une méthodologie de classification non supervisée fondée sur l'optimisation symbolique d'une mesure de distance inter-échantillons est proposée. Cette mesure est obtenue en optimisant une fonction de coût reliée à la préservation de la structure de voisinage d'un point entre l'espace des variables initiales et l'espace des composantes principales. Cette méthode est appliquée à l'analyse de données forensiques et comparée à un éventail de méthodes déjà existantes. En second lieu, une méthode fondée sur une optimisation conjointe des tâches de sélection de variables et de classification est implémentée dans un réseau de neurones et appliquée à diverses bases de données, dont deux images hyperspectrales. Le réseau de neurones est entraîné à l'aide d'un algorithme de gradient stochastique, ce qui rend cette technique applicable à des images de très haute résolution. Les résultats de l'application de cette dernière montrent que l'utilisation d'une telle technique permet de classifier de très grandes bases de données sans difficulté et donne des résultats avantageusement comparables aux méthodes existantes.

CE-ESI-TOF/MS for human growth hormone analysis.

CE is a powerful analytical tool used to separate intact biomolecules such as proteins. The coupling of CE with TOF/MS produces a very promising method that can be used to detect and identify proteins in different matrices. This paper describes an efficient, rapid, and simple CE-ESI-TOF/MS procedure for the analysis of endogenous human growth hormone and recombinant human growth hormone without sample preparation. Operational factors were optimized using an experimental design, and the method was successfully applied to distinguish human growth hormone and recombinant human growth hormone in unknown samples.

Optimization of HS-SPME/GC-MS analysis and its use in the profiling of illicit ecstasy tablets (Part 1)

A headspace solid-phase microextraction procedure (HS-SPME) was developed for the profiling of traces present in 3,4-methylenedioxymethylampethamine (MDMA). Traces were first extracted using HS-SPME and then analyzed by gas chromatography-mass spectroscopy (GC-MS). The HS-SPME conditions were optimized using varying conditions. Optimal results were obtained when 40 mg of crushed MDMA sample was heated at 80 °C for 15 min, followed by extraction at 80 °C for 15 min with a polydimethylsiloxane/divinylbenzene coated fibre. A total of 31 compounds were identified as traces related to MDMA synthesis, namely precursors, intermediates or by-products. In addition some fatty acids used as tabletting materials and caffeine used as adulterant, were also detected. The use of a restricted set of 10 target compounds was also proposed for developing a screening tool for clustering samples having close profile. 114 seizures were analyzed using an SPME auto-sampler (MultiPurpose Samples MPS2), purchased from Gerstel GMBH & Co. (Germany), and coupled to GC-MS. The data was handled using various pre-treatment methods, followed by the study of similarities between sample pairs based on the Pearson correlation. The results show that HS-SPME, coupled with the suitable statistical method is a powerful tool for distinguishing specimens coming from the same seizure and specimens coming from different seizures. This information can be used by law enforcement personnel to visualize the ecstasy distribution network as well as the clandestine tablet manufacturing.

Development and application of computational methodologies in qualitative modeling

La présente thèse s'intitule "Développent et Application des Méthodologies Computationnelles pour la Modélisation Qualitative". Elle comprend tous les différents projets que j'ai entrepris en tant que doctorante. Plutôt qu'une mise en oeuvre systématique d'un cadre défini a priori, cette thèse devrait être considérée comme une exploration des méthodes qui peuvent nous aider à déduire le plan de processus regulatoires et de signalisation. Cette exploration a été mue par des questions biologiques concrètes, plutôt que par des investigations théoriques. Bien que tous les projets aient inclus des systèmes divergents (réseaux régulateurs de gènes du cycle cellulaire, réseaux de signalisation de cellules pulmonaires) ainsi que des organismes (levure à fission, levure bourgeonnante, rat, humain), nos objectifs étaient complémentaires et cohérents. Le projet principal de la thèse est la modélisation du réseau de l'initiation de septation (SIN) du S.pombe. La cytokinèse dans la levure à fission est contrôlée par le SIN, un réseau signalant de protéines kinases qui utilise le corps à pôle-fuseau comme échafaudage. Afin de décrire le comportement qualitatif du système et prédire des comportements mutants inconnus, nous avons décidé d'adopter l'approche de la modélisation booléenne. Dans cette thèse, nous présentons la construction d'un modèle booléen étendu du SIN, comprenant la plupart des composantes et des régulateurs du SIN en tant que noeuds individuels et testable expérimentalement. Ce modèle utilise des niveaux d'activité du CDK comme noeuds de contrôle pour la simulation d'évènements du SIN à différents stades du cycle cellulaire. Ce modèle a été optimisé en utilisant des expériences d'un seul "knock-out" avec des effets phénotypiques connus comme set d'entraînement. Il a permis de prédire correctement un set d'évaluation de "knock-out" doubles. De plus, le modèle a fait des prédictions in silico qui ont été validées in vivo, permettant d'obtenir de nouvelles idées de la régulation et l'organisation hiérarchique du SIN. Un autre projet concernant le cycle cellulaire qui fait partie de cette thèse a été la construction d'un modèle qualitatif et minimal de la réciprocité des cyclines dans la S.cerevisiae. Les protéines Clb dans la levure bourgeonnante présentent une activation et une dégradation caractéristique et séquentielle durant le cycle cellulaire, qu'on appelle communément les vagues des Clbs. Cet évènement est coordonné avec la courbe d'activation inverse du Sic1, qui a un rôle inhibitoire dans le système. Pour l'identification des modèles qualitatifs minimaux qui peuvent expliquer ce phénomène, nous avons sélectionné des expériences bien définies et construit tous les modèles minimaux possibles qui, une fois simulés, reproduisent les résultats attendus. Les modèles ont été filtrés en utilisant des simulations ODE qualitatives et standardisées; seules celles qui reproduisaient le phénotype des vagues ont été gardées. L'ensemble des modèles minimaux peut être utilisé pour suggérer des relations regulatoires entre les molécules participant qui peuvent ensuite être testées expérimentalement. Enfin, durant mon doctorat, j'ai participé au SBV Improver Challenge. Le but était de déduire des réseaux spécifiques à des espèces (humain et rat) en utilisant des données de phosphoprotéines, d'expressions des gènes et des cytokines, ainsi qu'un réseau de référence, qui était mis à disposition comme donnée préalable. Notre solution pour ce concours a pris la troisième place. L'approche utilisée est expliquée en détail dans le dernier chapitre de la thèse. -- The present dissertation is entitled "Development and Application of Computational Methodologies in Qualitative Modeling". It encompasses the diverse projects that were undertaken during my time as a PhD student. Instead of a systematic implementation of a framework defined a priori, this thesis should be considered as an exploration of the methods that can help us infer the blueprint of regulatory and signaling processes. This exploration was driven by concrete biological questions, rather than theoretical investigation. Even though the projects involved divergent systems (gene regulatory networks of cell cycle, signaling networks in lung cells), as well as organisms (fission yeast, budding yeast, rat, human), our goals were complementary and coherent. The main project of the thesis is the modeling of the Septation Initiation Network (SIN) in S.pombe. Cytokinesis in fission yeast is controlled by the SIN, a protein kinase signaling network that uses the spindle pole body as scaffold. In order to describe the qualitative behavior of the system and predict unknown mutant behaviors we decided to adopt a Boolean modeling approach. In this thesis, we report the construction of an extended, Boolean model of the SIN, comprising most SIN components and regulators as individual, experimentally testable nodes. The model uses CDK activity levels as control nodes for the simulation of SIN related events in different stages of the cell cycle. The model was optimized using single knock-out experiments of known phenotypic effect as a training set, and was able to correctly predict a double knock-out test set. Moreover, the model has made in silico predictions that have been validated in vivo, providing new insights into the regulation and hierarchical organization of the SIN. Another cell cycle related project that is part of this thesis was to create a qualitative, minimal model of cyclin interplay in S.cerevisiae. CLB proteins in budding yeast present a characteristic, sequential activation and decay during the cell cycle, commonly referred to as Clb waves. This event is coordinated with the inverse activation curve of Sic1, which has an inhibitory role in the system. To generate minimal qualitative models that can explain this phenomenon, we selected well-defined experiments and constructed all possible minimal models that, when simulated, reproduce the expected results. The models were filtered using standardized qualitative ODE simulations; only the ones reproducing the wave-like phenotype were kept. The set of minimal models can be used to suggest regulatory relations among the participating molecules, which will subsequently be tested experimentally. Finally, during my PhD I participated in the SBV Improver Challenge. The goal was to infer species-specific (human and rat) networks, using phosphoprotein, gene expression and cytokine data and a reference network provided as prior knowledge. Our solution to the challenge was selected as in the final chapter of the thesis.

THE IMPACT OF ARCHITECTURAL DESIGN ON SOFTWARE DEVELOPMENT

Tässä työssä tutkitaan ohjelmistoarkkitehtuurisuunnitteluominaisuuksien vaikutusta erään client-server –arkkitehtuuriin perustuvan mobiilipalvelusovelluksen suunnittelu- ja toteutusaikaan. Kyseinen tutkimus perustuu reaalielämän projektiin, jonka kvalitatiivinen analyysi paljasti arkkitehtuurikompponenttien välisten kytkentöjen merkittävästi vaikuttavan projektin työmäärään. Työn päätavoite oli kvantitatiivisesti tutkia yllä mainitun havainnon oikeellisuus. Tavoitteen saavuttamiseksi suunniteltiin ohjelmistoarkkitehtuurisuunnittelun mittaristo kuvaamaan kyseisen järjestelmän alijärjestelmien arkkitehtuuria ja luotiin kaksi suunniteltua mittaristoa käyttävää, työmäärää (komponentin suunnittelu-, toteutus- ja testausaikojen summa) arvioivaa mallia, joista toinen on lineaarinen ja toinen epälineaarinen. Näiden mallien kertoimet sovitettiin optimoimalla niiden arvot epälineaarista gloobaalioptimointimenetelmää, differentiaalievoluutioalgoritmia, käyttäen, niin että mallien antamat arvot vastasivat parhaiten mitattua työmäärää sekä kaikilla ominaisuuksilla eli attribuuteilla että vain osalla niistä (yksi jätettiin vuorotellen pois). Kun arkkitehtuurikompenttien väliset kytkennät jätettiin malleista pois, mitattujen ja arvoitujen työmäärien välinen ero (ilmaistuna virheenä) kasvoi eräässä tapauksessa 367 % entisestä tarkoittaen sitä, että näin muodostettu malli vastasi toteutusaikoja huonosti annetulla ainestolla. Tämä oli suurin havaitu virhe kaikkien poisjätettyjen ominaisuuksien kesken. Saadun tuloksen perusteella päätettiin, että kyseisen järjestelmän toteutusajat ovat vahvasti riippuvaisia kytkentöjen määrästä, ja näin ollen kytkentöjen määrä oli mitä todennäköisemmin kaikista tärkein työmäärään vaikuttava tekijä tutkitun järjestelmän arkkitehtuurisuunnittelussa.

Tietoverkon varmistusten simulointi ja optimointi

Tässä diplomityössä määritellään varmistusjärjestelmän simulointimalli eli varmistusmalli. Varmistusjärjestelmän toiminta optimoidaan kyseisen varmistusmallin avulla. Optimoinnin tavoitteena on parantaa varmistusjärjestelmän tehokkuutta. Parannusta etsitään olemassa olevien varmistusjärjestelmän resurssien maksimaalisella hyödyntämisellä. Varmistusmalli optimoidaan evoluutioalgoritmin avulla. Optimoinnissa on useita tavoitteita, jotka ovat ristiriidassa keskenään. Monitavoiteoptimointiongelma muunnetaan yhden tavoitteen optimointiongelmaksi muodostamalla tavoitefunktio painotetun summan menetelmän avulla. Rinnakkain edellisen menetelmän kanssa käytetään myös Pareto-optimointia. Pareto-optimaalisen rintaman pisteiden etsintä ohjataan lähelle painotetun summan menetelmän optimipistettä. Evoluutioalgoritmin toteutuksessa käytetään hyväksi varmistusjärjestelmiin liittyvää ongelmakohtaista tietoa. Työn tuloksena saadaan varmistusjärjestelmän simulointi- sekä optimointityökalu. Simulointityökalua käytetään kartoittamaan nykyisen varmistusjärjestelmän toimivuutta. Optimoinnin avulla tehostetaan varmistusjärjestelmän toimintaa. Työkalua voidaan käyttää myös uusien varmistusjärjestelmien suunnittelussa sekä nykyisten varmistusjärjestelmien laajentamisessa.

Análise estrutural de ciclodextrinas: um estudo comparativo entre métodos teóricos clássicos e quânticos

In the present work, we analyzed the accuracy of distinct theoretical methods to reproduce the solid state structures of cyclodextrins. The a, b and g-cyclodextrins (CD) were considered and also their hydrates with included water molecules: a-CD.2H2O, b-CD.10H2O and g-CD.12H2O. The geometries were fully optimized using Molecular Mechanics (MM2), semiempirical (AM1 and PM3) and ab initio (HF/3-21G) methods and quantitatively compared with experimental data from X ray diffraction. The results obtained from the classical MM2 method were in best agreement with the experiment. The semiempirical and ab initio structures were also in satisfactory accordance with the experimental data. In general, the PM3 method was found to be more suitable than the AM1 to describe the CD geometries, mainly when the intramolecular hydrogen bonds are considered.

Azul de metileno imobilizado na celulose/TiO2 e SiO2/TiO2: propriedades eletroquímicas e planejamento fatorial

The electrochemical properties of methylene blue immobilized on cellulose/TiO2 and mixed oxide SiO2/TiO2 matrices were investigated by means of cyclic voltammetry. The electron mediator property of the methylene blue was optimized using a factorial design, consisting of four factors in two levels. The experimental observations and data analyses on the system indicate that the lowest peak separation occurs for Sil/TiOAM, 1.0 mol L-1 KCl solution and 20 mV s-1 scan rate, while values of current ratio closest to unity were found for Cel/TiOAM independent of electrolyte concentration, 0.2 or 1.0 mol L-1, and scan rate, 20 mV s-1 or 60 mV s-1.

Otimização das condições de produção de ésteres etílicos a partir de óleo de peixe com elevado teor de ácidos graxos ômega-3

The production of ethyl esters by alcoholysis is an alternative for splitting triacylglycerols due to the possibility of using low temperatures, which results in oxidative protection of the polyunsaturated fatty acids. Ethyl esters produced under mild conditions of temperature could be used as substrate for obtaining structured lipids. The reaction parameters of production of ethyl esters from fish oil with high content of omega-3 fatty acids by alcoholysis were optimized using response surface methodology. An experimental design (2³) (with levels +1 and -1, six axial points with levels -alpha and +alpha and three central points) was applied. The variables investigated were concentration of catalyst, amount of ethyl alcohol and temperature. Ethyl ester conversion was monitored by high performance size exclusion chromatography (HPSEC) and the best result obtained was 95% conversion rate. The optimal conditions were 40 °C, 1% of NaOH and 36% of ethanol.

Un método de bajo costo para la determinación de cobre a nivel de vestigios en matrices de interés ambiental por espectrofotometría en fase sólida (EFS)

A method for determining copper by solid phase spectrophotometry (SPS) was optimized using the Doehlert design. Copper(II) was sorbed on a styrene-divinylbenzene anion-exchange resin as a Cu(II)-1-(2-pyridylazo)-2-naphthol (PAN) complex, at pH 7.0. Resin phase absorbances at 560 and 800 nm were measured directly. The detection limit was found to be 2.5 µg L-1. The relative standard deviation on ten replicate determinations of 10 µg Cu(II) in 1000 mL samples was 1.1%. The linear range of the determination was 5.0-100 µg L-1. The method was applied successfully to the determination of Cu(II) in natural water and vegetable samples.

Imobilização de lacase de Aspergillus sp. em quitosana e sua aplicação na bioconversão de fenóis em reatores de leito fixo

The immobilization of laccase on chitosan by cross-linking and application of the immobilized laccase in the bioconversion of phenolic compounds in batch and fixed bed reactors were studied. The process for immobilization of enzyme was optimized using a rotational central composite design. The optimized conditions to generate immobilized laccase with maximal activity were determined to be a glutaraldehyde concentration of 1.0% (v/v), a pH of 6.0, an immobilization time of 5.0 hours and an enzyme concentration of 5.2 g L-1. In packed bed reactors, the activity of the immobilized enzyme is maintained for a longer time in the bioconversion of 2,6-dimethoxyphenol than in the bioconversion of syringaldazine.

ESTERIFICAÇÃO E TRANSESTERIFICAÇÃO SIMULTÂNEAS DE ÓLEOS ÁCIDOS UTILIZANDO CARBOXILATOS LAMELARES DE ZINCO COMO CATALISADORES BIFUNCIONAIS

Palm oil containing 40% fatty acids was converted to methyl esters using zinc carboxylates as the esterification/transesterification catalyst. The reaction was optimized using a factorial design in which the effects of the alcohol:fatty acids molar ratio (MRAG) and the catalyst concentration (CAT) were assessed. The best conversion was achieved with CAT at 4 wt% and MRAG at 4:1. However, the solid catalyst presented significant structural changes after use. For instance, laurate anions were replaced by carboxylates of higher molecular mass, leading to the formation of a new catalytically active layered structure. Also, the glycerin obtained as a co-product contained 86 wt% glycerol.

Modeling, optimizing and simulating robot calibration with accuracy improvement

This work describes techniques for modeling, optimizing and simulating calibration processes of robots using off-line programming. The identification of geometric parameters of the nominal kinematic model is optimized using techniques of numerical optimization of the mathematical model. The simulation of the actual robot and the measurement system is achieved by introducing random errors representing their physical behavior and its statistical repeatability. An evaluation of the corrected nominal kinematic model brings about a clear perception of the influence of distinct variables involved in the process for a suitable planning, and indicates a considerable accuracy improvement when the optimized model is compared to the non-optimized one.

FE-analyysin soveltaminen S960 QC teräksisen I-profiilin äärikestävyyden määrittämisessä

Tässä työssä tutkittiin FE-analyysin soveltamista S960 QC teräksisen I-profiilin kestävyyden määrittämisessä. Työn tavoitteena oli tarkastella nykyisten suunnitteluohjeiden soveltuvuutta ultralujille teräksille ja koota ohjemateriaali I-profiilin optimoimisesta sekä FE-analyysin hyö-dyntämisestä I-profiilin staattisen ja dynaamisen kestävyyden määrittämisessä. I-profiili mitoitettiin ja optimoitiin Eurokoodi 3:ssa esitettyjen PL3 mukaisten mitoitusohjeiden avulla. Rakenteelle suoritettiin Eurokoodi 3:n ja IIW:n mukaiset lommahdus-, kiepahdus- ja vä-symiskestävyystarkastelut. Väsymistarkastelussa sovellettiin nimellisen jännityksen, rakenteelli-sen jännityksen ja tehollisen lovijännityksen menetelmiä sekä murtumismekaniikkaa. Rakenteel-lisen jännityksen menetelmässä sovellettiin lisäksi lineaarista ja parabolista pintaa pitkin ekstra-polointia, paksuuden yli linearisointia sekä Dong:in menetelmää. Lommahdus-, kiepahdus- ja väsymistarkasteluissa hyödynnettiin analyyttistä laskentaa, FE-analyysiä sekä Frank2d sovellusta. Tarkastelujen perusteella voidaan todeta, että analyyttisillä menetelmillä saadaan numeerisia me-netelmiä varmemmalla puolella olevia tuloksia. Lommahdustarkastelussa ero tulosten välillä on suurimmillaan 8 % ja kiepahdustarkastelussa suurimmillaan 20 % mutta väsymistarkastelussa saadut tulokset eroavat keskenään huomattavasti. Väsymistarkastelussa tehollisen lovijännityksen menetelmällä sekä rakenteellisen jännityksen menetelmän Dong:in menetelmällä saadaan huo-mattavasti muita menetelmiä pidempiä kestoikiä, kun taas yksinkertaisemmilla menetelmillä saa-dut kestoiät ovat lyhyempiä. Rakenteen kestävyyden määrittäminen analyyttisillä menetelmillä on melko helppoa, mutta tu-lokset ovat monesti liian konservatiivisia. FE-analyysillä saadaan puolestaan hyvin tarkkoja tu-loksia mallin ollessa yksityiskohtainen. Mallintaminen on kuitenkin aikaa ja resursseja vievää ja vaatii käyttökokemusta. FE-analyysin mahdolliset hyödyt on aina arvioitava tapauskohtaisesti tarkasteltavan geometrian, kuormitusten ja reunaehtojen perusteella.

Influence of carbon source, pH, and temperature on the polygalacturonase activity of Kluyveromyces marxianus CCMB 322

Microbial pectinolytic enzymes are known to play a commercially important role in a number of industrial processes. Two kinds of yeast can be discerned regarding the production of enzymes. One group includes those which can produce enzymes in the absence of an inducer, and the other group comprises the yeasts that produce enzymes in the presence of an inducer. The objective of this study was to investigate the influence of pectic substances, glucose, pH, and temperature on the polygalacturonase activity by Kluyveromyces marxianus CCMB 322. The yeast was grown in a fermentation broth containing different concentrations of glucose and pectic substances. The polygalacturonase activity was determined by the DNS method, and the pH and temperature were optimized using a central composite experimental design. The polygalacturonase secreted by K. marxianus CCMB 322 was partially constitutive showing optimum pH and temperature of 7.36 and 70 °C, respectively, and maintained approximately 93% of its original activity for 50 minutes at 50 °C. Thermal stability of the polygalacturonase enzyme was studied at different temperatures (50, 60, 70, and 80 °C) and different incubation times (0, 10, 20, 30, 40, and 50 minutes). This study showed that glucose can influence the regulation of the synthesis of polygalacturonase.