Data-driven clustering : new methods and applications

Abstract : This work is concerned with the development and application of novel unsupervised learning methods, having in mind two target applications: the analysis of forensic case data and the classification of remote sensing images. First, a method based on a symbolic optimization of the inter-sample distance measure is proposed to improve the flexibility of spectral clustering algorithms, and applied to the problem of forensic case data. This distance is optimized using a loss function related to the preservation of neighborhood structure between the input space and the space of principal components, and solutions are found using genetic programming. Results are compared to a variety of state-of--the-art clustering algorithms. Subsequently, a new large-scale clustering method based on a joint optimization of feature extraction and classification is proposed and applied to various databases, including two hyperspectral remote sensing images. The algorithm makes uses of a functional model (e.g., a neural network) for clustering which is trained by stochastic gradient descent. Results indicate that such a technique can easily scale to huge databases, can avoid the so-called out-of-sample problem, and can compete with or even outperform existing clustering algorithms on both artificial data and real remote sensing images. This is verified on small databases as well as very large problems. Résumé : Ce travail de recherche porte sur le développement et l'application de méthodes d'apprentissage dites non supervisées. Les applications visées par ces méthodes sont l'analyse de données forensiques et la classification d'images hyperspectrales en télédétection. Dans un premier temps, une méthodologie de classification non supervisée fondée sur l'optimisation symbolique d'une mesure de distance inter-échantillons est proposée. Cette mesure est obtenue en optimisant une fonction de coût reliée à la préservation de la structure de voisinage d'un point entre l'espace des variables initiales et l'espace des composantes principales. Cette méthode est appliquée à l'analyse de données forensiques et comparée à un éventail de méthodes déjà existantes. En second lieu, une méthode fondée sur une optimisation conjointe des tâches de sélection de variables et de classification est implémentée dans un réseau de neurones et appliquée à diverses bases de données, dont deux images hyperspectrales. Le réseau de neurones est entraîné à l'aide d'un algorithme de gradient stochastique, ce qui rend cette technique applicable à des images de très haute résolution. Les résultats de l'application de cette dernière montrent que l'utilisation d'une telle technique permet de classifier de très grandes bases de données sans difficulté et donne des résultats avantageusement comparables aux méthodes existantes.

Mean first-passage time of continuous non-Markovian processes driven by colored noise

An equation for mean first-passage times of non-Markovian processes driven by colored noise is derived through an appropriate backward integro-differential equation. The equation is solved in a Bourret-like approximation. In a weak-noise bistable situation, non-Markovian effects are taken into account by an effective diffusion coefficient. In this situation, our results compare satisfactorily with other approaches and experimental data.

Dynamics of a paramagnetic colloidal particle driven on a magnetic-bubble lattice

We present a theoretical study of the recently observed dynamical regimes of paramagnetic colloidal particles externally driven above a regular lattice of magnetic bubbles [P. Tierno, T. H. Johansen, and T. M. Fischer, Phys. Rev. Lett. 99, 038303 (2007)]. An external precessing magnetic field alters the potential generated by the surface of the film in such a way to either drive the particle circularly around one bubble, ballistically through the array, or in triangular orbits on the interstitial regions between the bubbles. In the ballistic regime, we observe different trajectories performed by the particles phase locked with the external driving. Superdiffusive motion, which was experimentally found bridging the localized and delocalized dynamics, emerge only by introducing a certain degree of randomness into the bubbles size distribution.

Audit report on the Iowa Petroleum Underground Storage Tank Board for the year ended June 30, 2011

Audit report on the Iowa Petroleum Underground Storage Tank Board for the year ended June 30, 2011

Development of a Database for Drilled Shaft Foundation Testing (DSHAFT), June 2012

Drilled shafts have been used in the US for more than 100 years in bridges and buildings as a deep foundation alternative. For many of these applications, the drilled shafts were designed using the Working Stress Design (WSD) approach. Even though WSD has been used successfully in the past, a move toward Load Resistance Factor Design (LRFD) for foundation applications began when the Federal Highway Administration (FHWA) issued a policy memorandum on June 28, 2000.The policy memorandum requires all new bridges initiated after October 1, 2007, to be designed according to the LRFD approach. This ensures compatibility between the superstructure and substructure designs, and provides a means of consistently incorporating sources of uncertainty into each load and resistance component. Regionally-calibrated LRFD resistance factors are permitted by the American Association of State Highway and Transportation Officials (AASHTO) to improve the economy and competitiveness of drilled shafts. To achieve this goal, a database for Drilled SHAft Foundation Testing (DSHAFT) has been developed. DSHAFT is aimed at assimilating high quality drilled shaft test data from Iowa and the surrounding regions, and identifying the need for further tests in suitable soil profiles. This report introduces DSHAFT and demonstrates its features and capabilities, such as an easy-to-use storage and sharing tool for providing access to key information (e.g., soil classification details and cross-hole sonic logging reports). DSHAFT embodies a model for effective, regional LRFD calibration procedures consistent with PIle LOad Test (PILOT) database, which contains driven pile load tests accumulated from the state of Iowa. PILOT is now available for broader use at the project website: http://srg.cce.iastate.edu/lrfd/. DSHAFT, available in electronic form at http://srg.cce.iastate.edu/dshaft/, is currently comprised of 32 separate load tests provided by Illinois, Iowa, Minnesota, Missouri and Nebraska state departments of transportation and/or department of roads. In addition to serving as a manual for DSHAFT and providing a summary of the available data, this report provides a preliminary analysis of the load test data from Iowa, and will open up opportunities for others to share their data through this quality–assured process, thereby providing a platform to improve LRFD approach to drilled shafts, especially in the Midwest region.

Audit report on the Iowa Petroleum Underground Storage Tank Board for the year ended June 30, 2012

Audit report on the Iowa Petroleum Underground Storage Tank Board for the year ended June 30, 2012

Growth of and partitioning between shoot and storage root of carrot in a northern climate

Selostus: Porkkanan kasvu ja biomassan jakautuminen varastojuuren ja verson välillä pohjoisissa oloissa

Stochastic delay equations with non-negativity constraints driven by fractional Brownian motion

In this note we prove an existence and uniqueness result for the solution of multidimensional stochastic delay differential equations with normal reflection. The equations are driven by a fractional Brownian motion with Hurst parameter H > 1/2. The stochastic integral with respect to the fractional Brownian motion is a pathwise Riemann¿Stieltjes integral.

Stochastic delay differential equations driven by fractional Brownian motion with Hurst parameter H 1/2

We consider the Cauchy problem for a stochastic delay differential equation driven by a fractional Brownian motion with Hurst parameter H>¿. We prove an existence and uniqueness result for this problem, when the coefficients are sufficiently regular. Furthermore, if the diffusion coefficient is bounded away from zero and the coefficients are smooth functions with bounded derivatives of all orders, we prove that the law of the solution admits a smooth density with respect to Lebesgue measure on R.

The effect of cover crop and crop rotation on soil water storage and on sorghum yield

Crop rotation and cover crop can be important means for enhancing crop yield in rainfed areas such as the lower Coastal Bend Region of Texas, USA. A trial was conducted in 1995 as part of a long-term cropping experiment (7 years) to investigate the effect of oat (Avena sativa L.) cover and rotation on soil water storage and yield of sorghum (Sorghum bicolor L.). The trial design was a RCB in a split-plot arrangement with four replicates. Rotation sequences were the main plots and oat cover crop the subplots. Cover crop reduced sorghum grain yield. This effect was attributed to a reduced concentration of available soil N and less soil water storage under this treatment. By delaying cover termination, the residue with a high C/N acted as an N sink through competition and/or immobilization instead of an N source to sorghum plants. Crop rotation had a significantly positive effect on sorghum yield and this effect was attributed to a significantly larger amount of N concentration under these rotation sequences.

Microcontroller-driven fluid-injection system for atomic force microscopy.

We present a programmable microcontroller-driven injection system for the exchange of imaging medium during atomic force microscopy. Using this low-noise system, high-resolution imaging can be performed during this process of injection without disturbance. This latter circumstance was exemplified by the online imaging of conformational changes in DNA molecules during the injection of anticancer drug into the fluid chamber.

Biochemical changes associated to soybean seeds osmoconditioning during storage

A work was carried out with the purpose of verifying the biochemical changes associated to soybean (Glycine max (L.) Merrill) seeds osmoconditioning. Seeds of the UFV 10, IAC 8 and Doko RC cultivars harvested at R8 development stage and submitted to different treatments were used. The biochemical evaluations were performed during seed storage, after the hydration-dehydration process. Initially, seeds were osmoconditioned in a polyethylene glycol (PEG 6000) solution, with the osmotic potential of -0.8 MPa and 20ºC, for a period of four days. After that, seeds were dried back until the initial moisture content (10-11%) and stored in natural conditions for three and six months. Two controls were used: untreated seeds (dry seeds) and water soaked seeds. Seed changes in protein and lipid, hexanal accumulation and fatty acids contents were evaluated. The results showed that seed storage under laboratory natural conditions caused reduction in protein, lipid and polyunsaturated fatty acids content and promoted hexanal production. Storage periods reduced protein levels for all treatments, however the PEG 6000 treatment showed lower protein reduction. The soybean seed storage increased hexanal production, but hexanal levels were smaller with osmoconditioning comparing to the other imbibition treatments.

Consumer Advisory: The Drive to Destroy: Removing data from computer hard drives, storage devices & wireless phones, June 2014

The Attorney General’s Consumer Protection Division receives hundreds of calls and consumer complaints every year. Follow these tips to avoid unexpected expense and disappointments. This record is about: The Drive to Destroy: Removing data from computer hard drives, storage devices & wireless phones

The effect of storage ageing and spring sprouting of seed tubers on the yield of three potato varieties in the Finnish Lapland : Research Note

Selostus: Siemenmukuloiden varastointiaikaisen lämpökäsittelyn ja kevätidätyksen vaikutus kolmen perunalajikkeen satoon Lapissa

Effect of harvest time on storage loss and sprouting in onion

Selostus: Sadonkorjuuajan vaikutus sipulin varastohävikkiin ja varastoinnin jälkeiseen versomiseen