Data-driven clustering : new methods and applications

Abstract : This work is concerned with the development and application of novel unsupervised learning methods, having in mind two target applications: the analysis of forensic case data and the classification of remote sensing images. First, a method based on a symbolic optimization of the inter-sample distance measure is proposed to improve the flexibility of spectral clustering algorithms, and applied to the problem of forensic case data. This distance is optimized using a loss function related to the preservation of neighborhood structure between the input space and the space of principal components, and solutions are found using genetic programming. Results are compared to a variety of state-of--the-art clustering algorithms. Subsequently, a new large-scale clustering method based on a joint optimization of feature extraction and classification is proposed and applied to various databases, including two hyperspectral remote sensing images. The algorithm makes uses of a functional model (e.g., a neural network) for clustering which is trained by stochastic gradient descent. Results indicate that such a technique can easily scale to huge databases, can avoid the so-called out-of-sample problem, and can compete with or even outperform existing clustering algorithms on both artificial data and real remote sensing images. This is verified on small databases as well as very large problems. Résumé : Ce travail de recherche porte sur le développement et l'application de méthodes d'apprentissage dites non supervisées. Les applications visées par ces méthodes sont l'analyse de données forensiques et la classification d'images hyperspectrales en télédétection. Dans un premier temps, une méthodologie de classification non supervisée fondée sur l'optimisation symbolique d'une mesure de distance inter-échantillons est proposée. Cette mesure est obtenue en optimisant une fonction de coût reliée à la préservation de la structure de voisinage d'un point entre l'espace des variables initiales et l'espace des composantes principales. Cette méthode est appliquée à l'analyse de données forensiques et comparée à un éventail de méthodes déjà existantes. En second lieu, une méthode fondée sur une optimisation conjointe des tâches de sélection de variables et de classification est implémentée dans un réseau de neurones et appliquée à diverses bases de données, dont deux images hyperspectrales. Le réseau de neurones est entraîné à l'aide d'un algorithme de gradient stochastique, ce qui rend cette technique applicable à des images de très haute résolution. Les résultats de l'application de cette dernière montrent que l'utilisation d'une telle technique permet de classifier de très grandes bases de données sans difficulté et donne des résultats avantageusement comparables aux méthodes existantes.

Development of LRFD Procedures for Bridge Pile Foundations in Iowa: Volume II: Field Testing of Steel Piles in Clay, Sand, and Mixed Soils and Data Analysis, September 2011

In response to the mandate on Load and Resistance Factor Design (LRFD) implementations by the Federal Highway Administration (FHWA) on all new bridge projects initiated after October 1, 2007, the Iowa Highway Research Board (IHRB) sponsored these research projects to develop regional LRFD recommendations. The LRFD development was performed using the Iowa Department of Transportation (DOT) Pile Load Test database (PILOT). To increase the data points for LRFD development, develop LRFD recommendations for dynamic methods, and validate the results ofLRFD calibration, 10 full-scale field tests on the most commonly used steel H-piles (e.g., HP 10 x 42) were conducted throughout Iowa. Detailed in situ soil investigations were carried out, push-in pressure cells were installed, and laboratory soil tests were performed. Pile responses during driving, at the end of driving (EOD), and at re-strikes were monitored using the Pile Driving Analyzer (PDA), following with the CAse Pile Wave Analysis Program (CAPWAP) analysis. The hammer blow counts were recorded for Wave Equation Analysis Program (WEAP) and dynamic formulas. Static load tests (SLTs) were performed and the pile capacities were determined based on the Davisson’s criteria. The extensive experimental research studies generated important data for analytical and computational investigations. The SLT measured loaddisplacements were compared with the simulated results obtained using a model of the TZPILE program and using the modified borehole shear test method. Two analytical pile setup quantification methods, in terms of soil properties, were developed and validated. A new calibration procedure was developed to incorporate pile setup into LRFD.

Development of a two-step screening ESI-TOF-MS method for rapid determination of significant stress-induced metabolome modifications in plant leaf extracts: the wound response in Arabidopsis thaliana as a case study.

To study the stress-induced effects caused by wounding under a new perspective, a metabolomic strategy based on HPLC-MS has been devised for the model plant Arabidopsis thaliana. To detect induced metabolites and precisely localise these compounds among the numerous constitutive metabolites, HPLC-MS analyses were performed in a two-step strategy. In a first step, rapid direct TOF-MS measurements of the crude leaf extract were performed with a ballistic gradient on a short LC-column. The HPLC-MS data were investigated by multivariate analysis as total mass spectra (TMS). Principal components analysis (PCA) and hierarchical cluster analysis (HCA) on principal coordinates were combined for data treatment. PCA and HCA demonstrated a clear clustering of plant specimens selecting the highest discriminating ions given by the complete data analysis, leading to the specific detection of discrete-induced ions (m/z values). Furthermore, pool constitution with plants of homogeneous behaviour was achieved for confirmatory analysis. In this second step, long high-resolution LC profilings on an UPLC-TOF-MS system were used on pooled samples. This allowed to precisely localise the putative biological marker induced by wounding and by specific extraction of accurate m/z values detected in the screening procedure with the TMS spectra.

Development and Demonstration of a Freezing Drizzle Algorithm for Roadway Environmental Sensing Systems, Final Report, October 2012

The primary goal of this project is to demonstrate the accuracy and utility of a freezing drizzle algorithm that can be implemented on roadway environmental sensing systems (ESSs). The types of problems related to the occurrence of freezing precipitation range from simple traffic delays to major accidents that involve fatalities. Freezing drizzle can also lead to economic impacts in communities with lost work hours, vehicular damage, and downed power lines. There are means for transportation agencies to perform preventive and reactive treatments to roadways, but freezing drizzle can be difficult to forecast accurately or even detect as weather radar and surface observation networks poorly observe these conditions. The detection of freezing precipitation is problematic and requires special instrumentation and analysis. The Federal Aviation Administration (FAA) development of aircraft anti-icing and deicing technologies has led to the development of a freezing drizzle algorithm that utilizes air temperature data and a specialized sensor capable of detecting ice accretion. However, at present, roadway ESSs are not capable of reporting freezing drizzle. This study investigates the use of the methods developed for the FAA and the National Weather Service (NWS) within a roadway environment to detect the occurrence of freezing drizzle using a combination of icing detection equipment and available ESS sensors. The work performed in this study incorporated the algorithm developed initially and further modified for work with the FAA for aircraft icing. The freezing drizzle algorithm developed for the FAA was applied using data from standard roadway ESSs. The work performed in this study lays the foundation for addressing the central question of interest to winter maintenance professionals as to whether it is possible to use roadside freezing precipitation detection (e.g., icing detection) sensors to determine the occurrence of pavement icing during freezing precipitation events and the rates at which this occurs.

Development of an aggregation assay to screen FimH antagonists.

Alpha-D-mannopyranosides are potent FimH antagonists, which inhibit the adhesion of Escherichia coli to highly mannosylated uroplakin Ia on the urothelium and therefore offer an efficient therapeutic opportunity for the treatment and prevention of urinary tract infection. For the evaluation of the therapeutic potential of FimH antagonists, their effect on the disaggregation of E. coli from Candida albicans and guinea pig erythrocytes (GPE) was studied. The mannose-specific binding of E. coli to yeast cells and erythrocytes is mediated by type 1 pili and can be monitored by aggregometry. Maximal aggregation of C. albicans or GPE to E. coli is reached after 600 s. Then the FimH antagonist was added and disaggregation determined by light transmission over a period of 1400 s. A FimH-deleted mutant of E. coli, which does not induce any aggregation, was used in a control experiment. The activities of FimH antagonists are expressed as IC(50)s, the half maximal inhibitory concentration of the disaggregation potential. n-Heptyl alpha-D-mannopyranoside (1) was used as a reference compound and exhibits an IC(50) of 77.14 microM , whereas methyl alpha-D-mannopyranoside (2) does not lead to any disaggregation at concentrations up to 800 microM. o-Chloro-p-[N-(2-ethoxy-3,4-dioxocyclobut-1-enyl)amino]phenyl alpha-D-mannopyranoside (3) shows a 90-fold and 2-chloro-4-nitrophenyl alpha-D-mannopyranoside (4) a 6-fold increased affinity compared to 1. Finally, 4-nitrophenyl alpha-D-mannopyranoside (5) exhibits an activity similar to 1. As negative control, D-galactose (6) was used. The standardized aggregation assay generates concentration-dependent, reproducible data allowing the evaluation of FimH antagonists according to their potency to inhibit E. coli adherence and can therefore be employed to select candidates for experimental and clinical studies for treatment and prevention of urinary tract infections.

Assessment of Weathering Steel Bridge Performance in Iowa and Development of Inspection and Maintenance Techniques, RB17-012, 2013

Weathering steel is commonly used as a cost-effective alternative for bridge superstructures, as the costs and environmental impacts associated with the maintenance/replacement of paint coatings are theoretically eliminated. The performance of weathering steel depends on the proper formation of a surface patina, which consists of a dense layer of corrosion product used to protect the steel from further atmospheric corrosion. The development of the weathering steel patina may be hindered by environmental factors such as humid environments, wetting/drying cycles, sheltering, exposure to de-icing chlorides, and design details that permit water to pond on steel surfaces. Weathering steel bridges constructed over or adjacent to other roadways could be subjected to sufficient salt spray that would impede the development of an adequate patina. Addressing areas of corrosion on a weathering steel bridge superstructure where a protective patina has not formed is often costly and negates the anticipated cost savings for this type of steel superstructure. Early detection of weathering steel corrosion is important to extending the service life of the bridge structure; however, written inspection procedures are not available for inspectors to evaluate the performance or quality of the patina. This project focused on the evaluation of weathering steel bridge structures, including possible methods to assess the quality of the weathering steel patina and to properly maintain the quality of the patina. The objectives of this project are summarized as follows:  Identify weathering steel bridge structures that would be most vulnerable to chloride contamination, based on location, exposure, environment, and other factors.  Identify locations on an individual weathering steel bridge structure that would be most susceptible to chloride contamination, such as below joints, splash/spray zones, and areas of ponding water or debris.  Identify possible testing methods and/or inspection techniques for inspectors to evaluate the quality of the weathering steel patina at locations discussed above.  Identify possible methods to measure and evaluate the level of chloride contamination at the locations discussed above.  Evaluate the effectiveness of water washing on removing chlorides from the weathering steel patina.  Develop a general prioritization for the washing of bridge structures based on the structure’s location, environment, inspection observations, patina evaluation findings, and chloride test results.

Development of a real-time PCR for the specific detection of Waddlia chondrophila in clinical samples.

Waddlia chondrophila is considered as an emerging human pathogen likely involved in miscarriage and lower respiratory tract infections. Given the low sensitivity of cell culture to recover such an obligate intracellular bacteria, molecular-based diagnostic approaches are warranted. We thus developed a real-time PCR that amplifies Waddlia chondrophila DNA. Specific primers and probe were selected to target the 16S rRNA gene. The PCR specifically amplified W. chondrophila but did not amplify other related-bacteria such as Parachlamydia acanthamoebae, Simkania negevensis and Chlamydia pneumoniae. The PCR exhibited a good intra-run and inter-run reproducibility and a sensitivity of less than ten copies of the positive control. This real-time PCR was then applied to 32 nasopharyngeal aspirates taken from children with bronchiolitis not due to respiratory syncytial virus (RSV). Three samples revealed to be Waddlia positive, suggesting a possible role of this Chlamydia-related bacteria in this setting.

Development of a Sensitive Resource Use Questionnaire

Alcoholism is a chronic disease and the evaluation of its burden usually focuses on long-term co-morbidity and mortality. Clinical Trials evaluating new interventions for alcohol-dependent patients rarely last more than 12 to 24 months. OBJECTIVES: Develop a questionnaire capable of capturing principal resource use yet sensitive enough to show short-term economic benefit of drugs developed to reduce consump¬tion in alcohol-dependent patients. METHODS: Comprehensive Medline literature search using keywords: Alcohol-related-disorders, economics, cost of illness. Further, experts panel discussions provided additional data. RESULTS: Two key cost drivers, hospitalisation and sick leaves were identified by the literature review. Expert findings related to costs of social consequences were incorporated. These three important resources were included in the questionnaire in addition to standard medical resource use consumption input. Finally, the following items were included: consultation visits, hospitalisations, sick leaves and working situation, living situation, social environ¬ment, accidents, arrests and domestic violence. The recall period is 3 months. DISCUSSION: A great deal of information is collected in this questionnaire in order to capture all relevant resources. Tests to validate the questionnaire in a real-life setting will be conducted (face validity, concurrent validity, and test-retest) in a cohort of dependent patients initiated at Lausanne University hospital ( Switzerland). Items not sensitive enough to capture short-term costs and consequences will be removed. Translation into other major languages and adaptation to different settings after cultural validation is planned. CONCLUSIONS: Publication of this tool should facilitate additional knowledge about resource utilisation at the patient level and enable evaluation of short-term economic impact of pharmacological and non-pharmacological interventions.

Development of Elispot and CFSE flow cytometric assays for detecting beryllium sensitivity

Background: Beryllium sensitization (BeS) is caused by exposure to beryllium in the workplace and may progress to chronic beryllium disease (CBD). This granulomatous lung disorder mimicks sarcoidosis clinically, but is characterized by beryllium specific CD4+ T-cells immune response. BeS is classically detected by beryllium lymphocyte proliferation test (BeLPT), but this assay requires radioactivity and is not very sensitive. In the context of a study aiming to evaluate if CBD patients are misdiagnosed as sarcoidosis patients in Switzerland, we developed EliSpot and CFSE beryllium flow cytometric test. Methods: 23 patients considered as having sarcoidosis (n = 21), CBD (n = 1) and possible CBD (n = 1) were enrolled. Elispot was performed using plate covered with gamma-IFN mAb. Cells were added to wells and incubated overnight at 37 °C with medium (neg ctrl), SEB (pos ctrl) or BeSO4 at 1, 10 and 100 microM. Anti-IFN-gamma biotinylated mAb were added and spots were visualized using streptavidinhorseradish peroxidase and AEC substrate reagent. Results were reported as spot forming unit (SFU). For Beryllium specific CFSE flow cytometry analysis, CFSE labelled cells were cultured in the presence of SEB and 1, 10 or 100 microM BeSO4. Unstimulated CFSE labeled cells were defined as controls. The cells were incubated for 6 days at 37 °C and 5% CO2. Surface labelling of T-lymphocytes and vivid as control of cells viability was performed at the time of harvest. Results: Using EliSpot technology, we were able to detect a BeS in 1/23 enrolled patients with a mean of 780 SFU (cut off value at 50 SFU). This positive result was confirmed using different concentration of BeSO4. Among the 23 patients tested, 22 showed negative results with EliSpot. Using CFSE flow cytometry, 1/7 tested patients showed a positive result with a beryllium specific CD4+ count around 30% versus 45% for SEB stimulation as positif control and 0.6 % for negative control. This patient was the one with a positive EliSpot assay. Conclusions: The preliminary data demonstrated the feasibility of Elispot and CFSE flow cytometry to detect BeS. The patient with a beryllium specific positive EliSpot and CFSE flow cytometry result had been exposed to beryllium at her workplace 20 years ago and is still regularly controlled for her pulmonary status. A positive BeLPT had already been described in 2001 in France for this patient. Further validation of these techniques are in progress.

Development of a Rational Characterization Method for Iowa Fly Ash, HR-286, 1988

This research project was conducted in an attempt to determine the cause of paste strength variability in Iowa fly ashes and to develop test methods to more adequately reflect fly ash physical and chemical characteristics. An extensive three year sampling and testing program was developed and initiated which incorporated fly ash from several Iowa power plants. Power plant design and operating data were collected. The variability was directly linked to power plant maintenance schedules and to sodium carbonate coal pretreatment. Fly ash physical and chemical properties can change drastically immediately before and after a maintenance outage. The concentrations of sulfate bearing minerals in the fly ash increases sharply during shutdown. Chemical, mineralogical, and physical testing indicated that the sodium, sulfate bearing minerals, lime and tricalcium aluminate contents of the fly ashes play important roles in the development of hydration reaction products in fly ash pastes. The weak pastes always contained ettringite as the major reaction product. The strong pastes contained straetlingite and monosulfoaluminate as the major reaction products along with minor amounts of ettringite. Recommendations for testing procedure changes and suggested interim test methods are presented.

Detecting and measuring deprivation in primary care: development, validity and reliability of a self-reported questionnaire - the DiPCare-Q

Background: General practitioners play a central role in taking deprivation into consideration when caring for patients in primary care. Validated questions to identify deprivation in primary-care practices are still lacking. For both clinical and research purposes, this study therefore aims to develop and validate a standardized instrument measuring both material and social deprivation at an individual level. Methods: The Deprivation in Primary Care Questionnaire (DiPCare-Q) was developed using qualitative and quantitative approaches between 2008 and 2011. A systematic review identified 199 questions related to deprivation. Using judgmental item quality, these were reduced to 38 questions. Two focus groups (primary-care physicians, and primary-care researchers), structured interviews (10 laymen), and think aloud interviews (eight cleaning staff) assured face validity. Item response theory analysis was then used to derive the DiPCare-Q index using data obtained from a random sample of 200 patients who were to complete the questionnaire a second time over the phone. For construct and criterion validity, the final 16 questions were administered to a random sample of 1,898 patients attending one of 47 different private primary-care practices in western Switzerland (validation set) along with questions on subjective social status (subjective SES ladder), education, source of income, welfare status, and subjective poverty. Results: Deprivation was defined in three distinct dimensions (table); material deprivation (eight items), social deprivation (five items) and health deprivation (three items). Item consistency was high in both the derivation (KR20 = 0.827) and the validation set (KR20 = 0.778). The DiPCare-Q index was reliable (ICC = 0.847). For construct validity, we showed the DiPCare-Q index to be correlated to patients' estimation of their position on the subjective SES ladder (rs = 0.539). This position was correlated to both material and social deprivation independently suggesting two separate mechanisms enhancing the feeling of deprivation. Conclusion: The DiPCare-Q is a rapid, reliable and validated instrument useful for measuring both material and social deprivation in primary care. Questions from the DiPCare-Q are easy to use when investigating patients' social history and could improve clinicians' ability to detect underlying social distress related to deprivation.

Iowa Development of Rubblized Concrete Pavement Base - Mills County, HR-315, 1995

Iowa counties have tried to rehabilitate deteriorating portland cement concrete (PCC) pavements with standard overlays, placement of engineering fabric, rock, open graded bituminous mixes and cracking and seating. While these methods prolong the life of the road, the cracks in the old pavement have eventually reflected to the surface. One possible alternative for rehabilitating severely deteriorated roads and preventing reflective cracking is the rubblization process. The objective of this research project was to rehabilitate and evaluate a severely deteriorated PCC roadway using a rubblization process. A 3.0 km (1.9 mi) section of L63 in Mills County was selected for this research. The road was divided into 16 sections. A resonate frequency vibration pavement breaker was used to rubblize the existing pavement. The variables of rubblization, drainage, and ACC overlay depths of 75 mm (3 in.), 100 mm (4 in.), and 125 mm (5 in.) were evaluated. The research on rubblized concrete pavement bases support the following conclusions: (1) The rubblization process prevents reflective cracking; (2) Edge drains improved the structural rating of the rubblized roadway; (3) An ACC overlay of 125 mm (5 in.) on a rubblized base provided an excellent roadway regardless of soil and drainage conditions; (4) An ACC overlay of 75 mm (3 in.) on a rubblized base can provide a good roadway if the soil structure below the rubblized base is stable and well drained; and (5) The Road Rater structural ratings of the rubblized test sections for this project are comparable to the nonrubblized test sections.

Development of a Conductometric Test for Frost Resistance of Concrete, HR-272, 1988

Research is described that was aimed at developing a test method which can be reasonably and rapidly performed in the laboratory and in the field to predict, with a high degree of certainty, the behavior of concrete subjected to the action of alternate freezing and thawing. The conductometric evaluation of concrete durability was explored with 3 different test methods: conductometric evaluation of the resistance of concrete to rapid freezing and thawing; conductomtric evaluation of the resistance of concrete to natural freezing and thawing, and conductometric evaluation of the pore size distribution of concrete and its correlation to concrete durability. The study showed that conductance could be used as a viable method for determining the durability of portland cement concrete. This would also allow the continuous monitoring of concrete durability without the removal twice per week from the freeze/thaw chamber. Recommendations for the continued development of these test methods are also included.

Observational methodology in football: Development of an instrument to study the offensiva game in football.

The following paper introduces a new approach to the analysis of offensive game in football. Therefore, the main aim of this study was to create an instrument for collecting information for the analysis of offensive action and interactions game. The observation instrument that was used to accomplish the main objective of this work consists of a combination of format fields (FC) and systems of categories (SC). This methodology is a particular strategy of the scientific method that has as an objective to analyse the perceptible behaviour that occurs in habitual contexts, allowing them to be formally recorded and quantified and using an ad hoc instrument in order to obtain a behaviour systematic registration that, since they have been transformed in quantitative data with the necessary reliability and validity determined level, will allow analysis of the relations between these behaviours. The codifications undertaken to date in various games of football have shown that it serves the purposes for which it was developed, allowing more research into the offensive game methods in football.