Exploring the integration of data mining and data visualization

Due to the rapid advances in computing and sensing technologies, enormous amounts of data are being generated everyday in various applications. The integration of data mining and data visualization has been widely used to analyze these massive and complex data sets to discover hidden patterns. For both data mining and visualization to be effective, it is important to include the visualization techniques in the mining process and to generate the discovered patterns for a more comprehensive visual view. In this dissertation, four related problems: dimensionality reduction for visualizing high dimensional datasets, visualization-based clustering evaluation, interactive document mining, and multiple clusterings exploration are studied to explore the integration of data mining and data visualization. In particular, we 1) propose an efficient feature selection method (reliefF + mRMR) for preprocessing high dimensional datasets; 2) present DClusterE to integrate cluster validation with user interaction and provide rich visualization tools for users to examine document clustering results from multiple perspectives; 3) design two interactive document summarization systems to involve users efforts and generate customized summaries from 2D sentence layouts; and 4) propose a new framework which organizes the different input clusterings into a hierarchical tree structure and allows for interactive exploration of multiple clustering solutions.

Intelligent retrieval system for conditions of contract documents in construction

The outcome of this research is an Intelligent Retrieval System for Conditions of Contract Documents. The objective of the research is to improve the method of retrieving data from a computer version of a construction Conditions of Contract document. SmartDoc, a prototype computer system has been developed for this purpose. The system provides recommendations to aid the user in the process of retrieving clauses from the construction Conditions of Contract document. The prototype system integrates two computer technologies: hypermedia and expert systems. Hypermedia is utilized to provide a dynamic way for retrieving data from the document. Expert systems technology is utilized to build a set of rules that activate the recommendations to aid the user during the process of retrieval of clauses. The rules are based on experts knowledge. The prototype system helps the user retrieve related clauses that are not explicitly cross-referenced but, according to expert experience, are relevant to the topic that the user is interested in.

Preimplantation genetic diagnosis: Analysis of gene expression, nuclear DNA and cytoplasmic DNA

Preimplantation genetic diagnosis (PGD) following in vitro fertilization (IVF) offers couples at risk for transmitting genetic disorders the opportunity to identify affected embryos prior to replacement. In particular, embryo gender determination permits screening for X-linked diseases of unknown etiology. Analysis of embryos can be performed by polymerase chain reaction (PCR) amplification of material obtained by micromanipulation. This approach provides an alternative to the termination of an established pregnancy following chorionic villi sampling or amniocentesis. ^ Lately, the focus of preimplantation diagnosis and intervention has been shifting toward an attempt to correct cytoplasmic deficiencies. Accordingly, it is the aim of this investigation to develop methods to permit the examination of single cells or components thereof for clinical evaluation. In an attempt to lay the groundwork for precise therapeutic intervention for age related aneuploidy, transcripts encoding proteins believed to be involved in the proper segregation of chromosomes during human oocyte maturation were examined and quantified. Following fluorescent rapid cycle RT-PCR analysis it was determined that the concentration of cell cycle checkpoint gene transcripts decreases significantly as maternal age increases. Given the well established link between increasing maternal age and the incidence of aneuploidy, these results suggest that the degradation of these messages in aging oocytes may be involved with inappropriate chromosome separation during meiosis. ^ In order to investigate the cause of embryonic rescue observed following clinical cytoplasmic transfer procedures and with the objective of developing a diagnostic tool, mtDNA concentrations in polar bodies and subcellular components were evaluated. First, the typical concentration of mtDNA in human and mouse oocytes was determined by fluorescent rapid cycle PCR. Some disparity was noted between the copy numbers of individual cytoplasmic samples which may limit the use of the current methodology for the clinical assessment of the corresponding oocyte. ^

Temporal Mining for Distributed Systems

Many systems and applications are continuously producing events. These events are used to record the status of the system and trace the behaviors of the systems. By examining these events, system administrators can check the potential problems of these systems. If the temporal dynamics of the systems are further investigated, the underlying patterns can be discovered. The uncovered knowledge can be leveraged to predict the future system behaviors or to mitigate the potential risks of the systems. Moreover, the system administrators can utilize the temporal patterns to set up event management rules to make the system more intelligent. With the popularity of data mining techniques in recent years, these events grad- ually become more and more useful. Despite the recent advances of the data mining techniques, the application to system event mining is still in a rudimentary stage. Most of works are still focusing on episodes mining or frequent pattern discovering. These methods are unable to provide a brief yet comprehensible summary to reveal the valuable information from the high level perspective. Moreover, these methods provide little actionable knowledge to help the system administrators to better man- age the systems. To better make use of the recorded events, more practical techniques are required. From the perspective of data mining, three correlated directions are considered to be helpful for system management: (1) Provide concise yet comprehensive summaries about the running status of the systems; (2) Make the systems more intelligence and autonomous; (3) Effectively detect the abnormal behaviors of the systems. Due to the richness of the event logs, all these directions can be solved in the data-driven manner. And in this way, the robustness of the systems can be enhanced and the goal of autonomous management can be approached. This dissertation mainly focuses on the foregoing directions that leverage tem- poral mining techniques to facilitate system management. More specifically, three concrete topics will be discussed, including event, resource demand prediction, and streaming anomaly detection. Besides the theoretic contributions, the experimental evaluation will also be presented to demonstrate the effectiveness and efficacy of the corresponding solutions.

Three essays on the economics of defense contracting, output and income inequality

This dissertation analyzes both the economics of the defense contracting process and the impact of total dollar obligations on the economies of U.S. states. Using various econometric techniques, I will estimate relationships across individual contracts, state level output, and income inequality. I will achieve this primarily through the use of a dataset on individual contract obligations. ^ The first essay will catalog the distribution of contracts and isolate aspects of the process that contribute to contract dollar obligations. Accordingly, this study describes several characteristics about individual defense contracts, from 1966-2006: (i) the distribution of contract dollar obligations is extremely rightward skewed, (ii) contracts are unevenly distributed in a geographic sense across the United States, (iii) increased duration of a contract by 10 percent is associated with an increase in costs by 4 percent, (iv) competition does not seem to affect dollar obligations in a substantial way, (v) contract pre-payment financing increases the obligation of contracts from anywhere from 62 to 380 percent over non-financed contracts. ^ The second essay will turn to an aggregate focus, and look the impact of defense spending on state economic output. The analysis in chapter two attempts to estimate the state level fiscal multiplier, deploying Difference-in-Differences estimation as an attempt to filter out potential endogeneity bias. Interstate variation in procurement spending facilitates utilization of a natural experiment scenario, focusing on the spike in relative spending in 1982. The state level relative multiplier estimate here is 1.19, and captures the short run, impact effect of the 1982 spending spike. ^ Finally I will look at the relationship between defense contracting and income inequality. Military spending has typically been observed to have a negative relationship with income inequality. The third chapter examines the existence of this relationship, combining data on defense procurement with data on income inequality at the state level, in a longitudinal analysis across the United States. While the estimates do not suggest a significant relationship exists for the income share of the top ten percent of households, there is a significant positive relationship for the income share of top one percent households for an increase in defense procurement.^

Three Essays on the Economics of Defense Contracting, Output and Income Inequality

This dissertation analyzes both the economics of the defense contracting process and the impact of total dollar obligations on the economies of U.S. states. Using various econometric techniques, I will estimate relationships across individual contracts, state level output, and income inequality. I will achieve this primarily through the use of a dataset on individual contract obligations. The first essay will catalog the distribution of contracts and isolate aspects of the process that contribute to contract dollar obligations. Accordingly, this study describes several characteristics about individual defense contracts, from 1966-2006: (i) the distribution of contract dollar obligations is extremely rightward skewed, (ii) contracts are unevenly distributed in a geographic sense across the United States, (iii) increased duration of a contract by 10 percent is associated with an increase in costs by 4 percent, (iv) competition does not seem to affect dollar obligations in a substantial way, (v) contract pre-payment financing increases the obligation of contracts from anywhere from 62 to 380 percent over non-financed contracts. The second essay will turn to an aggregate focus, and look the impact of defense spending on state economic output. The analysis in chapter two attempts to estimate the state level fiscal multiplier, deploying Difference-in-Differences estimation as an attempt to filter out potential endogeneity bias. Interstate variation in procurement spending facilitates utilization of a natural experiment scenario, focusing on the spike in relative spending in 1982. The state level relative multiplier estimate here is 1.19, and captures the short run, impact effect of the 1982 spending spike. Finally I will look at the relationship between defense contracting and income inequality. Military spending has typically been observed to have a negative relationship with income inequality. The third chapter examines the existence of this relationship, combining data on defense procurement with data on income inequality at the state level, in a longitudinal analysis across the United States. While the estimates do not suggest a significant relationship exists for the income share of the top ten percent of households, there is a significant positive relationship for the income share of top one percent households for an increase in defense procurement.