Matrix Decomposition Methods for Data Mining : Computational Complexity and Algorithms

Matrix decompositions, where a given matrix is represented as a product of two other matrices, are regularly used in data mining. Most matrix decompositions have their roots in linear algebra, but the needs of data mining are not always those of linear algebra. In data mining one needs to have results that are interpretable -- and what is considered interpretable in data mining can be very different to what is considered interpretable in linear algebra. --- The purpose of this thesis is to study matrix decompositions that directly address the issue of interpretability. An example is a decomposition of binary matrices where the factor matrices are assumed to be binary and the matrix multiplication is Boolean. The restriction to binary factor matrices increases interpretability -- factor matrices are of the same type as the original matrix -- and allows the use of Boolean matrix multiplication, which is often more intuitive than normal matrix multiplication with binary matrices. Also several other decomposition methods are described, and the computational complexity of computing them is studied together with the hardness of approximating the related optimization problems. Based on these studies, algorithms for constructing the decompositions are proposed. Constructing the decompositions turns out to be computationally hard, and the proposed algorithms are mostly based on various heuristics. Nevertheless, the algorithms are shown to be capable of finding good results in empirical experiments conducted with both synthetic and real-world data.

Mining Cell Transition Data

Cell transition data is obtained from a cellular phone that switches its current serving cell tower. The data consists of a sequence of transition events, which are pairs of cell identifiers and transition times. The focus of this thesis is applying data mining methods to such data, developing new algorithms, and extracting knowledge that will be a solid foundation on which to build location-aware applications. In addition to a thorough exploration of the features of the data, the tools and methods developed in this thesis provide solutions to three distinct research problems. First, we develop clustering algorithms that produce a reliable mapping between cell transitions and physical locations observed by users of mobile devices. The main clustering algorithm operates in online fashion, and we consider also a number of offline clustering methods for comparison. Second, we define the concept of significant locations, known as bases, and give an online algorithm for determining them. Finally, we consider the task of predicting the movement of the user, based on historical data. We develop a prediction algorithm that considers paths of movement in their entirety, instead of just the most recent movement history. All of the presented methods are evaluated with a significant body of real cell transition data, collected from about one hundred different individuals. The algorithms developed in this thesis are designed to be implemented on a mobile device, and require no extra hardware sensors or network infrastructure. By not relying on external services and keeping the user information as much as possible on the user s own personal device, we avoid privacy issues and let the users control the disclosure of their location information.

A crop productivity research protocol for long wall mining

Springsure Creek Coal (SCC) intends to develop a coal mine using the long wall mining process under grain farming land near Emerald in Central Queensland (CQ). While this technology will result in some subsidence of the land surface, SCC wishes to maintain productivity of the grain cropping land in the precinct after coal mining. However, the impact of the surface subsidence resulting from that mining process on productivity of cropping land in any Australian landscape is currently unclear. A research protocol to investigate the impacts of subsidence on grain productivity for when the SCC project becomes operational is proposed. The protocol has wider application for other similar mining projects throughout the country. A copy of the full report is accessible on www.aginstitute.com.au.

Sequence-dependent molecular conformation of polynucleotides: right and left-handed helices

Based upon a stereochemical guideline, two topologically distinct types of helicalduplexes have been deduced for a polynucleotide duplex with alternating purine pyrimidine sequence (PAPP): (a) right-handed uniform (RU) helix and (b) left-handed zig-zag (LZ) helix. Both structures have trinucleoside diphosphate as the basic unit wherein the purine pyrimidine fragment has a different conformation from the pyrimidine-purine fragment. Thus, RU and LZ helices represent two different classes of sequence-dependent molecular conformations for PAPP. The conformationalf eatures of an RU helix of PAPP in B-form and three LZ-helices for B-, D- and Z-forms are discussed.

Towards a Critique of the Concept of the Right to Self-Determination in Africa : A Conceptual Examination and the Cases of Western Sahara, Southern Sudan and Eritrea

This thesis examines the right to self-determination which is a norm used for numerous purposes by multiple actors in the field of international relations, with relatively little clarity or agreement on the actual and potential meaning of the right. In international practice, however, the main focus in applying the right has been in the context of decolonization as set by the United Nations in its early decades. Thus, in Africa the right to self-determination has traditionally implied that the colonial territories, and particularly the populations within these territories, were to constitute the people who were entitled to the right. That is, self-determination by decolonization provided a framework for the construction of independent nation-states in Africa whilst other dimensions of the right remained largely or totally neglected. With the objective of assessing the scope, content, developments and interpretations of the right to self-determination in Africa, particularly with regard to the relevance of the right today, the thesis proceeds on two fundamental hypotheses. The first is that Mervyn Frost s theory of settled norms, among which he lists the right to self-determination, assumes too much. Even if the right to self-determination is a human right belonging to all peoples stipulated, inter alia, in the first Article of the 1966 International Human Rights Covenants, it is a highly politicized and context-bound right instead of being settled and observed in a way that its denial would need special justification. Still, the suggested inconsistency or non-compliance with the norm of self-determination is not intended to prove the uselessness or inappropriateness of the norm, but, on the contrary, to invite and encourage debate on the potential use and coverage of the right to self-determination. The second hypothesis is that within the concept of self-determination there are two normative dimensions. One is to do with the idea and practice of statehood, the nation and collectivity that may decide to conduct itself as an independent state. The other one is to do with self-determination as a human right, as a normative condition, to be enjoyed by people and peoples within states that supersedes state authority. These external and internal dimensions need to be seen as complementary and co-terminous, not as mutually exclusive alternatives. The thesis proceeds on the assumption that the internal dimension of the right, with human rights and democracy at its core, has not been considered as important as the external. In turn, this unbalanced and selective interpretation has managed to put the true normative purpose of the right making the world better and bringing more just polity models into a somewhat peculiar light. The right to self-determination in the African context is assessed through case studies of Western Sahara, Southern Sudan and Eritrea. The study asks what these cases say about the right to self-determination in Africa and what their lessons learnt could contribute to the understanding and relevance of the right in today s Africa. The study demonstrates that even in the context of decolonization, the application of the right to self-determination has been far from the consistent approach supposedly followed by the international community: in many respects similar colonial histories have easily led to rather different destinies. While Eritrea secured internationally recognized right to self-determination in the form of retroactive independence in 1993, international recognition of distinct Western Sahara and Southern Sudan entities is contingent on complex and problematic conditions being satisfied. Overall, it is a considerable challenge for international legality to meet empirical political reality in a meaningful way, so that the universal values attached to the norm of self-determination are not overlooked or compromised but rather reinforced in the process of implementing the right. Consequently, this thesis seeks a more comprehensive understanding of the right to self-determination with particular reference to post-colonial Africa and with an emphasis on the internal, human rights and democracy dimensions of the norm. It is considered that the right to self-determination cannot be perceived only as an inter-state issue as it is also very much an intra-state issue, including the possibility of different sub-state arrangements exercised under the right, for example, in the form of autonomy. At the same time, the option of independent statehood achieved through secession remains a mode of exercising and part of the right to self-determination. But in whatever form or way applied, the right to self-determination, as a normative instrument, should constitute and work as a norm that comprehensively brings more added value in terms of the objectives of human rights and democracy. From a normative perspective, a peoples right should not be allowed to transform and convert itself into a right of states. Finally, in light of the case studies of Western Sahara, Southern Sudan and Eritrea, the thesis suggests that our understanding of the right to self-determination should now reach beyond the post-colonial context in Africa. It appears that both the questions and answers to the most pertinent issues of self-determination in the cases studied must be increasingly sought within the postcolonial African state rather than solely in colonial history. In this vein, the right to self-determination can be seen not only as a tool for creating states but also as a way to transform the state itself from within. Any such genuinely post-colonial approach may imply a judicious reconsideration, adaptation or up-dating of the right and our understanding of it in order to render it meaningful in Africa today.

Incorporating the interrelationship between primary and support processes in monitoring and optimising longwall coal mining efficiency

This thesis increased the researchers understanding of the relationship between operations and maintenance in underground longwall coal mines, using data from a Queensland underground coal mine. The thesis explores various relationships between recorded variables. Issues with human recorded data was uncovered, and results emphasised the significance of variables associated with conveyor operation to explain production.

Tax transparency can work for companies if they do it right

The Tax Transparency Package released by the European Commission last week comes amid global moves by the G20 and others to make it more difficult for companies to avoid paying their fair share of tax. But as serious information sharing plans are hammered out between nations around the world, the Australian government is considering protecting the privacy of some of Australia’s richest people, diluting transparency measures aimed at private companies.

Pictures that ask the right questions

An article about the use of photographs as research in the writing of memoir. "I expect many people begin the writing of a memoir by looking through old photos. Pictures, after all, belong in the past, and they hold out the promise of delivering it to us again: everyone is younger, surrounded by yesterday’s world, a moment fixed in time. Even the size of the photo paper and printing tone belong back there, in a printer’s shop that doesn’t exist anymore. And yet, for the purpose of writing a memoir, the most useful pictures also reach beyond the past, and beyond their initial role in verifying your memories, or filling out the details. That is, they are more than an account. Such pictures seem to be asking questions about what happened next, in the moments and years after they were taken..."

Spatial ecology of a specialist insect herbivore : the leaf-mining moth Tischeria ekebladella on the pedunculate oak Quercus robur

Herbivorous insects comprise a major part of terrestrial biodiversity, and their interactions with their host plants and natural enemies are of vast ecological importance. A large body of research demonstrates that the ecology and evolution of these insects may be affected by trophic interactions, by abiotic influences, and by intraspecific processes, but so far research on these individual aspects has rarely been combined. This thesis uses the leaf-mining moth Tischeria ekebladella and the pedunculate oak (Quercus robur) as a case study to assess how spatial variation in trophic interactions and the physical distribution of host trees jointly affect the distribution, dynamics and evolution of a host-specific herbivore. With respect to habitat quality, Tischeria ekebladella experiences abundant variation at several spatial scales. Most of this variation occurs at small scales notably among leaves and shoots within individual trees. While hypothetically this could cause moths to evolve an ability to select leaves and shoots of high quality, I did not find any coupling between female preference and offspring performance. Based on my studies on temporal variation in resource quality I therefore propose that unpredictable temporal changes in the relative rankings of individual resource units may render it difficult for females to predict the fate of their developing offspring. With respect to intraspecific processes, my results suggest that limited moth dispersal in relation to the spatial distribution of oak trees plays a key role in determining the regional distribution of Tischeria ekebladella. The distribution of the moth is aggregated at the landscape level, where local leaf miner populations are less likely to be present where oaks are scarce. A modelling exercise based on empirical dispersal estimates revealed that the moth population on Wattkast an island in south-western Finland is spatially structured overall, but that the relative importance of local and regional processes on tree-specific moth dynamics varies drastically across the landscape. To conclude, my work in the oak-Tischeria ekebladella system demonstrates that the local abundance and regional distribution of a herbivore may be more strongly influenced by the spatial location of host trees than by their relative quality. Hence, it reveals the importance of considering spatial context in the study of herbivorous insects, and forms a bridge between the classical fields of plant-insect interactions and spatial ecology.

Mining topical relevant patterns for multi-document summarization

Multi-document summarization addressing the problem of information overload has been widely utilized in the various real-world applications. Most of existing approaches adopt term-based representation for documents which limit the performance of multi-document summarization systems. In this paper, we proposed a novel pattern-based topic model (PBTMSum) for the task of the multi-document summarization. PBTMSum combining pattern mining techniques with LDA topic modelling could generate discriminative and semantic rich representations for topics and documents so that the most representative and non-redundant sentences can be selected to form a succinct and informative summary. Extensive experiments are conducted on the data of document understanding conference (DUC) 2007. The results prove the effectiveness and efficiency of our proposed approach.

Inferring neuronal network connectivity from spike data: A temporal data mining approach

Understanding the functioning of a neural system in terms of its underlying circuitry is an important problem in neuroscience. Recent d evelopments in electrophysiology and imaging allow one to simultaneously record activities of hundreds of neurons. Inferring the underlying neuronal connectivity patterns from such multi-neuronal spike train data streams is a challenging statistical and computational problem. This task involves finding significant temporal patterns from vast amounts of symbolic time series data. In this paper we show that the frequent episode mining methods from the field of temporal data mining can be very useful in this context. In the frequent episode discovery framework, the data is viewed as a sequence of events, each of which is characterized by an event type and its time of occurrence and episodes are certain types of temporal patterns in such data. Here we show that, using the set of discovered frequent episodes from multi-neuronal data, one can infer different types of connectivity patterns in the neural system that generated it. For this purpose, we introduce the notion of mining for frequent episodes under certain temporal constraints; the structure of these temporal constraints is motivated by the application. We present algorithms for discovering serial and parallel episodes under these temporal constraints. Through extensive simulation studies we demonstrate that these methods are useful for unearthing patterns of neuronal network connectivity.

Microbial aspects of acid generation and bioremediation with relevance to indian mining

The role of Acidithiobacillus group of bacteria in acid generation and heavy metal dissolution was studied with relevance to some Indian mines. Microorganisms implicated in acid generation such as Acidithiobacillus Acidithicibacillus thiooxidans and Leptospirillum ferrooxidans were isolated from abandoned mines, waste rocks and tailing dumps. Arsenite oxidizing Thiomonas and Bacillus group of bacteria were isolated and their ability to oxidize As (111) to As (V) established. Mine isolated Sulfate reducing bacteria were used to remove dissolved copper, zinc, iron and arsenic from solutions.

A cloud-based intelligent computing system for contextual exploration on personal sleep-tracking data using association rule mining

With the development of wearable and mobile computing technology, more and more people start using sleep-tracking tools to collect personal sleep data on a daily basis aiming at understanding and improving their sleep. While sleep quality is influenced by many factors in a person’s lifestyle context, such as exercise, diet and steps walked, existing tools simply visualize sleep data per se on a dashboard rather than analyse those data in combination with contextual factors. Hence many people find it difficult to make sense of their sleep data. In this paper, we present a cloud-based intelligent computing system named SleepExplorer that incorporates sleep domain knowledge and association rule mining for automated analysis on personal sleep data in light of contextual factors. Experiments show that the same contextual factors can play a distinct role in sleep of different people, and SleepExplorer could help users discover factors that are most relevant to their personal sleep.

A self-adaptive migration model genetic algorithm for data mining applications

Data mining involves nontrivial process of extracting knowledge or patterns from large databases. Genetic Algorithms are efficient and robust searching and optimization methods that are used in data mining. In this paper we propose a Self-Adaptive Migration Model GA (SAMGA), where parameters of population size, the number of points of crossover and mutation rate for each population are adaptively fixed. Further, the migration of individuals between populations is decided dynamically. This paper gives a mathematical schema analysis of the method stating and showing that the algorithm exploits previously discovered knowledge for a more focused and concentrated search of heuristically high yielding regions while simultaneously performing a highly explorative search on the other regions of the search space. The effective performance of the algorithm is then shown using standard testbed functions and a set of actual classification datamining problems. Michigan style of classifier was used to build the classifier and the system was tested with machine learning databases of Pima Indian Diabetes database, Wisconsin Breast Cancer database and few others. The performance of our algorithm is better than others.