Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Valuation 'accuracy' within the Right to Buy process

Based on surveys undertaken with local authorities and valuers who provide the valuations on which purchase prices for local authority houses under the Right to Buy are based, this paper reports on research which aims to establish the reasons for the differences between the initial valuations provided by the local authority valuers and those provided by the District Valuer on appeal. The paper reports on the reasons why tenants appeal the initial valuation and discusses issues of valuation accuracy, uncertainty and the different and imperfect data available to valuers employed by the organisations involved, as well as the factors within the valuation process, including the absence of any requirement to agree a value, which contribute to the different outcomes.

A new algorithm for tracking people in a pervasive mining environment

This paper analyze and study a pervasive computing system in a mining environment to track people based on RFID (radio frequency identification) technology. In first instance, we explain the RFID fundamentals and the LANDMARC (location identification based on dynamic active RFID calibration) algorithm, then we present the proposed algorithm combining LANDMARC and trilateration technique to collect the coordinates of the people inside the mine, next we generalize a pervasive computing system that can be implemented in mining, and finally we show the results and conclusions.

Real-time identification and modelling in pervasive mining

This paper introduces an architecture for identifying and modelling in real-time at a copper mine using new technologies as M2M and cloud computing with a server in the cloud and an Android client inside the mine. The proposed design brings up pervasive mining, a system with wider coverage, higher communication efficiency, better fault-tolerance, and anytime anywhere availability. This solution was designed for a plant inside the mine which cannot tolerate interruption and for which their identification in situ, in real time, is an essential part of the system to control aspects such as instability by adjusting their corresponding parameters without stopping the process.

Data mining in education

The third chapter, data mining in education, examines potentials and constraints in the use of data mining in education, summarizing the potential they have to offer meaningful support to: students, teachers, tutors, authors, developers, researchers, and the education and training institutions in which they work and study.

‘Cursed’ communities? Corporate Social Responsibility (CSR), company towns and the mining industry in Namibia

This article examines Corporate Social Responsibility (CSR) and mining community development, sustainability and viability. These issues are considered focussing on current and former company-owned mining towns in Namibia. Historically company towns have been a feature of mining activity in Namibia. However, the fate of such towns upon mine closure has been and remains controversial. Declining former mining communities and even ghost mining towns can be found across the country. This article draws upon research undertaken in Namibia and considers these issues with reference to three case study communities. This article examines the complexities which surround decision-making about these communities, and the challenges faced in efforts to encourage their sustainability after mining. In this article, mine company engagements through CSR with the development, sustainability and viability of such communities are also critically discussed. The role, responsibilities, and actions of the state in relation to these communities are furthermore reflected upon. Finally, ways forward for these communities are considered.

An overview of interactive visual data mining techniques for knowledge discovery

n the past decade, the analysis of data has faced the challenge of dealing with very large and complex datasets and the real-time generation of data. Technologies to store and access these complex and large datasets are in place. However, robust and scalable analysis technologies are needed to extract meaningful information from these datasets. The research field of Information Visualization and Visual Data Analytics addresses this need. Information visualization and data mining are often used complementary to each other. Their common goal is the extraction of meaningful information from complex and possibly large data. However, though data mining focuses on the usage of silicon hardware, visualization techniques also aim to access the powerful image-processing capabilities of the human brain. This article highlights the research on data visualization and visual analytics techniques. Furthermore, we highlight existing visual analytics techniques, systems, and applications including a perspective on the field from the chemical process industry.

The creativity of action: Property, Kin and the social in African artisanal mining

Analyses of neo-liberal change in African mining tend to frame discussion through the lens of an overarching structural perspective. Far less attention has been paid to the way change is enacted within social relations in mining communities. To this end, our chapter considers how development in the Tanzanian mineral sector transforms people’s relationships and stimulates new iterations of power and agency within local trajectories of development, focusing on the case of artisanal gold mining in Mgusu village in Geita region, Tanzania. The aim is to trace how neo-liberal change configures market rationality and property relations in ways that can fundamentally alter social relationships within the local community, occupational groups and families, raising both opportunities for wealth accumulation and the potential to entrench poverty. The creative action involved in these processes generates new associational ties and repertoires of practice, as miners’ respond to change and the need to protect their livelihoods.

An ethical turn in African mining: voluntary regulation through fair trade

In recent decades there has been an ethical turn in expectations of how African mineral production and trade should be conducted. Good labour conditions, the absence of conflict and mining’s potential for securing economic, social and environmental benefits are being demanded in the jewellery trade. As a consequence the quality of precious and semi-precious metals and gemstones is now being judged on their ethical credentials in addition to their aesthetic and mineral qualities. Mineral production for industrial manufacture, particularly in the electronics industry, is also coming under scrutiny. Adding value through ethics is closely associated with the use of voluntary (non-state) regulation. This includes standards and associated certification and labels, which have been widely adopted by the minerals and metals sector in efforts to ensure improvements in the social and environmental conditions of production and to enable access to the profitable and expanding global ‘ethical market’. In this chapter, we focus on ethical trading schemes that incorporate voluntary regulation, by using artisanal gold mining in Tanzania and the sale of gold through international fair trade markets as an exemplar to consider the development dynamics that emerge from ethical schemes.

Artisanal mining's democratizing directions and deviations

Artisanal miners have tended to be portrayed in the literature and media as people who work hard and play hard, not infrequently depicted as ‘rough diamonds’ likely to cross the boundaries of appropriate behaviour through pursuit of wealth and flamboyant living, often at the cost of local environmental damage. A popular alternative image is that of marginalised labourers, driven by poverty to toil in harsh conditions and pursuing mining livelihoods in the face of national governments and large-scale mining companies’ subversion of their land and mineral rights. Both views reflect partial realities, but are inclined to exaggerate the position of miners as mischief-making rogues or victims. Through documentation of the multi-faceted nature of Tanzanian artisanal miners’ work and home lives during the country’s on-going economic mineralisation, we endeavour to convey a balanced rendering of their aspirations, occupational identity and social ties. Our emphasis is on their working lives as artisans, how they organise themselves and contend with the risks of their occupation, including their engagement with government policy and large-scale mining interests.

Occupying the margins: Labour integration and social exclusion in artisanal mining in Tanzania

This article examines the marginal position of artisanal miners in sub-Saharan Africa, and considers how they are incorporated into mineral sector change in the context of institutional and legal integration. Taking the case of diamond and gold mining in Tanzania, the concept of social exclusion is used to explore the consequences of marginalization on people's access to mineral resources and ability to make a living from artisanal mining. Because existing inequalities and forms of discrimination are ignored by the Tanzanian state, the institutionalization of mineral titles conceals social and power relations that perpetuate highly unequal access to resources. The article highlights the complexity of these processes, and shows that while legal integration can benefit certain wealthier categories of people, who fit into the model of an 'entrepreneurial small-scale miner', for others adverse incorporation contributes to socio-economic dependence, exploitation and insecurity. For the issue of marginality to be addressed within integration processes, the existence of local forms of organization, institutions and relationships, which underpin inequalities and discrimination, need to be recognized.

Neural stem cells and cell replacement therapy: making the right cells

The past few years have seen major advances in the field of NSC (neural stem cell) research with increasing emphasis towards its application in cell-replacement therapy for neurological disorders. However, the clinical application of NSCs will remain largely unfeasible until a comprehensive understanding of the cellular and molecular mechanisms of NSC fate specification is achieved. With this understanding will come an increased possibility to exploit the potential of stem cells in order to manufacture transplantable NSCs able to provide a safe and effective therapy for previously untreatable neurological disorders. Since the pathology of each of these disorders is determined by the loss or damage of a specific neural cell population, it may be necessary to generate a range of NSCs able to replace specific neurons or glia rather than generating a generic NSC population. Currently, a diverse range of strategies is being investigated with this goal in mind. In this review, we focus on the relationship between NSC specification and differentiation and discuss how this information may be used to direct NSCs towards a particular fate.