Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Distributed parallelization of greedy Mobile Network Optimization algorithms

The Mobile Network Optimization (MNO) technologies have advanced at a tremendous pace in recent years. And the Dynamic Network Optimization (DNO) concept emerged years ago, aimed to continuously optimize the network in response to variations in network traffic and conditions. Yet, DNO development is still at its infancy, mainly hindered by a significant bottleneck of the lengthy optimization runtime. This paper identifies parallelism in greedy MNO algorithms and presents an advanced distributed parallel solution. The solution is designed, implemented and applied to real-life projects whose results yield a significant, highly scalable and nearly linear speedup up to 6.9 and 14.5 on distributed 8-core and 16-core systems respectively. Meanwhile, optimization outputs exhibit self-consistency and high precision compared to their sequential counterpart. This is a milestone in realizing the DNO. Further, the techniques may be applied to similar greedy optimization algorithm based applications.

Asynchronous distributed parallelization of mobile network optimization algorithms

It has been years since the introduction of the Dynamic Network Optimization (DNO) concept, yet the DNO development is still at its infant stage, largely due to a lack of breakthrough in minimizing the lengthy optimization runtime. Our previous work, a distributed parallel solution, has achieved a significant speed gain. To cater for the increased optimization complexity pressed by the uptake of smartphones and tablets, however, this paper examines the potential areas for further improvement and presents a novel asynchronous distributed parallel design that minimizes the inter-process communications. The new approach is implemented and applied to real-life projects whose results demonstrate an augmented acceleration of 7.5 times on a 16-core distributed system compared to 6.1 of our previous solution. Moreover, there is no degradation in the optimization outcome. This is a solid sprint towards the realization of DNO.

Germination rate and sporeling development of Chondracanthus chamissoi (Rhodophyta, Gigartinales) varies along a latitudinal gradient on the coast of Chile

Chondracanthus chamissoi (C. Agardh) Kutzing is an economically important red seaweed with an extended latitudinal distribution along the south-east Pacific. Here we report on the seasonal in vitro germination of carpospores and tetraspores from four populations distributed from 27 to 41 degrees S on the Chilean coast. Our results show that both types of spores exhibited a different physiological behavior related to the geographic origin of the specimens. Germination occurred throughout the year for both spore types in the four populations. However, for the northern locations (Calderilla, La Herradura and Puerto Aldea) germination was higher in spring, while for the southern location (Lechagua), germination was higher in summer. The growth rate of carposporelings and tetrasporelings varied seasonally in ail locations studied, with higher growth in spring. Among all, carposporelings from Lechagua specimens reached the highest growth rates (9.3 +/- 0.2% d(-1)). However, spores from Herradura and P. Aldea had a good germination and SGR in all seasons and would be good candidates to start spores-based cultivation of this valuable resource in Chile. (C) 2009 Elsevier B.V. All rights reserved

Akt Expression is Diminished by Physical Inactivity in Early Stages of Development in Soleus Muscle of Rats

Metabolic Syndrome is a group of conditions related to obesity and physical inactivity. Little is known about the role of physical inactivity, in early stages of development, in the susceptibility to insulin resistant phenotype induced by high fat diet. Akt plays a key role in protein synthesis and glucose transport in skeletal muscle and has been regulated by muscle activity. The objective of present study was to determine the effect of early physical inactivity on muscle growth and susceptibility to acquire a diabetic phenotype and to assess its relationship with Akt expression. Forty Wistar male rats were distributed in two groups (standard group, Std) and movement restriction (RM). Between days 23 and 70 after birth, RM group was kept in small cages that did not allow them to perform relevant motor activity. From day 71 to 102 after birth, 10 rats of each group were fed with hyperlipidic diet (groups Std-DAG and RM-DAG). No differences were observed in total body weight although DAG increased epididymal fat pad weight. RM decreased significantly the soleus weight. Insulin-mediated glucose uptake was lower in RM-DAG group. Akt protein levels were lower in RM groups. Real time RT-PCR analysis showed that movement restriction decreased mRNA levels of AKT1 in soleus muscle, regardless of supplied diet. These findings suggest that early physical inactivity limits muscle`s growth and contributes to instauration of insulin resistant phenotype, which can be partly explained by dysregulation of Akt expression.

EFFECTIVE NETWORKS FOR REAL-TIME DISTRIBUTED PROCESSING

This paper applies the concepts and methods of complex networks to the development of models and simulations of master-slave distributed real-time systems by introducing an upper bound in the allowable delivery time of the packets with computation results. Two representative interconnection models are taken into account: Uniformly random and scale free (Barabasi-Albert), including the presence of background traffic of packets. The obtained results include the identification of the uniformly random interconnectivity scheme as being largely more efficient than the scale-free counterpart. Also, increased latency tolerance of the application provides no help under congestion.

Development of secondary palate requires strict regulation of ECM remodeling: sequential distribution of RECK, MMP-2, MMP-3, and MMP-9

We have evaluated RECK (reversion-inducing-cysteine-rich protein with Kazal motifs), MMP-2 (matrix metalloproteinase-2), MMP-3, and MMP-9 involvement during palate development in mice by using various techniques. Immunohistochemical features revealed the distribution of RECK, MMP-2, and MMP-3 in the mesenchymal tissue and in the midline epithelial seam at embryonic day 13 (E13), MMPs-2, -3, and -9 being particularly expressed at E14 and E14.5. In contrast, RECK was weakly immunostained at these times. Involvement of MMPs was validated by measuring not only their protein expression, but also their activity (zymograms). In situ hybridization signal (ISH) for RECK transcript was distributed in mesenchymal and epithelial regions within palatal shelves at all periods evaluated. Importantly, the results from ISH analysis were in accord with those obtained by real-time polymerase chain reaction. The expression of RECK was found to be temporally regulated, which suggested possible roles in palatal ontogeny. Taken together, our results clearly show that remodeling of the extracellular matrix is finely modulated during secondary palate development and occurs in a sequential manner.

Transparent access to relational, autonomous and distributed databases using semantic web and service oriented technologies

With the constant grow of enterprises and the need to share information across departments and business areas becomes more critical, companies are turning to integration to provide a method for interconnecting heterogeneous, distributed and autonomous systems. Whether the sales application needs to interface with the inventory application, the procurement application connect to an auction site, it seems that any application can be made better by integrating it with other applications. Integration between applications can face several troublesome due the fact that applications may not have been designed and implemented having integration in mind. Regarding to integration issues, two tier software systems, composed by the database tier and by the “front-end” tier (interface), have shown some limitations. As a solution to overcome the two tier limitations, three tier systems were proposed in the literature. Thus, by adding a middle-tier (referred as middleware) between the database tier and the “front-end” tier (or simply referred application), three main benefits emerge. The first benefit is related with the fact that the division of software systems in three tiers enables increased integration capabilities with other systems. The second benefit is related with the fact that any modifications to the individual tiers may be carried out without necessarily affecting the other tiers and integrated systems and the third benefit, consequence of the others, is related with less maintenance tasks in software system and in all integrated systems. Concerning software development in three tiers, this dissertation focus on two emerging technologies, Semantic Web and Service Oriented Architecture, combined with middleware. These two technologies blended with middleware, which resulted in the development of Swoat framework (Service and Semantic Web Oriented ArchiTecture), lead to the following four synergic advantages: (1) allow the creation of loosely-coupled systems, decoupling the database from “front-end” tiers, therefore reducing maintenance; (2) the database schema is transparent to “front-end” tiers which are aware of the information model (or domain model) that describes what data is accessible; (3) integration with other heterogeneous systems is allowed by providing services provided by the middleware; (4) the service request by the “frontend” tier focus on ‘what’ data and not on ‘where’ and ‘how’ related issues, reducing this way the application development time by developers.

Effect of density on population development in the Amazon River prawn Macrobrachium amazonicum

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Intestinal mucosa development in broiler chickens fed natural growth promoters

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Saccharomyces Cerevisiae cell wall dietary supplementation on the performance and intestinal mucosa development and integrity of broiler chickens vaccinated against coccidiosis

This study was carried out to verify if Saccharomyces cerevisiae cell wall (SCCW) dietary supplementation (0.2%) was capable of protecting the intestinal mucosa of broiler chickens vaccinated against coccidiosis. Body weight gain, feed intake, feed conversion and intestinal mucosa morphometric parameters and epithelial loss were evaluated. In the experiment,400 day-old male chicks were distributed according to a completely randomized design in a 2x2 factorial arrangement. The following treatments were applied: T1 - no vaccination/ no SCCW supplementation; T2 - no vaccination/SCCW supplementation; T3 - vaccination/no SCCW supplementation; and T4 - vaccination/SCCW supplementation to four replicates of 25 birds each. Birds were vaccinated on the first day of age using a spray vaccine (Coccivac B®, Coopers), containing E. acervulina, E. maxima, E. mivati and E. tenella. S. cerevisiae cell wall was supplied from the first day of age. Live performance, intestinal morphometric parameters and epithelial loss were evaluated at 14, 21 and 28 days of age. Performance was affected by vaccination only at 21-days of age, when body weight gain was reduced in the vaccinated birds, but no body weight difference was observed on day 28. Vaccine also increased the crypt depth (p<0.05) in the duodenum and jejunum, suggesting a high cell activity in the crypt:villus transition area to maintain the epithelial cell turnover. Villi number/area (103,269 µm²) was not affected (p>0.05) by vaccine or cell wall supplementation, and epithelial loss was more pronounced in the duodenum and jejunum. In conclusion, the findings of this study suggest that S. cerevisiae cell wall supplementation may be an useful management tool to maintain the intestinal integrity of broilers vaccinated against coccidiosis.

Development and characterization of microsatellite loci in the marsh deer (Blastocerus dichotomus Cervidae)

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Small intestine development of laying hens fed different fiber sources diets and crude protein levels

The objective of the presente study was to evaluate the effects on different dietary fiber sources and crude protein levels on the intestinal morphometry of commercial layers. Isa Brown® layers with 48 weeks of age were distributed in a completely randomized experimental design with a 3 x 2 + 1 factorial arrangement, resulting in seven treatments with seven replicates of eight birds each. At the end of the fourth experimental period (28 days each), birds were 64 weeks of age and were randomly chosen (two birds per replicate, totaling 14 birds per treatment), weighed and sacrificed by neck dislocation. Their intestine was dissected and the duodenum, jejunum and ileum were collected for subsequent analysis of intestinal morphometry. Treatments consisted of diets containing three different fiber sources (cottonseed hulls, soybean hulls or rice husks) and two crude protein levels (12% or 16%). Soybean hulls and 16% crude protein level promoted, in general, an increase in villus height and crypt depth in the three intestinal segments. In the duodenum, the control diet resulted in higher villus height and crypt depth relative to the diets containing fiber. In the jejunum, higher crypt depth values. In the ileum, dietary fiber increased villus height as compared to the control diet.

Time-series-based maximization of distributed wind power generation integration

Energy policies and technological progress in the development of wind turbines have made wind power the fastest growing renewable power source worldwide. The inherent variability of this resource requires special attention when analyzing the impacts of high penetration on the distribution network. A time-series steady-state analysis is proposed that assesses technical issues such as energy export, losses, and short-circuit levels. A multiobjective programming approach based on the nondominated sorting genetic algorithm (NSGA) is applied in order to find configurations that maximize the integration of distributed wind power generation (DWPG) while satisfying voltage and thermal limits. The approach has been applied to a medium voltage distribution network considering hourly demand and wind profiles for part of the U.K. The Pareto optimal solutions obtained highlight the drawbacks of using a single demand and generation scenario, and indicate the importance of appropriate substation voltage settings for maximizing the connection of MPG.

Repercussions of mild diabetes on pregnancy in Wistar rats and on the fetal development

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)