On erasure coding for distributed storage and streaming communications

The work presented in this thesis revolves around erasure correction coding, as applied to distributed data storage and real-time streaming communications.

First, we examine the problem of allocating a given storage budget over a set of nodes for maximum reliability. The objective is to find an allocation of the budget that maximizes the probability of successful recovery by a data collector accessing a random subset of the nodes. This optimization problem is challenging in general because of its combinatorial nature, despite its simple formulation. We study several variations of the problem, assuming different allocation models and access models, and determine the optimal allocation and the optimal symmetric allocation (in which all nonempty nodes store the same amount of data) for a variety of cases. Although the optimal allocation can have nonintuitive structure and can be difficult to find in general, our results suggest that, as a simple heuristic, reliable storage can be achieved by spreading the budget maximally over all nodes when the budget is large, and spreading it minimally over a few nodes when it is small. Coding would therefore be beneficial in the former case, while uncoded replication would suffice in the latter case.

Second, we study how distributed storage allocations affect the recovery delay in a mobile setting. Specifically, two recovery delay optimization problems are considered for a network of mobile storage nodes: the maximization of the probability of successful recovery by a given deadline, and the minimization of the expected recovery delay. We show that the first problem is closely related to the earlier allocation problem, and solve the second problem completely for the case of symmetric allocations. It turns out that the optimal allocations for the two problems can be quite different. In a simulation study, we evaluated the performance of a simple data dissemination and storage protocol for mobile delay-tolerant networks, and observed that the choice of allocation can have a significant impact on the recovery delay under a variety of scenarios.

Third, we consider a real-time streaming system where messages created at regular time intervals at a source are encoded for transmission to a receiver over a packet erasure link; the receiver must subsequently decode each message within a given delay from its creation time. For erasure models containing a limited number of erasures per coding window, per sliding window, and containing erasure bursts whose maximum length is sufficiently short or long, we show that a time-invariant intrasession code asymptotically achieves the maximum message size among all codes that allow decoding under all admissible erasure patterns. For the bursty erasure model, we also show that diagonally interleaved codes derived from specific systematic block codes are asymptotically optimal over all codes in certain cases. We also study an i.i.d. erasure model in which each transmitted packet is erased independently with the same probability; the objective is to maximize the decoding probability for a given message size. We derive an upper bound on the decoding probability for any time-invariant code, and show that the gap between this bound and the performance of a family of time-invariant intrasession codes is small when the message size and packet erasure probability are small. In a simulation study, these codes performed well against a family of random time-invariant convolutional codes under a number of scenarios.

Finally, we consider the joint problems of routing and caching for named data networking. We propose a backpressure-based policy that employs virtual interest packets to make routing and caching decisions. In a packet-level simulation, the proposed policy outperformed a basic protocol that combines shortest-path routing with least-recently-used (LRU) cache replacement.

How are Italian and Spanish cities tackling climate change? A local comparative study

27 p.

Aquaculture genetics research and issues in INGA member countries/institutions

The information presented here is extracted from the presentations and discussions at the Sixth Steering Committee Meeting of the International Network on Genetics in Aquaculture (INGA) held in Hanoi, Vietnam on 8-10 May 2001. The main topics discussed were: review of genetics research progress and planned activities in member countries and Associate Member institutions; genetics improvement technologies; strategies and action plans for distribution of improved fish breeds to small-scale farmers; ecological risk assessment for genetically improved fish breeds; methods for monitoring the uptake of improved strains and impact assessment; and network activities and collaborations.

Learning from implementation of community selection in Zambia, Solomon Islands, and Bangladesh AAS hubs

The CGIAR Research Program on Aquatic Agricultural Systems (AAS) is a research in development program which aims to foster innovation to respond to community needs, and through networking and social learning to bring about development outcomes and impact at scale. It aims to reach the poorest and most vulnerable communities that are dependent upon aquatic agricultural systems. AAS uses monitoring and evaluation to track progress along identified impact pathways for accountability and learning. This report presents an evaluation of the recommended method for selecting communities during the participatory planning process, referred to as AAS “hub rollout,” in the first year of program implementation.

Spatial and temporal analysis of bottlenose dolphin strandings in South Carolina, 1992-2005

This CD contains summary data of bottlenose dolphins stranded in South Carolina using a Geographical Information System (GIS) and contains two published manuscripts in .pdf files. The intent of this CD is to provide data on bottlenose dolphin strandings in South Carolina to marine mammal researchers and managers. This CD is an accumulation of 14 years of stranding data collected through the collaborations of the National Ocean Service, Center for Coastal Environmental Health and Biomolecular Research (CCEHBR), the South Carolina Department of Natural Resources, and numerous volunteers and veterinarians that comprised the South Carolina Marine Mammal Stranding Network. Spatial and temporal information can be visually represented on maps using GIS. For this CD, maps were created to show relationships of stranding densities with land use, human population density, human interaction with dolphins, high geographical regions of live strandings, and seasonal changes. Point maps were also created to show individual strandings within South Carolina. In summary, spatial analysis revealed higher densities of bottlenose dolphin strandings in Charleston and Beaufort Counties, which consist of urban land with agricultural input. This trend was positively correlated with higher human population levels in these coastal counties as compared with other coastal counties. However, spatial analysis revealed that certain areas within a county may have low human population levels but high stranding density, suggesting that the level of effort to respond to strandings is not necessarily positively correlated with the density of strandings in South Carolina. Temporal analysis revealed a significantly higher density of bottlenose dolphin strandings in the northern portion of the State in the fall, mostly due to an increase of neonate strandings. On a finer geographic scale, seasonal stranding densities may fluctuate depending on the region of interest. Charleston Harbor had the highest density of live bottlenose dolphin strandings compared to the rest of the State. This was due in large part to the number of live dolphin entanglements in the crab pot fishery, the largest source of fishery-related mortality for bottlenose dolphins in South Carolina (Burdett and McFee 2004). Spatial density calculations also revealed that Charleston and Beaufort accounted for the majority of dolphins that were involved with human activities. 1

The state of coral reef ecosystems of the United States and Pacific Freely Associated States: 2008

In the past decade, increased awareness regarding the declining condition of U.S. coral reefs has prompted various actions by governmental and non-governmental organizations. Presidential Executive Order 13089 created the U.S. Coral Reef Task Force (USCRTF) in 1998 to coordinate federal and state/territorial activities (Clinton, 1998), and the Coral Reef Conservation Act of 2000 provided Congressional funding for activities to conserve these important ecosystems, including mapping, monitoring and assessment projects carried out through the support of NOAA’s CRCP. Numerous collaborations forged among federal agencies and state, local, non-governmental, academic and private partners now support a variety of monitoring activities. This report shares the results of many of these monitoring activities, relying heavily on quantitative, spatially-explicit data that has been collected in the recent past and comparisons with historical data where possible. The success of this effort can be attributed to the dedication of over 270 report contributors who comprised the expert writing teams in the jurisdictions and contributed to the National Level Activities and National Summary chapters. The scope and content of this report are the result of their dedication to this considerable collaborative effort. Ultimately, the goal of this report is to answer the difficult but vital question: what is the condition of U.S. coral reef ecosystems? The report attempts to base a response on the best available science emerging from coral reef ecosystem monitoring programs in 15 jurisdictions across the country. However, few monitoring programs have been in place for longer than a decade, and many have been initiated only within the past two to five years. A few jurisdictions are just beginning to implement monitoring programs and face challenges stemming from a lack of basic habitat maps and other ecosystem data in addition to adequate training, capacity building, and technical support. There is also a general paucity of historical data describing the condition of ecosystem resources before major human impacts occurred, which limits any attempt to present the current conditions within an historical context and contributes to the phenomenon of shifting baselines (Jackson, 1997; Jackson et al., 2001; Pandolfi et al., 2005).

Scientific statistics and graphics on the Macintosh

The personal computer has become commonplace on the desk of most scientists. As hardware costs have plummeted, software capabilities have expanded enormously, permitting the scientist to examine extremely large datasets in novel ways. Advances in networking now permit rapid transfer of large datasets, which can often be used unchanged from one machine to the next. In spite of these significant advances, many scientists still use their personal computers only for word processing or e-mail, or as "dumb terminals". Many are simply unaware of the richness of software now available to statistically analyze and display scientific data in highly innovative ways. This paper presents several examples drawn from actual climate data analysis that illustrate some novel and practical features of several widely-used software packages for Macintosh computers.

An investigation into the information exchange between a consultant and client company: a case study

This report deals with collaborations of engineering consultants and clients in the automobile industry.

In these relationships three main challenges have been identified which have to be addressed by the consultancies. Therefore, the research takes the viewpoint of the consulting side. The challenges are

(i) the appropriate project goal definition;

(ii) achieving client satisfaction; and

(iii) dealing with international clients.

An investigation of such a relationship carried out on a case study shows that improvements can be achieved through communication support. The ways to do that are proposed.

A condition monitoring platform using COTS wireless sensor networks - Lessons and experience

Developments in Micro-Electro-Mechanical Systems (MEMS), wireless communication systems and ad-hoc networking have created new dimensions to improve asset management not only during the operational phase but throughout an asset's lifecycle based on using improved quality of information obtained with respect to two key aspects of an asset: its location and condition. In this paper, we present our experience as well as lessons learnt from building a prototype condition monitoring platform to demonstrate and to evaluate the use of COTS wireless sensor networks to develop a prototype condition monitoring platform with the aim of improving asset management by providing accurate and real-time information. © 2010 IEEE.