Coding for information storage

Storage systems are widely used and have played a crucial rule in both consumer and industrial products, for example, personal computers, data centers, and embedded systems. However, such system suffers from issues of cost, restricted-lifetime, and reliability with the emergence of new systems and devices, such as distributed storage and flash memory, respectively. Information theory, on the other hand, provides fundamental bounds and solutions to fully utilize resources such as data density, information I/O and network bandwidth. This thesis bridges these two topics, and proposes to solve challenges in data storage using a variety of coding techniques, so that storage becomes faster, more affordable, and more reliable.

We consider the system level and study the integration of RAID schemes and distributed storage. Erasure-correcting codes are the basis of the ubiquitous RAID schemes for storage systems, where disks correspond to symbols in the code and are located in a (distributed) network. Specifically, RAID schemes are based on MDS (maximum distance separable) array codes that enable optimal storage and efficient encoding and decoding algorithms. With r redundancy symbols an MDS code can sustain r erasures. For example, consider an MDS code that can correct two erasures. It is clear that when two symbols are erased, one needs to access and transmit all the remaining information to rebuild the erasures. However, an interesting and practical question is: What is the smallest fraction of information that one needs to access and transmit in order to correct a single erasure? In Part I we will show that the lower bound of 1/2 is achievable and that the result can be generalized to codes with arbitrary number of parities and optimal rebuilding.

We consider the device level and study coding and modulation techniques for emerging non-volatile memories such as flash memory. In particular, rank modulation is a novel data representation scheme proposed by Jiang et al. for multi-level flash memory cells, in which a set of n cells stores information in the permutation induced by the different charge levels of the individual cells. It eliminates the need for discrete cell levels, as well as overshoot errors, when programming cells. In order to decrease the decoding complexity, we propose two variations of this scheme in Part II: bounded rank modulation where only small sliding windows of cells are sorted to generated permutations, and partial rank modulation where only part of the n cells are used to represent data. We study limits on the capacity of bounded rank modulation and propose encoding and decoding algorithms. We show that overlaps between windows will increase capacity. We present Gray codes spanning all possible partial-rank states and using only ``push-to-the-top'' operations. These Gray codes turn out to solve an open combinatorial problem called universal cycle, which is a sequence of integers generating all possible partial permutations.

Effects of density differences on lateral mixing in open-channel flows

This study investigates lateral mixing of tracer fluids in turbulent open-channel flows when the tracer and ambient fluids have different densities. Longitudinal dispersion in flows with longitudinal density gradients is investigated also.

Lateral mixing was studied in a laboratory flume by introducing fluid tracers at the ambient flow velocity continuously and uniformly across a fraction of the flume width and over the entire depth of the ambient flow. Fluid samples were taken to obtain concentration distributions in cross-sections at various distances, x, downstream from the tracer source. The data were used to calculate variances of the lateral distributions of the depth-averaged concentration. When there was a difference in density between the tracer and the ambient fluids, lateral mixing close to the source was enhanced by density-induced secondary flows; however, far downstream where the density gradients were small, lateral mixing rates were independent of the initial density difference. A dimensional analysis of the problem and the data show that the normalized variance is a function of only three dimensionless numbers, which represent: (1) the x-coordinate, (2) the source width, and (3) the buoyancy flux from the source.

A simplified set of equations of motion for a fluid with a horizontal density gradient was integrated to give an expression for the density-induced velocity distribution. The dispersion coefficient due to this velocity distribution was also obtained. Using this dispersion coefficient in an analysis for predicting lateral mixing rates in the experiments of this investigation gave only qualitative agreement with the data. However, predicted longitudinal salinity distributions in an idealized laboratory estuary agree well with published data.

Development of roll waves in open channels

This study is concerned with some of the properties of roll waves that develop naturally from a turbulent uniform flow in a wide rectangular channel on a constant steep slope . The wave properties considered were depth at the wave crest, depth at the wave trough, wave period, and wave velocity . The primary focus was on the mean values and standard deviations of the crest depths and wave periods at a given station and how these quantities varied with distance along the channel.

The wave properties were measured in a laboratory channel in which roll waves developed naturally from a uniform flow . The Froude number F (F = u_n/√gh_n, u_n = normal velocity , h_n = normal depth, g =acceleration of gravity) ranged from 3. 4 to 6. 0 for channel slopes S_o of . 05 and . 12 respectively . In the initial phase of their development the roll waves appeared as small amplitude waves with a continuous water surface profile . These small amplitude waves subsequently developed into large amplitude shock waves. Shock waves were found to overtake and combine with other shock waves with the result that the crest depth of the combined wave was larger than the crest depths before the overtake. Once roll waves began to develop, the mean value of the crest depths h_nmax increased with distance . Once the shock waves began to overtake, the mean wave period T_av increased approximately linearly with distance.

For a given Froude number and channel slope the observed quantities h^-_max/h_n , T' (T' = S_o T_av √g/h_n), and the standard deviations of h^-_max/h_n and T', could be expressed as unique functions of l/h_n (l = distance from beginning of channel) for the two-fold change in h_n occurring in the observed flows . A given value of h^-_max/h_n occurred at smaller values of l/h_n as the Froude number was increased. For a given value of h /hh^-_max/h_n the growth rate of δh^-_max/h^-_maxδl of the shock waves increased as the Froude number was increased.

A laboratory channel was also used to measure the wave properties of periodic permanent roll waves. For a given Froude number and channel slope the h^-_max/h_n vs. T' relation did not agree with a theory in which the weight of the shock front was neglected. After the theory was modified to include this weight, the observed values of h^-_max/h_n were within an average of 6.5 percent of the predicted values, and the maximum discrepancy was 13.5 percent.

For h^-_max/h_n sufficiently large (h^-_max/h_n > approximately 1.5) it was found that the h^-_max/h_n vs. T' relation for natural roll waves was practically identical to the h^-_max/h_n vs. T' relation for periodic permanent roll waves at the same Froude number and slope. As a result of this correspondence between periodic and natural roll waves, the growth rate δh^-_max/h^-_maxδl of shock waves was predicted to depend on the channel slope, and this slope dependence was observed in the experiments.