Content-aware compression for big textual data analysis

A substantial amount of information on the Internet is present in the form of text. The value of this semi-structured and unstructured data has been widely acknowledged, with consequent scientific and commercial exploitation. The ever-increasing data production, however, pushes data analytic platforms to their limit. This thesis proposes techniques for more efficient textual big data analysis suitable for the Hadoop analytic platform. This research explores the direct processing of compressed textual data. The focus is on developing novel compression methods with a number of desirable properties to support text-based big data analysis in distributed environments. The novel contributions of this work include the following. Firstly, a Content-aware Partial Compression (CaPC) scheme is developed. CaPC makes a distinction between informational and functional content in which only the informational content is compressed. Thus, the compressed data is made transparent to existing software libraries which often rely on functional content to work. Secondly, a context-free bit-oriented compression scheme (Approximated Huffman Compression) based on the Huffman algorithm is developed. This uses a hybrid data structure that allows pattern searching in compressed data in linear time. Thirdly, several modern compression schemes have been extended so that the compressed data can be safely split with respect to logical data records in distributed file systems. Furthermore, an innovative two layer compression architecture is used, in which each compression layer is appropriate for the corresponding stage of data processing. Peripheral libraries are developed that seamlessly link the proposed compression schemes to existing analytic platforms and computational frameworks, and also make the use of the compressed data transparent to developers. The compression schemes have been evaluated for a number of standard MapReduce analysis tasks using a collection of real-world datasets. In comparison with existing solutions, they have shown substantial improvement in performance and significant reduction in system resource requirements.

Diaphragm muscle adaptation to sustained hypoxia: lessons from animal models with relevance to high altitude and chronic respiratory diseases

The diaphragm is the primary inspiratory pump muscle of breathing. Notwithstanding its critical role in pulmonary ventilation, the diaphragm like other striated muscles is malleable in response to physiological and pathophysiological stressors, with potential implications for the maintenance of respiratory homeostasis. This review considers hypoxic adaptation of the diaphragm muscle, with a focus on functional, structural, and metabolic remodeling relevant to conditions such as high altitude and chronic respiratory disease. On the basis of emerging data in animal models, we posit that hypoxia is a significant driver of respiratory muscle plasticity, with evidence suggestive of both compensatory and deleterious adaptations in conditions of sustained exposure to low oxygen. Cellular strategies driving diaphragm remodeling during exposure to sustained hypoxia appear to confer hypoxic tolerance at the expense of peak force-generating capacity, a key functional parameter that correlates with patient morbidity and mortality. Changes include, but are not limited to: redox-dependent activation of hypoxia-inducible factor (HIF) and MAP kinases; time-dependent carbonylation of key metabolic and functional proteins; decreased mitochondrial respiration; activation of atrophic signaling and increased proteolysis; and altered functional performance. Diaphragm muscle weakness may be a signature effect of sustained hypoxic exposure. We discuss the putative role of reactive oxygen species as mediators of both advantageous and disadvantageous adaptations of diaphragm muscle to sustained hypoxia, and the role of antioxidants in mitigating adverse effects of chronic hypoxic stress on respiratory muscle function.