Deep learning of representations and its application to computer vision

L’objectif de cette thèse par articles est de présenter modestement quelques étapes du parcours qui mènera (on espère) à une solution générale du problème de l’intelligence artificielle. Cette thèse contient quatre articles qui présentent chacun une différente nouvelle méthode d’inférence perceptive en utilisant l’apprentissage machine et, plus particulièrement, les réseaux neuronaux profonds. Chacun de ces documents met en évidence l’utilité de sa méthode proposée dans le cadre d’une tâche de vision par ordinateur. Ces méthodes sont applicables dans un contexte plus général, et dans certains cas elles on tété appliquées ailleurs, mais ceci ne sera pas abordé dans le contexte de cette de thèse. Dans le premier article, nous présentons deux nouveaux algorithmes d’inférence variationelle pour le modèle génératif d’images appelé codage parcimonieux “spike- and-slab” (CPSS). Ces méthodes d’inférence plus rapides nous permettent d’utiliser des modèles CPSS de tailles beaucoup plus grandes qu’auparavant. Nous démontrons qu’elles sont meilleures pour extraire des détecteur de caractéristiques quand très peu d’exemples étiquetés sont disponibles pour l’entraînement. Partant d’un modèle CPSS, nous construisons ensuite une architecture profonde, la machine de Boltzmann profonde partiellement dirigée (MBP-PD). Ce modèle a été conçu de manière à simplifier d’entraînement des machines de Boltzmann profondes qui nécessitent normalement une phase de pré-entraînement glouton pour chaque couche. Ce problème est réglé dans une certaine mesure, mais le coût d’inférence dans le nouveau modèle est relativement trop élevé pour permettre de l’utiliser de manière pratique. Dans le deuxième article, nous revenons au problème d’entraînement joint de machines de Boltzmann profondes. Cette fois, au lieu de changer de famille de modèles, nous introduisons un nouveau critère d’entraînement qui donne naissance aux machines de Boltzmann profondes à multiples prédictions (MBP-MP). Les MBP-MP sont entraînables en une seule étape et ont un meilleur taux de succès en classification que les MBP classiques. Elles s’entraînent aussi avec des méthodes variationelles standard au lieu de nécessiter un classificateur discriminant pour obtenir un bon taux de succès en classification. Par contre, un des inconvénients de tels modèles est leur incapacité de générer deséchantillons, mais ceci n’est pas trop grave puisque la performance de classification des machines de Boltzmann profondes n’est plus une priorité étant donné les dernières avancées en apprentissage supervisé. Malgré cela, les MBP-MP demeurent intéressantes parce qu’elles sont capable d’accomplir certaines tâches que des modèles purement supervisés ne peuvent pas faire, telles que celle de classifier des données incomplètes ou encore celle de combler intelligemment l’information manquante dans ces données incomplètes. Le travail présenté dans cette thèse s’est déroulé au milieu d’une période de transformations importantes du domaine de l’apprentissage à réseaux neuronaux profonds qui a été déclenchée par la découverte de l’algorithme de “dropout” par Geoffrey Hinton. Dropout rend possible un entraînement purement supervisé d’architectures de propagation unidirectionnel sans être exposé au danger de sur- entraînement. Le troisième article présenté dans cette thèse introduit une nouvelle fonction d’activation spécialement con ̧cue pour aller avec l’algorithme de Dropout. Cette fonction d’activation, appelée maxout, permet l’utilisation de aggrégation multi-canal dans un contexte d’apprentissage purement supervisé. Nous démontrons comment plusieurs tâches de reconnaissance d’objets sont mieux accomplies par l’utilisation de maxout. Pour terminer, sont présentons un vrai cas d’utilisation dans l’industrie pour la transcription d’adresses de maisons à plusieurs chiffres. En combinant maxout avec une nouvelle sorte de couche de sortie pour des réseaux neuronaux de convolution, nous démontrons qu’il est possible d’atteindre un taux de succès comparable à celui des humains sur un ensemble de données coriace constitué de photos prises par les voitures de Google. Ce système a été déployé avec succès chez Google pour lire environ cent million d’adresses de maisons.

Fermentation of Prawn Shell Waste and Its Application of its Product as Dietary Ingredient for Penaeus Indicus (H. Milne Edwards)

This work envisages the fermentation of prawn shell waste into a more nutritious product with simpler components for application as a feed ingredient in aquaculture. This product would be a rich source of protein along with chitin, minerals, vitamins and N-acetyl glucosamine. A brief description of the various processing (chemical and bioprocess) methods employed for chitin, chitosan and single sell protein preparations from shell waste. It deals with the isolation of micro flora associated with prawn shell degradation. It describes the methods adopted for fermentation of prawn shell degradation and fermentation of prawn shell waste with the selected highly chitinoclastic strains. The comparison of SSF and SmF for each selected strain in terms of enrichment of protein, lipid and carbohydrate in the fermented product was done. Detailed analysis of product quality is discussed. The feed for mulation and feeding experiment explained in detail. Statistical analysis of various biogrowth parameters was done with Duncan’s multiple range test. Very briefly explains 28 days of feeding experiment. A method for the complete utilization of shell waste explains with the help of experiments.

Extraction of Glucan from Acremonium Diospyri and Its Application in Macrobrachium Rosenbergii Larval Rearing System Along With Bacterians as Microspheres

Present work is aimed at development of an appropriate microbial technology for protection of larvae of macrobrachium rosenbergii from disease and to increase survival rate in hatcheries. Application of immunostimulants to activate the immune system of cultured animals against pathogen is the widely accepted alternative to antibiotics in aquaculture. The most important immunostimulant is glucan. Therefore a research programme entitled as extraction of glucan from Acremonium diospyri and its application in macrobrachium rosenbergii larval rearing system along with bacterians as microspheres. The main objectives of the study are development of aquaculture grade glucan from acremonium diospyri, microencapsulated drug delivery system for the larvae of M. rosenbergii and microencapsulated glucan with bacterian preparation for the enhanced production of M. rosenbergii in larval rearing system. Based on the results of field trials microencapsulated glucan with bacterin preparation, it is concluded that the microencapsulated preparation at a concentration of 25g per million larvae once in seven days will enhance the production and quality seed of M. rosenbergii.

Ecological and Biochemical Studies On Cyanobacteria of Cochin Estuary and Their Application as Source of Antioxidants

The main objectives of the present investigation were to evaluate the qualitative and quantitative distribution of natural cyanobacterial population and their ecobiological properties along the Cochin estuary and their application in aquaculture systems as a nutritional supplement due to their nutrient-rich biochemical composition and antioxidant potential. This thesis presents a detailed account of the distribution of cyanobacteria in Cochin estuary, an assessment of physico-chemical parameters and the nutrients of the study site, an evaluation of the effect of physico-chemical parameters on cyanobacterial distribution and abundance, isolation, identification and culturing of cyanobacteria, the biochemical composition an productivity of cyanobacteria, and an evaluation of the potential of the selected cyanobacteria as antioxidants against ethanol induced lipid peroxidation. The pH, salinity and nutritional requirements were optimized for low-cost production of the selected cyanobacterial strains. The present study provides an insight into the distribution, abundance, diversity and ecology of cyanobacteria of Cochin estuary. From the results, it is evident that the ecological conditions of Cochin estuary support a rich cyanobacterial growth.

Production and Characterization of Endocylanase from Bacillus Pumilus Using Solidstate Fermentation and its Application in 'Paper Pulp Processing

In the present studies it is clear that Bacillus pumilus xylanase is having the characteristic suited for an industrial enzyme (xylanases that are active and stable at elevated temperatures and alkaline pH are needed). SSF production of xylanases and its application appears to be an innovative technology where the fermented substrate is the enzyme source that is used directly in the bleaching process without a prior downstream processing. The direct use of SSF enzymes in bleaching is a relatively new biobleaching approach. This can certainly benefit the bleaching process to lower the xylanase production costs and improve the economics and viability of the biobleaching technology. The application of enzymes to the bleaching process has been considered as an environmentally friendly approach that can reduce the negative impact on the environment exerted by the use of chlorine-based bleaching agents. It has been demonstrated that pretreatment of kraft pulp with xylanase prior to bleaching (biobleaching) can facilitate subsequent removal of lignin by bleaching chemicals, thereby, reducing the demand for elemental chlorine or improving final paper brightness. Using this xylanase pre-treatment, has resulted in an increased of brightness (8.5 Unit) when compared to non-enzymatic treated bleached pulp prepared using identical conditions. Reduction of the consumption of active chlorine can be achieved which results in a decrease in the toxicity, colour, chloride and absorbable organic halogen (AOX) levels of bleaching effluents. The xylanase treatment improves drainage, strength properties and the fragility of pulps, and also increases the brightness of pulps. This positive result shows that enzyme pre-treatment facilitates the removal of chromophore fragments of pulp there by making the process more environment friendly

Intraseasonal oscillation of total precipitable water over North Indian Ocean and its application in the diagnostic study of coastal rainfall

TRMM Microwave Imager (TMI) is reported to be a useful sensor to measure the atmospheric and oceanic parameters even in cloudy conditions. Vertically integrated specific humidity, Total Precipitable Water (TPW) retrieved from the water vapour absorption channel (22GHz.) along with 10m wind speed and rain rate derived from TMI is used to investigate the moisture variation over North Indian Ocean. Intraseasonal Oscillations (ISO) of TPW during the summer monsoon seasons 1998, 1999, and 2000 over North Indian Ocean is explored using wavelet analysis. The dominant waves in TPW during the monsoon periods and the differences in ISO over Arabian Sea and Bay of Bengal are investigated. The northward propagation of TPW anomaly and its coherence with the coastal rainfall is also studied. For the diagnostic study of heavy rainfall spells over the west coast, the intrusion of TPW over the North Arabian Sea is seen to be a useful tool.

Production of Alkaline Protease by Free and Immobilised Cells of VIBRIO sp. Under Different Fermentation Systems and Its Application on Deproteinisation of Prawn Shell Waste for Chitin Recovery

This thesis presents a detailed account of a cost - effective approach towards enhanced production of alkaline protease at profitable levels using different fermentation designs employing cheap agro-industrial residues. It involves the optimisation of process parameters for the production of a thermostable alkaline protease by Vibrio sp. V26 under solid state, submerged and biphasic fermentations, production of the enzyme using cell immobilisation technology and the application of the crude enzyme on the deproteinisation of crustacean waste.The present investigation suggests an economic move towards Improved production of alkaline protease at gainful altitudes employing different fermentation designs utilising inexpensive agro-industrial residues. Moreover, the use of agro-industrial and other solid waste substrates for fermentation helps to provide a substitute in conserving the already dwindling global energy resources. Another alternative for accomplishing economically feasible production is by the use of immobilisation technique. This method avoids the wasteful expense of continually growing microorganisms. The high protease producing potential of the organism under study ascertains their exploitation in the utilisation and management of wastes. However, strain improvement studies for the production of high yielding variants using mutagens or by gene transfer are required before recommending them to Industries.Industries, all over the world, have made several attempts to exploit the microbial diversity of this planet. For sustainable development, it is essential to discover, develop and defend this natural prosperity. The Industrial development of any country is critically dependent on the intellectual and financial investment in this area. The need of the hour is to harness the beneficial uses of microbes for maximum utilisation of natural resources and technological yields. Owing to the multitude of applications in a variety of industrial sectors, there has always been an increasing demand for novel producers and resources of alkaline proteases as well as for innovative methods of production at a commercial altitude. This investigation forms a humble endeavour towards this perspective and bequeaths hope and inspiration for inventions to follow.

Fabrication And Parametric Measurements Of N2 Laser Pumped Dye Laser And Its Application To Energy Transfer Studies In Mixed Dyes

Eventhough a large number of schemes have been proposed and develoned for N9 laser ouined dye lasers the relatively low efficiency compelled the scientists to device new methods to improve the system efficiencs. Energy transfer mechanism has been shown to he a convenien tool for the enhancement of efficiency of dye lasers. Th p resent work covers a detailed study of the performance characteristics of a N2 laser pumped dye laser in the con— ventional mode and also, when pumped by the energy transfer mechanism. For .th.e present investigations a dye laser pumped by a'N2 laser (A4200 kw peak power) was fabricated. The grating at grazing incidence was used as the beam expanding device; A t its best performance the system was giving an output peak power of l5 kW for a 5 X lC"3H/l Rh—€ solution in methanol. T he conversion efficiency was 7.5; The output beam was having 3 divergence of 2 mrad and bandwidth o.9 A. Suitable modifications were suggested for obtaining better conversion efficiency and bandwidth.

Quasilocal density functional theory and its application within the extended Thomas-Fermi approximation

In this paper we propose a generalization of the density functional theory. The theory leads to single-particle equations of motion with a quasilocal mean-field operator, which contains a quasiparticle position-dependent effective mass and a spin-orbit potential. The energy density functional is constructed using the extended Thomas-Fermi approximation and the ground-state properties of doubly magic nuclei are considered within the framework of this approach. Calculations were performed using the finite-range Gogny D1S forces and the results are compared with the exact Hartree-Fock calculations

The Surface Plasmon Resonance of Supported Noble Metal Nanoparticles: Characterization, Laser Tailoring, and SERS Application

This work deals with the optical properties of supported noble metal nanoparticles, which are dominated by the so-called Mie resonance and are strongly dependent on the particles’ morphology. For this reason, characterization and control of the dimension of these systems are desired in order to optimize their applications. Gold and silver nanoparticles have been produced on dielectric supports like quartz glass, sapphire and rutile, by the technique of vapor deposition under ultra-high vacuum conditions. During the preparation, coalescence is observed as an important mechanism of cluster growth. The particles have been studied in situ by optical transmission spectroscopy and ex situ by atomic force microscopy. It is shown that the morphology of the aggregates can be regarded as oblate spheroids. A theoretical treatment of their optical properties, based on the quasistatic approximation, and its combination with results obtained by atomic force microscopy give a detailed characterization of the nanoparticles. This method has been compared with transmission electron microscopy and the results are in excellent agreement. Tailoring of the clusters’ dimensions by irradiation with nanosecond-pulsed laser light has been investigated. Selected particles are heated within the ensemble by excitation of the Mie resonance under irradiation with a tunable laser source. Laser-induced coalescence prevents strongly tailoring of the particle size. Nevertheless, control of the particle shape is possible. Laser-tailored ensembles have been tested as substrates for surface-enhanced Raman spectroscopy (SERS), leading to an improvement of the results. Moreover, they constitute reproducible, robust and tunable SERS-substrates with a high potential for specific applications, in the present case focused on environmental protection. Thereby, these SERS-substrates are ideally suited for routine measurements.

Global Optimization Algorithms and their Application to Distributed Systems

In this report, we discuss the application of global optimization and Evolutionary Computation to distributed systems. We therefore selected and classified many publications, giving an insight into the wide variety of optimization problems which arise in distributed systems. Some interesting approaches from different areas will be discussed in greater detail with the use of illustrative examples.

Reflections about Complicity and its Application in some Socio Economics Crimes

In Colombia, the definitions of crimes are found in the special part of the Criminal Code. They are set out as though the only way of to commit them was by being the author of the punishable conduct there described. Nevertheless, in the general part of the Criminal Code, we find other forms of criminal responsibility for the conduct described in the special part. Complicity is one of those ways. Although complicity is established in the Criminal Code, it does not appear as a criminal definition and, as such it is ignored or, worse, applied incorrectly. For those reasons, this article tries to reflect upon the validity of complicity. Accordingly, this article analyzes: what is complicity, what is the difference between complicity and co-authorship and how would complicity work in some practical cases related to socio-economic crimes, in which it has being overlooked or, has been used incorrectly. The article concludes that complicity is still valid, and that the correct application of complicity materializes the ideal of justice.

Biological Basis and Clinical Application of Serum Tumor Markers

Cancer is the result of the accumulation of changes in molecules with important functions in processes such as cell proliferation, apoptosis, cell death and gene repair. Molecules, substances or altered pathways constitute tumor markers or biomarkers useful in clinical monitoring of cancer patients, because they have demonstrated to be suitable for the valuation of the patient’s treatment and it efficiency. Determination of tumor markers has not been very successful due to the low sensitivity and specificity of the techniques used and the requirement of large volumes of biological samples or the use of invasive methods for collecting them. The serum tumor markers arise, as a useful tool to obtain information about the disease progress and constitute as a scientific challenge to improve its applicability in early diagnosis, prognosis, monitoring of the disease and evaluation of therapeutic efficacy.