Advances in scaling deep learning algorithms

Les algorithmes d'apprentissage profond forment un nouvel ensemble de méthodes puissantes pour l'apprentissage automatique. L'idée est de combiner des couches de facteurs latents en hierarchies. Cela requiert souvent un coût computationel plus elevé et augmente aussi le nombre de paramètres du modèle. Ainsi, l'utilisation de ces méthodes sur des problèmes à plus grande échelle demande de réduire leur coût et aussi d'améliorer leur régularisation et leur optimization. Cette thèse adresse cette question sur ces trois perspectives. Nous étudions tout d'abord le problème de réduire le coût de certains algorithmes profonds. Nous proposons deux méthodes pour entrainer des machines de Boltzmann restreintes et des auto-encodeurs débruitants sur des distributions sparses à haute dimension. Ceci est important pour l'application de ces algorithmes pour le traitement de langues naturelles. Ces deux méthodes (Dauphin et al., 2011; Dauphin and Bengio, 2013) utilisent l'échantillonage par importance pour échantilloner l'objectif de ces modèles. Nous observons que cela réduit significativement le temps d'entrainement. L'accéleration atteint 2 ordres de magnitude sur plusieurs bancs d'essai. Deuxièmement, nous introduisont un puissant régularisateur pour les méthodes profondes. Les résultats expérimentaux démontrent qu'un bon régularisateur est crucial pour obtenir de bonnes performances avec des gros réseaux (Hinton et al., 2012). Dans Rifai et al. (2011), nous proposons un nouveau régularisateur qui combine l'apprentissage non-supervisé et la propagation de tangente (Simard et al., 1992). Cette méthode exploite des principes géometriques et permit au moment de la publication d'atteindre des résultats à l'état de l'art. Finalement, nous considérons le problème d'optimiser des surfaces non-convexes à haute dimensionalité comme celle des réseaux de neurones. Tradionellement, l'abondance de minimum locaux était considéré comme la principale difficulté dans ces problèmes. Dans Dauphin et al. (2014a) nous argumentons à partir de résultats en statistique physique, de la théorie des matrices aléatoires, de la théorie des réseaux de neurones et à partir de résultats expérimentaux qu'une difficulté plus profonde provient de la prolifération de points-selle. Dans ce papier nous proposons aussi une nouvelle méthode pour l'optimisation non-convexe.

Neurotransmitters Functional Balance in Neurodegenerative Disease Management:recent Advances

The recent developments in neurobiology have rendered new prominence and potential to study about the structure and function of brain and related disorders. Human behaviour is the net result of neural control of the communication between brain cells. Neurotransmitters are chemicals that are used to relay, amplify and modulate electrical signals between neurons and/or another cell. It mediates rapid intercellular communication through the nervous system by interacting with cell surface receptors. These receptors often trigger second messenger signaling pathways that regulate the activity of ion channels. The functional balance of different neurotransmitters such as Acetylcholine (Ach), Dopamine (DA), Serotonin (5-HT), Norepinephrine (NE), Epinephrine (EPI), Glutamate and Gamma amino butyric acid (GABA) regulates the growth, division and other vital functions of a normal cell / organism (Sudha, 1998). Any change in neurotransmitters' functional balance will result in the failure of cell function and may lead to the occurrence of diseases. Abnormalities in the production or functioning of neurotransmitters have been implicated in a number of neurological disorders like Schizophrenia, Alzheimer's, Epilepsy, Depression and Parkinson's disease. Changes in central and peripheral neuronal signaling system is also noted in diabetes, cancer, cell proliferation, alcoholism and aging. Elucidation of neurotransmitters receptor interaction pathways and gene expression regulation by second messengers and transcriptional factors in health and disease conditions can lead to new small molecules for development of therapeutic agents to improve neurological disease conditions. Increased awareness of the global effects of neurological disorders should help health care planners and the neurological community set appropriate priorities in research, prevention, and management of these diseases.

Technological Change and Modernisation in the Fishing Sector: The Question of Sustainability

Department of Applied Economics, Cochin University of Science And Technology.

Studies all transport and magnetic properties of nano particle doped MgB2 superconductor for technological applications

This thesis Entitled Studies on transport and magnetic properties of nano particle doped mgb2 superconductor for technological applications.The thesis ahead focuses on the establishment of enhanced superconducting properties in bulk MgB2 via nano particle doping and its conversion into mono/multifilamentary wires. Further, an attempt has also been made to develop prototypes of MgB2 coil and conduction cooled current lead for technological applications. The thesis is configured into 6 chapters. The opening chapter gives an idea on the phenomenon of superconductivity, the various types of superconductors and its applications in different fields. The second chapter is an introduction on MgB2 superconductor and its relevance which includes crystal and electronic structure, superconducting mechanism, basic superconducting properties along with its present international status. The third chapter provides details on the preparation and characterization techniques followed through out the study on MgB2. Fourth chapter discusses the effect of processing temperature and chemical doping using nano sized dopants on the superconducting properties of MgB2• Fifth chapter deals with the optimization of processing parameters and novel preparation techniques for wire fabrication. Sixth chapter furnishes the preparation of multifilamentary wires with various filament configurations, their electromechanical properties and it also incorporates the development of an MgB2 coil and a general purpose conduction cooled current lead.

Studies on the technological aspects and economic efficiency of trawl gear operating along the Cochin coast

Trawling, despite being heavily energy expensive, still continues to be the most energy expensive fishing method particularly so in View of the export oriented nature of the Indian seafood industry. This study therefore aims at analyzing the efficiency of trawls operation from Cochin, an important fishing center along the southwest coast of India. The analysis is made along two perspectives - economic and technological. Even though technological efficiency complement economic efficiency, in the fishing parlance, parameters like the size composition of the catch, selectivity factors, etc., will have a direct bearing on the technological qualities of the trawl, and which parameters will have a significant impact on the effective exploitation of a fishery stock. Whereas the technological analysis aims at improving the efficiency with regard to the effective utilization of fuel and fishery stocks, economic analysis ascertains the present status of the trawling operations from the commercial angle.

Inter- State Variations in Productivity trends and Technological Change in Indian industry

The present study entitled ‘Inter-State Variations in Manufacturing Productivity and Technological Changes in India’ covers a period of 38 years from l960 tol998-99. The study is mainly based on ASI data. The study starts with a discussion of the major facilitating factors of industrialization, namely, historical forces, public policy and infrastructure facilities. These are discussed in greater details in the context of our discussion on Perrox’s (1998) ‘growth pole’ and ‘development pole’, Hirschman’s (1958) ‘industrial centers’ and Myrdal’s ‘spread effect’ Most of the existing literature more or less agrees that the process of industrialization has not been unifonn in all Indian states. There has been a decline in inter-state industrial disparities over time. This aspect is dealt at some length in the third chapter. An important element that deserves detailed attention is the intra-regional differences in industrialisation. Regional industrialisation implies the emergence of a few focal points and industrial regions. Calcutta, Bombay and Madras were the initial focal points. Later other centers like Bangalore, Amritsar, Ahemedabad etc. emerged as nodal points in other states. All major states account for focal points. The analysis made in the third chapter shows that industrial activities generally converge to one or two focal points and industrial regions have emerged out of the focal points in almost all states. One of the general features of these complexes and regions is that they approximately accommodate 50 to 75 percent of the total industrial units and workers in the state. Such convergence is seen hands in glow with urbanization. It was further seen that intra-regional industrial disparity comes down in industrial states like Maharashtra, Gujarat and Uttar Pradesh.

Technological Change and the Development of the Primary Fishing Industry of Kerala - A Study of Limited Growth

Induction of growth in the primary marine fishing industry of Kerala is a sine gua Qgn for improving the economy of the fishermen, the state's domestic product as well as earning more foreign exchange for the country. The State Administration has been trying to instil growth into the industry eversince the output of the industry showed marked sign of decline (particularly after 1975). Significantly, it has attempted to strengthen the traditional sector, (which is considered to be the crucial sector of the primary marine fishing industry of the state) by introducing intermediate technology and by revamping the organisational structure of the industry. But it appears that the production system in the primary marine fishing industry of Kerala has been severely constrained by the existing technology, organisation of production and marketing institutions. Regeneration of growth in the industry calls forth an understanding of the 'process' of growth in the industry and the need to réorganise it with new technology, and new organisations. The present study is an attempt to unraval the process of growth in the primary marine fishing industry of Kerala since 1951

Low-Cost Micromechanically Tunable Optical Devices: Strained Resonator Engineering, Technological Implementation and Characterization

The rapid growth of the optical communication branches and the enormous demand for more bandwidth require novel networks such as dense wavelength division multiplexing (DWDM). These networks enable higher bitrate transmission using the existing optical fibers. Micromechanically tunable optical microcavity devices like VCSELs, Fabry-Pérot filters and photodetectors are core components of these novel DWDM systems. Several air-gap based tunable devices were successfully implemented in the last years. Even though these concepts are very promising, two main disadvantages are still remaining. On the one hand, the high fabrication and integration cost and on the other hand the undesired adverse buckling of the suspended membranes. This thesis addresses these two problems and consists of two main parts: • PECVD dielectric material investigation and stress control resulting in membranes shape engineering. • Implementation and characterization of novel tunable optical devices with tailored shapes of the suspended membranes. For this purposes, low-cost PECVD technology is investigated and developed in detail. The macro- and microstress of silicon nitride and silicon dioxide are controlled over a wide range. Furthermore, the effect of stress on the optical and mechanical properties of the suspended membranes and on the microcavities is evaluated. Various membrane shapes (concave, convex and planar) with several radii of curvature are fabricated. Using this resonator shape engineering, microcavity devices such as non tunable and tunable Fabry-Pérot filters, VCSELs and PIN photodetectors are succesfully implemented. The fabricated Fabry-Pérot filters cover a spectral range of over 200nm and show resonance linewidths down to 1.5nm. By varying the stress distribution across the vertical direction within a DBR, the shape and the radius of curvature of the top membrane are explicitely tailored. By adjusting the incoming light beam waist to the curvature, the fundamental resonant mode is supported and the higher order ones are suppressed. For instance, a tunable VCSEL with 26 nm tuning range, 400µW maximal output power, 47nm free spectral range and over 57dB side mode suppresion ratio (SMSR) is demonstrated. Other technologies, such as introducing light emitting organic materials in microcavities are also investigated.

Entwicklung der Windenergietechnik in Deutschland und der Einfluss staatlicher Förderpolitik - Technikentwicklung in den 90er Jahren zwischen Markt und Forschungsförderung

Seit gut zehn Jahren erlebt die Windenergienutzung in Deutschland einen in der Mitte der 80er Jahre nicht für möglich gehaltenen Aufschwung. Anlagenanzahl und installierte Leistung haben in diesem Zeitraum mit durchschnittlichen jährlichen Wachstumsraten von mehr als 30 Prozent zugenommen, die mittlere installierte Leistung pro neu errichteter Anlage stieg dabei um das Zehnfache und die technische Verfügbarkeit der Anlagen liegt mittlerweile bei über 98 Prozent. Mit größer werdenden Anlagen zeigt sich weiterhin ein klarer Trend zu Blattwinkel verstellbaren Konzepten, mit zunehmend drehzahlvariabler Betriebsweise. Vor dem von Vielen für die kommenden drei bis sechs Jahre prognostizierten Einstieg in die großtechnische Offshore- Windenergienutzung mit den damit verbundenen immensen technologischen und strukturellen Herausforderungen erscheint es sinnvoll, einen kritischen Blick zurückzuwerfen auf die 90er Jahre mit den ihnen zugrunde liegenden förderpolitischen Rahmenbedingungen. Dabei soll die Frage beantwortet werden, welchen konkreten Einfluss die staatlichen Forschungs- und Förderprogramme, besonders das "250 MW Wind"-Programm, auf die Entwicklung der Windenergienutzung hatten, das heißt, unter welchen Bedingungen sich bestimmte Techniklinien durchsetzten, wie der Einfluss eines geschützten Marktes durch gesetzlich garantierte Einspeisetarife auf diese Entwicklung zu bewerten ist und schließlich, welche Fehlentwicklungen möglicher Weise eingetreten sind. Dazu wird mit Hilfe von Lernkurven gezeigt, welche Kostenreduktionen insgesamt erzielt wurden, wie hoch die dazu notwendigen staatlichen Finanzmittel waren und welche Schlussfolgerungen daraus für die Zukunft abgeleitet werden können. Die Arbeit soll insgesamt dazu beitragen, die erreichten technischen Entwicklungsschritte vor dem Hintergrund der förderpolitischen Gegebenheiten besser zu verstehen, Chancen für gezielte Änderungen in der Förderpraxis zu ergreifen und Hinweise auf die Ausgestaltung von zukünftigen Forschungsprogrammen und Entwicklungsschwerpunkten im Bereich der Windenergie zu geben, um weitere Kostensenkungspotenziale auszuschöpfen. Dabei wird sich die zukünftige Schwerpunktsetzung in der programmatischen Ausrichtung der Forschung stärker auf die drei wichtigsten Anwendungsfelder für Windenergieanlagen konzentrieren müssen, die großtechnische Offshore- Anwendung, die netzgebundene, dezentrale Energieversorgung sowie auf Windenergieanlagen zur ländlichen Elektrifizierung in autonomen Versorgungssystemen für Schwellen- und Entwicklungsländer.

Optimization in the Technological Steps for the Fabrication of Large Area Micromirror Arrays

Micromirror arrays are a very strong candidate for future energy saving applications. Within this work, the fabrication process for these micromirror arrays has been optimized and some steps for the large area fabrication of micromirror modules were performed. At first the surface roughness of the insulation layer of silicon dioxide (SiO2) was investigated. This SiO2 thin layer was deposited on three different type of substrates i.e. silicon, glass and Polyethylene Naphthalate (PEN) substrates. The deposition techniques which has been used are Plasma Enhanced Chemical Vapor Deposition (PECVD), Physical Vapor Deposition (PVD) and Ion Beam Sputter Deposition (IBSD). The thickness of the SiO2 thin layer was kept constant at 150nm for each deposition process. The surface roughness was measured by Stylus Profilometry and Atomic Force Microscopy (AFM). It was found that the layer which was deposited by IBSD has got the minimum surface roughness value and the layer which was deposited by PECVD process has the highest surface roughness value. During the same investigation, the substrate temperature of PECVD was varied from 80° C to 300° C with the step size of 40° C and it was found that the surface roughness keeps on increasing as the substrate holder temperature increases in the PECVD process. A new insulation layer system was proposed to minimize the dielectric breakdown effect in insulation layer for micromirror arrays. The conventional bilayer system was replaced by five layer system but the total thickness of insulation layer remains the same. It was found that during the actuation of micromirror arrays structure, the dielectric breakdown effect was reduced considerably as compared to the bilayer system. In the second step the fabrication process of the micromirror arrays was successfully adapted and transferred from glass substrates to the flexible PEN substrates by optimizing the conventional process recipe. In the last section, a large module of micromirror arrays was fabricated by electrically interconnecting four 10cm×10cm micromirror modules on a glass pane having dimensions of 21cm×21cm.

Technological convergence: a strategic perspective

The information and communication technologies (ICT) sectors are in a process of technological convergence. Determinant factors in this process are the liberalisation of the telecommunications markets and technological change. Many firms are engaged in a process of mergers and alliances to position themselves in this new framework. Technological and demand uncertainties are very important. Our objective in this paper is to study the economic determinants of the strategies of the firms. With this aim, we review some key technological and demand aspects. We shed some light on the strategic motivations of the firms by establishing a parallel with the evolution of the retailing sector

Fomento de las certificaciones del talento humano y la biotecnología en las cadenas de las TIC

Teniendo en cuenta que las Tecnologías de la Información y las Comunicación (TIC) son incuestionables y están ahí, formando parte de la cultura tecnológica que nos rodea y con la que debemos convivir Incluimos en el concepto TIC, la biotecnología y la acreditación de procesos y certificación de talento humano en la prestación de servicios de salud teniendo en cuenta la importancia de los mismos en el desarrollo de nuestras regiones y a nivel nacional. La biotecnología y la acreditación en salud a través del tiempo han sido temas Cambiantes, siguiendo el ritmo de los continuos avances científicos y en un marco de globalización económica y cultural, contribuyen a la rápida obsolescencia de los conocimientos y a la emergencia de nuevos valores, provocando continuas transformaciones en nuestras estructuras económicas, sociales y culturales, e incidiendo en casi todos los aspectos de nuestra vida. La biotecnología comprende una amplia variedad de conocimientos y tecnologías que incluyen disciplinas básicas y aplicadas, logrando un impacto positivo en el progreso socioeconómico de los países que se han interesado en fortalecer el desarrollo y aplicación de la biotecnología en sus mercados. Por otro lado la acreditación de los diferentes servicios de salud y la certificación del talento humano en nuestro país se ha venido perfeccionando guiado por estándares competentes a nivel mundial lo que nos da una ventaja para la promoción, venta y reconocimiento de nuestros servicios de salud a nivel internacional.

Biased Technological Change, Impatience and Welfare

En este artículo utilizamos un modelo de generaciones traslapadas con heterogeneidad en la tasa de impaciencia para mostrar que los efectos de un cambio tecnológico aumentador de capital no son simétricos en los agentes y pueden conllevar una reducci on en el consumo. La asimetría en la tasa de impaciencia de los agentes en un período, tiene consecuencias sobre los beneficios del cambio tecnológico para las generaciones futuras. Menores tasas de impaciencia llevan a mayores niveles de capital y de consumo, si se entiende que la economía tiene el suficiente nivel de capital per capita.