Self-Supervised ARTMAP

Computational models of learning typically train on labeled input patterns (supervised learning), unlabeled input patterns (unsupervised learning), or a combination of the two (semisupervised learning). In each case input patterns have a fixed number of features throughout training and testing. Human and machine learning contexts present additional opportunities for expanding incomplete knowledge from formal training, via self-directed learning that incorporates features not previously experienced. This article defines a new self-supervised learning paradigm to address these richer learning contexts, introducing a neural network called self-supervised ARTMAP. Self-supervised learning integrates knowledge from a teacher (labeled patterns with some features), knowledge from the environment (unlabeled patterns with more features), and knowledge from internal model activation (self-labeled patterns). Self-supervised ARTMAP learns about novel features from unlabeled patterns without destroying partial knowledge previously acquired from labeled patterns. A category selection function bases system predictions on known features, and distributed network activation scales unlabeled learning to prediction confidence. Slow distributed learning on unlabeled patterns focuses on novel features and confident predictions, defining classification boundaries that were ambiguous in the labeled patterns. Self-supervised ARTMAP improves test accuracy on illustrative lowdimensional problems and on high-dimensional benchmarks. Model code and benchmark data are available from: http://techlab.bu.edu/SSART/.

ARTMAP: Supervised Real-Time Learning and Classification of Nonstationary Data by a Self-Organizing Neural Network

This article introduces a new neural network architecture, called ARTMAP, that autonomously learns to classify arbitrarily many, arbitrarily ordered vectors into recognition categories based on predictive success. This supervised learning system is built up from a pair of Adaptive Resonance Theory modules (ARTa and ARTb) that are capable of self-organizing stable recognition categories in response to arbitrary sequences of input patterns. During training trials, the ARTa module receives a stream {a^(p)} of input patterns, and ARTb receives a stream {b^(p)} of input patterns, where b^(p) is the correct prediction given a^(p). These ART modules are linked by an associative learning network and an internal controller that ensures autonomous system operation in real time. During test trials, the remaining patterns a^(p) are presented without b^(p), and their predictions at ARTb are compared with b^(p). Tested on a benchmark machine learning database in both on-line and off-line simulations, the ARTMAP system learns orders of magnitude more quickly, efficiently, and accurately than alternative algorithms, and achieves 100% accuracy after training on less than half the input patterns in the database. It achieves these properties by using an internal controller that conjointly maximizes predictive generalization and minimizes predictive error by linking predictive success to category size on a trial-by-trial basis, using only local operations. This computation increases the vigilance parameter ρa of ARTa by the minimal amount needed to correct a predictive error at ARTb· Parameter ρa calibrates the minimum confidence that ARTa must have in a category, or hypothesis, activated by an input a^(p) in order for ARTa to accept that category, rather than search for a better one through an automatically controlled process of hypothesis testing. Parameter ρa is compared with the degree of match between a^(p) and the top-down learned expectation, or prototype, that is read-out subsequent to activation of an ARTa category. Search occurs if the degree of match is less than ρa. ARTMAP is hereby a type of self-organizing expert system that calibrates the selectivity of its hypotheses based upon predictive success. As a result, rare but important events can be quickly and sharply distinguished even if they are similar to frequent events with different consequences. Between input trials ρa relaxes to a baseline vigilance pa When ρa is large, the system runs in a conservative mode, wherein predictions are made only if the system is confident of the outcome. Very few false-alarm errors then occur at any stage of learning, yet the system reaches asymptote with no loss of speed. Because ARTMAP learning is self stabilizing, it can continue learning one or more databases, without degrading its corpus of memories, until its full memory capacity is utilized.

Fuzzy ARTMAP: A Neural Network Architecture for Incremental Supervised Learning of Analog Multidimensional Maps

A new neural network architecture is introduced for incremental supervised learning of recognition categories and multidimensional maps in response to arbitrary sequences of analog or binary input vectors. The architecture, called Fuzzy ARTMAP, achieves a synthesis of fuzzy logic and Adaptive Resonance Theory (ART) neural networks by exploiting a close formal similarity between the computations of fuzzy subsethood and ART category choice, resonance, and learning. Fuzzy ARTMAP also realizes a new Minimax Learning Rule that conjointly minimizes predictive error and maximizes code compression, or generalization. This is achieved by a match tracking process that increases the ART vigilance parameter by the minimum amount needed to correct a predictive error. As a result, the system automatically learns a minimal number of recognition categories, or "hidden units", to met accuracy criteria. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy logic play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Improved prediction is achieved by training the system several times using different orderings of the input set. This voting strategy can also be used to assign probability estimates to competing predictions given small, noisy, or incomplete training sets. Four classes of simulations illustrate Fuzzy ARTMAP performance as compared to benchmark back propagation and genetic algorithm systems. These simulations include (i) finding points inside vs. outside a circle; (ii) learning to tell two spirals apart; (iii) incremental approximation of a piecewise continuous function; and (iv) a letter recognition database. The Fuzzy ARTMAP system is also compared to Salzberg's NGE system and to Simpson's FMMC system.

Application of semi-automated strain analysis techniques and anisotropy of magnetic susceptibility in fold and thrust belts

Quantitative analysis of penetrative deformation in sedimentary rocks of fold and thrust belts has largely been carried out using clast based strain analysis techniques. These methods analyse the geometric deviations from an original state that populations of clasts, or strain markers, have undergone. The characterisation of these geometric changes, or strain, in the early stages of rock deformation is not entirely straight forward. This is in part due to the paucity of information on the original state of the strain markers, but also the uncertainty of the relative rheological properties of the strain markers and their matrix during deformation, as well as the interaction of two competing fabrics, such as bedding and cleavage. Furthermore one of the single largest setbacks for accurate strain analysis has been associated with the methods themselves, they are traditionally time consuming, labour intensive and results can vary between users. A suite of semi-automated techniques have been tested and found to work very well, but in low strain environments the problems discussed above persist. Additionally these techniques have been compared to Anisotropy of Magnetic Susceptibility (AMS) analyses, which is a particularly sensitive tool for the characterisation of low strain in sedimentary lithologies.

Self-organized vegetation patterning as a fingerprint of climate and human impact on semi-arid ecosystems

Spatially periodic vegetation patterns are well known in arid and semi-arid regions around the world. Mathematical models have been developed that attribute this phenomenon to a symmetry-breaking instability. Such models are based on the interplay between competitive and facilitative influences that the vegetation exerts on its own dynamics when it is constrained by arid conditions, but evidence for these predictions is still lacking. Moreover, not all models can account for the development of regularly spaced spots of bare ground in the absence of a soil prepattern. We applied Fourier analysis to high-resolution, remotely sensed data taken at either end of a 40-year interval in southern Niger. Statistical comparisons based on this textural characterization gave us broad-scale evidence that the decrease in rainfall over recent decades in the sub-Saharan Sahel has been accompanied by a detectable shift from homogeneous vegetation cover to spotted patterns marked by a spatial frequency of about 20 cycles km-1. Wood cutting and grazing by domestic animals have led to a much more marked transition in unprotected areas than in a protected reserve. Field measurements demonstrated that the dominant spatial frequency was endogenous rather than reflecting the spatial variation of any pre-existing heterogeneity in soil properties. All these results support the use of models that can account for periodic vegetation patterns without invoking substrate heterogeneity or anisotropy, and provide new elements for further developments, refinements and tests. This study underlines the potential of studying vegetation pattern properties for monitoring climatic and human impacts on the extensive fragile areas bordering hot deserts. Explicit consideration of vegetation self-patterning may also improve our understanding of vegetation and climate interactions in arid areas. © 2006 The Authors.

On the role of molecular clustering on infrared absorption line shapes of acetylene in a supersonic expansion

A supersonic expansion containing acetylene seeded into Ar and produced from a circular nozzle is investigated using CW/cavity ring down spectroscopy, in the 1.5 μm range. The results, also involving experiments with pure acetylene and acetylene-He expansions, as well as slit nozzles, demonstrate that the denser central section in the expansion is slightly heated by the formation of acetylene aggregates, resulting into a dip in the monomer absorption line profiles. Acetylene-Ar aggregates are also formed at the edge of the circular nozzle expansion cone. © 2008 Elsevier B.V. All rights reserved.

In situ concentration of semi-volatile aerosol using water-condensation technology

The effect of concentrating semi-volatile aerosols using a water-condensation technology was investigated using the Versatile Aerosol Concentration Enrichment System (VACES) and the Aerodyne Aerosol Mass Spectrometer (AMS) during measurements of ambient aerosol in Pittsburgh, PA. It was found that the shape of the sulfate mass-weighed size distribution was approximately preserved during passage through the concentrator for all the experiments performed, with a mass enhancement factor of about 10-20 depending on the experiment. The size distributions of organics, ammonium and nitrate were preserved on a relatively clean day (sulfate concentration around 7μg/m3), while during more polluted conditions the concentration of these compounds, especially nitrate, was increased at small sizes after passage through the concentrator. The amount of the extra material, however, is rather small in these experiments: between 2.4% and 7.5% of the final concentrated PM mass is due to "artifact" condensation. An analysis of thermodynamic processes in the concentrator indicates that the extra particle material detected can be explained by redistribution of gas-phase material to the aerosol phase in the concentrator. The analysis shows that the condensation of extra material is expected to be larger for water-soluble semi-volatile material, such as nitrate, which agrees with the observations. The analysis also shows that artifact formation of nitrate will be more pronounced in ammonia-limited conditions and virtually undetectable in ammonia-rich conditions. © 2004 Elsevier Ltd. All rights reserved.

UNC-6 (netrin) stabilizes oscillatory clustering of the UNC-40 (DCC) receptor to orient polarity.

The receptor deleted in colorectal cancer (DCC) directs dynamic polarizing activities in animals toward its extracellular ligand netrin. How DCC polarizes toward netrin is poorly understood. By performing live-cell imaging of the DCC orthologue UNC-40 during anchor cell invasion in Caenorhabditis elegans, we have found that UNC-40 clusters, recruits F-actin effectors, and generates F-actin in the absence of UNC-6 (netrin). Time-lapse analyses revealed that UNC-40 clusters assemble, disassemble, and reform at periodic intervals in different regions of the cell membrane. This oscillatory behavior indicates that UNC-40 clusters through a mechanism involving interlinked positive (formation) and negative (disassembly) feedback. We show that endogenous UNC-6 and ectopically provided UNC-6 orient and stabilize UNC-40 clustering. Furthermore, the UNC-40-binding protein MADD-2 (a TRIM family protein) promotes ligand-independent clustering and robust UNC-40 polarization toward UNC-6. Together, our data suggest that UNC-6 (netrin) directs polarized responses by stabilizing UNC-40 clustering. We propose that ligand-independent UNC-40 clustering provides a robust and adaptable mechanism to polarize toward netrin.

Interactions spatiales et auto-organisation des végétations semi-arides

Les recherches récapitulées dans cette thèse de doctorat ont porté sur les causes de l’organisation spatiale des végétations périodiques. Ces structures paysagères aux motifs réguliers, tachetés, tigrés ou labyrinthiques, d’échelle décamétrique à hectométrique, couvrant des étendues considérables sur au moins trois continents, constituent un cas d’école dans l’étude des processus endogènes présidant à l’hétérogénéité du couvert végétal. Ces structures prennent place sur un substrat homogène, mis à part la rétroaction du couvert lui-même, et sont marquées par des écotones abrupts et la persistance d’une proportion considérable de sol nu. Plusieurs modèles ont mis en avant l’existence possible d’un phénomène d’auto-organisation du couvert, qui verrait une structure d’ensemble émerger des interactions locales entre individus. Ces modèles se basent sur le jeu simultané de la consommation de la ressource (compétition) et de l’amélioration de l’un ou l’autre des éléments du bilan de la même ressource par le couvert (facilitation). La condition à l’existence d’une structure d’ensemble spatialement périodique et stable réside dans une différence entre la portée de la compétition (plus grande) et celle de la facilitation. L’apparition de ces structures est modulée par le taux de croissance biologique, qui est le reflet des contraintes extérieures telles que l’aridité, le pâturage ou la coupe de bois. Le modus operandi des interactions spatiales supposées entre individus reste largement à préciser.

Nos recherches ont été menées au sud-ouest de la République du Niger, à l’intérieur et dans les environs du parc Régional du W. Trois axes ont été explorés :(i) Une étude de la dépendance spatiale entre la structure de la végétation (biovolumes cartographiés) et les paramètres du milieu abiotique (relief, sol), sur base d’analyses spectrales et cross-spectrales par transformée de Fourier (1D et 2D). (ii) Une étude diachronique (1956, 1975 et 1996) à large échelle (3000 km²) de l’influence de l’aridité et des pressions d’origine anthropique sur l’auto-organisation des végétations périodiques, basée sur la caractérisation de la structure spatiale des paysages sur photos aériennes via la transformée de Fourier en 2D. (iii) Trois études portant sur les interactions spatiales entre individus :En premier lieu, via l’excavation des systèmes racinaires (air pulsé) ;Ensuite, par un suivi spatio-temporel du bilan hydrique du sol (blocs de gypse) ;Enfin, via le marquage de la ressource par du deutérium.

Nous avons ainsi pu établir que les végétations périodiques constituent bien un mode d’auto-organisation pouvant survenir sur substrat homogène et modulé par les contraintes climatiques et anthropiques. Un ajustement rapide entre l’organisation des végétations périodiques et le climat a pu être montrée en zone protégée. La superficie et l’organisation des végétations périodiques y ont tour à tour progressé et régressé en fonction d’épisodes secs ou humides. Par contre, en dehors de l’aire protégée, la possibilité d’une restauration du couvert semble fortement liée au taux d’exploitation des ressources végétales. Ces résultats ont d’importantes implications quant à la compréhension des interactions entre climat et écosystèmes et à l’évaluation de leurs capacités de charge. La caractérisation de la structure spatiale des végétations arides, notamment par la transformée de Fourier d’images HR, devrait être généralisée comme outil de monitoring de l’état de ces écosystèmes. Nos études portant sur les modes d’interactions spatiales ont permis de confirmer l’existence d’une facilitation à courte portée du couvert végétal sur la ressource. Cependant, cette facilitation ne semble pas s’exercer sur le terme du bilan hydrique traditionnellement avancé, à savoir l’infiltration, mais plutôt sur le taux d’évaporation (deux fois moindre à l’ombre des canopées). Ce mécanisme exclut l’existence de transferts diffusifs souterrains entre sols nu et fourrés. Des transferts inverses semblent d’ailleurs montrés par le marquage isotopique. L’étude du bilan hydrique et la cartographie du micro-relief, ainsi que la profondeur fortement réduite de la zone d’exploitation racinaire, jettent de sérieux doutes quant au rôle communément admis des transferts d’eau par ruissellement/diffusion de surface en tant que processus clé dans la compétition à distance entre les plantes. L’alternative réside dans l’existence d’une compétition racinaire de portée supérieure aux canopées. Cette hypothèse trouve une confirmation tant par les rhizosphères excavées, superficielles et étendues, que dans le marquage isotopique, montrant des contaminations d’arbustes situés à plus de 15 m de la zone d’apport. De même, l’étude du bilan hydrique met en évidence les influences simultanées et contradictoires (facilitation/compétition) des ligneux sur l’évapotranspiration.

/

This PhD thesis gathers results of a research dealing with the causes of the spatial organisation of periodic vegetations. These landscape structures, featuring regular spotted, labyrinthine or banded patterns of decametric to hectometric scale, and extending over considerable areas on at least three continents, constitute a perfect study case to approach endogenous processes leading to vegetation heterogeneities. These patterns occur over homogeneous substratum, except for vegetation’s own feedbacks, and are marked by sharp ecotones and the persistence of a considerable amount of bare soil. A number of models suggested a possible case of self-organized patterning, in which the general structure would emerge from local interactions between individuals. Those models rest on the interplay of competitive and facilitative effects, relating to soil water consumption and to soil water budget enhancement by vegetation. A general necessary condition for pattern formation to occur is that negative interactions (competition) have a larger range than positive interactions (facilitation). Moreover, all models agree with the idea that patterning occurs when vegetation growth decreases, for instance as a result of reduced water availability, domestic grazing or wood cutting, therefore viewing patterns as a self-organised response to environmental constraints. However the modus operandi of the spatial interactions between individual plants remains largely to be specified.

We carried out a field research in South-West Niger, within and around the W Regional Park. Three research lines were explored: (i) The study of the spatial dependency between the vegetation pattern (mapped biovolumes) and the factors of the abiotic environment (soil, relief), on the basis of spectral and cross-spectral analyses with Fourier transform (1D and 2D). (ii) A broad scale diachronic study (1956, 1975, 1996) of the influence of aridity and human induced pressures on the vegetation self-patterning, based on the characterisation of patterns on high resolution remote sensing data via 2D Fourier transform. (iii) Three different approaches of the spatial interactions between individuals: via root systems excavation with pulsed air; via the monitoring in space and time of the soil water budget (gypsum blocks method); and via water resource labelling with deuterated water.

We could establish that periodic vegetations are indeed the result of a self-organisation process, occurring in homogeneous substratum conditions and modulated by climate and human constraints. A rapid adjustment between vegetation patterning and climate could be observed in protected zones. The area and patterning of the periodic vegetations successively progressed and regressed, following drier or wetter climate conditions. On the other hand, outside protected areas, the restoration ability of vegetation appeared to depend on the degree of vegetation resource exploitation. These results have important implications regarding the study of vegetation-climate interactions and the evaluation of ecosystems’ carrying capacities. Spatial pattern characterisation in arid vegetations using Fourier transform of HR remote sensing data should be generalised for the monitoring of those ecosystems. Our studies dealing with spatial interaction mechanisms confirmed the existence of a short range facilitation of the cover on water resource. However, this facilitation does not seem to act through the commonly accepted infiltration component, but rather on the evaporative rate (twice less within thickets). This mechanism excludes underground diffusive transfers between bare ground and vegetation. Inverse transfers were even shown by deuterium labelling. Water budget study and micro-elevation mapping, along with consistent soil shallowness, together cast serious doubts on the traditional mechanism of run-off/diffusion of surface water as a key process of the long range competition between plants. An alternative explanation lies in long range root competition. This hypothesis find support as well in the excavated root systems, shallow and wide, as in isotopic labelling, showing contaminations of shrubs located up to 15 m of the irrigated area. Water budget study also evidenced simultaneous contradictory effects (facilitation/competition) of shrubs on evapotranspiration.

Comparison of the experimental, semi-experimental and ab initio equilibrium structures of acetylene: Influence of relativisitic effects and of the diagonal Born-Oppenheimer corrections

The equilibrium structure of acetylene (also named ethyne) has been reinvestigated to resolve the small discrepancies noted between different determinations. The size of the system as well as the large amount of available experimental data provides the quite unique opportunity to check the magnitude and relevance of various contributions to equilibrium structure as well as to verify the accuracy of experimental results. With respect to pure theoretical investigation, quantum-chemical calculations at the coupled-cluster level have been employed together with extrapolation to the basis set limit, consideration of higher excitations in the cluster operator, inclusion of core correlation effects as well as relativistic and diagonal Born-Oppenheimer corrections. In particular, it is found that the extrapolation to the complete basis set limit, the inclusion of higher excitations in the electronic-correlation treatment and the relativistic corrections are of the same order of magnitude. It also appears that a basis set as large as a core-valence quintuple-zeta set is required for accurately accounting for the inner-shell correlation contribution. From a pure experimental point of view, the equilibrium structure has been determined using very accurate rotational constants recently obtained by a global analysis (that is to say that all non-negligible interactions are explicitely included in the Hamiltonian matrix) of rovibrational spectra. Finally, a semi-experimental equilibrium structure (where the equilibrium rotational constants are obtained from the experimental ground state rotational constants and computed rovibrational corrections) has been obtained from the available experimental ground-state rotational constants for ten isotopic species corrected for computed vibrational corrections. Such a determination led to the revision of the ground-state rotational constants of two isotopologues, thus showing that structural determination is a good method to identify errors in experimental rotational constants. The three structures are found in a very good agreement, and our recommended values are rCC 120.2958(7) pm and rCH 106.164(1) pm. © 2011 American Institute of Physics.

Dinámica y consecuencias del cambio en la cobertura y el uso del suelo en el Chaco semi-árido

La deforestación en Sudamérica afecta principalmente a tres ecosistemas: El Cerrado en Brasil, la selva de Chiquitanos en Bolivia y el Gran Chaco en Bolivia, Paraguay y Argentina, siendo en estos dos últimos países en donde ocurren las mayores transformaciones del paisaje para la producción de commodities para exportación. En la presente tesis, para la porción Noroeste del Chaco Argentino, se analizó la dinámica de cambios de los últimos 30 años; se evaluó la ocurrencia del modelo cambio de uso del suelo denominado "Transición Forestal"; se estudió la influencia de factores locales que controlan la localización de desmontes; y se cuantificó el impacto de dicha transformación sobre el nivel de provisión de servicios ecosistémicos intermedios relativos a la dinámica del C. En el período 1977-2007 ocurrieron cambios que alcanzaron más del 26 por ciento del área de estudio. Los desmontes para actividad agropecuaria alcanzaron un total de 4,5 millones ha, de los cuales el 53 por ciento ocurrieron en el último período (1997-07), siendo los bosques secos y los pastizales las coberturas más afectadas. De continuar con esta tendencia, ocurrirá una inversión del paisaje en un periodo comprendido entre 40 y 100 años, en donde la actividad agropecuaria comenzaría a ser dominante en el paisaje chaqueño. No están ocurriendo ninguno de los modelos de cambios de uso del suelo de compatibilización de producción-conservación discutidos en esta tesis: (a) "Transición Forestal" (Forest Transition), (b) "separación-territorial" (land-sparing); o (c) "integración-territorial" (land-sharing). Se propone un nuevo modelo de cambio de uso de suelo que probablemente se verifica en otras regiones del Gran Chaco Americano, al que se denominó "modelo tipo Tsunami" por sus características de avance en forma de ola, que a su paso homogeniza el paisaje bajo el punto de vista estructural y funcional.

Host species of bees from the tribe Meliponini Nest in semi - arid Chaco forest near Las Lomitas, Formosa (Argentina)

p.85-91

Host species of bees from the tribe Meliponini Nest in semi - arid Chaco forest near Las Lomitas, Formosa (Argentina)

p.85-91

Dinámica y consecuencias del cambio en la cobertura y el uso del suelo en el Chaco semi-árido

La deforestación en Sudamérica afecta principalmente a tres ecosistemas: El Cerrado en Brasil, la selva de Chiquitanos en Bolivia y el Gran Chaco en Bolivia, Paraguay y Argentina, siendo en estos dos últimos países en donde ocurren las mayores transformaciones del paisaje para la producción de commodities para exportación. En la presente tesis, para la porción Noroeste del Chaco Argentino, se analizó la dinámica de cambios de los últimos 30 años; se evaluó la ocurrencia del modelo cambio de uso del suelo denominado "Transición Forestal"; se estudió la influencia de factores locales que controlan la localización de desmontes; y se cuantificó el impacto de dicha transformación sobre el nivel de provisión de servicios ecosistémicos intermedios relativos a la dinámica del C. En el período 1977-2007 ocurrieron cambios que alcanzaron más del 26 por ciento del área de estudio. Los desmontes para actividad agropecuaria alcanzaron un total de 4,5 millones ha, de los cuales el 53 por ciento ocurrieron en el último período (1997-07), siendo los bosques secos y los pastizales las coberturas más afectadas. De continuar con esta tendencia, ocurrirá una inversión del paisaje en un periodo comprendido entre 40 y 100 años, en donde la actividad agropecuaria comenzaría a ser dominante en el paisaje chaqueño. No están ocurriendo ninguno de los modelos de cambios de uso del suelo de compatibilización de producción-conservación discutidos en esta tesis: (a)"Transición Forestal" (Forest Transition), (b)"separación-territorial" (land-sparing); o (c)"integración-territorial" (land-sharing). Se propone un nuevo modelo de cambio de uso de suelo que probablemente se verifica en otras regiones del Gran Chaco Americano, al que se denominó "modelo tipo Tsunami" por sus características de avance en forma de ola, que a su paso homogeniza el paisaje bajo el punto de vista estructural y funcional.