The Synthesis of Arbitrary Stable Dynamics in Non-linear Neural Networks II: Feedback and Universality

We wish to construct a realization theory of stable neural networks and use this theory to model the variety of stable dynamics apparent in natural data. Such a theory should have numerous applications to constructing specific artificial neural networks with desired dynamical behavior. The networks used in this theory should have well understood dynamics yet be as diverse as possible to capture natural diversity. In this article, I describe a parameterized family of higher order, gradient-like neural networks which have known arbitrary equilibria with unstable manifolds of known specified dimension. Moreover, any system with hyperbolic dynamics is conjugate to one of these systems in a neighborhood of the equilibrium points. Prior work on how to synthesize attractors using dynamical systems theory, optimization, or direct parametric. fits to known stable systems, is either non-constructive, lacks generality, or has unspecified attracting equilibria. More specifically, We construct a parameterized family of gradient-like neural networks with a simple feedback rule which will generate equilibrium points with a set of unstable manifolds of specified dimension. Strict Lyapunov functions and nested periodic orbits are obtained for these systems and used as a method of synthesis to generate a large family of systems with the same local dynamics. This work is applied to show how one can interpolate finite sets of data, on nested periodic orbits.

Broadening public input into science policy decision making: can the democratic model for science communication influence scientific, innovation and technological trajectories?

This PhD thesis investigates the potential use of science communication models to engage a broader swathe of actors in decision making in relation to scientific and technological innovation in order to address possible democratic deficits in science and technology policy-making. A four-pronged research approach has been employed to examine different representations of the public(s) and different modes of engagement. The first case study investigates whether patient-groups could represent an alternative needs-driven approach to biomedical and health sciences R & D. This is followed by enquiry into the potential for Science Shops to represent a bottom-up approach to promote research and development of local relevance. The barriers and opportunities for the involvement of scientific researchers in science communication are next investigated via a national survey which is comparable to a similar survey conducted in the UK. The final case study investigates to what extent opposition or support regarding nanotechnology (as an emerging technology) is reflected amongst the YouTube user community and the findings are considered in the context of how support or opposition to new or emerging technologies can be addressed using conflict resolution based approaches to manage potential conflict trajectories. The research indicates that the majority of communication exercises of relevance to science policy and planning take the form of a one-way flow of information with little or no facility for public feedback. This thesis proposes that a more bottom-up approach to research and technology would help broaden acceptability and accountability for decisions made relating to new or existing technological trajectories. This approach could be better integrated with and complementary to government, institutional, e.g. university, and research funding agencies activities and help ensure that public needs and issues are better addressed directly by the research community. Such approaches could also facilitate empowerment of societal stakeholders regarding scientific literacy and agenda-setting. One-way information relays could be adapted to facilitate feedback from representative groups e.g. Non-governmental organisations or Civil Society Organisations (such as patient groups) in order to enhance the functioning and socio-economic relevance of knowledge-based societies to the betterment of human livelihoods.

Sequential anomaly detection in the presence of noise and limited feedback

This paper describes a methodology for detecting anomalies from sequentially observed and potentially noisy data. The proposed approach consists of two main elements: 1) filtering, or assigning a belief or likelihood to each successive measurement based upon our ability to predict it from previous noisy observations and 2) hedging, or flagging potential anomalies by comparing the current belief against a time-varying and data-adaptive threshold. The threshold is adjusted based on the available feedback from an end user. Our algorithms, which combine universal prediction with recent work on online convex programming, do not require computing posterior distributions given all current observations and involve simple primal-dual parameter updates. At the heart of the proposed approach lie exponential-family models which can be used in a wide variety of contexts and applications, and which yield methods that achieve sublinear per-round regret against both static and slowly varying product distributions with marginals drawn from the same exponential family. Moreover, the regret against static distributions coincides with the minimax value of the corresponding online strongly convex game. We also prove bounds on the number of mistakes made during the hedging step relative to the best offline choice of the threshold with access to all estimated beliefs and feedback signals. We validate the theory on synthetic data drawn from a time-varying distribution over binary vectors of high dimensionality, as well as on the Enron email dataset. © 1963-2012 IEEE.

Display of cell surface sites for fibronectin assembly is modulated by cell adherence to (1)F3 and C-terminal modules of fibronectin.

BACKGROUND: Fibronectin-null cells assemble soluble fibronectin shortly after adherence to a substrate coated with intact fibronectin but not when adherent to the cell-binding domain of fibronectin (modules (7)F3-(10)F3). Interactions of adherent cells with regions of adsorbed fibronectin other than modules (7)F3-(10)F3, therefore, are required for early display of the cell surface sites that initiate and direct fibronectin assembly. METHODOLOGY/PRINCIPAL FINDINGS: To identify these regions, coatings of proteolytically derived or recombinant pieces of fibronectin containing modules in addition to (7)F3-(10)F3 were tested for effects on fibronectin assembly by adherent fibronectin-null fibroblasts. Pieces as large as one comprising modules (2)F3-(14)F3, which include the heparin-binding and cell adhesion domains, were not effective in supporting fibronectin assembly. Addition of module (1)F3 or the C-terminal modules to modules (2)F3-(14)F3 resulted in some activity, and addition of both (1)F3 and the C-terminal modules resulted in a construct, (1)F3-C, that best mimicked the activity of a coating of intact fibronectin. Constructs (1)F3-C V0, (1)F3-C V64, and (1)F3-C Delta(V(15)F3(10)F1) were all able to support fibronectin assembly, suggesting that (1)F3 through (11)F1 and/or (12)F1 were important for activity. Coatings in which the active parts of (1)F3-C were present in different proteins were much less active than intact (1)F3-C. CONCLUSIONS: These results suggest that (1)F3 acts together with C-terminal modules to induce display of fibronectin assembly sites on adherent cells.

Outer Membrane Vesicle Production in Escherichia coli Relieves Envelope Stress and is Modulated by Changes in Peptidoglycan

Bacterial outer membrane vesicles (OMVs) are spherical buds of the outer membrane (OM) containing periplasmic lumenal components. OMVs have been demonstrated to play a critical part in the transmission of virulence factors, immunologically active compounds, and bacterial survival, however vesiculation also appears to be a ubiquitous physiological process for Gram-negative bacteria. Despite their characterized biological roles, especially for pathogens, very little is known about their importance for the originating organism as well as regulation and mechanism of production. Only when we have established their biogenesis can we fully uncover their roles in pathogenesis and bacterial physiology. The overall goal of this research was to characterize bacterial mutants which display altered vesiculation phenotypes using genetic and biochemical techniques, and thereby begin to elucidate the mechanism of vesicle production and regulation. One part of this work elucidated a synthetic genetic growth defect for a strain with reduced OMV production (ΔnlpA, inner membrane lipoprotein with a minor role in methionine transport) and envelope stress (ΔdegP, dual function periplasmic chaperone/ protease responsible for managing proteinaceous waste). This research showed that the growth defect of ΔnlpAΔdegP correlated with reduced OMV production with respect to the hyprevesiculator ΔdegP and the accumulation of protein in the periplasm and DegP substrates in the lumen of OMVs. We further demonstrated that OMVs do not solely act as a stress response pathway to rid the periplasm of otherwise damaging misfolded protein but also of accumulated peptidoglycan (PG) fragments and lipopolysaccharide (LPS), elucidating OMVs as a general stress response pathway critical for bacterial well-being. The second part of this work, focused on the role of PG structure, turnover and covalent crosslinks to the OM in vesiculation. We established a direct link between PG degradation and vesiculation: Mutations in the OM lipoprotein nlpI had been previously established as a very strong hypervesiculation phenotype. In the literature NlpI had been associated with another OM lipoprotein, Spr that was recently identified as a PG hydrolase. The data presented here suggest that NlpI acts as a negative regulator of Spr and that the ΔnlpI hypervesiculation phenotype is a result of rampantly degraded PG by Spr. Additionally, we found that changes in PG structure and turnover correlate with altered vesiculation levels, as well as non-canonical D-amino acids, which are secreted by numerous bacteria on the onset of stationary phase, being a natural factor to increase OMV production. Furthermore, we discovered an inverse relationship between the concentration of Lpp-mediated, covalent crosslinks and the level of OMV production under conditions of modulated PG metabolism and structure. In contrast, situations that lead to periplasmic accumulation (protein, PG fragments, and LPS) and consequent hypervesiculation the overall OM-PG crosslink concentration appears to be unchanged. Form this work, we conclude that multiple pathways lead to OMV production: Lpp concentration-dependent and bulk driven, Lpp concentration-independent.

Of mice, birds, and men: the mouse ultrasonic song system has some features similar to humans and song-learning birds.

Humans and song-learning birds communicate acoustically using learned vocalizations. The characteristic features of this social communication behavior include vocal control by forebrain motor areas, a direct cortical projection to brainstem vocal motor neurons, and dependence on auditory feedback to develop and maintain learned vocalizations. These features have so far not been found in closely related primate and avian species that do not learn vocalizations. Male mice produce courtship ultrasonic vocalizations with acoustic features similar to songs of song-learning birds. However, it is assumed that mice lack a forebrain system for vocal modification and that their ultrasonic vocalizations are innate. Here we investigated the mouse song system and discovered that it includes a motor cortex region active during singing, that projects directly to brainstem vocal motor neurons and is necessary for keeping song more stereotyped and on pitch. We also discovered that male mice depend on auditory feedback to maintain some ultrasonic song features, and that sub-strains with differences in their songs can match each other's pitch when cross-housed under competitive social conditions. We conclude that male mice have some limited vocal modification abilities with at least some neuroanatomical features thought to be unique to humans and song-learning birds. To explain our findings, we propose a continuum hypothesis of vocal learning.

A new method based on Markov chains for deriving SB2 orbits directly from their spectra

info:eu-repo/semantics/published

Droplet generation with modulated AC electromagnetic field at nozzle exit

A method of droplet generation based on applying a modulated AC high frequency magnetic field in the localized region of capillary breakup is considered as ans alternative to traditional methods for high temperature liquid melt droplet serial production by pressure variation. The method is based on a pseudo-spectral approximation with a coordinate transformation adaptin to the developing free surface. The electromagnetic field is recomputed continuously with the domain shape change. Practical application cases for liquid silicon droplets of 0.5 - 2 mm diameter are considered in detail.

Open ended microwave oven for packaging

A novel open waveguide cavity resonator is presented for the combined variable frequency microwave curing of bumps, underfills and encapsulants, as well as the alignment of devices for fast flip-chip assembly, direct chip attach (DCA) or wafer-scale level packaging (WSLP). This technology achieves radio frequency (RF) curing of adhesives used in microelectronics, optoelectronics and medical devices with potential simultaneous micron-scale alignment accuracy and bonding of devices. In principle, the open oven cavity can be fitted directly onto a flip-chip or wafer scale bonder and, as such, will allow for the bonding of devices through localised heating thus reducing the risk to thermally sensitive devices. Variable frequency microwave (VFM) heating and curing of an idealised polymer load is numerically simulated using a multi-physics approach. Electro-magnetic fields within a novel open ended microwave oven developed for use in micro-electronics manufacturing applications are solved using a dedicated Yee scheme finite-difference time-domain (FDTD) solver. Temperature distribution, degree of cure and thermal stresses are analysed using an Unstructured Finite Volume method (UFVM) multi-physics package. The polymer load was meshed for thermophysical analysis, whilst the microwave cavity - encompassing the polymer load - was meshed for microwave irradiation. The two solution domains are linked using a cross mapping routine. The principle of heating using the evanescent fringing fields within the open-end of the cavity is demonstrated. A closed loop feedback routine is established allowing the temperature within a lossy sample to be controlled. A distribution of the temperature within the lossy sample is obtained by using a thermal imaging camera.

Model-based pilot and data power adaptation in psam with periodic delayed feedback

We consider the optimum design of pilot-symbol-assisted modulation (PSAM) schemes with feedback. The received signal is periodically fed back to the transmitter through a noiseless delayed link and the time-varying channel is modeled as a Gauss-Markov process. We optimize a lower bound on the channel capacity which incorporates the PSAM parameters and Kalman-based channel estimation and prediction. The parameters available for the capacity optimization are the data power adaptation strategy, pilot spacing and pilot power ratio, subject to an average power constraint. Compared to the optimized open-loop PSAM (i.e., the case where no feedback is provided from the receiver), our results show that even in the presence of feedback delay, the optimized power adaptation provides higher information rates at low signal-to-noise ratios (SNR) in medium-rate fading channels. However, in fast fading channels, even the presence of modest feedback delay dissipates the advantages of power adaptation.

"Practise what we preach": a social constructivist approach to blended learning

This presentation reports on the formal evaluation, through questionnaires, of a new Level 1 undergraduate course, for 130 student teachers, that uses blended learning. The course design seeks to radicalise the department’s approach to teaching, learning and assessment and use students as change agents. Its structure and content, model social constructivist approaches to learning. Building on the student’s experiences of and, reflections on, previous learning, promotes further learning through the support of “able others” (Vygotsky 1978), facilitating and nurturing a secure community of practice for students new to higher education. The course’s design incorporates individual, paired, small and large group activities and exploits online video, audio and text materials. Course units begin and end with face-to-face tutor-led activities. Online elements, including discussions and formative submissions, are tutor-mediated. Students work together face-to-face and online to read articles, write reflections, develop presentations, research and share experiences and resources. Summative joint assignments and peer assessments emphasise the value of collaboration and teamwork for academic, personal and professional development. Initial informal findings are positive, indicating that students have engaged readily with course content and structure, with few reporting difficulties accessing or using technology. Students have welcomed the opportunity to work together to tackle readings in a new genre, pilot presentation skills and receive and give constructive feedback to peers. Course tutors have indicated that depth and quality of study are evident, with regular online formative submissions enabling tutors to identify and engage directly with student’s needs, provide feedback and develop appropriately designed distance and face-to-face teaching materials. Pastoral tutors have indicated that students have reported non-engagement of peers, leading to the rapid application of academic or personal support. Outcomes of the formal evaluation will inform the development of Level 2 and 3 courses and influence the department’s use of blended learning.

Controlled release from directly compressible theophylline buccal tablets

The aim of the current study was the development of theophylline buccal adhesive tablets using direct compression. Buccal adhesive formulations were developed using a water soluble resin with various combinations of mucoadhesive polymers. The prepared theophylline tablets were evaluated for tensile strength, swelling capacity and ex vivo mucoadhesion performance. Ex vivo mucoadhesion was assessed using porcine gingival tissue and the peak detachment forces were found to be suitable for a buccal adhesive tablet with a maximum of 1.5N approximately. The effect of formulation composition on the release pattern was also investigated. Most formulations showed theophylline controlled release profiles depended on the grade and polymer ratio. The release mechanisms were found to fit Peppas' kinetic model over a period of 5h. In general the majority of the developed formulations presented suitable adhesion and controlled drug release. Copyright © 2010 Elsevier B.V. All rights reserved.

Adaptive ordering for imperfect successive decision feedback multiuser detection

A method for selecting the order in which the users are detected in communication systems employing adaptive successive decision feedback multiuser detection is proposed. Systems employing channel coding without the assumption of perfect decision feedback are analyzed. The method is based on the mean squared error (MSE) measurements during a training period for each user. The analysis' shows that the method delivers BER performance improvement relative to other previously proposed ordering methods

The missing link between information and action: hastenings and delays as universal reactions to performance feedback

This chapter focuses on what the key decision makers in organizations decide after having received information on the current state of the organizational performance. Because of strong attributions to success and failure, it is impossible to predict in advance which concrete actions will occur. We can however find out what kinds of actions are decided upon by means of an organizational learning model that focuses on the hastenings and delays after performance feedback. As an illustration, the responses to performance signals by trainers and club owners in Dutch soccer clubs are analyzed.

Effects of training peer tutors in content knowledge versus tutoring skills on giving feedback to help tutees’ complex tasks

This study aims to investigate the effectiveness of training tutors in content knowledge of a particular domain versus training them in tutoring skills of pedagogical knowledge when tutoring on a complex tutee task. Forty-seven tutor-tutee pairs of fourth year secondary school students were created and assigned to one of two treatments. Twenty-two tutors received training in content knowledge and the other twenty-five tutors in tutoring skills. Tutors formulated written feedback immediately after the training. Tutees first interpreted the tutor feedback and then used it to revise their research questions. The results showed that tutors trained in tutoring skills formulated more effective feedback than tutors trained in content knowledge. In addition, tutees helped by tutoring-skills tutors found the feedback more motivating than those helped by content- knowledge tutors. However, no differences were found in tutee performance on revision. The findings are discussed in terms of the set-up of this study and implications for improving the effectiveness of peer tutoring.