Natural actor and belief critic: Reinforcement algorithm for learning parameters of dialogue systems modelled as POMDPs

This article presents a novel algorithm for learning parameters in statistical dialogue systems which are modeled as Partially Observable Markov Decision Processes (POMDPs). The three main components of a POMDP dialogue manager are a dialogue model representing dialogue state information; a policy that selects the system's responses based on the inferred state; and a reward function that specifies the desired behavior of the system. Ideally both the model parameters and the policy would be designed to maximize the cumulative reward. However, while there are many techniques available for learning the optimal policy, no good ways of learning the optimal model parameters that scale to real-world dialogue systems have been found yet. The presented algorithm, called the Natural Actor and Belief Critic (NABC), is a policy gradient method that offers a solution to this problem. Based on observed rewards, the algorithm estimates the natural gradient of the expected cumulative reward. The resulting gradient is then used to adapt both the prior distribution of the dialogue model parameters and the policy parameters. In addition, the article presents a variant of the NABC algorithm, called the Natural Belief Critic (NBC), which assumes that the policy is fixed and only the model parameters need to be estimated. The algorithms are evaluated on a spoken dialogue system in the tourist information domain. The experiments show that model parameters estimated to maximize the expected cumulative reward result in significantly improved performance compared to the baseline hand-crafted model parameters. The algorithms are also compared to optimization techniques using plain gradients and state-of-the-art random search algorithms. In all cases, the algorithms based on the natural gradient work significantly better. © 2011 ACM.

Multiple pitch estimation using non-homogeneous poisson processes

Novel statistical models are proposed and developed in this paper for automated multiple-pitch estimation problems. Point estimates of the parameters of partial frequencies of a musical note are modeled as realizations from a non-homogeneous Poisson process defined on the frequency axis. When several notes are combined, the processes for the individual notes combine to give a new Poisson process whose likelihood is easy to compute. This model avoids the data-association step of linking the harmonics of each note with the corresponding partials and is ideal for efficient Bayesian inference of unknown multiple fundamental frequencies in a signal. © 2011 IEEE.

Zero carbon manufacturing facility - Towards integrating material, energy, and waste process flows

The increasing pressure on material availability, energy prices, as well as emerging environmental legislation is leading manufacturers to adopt solutions to reduce their material and energy consumption as well as their carbon footprint, thereby becoming more sustainable. Ultimately manufacturers could potentially become zero carbon by having zero net energy demand and zero waste across the supply chain. The literature on zero carbon manufacturing and the technologies that underpin it are growing, but there is little available on how a manufacturer undertakes the transition. Additionally, the work in this area is fragmented and clustered around technologies rather than around processes that link the technologies together. There is a need to better understand material, energy, and waste process flows in a manufacturing facility from a holistic viewpoint. With knowledge of the potential flows, design methodologies can be developed to enable zero carbon manufacturing facility creation. This paper explores the challenges faced when attempting to design a zero carbon manufacturing facility. A broad scope is adopted from legislation to technology and from low waste to consuming waste. A generic material, energy, and waste flow model is developed and presented to show the material, energy, and waste inputs and outputs for the manufacturing system and the supporting facility and, importantly, how they can potentially interact. Finally the application of the flow model in industrial applications is demonstrated to select appropriate technologies and configure them in an integrated way. © 2009 IMechE.

A comparison of four sustainable manufacturing strategies

Effective use of materials is one possible component of a sustainable manufacturing strategy. There are many such strategies proposed in the literature and used in practice, with confusion over what they are, what the differences among them may be and how they can be used by practitioners in design and manufacture to improve the sustainability of their product and processes. This paper reviews the literature on sustainable manufacturing strategies that deliver improved material performance. Four primary strategies were found: waste minimisation; material efficiency; resource efficiency; and eco-efficiency. The literature was analysed to determine the key characteristics of these sustainable manufacturing strategies and 17 characteristics were found. The four strategies were then compared and contrasted against all the characteristics. While current literature often uses these strategy titles in a confusing, occasionally inter-changeable manner, this study attempts to create clear separation between them. Definition, scope and practicality of measurement are shown to be key characteristics that impact upon the ability of manufacturing companies to make effective use of the proposed strategy. It is observed that the most actionable strategies may not include all of the dimensions of interest to a manufacturer wishing to become more sustainable, creating a dilemma between ease of implementation and breadth of impact. © 2008 Taylor & Francis.

Towards robust part tracking in an automated manufacturing process using RFID

Automated Identification and in particular, Radio Frequency Identification (RFID) promises to assist with the automation of mass customised production processes. RFID has long been used to gather a history or trace of part movements, but the use of it as an integral part of the control process is yet to be fully exploited. Such use places stringent demands on the quality of the sensor data and the method used to interpret that data. in particular, this paper focuses on the issue of correctly identifying, tracking and dealing with aggregated objects with the use of RFID. The presented approach is evaluated in the context of a laboratory manufacturing system that produces customised gift boxes. Copyright © 2005 IFAC.

The use of spatial impulse responses to characterise flexible forming processes with mobile tools

A novel test method for the characterisation of flexible forming processes is proposed and applied to four flexible forming processes: Incremental Sheet Forming (ISF), conventional spinning, the English wheel and power hammer. The proposed method is developed in analogy with time-domain control engineering, where a system is characterised by its impulse response. The spatial impulse response is used to characterise the change in workpiece deformation created by a process, but has also been applied with a strain spectrogram, as a novel way to characterise a process and the physical effect it has on the workpiece. Physical and numerical trials to study the effects of process and material parameters on spatial impulse response lead to three main conclusions. Incremental sheet forming is particularly sensitive to process parameters. The English wheel and power hammer are strongly similar and largely insensitive to both process and material parameters. Spinning develops in two stages and is sensitive to most process parameters, but insensitive to prior deformation. Finally, the proposed method could be applied to modelling, classification of existing and novel processes, product-process matching and closed-loop control of flexible forming processes. © 2012 Elsevier B.V.

State-space inference and learning with Gaussian processes

State-space inference and learning with Gaussian processes (GPs) is an unsolved problem. We propose a new, general methodology for inference and learning in nonlinear state-space models that are described probabilistically by non-parametric GP models. We apply the expectation maximization algorithm to iterate between inference in the latent state-space and learning the parameters of the underlying GP dynamics model. Copyright 2010 by the authors.

The foundations of a new approach to additive manufacturing: Characteristics of free space metal deposition

In this paper, we report on the realisation of a free space deposition process (FSD). For the first time the use of a moving support structure to deposit tracks of metal starting from a substrate and extending into free space is characterised. The ability to write metal shapes in free space has wide ranging applications in additive manufacturing and rapid prototyping where the tracks can be layered to build overhanging features without the use of fixed support structures (such as is used in selective laser melting (SLM) and stereo lithography (SLA)). We demonstrate and perform a preliminary characterisation of the process in which a soldering iron was used to deposit lead free solder tracks. The factors affecting the stability of tracks and the effect of operating parameters, temperature, velocity, initial track starting diameter and starting volume were measured. A series of 10 tracks at each setting were compared with a control group of tracks; the track width, taper and variation between tracks were compared. Notable results in free space track deposition were that the initial track diameter and volume affected the repeatability and quality of tracks. The standard deviation of mean track width of tracks from the constrained initial diameter group were half that of the unconstrained group. The amount of material fed to the soldering iron before commencing deposition affected the taper of tracks. At an initial volume of 7 mm3 and an initial track diameter of 0.8 mm, none of the ten tracks deposited broke or showed taper > ∼1°. The maximum deposition velocity for free space track deposition using lead-free solder was limited to 1.5 mm s-1. © 2011 Elsevier B.V. All rights reserved.

A Computer integrated unified modelling approach to responsive manufacturing

Computer modelling approaches have significant potential to enable decision-making about various aspects of responsive manufacturing. In order to understand the system prior to the selection of any responsiveness strategy, multiple process segments of organisations need to be modelled. The article presents a novel systematic approach for creating coherent sets of unified enterprise, simulation and other supporting models that collectively facilitate responsiveness. In this approach, enterprise models are used to explicitly define relatively enduring relationships between (i) production planning and control (PPC) processes, that implement a particular strategy and (ii) process-oriented elements of production systems, that are work loaded by the PPC processes. Coherent simulation models, can in part be derived from the enterprise models, so that they computer execute production system behaviours. In this way, time-based performance outcomes can be simulated; so that the impacts of alternative PPC strategies on the planning and controlling historical or forecasted patterns of workflow, through (current and possible future) production system models, can be analysed. The article describes the unified modelling approach conceived and its application in a furniture industry case study small and medium enterprise (SME). Copyright © 2010 Inderscience Enterprises Ltd.

Market-pull and technology-push in manufacturing start-ups in emerging industries

Purpose - As traditional manufacturing, previously vital to the UK economy, is increasingly outsourced to lower-cost locations, policy makers seek leadership in emerging industries by encouraging innovative start-up firms to pursue competitive opportunities. Emerging industries can either be those where a technology exists but the corresponding downstream value chain is unclear, or a new technology may subvert the existing value chain to satisfy existing customer needs. Hence, this area shows evidence of both technology-push and market-pull forces. The purpose of this paper is to focus on market-pull and technology-push orientations in manufacturing ventures, specifically examining how and why this orientation shifts during the firm's formative years. Design/methodology/approach - A multiple case study approach of 25 UK start-ups in emerging industries is used to examine this seldom explored area. The authors offer two models of dynamic business-orientation in start-ups and explain the common reasons for shifts in orientation and why these two orientations do not generally co-exist during early firm development. Findings - Separate evolution paths were found for strategic orientation in manufacturing start-ups and separate reasons for them to shift in their early development. Technology-push start-ups often changed to a market-pull orientation because of new partners, new market information or shift in management priorities. In contrast, many of the start-ups beginning with a market-pull orientation shifted to a technology-push orientation because early market experiences necessitated a focus on improving processes in order to increase productivity or meet partner specifications, or meet a demand for complementary products. Originality/value - While a significant body of work exists regarding manufacturing strategy in established firms, little work has been found that investigates how manufacturing strategy emerges in start-up companies, particularly those in emerging industries. © Emerald Group Publishing Limited.

Enhanced integrated modelling approach to reconfiguring manufacturing enterprises

Dynamism and uncertainty are real challenges for present day manufacturing enterprises (MEs). Reasons include: an increasing demand for customisation, reduced time to market, shortened product life cycles and globalisation. MEs can reduce competitive pressure by becoming reconfigurable and change-capable. However, modern manufacturing philosophies, including agile and lean, must complement the application of reconfigurable manufacturing paradigms. Choosing and applying the best philosophies and techniques is very difficult as most MEs deploy complex and unique configurations of processes and resource systems, and seek economies of scope and scale in respect of changing and distinctive product flows. It follows that systematic methods of achieving model driven reconfiguration and interoperation of component based manufacturing systems are required to design, engineer and change future MEs. This thesis, titled Enhanced Integrated Modelling Approach to Reconfiguring Manufacturing Enterprises , introduces the development and prototyping a model-driven environment for the design, engineering, optimisation and control of the reconfiguration of MEs with an embedded capability to handle various types of change. The thesis describes a novel systematic approach, namely enhanced integrated modelling approach (EIMA), in which coherent sets of integrated models are created that facilitates the engineering of MEs especially their production planning and control (PPC) systems. The developed environment supports the engineering of common types of strategic, tactical and operational processes found in many MEs. The EIMA is centred on the ISO standardised CIMOSA process modelling approach. Early study led to the development of simulation models during which various CIMOSA shortcomings were observed, especially in its support for aspects of ME dynamism. A need was raised to structure and create semantically enriched models hence forming an enhanced integrated modelling environment. The thesis also presents three industrial case examples: (1) Ford Motor Company; (2) Bradgate Furniture Manufacturing Company; and (3) ACM Bearings Company. In order to understand the system prior to realisation of any PPC strategy, multiple process segments of any target organisation need to be modelled. Coherent multi-perspective case study models are presented that have facilitated process reengineering and associated resource system configuration. Such models have a capability to enable PPC decision making processes in support of the reconfiguration of MEs. During these case studies, capabilities of a number of software tools were exploited such as Arena®, Simul8®, Plant Simulation®, MS Visio®, and MS Excel®. Case study results demonstrated effectiveness of the concepts related to the EIMA. The research has resulted in new contributions to knowledge in terms of new understandings, concepts and methods in following ways: (1) a structured model driven integrated approach to the design, optimisation and control of future reconfiguration of MEs. The EIMA is an enriched and generic process modelling approach with capability to represent both static and dynamic aspects of an ME; and (2) example application cases showing benefits in terms of reduction in lead time, cost and resource load and in terms of improved responsiveness of processes and resource systems with a special focus on PPC; (3) identification and industrial application of a new key performance indicator (KPI) known as P3C the measuring and monitoring of which can aid in enhancing reconfigurability and responsiveness of MEs; and (4) an enriched modelling concept framework (E-MUNE) to capture requirements of static and dynamic aspects of MEs where the conceptual framework has the capability to be extended and modified according to the requirements. The thesis outlines key areas outlining a need for future research into integrated modelling approaches, interoperation and updating mechanisms of partial models in support of the reconfiguration of MEs.

Inkjet printing of weakly elastic polymer solutions

Fluid assessment methods, requiring small volumes and avoiding the need for jetting, are particularly useful in the design of functional fluids for inkjet printing applications. With the increasing use of complex (rather than Newtonian) fluids for manufacturing, single frequency fluid characterisation cannot reliably predict good jetting behaviour, owing to the range of shearing and extensional flow rates involved. However, the scope of inkjet fluid assessments (beyond achievement of a nominal viscosity within the print head design specification) is usually focused on the final application rather than the jetting processes. The experimental demonstration of the clear insufficiency of such approaches shows that fluid jetting can readily discriminate between fluids assessed as having similar LVE characterisation (within a factor of 2) for typical commercial rheometer measurements at shearing rates reaching 104rads-1.Jetting behaviour of weakly elastic dilute linear polystyrene solutions, for molecular weights of 110-488. kDa, recorded using high speed video was compared with recent results from numerical modelling and capillary thinning studies of the same solutions.The jetting images show behaviour ranging from near-Newtonian to "beads-on-a-string". The inkjet printing behaviour does not correlate simply with the measured extensional relaxation times or Zimm times, but may be consistent with non-linear extensibility L and the production of fully extended polymer molecules in the thinning jet ligament.Fluid test methods allowing a more complete characterisation of NLVE parameters are needed to assess inkjet printing feasibility prior to directly jetting complex fluids. At the present time, directly jetting such fluids may prove to be the only alternative. © 2014 The Authors.

Effect of process parameters on the morphology and nanostructure of roll-to-roll printed P3HT:PCBM thin films for organic photovoltaics

Roll-to-roll (R2R) gravure exhibits significant advantages such as high precision and throughput for the printing of photoactive and conductive materials and the fabrication of flexible organic electronics such as organic photovoltaics (OPVs). Since the photoactive layer is the core of the OPV, it is important to investigate and finally control the process parameters and mechanisms that define the film morphology in a R2R process. The scope of this work is to study the effect of the R2R gravure printing and drying process on the nanomorphology and nanostructure of the photoactive P3HT:PCBM thin films printed on PEDOT:PSS electrodes towards the fabrication of indium tin oxide (ITO)-free flexible OPVs. In order to achieve this, P3HT:PCBM blends of different concentration were R2R printed under various speeds on the PEDOT:PSS layers. Due to the limited drying time during the rolling, an amount of solvent remains in the P3HT:PCBM films and the slow-drying process takes place which leads to the vertical and lateral phase separation, according to the Spectroscopic Ellipsometry and Atomic Force Microscopy analysis. The enhanced slow-drying leads to stronger phase separation, larger P3HT crystallites according to the Grazing Incidence X-Ray Diffraction data and to weaker mechanical response as it was shown by the nanoindentation creep. However, in the surface of the films the P3HT crystallization is controlled by the impinged hot air during the drying, where the more the drying time the larger the surface P3HT crystallites. The integration of the printed P3HT:PCBM and PEDOT:PSS layers in an OPV device underlined the feasibility of fabricating ITO-free flexible OPVs by R2R gravure processes. © 2013 Elsevier B.V.