Stochastic control strategies and adaptive critic methods

Adaptive critic methods have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Since they approximate the dynamic programming solutions, they are potentially suitable for learning in noisy, nonlinear and nonstationary environments. In this study, a novel probabilistic dual heuristic programming (DHP) based adaptive critic controller is proposed. Distinct to current approaches, the proposed probabilistic (DHP) adaptive critic method takes uncertainties of forward model and inverse controller into consideration. Therefore, it is suitable for deterministic and stochastic control problems characterized by functional uncertainty. Theoretical development of the proposed method is validated by analytically evaluating the correct value of the cost function which satisfies the Bellman equation in a linear quadratic control problem. The target value of the critic network is then calculated and shown to be equal to the analytically derived correct value.

Advanced control of managed pressure drilling

Automation of managed pressure drilling (MPD) enhances the safety and increases efficiency of drilling and that drives the development of controllers and observers for MPD. The objective is to maintain the bottom hole pressure (BHP) within the pressure window formed by the reservoir pressure and fracture pressure and also to reject kicks. Practical MPD automation solutions must address the nonlinearities and uncertainties caused by the variations in mud flow rate, choke opening, friction factor, mud density, etc. It is also desired that if pressure constraints are violated the controller must take appropriate actions to reject the ensuing kick. The objectives are addressed by developing two controllers: a gain switching robust controller and a nonlinear model predictive controller (NMPC). The robust gain switching controller is designed using H1 loop shaping technique, which was implemented using high gain bumpless transfer and 2D look up table. Six candidate controllers were designed in such a way they preserve robustness and performance for different choke openings and flow rates. It is demonstrated that uniform performance is maintained under different operating conditions and the controllers are able to reject kicks using pressure control and maintain BHP during drill pipe extension. The NMPC was designed to regulate the BHP and contain the outlet flow rate within certain tunable threshold. The important feature of that controller is that it can reject kicks without requiring any switching and thus there is no scope for shattering due to switching between pressure and flow control. That is achieved by exploiting the constraint handling capability of NMPC. Active set method was used for computing control inputs. It is demonstrated that NMPC is able to contain kicks and maintain BHP during drill pipe extension.

A ROS-based Workspace Control and Trajectory Planner for a seven degrees of freedom Robotic arm

In this Bachelor Thesis I want to provide readers with tools and scripts for the control of a 7DOF manipulator, backed up by some theory of Robotics and Computer Science, in order to better contextualize the work done. In practice, we will see most common software, and developing environments, used to cope with our task: these include ROS, along with visual simulation by VREP and RVIZ, and an almost "stand-alone" ROS extension called MoveIt!, a very complete programming interface for trajectory planning and obstacle avoidance. As we will better appreciate and understand in the introduction chapter, the capability of detecting collision objects through a camera sensor, and re-plan to the desired end-effector pose, are not enough. In fact, this work is implemented in a more complex system, where recognition of particular objects is needed. Through a package of ROS and customized scripts, a detailed procedure will be provided on how to distinguish a particular object, retrieve its reference frame with respect to a known one, and then allow navigation to that target. Together with technical details, the aim is also to report working scripts and a specific appendix (A) you can refer to, if desiring to put things together.

Investigating the Tradespace between Increased Automation and Optimal Manning on Aircraft Carrier Decks

With increasing prevalence and capabilities of autonomous systems as part of complex heterogeneous manned-unmanned environments (HMUEs), an important consideration is the impact of the introduction of automation on the optimal assignment of human personnel. The US Navy has implemented optimal staffing techniques before in the 1990's and 2000's with a "minimal staffing" approach. The results were poor, leading to the degradation of Naval preparedness. Clearly, another approach to determining optimal staffing is necessary. To this end, the goal of this research is to develop human performance models for use in determining optimal manning of HMUEs. The human performance models are developed using an agent-based simulation of the aircraft carrier flight deck, a representative safety-critical HMUE. The Personnel Multi-Agent Safety and Control Simulation (PMASCS) simulates and analyzes the effects of introducing generalized maintenance crew skill sets and accelerated failure repair times on the overall performance and safety of the carrier flight deck. A behavioral model of four operator types (ordnance officers, chocks and chains, fueling officers, plane captains, and maintenance operators) is presented here along with an aircraft failure model. The main focus of this work is on the maintenance operators and aircraft failure modeling, since they have a direct impact on total launch time, a primary metric for carrier deck performance. With PMASCS I explore the effects of two variables on total launch time of 22 aircraft: 1) skill level of maintenance operators and 2) aircraft failure repair times while on the catapult (referred to as Phase 4 repair times). It is found that neither introducing a generic skill set to maintenance crews nor introducing a technology to accelerate Phase 4 aircraft repair times improves the average total launch time of 22 aircraft. An optimal manning level of 3 maintenance crews is found under all conditions, the point at which any additional maintenance crews does not reduce the total launch time. An additional discussion is included about how these results change if the operations are relieved of the bottleneck of installing the holdback bar at launch time.

The Inverse Jacobian Control Method Applied to a Four Degree of Freedom Confined Space Robot

Thesis (Master's)--University of Washington, 2016-06

Utformning av tak och möjligheter med automation av takstolstillverkning i trä

Purpose: The purpose of this work is to increase the possibilities of designing building components for specific demands to increase the building’s value, and to investigate how the possibilities can be affected by automating the production process. Method: The theoretical framework, which this study is based on, was collected using literature studies and was thereafter combined with the empirics, which were retrieved from qualitative methods as interviews and planned observations. A case study was made of the building Ormhuset in Jönköping. Findings: The objective of this work is to investigate the possibilities for designing roofs by using new automation methods for the production process of wooden roof structures. This study implies that parametric design can be used to generate new innovative shapes and designs that are optimised according to specific criteria. Furthermore, an increased use of automation in the production process of wooden roof trusses result in cheaper roof trusses, regardless of their shapes. The generated optimized designs are therefore cheaper and easier to produce using more automation in the production process. Implications: If parametric design is used, almost any kind of shapes can be generated and optimised. To ensure manufacturability of a design, an early connection between architect and manufacturer is important. Furthermore, increased use of automation can lead to easier and faster production of roof trusses and investing in more automation can be relevant for companies with large production volumes. Using digital files to control the manufacturing machines is time saving. There are alternative manufacturing methods for advanced roof structurers in wood, which are better suited for production, which cannot be rationalized as for roof trusses. Constraints for increased automation are often a high investment cost and limited space. Limitations: If the study is performed on another case than Ormhuset and with other respondents, the result might have differed but could be similar, why this study is not generally valid but only shows one possible outcome.

SCADA configuration and control modes implementation on an experimental water supply canal

In the last years, digital controllers became a very interesting alternative (low costs and higher accuracy) to the analogue or to hydrodynamic traditional controllers in water supply canal automation, in order to match water supply to water demands. This kind of hydraulic systems needs particular research for control applications because they are big scale systems, open and characterized by big delays and great inertia. This paper presents several digital control modes tested in an experimental canal that will be used as a research platform on the automatic canal control domain. The canal operation and their control modes selection are supervised by a SCADA system developed and configured for this particular canal.

Modeling, control and field tests on an experimental irrigation canal

Irrigation canals are complex hydraulic systems difficult to control. Many models and control strategies have already been developed using linear control theory. In the present study, a PI controller is developed and implemented in a brand new prototype canal and its features evaluated experimentally. The base model relies on the linearized Saint-Venant equations which is compared with a reservoir model to check its accuracy. This technique will prove its capability and versatility in tuning properly a controller for this kind of systems.

A second order control-volume finite-element least-squares strategy for simulating diffusion in strongly anisotropic media

An unstructured mesh �nite volume discretisation method for simulating di�usion in anisotropic media in two-dimensional space is discussed. This technique is considered as an extension of the fully implicit hybrid control-volume �nite-element method and it retains the local continuity of the ux at the control volume faces. A least squares function recon- struction technique together with a new ux decomposition strategy is used to obtain an accurate ux approximation at the control volume face, ensuring that the overall accuracy of the spatial discretisation maintains second order. This paper highlights that the new technique coincides with the traditional shape function technique when the correction term is neglected and that it signi�cantly increases the accuracy of the previous linear scheme on coarse meshes when applied to media that exhibit very strong to extreme anisotropy ratios. It is concluded that the method can be used on both regular and irregular meshes, and appears independent of the mesh quality.