Closing the gap: Improved bounds on optimal POMDP solutions

POMDP algorithms have made significant progress in recent years by allowing practitioners to find good solutions to increasingly large problems. Most approaches (including point-based and policy iteration techniques) operate by refining a lower bound of the optimal value function. Several approaches (e.g., HSVI2, SARSOP, grid-based approaches and online forward search) also refine an upper bound. However, approximating the optimal value function by an upper bound is computationally expensive and therefore tightness is often sacrificed to improve efficiency (e.g., sawtooth approximation). In this paper, we describe a new approach to efficiently compute tighter bounds by i) conducting a prioritized breadth first search over the reachable beliefs, ii) propagating upper bound improvements with an augmented POMDP and iii) using exact linear programming (instead of the sawtooth approximation) for upper bound interpolation. As a result, we can represent the bounds more compactly and significantly reduce the gap between upper and lower bounds on several benchmark problems. Copyright © 2011, Association for the Advancement of Artificial Intelligence. All rights reserved.

Closing the Energy Efficiency Gap: A study linking demographics with barriers to adopting energy efficiency measures in the home

This paper presents a study which linked demographic variables with barriers affecting the adoption of domestic energy efficiency measures in large UK cities. The aim was to better understand the 'Energy Efficiency Gap' and improve the effectiveness of future energy efficiency initiatives. The data for this study was collected from 198 general population interviews (1.5-10 min) carried out across multiple locations in Manchester and Cardiff. The demographic variables were statistically linked to the identified barriers using a modified chi-square test of association (first order Rao-Scott corrected to compensate for multiple response data), and the effect size was estimated with an odds-ratio test. The results revealed that strong associations exist between demographics and barriers, specifically for the following variables: sex; marital status; education level; type of dwelling; number of occupants in household; residence (rent/own); and location (Manchester/Cardiff). The results and recommendations were aimed at city policy makers, local councils, and members of the construction/retrofit industry who are all working to improve the energy efficiency of the domestic built environment. © 2012 Elsevier Ltd.

An extended computational model of the circulatory system for designing ventricular assist devices.

An extended computational model of the circulatory system has been developed to predict blood flow in the presence of ventricular assist devices (VADs). A novel VAD, placed in the descending aorta, intended to offload the left ventricle (LV) and augment renal perfusion is being studied. For this application, a better understanding of the global hemodynamic response of the VAD, in essence an electrically driven pump, and the cardiovascular system is necessary. To meet this need, a model has been established as a nonlinear, lumped-parameter electrical analog, and simulated results under different states [healthy, congestive heart failure (CHF), and postinsertion of VAD] are presented. The systemic circulation is separated into five compartments and the descending aorta is composed of three components to accurately yield the system response of each section before and after the insertion of the VAD. Delays in valve closing time and blood inertia in the aorta were introduced to deliver a more realistic model. Pump governing equations and optimization are based on fundamental theories of turbomachines and can serve as a practical initial design point for rotary blood pumps. The model's results closely mimic established parameters for the circulatory system and confirm the feasibility of the intra-aortic VAD concept. This computational model can be linked with models of the pump motor to provide a valuable tool for innovative VAD design.

Solid particle erosion of boronized steels

Boronizing is a thermochemical diffusion-based process for producing iron boride layers in the surface of steel components. The boride layer is wear resistant and is very hard. Large residual stresses are found to exist in the surface layers, which are a function of substrate steel composition and heat treatment. By slow cooling from the boronizing temperature (900°C), a large compressive stress is developed in the boride layer. Hardening the steel by rapid cooling, either directly from the boronizing treatment or after subsequent austenitizing, develops tension in the coating which causes it to fracture. Tempering of the martensite produces compression in the coating, closing but not welding the cracks. The results of solid particle erosion experiments using silicon carbide, quartz, and glass bead erodents on boronized steels are presented.

3D FE Analyses of Buried Pipeline with Elbows Subjected to Lateral Loading

This study investigates the interaction between soil and pipeline in sand subjected to lateral ground displacements with emphasis on the peak force exerted to a bended elbow-pipe. A series of three-dimensional (3D) finite-element (FE) analyses were performed in both opening and closing modes of the elbow section for different initial pipe bending angles. To model the mechanical behavior of sands, two soil models were adopted: Mohr-Coulomb and Nor-Sand soil model. Investigations also included the effects of pipe embedment depth and soil density. Results show that the opening mode exhibits higher ultimate forces and greater localized deformations than the closing mode. Nondimensional charts that account for pipeline location, bending angle, and soil density are developed. Soil-spring pipeline analyses of an elbow-pipe were performed using modified F-δ soil-spring models based on the 3D FE results and were compared to the findings of conventional spring model analyses using the standard two-dimensional soil-spring model. Results show that the pipe strain does not change in the closing mode case. However, in the opening mode case, the pipe strain computed by the modified analysis is larger than that by the conventional analysis and the difference is more pronounced when the pipe stiffness is stiffer. © 2011 American Society of Civil Engineers.

Development of a time and space resolved sampling probe diagnostic for engine exhaust hydrocarbons

In order to understand how unburned hydrocarbons emerge from SI engines and, in particular, how non-fuel hydrocarbons are formed and oxidized, a new gas sampling technique has been developed. A sampling unit, based on a combination of techniques used in the Fast Flame Ionization Detector (FFID) and wall-mounted sampling valves, was designed and built to capture a sample of exhaust gas during a specific period of the exhaust process and from a specific location within the exhaust port. The sampling unit consists of a transfer tube with one end in the exhaust port and the other connected to a three-way valve that leads, on one side, to a FFID and, on the other, to a vacuum chamber with a high-speed solenoid valve. Exhaust gas, drawn by the pressure drop into the vacuum chamber, impinges on the face of the solenoid valve and flows radially outward. Once per cycle during a specified crank angle interval, the solenoid valve opens and traps exhaust gas in a storage unit, from which gas chromatography (GC) measurements are made. The port end of the transfer tube can be moved to different locations longitudinally or radially, thus allowing spatial resolution and capturing any concentration differences between port walls and the center of the flow stream. Further, the solenoid valve's opening and closing times can be adjusted to allow sampling over a window as small as 0.6 ms during any portion of the cycle, allowing resolution of a crank angle interval as small as 15°CA. Cycle averaged total HC concentration measured by the FFID and that measured by the sampling unit are in good agreement, while the sampling unit goes one step further than the FFID by providing species concentrations. Comparison with previous measurements using wall-mounted sampling valves suggests that this sampling unit is fully capable of providing species concentration information as a function of air/fuel ratio, load, and engine speed at specific crank angles. © Copyright 1996 Society of Automotive Engineers, Inc.