Efficient solutions to factored MDPs with imprecise transition probabilities

When modeling real-world decision-theoretic planning problems in the Markov Decision Process (MDP) framework, it is often impossible to obtain a completely accurate estimate of transition probabilities. For example, natural uncertainty arises in the transition specification due to elicitation of MOP transition models from an expert or estimation from data, or non-stationary transition distributions arising from insufficient state knowledge. In the interest of obtaining the most robust policy under transition uncertainty, the Markov Decision Process with Imprecise Transition Probabilities (MDP-IPs) has been introduced to model such scenarios. Unfortunately, while various solution algorithms exist for MDP-IPs, they often require external calls to optimization routines and thus can be extremely time-consuming in practice. To address this deficiency, we introduce the factored MDP-IP and propose efficient dynamic programming methods to exploit its structure. Noting that the key computational bottleneck in the solution of factored MDP-IPs is the need to repeatedly solve nonlinear constrained optimization problems, we show how to target approximation techniques to drastically reduce the computational overhead of the nonlinear solver while producing bounded, approximately optimal solutions. Our results show up to two orders of magnitude speedup in comparison to traditional ""flat"" dynamic programming approaches and up to an order of magnitude speedup over the extension of factored MDP approximate value iteration techniques to MDP-IPs while producing the lowest error of any approximation algorithm evaluated. (C) 2011 Elsevier B.V. All rights reserved.

Efficient solutions to robust, semi-implicit discretizations of the immersed boundary method

The immersed boundary method is a versatile tool for the investigation of flow-structure interaction. In a large number of applications, the immersed boundaries or structures are very stiff and strong tangential forces on these interfaces induce a well-known, severe time-step restriction for explicit discretizations. This excessive stability constraint can be removed with fully implicit or suitable semi-implicit schemes but at a seemingly prohibitive computational cost. While economical alternatives have been proposed recently for some special cases, there is a practical need for a computationally efficient approach that can be applied more broadly. In this context, we revisit a robust semi-implicit discretization introduced by Peskin in the late 1970s which has received renewed attention recently. This discretization, in which the spreading and interpolation operators are lagged. leads to a linear system of equations for the inter-face configuration at the future time, when the interfacial force is linear. However, this linear system is large and dense and thus it is challenging to streamline its solution. Moreover, while the same linear system or one of similar structure could potentially be used in Newton-type iterations, nonlinear and highly stiff immersed structures pose additional challenges to iterative methods. In this work, we address these problems and propose cost-effective computational strategies for solving Peskin`s lagged-operators type of discretization. We do this by first constructing a sufficiently accurate approximation to the system`s matrix and we obtain a rigorous estimate for this approximation. This matrix is expeditiously computed by using a combination of pre-calculated values and interpolation. The availability of a matrix allows for more efficient matrix-vector products and facilitates the design of effective iterative schemes. We propose efficient iterative approaches to deal with both linear and nonlinear interfacial forces and simple or complex immersed structures with tethered or untethered points. One of these iterative approaches employs a splitting in which we first solve a linear problem for the interfacial force and then we use a nonlinear iteration to find the interface configuration corresponding to this force. We demonstrate that the proposed approach is several orders of magnitude more efficient than the standard explicit method. In addition to considering the standard elliptical drop test case, we show both the robustness and efficacy of the proposed methodology with a 2D model of a heart valve. (C) 2009 Elsevier Inc. All rights reserved.

Generalized solutions of a nonlinear parabolic equation with generalized functions as initial data

In [H. Brezis, A. Friedman, Nonlinear parabolic equations involving measures as initial conditions, J. Math. Pure Appl. (9) (1983) 73-97.] Brezis and Friedman prove that certain nonlinear parabolic equations, with the delta-measure as initial data, have no solution. However in [J.F. Colombeau, M. Langlais, Generalized solutions of nonlinear parabolic equations with distributions as initial conditions, J. Math. Anal. Appl (1990) 186-196.] Colombeau and Langlais prove that these equations have a unique solution even if the delta-measure is substituted by any Colombeau generalized function of compact support. Here we generalize Colombeau and Langlais` result proving that we may take any generalized function as the initial data. Our approach relies on recent algebraic and topological developments of the theory of Colombeau generalized functions and results from [J. Aragona, Colombeau generalized functions on quasi-regular sets, Publ. Math. Debrecen (2006) 371-399.]. (C) 2009 Elsevier Ltd. All rights reserved.

Surface Activity of the Triflate Ion at the Air/Water Interface and Properties of N,N,N-Trimethyl-N-Dodecylammonium Triflate Aqueous Solutions

The surface activity of salts added to water is Air orders of magnitude lower than that of surfactants. Sodium trifluoromethanesulfonate (NaTf) produced a change in surface tension. with concentration, Delta gamma/Delta c, of -13.2 mN.L/m.mol. This value is ca. 4-fold larger than those of simple salts and that of methanesulfonate. This unexpected surface effect suggested that positively charged micelles containing Tf could exhibit interesting properties. Dodecyltrimethylammonium triflate (DTATf) had a higher Kraft temperature (37 degrees C) and a lower cmc (5 x 10(-3)M) and degree of dissociation (0.11) than the chloride and bromide salts of DTA. Above the Kraft temperature, at a characteristic temperature t(1), the addition of NaTf above 0.05 M. to a DTATf solution induced phase separation. By increasing the temperature of the two-phase system to above t(1), a homogeneous, transparent solution was obtained at a characteristic temperature t(2). These results, together with well-known triflate properties, led us to suggest that the Tf ion pairs With DTA and that the -CF(3) group may be dehydrated in the interfacial region, resulting in new and interesting self-aggregated structures.

Application of Microelectrode Voltammetry to Study the Properties of Surfactant Solutions: Alkyltrimethylammonium Bromides

Microelectrode cyclic voltammetry (MV) has been employed to investigate the micellar properties of solutions of homologous alkyltrimethylammonium bromides, RMe(3)ABr, R = C(10), C(12), and C(14), in water and in the presence of added NaBr. The micellar self-diffusion coefficient was calculated from the limiting current for the reversible electron transfer of micelle-bound ferrocene. From the values of this property, other parameters were calculated, including the micellar hydrodynamic radius, RH, and aggregation number, N(agg); the latter was also theoretically calculated. We determined the values of the diffusion coefficient as a function of various experimental variables and observed the following trends: The diffusion coefficient decreases as a function of increasing surfactant concentration (no additional electrolyte added); it decreases as a function of increasing surfactant concentration at fixed NaBr concentration; and it shows a complex dependence (increase then decrease) on the NaBr concentration at a fixed RMe(3)ABr concentration. The value of the intermicellar interaction parameter decreases and then increases as a function of increasing NaBr concentration. These results are discussed in terms of intermicellar,interactions and the effect of NaBr on the micellar surface charge density and sphere-to-rod geometry change. The NaBr concentration required to induce the latter change increases rapidly as a function of decreasing the length of R: no geometry change was detected for C(10)Me(3)ABr. Values of N(agg) increase as I function of increasing the length of R and are in good agreement with both literature values and values that were calculated theoretically. Thus, MV is a convenient and simple technique for obtaining fundamental properties of surfactant solutions, including additive-induced changes of micellar parameters (N(agg)) and morphology changes.

Characteristics of thin cellulose ester films spin-coated from acetone and ethyl acetate solutions

Spin-coated films of cellulose acetate (CA), cellulose acetate propionate (CAP), cellulose acetate butyrate (CAB) and carboxymethylcellulose acetate butyrate (CMCAB) have been characterized by ellipsometry, atomic force microscopy (AFM) and contact angle measurements. The films were spin-coated onto silicon wafers, a polar surface. Mean thickness values were determined by means of ellipsometry and AFM as a function of polymer concentration in solutions prepared either in acetone or in ethyl acetate (EA), both are good solvents for the cellulose esters. The results were discussed in the light of solvent evaporation rate and interaction energy between substrate and solvent. The effects of annealing and type of cellulose ester on film thickness, film morphology, surface roughness and surface wettability were also investigated.

Transport coefficients, Raman spectroscopy, and computer simulation of lithium salt solutions in an ionic liquid

Lithium salt solutions of Li(CF3SO2)(2)N, LiTFSI, in a room-temperature ionic liquid (RTIL), 1-butyl-2,3-dimethyl-imidazolium cation, BMMI, and the (CF3SO2)(2)N-, bis(trifluoromethanesulfonyl)imide anion, [BMMI][TFSI], were prepared in different concentrations. Thermal properties, density, viscosity, ionic conductivity, and self-diffusion coefficients were determined at different temperatures for pure [BMMI][TFSI] and the lithium solutions. Raman spectroscopy measurements and computer simulations were also carried out in order to understand the microscopic origin of the observed changes in transport coefficients. Slopes of Walden plots for conductivity and fluidity, and the ratio between the actual conductivity and the Nernst-Einstein estimate for conductivity, decrease with increasing LiTFSI content. All of these studies indicated the formation of aggregates of different chemical nature, as it is corroborated by the Raman spectra. In addition, molecular dynamics (MD) simulations showed that the coordination of Li+ by oxygen atoms of TFSI anions changes with Li+ concentration producing a remarkable change of the RTIL structure with a concomitant reduction of diffusion coefficients of all species in the solutions.

Effect of the chain length in the structure of imidazolic ionic liquids and dimethylformamide solutions probed by Raman spectroscopy

The Raman band assigned to the nu(C=O)mode in N,N-dimethylformamide (at ca. 1660 cm(-1)) was used as a probe to study a group of ionic liquids 1-alkyl-3-methylimidazolium bromide ([C(n)Mlm]Br) with different alkyl groups (n = 2, 4, 6, 8 and 10 carbons) in binary equimolar binary mixtures with dimethylformamide. Due to the high electric dipole moment of the group C=O, there is a substantial coupling between adjacent molecules in the solution, and the corresponding Raman band involves both vibrational and reorientational modes. Different chain lengths of the ILs lead to different extents of the uncoupling of adjacent molecules of dimethylformamide, resulting in different shifts for this band in the mixtures. Information about the organization of ionic liquids in solution was obtained and a model of aggregation for these systems is proposed. (C) 2010 Elsevier B.V. All rights reserved.

Wettability of Aqueous Rhamnolipids Solutions Produced by Pseudomonas aeruginosa LBI

The wetting behavior of rhamnolipids produced by Pseudomonas aeruginosa LBI strain grown on waste oil substrate and sodium dodecyl sulfate (SDS) on glass, polyethylene terephthalate (PET), poly(vinyl chloride) (PVC), poly(epsilon-caprolactone) (PCL) and polymer blend (PVC-PCL) was investigated by the measuring contact angle of sessile drops, to determine the wetting characteristics of rhamnolipids. The comparison of the wetting profiles showed that at low SDS and rhamnolipid concentrations, the contact angle increased and when the concentration of the surfactant increased further, the contact angle decreased. The blend surface (PVC-PCL) showed better wettability than the homopolymers themselves and the blend changed the surface hydrophobicity of the polymer, making it more hydrophilic. The rhamnolipids produced by the LBI strain exhibited superior wetting abilities than the chemical surfactant SDS one. This is the first work that evaluates the wetting properties of rhamnolipids on polymer blends.

Electrocombustion of humic acid and removal of algae from aqueous solutions

This paper reports experiments involving the electrochemical combustion of humic acid (HA) and removal of algae from pond water. An electrochemical flow reactor with a boron-doped diamond film anode was used and constant current experiments were conducted in batch recirculation mode. The mass transfer characteristics of the electrochemical device were determined by voltammetric experiments in the potential region of water stability, followed by a controlled current experiment in the potential region of oxygen evolution. The average mass transfer coefficient was 5.2 x 10(-5) m s(-1). The pond water was then processed to remove HA and algae in the conditions in which the reaction combustion occurred under mass transfer control. To this end, the mass transfer coefficient was used to estimate the initial limiting current density applied in the electrolytic experiments. As expected, all the parameters analyzed here-solution absorbance at 270 nm, total phenol concentration and total organic carbon concentration-decayed according to first-order kinetics. Since the diamond film anode successfully incinerated organic matter, the electrochemical system proved to be predictable and programmable.

Analysis and Evaluation of EndpointSecurity Solutions

The main objective for this degree project was to analyze the Endpoint Security Solutions developed by Cisco, Microsoft and a third minor company solution represented by InfoExpress. The different solutions proposed are Cisco Network Admission Control, Microsoft Network Access Protection and InfoExpress CyberGatekeeper. An explanation of each solution functioning is proposed as well as an analysis of the differences between those solutions. This thesis work also proposes a tutorial for the installation of Cisco Network Admission Control for an easier implementation. The research was done by reading articles on the internet and by experimenting the Cisco Network Admission Control solution. My background knowledge about Cisco routing and ACL was also used. Based on the actual analysis done in this thesis, a conclusion was drawn that all existing solutions are not yet ready for large-scale use in corporate networks. Moreover all solutions are proprietary and incompatible. The future possible standard for Endpoint solution might be driven by Cisco and Microsoft and a rude competition begins between those two giants.

Implementation and role of device management Solutions to the end users

This research is based on consumer complaints with respect to recently purchased consumer electronics. This research document will investigate the instances of development and device management as a tool used to aid consumer and manage consumer’s mobile products in order to resolve issues in or before the consumers is aware one exists. The problem at the present time is that mobile devices are becoming very advanced pieces of technology, and not all manufacturers and network providers have kept up the support element of End users. As such, the subject of the research is to investigate how device management could possibly be used as a method to promote research and development of mobile devices, and provide a better experience for the consumer. The wireless world is becoming increasingly complex as revenue opportunities are driven by new and innovative data services. We can no longer expect the customer to have the knowledge or ability to configure their own device. Device Management platforms can address the challenges of device configuration and support through new enabling technologies. Leveraging these technologies will allow a network operator to reduce the cost of subscriber ownership, drive increased ARPU (Average Revenue per User) by removing barriers to adoption, reduce churn by improving the customer experience and increase customer loyalty. DM technologies provide a flexible and powerful management method but are managing the same device features that have historically been configured manually through call centers or by the end user making changes directly on the device. For this reason DM technologies must be treated as part of a wider support solution. The traditional requirement for discovery, fault finding, troubleshooting and diagnosis are still as relevant with DM as they are in the current human support environment yet the current generation of solutions do little to address this problem. In the deployment of an effective Device Management solution the network operator must consider the integration of the DM platform, interfacing with many areas of the business, supported by knowledge of the relationship between devices, applications, solutions and services maintained on an ongoing basis. Complementing the DM solution with published device information, setup guides, training material and web based tools will ensure the quality of the customer experience, ensuring that problems are completely resolved, driving data usage by focusing customer education on the use of the wireless service In this way device management becomes a tool used both internally within the network or device vendor and by the customer themselves, with each user empowered to effectively manage the device without any prior knowledge or experience, confident that changes they apply will be relevant, accurate, stable and compatible. The value offered by an effective DM solution with an expert knowledge service will become a significant differentiator for the network operator in an ever competitive wireless market. This research document is intended to highlight some of the issues the industry faces as device management technologies become more prevalent, and offers some potential solutions to simplify the increasingly complex task of managing devices on the network, where device management can be used as a tool to aid customer relations and manage customer’s mobile products in order to resolve issues before the user is aware one exists. The research is broken down into the following, Customer Relationship Management, Device management, the role of knowledge with the DM, Companies that have successfully implemented device management, and the future of device management and CRM. And it also consists of questionnaires aimed at technical support agents and mobile device users. Interview was carried out with CRM managers within support centre to further the evidence gathered. To conclude, the document is to consider the advantages and disadvantages of device management and attempt to determine the influence it will have over customer support centre, and what methods could be used to implement it.

Electricity Supply Solutions for an Educational Center in Tanzania

The aim of this study was to investigate electricity supply solutions for an educationalcenter that is being built in Chonyonyo Tanzania. Off-grid power generation solutions andfurther optimization possibilities were studied for the case.The study was done for Engineers Without Borders in Sweden. Who are working withMavuno Project on the educational center. The school is set to start operating in year 2015with 40 girl students in the beginning. The educational center will help to improve genderequality by offering high quality education in a safe environment for girls in rural area.It is important for the system to be economically and environmentally sustainable. Thearea has great potential for photovoltaic power generation. Thus PV was considered as theprimary power generation and a diesel generator as a reliable backup. The system sizeoptimization was done with HOMER. For the simulations HOMER required componentdata, weather data and load data. Common components were chose with standardproperties, the loads were based on load estimations from year 2011 and the weather datawas acquired from NASA database. The system size optimization result for this base casewas a system with 26 kW PW; 5.5 kW diesel generator, 15 kW converter and 112 T-105batteries. The initial cost of the system was 55 875 €, the total net present cost 92 121 €and the levelized cost of electricity 0.264 €/kWh.In addition three optimization possibilities were studied. First it was studied how thesystem should be designed and how it would affect the system size to have night loads(security lights) use DC and could the system then be extended in blocks. As a result it wasfound out that the system size could be decreased as the inverter losses would be avoided.Also the system extension in blocks was found to be possible. The second study was aboutinverter stacking where multiple inverters can work as one unit. This type of connectionallows only the required number of inverters to run while shutting down the excess ones.This would allow the converter-unit to run with higher efficiency and lower powerconsumption could be achieved. In future with higher loads the system could be easilyextendable by connecting more inverters either in parallel or series depending on what isneeded. Multiple inverters would also offer higher reliability than using one centralizedinverter. The third study examined how the choice of location for a centralized powergeneration affects the cable sizing for the system. As a result it was found that centralizedpower generation should be located close to high loads in order to avoid long runs of thickcables. Future loads should also be considered when choosing the location. For theeducational center the potential locations for centralized power generation were found outto be close to the school buildings and close to the dormitories.