Learning dynamic prices in multiseller electronic retail markets with price sensitive customers, stochastic demands, and inventory replenishments

In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers, and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers), and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not previously been applied. We consider two representative cases: 1) no information case, were none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and 2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents, or pricebots, which use RL-based pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new and promising way of setting dynamic prices in multiseller environments with stochastic demands, price sensitive customers, and inventory replenishments.

Fractional-factorial design of a porous-carbon fuel-cell electrode

The use of fractional-factorial methods in the optimization of porous-carbon electrode structure is discussed with respect to weight-loss of carbon during gas treatment, weight and mixing time of binder, compaction temperature, time and pressure, and pressure of feed gas. The experimental optimization of an air electrode in alkaline solution is described.

Biomassan energia-arvon nostaminen sekundäärilämmöllä kuivaamalla

Viime aikoina ilmastonmuutos, fossiilisten polttoaineiden väheneminen ja niiden hinnan nousu ovat lisänneet merkittävästi maailmanlaajuista kiinnostusta uusiutuviin energiavaroihin. Suomessa uusiutuvien energialähteiden käytössä on jo pitkään panostettu metsäteollisuuden sivutuotevirtana tuottamaan puuperäiseen biomassaan, jota metsäteollisuus käyttää energiantuotantoonsa. Metsäteollisuuden jätevesien käsittelyssä syntyy erilaisia lietteitä, jotka joko uusiokäytetään tai hävitetään polttamalla tai sijoittamalla kaatopaikalle. Erityisesti biolietteiden uusiokäyttö on hankalaa ja kaatopaikkasijoitus tulevaisuudessa mahdotonta tai ainakin kustannuksiltaan kohtuutonta. Käytännössä liete hävitetään polttamalla ja kuivaamalla siitä tulee polttoaine. Lietteiden energiakäyttö on järkevin tapa hävittää jäteliete. Lietteiden korkean vesipitoisuuden vuoksi ne tulee kuitenkin kuivata ennen polttoa. Lietteen kuivaaminen sekundäärienergiavirralla eli metsäteollisuusprosesseissa sivutuotteena muodostuvalla ns. hukkalämmöllä lisää lietteen poltosta saatavaa energiamäärää ja korvaa fossiilisten polttoaineiden käyttöä. Tutkimuksen tavoitteena oli selvittää lietteen kuivaukseen optimaalisin kuoren ja lietteen seossuhde eri kuivausparametrejä vaihdellen. Kokeellinen työ aloitettiin rakentamalla energiatekniikan koehalliin laboratoriokokoluokan kiintopetikuivuri, jossa kuivumista tutkittiin puhaltamalla polttoainepedin läpi lämmitettyä ilmaa. Kuivattavina polttoaineina olivat kuoren ja lietteen seos tai pelkkä kuori ja liete erilaisilla massoilla ja erilaisilla prosenttisilla suhteilla ja erilaisissa lämpötiloissa. Kuivumiskäyrien määritys perustui massanmuutokseen. Koelaitteessa olivat anturit lämpötilan mittausta varten, jotta lämpötila saatiin säädettyä ja seurattua kokeen edellyttämällä tavalla. Lämpötilat ja painonmuutokset tallentuivat koetta tehdessä tietokoneelle. Kuivauskokeet osoittivat, että liete-kuori seos kuivuu hyvin kiintopedissä kun lietteen massaosuus seoksessa on korkeintaan 50 %. Lietteen massaosuuden ollessa tätä suurempi kuivaaminen ei enää ole tehokasta, mikä johtuu luultavasti ilman suuresta kanavoitumisesta kuivauspedissä. Kuorta kuivatessa lämpötilan nosto 50 °C:stä 70 °C:een oli huomattavasti tehokkaampaa kuin 70 °C:stä 90 °C:een, ajallisesti ero oli noin kaksinkertainen.

Catalytic hydrogen combustion for treatment of combustible gases from fuel cell processors

Catalytic combustion of H-2 was carried out over combustion synthesized noble metal (Pd or Pt) ion-substituted CeO2 based catalysts using a feed stream that simulated exhaust gases from a fuel cell processor The catalysts showed a high activity for H-2-combustion and complete conversion was achieved below 200 C over all the catalysts when O-2 was used in a stoichiometric amount With higher amounts of O-2 the reaction rates Increased and complete conversions were possible below 100 C The reaction was also carried out over Pd-impregnated CeO2 The conversions of H-2 with stoichiometric amount of O-2 were found to be higher over Pd-substituted compound The mechanism of the reaction over noble metal-substituted compounds was proposed on the basis of X-ray photoelectron spectroscopy studies The redox couples between Ce and metal ions were established and a dual site redox mechanism was pi posed for the reaction (C) 2010 Elsevier B V All rights reserved

Mesoporous Carbon and Poly(3,4-ethylenedioxythiophene) Composite as Catalyst Support for Polymer Electrolyte Fuel Cells

In situ polymerization of 3,4-ethylenedioxythiophene with sol-gel-derived mesoporous carbon (MC) leading to a new composite and its subsequent impregnation with Pt nanoparticles for application in polymer electrolyte fuel cells (PEFCs) is reported. The composite exhibits good dispersion and utilization of platinum nanoparticles akin to other commonly used microporous carbon materials, such as carbon black. Pt-supported MC-poly(3,4-ethylenedioxythiophene) (PEDOT) composite also exhibits promising electrocatalytic activity toward oxygen reduction reaction, which is central to PEFCs. The PEFC with Pt-loaded MC-PEDOT support exhibits 75% of enhancement in its power density in relation to the PEFC with Pt-loaded pristine MC support while operating under identical conditions. It is conjectured that Pt-supported MC-PEDOT composite ameliorates PEFC performance/durability on repetitive potential cycling. (C) 2010 The Electrochemical Society. DOI: 10.1149/1.3486172] All rights reserved.

Housing the skilled migrants in the Helsinki Metropolitan Area : International attractiveness of housing, neighbourhoods and the city region

The aim of this thesis is to examine the skilled migrants’ satisfaction with the Helsinki Metropolitan Area. The examination is executed on three scales: housing, neighbourhoods and the city region. Specific focus is on the built environment and how it meets the needs of the migrants. The empirical data is formed of 25 semi-structured interviews with skilled migrants and additionally 5 expert interviews. Skilled and educated workforce is an increasingly important resource in the new economy, and cities are competing globally for talented workers. With aging population and a need to develop its innovational structure, the Helsinki Metropolitan Area needs migrant workforce. It has been stated that quality of place is a central factor for skilled migrants when choosing where to settle, and from this perspective their satisfaction with the region is significant. In housing, the skilled migrants found the price-quality ratio and the general sizes of apartments inadequate. The housing market is difficult for the migrants to approach, since they often do not speak Finnish and there are prejudices towards foreigners. The general quality of housing was rated well. On the neighbourhood level, the skilled migrants had settled in residential areas which are also preferred by the Finnish skilled workers. While the migrants showed suburban orientation in their settlement patterns, they were not concentrated in the suburban areas which host large shares of traditional immigrant groups. Migrants were usually satisfied with their neighbourhoods; however, part of the suburban dwellers were unsatisfied with the services and social life in their neighbourhoods. Considering the level of the city region, the most challenging feature for the skilled migrants was the social life. The migrants felt that the social environment is homogeneous and difficult to approach. The physical environment was generally rated well, the most appreciated features being public transportation, human scale of the Metropolitan Helsinki, cleanliness, and the urban nature. Urban culture and services were seen good for the city region’s size, but lacking in international comparison.