Henny? Beitman with a bicycle; Dielkirchen, Falkenstein, Germany Portraits Women

Digital Image

Rose Herz outdoors with a bicycle.

Digital Image

Young boy (Herbert Strauss?) pushing a bicycle down a busy street.

Digital Image

Rose Herz outdoors with a bicycle.

Digital Image

Young boy (Herbert Strauss?) pushing a bicycle down a busy street.

Digital Image

The Philosophical Age. Almanac. Issue 36. The Northern Lights

keywords: Enlightenment, Northern countries, Finland, Russia, Scotland In the 36 th edition of the almanac "Philosophical Age" published materials of international symposium «The Northern Lights - Facets of Enlightenment Culture», (held September 25-26, 2009) in The Aleksanteri Institute the University of Helsinki. Contents: Vesa Oittinen Between Radicalism and Utilitarianism — On the Profile of the Finnish Enlightenment Tatiana Artemyeva The Status of Intellectual Values in the Russian Enlightenment Oili Pulkkinen The Cosmopolitan Experience, Theoretical Histories and the Universal Science of the Scottish Enlightenment Аlla Zlatopolskaya L’autocritique des Lumières chez Rousseau et le rousseauisme russe Johannes Remy Alexander Radishchev, Ethical Consuming, and North American Quakers Kimmo Sarje Anders Chydenius and Radical Swedish Enlightenment Johan Sten Anders Johan Lexell: A Finnish Astronomer at St. Petersburg Academy of Sciences and His European Contacts Mikhail Mikeshin A Russian Adam Smith in French Style: An Example of the Transfer of Ideas Larisa Agamalian The Library of an Enlightened Russian Landowner

Reinforcement learning with average cost for adaptive control of traffic lights at intersections

We propose for the first time two reinforcement learning algorithms with function approximation for average cost adaptive control of traffic lights. One of these algorithms is a version of Q-learning with function approximation while the other is a policy gradient actor-critic algorithm that incorporates multi-timescale stochastic approximation. We show performance comparisons on various network settings of these algorithms with a range of fixed timing algorithms, as well as a Q-learning algorithm with full state representation that we also implement. We observe that whereas (as expected) on a two-junction corridor, the full state representation algorithm shows the best results, this algorithm is not implementable on larger road networks. The algorithm PG-AC-TLC that we propose is seen to show the best overall performance.