A unified framework for linear function approximation of value functions in stochastic control

This paper contributes with a unified formulation that merges previ- ous analysis on the prediction of the performance ( value function ) of certain sequence of actions ( policy ) when an agent operates a Markov decision process with large state-space. When the states are represented by features and the value function is linearly approxi- mated, our analysis reveals a new relationship between two common cost functions used to obtain the optimal approximation. In addition, this analysis allows us to propose an efficient adaptive algorithm that provides an unbiased linear estimate. The performance of the pro- posed algorithm is illustrated by simulation, showing competitive results when compared with the state-of-the-art solutions.

Gromov hyperbolicity of periodic planar graphs

The study of hyperbolic graphs is an interesting topic since the hyperbolicity of a geodesic metric space is equivalent to the hyperbolicity of a graph related to it. The main result in this paper is a very simple characterization of the hyperbolicity of a large class of periodic planar graphs.

Weighted composition operators on the predual and dual Banach spaces of Beurling algebras on Z

Let vv be a weight sequence on ZZ and let ψ,φψ,φ be complex-valued functions on ZZ such that φ(Z)⊂Zφ(Z)⊂Z. In this paper we study the boundedness, compactness and weak compactness of weighted composition operators Cψ,φCψ,φ on predual Banach spaces c0(Z,1/v)c0(Z,1/v) and dual Banach spaces ℓ∞(Z,1/v)ℓ∞(Z,1/v) of Beurling algebras ℓ1(Z,v)ℓ1(Z,v).

The Power of the Palestinian Landscape : An exploratory study of the functions of power using aerial image interpretation

The Palestinian region is changing rapidly, with both economic and cultural consequences. One way of approaching this very political process is thru the concept of landscape. By viewing the region as a multiprocessual, dynamic landscape the analysis allows for a holistic read where historical and contemporary projections, interpretations and notions of power are fused. This thesis draws on the scholarly fields of humanistic landscape research and aerial image interpretation as well as theories of orientalism and power. A case study of two regions of the West Bank is performed; interviews and observations provide localized knowledge that is then used in open-access image interpretation. By performing image interpretations this thesis explores the power embedded in mapping and the possible inclinations the development towards open-access geospatial analytic tools could have on the functions of power in the Palestinian landscape. By investigating the spatial configuration of the Palestinian landscape and tracing its roots this thesis finds four major themes that are particularly pivotal in the processual change of the Palestinian landscape: the Israeli/Palestinian time-space, the blurring of the conflict, the dynamics of the frontier region and the orientalist gaze. 

Fast algorithms for automatic mapping with space-limited covariance functions

In this paper we discuss a fast Bayesian extension to kriging algorithms which has been used successfully for fast, automatic mapping in emergency conditions in the Spatial Interpolation Comparison 2004 (SIC2004) exercise. The application of kriging to automatic mapping raises several issues such as robustness, scalability, speed and parameter estimation. Various ad-hoc solutions have been proposed and used extensively but they lack a sound theoretical basis. In this paper we show how observations can be projected onto a representative subset of the data, without losing significant information. This allows the complexity of the algorithm to grow as O(n m 2), where n is the total number of observations and m is the size of the subset of the observations retained for prediction. The main contribution of this paper is to further extend this projective method through the application of space-limited covariance functions, which can be used as an alternative to the commonly used covariance models. In many real world applications the correlation between observations essentially vanishes beyond a certain separation distance. Thus it makes sense to use a covariance model that encompasses this belief since this leads to sparse covariance matrices for which optimised sparse matrix techniques can be used. In the presence of extreme values we show that space-limited covariance functions offer an additional benefit, they maintain the smoothness locally but at the same time lead to a more robust, and compact, global model. We show the performance of this technique coupled with the sparse extension to the kriging algorithm on synthetic data and outline a number of computational benefits such an approach brings. To test the relevance to automatic mapping we apply the method to the data used in a recent comparison of interpolation techniques (SIC2004) to map the levels of background ambient gamma radiation. © Springer-Verlag 2007.

Ultrafast all-optical Nth-order differentiator and simultaneous repetition-rate multiplier of periodic pulse train

The letter presents a technique for Nth-order differentiation of periodic pulse train, which can simultaneously multiply the input repetition rate. This approach uses a single linearly chirped apodized fiber Bragg grating, which grating profile is designed to map the spectral response of the Nth-order differentiator, and the chirp introduces a dispersion that, besides space-to-frequency mapping, it also causes a temporal Talbot effect.

Subdifferentials of Performance Functions and Calculus of Coderivatives of Set-Valued Mappings

The paper contains calculus rules for coderivatives of compositions, sums and intersections of set-valued mappings. The types of coderivatives considered correspond to Dini-Hadamard and limiting Dini-Hadamard subdifferentials in Gˆateaux differentiable spaces, Fréchet and limiting Fréchet subdifferentials in Asplund spaces and approximate subdifferentials in arbitrary Banach spaces. The key element of the unified approach to obtaining various calculus rules for various types of derivatives presented in the paper are simple formulas for subdifferentials of marginal, or performance functions.

Mean-Periodic Functions Associated with the Jacobi-Dunkl Operator on R

2000 Mathematics Subject Classification: 34K99, 44A15, 44A35, 42A75, 42A63

Representations of Inverse Functions by the Integral Transform with the Sign Kernel

Mathematics Subject Classification: Primary 30C40

A Characterization of Weakly Lindelöf Determined Banach Spaces

2000 Mathematics Subject Classification: 46B26, 46B03, 46B04.

Linear Colligations and Dynamic System Corresponding to Operators in the Banach Space

2000 Mathematics Subject Classification: Primary 47A48, 93B28, 47A65; Secondary 34C94.

Sobolev Type Decomposition of Paley-Wiener-Schwartz Space with Application to Sampling Theory

2000 Mathematics Subject Classification: 94A12, 94A20, 30D20, 41A05.

Solutions of Fractional Diffusion-Wave Equations in Terms of H-functions

MSC 2010: 35R11, 42A38, 26A33, 33E12

A New Hereditarily l^2 Banach Space

2000 Mathematics Subject Classification: 46B20, 46B26.

Density of Polynomials in the L^2 Space on the Real and the Imaginary Axes and in a Sobolev Space

2000 Mathematics Subject Classification: 41A10, 30E10, 41A65.