Absolutely expedient algorithms for learning Nash equilibria

This paper considers a multi-person discrete game with random payoffs. The distribution of the random payoff is unknown to the players and further none of the players know the strategies or the actual moves of other players. A class of absolutely expedient learning algorithms for the game based on a decentralised team of Learning Automata is presented. These algorithms correspond, in some sense, to rational behaviour on the part of the players. All stable stationary points of the algorithm are shown to be Nash equilibria for the game. It is also shown that under some additional constraints on the game, the team will always converge to a Nash equilibrium.

General-sum stochastic games: Verifiability conditions for Nash equilibria

Unlike zero-sum stochastic games, a difficult problem in general-sum stochastic games is to obtain verifiable conditions for Nash equilibria. We show in this paper that by splitting an associated non-linear optimization problem into several sub-problems, characterization of Nash equilibria in a general-sum discounted stochastic games is possible. Using the aforementioned sub-problems, we in fact derive a set of necessary and sufficient verifiable conditions (termed KKT-SP conditions) for a strategy-pair to result in Nash equilibrium. Also, we show that any algorithm which tracks the zero of the gradient of the Lagrangian of every sub-problem provides a Nash strategy-pair. (c) 2012 Elsevier Ltd. All rights reserved.

A Fair Contract for Managing Water Scarcity

In public utilities, under supply constraints, fairness considerations lead to a market failure. This paper characterizes a two-period principal-agent contract for demand management, that mitigates this market failure in urban water systems. The contract is designed as an extensive form mechanism using subgame perfect Nash equilibrium (SPNE) as the solution concept. The contract is fair; and is shown to be economically efficient if, in case of deviation by the agent, the gain to the agent and the loss to the principal are small. It is shown that the assumption can be avoided in an infinite horizon contract.

Bidding Dynamics of Rational Advertisers in Sponsored Search Auctions on the Web

In this paper, we address a key problem faced by advertisers in sponsored search auctions on the web: how much to bid, given the bids of the other advertisers, so as to maximize individual payoffs? Assuming the generalized second price auction as the auction mechanism, we formulate this problem in the framework of an infinite horizon alternative-move game of advertiser bidding behavior. For a sponsored search auction involving two advertisers, we characterize all the pure strategy and mixed strategy Nash equilibria. We also prove that the bid prices will lead to a Nash equilibrium, if the advertisers follow a myopic best response bidding strategy. Following this, we investigate the bidding behavior of the advertisers if they use Q-learning. We discover empirically an interesting trend that the Q-values converge even if both the advertisers learn simultaneously.

Opportunistic Scheduling in Cellular Systems in the Presence of Noncooperative Mobiles

A central scheduling problem in wireless communications is that of allocating resources to one of many mobile stations that have a common radio channel. Much attention has been given to the design of efficient and fair scheduling schemes that are centrally controlled by a base station (BS) whose decisions depend on the channel conditions reported by each mobile. The BS is the only entity taking decisions in this framework. The decisions are based on the reports of mobiles on their radio channel conditions. In this paper, we study the scheduling problem from a game-theoretic perspective in which some of the mobiles may be noncooperative or strategic, and may not necessarily report their true channel conditions. We model this situation as a signaling game and study its equilibria. We demonstrate that the only Perfect Bayesian Equilibria (PBE) of the signaling game are of the babbling type: the noncooperative mobiles send signals independent of their channel states, the BS simply ignores them, and allocates channels based only on the prior information on the channel statistics. We then propose various approaches to enforce truthful signaling of the radio channel conditions: a pricing approach, an approach based on some knowledge of the mobiles' policies, and an approach that replaces this knowledge by a stochastic approximations approach that combines estimation and control. We further identify other equilibria that involve non-truthful signaling.

Phase Equilibria in the System $Al_{2}O_{3}-CaO-CoO$ and Gibbs Energy of Formation of $Ca_{3}CoAl_{4}O_{10}$

The floating-zone method with different growth ambiences has been used to selectively obtain hexagonal or orthorhombic DyMnO3 single crystals. The crystals were characterized by x-ray powder diffraction of ground specimens and a structure refinement as well as electron diffraction. We report magnetic susceptibility, magnetization and specific heat studies of this multiferroic compound in both the hexagonal and the orthorhombic structure. The hexagonal DyMnO3 shows magnetic ordering of Mn3+ (S = 2) spins on a triangular Mn lattice at T-N(Mn) = 57 K characterized by a cusp in the specific heat. This transition is not apparent in the magnetic susceptibility due to the frustration on the Mn triangular lattice and the dominating paramagnetic susceptibility of the Dy3+ (S = 9/2) spins. At T-N(Dy) = 3 K, a partial antiferromagnetic order of Dy moments has been observed. In comparison, the magnetic data for orthorhombic DyMnO3 display three transitions. The data broadly agree with results from earlier neutron diffraction experiments, which allows for the following assignment: a transition from an incommensurate antiferromagnetic ordering of Mn3+ spins at T-N(Mn) = 39 K, a lock-in transition at Tlock-in = 16 K and a second antiferromagnetic transition at T-N(Dy) = 5 K due to the ordering of Dy moments. Both the hexagonal and the orthorhombic crystals show magnetic anisotropy and complex magnetic properties due to 4f-4f and 4f-3d couplings.

Activities in the $FeTiO_{3}-NiTiO_{3}$ Solid Solution from Alloy-Oxide Equilibria at 1273 K

Nine tie-lines between Fe-Ni alloys and FeTiO3-NiTiO3 solid solutions were determined at 1273 K. Samples were equilibrated in evacuated quartz ampoules for periods up to 10 days. Compositions of the alloy and oxide phases at equilibrium were determined by energy-dispersive x-ray spectroscopy. X-ray powder diffraction was used to confirm the results. Attainment of equilibrium was verified by the conventional tie-line rotation technique and by thermodynamic analysis of the results. The tie-lines are skewed toward the FeTiO3 corner. From the tie-line data and activities in the Fe-Ni alloy phase available in the literature, activities of FeTiO3 and NiTiO3 in the ilmenite solid solution were derived using the modified Gibbs-Duhem technique of Jacob and Jeffes [K.T. Jacob and J.H.E. Jeffes, An Improved Method for Calculating Activities from Distribution Equilibria, High Temp. High Press., 1972, 4, p 177-182]. The components of the oxide solid solution exhibit moderate positive deviations from Raoult's law. Within experimental error, excess Gibbs energy of mixing for the FeTiO3-NiTiO3 solid solution at 1273 K is a symmetric function of composition and can be represented as: Delta G(E) = 8590 (+/- 200) X-FeTiO3 X-NiTiO3 J/mol Full spectrum of tie-lines and oxygen potentials for the three-phase equilibrium involving Fe-Ni alloys, FeTiO3-NiTiO3 solid solutions, and TiO2 at 1273 K were computed using results obtained in this study and data available in the literature.

Self-Assembled Pd(II) Metallocycles Using an Ambidentate Donor and the Study of Square-Triangle Equilibria

The self-assembly reaction of a cis-blocked 90° square planar metal acceptor with a symmetrical linear flexible linker is expected to yield a [4 + 4] self-assembled square, a [3 + 3] assembled triangle, or a mixture of these.However, if the ligand is a nonsymmetrical ambidentate, it is expected to form a complex mixture comprising several linkage isomeric squares and triangles as a result of different connectivities of the ambidentate linker. We report instead that the reaction of a 90° acceptor cis-(dppf)Pd(OTf)2 [where dppf ) 1,1′-bis(diphenylphosphino)- ferrocene] with an equimolar amount of the ambidentate unsymmetrical ligand Na-isonicotinate unexpectedly yields a mixture of symmetrical triangles and squares in the solution. An analogous reaction using cis-(tmen)Pd(NO3)2 instead of cis-(dppf)Pd(OTf)2 also produced a mixture of symmetrical triangles and squares in the solution. In both cases the square was isolated as the sole product in the solid state, which was characterized by a single crystal structure analysis. The equilibrium between the triangle and the square in the solution is governed by the enthalpic and entropic contributions. The former parameter favors the formation of the square due to less strain in the structure whereas the latter one favors the formation of triangles due to the formation of more triangles from the same number of starting linkers. The effects of temperature and concentration on the equilibria have been studied by NMR techniques. This represents the first report on the study of square-triangle equilibria obtained using a nonsymmetric ambidentate linker. Detail NMR spectroscopy along with the ESI-mass spectrometry unambiguously identified the components in the mixture while the X-ray structure analysis determined the solid-state structure.

Phase transformations and metastable phase equilibria in Al-Ge alloy

In this paper the results of a detailed investigation on the metastable phase relations in undercooled as well as rapidly solidified Al---Ge alloys containing 2–50 at.% Ge are reported. Data obtained on the structure and morphology of phases enable us to arrive at the phase relations and transformation processes occurring in undercooled and rapidly quenched melts of this system. These results are explained with the help of a metastable phase diagram consisting of a peritectic and eutectic reaction involving metastable phases.

Spin-state equilibria in the LCoO3 system from 59Co NMR

Spin-state equilibria in the whole set of LCoO3 (where L stands for a rare-earth metal or Y) have been investigated with the use of 59Co NMR as a probe for the polycrystalline samples (except Ce) in the temperature interval 110-550 K and frequency range 3- 11.6 MHz. Besides confirming the coexistence of the high-spin—low-spin state in this temperature range, a quadrupolar interaction of ∼0.1 -0.5 MHz has been detected for the first time from 59Co NMR. The NMR line shape is found to depend strongly on the relative magnitude of the magnetic and quadrupolar interactions present. Analysis of the powder pattern reveals two basically different types of transferred hyperfine interaction between the lighter and heavier members of the rare-earth series. The first three members of the lighter rare-earth metals La, Pr (rhombohedral), and Nd (tetragonal), exhibit second-order quadrupolar interaction with a zero-asymmetry parameter at lower temperatures. Above a critical temperature TS (dependent on the size of the rare-earth ion), the quadrupolar interaction becomes temperature dependent and eventually gives rise to a first-order interaction thus indicating a possible second-order phase change. Sm and Eu (orthorhombic) exhibit also a second-order quadrupolar interaction with a nonzero asymmetry parameter ((η∼0.47)) at 300 K, while the orthorhombic second-half members (Dy,..., Lu and Y) exhibit first-order quadrupolar interaction at all temperatures. Normal paramagnetic behavior, i.e., a linear variation of Kiso with T-1, has been observed in the heavier rare-earth cobaltites (Er,..., Lu and Y), whereas an anomalous variation has been observed in (La,..., Nd)CoO3. Thus, Kiso increases with increasing temperature in PrCoO3 and NdCoO3. These observations corroborate the model of the spin-state equilibria in LCoO3 originally proposed by Raccah and Goodenough. A high-spin—low-spin ratio, r=1, can be stabilized in the perovskite structure by a cooperative displacement of the oxygen atoms from the high-spin towards the low-spin cation. Where this ordering into high- and low-spin sublattices occurs at r=1, one can anticipate equivalent displacement of all near-neighbor oxygen atoms towards a low-spin cobalt ion. Thus the heavier LCoO3 exhibits a small temperature-independent first-order quadrupolar interaction. Where r<1, the high- and low-spin states are disordered, giving rise to a temperature-dependent second-order quadrupolar interaction with an anomalous Kiso for the lighter LCoO3.

59Co NMR studies of the spin-state equilibria in rare-earth cobaltites

Hyperfine interaction parameters reveal differences in the nature of spin-state equilibria in the lighter and heavier rare-earth cobaltites; the crystal-field parameter is lower in the lighter cobaltites. Temperature variation of the quadrupolar coupling constant is also more marked in the lighter rare-earth cobaltites, with NdCoO3 showing evidence for a structural phase transition.

Hydrothermal phase equilibria in Ln2O3-H2O-CO2 systems : I. The lighter lanthanides

Phase diagrams for Nd2O3-H2O-CO2 and Gd2O3-H2O-CO2 systems at 1500 atm are given along with the results of selected runs in La, Sm and Eu systems. The stable phases in systems of La and Nd, are Ln(OH)CO3-B, Ln2O2CO3-II and LnOOH, in addition to the Ln(OH)3 phase at extremely low partial pressures of CO2 in the system. The systems become more and more complex with decreasing ionic radi and the number of stable carbonate phases increases. Ln2(CO3)3 · 3H2O orthorhombic (tengerate-like phase) is stable from Sm to Gd in addition to the other phases. The Gd(OH)CO3-A (ancylite-like phase) is hydrothermally stable at XCO2 greater-or-equal, slanted 0.5 while its hexagonal polymorph, Gd(OH)CO3-B is stable at low partial pressures of CO2 in the system.

Spinel-Corundum Phase Equilibria in the Systems Mn-Cr-Al-O and Co-Cr-Al-O at 1373 K

The tie lines delineating ion-exchange equilibria between MCr2O4-MAl2O4 spinel solid solution, where M is either Mn or Co, and Cr2O3-Al2O3 solid solution with the corundum structure were determined at 1373 K by electron microprobe and E0AX point count analysis of the oxide phases equilibrated with metallic Co and Au-5% Mn. The component activities in the spinel solid solutions are derived from the tie lines and the thernodynamic data for Cr2O3-Al2O3 soiid solutions available hi the literature. The Gibbs free energies of mixing calculated from the experimental data are discussed in relation to the values derived from the cation distribution a.odel based on the site preference energies and assuming random mixing on both tetrahedral and octahedral sites. Positive deviations from ideality observed in this study suggest a miscibility gap for both series of spinel solid solutions at low temperatures in the absence of oxidation.

Hydrothermal phase equilibria studies in Ln2O3---H2O systems and synthesis of cubic lanthanide oxides

Phase diagrams for the systems Ln2O3---H2O (Ln = La, Pr, Nd, Sm, Eu, Gd, Tb, Dy, Ho, Er, Tm, Lu and Y) studied at 5000 to 10,000 psi and temperature range of 200–900°C, show that Ln(OH)3 hexagonal and LnOOH monoclinic are the only stable phases from Nd to Ho. The cubic oxide phase (C---Ln2O3) is stable for systems of Er, Tm, Yb and Lu, with no evidence of its equilibrium in the systems of lighter lanthanides. Using strong acids, HNO3 and HCOOH, as mineralisers the cubic oxides could be stabilised from Eu down to Lu. Solid solution phases of CeO2---Y2O3 and Eu2O3---Y2O3 have also been synthesised with HNO3 as mineraliser, since these compounds have promising use as solid electrolyte and phosphor materials respectively.