Learning dynamic prices in multiseller electronic retail markets with price sensitive customers, stochastic demands, and inventory replenishments

In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers, and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers), and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not previously been applied. We consider two representative cases: 1) no information case, were none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and 2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents, or pricebots, which use RL-based pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new and promising way of setting dynamic prices in multiseller environments with stochastic demands, price sensitive customers, and inventory replenishments.

Phenylboronic acids in crystal engineering: Utility of the energetically unfavorable syn,syn-conformation in co-crystal design

Phenylboronic acids can exist, in principle, in three different conformers (syn,syn; syn,anti and anti,anti) with distinct energy profiles. In their native state, these compounds prefer the energetically favored syn, anti-conformation. In molecular complexes, however, the functionality exhibits conformational diversity. In this paper we report a series of co-crystals, with N-donor compounds, prepared by a design strategy involving the synthons based on the syn, syn-conformation of the boronic acid functionality. For this purpose, we employed compounds with the 1,2-diazo fragment (alprazolam, 1H-tetrazole, acetazolamide and benzotriazole), 1,10-phenanthroline and 2,2'-bipyridine for the co-crystallization experiments. However, our study shows that the mere presence of the 1,2-diazo fragment in the coformer does not guarantee the successful formation of co-crystals with a syn, syn-conformation of the boronic acid. [GRAPHICS] The -B(OH)(2) fragment makes unsymmetrical O-H center dot center dot center dot N heterosynthons with alprazolam (ALP) and 1,10-phenanthroline (PHEN). In the co-crystals of phenylboronic acids with 1H-tetrazole (TETR) and 2,2'-bipyridine (BPY), the symmetrical boronic acid dimer is the major synthon. In the BPY complex, boronic acid forms linear chains and the pyridine compound interacts with the lateral OH of boronic acid dimers that acts as a connector, thus forming a ladder structure. In the TETR complex, each heterocycle interacts with three boronic acids. While two boronic acids interact using the phenolic group, the third molecule generates O-H center dot center dot center dot N hydrogen bonds using the extra OH group, of -B(OH)(2) fragment, left after the dimer formation. Thus, although molecules were selected retrosynthetically with the 1,2-diazo fragment or with nearby hetero-atoms to induce co-crystal formation using the syn,syn-orientation of the -B(OH)(2) functionality, co-crystal formation is in fact selective and is probably driven by energy factors. Acetazolamide (ACET) contains self-complementary functional groups and hence creates stable homosynthons. Phenylboronic acids being weak competitors fail to perturb the homosynthons and hence the components crystallize separately. Therefore, besides the availability of possible hydrogen bond acceptors in the required position and orientation, the ability of the phenyl-boronic acid to perturb the existing interactions is also a prerequisite to form co-crystals. This is illustrated in the table below. In the case of ALP, PHEN and BPY, the native structures are stabilized by weak interactions and may be influenced by the boronic acid fragment. Thus phenylboronic acids can attain co-crystals with those compounds, wherein the cyclic O-H center dot center dot center dot N hydrogen bonds are stronger than the individual homo-interactions. This can lower the lattice energy of the molecular complex as compared with the individual crystals. [GRAPHICS] Phenylboronic acids show some selectivity in the formation of co-crystals with N-heterocycles. The differences in solubility of the components fall short to provide a possible reason for the selective formation of co-crystals only with certain compounds. These compounds, being weak acids, do not follow the Delta pK(a) analysis and hence fail to provide any conclusive observation. Theoretical results show that of the three conformers possible, the syn,anti conformer is the most stable. The relative stabilities of the three conformers syn,anti,syn,syn and anti,anti are 0.0, 2.18 and 3.14 kcal/mol, respectively. The theoretical calculations corroborate the fact that only energetically favorable synthons can induce the formation of heterosynthons, as in ALP and PHEN complexes. From a theoretical and structural analysis it is seen that phenylboronic acids will form interactions with those molecules wherein the heterocyclic and acidic fragments can interrupt the homosynthons. However, the energy profile is shallow and can be perturbed easily by the presence of competing functional groups (such as OH and COOH) in the vicinity. [GRAPHICS] .

Moving to stay in place: behavioral mechanisms for coexistence of African large carnivores

Most ecosystems have multiple predator species that not only compete for shared prey, but also pose direct threats to each other. These intraguild interactions are key drivers of carnivore community structure, with ecosystem-wide cascading effects. Yet, behavioral mechanisms for coexistence of multiple carnivore species remain poorly understood. The challenges of studying large, free-ranging carnivores have resulted in mainly coarse-scale examination of behavioral strategies without information about all interacting competitors. We overcame some of these challenges by examining the concurrent fine-scale movement decisions of almost all individuals of four large mammalian carnivore species in a closed terrestrial system. We found that the intensity of intraguild interactions did not follow a simple hierarchical allometric pattern, because spatial and behavioral tactics of subordinate species changed with threat and resource levels across seasons. Lions (Panthera leo) were generally unrestricted and anchored themselves in areas rich in not only their principal prey, but also, during periods of resource limitation (dry season), rich in the main prey for other carnivores. Because of this, the greatest cost (potential intraguild predation) for subordinate carnivores was spatially coupled with the highest potential benefit of resource acquisition (prey-rich areas), especially in the dry season. Leopard (P. pardus) and cheetah (Acinonyx jubatus) overlapped with the home range of lions but minimized their risk using fine-scaled avoidance behaviors and restricted resource acquisition tactics. The cost of intraguild competition was most apparent for cheetahs, especially during the wet season, as areas with energetically rewarding large prey (wildebeest) were avoided when they overlapped highly with the activity areas of lions. Contrary to expectation, the smallest species (African wild dog, Lycaon pictus) did not avoid only lions, but also used multiple tactics to minimize encountering all other competitors. Intraguild competition thus forced wild dogs into areas with the lowest resource availability year round. Coexistence of multiple carnivore species has typically been explained by dietary niche separation, but our multi-scaled movement results suggest that differences in resource acquisition may instead be a consequence of avoiding intraguild competition. We generate a more realistic representation of hierarchical behavioral interactions that may ultimately drive spatially explicit trophic structures of multi-predator communities.