Learning dynamic prices in multiseller electronic retail markets with price sensitive customers, stochastic demands, and inventory replenishments

In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers, and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers), and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not previously been applied. We consider two representative cases: 1) no information case, were none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and 2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents, or pricebots, which use RL-based pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new and promising way of setting dynamic prices in multiseller environments with stochastic demands, price sensitive customers, and inventory replenishments.

Foaming of slags under dynamic conditions

Slag foaming under dynamic conditions has been studied in laboratory scale to examine the influence of properties commonly used to describe the foaminess and foam stability of slags under steady-state conditions. Synthetically produced slags with compositions relevant to tool steel and stainless steel production were studied through X-ray equipment in measurements simulating the dynamic conditions found in real processes. It is found that the dynamic systems display a more complex behavior than systems Under steady state. Traditional theories for foaming do not seem to be valid for slag foaming under dynamic conditions. The foam displays a fluctuating behavior, which the presently available models are not able to take into account. The concept of a foaming index does not seem to be applicable, resulting in the need for alternative models.

The fluctuations in slag foam under dynamic conditions

In the present article, slag foaming phenomenon under dynamic conditions is critically analyzed on the basis of the results of high-temperature X-ray image analysis experiments. The results indicate that the mismatch between the gas generation rate and gas escape rate has a serious impact on the foam height. This mismatch is attributed to the chemical reaction rate, which has to be considered in modeling slag foaming under dynamic conditions. The results further imply that a critical ratio of bubble size/crucible size exists, where wall effects are likely to become prominent.

Interaction between the Z-type DNA duplex and 1,3-propanediamine:crystal structure of d(CACGTG)(2) at 1.2 angstrom resolution

The crystal structure of a hexamer duplex d(CACGTG)(2) has been determined and refined to an R-factor of 18.3% using X-ray data up to 1.2 angstrom resolution. The sequence crystallizes as a left-handed Z-form double helix with Watson-Crick base pairing. There is one hexamer duplex, a spermine molecule, 71 water molecules, and an unexpected diamine (Z-5, 1,3-propanediamine, C3H10N2)) in the asymmetric unit. This is the high-resolution non-disordered structure of a Z-DNA hexamer containing two AT base pairs in the interior of a duplex with no modifications such as bromination or methylation on cytosine bases. This structure does not possess multivalent cations such as cobalt hexaammine that are known to stabilize Z-DNA. The overall duplex structure and its crystal interactions are similar to those of the pure-spermine form of the d(CGCGCG)(2) structure. The spine of hydration in the minor groove is intact except in the vicinity of the T5A8 base pair. The binding of the Z-5 molecule in the minor grove of the d(CACGTG)(2) duplex appears to have a profound effect in conferring stability to a Z-DNA conformation via electrostatic complementarity and hydrogen bonding interactions. The successive base stacking geometry in d(CACGTG)(2) is similar to the corresponding steps in d(CG)(3). These results suggest that specific polyamines such as Z-5 could serve as powerful inducers of Z-type conformation in unmodified DNA sequences with AT base pairs. This structure provides a molecular basis for stabilizing AT base pairs incorporated into an alternating d(CG) sequence.

Photocytotoxic and anaerobic DNA cleavage activity of binuclear 3,3 '-dithiodipropionic acid cobalt(II) complexes having phenanthroline bases

Dicobalt(II) complexes [{(B)Co-11)(2)(mu-dtdp)(2)] (1-3) of 3,3'-dithiodipropionic acid (dtdp) and phenanthroline bases (B), viz. 1,10-phenanthroline (phen in 1), dipyrido[3,2-d:2',3'-f]quinoxaline (dpq in 2) and dipyrido13,2-a:2',3'-clphenazine (dppz in 3), have been prepared, characterized and their photo-induced anaerobic DNA cleavage activity studied. The elemental analysis and mass spectral data suggest binuclear formulation of the complexes. The redox inactive complexes have magnetically non-interacting dicobalt(II) core showing magnetic moment of similar to 3.9 p per cobalt(II) center. The complexes show good binding propensity to calf thymus DNA giving K-b values within 4.3 x 10(5)-4.0 x 10(6) M-1. Thermal melting and viscosity data predict DNA groove binding and/or partial intercalative nature of the complexes. The complexes show significant anaerobic DNA cleavage activity in green light under argon atmosphere possibly involving radical species generated from the disulfide moiety in a type-I pathway. The DNA cleavage reaction under aerobic medium in green light is found to involve hydroxyl radical species. The dppz complex 3 exhibits significant photocytotoxicity in HeLa cervical cancer cells with an IC50 value of 2.31 mu M in UV-A light of 365 nm, while it is essentially non-toxic in dark giving an IC50 value of >200 mu M. A significant reduction of the dark toxicity of the organic dppz base (IC50 = 8.3 mu M in dark) is observed on binding to the cobalt(II) center while essentially retaining its photocytotoxicity in UV-A light (IC50 = 0.4 mu M). (C) 2010 Elsevier Ltd. All rights reserved.

Ferrocene-Promoted Photoactivated DNA Cleavage and Anticancer Activity of Terpyridyl Copper(II) Phenanthroline Complexes

Ferrocene-appended copper(II) complexes [Cu( Fc-tpy)(B)](ClO4)(2) (1-3) and [Cu(Ph-tpy)(dppz)](ClO4)(2) (4) as control, where Fc-tpy is 4'-ferroceny1-2,2':6',2 ''-terpyridine, Ph-tpy is 4'-pheny1-2,2':6',2 ''-terpyridine, and B is a phenanthroline base, viz., 1,10-phenanthroline (phen, 1), dipyridoquinoxaline (dpq, 2), and dipyridophenazine (dppz, 3), were prepared and structurally characterized, and their DNA binding, photoactivated DNA cleavage activity, and cytotoxic properties were studied [Fe = (eta(5)-C5H4)Fe-11(eta(5)-C5H5)]. Complexes 1 and 3 as hexafluorophosphate salts were structurally characterized by X-ray crystallography. Molecular structures of [Cu(Fc-tpy)(phen)](PF6)(2) (1a) and [Cu(Fc-tpy)(dppz)](PF6)(2)center dot MeCN (3a center dot MeCN) show a distorted square-pyramidal geometry at copper(II), with the Fc-tpy ligand and the phenanthroline base showing respective tridentate and bidentate binding modes. The phenanthroline base exhibits axial-equatorial bonding, while the Fc-tpy ligand binds at the basal plane. The complexes showed quasi-reversible cyclic voltammetric responses near 0.45 and -0.3 V vs SCE in aqueous DMF-0.1 M KCl assignable to the Fc(+)-Fc and Cu(II) Cu(1) redox couples, respectively. The complexes bind to DNA, giving K-b values of 1.4 x 10(4) to 5.6 x 10(5) M-1 in the order 4 similar to 3 > 2 > 1. Thermal denaturation and viscometric titration data suggest groove and/or partial intercalative mode of DNA binding of the complexes. The complexes showed chemical nuclease activity in the presence of 3-mercaptopropionic acid (0.5 mM) or H2O2 (0.25 mM). Complexes 2-4 showed plasmid DNA cleavage activity in visible light, forming (OH)-O-center dot radicals. The Fc-tpy complex 3 showed better DNA photocleavage activity than its Ph-tpy analogue. The ferrocene moiety in the dppz complex 3 makes it more photocytotoxic than the Ph-tpy analogue 4 in HeLa cells.

Structure of uracil-DNA glycosylase from Mycobacterium tuberculosis: insights into interactions with ligands

Uracil N-glycosylase (Ung) is the most thoroughly studied of the group of uracil DNA-glycosylase (UDG) enzymes that catalyse the first step in the uracil excision-repair pathway. The overall structure of the enzyme from Mycobacterium tuberculosis is essentially the same as that of the enzyme from other sources. However, differences exist in the N- and C-terminal stretches and some catalytic loops. Comparison with appropriate structures indicate that the two-domain enzyme closes slightly when binding to DNA, while it opens slightly when binding to the proteinaceous inhibitor Ugi. The structural changes in the catalytic loops on complexation reflect the special features of their structure in the mycobacterial protein. A comparative analysis of available sequences of the enzyme from different sources indicates high conservation of amino-acid residues in the catalytic loops. The uracil-binding pocket in the structure is occupied by a citrate ion. The interactions of the citrate ion with the protein mimic those of uracil, in addition to providing insights into other possible interactions that inhibitors could be involved in.

Groove Binding Ligands for the Interaction with Parallel-Stranded ps-Duplex DNA and Triplex DNA

DNA adopts different conformations not only based on novel base pairs, but also with different chain polarities. Besides several duplex structures (A, B, Z, parallel stranded (ps)-DNA, etc.), DNA also forms higher-order structures like triplex, tetraplex, and i-motif. Each of these structures has its own biological significance. The ps-duplexes have been found to be resistant to certain nucleases and endonucleases. Molecules that promote triple-helix formation have significant potential. These investigations have many therapeutic advantages which may be useful in the regulation of the expression of genes responsible for certain diseases by locking either their transcription (antigene) or translation (antisense). Each DNA minor groove binding ligand (MGBL) interacts with DNA through helical minor groove recognition in a sequence-specific manner, and this interferes with several DNA-associated processes. Incidentally, these ligands interact with some non-B-DNA and with higher-order DNA structures including ps-DNA and triplexes. While the design and recognition of minor grooves of duplex DNA by specific MGBLs have been a topic of many reports, limited information is available on the binding behavior of MGBLs with nonduplex DNA. In this review, we summarize various attempts of the interaction of MGBLs with ps-DNA and DNA triplexes.

Binding of deoxyadenylate and deoxycytidylate antibodies to double-stranded DNA

Antibodies raised against deoxyadenylate and deoxycytidylate were found to react with double stranded DNA as assessed by highly sensitive avidin-biotin microELISA. The binding was specific as it was completely inhibited by the homologous hapten. The antibodies did not react with tRNA and rRNA. These antibodies were also shown to react with supercoiled and relaxed forms of pBR322 DNA as demonstrated by gel retardation assay. ssDNA, single-stranded DNA; dsDNA, double-stranded DNA; CT DNA, calf thymus DNA; AB microELISA, avidin-biotin microELISA; dpA, deoxyadenylate; dpC, deoxycytidylate; avidin-HRP, avidin-horseradish peroxidase

Communication: Evidence of dynamic heterogeneity in glassy polymer monolayers from interface microrheology measurements

We have developed a novel nanoparticle tracking based interface microrheology technique to perform in situ studies on confined complex fluids. To demonstrate the power of this technique, we show, for the first time, how in situ glass formation in polymers confined at air-water interface can be directly probed by monitoring variation of the mean square displacement of embedded nanoparticles as a function of surface density. We have further quantified the appearance of dynamic heterogeneity and hence vitrification in polymethyl methacrylate monolayers above a certain surface density, through the variation of non-Gaussian parameter of the probes. (C) 2010 American Institute of Physics. [doi:10.1063/1.3471584].

Uniparental DNA markers and forensic genetics in Finland

Over the years, a wide range of methods to verify identity have been developed. Molecular markers have been used for identification since the 1920s, commencing with blood types and culminating with the advent of DNA techniques in the 1980s. Identification is required by authorities in many occasions, e.g. in disputed paternity cases, identification of deceased, or crime investigation. To clarify maternal and paternal lineages, uniparental DNA markers in mtDNA and Y-chromosome can be utilized. These markers have several advantages: male specific Y-chromosome can be used to identify a male from a mixture of male and female cells, e.g. in rape cases. MtDNA is durable and has a high copy number, allowing analyses even from old or degraded samples. However, both markers are lineage-specific, not individualizing, and susceptible to genetic drift. Prior to the application of any DNA marker in forensic casework, it is of utmost importance to investigate its qualities and peculiarities in the target population. Earlier studies on the Finnish population have shown reduced variation in the Y-chromosome, but in mtDNA results have been ambiguous. The obtained results confirmed the low diversity in Y-chromosome in Finland. Detailed population analysis revealed large regional differences, and extremely reduced diversity especially in East Finland. Analysis of the qualities affecting Y-chromosomal short tandem repeat (Y-STR) variation and mutation frequencies, and search of new polymorphic markers resulted a set of Y-STRs with especially high diversity in Finland. Contrary to Y-chromosome, neither reduced diversity nor regional differences were found in mtDNA within Finland. In fact, mtDNA diversity was found similar to other European populations. The revealed peculiarities in the uniparental markers are a legacy of the Finnish population history. The obtained results challenge the traditional explanation which emphasizes relatively recent founder effects creating the observed east-west patterns. Uniparentally inherited markers, both mtDNA and Y-chromosome, are applicable for identification purposes in Finland. By adjusting the analysed Y marker set to meet the characteristics of Finnish population, Y-chromosomal diversity increases and the regional differentiation decreases, resulting increase in discrimination power and thus usefulness of Y-chromosomal analysis in forensic casework.

DNA Clasping by Mycobacterial HU: The C-Terminal Region of HupB Mediates Increased Specificity of DNA Binding

Background: HU a small, basic, histone like protein is a major component of the bacterial nucleoid. E. coli has two subunits of HU coded by hupA and hupB genes whereas Mycobacterium tuberculosis (Mtb) has only one subunit of HU coded by ORF Rv2986c (hupB gene). One noticeable feature regarding Mtb HupB, based on sequence alignment of HU orthologs from different bacteria, was that HupB(Mtb) bears at its C-terminal end, a highly basic extension and this prompted an examination of its role in Mtb HupB function. Methodology/Principal Findings: With this objective two clones of Mtb HupB were generated; one expressing full length HupB protein (HupB(Mtb)) and another which expresses only the N terminal region (first 95 amino acid) of hupB (HupB(MtbN)). Gel retardation assays revealed that HupBMtbN is almost like E. coli HU (heat stable nucleoid protein) in terms of its DNA binding, with a binding constant (K-d) for linear dsDNA greater than 1000 nM, a value comparable to that obtained for the HU alpha alpha and HU alpha beta forms. However CTR (C-terminal Region) of HupB(Mtb) imparts greater specificity in DNA binding. HupB(Mtb) protein binds more strongly to supercoiled plasmid DNA than to linear DNA, also this binding is very stable as it provides DNase I protection even up to 5 minutes. Similar results were obtained when the abilities of both proteins to mediate protection against DNA strand cleavage by hydroxyl radicals generated by the Fenton's reaction, were compared. It was also observed that both the proteins have DNA binding preference for A: T rich DNA which may occur at the regulatory regions of ORFs and the oriC region of Mtb. Conclusions/Significance: These data thus point that HupB(Mtb) may participate in chromosome organization in-vivo, it may also play a passive, possibly an architectural role.

Interaction of synthetic analogs of distamycin and netropsin with nucleic acids. Does curvature of ligand play a role in distamycin-DNA interactions?

Distamycin and netropsin, a class of minor groove binding nonintercalating agents, are characterized by their B-DNA and A-T basespecific interactions. To understand the CQI I ~OIT~ ~ I ~ ~aOnMd ~c hemical basis of the above specificities, the DNA-binding characteristics of a novel synthetic analogue of distamycin have been studied. The analogue, mPD derivative, has the requisite charged end groups and a number of potential hydrogen-bonding loci equal to those of distamycin. The difference in the backbone curvatures of the ligands, distamycin, the mPD derivative, and NSC 101327 (another structurally analogous compound),is a major difference between these ligands. UV and CD spectrosoopic studies reported here show the following salient features: The mPD derivative recognizes only B-DNA, to which it binds via the minor groove. On the other hand, unlike distamycin, it binds with comparable affinities to A-T and G-C base pairs in a natural DNA. These DNA-binding properties are compared with those reported earlier for distamycin and NSC 101327 [Zimmer, Ch., & Wahnert, U. (1986) Prog. Biophys. Mol. Biol. 47, 31-1121. The backbone structures of these three ligands were compared to show the progressive decrease in curvatures in the order distamycin, mPD derivative, and NSC 101327. The plausible significance of the backbone curvature vis-&vis the characteristic B-DNA and AT-specific binding of distamycin is discussed. To our knowledge, this is the first attempt (with a model synthetic analogue) to probe the possible influence of backbone curvature upon the specificity of interactions of the distamycin class of groove-binding ligands with DNA.