Human cooperation in the simultaneous and the alternating Prisoner's Dilemma: Pavlov versus Generous Tit-for-Tat.

The iterated Prisoner's Dilemma has become the paradigm for the evolution of cooperation among egoists. Since Axelrod's classic computer tournaments and Nowak and Sigmund's extensive simulations of evolution, we know that natural selection can favor cooperative strategies in the Prisoner's Dilemma. According to recent developments of theory the last champion strategy of "win--stay, lose--shift" ("Pavlov") is the winner only if the players act simultaneously. In the more natural situation of players alternating the roles of donor and recipient a strategy of "Generous Tit-for-Tat" wins computer simulations of short-term memory strategies. We show here by experiments with humans that cooperation dominated in both the simultaneous and the alternating Prisoner's Dilemma. Subjects were consistent in their strategies: 30% adopted a Generous Tit-for-Tat-like strategy, whereas 70% used a Pavlovian strategy in both the alternating and the simultaneous game. As predicted for unconditional strategies, Pavlovian players appeared to be more successful in the simultaneous game whereas Generous Tit-for-Tat-like players achieved higher payoffs in the alternating game. However, the Pavlovian players were smarter than predicted: they suffered less from defectors and exploited cooperators more readily. Humans appear to cooperate either with a Generous Tit-for-Tat-like strategy or with a strategy that appreciates Pavlov's advantages but minimizes its handicaps.

Population dynamics, demographic stochasticity, and the evolution of cooperation

A basic evolutionary problem posed by the Iterated Prisoner’s Dilemma game is to understand when the paradigmatic cooperative strategy Tit-for-Tat can invade a population of pure defectors. Deterministically, this is impossible. We consider the role of demographic stochasticity by embedding the Iterated Prisoner’s Dilemma into a population dynamic framework. Tit-for-Tat can invade a population of defectors when their dynamics exhibit short episodes of high population densities with subsequent crashes and long low density periods with strong genetic drift. Such dynamics tend to have reddened power spectra and temporal distributions of population size that are asymmetric and skewed toward low densities. The results indicate that ecological dynamics are important for evolutionary shifts between adaptive peaks.

Working memory constrains human cooperation in the Prisoner’s Dilemma

Many problems in human society reflect the inability of selfish parties to cooperate. The “Iterated Prisoner’s Dilemma” has been used widely as a model for the evolution of cooperation in societies. Axelrod’s computer tournaments and the extensive simulations of evolution by Nowak and Sigmund and others have shown that natural selection can favor cooperative strategies in the Prisoner’s Dilemma. Rigorous empirical tests, however, lag behind the progress made by theorists. Clear predictions differ depending on the players’ capacity to remember previous rounds of the game. To test whether humans use the kind of cooperative strategies predicted, we asked students to play the iterated Prisoner’s Dilemma game either continuously or interrupted after each round by a secondary memory task (i.e., playing the game “Memory”) that constrained the students’ working-memory capacity. When playing without interruption, most students used “Pavlovian” strategies, as predicted, for greater memory capacity, and the rest used “generous tit-for-tat” strategies. The proportion of generous tit-for-tat strategies increased when games of Memory interfered with the subjects’ working memory, as predicted. Students who continued to use complex Pavlovian strategies were less successful in the Memory game, but more successful in the Prisoner’s Dilemma, which indicates a trade-off in memory capacity for the two tasks. Our results suggest that the set of strategies predicted by game theorists approximates human reality.

Types of evolutionary stability and the problem of cooperation.

The evolutionary stability of cooperation is a problem of fundamental importance for the biological and social sciences. Different claims have been made about this issue: whereas Axelrod and Hamilton's [Axelrod, R. & Hamilton, W. (1981) Science 211, 1390-1398] widely recognized conclusion is that cooperative rules such as "tit for tat" are evolutionarily stable strategies in the iterated prisoner's dilemma (IPD), Boyd and Lorberbaum [Boyd, R. & Lorberbaum, J. (1987) Nature (London) 327, 58-59] have claimed that no pure strategy is evolutionarily stable in this game. Here we explain why these claims are not contradictory by showing in what sense strategies in the IPD can and cannot be stable and by creating a conceptual framework that yields the type of evolutionary stability attainable in the IPD and in repeated games in general. Having established the relevant concept of stability, we report theorems on some basic properties of strategies that are stable in this sense. We first show that the IPD has "too many" such strategies, so that being stable does not discriminate among behavioral rules. Stable strategies differ, however, on a property that is crucial for their evolutionary survival--the size of the invasion they can resist. This property can be interpreted as a strategy's evolutionary robustness. Conditionally cooperative strategies such as tit for tat are the most robust. Cooperative behavior supported by these strategies is the most robust evolutionary equilibrium: the easiest to attain, and the hardest to disrupt.

HIV-1 Tat protein mimicry of chemokines

The HIV-1 Tat protein is a potent chemoattractant for monocytes. We observed that Tat shows conserved amino acids corresponding to critical sequences of the chemokines, a family of molecules known for their potent ability to attract monocytes. Synthetic Tat and a peptide (CysL24–51) encompassing the “chemokine-like” region of Tat induced a rapid and transient Ca2+ influx in monocytes and macrophages, analogous to β-chemokines. Both monocyte migration and Ca2+ mobilization were pertussis toxin sensitive and cholera toxin insensitive. Cross-desensitization studies indicated that Tat shares receptors with MCP-1, MCP-3, and eotaxin. Tat was able to displace binding of β-chemokines from the β-chemokine receptors CCR2 and CCR3, but not CCR1, CCR4, and CCR5. Direct receptor binding experiments with the CysL24–51 peptide confirmed binding to cells transfected with CCR2 and CCR3. HIV-1 Tat appears to mimic β-chemokine features, which may serve to locally recruit chemokine receptor-expressing monocytes/macrophages toward HIV producing cells and facilitate activation and infection.

HIV-1 Tat transactivator recruits p300 and CREB-binding protein histone acetyltransferases to the viral promoter

In cells infected with HIV type 1 (HIV-1), the integrated viral promoter is present in a chromatin-bound conformation and is transcriptionally silent in the absence of stimulation. The HIV-1 Tat protein binds to a stem-loop structure at the 5′ end of viral mRNA and relieves this inhibition by inducing a remodeling of the nucleosome arrangement downstream of the transcription-initiation site. Here we show that Tat performs this activity by recruiting to the viral long terminal repeat (LTR) the transcriptional coactivator p300 and the closely related CREB-binding protein (CBP), having histone acetyltransferase (HAT) activity. Tat associates with HAT activity in human nuclear extracts and binds to p300 and CBP both in vitro and in vivo. Integrity of the basic domain of Tat is essential for this interaction. By a quantitative chromatin immunoprecipitation assay we show that the delivery of recombinant Tat induces the association of p300 and CBP with the chromosomally integrated LTR promoter. Expression of human p300 in both human and rodent cells increases the levels of Tat transactivation of the integrated LTR. These results reinforce the evidence that p300 and CBP have a pivotal function at both cellular and viral promoters and demonstrate that they also can be recruited by an RNA-targeted activator. Additionally, these findings have important implications for the understanding of the mechanisms of HIV-1 latency and reactivation.

TAK, an HIV Tat-associated kinase, is a member of the cyclin-dependent family of protein kinases and is induced by activation of peripheral blood lymphocytes and differentiation of promonocytic cell lines

We have previously identified a cellular protein kinase activity termed TAK that specifically associates with the HIV types 1 and 2 Tat proteins. TAK hyperphosphorylates the carboxyl-terminal domain of the large subunit of RNA polymerase II in vitro in a manner believed to activate transcription [Herrmann, C. H. & Rice, A. P. (1995) J. Virol. 69, 1612–1620]. We show here that the catalytic subunit of TAK is a known human kinase previously named PITALRE, which is a member of the cyclin-dependent family of proteins. We also show that TAK activity is elevated upon activation of peripheral blood mononuclear cells and peripheral blood lymphocytes and upon differentiation of U1 and U937 promonocytic cell lines to macrophages. Therefore, in HIV-infected individuals TAK may be induced in T cells following activation and in macrophages following differentiation, thus contributing to high levels of viral transcription and the escape from latency of transcriptionally silent proviruses.

tRNAVal-heterodimeric maxizymes with high potential as geneinactivating agents: Simultaneous cleavage at two sites in HIV-1 tat mRNA in cultured cells

It has been demonstrated that shortened forms of (stem II-deleted) hammerhead ribozymes with low intrinsic activity form very active dimers with a common stem II (very active short ribozymes capable of forming dimers were designated maxizymes). Intracellular activities of heterodimeric maxizymes and conventional ribozymes, under the control of a human tRNAVal-promoter, were compared against the cleavage of HIV-1 tat mRNA. The pol III-driven maxizymes formed very active heterodimers, and they successfully cleaved HIV-1 tat mRNA in mammalian cells at two sites simultaneously. The cleaved fragments were identified directly by Northern blotting analysis. Despite the initial concerns that a complicated dimerization process and formation of inactive homodimers were involved in addition to the process of association with the target, the overall intracellular activities of tRNAVal-driven maxizymes were significantly higher in mammalian cells than those of two sets of independent, conventional hammerhead ribozymes that were targeted at the same two sites within HIV-1 tat mRNA. Because the tRNAVal-driven maxizymes tested to date have been more effective than tRNAVal-driven “standard” hammerhead ribozymes, the tRNAVal-driven heterodimeric maxizymes appear to have potential utility as gene-inactivating agents.

Induction of the Tat-binding protein 1 gene accompanies the disabling of oncogenic erbB receptor tyrosine kinases

Conversion of a malignant phenotype into a more normal one can be accomplished either by down-regulation of erbB family surface receptors or by creating inactive erbB heterodimers on the cell surface. In this report, we report the identification and cloning of differentially expressed genes from antibody-treated vs. untreated fibroblasts transformed by oncogenic p185neu. We repeatedly isolated a 325-bp cDNA fragment that, as determined by Northern analysis, was expressed at higher levels in anti-p185neu-treated tumor cells but not in cells expressing internalization defective p185neu receptors. This cDNA fragment was identical in amino acid sequence to the recently cloned mouse Tat binding protein-1 (mTBP1), which has 98.4% homology to the HIV tat-binding protein-1 (TBP1). TBP1 mRNA levels were found to be elevated on inhibition of the oncogenic phenotype of transformed cells expressing erbB family receptors. TBP1 overexpression diminished cell proliferation, reduced the ability of the parental cells to form colonies in vitro, and almost completely inhibited transforming efficiency in athymic mice when stably expressed in human tumor cells containing erbB family receptors. Collectively, these results suggest that the attenuation of erbB receptor signaling seems to be associated with activation/induction or recovery of a functional tumor suppressor-like gene, TBP1. Disabling erbB tyrosine kinases by antibodies or by trans-inhibition represents an initial step in triggering a TBP1 pathway.

Decreased ability of HIV-1 Tat protein-treated accessory cells to organize cellular clusters is associated with partial activation of T cells

It has been shown in several animal models that HIV infection of accessory cells (ACs) plays an important role in development of AIDS. Here, we report that ACs treated with HIV-1 Tat protein (Tat-ACs) have a decreased ability to organize cellular aggregates as compared with untreated ACs, resulting in incomplete activation of T cells in responses to anti-CD3 mAb or staphylococcal enterotoxin B stimulation. The T cells failed to up-regulate adhesion molecules CD11a and CD2 on the cell surface and had reduced proliferative responses, as determined by [3H]thymidine incorporation, but they obtained lymphoblast-like morphology and expressed early activation antigens on the cell surface such as Fas and CD69 and interleukin 2 receptor, at comparable levels as those T cells undergoing a maximal proliferation. These results suggest that the Tat-AC-induced defect occurs in the late, but not in the early, phases of T cell activation. Normal expression of cell surface Fas antigen accompanied by defects in late activation thus may result in the susceptibility of these T cells to apoptosis. Our studies suggest that dysfunction, hyperactivation, and susceptibility to apoptosis, as observed with T cells isolated from HIV-infected individuals, may be, at least in part, a consequence of abnormal functions of ACs.

The HIV-1 regulatory proteins Tat and Rev are frequently targeted by cytotoxic T lymphocytes derived from HIV-1-infected individuals

The HIV-1 regulatory proteins Rev and Tat are expressed early in the virus life cycle and thus may be important targets for the immune control of HIV-1-infection and for effective vaccines. However, the extent to which these proteins are targeted in natural HIV-1 infection as well as precise epitopes targeted by human cytotoxic T lymphocytes (CTL) remain to be defined. In the present study, 57 HIV-1-infected individuals were screened for responses against Tat and Rev by using overlapping peptides spanning the entire Tat and Rev proteins. CD8+ T cell responses against Tat and Rev were found in up to 19 and 37% of HIV-1-infected individuals, respectively, indicating that these regulatory proteins are important targets for HIV-1-specific CTL. Despite the small size of these proteins, multiple CTL epitopes were identified in each. These data indicate that Tat and Rev are frequently targeted by CTL in natural HIV-1 infection and may be important targets for HIV vaccines.

Activation of the JC virus Tat-responsive transcriptional control element by association of the Tat protein of human immunodeficiency virus 1 with cellular protein Purα

JC virus is activated to replicate in glial cells of many AIDS patients with neurological disorders. In human glial cells, the human immunodeficiency virus 1 (HIV-1) Tat protein activates the major late promoter of JC virus through a Tat-responsive DNA element, termed upTAR, which is a recognition site for cellular Purα, a sequence-specific single-stranded DNA binding protein implicated in cell cycle control of DNA replication and transcription. Tat interacts with two leucine-rich repeats in Purα to form a complex that can be immunoprecipitated from cell extracts. Tat enhances the ability of purified glutathione S-transferase-Purα (GST-Purα) to bind the upTAR element. Tat acts synergistically with Purα, in a cell-cycle-dependent manner, to activate transcription at an upTAR element placed upstream of a heterologous promoter. Since Purα is ubiquitously expressed in human cells and since PUR elements are located near many promoters and origins of replication, the Tat-Purα interaction may be implicated in effects of HIV-1 throughout the full range of HIV-1-infected cells.

TAT peptide on the surface of liposomes affords their efficient intracellular delivery even at low temperature and in the presence of metabolic inhibitors

To achieve an efficient intracellular drug and DNA delivery, attempts were made to target microparticulate drug carriers into cytoplasm bypassing the endocytotic pathway. TAT peptides derived from the HIV-1 TAT protein facilitate intracellular delivery of proteins and small colloidal particles. We demonstrated that relatively large drug carriers, such as 200-nm liposomes, can also be delivered into cells by TAT peptide attached to the liposome surface. Liposomes were fluorescently labeled with membranotropic rhodamine-phosphatidylethanolamine or by entrapping FITC-dextran. Incubation of fluorescent TAT liposomes with mouse Lewis lung carcinoma cells, human breast tumor BT20 cells, and rat cardiac myocyte H9C2 results in intracellular localization of certain liposomes. Steric hindrances for TAT peptide⋅cell interaction (attachment of TAT directly to the liposome surface without spacer or the presence of a high MW polyethylene glycol on the liposome surface) abolish liposome internalization, evidencing the importance of direct contact of TAT peptide with the cell surface. Low temperature or metabolic inhibitors, sodium azide or iodoacetamide, have little influence on the translocation of TAT liposomes into cells, confirming the energy-independent character of this process. The approach may have important implications for drug delivery directly into cell cytoplasm.

Trans-activation by human immunodeficiency virus Tat protein requires the C-terminal domain of RNA polymerase II.

Human immunodeficiency virus (HIV)-encoded trans-activator (Tat) acts through the trans-activation response element RNA stem-loop to increase greatly the processivity of RNA polymerase II. Without Tat, transcription originating from the HIV promoter is attenuated. In this study, we demonstrate that transcriptional activation by Tat in vivo and in vitro requires the C-terminal domain (CTD) of RNA polymerase II. In contrast, the CTD is not required for basal transcription and for the formation of short, attenuated transcripts. Thus, trans-activation by Tat resembles enhancer-dependent activation of transcription. These results suggest that effects of Tat on the processivity of RNA polymerase II require proteins that are associated with the CTD and may result in the phosphorylation of the CTD.