Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior, and in particular in behavioral decision making. Such decision making is likely to involve the integration of many synaptic events in space and time. However, using a single reinforcement signal to modulate synaptic plasticity, as suggested in classical reinforcement learning algorithms, a twofold problem arises. Different synapses will have contributed differently to the behavioral decision, and even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike-time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward, but also by a population feedback signal. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference (TD) based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task, the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second task involves an action sequence which is itself extended in time and reward is only delivered at the last action, as it is the case in any type of board-game. The third task is the inspection game that has been studied in neuroeconomics, where an inspector tries to prevent a worker from shirking. Applying our algorithm to this game yields a learning behavior which is consistent with behavioral data from humans and monkeys, revealing themselves properties of a mixed Nash equilibrium. The examples show that our neuronal implementation of reward based learning copes with delayed and stochastic reward delivery, and also with the learning of mixed strategies in two-opponent games.

Outline of a theory of efficient teams in Sport.

Introduction So far, social psychology in sport has preliminary focused on team cohesion, and many studies and meta-analyses tried to demonstrate a relation between cohesiveness of a team and its performance. How a team really co-operates and how the individual actions are integrated towards a team action is a question that has received relatively little attention in research. This may, at least in part, be due to a lack of a theoretical framework for collective actions, a dearth that has only recently begun to challenge sport psychologists. Objectives In this presentation a framework for a comprehensive theory of teams in sport is outlined and its potential to integrate research in the domain of team performance and, more specifically, the following presentations, is put up for discussion. Method Based on a model developed by von Cranach, Ochsenbein and Valach (1986), teams are considered to be information processing organisms, and team actions need to be investigated on two levels: the individual team member and the group as an entity. Elements to be considered are the task, the social structure, the information processing structure and the execution structure. Obviously, different task require different social structures, communication processes and co-ordination of individual movements. Especially in rapid interactive sports planning and execution of movements based on feedback loops are not possible. Deliberate planning may be a solution mainly for offensive actions, whereas defensive actions have to adjust to the opponent team's actions. Consequently, mental representations must be developed to allow a feed-forward regulation of team member's actions. Results and Conclusions Some preliminary findings based on this conceptual framework as well as further consequences for empirical investigations will be presented. References Cranach, M.v., Ochsenbein, G. & Valach, L. (1986). The group as a self-active system: Outline of a theory of group action. European Journal of Social Psychology, 16, 193-229.

Decision making in beach volleyball defense: Crucial factors derived from interviews with top-level experts

Objectives: In fast ball sports like beach volleyball, decision-making skills are a determining factor for excellent performance. The current investigation aimed to identify factors that influence the decisionmaking process in top-level beach volleyball defense in order to find relevant aspects for further research. For this reason, focused interviews with top players in international beach volleyball were conducted and analyzed with respect to decision-making characteristics. Design: Nineteen world-tour beach volleyball defense players, including seven Olympic or world champions, were interviewed, focusing on decision-making factors, gaze behavior, and interactions between the two. Methods: Verbal data were analyzed by inductive content analysis according to Mayring (2008). This approach allows categories to emerge from the interview material itself instead of forcing data into preset classifications and theoretical concepts. Results: The data analysis showed that, for top-level beach volleyball defense, decision making depends on opponent specifics, external context, situational context, opponent's movements, and intuition. Information on gaze patterns and visual cues revealed general tendencies indicating optimal gaze strategies that support excellent decision making. Furthermore, the analysis highlighted interactions between gaze behavior, visual information, and domain-specific knowledge. Conclusions: The present findings provide information on visual perception, domain-specific knowledge, and interactions between the two that are relevant for decision making in top-level beach volleyball defense. The results can be used to inform sports practice and to further untangle relevant mechanisms underlying decision making in complex game situations.

Perception of critical situations involving football fans: dynamics of conflict escalation and de-escalation

Title: The perception of critical situations involving football fans – how conflicts escalate or de-escalate Authors: Brechbühl, A.1, Schumacher, A.1 & Seiler, R.1 1Institute of Sport Science, University of Bern, Switzerland Abstract: Introduction: Fan violence in the context of football matches is a prominent issue in today’s western societies and Switzerland presents no exception. A lot of research has been conducted on reasons for fan violence, mostly with fans of national teams. A prominent model is the Elaborated Social Identity Model (ESIM; Drury & Reicher, 2000): ESIM highlights the importance of interactions between the involved groups and their effect on the development of social identities. Another model is the aggravation mitigation model (AM model; Hylander & Guvå, 2010) which illustrates factors that can contribute towards an escalation or non-escalation of group violence, such as the “categorization” of the opponent group. Despite these models, research about the individual perceptions, and in particular, what factors distinguish between an escalation versus a non-escalation of a potentially violent situation in domestic football, is as yet scarce. This explorative study examines perceptions of critical situations in the domestic football fan context in Switzerland. Methods: An explorative qualitative design was employed to gather data about critical situations (CS) around football matches of two clubs of the Raiffeisen Super League. A CS is defined as a setting in or around the football stadium where violence between football fans and another group could occur. Eight CS were identified and analysed. Fifty-nine narrative interviews with individuals involved in a CS, e.g. fans, police officers or security personnel, were conducted. Interviews were analysed using interpretative phenomenological analysis (IPA). Results: The involved opposing groups expressed group-specific perceptions. Furthermore a strong tendency to negatively stereotype the opponent group was observed. Provocative symbols, such as balaclavas or riot-gear uniforms, were considered as highly relevant for the interpretation of the situation. Successful communication and sufficient distance between opponent groups supported the appeasement of a CS. These findings also underline the importance of knowledge about the local fan culture. This culture serves as basis for the perception of legitimacy, which was assessed to be essential for a de-escalation of a CS by fans. Discussion/Conclusion: This study improves the understanding of fan violence in the domestic football context in Switzerland. Based on the results it is suggested to deploy security or police forces without riot gear but with the goal of seeking dialogue with the fans to increase the likelihood of a peaceful ending in a CS. The findings also support the applicability of the ESIM (Drury & Reicher, 2000) and the AM model (Hylander & Guvå, 2010) in the context of domestic fan violence. Due to possible differences in the local fan cultures in Switzerland, research in this area should be continued. References: Drury, J., & Reicher, S. (2000). Collective action and psychological change: The emergence of new social identities. British Journal of Social Psychology, 39, 579-604. Hylander, I., & Guvå, G. (2010). Misunderstanding of out-group behaviour: Different interpretations of the same crowd events among police officers and demonstrators. Nordic Psychology, 62, 25-47.

Trust, Competition and Cooperation in Autism Spectrum Disorder

Objective: Impaired social interactions and repetitive behavior are key features of autism spectrum disorder (ASD). In the present study we compared social decision-making in subjects with and without ASD. Subjects performed five social decision-making games in order to assess trust, fairness, cooperation & competition behavior and social value orientation. Methods: 19 adults with autism spectrum disorder and 17 controls, matched for age and education, participated in the study. Each subject performed five social decision-making tasks. In the trust game, subjects could maximize their gain by sharing some of their money with another person. In the punishment game, subjects played two versions of the Dictator’s Dilemma. In the dictator condition they could share an amount of 0-100 points with another person. In the punishment condition, the opponent was able to punish the subject if he/she was not satisfied with the amount of points received. In the cooperation game, subjects played with a small group of 3 people. Each of them could (anonymously) select an amount of 5, 7.5 or 10 Swiss francs. The goal of the game was to achieve a high group minimum. In the competition game, subjects performed a dexterity task. Before performing the task, they were asked whether they wanted to compete (winner takes it all) or cooperation (sharing the joint achieved amount of points) with a randomly selected person. Lastly, subjects performed a social value orientation task where they were playing for themselves and for another person. Results: There was no overall difference between healthy controls an ASD subjects in investment in the trust game. However, healthy controls increased their investment over number of trials whereas ASD subjects did not. A similar pattern was found for the punishment game. Furthermore, ASD subjects revealed a decreased investment in the dictator condition of the punishment game. There were no mean differences in competition behavior and social value orientation. Conclusions: The results provide evidence for differences between ASD subjects and healthy controls in social decision-making. Subjects with ASD showed a more consistent behavior than healthy controls in the trust game and the dictator dilemma. The present findings provide evidence for impaired social learning in ASD.

Perceptions of critical situations involving football fans: the dynamics of conflict escalation or de-escalation

Fan violence in the context of football matches has drawn the attention of stakeholders and the media. This phenomenon has also attracted the scientific community’s attention, where research mostly focused on reasons for violence escalation. The Elaborated Social Identity Model (ESIM; Drury & Reicher, 2000) for example focuses on group-interactions and social identities, while the Aggravation Mitigation Model (AM model; Hylander & Guvå, 2010) concentrates on factors contributing to an escalation or a non-escalation of group-violence. However individual perceptions of the different persons involved in potential conflicts have not been sufficiently examined. Beside of that research in domestic football or involving ultrafans is scarce. Especially in Switzerland, there is a lack of research concerning the dynamics of the development or non-development of fan violence. This exploratory study included eight critical situations from the season 2012/2013 of the Swiss premier league to gather data about the perceptions of various persons involved (fans, police officers or security) and the dynamics contributing towards escalation or de-escalation. Fifty-nine narrative interviews were conducted and analysed with interpretative phenomenological analysis (Smith, Flowers, & Larkin, 2009). The individuals involved (fans, police and security personnel) showed groupspecific perceptions and a tendency to stereotype the opponent group. Provocative symbols (balaclavas or riot-gear uniforms) were important for the interpretation of the situation. No escalation occurred when successful communication and sufficient distance between the groups was established. Knowledge about the local fan culture is important, because it influences the perception of legitimacy on the side of the fans. This study improves the understanding of fan violence and is congruent with the ESIM and the AM model. It is suggested to deploy police dialogue teams without riot gear. Their task is to establish direct communication with the fans to facilitate a peaceful ending of a critical situation.

Qualitative Distinction of Autotrophic and Heterotrophic Processes at the Leaf Level by Means of Triple Stable Isotope (C–O–H) Patterns

Foliar samples were harvested from two oaks, a beech, and a yew at the same site in order to trace the development of the leaves over an entire vegetation season. Cellulose yield and stable isotopic compositions (δ13C, δ18O, and δD) were analyzed on leaf cellulose. All parameters unequivocally define a juvenile and a mature period in the foliar expansion of each species. The accompanying shifts of the δ13C-values are in agreement with the transition from remobilized carbohydrates (juvenile period), to current photosynthates (mature phase). While the opponent seasonal trends of δ18O of blade and vein cellulose are in perfect agreement with the state-of-art mechanistic understanding, the lack of this discrepancy for δD, documented for the first time, is unexpected. For example, the offset range of 18 permil (oak veins) to 57 permil (oak blades) in δD may represent a process driven shift from autotrophic to heterotrophic processes. The shared pattern between blade and vein found for both oak and beech suggests an overwhelming metabolic isotope effect on δD that might be accompanied by proton transfer linked to the Calvin-cycle. These results provide strong evidence that hydrogen and oxygen are under different biochemical controls even at the leaf level.