An investigation of two real time machine learning techniques that could enhance the adaptability of game AI agents

Developers strive to create innovative Artificial Intelligence (AI) behaviour in their games as a key selling point. Machine Learning is an area of AI that looks at how applications and agents can be programmed to learn their own behaviour without the need to manually design and implement each aspect of it. Machine learning methods have been utilised infrequently within games and are usually trained to learn offline before the game is released to the players. In order to investigate new ways AI could be applied innovatively to games it is wise to explore how machine learning methods could be utilised in real-time as the game is played, so as to allow AI agents to learn directly from the player or their environment. Two machine learning methods were implemented into a simple 2D Fighter test game to allow the agents to fully showcase their learned behaviour as the game is played. The methods chosen were: Q-Learning and an NGram based system. It was found that N-Grams and QLearning could significantly benefit game developers as they facilitate fast, realistic learning at run-time.

‘‘Model age-based” and ‘‘copy when uncertain” biases in children’s social learning of a novel task

Theoretical models of social learning predict that individuals can benefit from using strategies that specify when and whom to copy. Here the interaction of two social learning strategies, model age-based biased copying and copy when uncertain, was investigated. Uncertainty was created via a systematic manipulation of demonstration efficacy (completeness) and efficiency (causal relevance of some actions). The participants, 4- to 6-year-old children (N = 140), viewed both an adult model and a child model, each of whom used a different tool on a novel task. They did so in a complete condition, a near-complete condition, a partial demonstration condition, or a no-demonstration condition. Half of the demonstrations in each condition incorporated causally irrelevant actions by the models. Social transmission was assessed by first responses but also through children’s continued fidelity, the hallmark of social traditions. Results revealed a bias to copy the child model both on first response and in continued interactions. Demonstration efficacy and efficiency did not affect choice of model at first response but did influence solution exploration across trials, with demonstrations containing causally irrelevant actions decreasing exploration of alternative methods. These results imply that uncertain environments can result in canalized social learning from specific classes of mode

Do children copy an expert or a majority? Examining selective learning in instrumental and normative contexts

This study examined whether instrumental and normative learning contexts differentially influence 4- to 7-year-old children’s social learning strategies; specifically, their dispositions to copy an expert versus a majority consensus. Experiment 1 (N = 44) established that children copied a relatively competent “expert” individual over an incompetent individual in both kinds of learning context. In experiment 2 (N = 80) we then tested whether children would copy a competent individual versus a majority, in each of the two different learning contexts. Results showed that individual children differed in strategy, preferring with significant consistency across two different test trials to copy either the competent individual or the majority. This study is the first to show that children prefer to copy more competent individuals when shown competing methods of achieving an instrumental goal (Experiment 1) and provides new evidence that children, at least in our “individualist” culture, may consistently express either a competency or majority bias in learning both instrumental and normative information (Experiment 2). This effect was similar in the instrumental and normative learning contexts we applied.