INFO2009 Framework for Critical Friends Interaction

Guidance document detailing the suggested process for the critical friend team interaction

WAIS Seminar:Evaluating the Cognitive Side of Information Interaction

Abstract In this talk, I'll focus on the work we've been doing on evaluating the cognitive side of dealing with information resources and increasingly complex user interfaces. While we can build increasingly powerful user interfaces, they often come at the cost of simple design and ease of use. I'll describe two specific studies: 1) work on the ORCHID project focused on measuring mental workload during tasks using fNIRS (a blood-oxygen-based brain scanner), and 2) a evaluation metric for measuring how much people learn during tasks. Together these provide advances towards understanding the cognitive side of information interaction, in working towards building better tools for users.

Can you tell if they're learning?

The proliferation of Web-based learning objects makes finding and evaluating online resources problematic. While established Learning Analytics methods use Web interaction to evaluate learner engagement, there is uncertainty regarding the appropriateness of these measures. In this paper we propose a method for evaluating pedagogical activity in Web-based comments using a pedagogical framework, and present a preliminary study that assigns a Pedagogical Value (PV) to comments. This has value as it categorises discussion in terms of pedagogical activity rather than Web interaction. Results show that PV is distinct from typical interactional measures; there are negative or insignificant correlations with established Learning Analytics methods, but strong correlations with relevant linguistic indicators of learning, suggesting that the use of pedagogical frameworks may produce more accurate indicators than interaction analysis, and that linguistic rather than interaction analysis has the potential to automatically identify learning behaviour.