A case study on a design-informed developmental evaluation

Developmental evaluation (DE) is an evaluation approach that aims to support the development of an innovation (Patton, 1994, 2011). This aim is achieved through supporting clients’ information needs through evaluative inquiry as they work to develop and refine the innovation. While core concepts and principles are beginning to be articulated and refined, challenges remain as to how to focus a developmental evaluation beyond those knowledge frameworks most immediate to clients to support innovation development. Anchoring a DE in knowledge frameworks other than those of the clients might direct attention to issues not yet obvious to clients, but which might further the goal of supporting innovation development if attended to. Drawing concepts and practices from the field of design may be one avenue with which to inform developmental evaluation in achieving its aim. Through a case study methodology, this research seeks to understand the nuances of operationalizing the guiding principles of DE as well as to investigate the utility, feasibility, and consequences of integrating design concepts and practices into developmental evaluation (design-informed developmental evaluation, “DI-DE”). It does so by documenting the efforts of a design-informed developmental evaluator and a task force of educators and researchers in a Faculty of Education as they work to develop a graduate-level education program. A systematic review into those purposeful efforts made to introduce DI-DE thinking into task force deliberations, and an analysis into the responses and consequences of those efforts shed light on what it had meant to practice DI-DE. As a whole, this research on evaluation is intended to further contemporary thinking about the closely coupled relationship between program development and evaluation in complex and dynamic environments.

DIGITAL HISTORY: DESIGNING VIRTUAL ENVIRONMENTS THAT SUPPORT CRITICAL THINKING AND IDEA EXCHANGE, MOTIVATE AND ENGAGE USERS

In my thesis I argue for the use of system designs that: a) open access to a variety of users and allow for collaboration and idea exchange, while at the same time, b) are designed to motivate and engage users. To exemplify my proposed systems design, I created an interactive and open digital history project focused on Romanian culture and identity during Communism, from 1947, when the Communist Party took power by forcing the King to abdicate, until the revolution in 1989, which marked the end of Communism in Romania (Gilberg, 1990, Boia, 2014). In my project, I present the possibility to recreate Habermas’ notion of public sphere and “the unforced force of the better argument” (Habermas, 1989) and Dewey’s (2004) understanding of democracy as a mode of associated living imbued of the spirit of inquiry within contemporary digital history projects. Second, I outline system designs that motivate and engage users, by satisfying the basic psychological needs outlined in Ryan and Deci’s (2000) self-determination theory: autonomy, competence, and relatedness. Two more concepts are included to complete the proposed digital history project design: presence (Ryan, Rigby, & Przybylski, 2006) and learner hero (Rigby & Przybylski, 2009).