Paulina Terrazas

Highly complex and uncertain environments require experimentation and a different approach to evaluation.  This paper makes the case for a ‘formative evaluataion’ approach and explores the implications of following this approach for the skills, attitudes and values needed by those inovlved in the evaluation process. This article presents our approach to the evaluation of transformative … from Evaluating transformative innovation policy. Insights from two experimental policies

This blog is an edited extract from an article exploring TIPC experiences of implementing formative evaluation, highlighting the skills, attitudes and values required from evaluators to strengthen trust, participatory engagement and a learning mindset in experiments.    Between 2019 and 2021, TIPC worked with partners to develop a formative approach to the evaluation of Transformative … from Reflexive practice in Transformative Innovation Policy: Six lessons for action researchers

This in-depth article presents the TIPC approach to the evaluation of transformative innovation policies and practical experience of implementing this: in work on food policy with Sweden’s Innovation Agency (Vinnova), and in the ACT on NBS (Adaptive Cities through Nature Based Solutions) project. To be consistent with the principles and objectives of these policies, an … from Evaluating transformative innovation policy: Insights from two experimental policies

The MOTION self-assessment tool is an evaluation tool that can be used to assess the quality of transformative outcomes in a specific initiative. It is a test tool for use online in Miro, duplicated from the MOTION Handbook: Developing a Transformative Theory of Change. This tool can be used as part of the monitoring, evaluation … from MOTION self-assessment tool (for quality of transformative outcomes)

Presentation providing a practical and comprehensive overview of the methodology for formative evaluation with transformative outcomes, addressing the aims and purpose, the role of learning in sustainability transitions and evaluation, and second order learning, before walking through a six-step methodology. The authors introduce the steps that participants of a project, initiative or policy can take, … from Methodology for formative evaluation with transformative outcomes

This extract from the MOTION Handbook explains how transformative outcomes are a key ingredient in the transformative theory of change approach. It highlights how transformative outcomes reflect and make tangible the underlying ‘theory’ (the multi-level perspective), guiding us to think through the process of system transformation, and sets out how the 12 transformative outcomes help … from Transformative outcomes as a way to organise transformative portfolios

This is a short extract from the MOTION handbook, introducing the notion of formative evaluation, and how it was incorporated into the MOTION project through the theory of change approach, which was used as a focal point to incentivise learning and reflection among project partners. … from Formative evaluation as an opportunity and method for learning in a theory of change process

Experimentation for transformative change, while desirable, is far from a frequent characteristic within the policy arena. Institutional frameworks, policy funding and evaluation requirements are rarely fit for experimentation.  It is sometimes not obvious how to create and assess a space that allows for experiments, and how to reintegrate results from that space into other processes. … from Blog: Reflections on experimentation for transformative change

This is a test Miro tool duplicated from the MOTION Handbook: Developing a Transformative Theory of Change. It can be used to help us develop and/or revise a transformative system change strategy for a project, programme or organisation. This strategy can be applied within an initiative and accompany it throughout its lifecycle, serving as an … from MOTION Transformative Theory of Change tool

This extract from the MOTION handbook (pp. 48-51) presents the Theory of Change canvas tool and examples of applying the tool in two different projects.   … from Introduction to the Transformative Theory of Change (TToC) canvas tool and examples

This short extract from the MOTION handbook presents what a Theory of Change is and how this approach was used in the MOTION project.   … from What is a Theory of Change?

Public and private innovation organisations strive to contribute to tackling global challenges such as climate change and growing inequality. System change that drives a sustainability transformation has become a shared goal and innovation policy and actions play a key role in this process. However, transformations are long-term processes that require interventions at various levels and … from MOTION handbook

Short extract from Section 1 of the MOTION handbook, introducing the notion of transformative system change and the Multi-Level Perspective as a framework to understand it.   … from MOTION handbook extract: System change and the MLP

From May 2020 to February 2021, through two rounds of interviews and two online workshops, participants in this research project interacted and reflected about changes derived from the pandemic and their implications. These included the nature and extent of second-order learning: changes in beliefs, assumptions, and points of view relevant for transformation.   Can Covid-19 … from Introduction to Covid-19 and second-order learning for TIP

This research report explains how the Covid-19 pandemic may have led to second-order learning amongst the Transformative Innovation Policy Consortium (TIPC) community. The first component of the project was developed from May to August 2020 and built through a sample of 16 participants working as funders or practitioners from science, technology and innovation (STI) agencies … from SECOND-ORDER LEARNING FROM THE COVID-19 PANDEMIC: REPORT

Blog by Paulina Terrazas, introducing the methods, results and conclusions from the ‘Second-order learning in response to Covid-19’.    The possibility to learn from pandemics gives a different sense to the global crisis. As an example, Scholten, Huijskens, and Dörr (2020) explored how the SARS and A/H1N1 pandemics influenced organizational learning in the Canadian Institutes … from Case study: Covid-19 as an opportunity for transformative learning among innovation professionals?

  The MOTION project is a partnership between EIT Climate-KIC and Transformative Innovation Policy Consortium (TIPC) that aims to develop and test an innovative methodology to catalyse transformative change towards a low carbon economy and society. Through close collaboration with three associated policy experiment projects – ACT on NBS, SATURN and SuSMO – MOTION supports … from When Transformative Outcomes meet a theory of change: Making policy experiments more transformative with MOTION

This report by Sandra Boni and Paulina Terrazas introduces the methods and preliminary insights from research designed to trace ‘second-order learning’ effects stemming from the pandemic, understood as changes in beliefs, assumptions, points of view and behaviours relevant for transformation. The project, Second-Order Learning in Response to Covid-19′, seeks to understand the role of learning in … from SECOND-ORDER LEARNING FROM THE COVID-19 PANDEMIC: Preliminary insights