Pablo F. Mendez

Highly complex and uncertain environments require experimentation and a different approach to evaluation.  This paper makes the case for a ‘formative evaluataion’ approach and explores the implications of following this approach for the skills, attitudes and values needed by those inovlved in the evaluation process. This article presents our approach to the evaluation of transformative … from Evaluating transformative innovation policy. Insights from two experimental policies

This blog is an edited extract from an article exploring TIPC experiences of implementing formative evaluation, highlighting the skills, attitudes and values required from evaluators to strengthen trust, participatory engagement and a learning mindset in experiments.    Between 2019 and 2021, TIPC worked with partners to develop a formative approach to the evaluation of Transformative … from Reflexive practice in Transformative Innovation Policy: Six lessons for action researchers

This in-depth article presents the TIPC approach to the evaluation of transformative innovation policies and practical experience of implementing this: in work on food policy with Sweden’s Innovation Agency (Vinnova), and in the ACT on NBS (Adaptive Cities through Nature Based Solutions) project. To be consistent with the principles and objectives of these policies, an … from Evaluating transformative innovation policy: Insights from two experimental policies

The MOTION self-assessment tool is an evaluation tool that can be used to assess the quality of transformative outcomes in a specific initiative. It is a test tool for use online in Miro, duplicated from the MOTION Handbook: Developing a Transformative Theory of Change. This tool can be used as part of the monitoring, evaluation … from MOTION self-assessment tool (for quality of transformative outcomes)

Presentation providing a practical and comprehensive overview of the methodology for formative evaluation with transformative outcomes, addressing the aims and purpose, the role of learning in sustainability transitions and evaluation, and second order learning, before walking through a six-step methodology. The authors introduce the steps that participants of a project, initiative or policy can take, … from Methodology for formative evaluation with transformative outcomes

This extract from the MOTION Handbook explains how transformative outcomes are a key ingredient in the transformative theory of change approach. It highlights how transformative outcomes reflect and make tangible the underlying ‘theory’ (the multi-level perspective), guiding us to think through the process of system transformation, and sets out how the 12 transformative outcomes help … from Transformative outcomes as a way to organise transformative portfolios

This is a short extract from the MOTION handbook, introducing the notion of formative evaluation, and how it was incorporated into the MOTION project through the theory of change approach, which was used as a focal point to incentivise learning and reflection among project partners. … from Formative evaluation as an opportunity and method for learning in a theory of change process

This is a test Miro tool duplicated from the MOTION Handbook: Developing a Transformative Theory of Change. It can be used to help us develop and/or revise a transformative system change strategy for a project, programme or organisation. This strategy can be applied within an initiative and accompany it throughout its lifecycle, serving as an … from MOTION Transformative Theory of Change tool

Video on the process of building a Theory of Change for the MOTION project SusMo, explaining the main change pathways and transformative outcomes, presented by Dr Caetano Pennna, who was pert of the Climate-KIC MOTION project team and TIPC Research Fellow.     … from Sustainable Urban Shared Mobility (SuSMo) Theory of Change video

The graphical representation of the SATURN’s Theory of Change (MOTION project) explains the impact logic through connecting activities, outputs and transformative outcomes. … from SATURN Transformative Theory of Change

The graphical representation of the ‘Nature Based Solutions ’ (NBS) Theory of Change (MOTION project) explains the impact logic through connecting activities, outputs and transformative outcomes.      … from Nature Based Solutions Transformative Theory of Change

This extract from the MOTION handbook (pp. 48-51) presents the Theory of Change canvas tool and examples of applying the tool in two different projects.   … from Introduction to the Transformative Theory of Change (TToC) canvas tool and examples

This short extract from the MOTION handbook presents what a Theory of Change is and how this approach was used in the MOTION project.   … from What is a Theory of Change?

Public and private innovation organisations strive to contribute to tackling global challenges such as climate change and growing inequality. System change that drives a sustainability transformation has become a shared goal and innovation policy and actions play a key role in this process. However, transformations are long-term processes that require interventions at various levels and … from MOTION handbook

Short extract from Section 1 of the MOTION handbook, introducing the notion of transformative system change and the Multi-Level Perspective as a framework to understand it.   … from MOTION handbook extract: System change and the MLP

In December 2021, the MOTION project, a collaboration of TIPC and EIT Climate-KIC, came to an end. During its two years of working closely with partners from three EIT Climate-KIC projects – ACT on NBS, SATURN and SuSMo – MOTION supported capacity building and monitoring, evaluation and learning (MEL) activities to enhance their transformative potential. … from MONITORING, EVALUATION AND LEARNING FOR TRANSFORMATIVE CHANGE PROJECTS: LESSONS FROM MOTION’S COLLABORATION WITH SUSMO, SATURN AND ACT ON NBS

  The MOTION project is a partnership between EIT Climate-KIC and Transformative Innovation Policy Consortium (TIPC) that aims to develop and test an innovative methodology to catalyse transformative change towards a low carbon economy and society. Through close collaboration with three associated policy experiment projects – ACT on NBS, SATURN and SuSMO – MOTION supports … from When Transformative Outcomes meet a theory of change: Making policy experiments more transformative with MOTION