Pando - Root Change (Root Change, 2020)
Pando is a platform that gives organizations a way to visualize, learn from, and engage with the social systems in which they work. We have designed Pando to help users build trust, strengthen relationships, and work together to achieve greater social impact. Grounded in social network analysis, Pando allows users to collect and visualize organizations and their relationships in real-time on simple and easy-to-use relationship maps. Relationship maps are managed by map administrators. These are actors interested in learning about a particular system and making the tool available to those working in the system. Pando is integrated with Keystone Accountability’s Feedback Commons, an online tool that allows map administrators to collect and analyze qualitative feedback about levels of trust and relationship quality among map participants. Key features of Pando include relationship mapping, feedback surveys, and dashboards.

Special Issue: Causal Mechanisms in Program Evaluation - Schmidt, Johannes (New Directions for Evaluation, 2020)

The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill? - Schmitt, Johannes (New Directions for Evaluation, 2020)
Despite increased discussions in the community and a common understanding about the virtue of mechanism-based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two-way classification of causal mechanisms along which the chapters to this issue are structured. The chapter continues by introducing the Causal Mechanism Claim and elaborates on how analyzing causal mechanisms is expected to increase policy relevance and causal capacity in evaluations. Drawing on this issue's rich corpus of firsthand practical experience, this introduction synthesizes key lessons that support or contradict the Causal Mechanism Claim. We find that both parts of the claim—increased policy relevance and strengthened causal capacity—are supported by the authors' experiences as bundled in this issue. However, we also identify challenges related to cross-cutting issues such as communication and practical applicability and point to the importance of method integration.

System Innovation Network - Si Network (Si Network, 2020)
The Si Network is an online platform for building the developing of systems innovation - connecting people around the world to learn and apply the ideas and methods of systems innovation towards addressing complex challenges and building better systems that work for all. Not sure what systems innovation is? Systems innovation is a new approach to innovation that tries to tackle complex social and environmental challenges through the use of more holistic & innovation driven approaches. It is a kind of innovation that aims to change the underlying structure of a system, thus potentially enabling a more transformational kind of change - systems change - rather than incremental "innovation as usual". What Do You Do? We are building an ecosystem of individuals and organizations co-learning and co-creating systems innovation across geographies and sectors. This ecosystem is enabled by our online platform which provides educational content, toolkits, organizes events and projects as well as provides various support services for organizations. Purpose Statement Our purpose is to build the world’s capacity for systems innovation - so as to better understand and address complex challenges and co-create a world where systems work for all. We envision a world where everyone thinks in systems and has an understanding of complex systems. From this understanding, we are able to design and develop regenerative systems that work for everyone. Our mission is to grow the field of systems innovation as a pathway to co-learn the ideas of systems thinking and apply them to co-creating new systems Who's Involved? We are a networked organization of some 17K+ members forming part of 20+ hubs in major cities around the world. Our community is broad and diverse in areas of work and interest from designers, innovators, and entrepreneurs, to researchers and management but they all share a common interest in learning and applying systems thinking ideas. The Si platform is developed and managed by a small core team based in London UK. We are registered as a business but operate as a social enterprise focused on our purpose of advancing the area of systems innovation in theory and practice. Core Value Creativity - We put creativity at the centre of what we do. Holding a space for curiosity, diversity of views, exploration and critical thinking as a pathway to transformative innovation. Openness - We strongly believe in openness in our ways of being, thinking and organizing as a sustainable pathway to creating an adaptive, scalable and dynamic community. Growth Mindset - We embrace challenges as opportunities for continuous personal and collective learning and development, with a never-ending potential to grow and start with a new beginning. Perseverance - When facing uncertainty and failure, perseverance is what is needed to maintain commitment and a resilient pathway aligned with our purpose. Care - Care is one of our core principles. We foster relationships based on honesty and empathy, striving to be present and conscious in what we do and taking responsibility for the effects of our actions.

Learning and Accountability - Simister, Nigel; Scholz, Vera (INTRAC, 2020)
Most people agree that monitoring and evaluation (M&E) should be used for both learning and accountability. However, there is no consensus about which one is more important. The debate matters as there is sometimes tension between the two purposes. In the past there has often been a disconnect between M&E and learning. Many M&E systems are primarily designed to enable accountability to donors.

Chaos Report 2020 - Standish Group (Standish Group, 2020)

Guide for Adopting Remote Monitoring Approaches During COVID-19 - USAID (USAID, 2020)
USAID maintains staff and operations in more than 80 countries around the world, all of which the COVID-19 pandemic will disrupt. USAID remains committed to protecting the health and safety of our staff, while continuing appropriate oversight of our programs and ensuring the accountable and effective use of U.S. taxpayer funds. In the current operating environment, USAID and implementing partners face new challenges in implementing activities, monitoring progress, collecting data, and tracking indicators. As we adapt our approaches, we will work with implementing partners to find innovative, responsible, and safe ways to monitor and evaluate programming. Digital tools can support novel approaches to remote monitoring. Responsible use of digital tools also supports operating unit alignment with the Digital Data Collection mandate in the Agency’s new Digital Strategy. This guide provides information for Agency staff and implementing partners on remote monitoring techniques and when they can be employed. We encourage use of this guide to identify and pursue appropriate remote-monitoring approaches for your needs. CORs/AORs and Activity Managers should work with implementing partners to document updated approaches in each agreement’s plans for monitoring, evaluation, and learning (MEL), and should upload these amended Activity MEL Plans into the Agency Secure Image and Storage Tracking System (ASIST) as soon as possible. This can be done in collaboration with Mission and Washington Bureau M&E Specialists, as appropriate

Evaluation of International Development Interventions: An Overview of Approaches and Methods - Vaessen, Jos; Lemire, Sebastian; Befani, Barbara (World Bank, 2020)
This guide provides an introductory overview of a range of methods that have been selected for their actual and potential use in the field of international development evaluation. For each method, a detailed guidance note presents the method’s main features and procedural steps, key advantages and disadvantages, as well as its applicability. Each guidance note includes references for relevant background readings (basic and advanced) as well as references to other additional resources of interest. Both the choice of approaches and methods and the associated guidance are by no means definitive. IEG plans to periodically update the guide as evaluation practices evolve.

Applying Rigorous Impact Evaluation in GIZ Governance Programmes: Results of a GIZ Initiative on Impacts in Governance - von Schiller, Armin (GIZ GmbH, 2020)
Pressure is mounting on international development cooperation agencies to prove the impact of their work. Private and public commissioners as well as the general public are increasingly asking for robust evidence of impact. In this context, rigorous impact evaluation (RIE) methods are increasingly receiving attention within the broader German development system and in GIZ. Compared to other implementing agencies such as DFID or USAid, the Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) GmbH has so far relatively little experience in systematically applying rigorous methods of impact evaluation. This is particularly true in the governance sector. In order to gain more experience and to understand which methods and formats are best suited for GIZ governance programmes, the Governance and Conflict division and the Africa department launched the ‘Impact Initiative Africa’ in 2016, a cooperative effort with several programmes in Africa. The Initiative set out to apply the experiences from GIZ governance programmes to design and conduct RIEs, and to use the results to steer programme implementation. Initially, the Initiative included three countries: Benin (Programme for Decentralisation and Local Development), Malawi (Support to Public Financial and Economic Management) and Mozambique (Good Financial Governance in Mozambique). During its implementation, the Initiative also benefitted from the experience of two additional governance programmes which had already undertaken RIEs, namely Peru (Citizen-oriented State Reform Programme) and Pakistan (Support to Local Governance Programme II). This report summarizes the insights gained from these experiences and discusses opportunities and limitations regarding the use and usability of RIEs in GIZ governance programmes as well as proposals on how to organise RIEs to maximise learning potential and benefits for the specific programmes and the GIZ Governance sector at large.

Rigorous Impact Evaluation in GIZ Governance Programmes - von Schiller, Armin (How-To-Note, 2020)
Why should I integrate an impact assessment in my programme? How will the programme benefit from it? Are the benefits worth the effort and expenses? How do I design and implement it in detail? Who is addressable for support? What should I pay attention to in order to get the most out of it? This note is meant to answer these questions. It addresses leaders and project staff of governance programmes who are interested in using this tool within their specific governance programme or project. This note provides a guideline and good practice recommendations on how to design and conduct an impact assessment and on how to fully utilise the benefits of the results for the programme and for communication with commissioners, partners and other donors. Additionally, this note will point to indirect benefits that can arise and that should not be ignored. Results of impact assessments are highly relevant for the GIZ as an institution. However, in this note we stress the benefits for the programme or project itself. In particular this note addresses the following aspects: • What are rigorous impact assessments and why should GIZ Governance programmes conduct them more often within their programmes? • Which phases does an impact assessment include? How do I set one up and which aspects deserve special attention in each phase to maximise the benefits for my programme? • What are the benefits I can expect from implementing and impact assessment? • Whom to ask at headquarters in case I need support? This note complements the policy brief “Strategic use of Rigorous Impact Evaluation” and the corporate strategic review on “Rigorous Impact Evaluation” written by the GIZ evaluation unit which focuses on the strategic use of rigorous impact evaluations (RIE) at GIZ. Based on the review findings, the policy brief presents recommendations for strategic planning and implementation of purpose-sensitive RIE using a number of key levers. By adopting central coordination and needs-based support mechanisms, the evaluation unit intends to promote the strategic use of RIE for evidence-based learning and decision-making within the organisation.

Habits of a system thinker - WCST (Waters Center For Systems Thinking, 2020)
From the Waters Center For Systems Thinking. See: https://thinkingtoolsstudio.waterscenterst.org/courses/habits https://thinkingtoolsstudio.waterscenterst.org/cards

USAID Wildlife Asia as a case study in adaptive rigour - Ziegler, Jessica (Briefing Paper, 2020)
This briefing note looks at how the United States Agency for International Development (USAID) Wildlife Asia programme has operationalised the concepts of adaptive rigour and adaptive management as part of its approach to collaborating, learning and adapting. As described by the Global Learning for Adaptive Management (GLAM) initiative, adaptive rigour is about ensuring that the data, information, methods, processes and systems that underpin adaptive management are robust, systematic and high‑quality. Key messages When faced with programmatic complexity, it is important to take an adaptive approach driven by continuous and iterative monitoring, evaluation and learning (MEL). USAID Wildlife Asia, which works to advance regional action towards ending illegal wildlife trafficking in Southeast Asia and China, has embraced this approach as a way of operationalising adaptive rigour. Throughout programming, MEL approaches should reflect the characteristics of adaptive rigour: comprehensiveness, usefulness, practicality, timeliness and support. Utilising performance monitoring and research in order to test and revise technical approaches and employing mixed methods to collect both qualitative and quantitative data, as well as looking for relevant lessons generated by others, can ensure access to the most useful information for decision-making throughout implementation. For adaptive management, it is not enough to monitor, evaluate and learn; it is also essential to pause and reflect in order to analyse and process evidence gained through MEL with colleagues and stakeholders to reach the right conclusions and make good decisions.

Adapting data collection and utilisation to a Covid-19 reality: Monitoring, evaluation and learning approaches for adaptive management - Ziegler, Jessica; Mason, Paige (Briefing Paper, 2020)
This briefing note focuses on the remote collection and use of data for adaptive management during the Covid-19 pandemic, setting out key considerations to help practitioners think through a transition from more ‘traditional’ monitoring, evaluation and learning (MEL) to MEL for adaptive management (MEL4AM) that reflects the unique data collection challenges presented by Covid-19. The brief provides an overview of some key considerations in remote data collection, when this is required, and identifies other sources that address these issues in more detail. It concludes with a discussion of how to bring the information resulting from remote monitoring into decision-making to enable adaptive management. Key messages - When planning for remote data collection during the Covid-19 pandemic, first determine what information is still necessary, because data needs may have changed, e.g. if programming has pivoted or needs to pivot due to Covid-19. Then identify how the programme’s information needs align with existing data sources and what gaps remain, which will guide the need for remote data collection. - Also consider what data is ‘good enough’ for current decision-making needs in order to provide sufficient information to the right people at the right time to an acceptable standard of rigour. - There may be pragmatic reasons to reduce the number or scope of MEL activities, such as logistical constraints or ethical considerations introduced by the pandemic. - MEL activities should be accompanied by frequent feedback loops and pause points to reflect on emergent needs and challenges, information needs that have been met, and contextual changes that may affect MEL. - Be clear with decision-makers about the assumptions and gaps in the data, including proxies used and their limitations, sampling changes, and how these changes and assumptions may affect the decisions/options being discussed.

Evaluability Checklist for Post Project Evaluation - Zivetz, Laurie; Cekan, Jindra (Valuing Voices, 2020)
Considerations for planning a post project evaluation during the project, at the end, or after it has closed.

Handbook of Democratic Innovation and Governance - Elstub, Stephen; Escobar, Oliver (Edward Elgar Publishing, 2019)
Democratic innovations are proliferating in politics, governance, policy, and public administration. These new processes of public participation are reimagining the relationship between citizens and institutions. This Handbook advances understanding of democratic innovations, in theory and practice, by critically reviewing their importance throughout the world. The overarching themes are a focus on citizens and their relationship to these innovations, and the resulting effects on political equality. The Handbook therefore offers a definitive overview of existing research on democratic innovations, while also setting the agenda for future research and practice.
Keywords: Democracy; Public Affairs & Administration

From purposeful to meaningful adaptive programming: how about adaptive operations? - Nixon, Nicola (Devpolicy Blog from the Development Policy Centre, 2019)
Embracing adaptive programming approaches but sticking with rigid, traditional systems-based operations? It's time to take a long hard look at all the boring stuff, says Nicola Nixon.

Supporting adaptive management. Monitoring and evaluation tools and approaches - Pasanen, Tiina; Barnett, Inka (ODI, 2019)
Key messages • This working paper introduces a set of monitoring and evaluation (M&E) tools and approaches, discussing their potential usefulness in supporting adaptive management in development and humanitarian programmes. It emphasises adaptive programmes characterised by complex aspects, such as: (1) they are innovative; (2) they have uncertain pathways for change; or (3) they operate in uncertain or unstable environments. • The majority of these tools have been used in international development for many years. However, adaptive management brings additional challenges for monitoring and evaluating programmes, as they require intentional M&E design from the start that is oriented towards both learning and accountability. • All of the tools and approaches introduced in this paper have potential to support learning and adaptation, although in various ways and at different stages of a programme. Some tools can support strategic planning and diagnosing throughout a programme – especially during design and inception – while others can help analyse causal relationships at specific points in a programme. It is important to tailor the approach used for its intended purpose. However, whether learning and adaptation happens depends also on factors other than the choice of M&E methods. • For some of these approaches a considerable body of evidence already exists but, for many, more practical examples and systematic analysis is needed. In addition to building the evidence base concerned with which approaches are suitable for different types of adaptive programmes and why, it is also important to improve understanding of the enabling environmental conditions necessary for the tools and approaches outlined here to facilitate and strengthen evaluative thinking, evidence-informed decision-making and ongoing programme iteration.

What are the Simple Rules that guide our Strategies? - Green, Duncan (From Poverty to Power, 2019)
A management treatise on 'simplre rules' for companies facing unpredictable situations could provide useful guidance to aid organizations

Applying Power Analysis: Using the ‘Powercube’ to explore forms, levels and spaces - Gaventa, John (Power, Empowerment and Social Change, 2019)
In a complex, globalised and rapidly changing world, power dynamics are multidimensional, constantly evolving, and full of complexity. The ‘powercube’ (Gaventa, 2006) is an approach to power analysis which can be used to examine the multiple forms, levels and spaces of power, and their interactions. Building on earlier work on power, and elaborated and popularised in collaboration with other colleagues through the web site powercube.net and numerous other resources, the powercube has been widely used around the world for analysis of power, education and awareness building, context analysis, programme and strategy development, and monitoring and evaluation. This article briefly outlines the evolution of the powercube, and provides examples of the issue areas in which it has been used, and for what purposes. Drawing on these, we then offer eight lessons of how to apply the powercube framework for analysing and transforming power relations.

Power, Empowerment and Social Change - McGee, Rosemary; Pettit, Jethro (2019)
This book uncovers how power operates around the world, and how it can be resisted or transformed through empowered collective action and social leadership. The stakes have never been higher. Recent years have seen a rapid escalation of inequalities, the rise of new global powers and corporate interests, increasing impunity of human rights violations, suppression of civil society, and a re-shaping of democratic processes by post-truth, populist and nationalist politics. Rather than looking at power through the lenses of agency or structure alone, this book views power and empowerment as complex and multidimensional societal processes, defined by pervasive social norms, conditions, constraints and opportunities. Bridging theory and practice, the book explores real-world applications using a selection of frameworks, tools, case studies, examples, resources and reflections from experience to support actors to analyse their positioning and align themselves with progressive social forces. Compiled with social change practitioners, students and scholars in mind, Power, Empowerment and Social Change is the perfect volume for anyone involved in politics, international development, sociology, human rights and environmental justice who is looking for fresh insights for transforming power in favour of relatively less powerful people.

Towards evidence-informed adaptive management - Hernandez, Kevin; Ramalingam, Ben; Wild, Leni (Working Paper, 2019)
Development and humanitarian organisations seeking to be adaptive have emphasised the need to be transparent about complexity and uncertainty; to be honest about their inability to control what happens; and to design programmes that change over time to become more appropriate and relevant. At their heart, adaptive management approaches emphasise the ability to lean, 'unlearn' and adapt programming accordingly. The cornerstone of effective learning is the creation, gathering, accumulation, interpretation and use of data and evidence. This working paper provides development professionals with tools, strategies and ideas to help them use evidence for adaptive management in practical and evidence-informed ways. Key messages - Evidence is central to effective and rigorous adaptive management. However, despite this central importance, exactly how evidence has been used to inform decisions for adapting development and humanitarian programmes in the past remains unobservable to many. - There is a need to strengthen and document evidence-informed adaptive management. This working paper proposes a roadmap to do this. - Those seeking to use evidence for adaptive management will need to manage trade-offs between ensuring a rigorous, documented (and auditable) trail of evidence-informed actions, being pragmatic about the time and resources allocated to documentation and recognising that it may be necessary to proceed without rigorous evidence when it is unavailable.

Scrambling after Moving Targets: Monitoring & Evaluation Applied to Adaptive Management Approaches in Peacebuilding - Woodrow, Peter; Jean, Isabella (New Directions in Peacebuilding Evaluation, 2019)
In this landmark collection, the voices of pathMakers and innovators in peacebuilding evaluation are assembled to provide new direction for the field.
Keywords: IMPORTANT

The good and the ‘not so good’ of our experiences with SenseMaker - Mager, Franziska (Oxfam Views & Voices, 2019)
When we purchased a license for the SenseMaker research method in early 2017 (a proprietary data collection and analysis software), the excitement in our more “geeky” teams was palpable. SenseMaker ... Read More

Livelihoods in the Za'atari Camp: Impact evaluation of Oxfam’s Cash for Work activities in the Za’atari camp (Jordan) - Lombardini, Simone; Mager, Franziska (http://hdl.handle.net/10546/620883, 2019)

Stakeholder and Social Network Analysis - Guidance Note - IRC (International Rescue Committee, 2019)
Stakeholder Analysis is used to identify the actors and relationships that influence project outcomes. This guidance, from IRC, can help you determine how to work and who to partner, coordinate or engage with in order to best achieve the outcome. It builds on existing stakeholder information and typically will include a participatory internal meeting or workshop.

Theory of change in ten steps - Noble, James (NPC, 2019)

Citizen engagement: emerging digital technologies create new risks and value - Peixoto, Tiago; Steinberg, Tom (World Bank, 2019)
The recent rapid evolution of digital technologies has been changing behaviors and expectations in countries around the world. These shifts make it the right time to pose the key question this paper explores: Will digital technologies, both those that are already widespread and those that are still emerging, have substantial impacts on the way citizens engage and the ways through which power is sought, used, or contested? The authors address this question both to mitigate some of the World Bank’s operational risks, and to initiate a conversation with peers about how those risks might require policy shifts. The overall framing question also is being explored in case theapproaches to citizen engagement advocated by the World Bank are changing and may require different advice for client countries. Despite the lower technology penetration levels in developing countries, their more malleable governance contexts may be more influenced by the effects of emerging technologies than older states with greater rigidity. Digitally influencedcitizen engagement is, in short, one of those “leapfrog” areas in which developing nations may exploit technologies before the wealthier parts of the world. But countries can leapfrog to worse futures, not just better ones. This paper explores what technology might mean for engagement, makespredictions, and offers measures for governments to consider.

Tale of the converted: how complex social problems have made me question the use of data in driving impact - Burgoyne, John (Impact of Social Sciences, 2019)
15 Shares In practice the way in which research impacts and influences policy and society is often thought to be a rational, ordered and linear process. Whilst this might represent a ‘common sense’ understanding of research impact, in this cross-post John Burgoyne reflects on how upending the primacy of data and embracing complexity can lead to a more nuanced and effective understanding of research impact.

ICT4D Blog » A citizen participation ecosystem - Peña-López, Ismael (ICTlogy, 2019)
Research on the Information Society, the Digital Divide and Information and Communication Technologies for development

Who Owns Poverty? - Burt, Martin (Red Press Ltd, 2019)
This is the story of the one question about global poverty we never thought to ask: who owns it? It's a question with an unexpected answer, one that challenges everything that we thought we knew about what poverty is, and what we can do about it. This is a story of a powerful data-driven methodology being used in a dozen countries across 5 continents. It's a new approach that puts poor families in charge of defining and diagnosing their own unique, multidimensional povertywho by owning the problem, own the solution. This book is for all the governments, development NGOs, charities, dreamers, thinkers, doers and leaders who are frustrated with limiting their aspirations to reducing poverty, or alleviating its effectsand the lack of progress we face in doing either. This is a book about unleashing trapped energy within poor families to do the unthinkable: eliminate global poverty once and for all.

The M&E (Monitoring & Evaluation) Universe - INTRAC (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. To begin exploring the Universe right away, use the button below. To find out more, read on.

Decide Madrid: a case study on e-Participation - Pina, Vicente; Torres, Lourdes; Royo, Sonia; García-Rayado, Jaime (XX International AECA Congress, 2019)
This paper analyses the award-winning e-participation initiative of the city council of Madrid, Decide Madrid, to discover the critical success factors at contextual, organizational and individual level. This analysis is carried out with desk research and semi-structured interviews. Results show that the most relevant success factors are the socio-economic context, the commitment of the city council, the method used to recruit the workers and the knowledge of senior managers about citizen participation and ICTs. However, the lack of transparency and poor functioning of some of its participation activities are negatively affecting its performance.

Paradoxes and partnerships: a study of knowledge exploration and exploitation in international development programmes - Lannon, John; Walsh, John N. (Journal of Knowledge Management, 2019)
Purpose – This paper aims to look at how organisational partnerships balance knowledge exploration and exploitation in contexts that are rife with paradoxes. It draws on paradox theory to examine the partnership’s response to the explore-exploit relationship.

Are we suffering from obsessive measurement disorder? - Pasanen, Tiina (From Poverty to Power, 2019)
ODI’s Tiina Pasanen argues that more data doesn’t necessarily mean we make better decisions, and sets out some ideas for how we count what counts.

LAC MEL Specialists Use Peer Network to Improve Quality and Use of Evidence - Anderson, Todd M; Prevatt, Amy (CLA Case Competition, 2019)
Based on consultations and stocktakings with LAC Missions, the LAC Bureau identified Mission Monitoring, Evaluation and Learning (MEL) Specialists as influential decision makers regarding data and evidence use. The LAC Bureau aims to improve the quality and use of evidence for decision making, and ultimately to improve development outcomes.

Failing Forward: How CARE is focusing on what goes wrong to improve impact - Janoch, Emily (2019 CLA Case Competition, 2019)
CARE's Failing Forward initiative is sparking opportunities to showcase the ideas that don't work so we can spend more time implementing the ones that do. It's changing the conversation inside the organization, and leading to changes in the way we design and implement programs. It's also allowing us to make connections across a global portfolio of more than 900 projects, and with new and different partners to learn from their experience.

Failing Forward: How CARE is Focusing on What Goes Wrong to Improve Impact - Janoch, Emily (CLA Case Competition, 2019)
CARE's Failing Forward initiative is sparking opportunities to showcase the ideas that don't work so we can spend more time implementing the ones that do. It's changing the conversation inside the organization, and leading to changes in the way we design and implement programs.

Mayne18-Developing Useful ToCs REV3 - Mayne, John (2019)
An update on the previous September 2018 uploaded article

The COM-B Theory of Change Mode - v.5 - Mayne, John (Palladium, 2019)
ResearchGate is a network dedicated to science and research. Connect, collaborate and discover scientific publications, jobs and conferences. All for free.

What’s Next for Design Thinking - Cone, Taylor (Medium, 2019)
Thoughts on the future of creative problem-solving from across the industry

Calibrating adaptive programming across multi-country, multi-partner programs - Gray, Stephen; Carl, Andy (Adapt Peacebuilding, 2019)
This past week Andy Carl and I joined the international NGO Christian Aid Ireland team in Dublin to reflect on progress in a key feature of their work - adaptive programming. This post presents what Andy Carl and I learned in reflecting this week with the international NGO Christian Aid Ireland r

VCoL in action: How to use micro-VCoLs to learn optimally on the fly - Dawson, Theo (Medium, 2019)
VCoL (the virtuous cycle of learning), is designed to optimize learning while leveraging human´s natural motivational system. It’s easiest to tap into this motivational system when VCoLs are small, focused, relevant, and habitual. We call VCoLs with these characteristics micro-VCoLs. What is a micro-VCoL? Micro-VCoLs are frequently iterated learning cycles that are embedded in everyday activities. Like any VCoL, they involve setting a learning goal, gathering information, applying information, and reflecting on outcomes (preferably with input from others). But in the case of the micro-VCoL, the focus is on the smaller skills (micro-skills) that make up complex sets of skills.

What we’re missing by not getting our TWP alphabet straight - Marquette, Heather (From Poverty to Power, 2019)
Heather Marquette grapples with aid's alphabet soup, and explains why DDD, TWP, PDIA etc are different and why that matters

Process and Contextual Factors Supporting Action-Oriented Learning: A Thematic Synthesis of Empirical Literature in Natural Resource Management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina (Society & Natural Resources, 2019)
Despite a long-term focus on learning in natural resource management (NRM), it is still debated how learning supports sustainable real-world NRM practices. We offer a qualitative in-depth synthesis of selected scientific empirical literature (N = 53), which explores factors affecting action-oriented learning. We inductively identify eight key process-based and contextual factors discussed in this literature. Three patterns emerge from our results. First, the literature discusses both facilitated participation and self-organized collaboration as dialogical spaces, which bridge interests and support constructive conflict management. Second, the literature suggests practice-based dialogs as those best able to facilitate action and puts a strong emphasis on experimentation. Finally, not emphasized in existing reviews and syntheses, we found multiple evidence about certain contextual factors affecting learning, including social-ecological crises, complexity, and power structures. Our review also points at important knowledge gaps, which can be used to advance the current research agenda about learning and NRM.
Keywords: Ecosystem governance; Social learning; intermediaries; social-ecological systems; structural constraints

A market system by any other name would smell as sweet - Kessler, Adam; Conroy, Kevin (BEAM Exchange, 2019)
How does Doing Development Differently (DDD) and Problem Driven Iterative Adaption (PDIA) connect to core principles of the MSD approach?

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of Institutions for Inclusive Development, Tanzania - Green, Duncan; Guijt, Irene (Action for Empowerment and Accountability Research Programme, 2019)
Adaptive Management involves a dynamic interaction between three elements: delivery, programming and governance. This case study focuses on a large DfID governance project, the Institutions for Inclusive Development (I4ID), a five-year initiative in Tanzania. The study forms part of a research project to examine whether and how adaptive approaches can strengthen aid projects promoting empowerment and accountability in fragile, conflict and violence-affected settings (FCVAS). The research examines some of the assertions around the adaptive management approach and explores if and how adaptive approaches, including rapid learning and planning responses (fast feedback loops and agile programming) are particularly relevant and useful for citizen empowerment and government accountability (E&A) in FCVAS.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Supporting the policy environment for economic development (SPEED+) - Strategic Review Report - MSI (USAID, 2019)
Donor-funded policy reform has a long history in Mozambique, with United States Agency for International Development (USAID) efforts dating to the mid-1990s. Many laws and regulations adopted during the past quarter century are the consequence of these efforts. And yet, even with several years of robust economic growth, Mozambique has not experienced the broad economic transformation that policy reforms can trigger: per capita income in 2017 was $519 and more than 80 percent of the country lived on less than two dollars per day. The country ranks 180 out of 189 on the Human Development Index and 135 out of 180 on the World Bank’s Doing Business Index. Supporting the Policy Environment for Economic Development (SPEED+), a $37 million, four-year, USAID-funded program, represents the latest iteration of USAID’s policy reform efforts. SPEED+ began in August 2016 and is scheduled to run through August 2020. As the program passed the midway point, USAID commissioned Management Systems International (MSI) to conduct a strategic review (SR) of the SPEED+ program, with the objectives of advising on: • how to maximize the impact of SPEED+ during its final 18 months; • what type of follow-on program USAID should consider; and • what broader lessons can be drawn from SPEED+’s experience in Mozambique.

Top Tips: How to design and manage adaptive programmes - Valters, Craig; Wild, Leni (Overseas Development Institute, 2019)
Within DFID, there is now a commitment to more flexible and adaptive programming. This recognises that: • DFID works in contexts that continuously evolve and change, sometimes in unpredictable ways. To respond to this, the agency needs to remain flexible – to expect change and have a good understanding of context, with resources that can be adjusted and scope to change direction if needed. All DFID programmes should be able to do this. • Some DFID programmes aim to support change in complex systems, behaviours and incentives. Efforts to address women’s empowerment, improve sanitation or build more sustainable health systems, for instance, all require engagement with the way in which complex systems operate and the people and behaviours within them. Trying to deliver reforms in these circumstances is challenging because the pathway to reform itself will be unclear: as a reform is rolled out, the system itself will react and respond. These types of programmes therefore need to build in from the start deliberate processes of learning and testing, to allow for adaptations as more information is gathered for what works over time. These top tips are concerned with programmes that aim to be flexible and adaptive – which work in dynamic contexts and are trying to address complex problems. While there is growing commitment to these approaches, feedback suggests staff still have questions about how to do this well. This document highlights some of the commonly reported issues related to adaptive programming and a set of tips, strategies and examples to help in addressing them. It is aimed at programme managers and advisors who may be Senior Responsible Owners (SROs) or those managing and supporting adaptive programming in a range of ways. We have collated these lessons from discussions with country offices and SROs, feedback from surveys and the wider evidence. We have looked specifically at the adaptive programmes we can find in the DFID portfolio, but this is not an exhaustive list. It should be noted that there is as yet no wide variety of case law to review, but there is a growing set of examples within DFID that can provide continuous learning for the organisation.

Beyond Tweets and Screams: Action for Empowerment and Accountability in Nigeria – The Case of the #BBOG Movement - Aina, Tade Akin; Atela, Martin; Ojebode, Ayo; Dayil, Plangsat; Aremu, Fatai (IDS, 2019)
This paper explores the nature, role and dynamics of new forms of social and political action as pathways to empowerment and accountability in fragile conflict- and violence-affected settings in Africa. Through an in-depth analysis of the case of the Bring Back Our Girls (#BBOG) movement in Nigeria and a multi-methods approach, the paper provides new knowledge that addresses evidence gaps in the following areas: (1) the multiple ways through which social and political action play out in fragile, conflict- and violence-affected settings; (2) whether the conditions in which new forms of social and political action applicable to fragile, conflict- and violence-affected settings – the settings most dominant in African countries – emerge as currently projected in the literature; and (3) whether these social and political actions necessarily produce accountability and empowerment in fragile, conflict- and violence-affected settings. Although often expressed as contentious and/or unruly politics, experiences from the BBOG movement suggest that the new forms of social and political action possess a wide range of implications for citizen action and governance, including leading to multiple forms of empowerment in fragile settings.

Exploring the new world: practical insights for funding, commissioning and managing in complexity - Lowe, Toby; Plimmer, Dawn (Collaborate & Newcastle University, 2019)
The world is complex. If we want to contribute to creating positive social outcomes, we must learn to embrace this complexity. This is the New World that funders and commissioners are discovering: • People are complex: everyone’s life is different, everyone’s strengths and needs are different. • The issues we care about are complex: issues – like homelessness – are tangled and interdependent. • The systems that respond to these issues are complex: the range of people and organisations involved in creating ‘outcomes’ in the world are beyond the management control of any person or organisation. Building on the findings from our previous report, A Whole New World, we have spent the last 12 months working with a growing movement of funders, public sector commissioners, and organisations working on the ground to begin to explore this New World: to find examples of practice that will help people to navigate it effectively. This report explores the key features of their response: working in a way that is human, prioritises learning and takes a systems approach.

The Case for an Adaptive Approach to Empowerment and Accountability Programming in Fragile Settings: Synthesis report - Christie, Angela; Green, Duncan (Action for Empowerment and Accountability Research Programme, 2019)
Fragile, conflict and violence-affected settings (FCVAS) are messy and ambiguous contexts in which to plan and implement development initiatives. To work there, external actors are increasingly adopting an adaptive approach to empowerment and accountability (E&A) programming, whatever the setting. This means using a compass rather than map, where real-time political economy analysis (PEA) in relation to context and programme monitoring and evidence-informed learning in relation to intervention are used in combination and in shorter-than-usual planning cycles to maintain and adapt strategic direction. This paper brings together three case studies of large Department for International Development (DFID) governance projects in Myanmar, Nigeria and Tanzania.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Implementing Adaptive Approaches in Real World Scenarios: A Nigeria Case Study, with Lessons for Theory and Practice - Bridges, Kate; Woolcock, Michael (The World Bank, 2019)
How does adaptive implementation work in practice? Drawing on extensive interviews and observations, this paper contrasts the ways in which an adaptive component of a major health care project was implemented in three program and three matched comparison states in Nigeria. The paper examines the bases on which claims and counterclaims about the effectiveness of these approaches were made by different actors, concluding that resolution requires any such claims to be grounded in a fit-for-purpose theory of change and evaluation strategy. The principles of adaptive development may be gaining broad acceptance, but a complex array of skills, expectations, political support, empirical measures, and administrative structures needs to be deftly integrated if demonstrably positive operational results are to be obtained, especially when undertaken within institutional systems, administrative logics, and political imperatives that are predisposed to serve rather different purposes.

From Thinking Politically To Working Politically: Are We Really Doing Development Any Differently? (2019)
In June it will be seven years since the Center for Global Development published the Problem Driven Iterative Adaptation (PDIA) paper. Few academic papers have had such an impact on development thinking. The question is whether the paper – and subsequent debate and experimentation - have had a demonstrable and beneficial impact on development practice. Experience to date suggests thinking politically is easier than working politically. Practitioners in development agencies, governments and contractors find that convincing theoretical literature can be tricky to operationalize in a fractious environment. Still, a growing number of programs have set out to be politically informed in design and politically savvy in implementation. Engaging the reality of politics creates the potential to promote change. To consider these issues, Abt Associates is hosting a workshop for international development practitioners in Washington, DC, on June 18th, 2019, to discuss the successes and failures in operationalizing this agenda. The session will allow practitioners to discuss experiences in TWP and propose solutions or approaches. Please join us in this Innovations in Governance series finale where four internationally renowned thinkers and doers will join us to offer their perspectives.

What Does the Evidence Tell Us about ‘Thinking and Working Politically’ in Development Assistance? - Dasandi, Niheer; Laws, Ed; Marquette, Heather; Robinson, Mark (Politics and Governance, 2019)
Abstract: This paper critically reviews evidence on ‘thinking and working politically’ in development. Scholars and practitioners have increasingly recognised that development is fundamentally political, and efforts are underway to develop more politically informed ways of thinking and working. The literature does not yet constitute a strong evidence base to link these efforts to more effective aid programming: much evidence is anecdotal, does not meet high standards of robustness, is not comparative, and draws on self-selected successes reported by programme insiders. We discuss factors commonly considered to explain the success of politically informed programmes in areas where conventional programming approaches fall short. We consider evidence in three areas—political context, sector and organization—and provide guidance on where to focus next. Finally, we outline ways of testing the core assumptions of the ‘thinking and working politically’ agenda more thoroughly, to provide a clearer sense of the contribution it can make to aid effectiveness.

Biased Policy Professionals - Banuri, Sheheryar; Dercon, Stefan; Gauri, Varun (The World Bank Economic Review, 2019)
Although the decisions of policy professionals are often more consequential than those of individuals in their private capacity, there is a dearth of studies on the biases of policy professionals: those who prepare and implement policy on behalf of elected politicians. Experiments conducted on a novel subject pool of development policy professionals (public servants of the World Bank and the Department for International Development in the UK) show that policy professionals are indeed subject to decision-making traps, including the effects of framing outcomes as losses or gains, and, most strikingly, confirmation bias driven by ideological predisposition, despite having an explicit mission to promote evidence-informed and impartial decision making. These findings should worry policy professionals and their principals in governments and large organizations, as well as citizens themselves. A further experiment, in which policy professionals engage in discussion, shows that deliberation may be able to mitigate the effects of some of these biases.
Keywords: bias

Exploring the prospects for adaptive governance in marine transboundary conservation in East Africa - Tuda, Arthur Omondi; Kark, Salit; Newton, Alice (Marine Policy, 2019)
This article explores the prospects for adaptive governance in a proposed marine transboundary conservation initiative in East Africa. Adaptive governance that involves interdependent state and non-state actors learning and taking action on joint environmental problems is suggested for effective transboundary resource governance. Using the concept of adaptive co-management, the current multi-stakeholder marine governance systems in southern Kenya and northern Tanzania are compared to illuminate opportunities and constraints for adaptive marine transboundary conservation governance between Kenya and Tanzania. The concept of networks and the formal method of social network analysis (SNA) are applied as the main methodological device. Using questionnaire and semi-structured interviews, social network data of 70 organizations (local resources users, government agencies and NGOs) was generated from Kenya (n = 33) and Tanzania (n = 37). Results show the existence of strong collaboration networks for marine resource governance in both Kenya and Tanzania. Social proximity is the common driver of network formation. Collaboration networks in Kenya and Tanzania have contributed to enhanced learning among marine resource managers. Conclusions point to the need to focus on common challenges relating to low levels of rule-compliance, limited access to information on the state of resources and poor integration of science into marine management decisions. Finally, differences in views regarding the state of marine ecosystems need to be addressed to improve prospects for joint problem-solving in marine transboundary conservation.
Keywords: Adaptive co-management; Adaptive governance; Collaboration; Marine transboundary conservation; Social network analysis

Eight Practices for Strategic Agility - Algoso, Dave (Stanford Social Innovation Review, 2019)
Rather than a glossy brochure that no one reads, your strategy should be an ongoing practice that informs your decisions and adapts as circumstances change. A Viewpoint from the Summer 2019 issue.

Summer school on Adaptive Management - 2019 - CID (2019)
General description of the curriculum

M&E Universe - intrac (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. It can be explored through an online platform (intrac.org/universe) that is compatible with most web browsers. The M&E Universe is designed for M&E practitioners with different levels of experience and expertise in M&E, from those new to M&E who want an entry level into the subject to experienced practitioners wanting to broaden their knowledge. Initial contact with the Map will provide people with a starting point for understanding different aspects of M&E and how they link to each other. More experienced practitioners can browse the Map to identify more advanced subjects of interest, such as sampling methods, different forms of evaluation, organisational M&E systems and complex methodologies for data collection and analysis.

Adaptive Management - Jenal, Marcus; Cunningham, Shawn (Annual Reflection 2019, 2019)

Knowledge Retention and Transfer (KRT) - Model and Matsurity Matrix - USAID (CLA Toolkit, 2019)
The Maturity Matrix is not a standalone tool. It is one of the three major components of the KRT Model. The Maturity Matrix is meant to be used in conjunction with the KRT Toolkit and Implementation Plan.

Managing staff transistions through CLA: preserving institutional memory as staff come and go - USAID (CLA Toolkit, 2019)
This document is relevant for any position or hiring mechanism. While this document does not explicitly address what happens when someone arrives into a newly-created position, which has its own set of challenges, many of the principles, actions, and resources can be applied in that context. Section 1 offers guidance for how to set up and implement systems at Mission/OU or office to ensure that all staff help preserve institutional memory and enable continuity of relationships. This section is for any staff in a Mission/OU working to build systems that improve handovers and knowledge capture and sharing across the Mission or OU. If a Mission or OU is just beginning to develop a system to manage staff transitions, you may want to start by developing a system within an office or team and then expand it out to other offices or to the Mission/OU writ large. Section 2 includes key principles and actions individuals could consider following when arriving or departing a position, regardless of hiring mechanism and position. This includes staff new to the Mission/OU and staff who are currently in the Mission/OU and are moving into a new position. Section 3 provides a select number of resources to help you take a systematic and comprehensive approach to manage staff transitions as effectively and efficiently as possible at the individual or organizational level.

Making Sense of Complexity: Using SenseMaker as a Research Tool - Van der Merwe, Susara E.; Biggs, Reinette; Preiser, Rika; Cunningham, Charmaine; Snowden, David J.; O’Brien, Karen; Jenal, Marcus; Vosloo, Marietjie; Blignaut, Sonja; Goh, Zhen (Systems, 2019)
There is growing interest in studying processes of human sensemaking, as this strongly influences human and organizational behavior as well as complex system dynamics due to the diverse lenses people use to interpret and act in the world. The Cognitive Edge SenseMaker® tool is one method for capturing and making sense of people’s attitudes, perceptions, and experiences. It is used for monitoring and evaluation; mapping ideas, mind-sets, and attitudes; and detecting trends and weak signals. However, academic literature describing the tool-set and method is lacking. This introduction aims to guide researchers in choosing when to use SenseMaker and to facilitate understanding of its execution and limitations. SenseMaker can provide nuanced insight into system-level patterns of human sensemaking that can provide insight to nudge systems towards more desirable futures, and enable researchers to measure beyond what they know.
Keywords: Mixed methods; SenseMaker tool; complex systems; sensemaking; social complexity

Broad Agency Announcement for Locally Led Development Innovation - USAID (USAID, 2019)
This BAA allows USAID Operating Units (OUs) to co-create, co-design, co-invest, and collaborate in the research, development, piloting, testing, and scaling of innovative, practical, and cost-effective interventions to catalyze locally led development. The BAA aligns with a number of Agency priorities and policies, including the Journey to Self-Reliance, resilience, procurement innovation, and expanding and diversifying the partner base - as well as the New Partnerships Initiative and Acquisition and Assistance Strategy. E3/LS has put up the BAA’s first Addendum, "New Directions in Advancing Locally Led Development," which seeks Expressions of Interest on the following: - Engaging the Local Private Sector - Conflict, Post-Conflict, and Non-Permissive Environments - Effective Partnerships - The Changing Role of the Donor - Local Giving, Philanthropy, and Other Private Resources

Future Democracies - Laboratory of Collective Intelligence for Participatory Democracy - Yago Bermejo (MediaLab Prado, 2019)
The Laboratory of Collective Intelligence for Participatory Democracy (2016-2019) is a project that arose out of Medialab Prado in coordination with the Government Area of Citizen Participation, Transparency and Open Government of the city of Madrid. Its work has been very connected with the analysis, reflection and innovation found on the digital participation platform Decide Madrid. The project has also organised many workshops and conferences that have brought together hundreds of people from the world of participatory democracy. This publication summarises the project’s core working principles as well as the open activities it has hosted over the course of these three years. These pilot experiences offer a possible vision of the future of democratic governance.
Keywords: Democracy

You might not be as agile as you think you are - Lindpaintner, Julia; Rivera, Stephanie (18F, 2019)
The mandate to be agile is everywhere. But agile isn’t an on-off switch. It’s a skill and a mindset that is developed over time, through dedicated work, open teams, and lots (and lots) of practice

The Limits of Accounting-Based Accountability in Education (and Far Beyond): Why More Accounting Will Rarely Solve Accountability Problems - Honig, Dan; Pritchett, Lant (Center for Global Development, 2019)
Accountability is rightly at the center of the conversation regarding how to improve governance systems, particularly health and education systems. But efforts to address accountability deficits often focus primarily on improving what can be counted and verified—what we term “accountingbased accountability.” We argue that introducing greater accounting-based accountability will only very rarely be the appropriate solution for addressing accountability problems. We illustrate this by exploring the role of Accountability ICT in (not) improving education system performance. Strengthening “real” accountability is not the same as improving data systems for observation and verification, and often attempts at the latter undermine the former. The development discourse’s frequent semantic misunderstanding of the term “accountability” has pernicious effects on system reform efforts and ultimately global welfare.

Scaling Impact: Innovation for the Public Good - McLean, Robert; Gargani, John (Routledge, 2019)
Scaling Impact introduces a new and practical approach to scaling the positive impacts of research and innovation. Inspired by leading scientific and entrepreneurial innovators from across Africa, Asia, the Caribbean, Latin America, and the Middle East, this book presents a synthesis of unrivalled diversity and grounded ingenuity. The result is a different perspective on how to achieve impact that matters, and an important challenge to the predominant more-is-better paradigm of scaling. For organisations and individuals working to change the world for the better, scaling impact is a common goal and a well-founded aim. The world is changing rapidly, and seemingly intractable problems like environmental degradation or accelerating inequality press us to do better for each other and our environment as a global community. Challenges like these appear to demand a significant scale of action, and here the authors argue that a more creative and critical approach to scaling is both possible and essential. To encourage uptake and co-development, the authors present actionable principles that can help organisations and innovators design, manage, and evaluate scaling strategies. Scaling Impact is essential reading for development and innovation practitioners and professionals, but also for researchers, students, evaluators, and policymakers with a desire to spark meaningful change.
Keywords: Developing & Emerging Countries

How to manage complexity: four lessons for DFID’s new Secretary of State - LearnAdapt (Medium, 2019)
Lessons for DFID in addressing complex problems without creating complicated, workload heavy programmes.

The guiding logics and principles for designing emergent transdisciplinary research processes: learning experiences and reflections from a transdisciplinary urban case study in Enkanini informal settlement, South Africa - van Breda, John; Swilling, Mark (Sustainability Science, 2019)
Transdisciplinarity is not a new science per se, but a new methodology for doing science with society. A particular challenge in doing science with society is the engagement with non-academic actors to enable joint problem formulation, analysis and transformation. How this is achieved differs between contexts. The premise of this paper is that transdisciplinary research (TDR) methodologies designed for developed world contexts cannot merely be replicated and transferred to developing world contexts. Thus a new approach is needed for conducting TDR in contexts characterised by high levels of complexity, conflict and social fluidity. To that end, this paper introduces a new approach to TDR titled emergent transdisciplinary design research (ETDR). A core element of this approach is that the research process is designed as it unfolds, that is, it transforms as it emerges from and within the fluid context. The ETDR outlined in this paper emerged through a case study in the informal settlement (slum) of Enkanini in Stellenbosch, South Africa. This case study demonstrates the context from and within which the ETDR approach and identifies a set of guiding logics that can be used to guide ETDR approaches in other contexts. The study demonstrates that the new logics and guiding principles were not simply derived from the TDR literature, but rather emerged from constant interacting dynamics between theory and practice. Learning how to co-design the research process through co-producing transformative knowledge and then implementing strategic interventions to bring about incremental social change is key to theory development in ways that are informed by local contextual dynamics. There are, however, risks when undertaking such TDR processes such as under-valuing disciplinary knowledge, transferring risks onto a society, and suppressing ‘truth-to-power’.

Monitoring and learning for country-level portfolio decision-making and adaptation - Buffardi, Anne L; Mason, Paige; Hutchings, Claire; Sharp, Samuel (Briefing Note, 2019)
Most measurement and adaptive management approaches were developed for and from individual projects. This briefing aims to guide measurement and management of country-level portfolios of work. It identifies potential purposes portfolio-level analyses can fulfil, types of adaptation, and the relative role of monitoring, learning and evaluation (MEL). Drawing on reviews of practice from the United States Agency for International Development (USAID) and the United Kingdom Department for International Development (DFID), guidance notes, and experiences of members of the Global Learning for Adaptive Management (GLAM) initiative, it offers recommendations and considerations that are particularly relevant for this level of analysis and management. Key messages - Portfolio-level analyses can serve eight potential purposes, each of which answers different questions, involves adaptation at different times and levels, and requires different types of evidence. Identifying the purpose(s) and how the component parts relate to each other should guide the development of monitoring and learning systems. - Portfolios are oriented more towards breadth than depth, involve more people with different perspectives, and draw on multiple sources of evidence with potentially greater variation in quality. - In practice, four activities appear to be applied most frequently at a portfolio level: alignment of indicators and aggregation of monitoring data; synthesis of multiple sources and types of information to provide a summary of outputs, outcomes, common observations and trends; periodic review and reflection sessions; and strategic planning, design or refresh of the portfolio strategy. - The extent to which evidence-informed portfolio management is facilitating learning and adaptation has not been well documented to date, and we suggest potential indicators to do so.

Barrio Mio and Katye: PCI’s neighbourhood approach in cities - Campbell, Leah (AKNAP case study, 2019)

Help! I’m hiring new staff and I want them to work adaptively. A guide to hiring adaptive employees. - Salib, Monalisa (USAID LEARN, 2019)
If you are involved in hiring, this tool can help you increase your chances of selecting staff members skilled in adaptive management. It will help answer the questions: Which competencies should I recruit for in order to hire more adaptive employees? Which desired qualifications should I incorporate into position descriptions to attract adaptive employees? Which interview questions should I ask to screen for adaptive employee competencies? You should use this tool when you decide to hire a new individual - whether that be a direct hire, contractor, or consultant - or when you are changing an individual’s current position description or scope of work. Specifically, this tool will help you determine which qualifications are most important for the position and offers interview questions you can use with candidates. --- You’re in luck! We just released a new guide for hiring adaptive employees. This visual and user-friendly tool will help increase your chances of selecting staff skilled in adaptive management. Here are the details: What do you mean by “work adaptively” or an “adaptive employee”? An adaptive employee is an individual who, in collaboration with relevant stakeholders, systematically acquires and uses knowledge to make decisions and adjustments in their work in order to achieve greater impact. Why focus on adaptive employees? Why does it matter? With industries, technologies, and organizations in a near constant state of flux, leaders are recognizing the importance of adaptability as a critical capacity. Because of this, it’s not surprising that a recent LinkedIn report found that adaptability was the most important soft skill hiring managers were screening for. In addition, evidence shows that teams that apply more data-driven and adaptive leadership practices perform better than those that focus less on these practices. It makes sense, then, that managers want to recruit more team members who are skilled in adaptive management - it helps achieve results. Who should use this tool? Anyone involved in hiring, responsible for developing or approving position descriptions, participating in interviews, and/or approving new hires. When should I use this tool? Use it as soon as you decide to hire a new staff person or when you’re adjusting existing position descriptions. What does the tool help me do? It will help you think through: Which competencies should I recruit for in order to hire more adaptive employees? Which desired qualifications should I incorporate into position descriptions to attract adaptive employees? (You can even copy and paste qualification language from the tool into scopes of work!) Which interview questions should I ask to screen for adaptive employee competencies? (You can copy and paste interview questions into your screening, interview, and reference check protocols!) Has the tool been tested? Yes, staff within USAID’s Global Development Lab and on the USAID LEARN contract tested the tool, providing feedback on the minimum viable product and subsequent versions. Testers confirmed finding the tool useful, and gave it a 9/10 score when asked if they would recommend it to colleagues. Some specific feedback from testers included: "The tool prompts deeper thought on what you might need and want in a job candidate" and "All [of the interview questions I used from the tool] worked well." What about the existing staff? How can they gain greater skills in adaptive management? Existing USAID staff and implementing partners can access online training in collaborating, learning, and adapting (CLA) and find resources in the CLA Toolkit. USAID staff also have access to an internal CLA community of practice and five-day, in-person CLA training.

A Guide to Digital Feedback Loops. An approach to strengthening program outcomes through data for decision making - Whittle, Dennis; Campbell, Megan (USAID, 2019)
Feedback is information about what happens as a result of what you do. Using that information to adapt what you do or how you do it creates what is called a feedback loop. A digital feedback loop uses digital technology at some stage of the feedback loop. Digital feedback loops help USAID missions improve the effectiveness and efficiency of their activities and can support partner countries on their journey to self-reliance through increased information sharing and improved government and civil society capacity. USAID missions and their partners have used digital feedback loops to improve HIV treatment targeting in Zimbabwe, engage three million young people in Nigeria in policy, and reduce field reporting times from one month to one day. Digital feedback loops provide access to information faster and more cheaply than ever before. As part of an adaptive management approach, digital feedback loops increase our ability to act on opportunities and respond to challenges. That in turn can improve outcomes and reduce the risk of waste and failure. This guide outlines the case for integrating digital feedback loops into your work, and provides tools, resources and guiding questions to support you as you get started. The guide includes examples of how USAID missions are using digital feedback loops to improve their programs in various sectors and provides worksheets to help you apply digital feedback loops to your own context.

Policy-driven monitoring and evaluation: Does it support adaptive management of socio-ecological systems? - Waylen, Kerry A.; Blackstock, Kirsty L.; van Hulst, Freddy J.; Damian, Carmen; Horváth, Ferenc; Johnson, Richard K.; Kanka, Robert; Külvik, Mart; Macleod, Christopher J. A.; Meissner, Kristian; Oprina-Pavelescu, Mihaela M.; Pino, Joan; et al. (Science of The Total Environment, 2019)
Inadequate Monitoring and Evaluation (M&E) is often thought to hinder adaptive management of socio-ecological systems. A key influence on environmental management practices are environmental policies: however, their consequences for M&E practices have not been well-examined. We examine three policy areas - the Water Framework Directive, the Natura 2000 Directives, and the Agri-Environment Schemes of the Common Agricultural Policy - whose statutory requirements influence how the environment is managed and monitored across Europe. We use a comparative approach to examine what is monitored, how monitoring is carried out, and how results are used to update management, based on publicly available documentation across nine regional and national cases. The requirements and guidelines of these policies have provided significant impetus for monitoring: however, we find this policy-driven M&E usually does not match the ideals of what is needed to inform adaptive management. There is a tendency to focus on understanding state and trends rather than tracking the effect of interventions; a focus on specific biotic and abiotic indicators at the expense of understanding system functions and processes, especially social components; and limited attention to how context affects systems, though this is sometimes considered via secondary data. The resulting data are sometimes publicly-accessible, but it is rarely clear if and how these influence decisions at any level, whether this be in the original policy itself or at the level of measures such as site management plans. Adjustments to policy-driven M&E could better enable learning for adaptive management, by reconsidering what supports a balanced understanding of socio-ecological systems and decision-making. Useful strategies include making more use of secondary data, and more transparency in data-sharing and decision-making. Several countries and policy areas already offer useful examples. Such changes are essential given the influence of policy, and the urgency of enabling adaptive management to safeguard socio-ecological systems.
Keywords: Adaptive Management; Environmental governance; Monitoring and Evaluation; Policy making; Socio-ecological systems; Sustainability

Monitoring, Evaluation and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies – Governance Soapbox - Davda, Tara; Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2019)

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Scale Up Conference, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

How Does the World Bank Build Citizen Engagement Commitments into Project Design? Results from Pilot Assessments in Mozambique, Myanmar, Nigeria, and Pakistan - Nadelman, Rachel; Le, Ha; Sah, Anjali (Working Paper 525, 2019)
How and to what degree is the World Bank putting its new institutional citizen engagement (CE) commitments into practice? This question guides an independent assessment that the Accountability Research Center (ARC) at American University has undertaken as part of the Institute of Development Studies-led Action for Empowerment and Accountability (A4EA) research programme’s investigation into how external actors can best support local processes of and conditions for empowerment and accountability. This report investigates the World Bank’s incorporation of CE into project design, the critical early stage of donor engagement. To accomplish this, ARC reviewed the World Bank’s fiscal year 2015–17 investment project portfolios for four A4EA priority countries, Mozambique, Myanmar, Nigeria, and Pakistan, which covers 57 projects that range from US$19 million to U$600 million. The analysis determines whether projects commit to seeking a strategic approach to CE, which involves combining multiple tactics so that the whole could be greater than the sum of the parts. This assessment of CE commitments is intended to help to inform possible national, civil society organisation strategies to monitor whether and how these commitments are actually implemented in practice.

Behind the scenes: International NGOs’ influence on reproductive health policy in Malawi and South Sudan - Storeng, Katerini T.; Palmer, Jennifer; Daire, Judith; Kloster, Maren O. (Global Public Health, 2019)
Global health donors increasingly embrace international nongovernmental organisations (INGOs) as partners, often relying on them to conduct political advocacy in recipient countries, especially in controversial policy domains like reproductive health. Although INGOs are the primary recipients of donor funding, they are expected to work through national affiliates or counterparts to enable ‘locally-led’ change. Using prospective policy analysis and ethnographic evidence, this paper examines how donor-funded INGOs have influenced the restrictive policy environments for safe abortion and family planning in South Sudan and Malawi. While external actors themselves emphasise the technical nature of their involvement, the paper analyses them as instrumental political actors who strategically broker alliances and resources to shape policy, often working ‘behind the scenes’ to manage the challenging circumstances they operate under. Consequently, their agency and power are hidden through various practices of effacement or concealment. These practices may be necessary to rationalise the tensions inherent in delivering a global programme with the goal of inducing locally-led change in a highly controversial policy domain, but they also risk inciting suspicion and foreign-national tensions.

Advancing urban adaptation where it counts: reshaping unequal knowledge and resource diffusion in networked Indonesian cities - Geldin, Samuel (Environment and Urbanization, 2019)
Climate adaptation literature vocalizes the need for transnational municipal networks (TMNs) to expand activities in vulnerable medium-sized cities, but little work has examined the granular extent of city participation and processes constraining TMN growth. This study explores the effectiveness of TMNs in reaching adaptation outcomes and how financial, material, and knowledge exchanges of TMNs tend to exclude adaptation in high-priority intermediary cities. Nearly 40 semi-structured interviews with Indonesian city actors and a preliminary catalogue of cities participating in TMNs reveal that risk-averse selection criteria, insufficient impact assessments, and duplicative institutional efforts reinforce disparities between primary and intermediary cities. To effectively build adaptive capacity in the most vulnerable regions, TMNs should remove participation barriers for intermediary cities, improve incentives for institutional collaboration, and adopt more rigorous evaluative metrics. These results directly inform the governance, resource allocation, and operational goals of TMN stakeholders to advance distributive climate justice.

A study of the sustained uptake developmental evaluation: How does developmental evaluation work in the USAID context, what factors help and hinder its success, and what is its value to stakeholders? - Baylor, Rebecca; Fatehi, Y. K.; Esper, H. (USAID, 2019)

DFID’s partnerships with civil society organisations - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2019)
DFID values civil society organisations (CSOs), but its funding and partnership practices do not fully support the long-term health of the civil society sector.

Making adaptive rigour work - Principles and practices for strenghening monitoring, evaluation and learning for adaptive management - Ramalingam, Ben; Wild, Leni; Buffardi, Anne L (ODI/GLAM, 2019)
Adaptive programmes can be accountable, rigorous and high quality in how they use evidence by taking an ’adaptive rigour’ approach. Core development and humanitarian challenges are complex, and require processes of testing, learning and iteration to find solutions – adaptive management offers one approach for this. Yet large bureaucracies and development organisations can have low tolerance for experimentation and learning, and adaptive management can be viewed as an excuse for ‘making things up as you go along’. This briefing from the Global Learning for Adaptive Management (GLAM) initiative argues that adaptive programmes can be accountable, rigorous and high quality in how they use evidence – but this requires rethinking some key assumptions about how they are practised. The paper sets out three key elements of an ‘adaptive rigour’ approach: - Strengthening the quality of monitoring, evaluation and learning data and systems. - Ensuring appropriate investment in monitoring, evaluation and learning across the programme cycle. - Strengthening capacities and incentives to ensure the effective use of evidence and learning as part of decision-making, leading ultimately to improved effectiveness.

5 Emerging Lessons from new research into Empowerment and Accountability in Messy Places - Gaventa, John (From Poverty to Power, 2019)
Research guru John Gaventa summarizes the emerging lessons from a new research programme on 'action for empowerment and accountability' in messy places

Learning from Results-Based Management evaluations and reviews - Vähämäki, Janet; Verger, Chantal (Development Co-operation Working Papers, 2019)
What have we learned from implementing results-based management in development co-operation organisations? What progress and benefits can be seen? What are the main challenges and unintended consequences? Are there good practices to address these challenges? To respond to these questions this paper reviews and analyses the findings from various evaluations and reviews of results-based management systems conducted by members of the Development Assistance Committee (DAC), the OECD/DAC Results Community Secretariat and other bodies in the past four years (2015-2018). It also draws on emerging lessons from new methods for managing development co-operation results. This analytical work aims to: identify recent trends in results-based management, explore challenges faced by providers when developing their results approaches and systems, select good practices in responding to these challenges that can be useful for the OECD/DACResults Community, considering new approaches, new technologies and evolving contexts. This body of evidence will inform the development of a core set of generic guiding principles for results-based management in development co-operation.

Knowing When to Adapt - A Decision Tree - USAID (USAID LEARN, 2019)
This job aid will help you determine how best to resolve a challenge/issue in programming. It is intended for use by USAID, partners, and others working in international development.

Can’t See the Wood For the Logframe: Integrating Logframes and Theories of Change in Development Evaluation - Freer, Gordon; Lemire, Sebastian (Canadian Journal of Program Evaluation, 2019)
There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application. Drawing on lessons from a recent theory-based evaluation, this article argues that fully integrating the program theory of change within the program logframe provides for a stronger and more holistic understanding of program progress.

Using Actor-Based Theories Of Change to Conduct Robust Contribution Analysis in Complex Settings - Koleros, Andrew; Mayne, John (Canadian Journal of Program Evaluation, 2019)
The use of theories of change (ToCs) is a hallmark of sound evaluation practice. As interventions have become more complex, the development of ToCs that adequately unpack this complexity has become more challenging. Equally important is the development of evaluable ToCs, necessary for conducting robust theory-based evaluation approaches such as contribution analysis (CA). This article explores one approach to tackling these challenges through the use of nested actor-based ToCs using the case of an impact evaluation of a complex police-reform program in the Democratic Republic of Congo, describing how evaluable nested actor-based ToCs were built to structure the evaluation.
Keywords: Behavioural strategy; COM-B

Integrating farmers’ adaptive knowledge into flood management and adaptation policies in the Vietnamese Mekong Delta: A social learning perspective - Tran, Thong Anh; Rodela, Romina (Global Environmental Change, 2019)
Flood management and adaptation are important elements in sustaining farming production in the Vietnamese Mekong Delta (VMD). While over the past decades hydraulic development introduced by the central government has substantially benefited the rural economy, it has simultaneously caused multiple barriers to rural adaptation. We investigate the relational practices (i.e., learning interactions) taking place within and across the flood management and adaptation boundaries from the perspective of social learning. We explore whether and how adaptive knowledge (i.e., experimental and experiential knowledge) derived from farmers’ everyday adaptation practices contributes to local flood management and adaptation policies in the selected areas. We collected data through nine focus groups with farmers and thirty-three interviews with government officials, environmental scientists, and farmers. Qualitative analysis suggests that such processes are largely shaped by the institutional context where the boundary is embedded. This study found that while the highly bureaucratic operation of flood management creates constraints for feedback, the more informal arrangements set in place at the local level provide flexible platforms conducive to open communication, collaborative learning, and exchange of knowledge among the different actors. This study highlights the pivotal role of shadow systems that provide space for establishing and maintaining informal interactions and relationships between social actors (e.g., interactions between farmers and extension officials) in stimulating and influencing, from the bottom-up, the emergence of adaptive knowledge about flood management and adaptation in a local context.
Keywords: Adaptation; Flood management; Knowledge brokers; Mekong Delta; Shadow systems; Social learning; Vietnamese

How We Model Matters: A Manifesto for the Next Generation of Program Theorizing - Whynot, Jane; Lemire, Sebastian; Montague, Steve (Canadian Journal of Program Evaluation, 2019)
In this concluding article, grounded on the exemplary contributions contained in the preceding pages, the guest editors scale the proverbial soapbox and present a manifesto to guide the pursuit and advancement of the next generation of program theorizing. Formulating ten declarations for program theory development and examination, the modest hope of the authors is to motivate and inspire reflective evaluation practitioners to broaden their views, approaches, and techniques for future program theorizing.

Bringing adaptive management to life: Insights from practice - Arora, Anmol; Gogoi, Elizabeth; Joy, Divya; Kumar, Pankaj; Luthra, Rajni; Pal, Uma; Pervaiz, Arif (Oxford Policy Management, 2019)

READ ME - HOW TO USE THIS AM LIBRARY - Prieto Martin, Pedro (Institute of Development Studies, 2019)

How DFID can better manage complexity in development programming - Sharp, Samuel; Valters, Craig; Whitty, Brendan (ODI, 2019)
The United Kingdom’s (UK) Department for International Development (DFID) is an ambitious government department that is committed to reducing poverty and conflict overseas. Many of the issues on which DFID works are complex; whether focused on climate change, gender equality, health or other priorities, simple solutions rarely exist. And to tackle these complex challenges, DFID staff must interact with unpredictable systems of political, organisational and individual behaviours and incentives. There is a risk that complex problems spur more complicated programmes; that the complexity of development challenges is addressed through designing programmes with too many projects and implementers. While there may be valid reasons for this, too many of these complicated programmes will overburden staff. This briefing note is the outcome of an ongoing process within DFID to confront these issues and answer the question: how can DFID design and manage programmes to address complex development challenges without creating too much staff workload? Key messages DFID deals with complex problems, which require flexible systems to support testing, learning and adaptation. • Complex problems do not necessarily require workload-heavy delivery structures, but simpler approaches depend on delivery partners’ experience and competence. • However, programmes that tackle complex problems do require more hands-on engagement and face more workload from inflexible compliance requirements. We suggest that DFID and similar agencies: • Pay closer attention to delivery options in programme design, making use of existing options where possible and, where not, fostering local organisations through long-term investments. • Encourage programme designers to articulate how ambition matches resources and consider ‘good enough’ design. • Reduce the burden of compliance by cultivating partner autonomy, reassessing results and valuefor-money requirements and promoting more flexible contracting and procurement. • Plan and prioritise management resources across a portfolio of programmes to make sure they can be focused in the right areas, where the complexity of the problem requires greater engagement.

Agile Development in the Age of Adaptive Management - Davis, Taryn; Orton-Vipond, Sarah; Staid, Martha (Development Gateway, 2019)
Adaptive management – the idea that development projects should respond to real life complexities and be flexible enough to respond to unforeseen changes – is an often-praised approach to doing development differently, with donors and partners exploring how to apply it within their programming.

Towards ‘Targeted Systems Change’ - Rye, Sam (Fieldnotes by Sam Rye, 2019)
Modelling and communicating how to shift systems

What is different about how INGOs do Adaptive Management/Doing Development Differently? - Green, Duncan (From Poverty to Power, 2019)

Thinking and Working Politically in Economic Development Programmes – Some Sprints and Stumbles from a DFID Programme in Kyrgyzstan - Koleros, Andrew; Rinnert, David (From Poverty to Power, 2019)
A DFID programme in Kyrgyzstan offers useful insights into how the Thinking and Working Politically approach can escape from its governance ghetto
Keywords: Case Study

Short Course - Adaptive Management, an overview - Bazaz Smith, Komal (American University, 2019)

Monitoring, Evaluating and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies - Davda, Tara; Tyrrel, Lavinia (Governance Working Paper 6, 2019)

AID Programming Guide - DFAT (Australian Government, 2019)

Peacebuilding design, monitoring, and evaluation: A Training Package for participants and trainers at intermediate to advanced levels - Ernstorfer, Anita; Barnard-Webster, Kiely (Carnegie Corporation, 2019)
This training package includes 7 Training Modules and a set of Annexes (Annexes A-O). The Training Modules build on each other and should ideally be used in a sequenced way in a training setting. However, for groups with specific training needs around particular areas, modules can also be used individually, but need to be tailored by the trainers and facilitators to meet the needs of specific audiences. The annexes provide worksheets and hand-outs that can be used as resources during the training for specific modules and exercises.

Designing Monitoring and Evaluation Approaches for Learning An FOS How-To Guide - FOS (FOS, 2019)

Local Works Guidance - Round 4 - USAID (USAID, 2019)

Hospicing The Old - Robinson, Cassie (Stewarding Loss, 2019)
In 2010 I was introduced to the Berkana Institutes’s Two Loop model, and I come back to it again and again. As I’ve moved across different…

Conflict and Human Rights Shareweb (2019)

Positive deviance, big data, and development: A systematic literature review - Albanna, Basma; Heeks, Richard (The Electronic Journal of Information Systems in Developing Countries, 2019)
Positive deviance is a growing approach in international development that identifies those within a population who are outperforming their peers in some way, eg, children in low-income families who are well nourished when those around them are not. Analysing and then disseminating the behaviours and other factors underpinning positive deviance are demonstrably effective in delivering development results. However, positive deviance faces a number of challenges that are restricting its diffusion. In this paper, using a systematic literature review, we analyse the current state of positive deviance and the potential for big data to address the challenges facing positive deviance. From this, we evaluate the promise of “big data-based positive deviance”: This would analyse typical sources of big data in developing countries—mobile phone records, social media, remote sensing data, etc—to identify both positive deviants and the factors underpinning their superior performance. While big data cannot solve all the challenges facing positive deviance as a development tool, they could reduce time, cost, and effort; identify positive deviants in new or better ways; and enable positive deviance to break out of its current preoccupation with public health into domains such as agriculture, education, and urban planning. In turn, positive deviance could provide a new and systematic basis for extracting real-world development impacts from big data.
Keywords: big data; developing countries; machine learning; mobile data; positive deviance; systematic literature review

Integrating Big Data and Thick Data to Transform Public Services Delivery - Ang, Yuen Yuen (IBM Center for The Business of Government, 2019)
This report explains how public organizations can combine big data and thick data to transform public services delivery—a strategy called mixed analytics. Governments can greatly enhance the value of big data by combining it with “thick” data—rich qualitative information about users, such as their values, goals, and consumption behavior, obtained by observing or interacting with them in their daily lives. Big data holds great promise for improving public services delivery and innovation in government, but they are not a panacea . Having lots of data can be overwhelming or have little utility if the data are “thin”—that is, they lack meaning for users or fail to capture issues that matter most . By yielding insights into what citizens really care about and how they consume services, thick data can inform both the collection and analysis of big data. This report introduces the concept of “mixed analytics,” integrating big data and thick data to transform government decision making, public services delivery, and communication. The report presents three case studies of organizations that employ mixed analytics at the international, federal, and city level, respectively. Together, this research offers a set of transferable lessons for agencies at all levels of government: Lesson 1: Big data is a means to an end, rather than an end. Lesson 2: Thick data can identify unexpected problems or previously unexpressed needs. Lesson 3: Thick data can inform the analysis of big data. Lesson 4: Mixed analytics can offer both scale and depth. Lesson 5: Applying technology is a social activity, not an isolated technical task. Lesson 6: The best solutions are not always high-tech. The report concludes with five actionable recommendations for public managers. Make data and technology relevant to the people who use it. Leverage thick data at appropriate stages of the problem-solving process. Build an interdisciplinary team of quantitative and qualitative experts who work closely with stakeholders. Combine big and thick data to improve communication Improve government agencies’ knowledge of mixed research methods. This report builds on multiple past IBM Center reports about how government can leverage data and analytics to improve decisions, including Data-Driven Government: The Role of Chief Data Officers, by Jane Wiseman; Ten Actions to Implement Big Data Initiatives: A Study of 65 Cities, by Alfred Ho and Bo McCall, and Realizing The Promise of Big Data, by Kevin DeSouza. The report also complements several chapters that assess the past and potential use of data across the public sector in our recent book, Government For The Future: Reflection and Vision For Tomorrow’s Leaders. At a time when the US and other governments continue to enhance their use of data as a strategic asset for transformation, we hope that Professor Ang’s report provides useful insights for government managers and stakeholders.

Developmental Evaluation: How Barriers & Enablers Emerge Over Time - Baylor, Rebecca; Fatehi, Y. K.; Esper, H. (USAID, 2019)

Digital Development: Elements of a Critical ICT4D Theory and Praxis - Bon, Anna; Akkermans, Hans (Springer International Publishing, 2019)
In recent years, critical research literature in ICT4D has grown. It is widely accepted that theory is to inform practice. However, the inverse directionality, practice informs theory, is much less present in ICT4D, including in critical research. In this paper, we discuss ways how ICT4D research and theory may be better informed by practice—in terms of (i) recognizing praxis-oriented research paradigms and integrating their results, (ii) development of foundational theories, (iii) critical analysis of ICT4D emerging policies, and (iv) positioning ICT4D in the wider development debate. This suggests several elements or directions in which critical research has the potential to push current boundaries of ICT4D in terms of content as well as relevance.
Keywords: Action research paradigm; Critical research; Network complexity theory; Principles for Digital Development

Polycentric Systems of Governance: A Theoretical Model for the Commons - Carlisle, Keith; Gruby, Rebecca L. (Policy Studies Journal, 2019)
Polycentricity is a fundamental concept in commons scholarship that connotes a complex form of governance with multiple centers of semiautonomous decision making. If the decision-making centers take each other into account in competitive and cooperative relationships and have recourse to conflict resolution mechanisms, they may be regarded as a polycentric governance system. In the context of natural resource governance, commons scholars have ascribed a number of advantages to polycentric governance systems, most notably enhanced adaptive capacity, provision of good institutional fit for natural resource systems, and mitigation of risk on account of redundant governance actors and institutions. Despite the popularity of the concept, systematic development of polycentricity, including its posited advantages, is lacking in the commons literature. To build greater clarity and specificity around the concept, we develop a theoretical model of a polycentric governance system with a focus on the features necessary or conducive for achieving the functioning predicted by commons scholars. The model is comprised of attributes, which constitute the definitional elements, and enabling conditions, which specify additional institutional features for achieving functionality in the commons. The model we propose takes the concept a step further toward specificity without sacrificing the generality necessary for contextual application and further development.

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Purdue University, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Inclusive Social Accountability - Counterpart International (Counterpart International, 2019)
Counterpart International’s Inclusive Social Accountability (ISA) developmental framework integrates elements of social inclusion and community accountability into one comprehensive approach.

Large-Scale Transdisciplinary Collaboration for Adaptation Research: Challenges and Insights - Cundill, Georgina; Harvey, Blane; Tebboth, Mark; Cochrane, Logan; Currie‐Alder, Bruce; Vincent, Katharine; Lawn, Jon; Nicholls, Robert J.; Scodanibbio, Lucia; Prakash, Anjal; New, Mark; Wester, Philippus; et al. (Global Challenges, 2019)
An increasing number of research programs seek to support adaptation to climate change through the engagement of large-scale transdisciplinary networks that span countries and continents. While transdisciplinary research processes have been a topic of reflection, practice, and refinement for some time, these trends now mean that the global change research community needs to reflect and learn how to pursue collaborative research on a large scale. This paper shares insights from a seven-year climate change adaptation research program that supports collaboration between more than 450 researchers and practitioners across four consortia and 17 countries. The experience confirms the importance of attention to careful design for transdisciplinary collaboration, but also highlights that this alone is not enough. The success of well-designed transdisciplinary research processes is also strongly influenced by relational and systemic features of collaborative relationships. Relational features include interpersonal trust, mutual respect, and leadership styles, while systemic features include legal partnership agreements, power asymmetries between partners, and institutional values and cultures. In the new arena of large-scale collaborative science efforts, enablers of transdisciplinary collaboration include dedicated project coordinators, leaders at multiple levels, and the availability of small amounts of flexible funds to enable nimble responses to opportunities and unexpected collaborations.
Keywords: Climate change; collaboration; transdisciplinarity

Pocket Guide to Systems Wayfinding - Davidson, Seanna (The Systems School, 2019)

EvalC3 - Davies, Rick (2019)
Tools for developing, exploring and evaluating predictive models of expected outcomes

DFID Smart Rules: Better Programme Delivery - version X (2019.01) - DFID (DFID, 2019)

Breaking the Mould: Alternative approaches to monitoring and evaluation - Dillon, Neil (ALNAP, 2019)
This paper looks at a range of M&E innovations that are designed specifically to provide input to ongoing iterative decision-making and learning at the project level. It identifies three key areas for potential innovation: 1) timing of M&E data provision; 2) flexibility of M&E frameworks to evolve with programme change; and 3) approaches to integrate diverse perspectives on project implementation in a meaningful way. It then looks at a collection of approaches currently being used in each of these three areas through a series of ‘practice examples’, considering the key lessons learned. Finally, the paper discusses the major opportunities and challenges for applying and scaling up the use of these approaches inside the humanitarian sector.

Back to the Drawing Board: How to improve monitoring of outcomes - Dillon, Neil; Sundberg, Amelie (ALNAP Paper, 2019)

Towards an evidence base on the value of social learning-oriented approaches in the context of climate change and food security - Epp, Marissa Van; Garside, Ben (Environmental Policy and Governance, 2019)
Attention to social learning's potential to improve development outcomes in the context of climate change and food security challenges is growing. Yet evidence supporting the wide range of assertions about the outcomes of social learning processes is insufficient. More work is needed to understand when and how a social learning-oriented approach is effective. We respond to the gap in evidence by piloting the Climate Change and Social Learning initiative's monitoring and evaluation framework for social learning. Our objectives are to begin building an evidence base and to test the theory of change behind the framework. Using a peer-assist approach, we apply the framework to eight case studies in partnership with five initiatives. We analyse trends in evidence gathered across the case studies in four dimensions of social learning (engagement, iterative learning, capacity development, and challenging institutions) along three dimensions of change (process, learning outcomes, and changes in values and practice).
Keywords: Climate change adaptation; Monitoring and Evaluation; Social learning; food security

Urban climate change adaptation as social learning: Exploring the process and politics - Fisher, Susannah; Dodman, David (Environmental Policy and Governance, 2019)
Responses to climate change that build on adaptive natural resource management conceptualise social learning processes as having the potential to form a key component of climate adaptation. Social learning processes represent a way of managing the inherent uncertainties and interconnectedness of adaptation issues through ongoing learning, iterative reflection, and change of responses over time. Although the theoretical case is emerging for social learning as adaptation, there is limited empirical evidence of how these processes play out as local governments engage in urban adaptation planning. This paper starts to address this gap by examining social learning processes in two cities in India. We show how the social learning processes interact with complex governance contexts in the two cities and how evidence of outcomes is emerging across individuals, networks, and systems. We go on to argue that there are several areas of social learning that need further theorisation to support its application in the urban context. First, theories of social learning need to allow for unequal power relationships to continue to shape learning processes and take into account structural and historical dynamics as well as relational forms of power. Second, the way that scale is understood needs to be reopened as a point of analysis to understand how scalar concepts are used by actors to frame and locate problems and solutions rather than being understood as fixed and immutable.
Keywords: Climate change; India; Social learning; governance; urban planning

Empowerment and Accountability in difficult settings: What are we learning? - Gaventa, John; Oswald, Katy (Key messages emerging from theAction for Empowerment and Accountability Programme, 2019)
Empowerment and Accountability in Difficult Settings: What Are We Learning? Key Messages Emerging from the Action for Empowerment and Accountability Programme Empowerment and accountability have long been part of the international development vocabulary and a core part of governance, social development and civil society programmes. Yet, much of what has been learnt about these approaches has been drawn from studies in somewhat stable, open and middle-income places around the world. Less is known about how empowerment and accountability are achieved through social and political action in more difficult settings – those faced by institutional fragility, conflict, violence, and closing civic space. This document highlights key messages emerging from the work of the Action for Empowerment and Accountability Research Programme (A4EA), and the implications for how donors, policy makers and practitioners support strategies for empowerment and accountability in fragile, conflict and violence affected settings (FCVAS). Our eight key messages have strong implications for the theories of change used for effective programming in the field.

Adaptive Management Practice in the UK Government - The MUVA case - HLS (Human Learning Systems, 2019)
Case study about the MUVA programme in Mozambique. (Maybe it "misses the point of AP which is not learning for learning. Is learning for impact. The word impact doesn’t even come up once!") Adaptive Management programming within the Foreign & Commonwealth Development Office demonstrates that the UK Government has examples of optimising for learning within its existing management practice. However, currently, the adaptive management practices are unhelpfully framed by an approach which limits both their effectiveness and scope. The programmes use learning as their metastrategy. They succeed in connecting practicebased learning with strategic learning, and make a shift towards reframing accountability as accountability for learning. This learning strategy is enabled by funding and contract management arrangements which prioritise learning. Both at macro-level of programme management and micro level of de-risking experimentation and enabling necessary failure by decoupling people’s job security from potential failure.

When Reporting Undermines Performance: The Costs of Politically Constrained Organizational Autonomy in Foreign Aid Implementation - Honig, Daniel (International Organization, 2019)

Monitoring and Result Measurement for Adaptive Programming - How to Use Data to Manage a MSD Program: Lessons from PRISMA - Khan, Khaled; Seely, Kevin; Ridwan, Mustika; Mulya, Bodhiya (PRISMA, 2019)
Using monitoring data to improve interventions is harder than it seems. Decision-makers are often busy implementing activities, unclear about their roles in data collection and analysis, and uncertain what data matters most or when. PRISMA, an AUD77 million agricultural Market Systems Development (MSD) programme funded by DFAT Australia, has encountered these challenges. With the programme completing its first five year phase, this case study shares ten key lessons divided into three sections: shaping the culture, developing systems, and top management decisions. These lessons aim to help program, sector and intervention managers make better use of monitoring data to improve interventions.

Joint Programming in Conflict-Affected and Fragile States - Koenig, Sibylle; Brusset, Emery (Joint Programming - EU, 2019)
On the Joint Programming Practices from the EU in fragile settings

Community-based monitoring of Indigenous food security in a changing climate: Global trends and future directions - Lam, Steven; Dodd, Warren; Skinner, Kelly; Papadopoulos, Andrew; Zivot, Chloe; Ford, James; Garcia, Patricia J.; Team, IHACC Research; Harper, Sherilee L. (Environmental Research Letters, 2019)
Climate change is expected to exacerbate existing food security challenges, especially in Indigenous communities worldwide. Community-based monitoring is considered a promising strategy to improve monitoring of, and local adaptation to climatic and environmental change. Yet, it is unclear how this approach can be applied in food security or Indigenous contexts. The objectives of this paper are to: 1) review and synthesize the published literature on community-based monitoring of Indigenous food security; and, 2) identify gaps and trends in these monitoring efforts in the context of climate change. Using a systematic search and screening process, we identified 86 published articles. To be included, articles had to be published in a journal, describe a community-based monitoring system, describe any aspect of food security, and explicitly mention an Indigenous community. Relevant articles were thematically analyzed to characterize elements of community-based monitoring in the context of climate change. Results show that the number of articles published over time was steady and increased more than two-fold within the last five years. The reviewed articles reported on monitoring mainly in North America (37%) and South America (28%). In general, monitoring was either collaborative with local communities (51%) or externally-driven (37%), and focused primarily on tracking wildlife (29%), followed by natural resources (16%), environmental change (15%), fisheries (13%), climate change (9%), or some combination of these topics (18%). This review provides an evidence-base on the uses, characteristics, and opportunities of community-based monitoring, to guide future food security monitoring efforts in the context of climate change.

Supporting users with the OutNav approash - Matter of Focus (2019)
This report has been generated in OutNav, using the theory-based approach to evaluation pioneered by Matter of Focus. Example of a report from the tool, explaining OutNav approach

Thinking and Working Politically: Learning from practice. Overview to Special Issue - McCulloch, Neil; Piron, Laure-Hélène (Development Policy Review, 2019)
Over the last 15 years, a set of ideas now referred to as “thinking and working politically” (TWP) has coalesced into a “second orthodoxy” about how to take context into account when implementing development interventions. This approach stresses the importance of obtaining a better understanding of the local context (“thinking politically”) in order to support local actors to bring about sustainable developmental change (“working politically”). However, the evidence base to justify this new approach remains thin, despite a growing number of programmes which purport to be implementing it. Officials in development agencies struggle with putting it into practice and it is unclear how TWP differs—or not—from similar approaches, such as Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). This Special Issue sheds light on what TWP means in practice by examining a set of initiatives undertaken by both development partners and government departments in Nigeria, the Occupied Palestinian Territories, China and India. This overview article outlines, in brief, each of the Special Issue's four papers and then draws out five lessons—for funders and for practitioners—from across all the papers. Our five lessons are: (1) the fundamental importance of undertaking political economy analysis (PEA) to adapt programmes to their contexts; (2) the importance of having a realistic level of ambition for interventions; (3) the need to support local ownership—not just “agreement ownership” (between a donor agency and government) or local “management ownership” of the programme, but critically “driver ownership” by generating trust with the key local actors driving change; (4) the need for a more effective set of tools for measuring results in complex programmes that attempt to achieve improvements in long-run governance; and, (5) that although the political economy of donors is often seen as a barrier to applying TWP, the articles show how much can be done with a TWP approach if the analysis takes into account the political economy of donors as well as that of the local context. We conclude with a set of operational recommendations for donors and implementors, as well as suggestions of avenues for further research.
Keywords: Adaptation; Development programmes; Political economy analysis; Reform space; thinking and working politically

DAC Peer Review of Switzerland - 2019 - OECD (OECD, 2019)

Evaluation of development programmes - OECD - OECD (2019)
Data & research on evaluation of development programmes inc. paris declaration, budget support, multilateral effectiveness, impact evaluation, joint evaluations, governance, aid for trade

Planning & Navigating Social Change - Tools for Pacific voyagers - Orr, Douglas Epeli; Cavatore, Maria; Aston, Tom (Oxfam, 2019)
Those working to advance social change in the Pacific must understand, work with and respond to the complex and changing relationships and dynamics of power that exist within such networks, and situate their work in the context of decolonisation and self-determination. But the approaches typically used by NGOs to plan our projects and programs have failed to give due attention to these dynamics. The result is that our projects fall short of achieving their promise, despite being technically sound and logical. In this guide, we aim to provide a process and tools that prioritise and draw out the rich, often implicit, knowledge that Pacific Islanders have about our contexts to plan and manage social change initiatives in a manner that values and responds to this ocean of relationships. Drawing from these relationship-based and voyaging traditions, we emphasise the need to: • frame change in terms of change in people; e.g. change in the situation of groups of people and change in terms of the actions of people; • identify a course towards a particular ‘change destination’; • identify the signs to read that will help you determine where you are on that course; • be constantly attentive to the context as you make the journey, and • be ready to adjust your course in response to changes in your context. To support this way of working, we have selected a number of tools from approaches that we believe fit. In particular, we have drawn from the following approaches: • Thinking and Working Politically and other ‘politically aware’ approaches that recognise that the success of a development initiative will be determined by the interplay of relationships of power within a particular context, not just by having the right technical solution; • Outcome mapping because of its focus on people and relationships, and on identifying and supporting needed changes in the behaviour of specific actors in relation to others. This is key, because it’s individuals who deliver services, individuals who decide whether to allocate budget and resources to address a problem, and individuals who make the choice to believe whether a service is relevant to solving their issues; • Adaptive management because of its recognition that development initiatives take place within complex and changing systems and need to adjust to these and that this requires ongoing learning and adaptation.

Monitoring And Evaluation Tools and Approaches to Support Adaptive Management - Pasanen, Tiina (GLAM, 2019)

The Rapid Evaluation, Action, and Learning (REAL) Approach: A toolkit to measure and refine changes and interventions in health campaigns - PATH (PATH, 2019)
Evaluative Tools for Improving Campaign Effectiveness Public health campaigns aim to control disease or deliver essential health services and products through time-limited and periodic channels. Many countries use campaigns to augment or replace routine service delivery, to target certain populations, or to accelerate progress towards coverage targets. The Root Cause Analysis and Rapid Evaluation, Action, and Learning toolkits present a systematic but flexible approach to identifying the root causes of campaign bottlenecks and then designing, testing, and refining solutions to optimize potential impact. These toolkits respond to a growing need for “fit-for-purpose” rapid-testing, adaptive learning approaches to evaluation and the need for a culture shift toward iterative adaptation and improvement that integrates measurement and evidence-informed decision-making into daily practice. The comprehensive package of toolkits, in addition to the individual Root Cause Analysis toolkit and Rapid Evaluation, Action, and Learning toolkit are available below.

Identifying general trends and patterns in complex systems research: An overview of theoretical and practical implications - Preiser, Rika (Systems Research and Behavioral Science, 2019)
Research on complex systems is becoming more prolific, and there is a need to provide some point of orientation to researchers and practitioners that are drawing on the body of literature that informs the field of complexity research. In this paper, I aim to give an overview of the development of the field and offer some overarching trends and patterns that are recognizable in research on complex systems. The paper then draws on the work to provide six organizing principles of complex systems to inform practical implications and methods for studying and understanding complex systems.
Keywords: complex systems; heuristics; trends and patterns

Defining and using evidence in conservation practice - Salafsky, Nick; Boshoven, Judith; Burivalova, Zuzana; Dubois, Natalie S.; Gomez, Andres; Johnson, Arlyne; Lee, Aileen; Margoluis, Richard; Morrison, John; Muir, Matthew; Pratt, Stephen C.; Pullin, Andrew S.; et al. (Conservation Science and Practice, 2019)
There is growing interest in evidence-based conservation, yet there are no widely accepted standard definitions of evidence, let alone guidance on how to use it in the context of conservation and natural resource management practice. In this paper, we first draw on insights of evidence-based practice from different disciplines to define evidence as being the “relevant information used to assess one or more hypotheses related to a question of interest.” We then construct a typology of different kinds of information, hypotheses, and evidence and show how these different types can be used in different steps of conservation practice. In particular, we distinguish between specific evidence used to assess project hypotheses and generic evidence used to assess generic hypotheses. We next build on this typology to develop a decision tree to support practitioners in how to appropriately use available specific and generic evidence in a given conservation situation. Finally, we conclude with a discussion of how to better promote and enable evidence-based conservation in both projects and across the discipline of conservation. Our hope is that by understanding and using evidence better, conservation can both become more effective and attract increased support from society.
Keywords: Adaptive Management; Evidence-based conservation; Evidence-based practice; Natural resource management; Project management; biodiversity; environmental evidence

What is Uncertainty and Why Does it Matter? - Scoones, Ian (STEPS Working Paper 105, 2019)
Uncertainty defines our times. Whether it is in relation to climate change, disease outbreaks, financial volatility, natural disasters or political settlements, every media headline seems to assert that things are uncertain, and increasingly so. Uncertainty, where we do not know the probabilities of either likelihoods or outcomes, is different to risk, the implications of which are explored in this paper through five different ways of thinking about uncertainty, derived from highly diverse literatures encompassing societal, political, cultural, practice and individual perspectives. The paper continues by examining how these perspectives relate to four domains: finance and banking; critical infrastructures; disease outbreaks and climate change; natural hazards and disasters. Reflecting on these experiences, the paper argues that embracing uncertainty raises some fundamental challenges. It means questioning simple, linear perspectives on modernity and progress. It means rethinking expertise and including diverse knowledges in deliberations about the future. It means understanding how uncertainties emerge in social, political and economic contexts, and how uncertainties affect different people, depending on class, gender, race, age and other dimensions of social difference. And, if uncertainty is not reducible to probabilistic risk, it means a radically different approach to governance; one that rejects control-oriented, technocratic approaches in favour of more tentative, adaptive, hopeful and caring responses. The paper concludes by asking whether we can learn from those who live with and from uncertainty – including pastoralists in marginal settings – as part of a wider conversation about embracing uncertainties to meet the challenges of our turbulent world.

Managing and Adapting a development program: Lessons from PRISMA - Seely, Kevin (PRISMA, 2019)
This case study is part of the AIP-Rural Learning Series. Funders and implementers of international development programs largely agree that adaptive management is industry best practice. Most development experts also broadly agree on what ‘adaptive management’ means. In this case study, we use a common definition of ‘adaptive management’, including the following features: Flexibility. Implementers create, modify and drop interventions when circumstances change or new information emerges, in order to tailor strategies to context and maximise impact. Purposeful experimentation. Implementers test different activities at the same time, monitoring them to learn what will achieve the desired impact. Since 2015, the number of publications calling for and praising adaptive management in development programs has grown fast. These publications give us an idea of the state of adaptive management in development programs. They reveal progress in some areas, such as tailoring interventions to local context and using evidence for decision-making. Yet they also reveal multiple, ongoing, real-world constraints to adaptive management. This case study explores how one development program, PRISMA, has avoided and overcome some of these constraints, whilst continuing to battle others. Four major constraints revealed in the adaptive management literature are discussed in this case study: Programs are designed in ways that make it hard to adapt interventions, target regions or sectors based on new learning or changing circumstances. Programs struggle to create an organisational culture that encourages learning and adapting. When staffing programs, recruiters prioritise sectoral expertise and length of experience over adaptive managerial competence. Program managers face pressures to spend their budgets predictably and before their program ends. Learning and testing take time and cost little, so managers feel pressure to deprioritise them. The first of these constraints is explored in the next section, ‘Design’, which looks at how the selection of target sectors and performance targets affects PRISMA implementers’ ability to manage adaptively. The third section, ‘Organisational Culture’, shares lessons on encouraging staff to test and improve interventions. Section 4, ‘Staffing’, looks at hiring adaptive managers, and freeing up their time to improve interventions. The final section summarises this case study’s key lessons. Throughout this paper, findings are based on 16 in-depth interviews with PRISMA’s junior, mid-level and senior staff, and its funders. To contextualise these findings, the authors reviewed the ‘adaptive management’ literature, and drew on their experience with development programs worldwide.

Agile distributed software development in nine Central European teams: challenges, benefits and recommendations - Stadler, Manuel; Vallon, Raoul; Pazderka, Martin; Grechenig, Thomas (Information Technology, 2019)

Doing adaptive management at Sida - Tim Ruffer; Helen Bailey; Stefan Dahlgren; Patrick Spaven; Mark Winters (Evaluation Brief, 2019)
Lessons from the market systems development approach The evaluation focuses on Sida’s management of MSD projects. The projects are applying the MSD approach with an aim to: - contribute to improved MSD programming by Sida through better management practices across the project cycle - generate recommendations on how Sida can create conducive conditions for systems approaches and adaptive programming more generally. The brief assesses Sida’s organisational capacity for adaptive management in three dimensions: - leadership and culture - staff capacities - skills, and systems and procedures

How should donors manage adaptively? Market Systems Development as a case study. - Itad (Itad, 2018)
Itad has recently completed a strategic evaluation for Sida to help them work through how they can best manage programmes that are adaptive and apply systems approaches - the conclusions from the evaluation about what funders need to do to manage adaptively are of broader relevance.

Working the System: What We’ve Learned About Strengthening Accountability - Nugent, Sarah (Chemonics International, 2018)
When designing a new project, how often do we set out to strengthen a particular actor’s or institution’s ability to “hold government to account?” What does that mean exactly? Maybe the better question to ask is: what is the most effective way to strengthen accountability in our development work? And then, what does it look …

Debiasing: a systematic discipline and delight for development professionals - Chambers, Robert (Institute of Development Studies, 2018)
Do we really need debiasing, yet another word?  Yes, unless anyone can improve on it, because we need a word to describe a rigorous discipline we development professionals need for grounded realism. This has been coming on me slowly. But now explorations and ‘aha!’ moments in India have accumulated and combined into an epiphany.  For […]

Transformative Networks Are Multiscalar - Holley, June (NetworkWeaver, 2018)
This is an excerpt from the Network Weaver Handbook. I’ll be writing an update with my latest research and thinking on the topic in the coming weeks so stay tuned!     June Holley How does tr…

Was bedeutet “Staying Engaged” im Kontext der aktuellen Krise in Nicaragua? Überlegungen und Strategien der ALAK (Internal memo) - SDC (SDC, 2018)
«Mitigation» (im Sinne von Notlinderung) und «Transformation» sind die zwei Schlagworte, an welchen sich die Neuausrichtung des Portfolios in Nicaragua über die nächsten Monate orientieren wird. Ziel ist es, dass die Schweiz ihr über die letzten Jahrzehnte akquiriertes politisches Kapital und ihre Expertise nutzt, um zu einer Linderung der Auswirkung der Krise für die Bevölkerung beizutragen und mithilft die Grundlagen für eine Transformation der politischen Kultur und eine langfristig angelegte Demokratisierung zu schaffen.

Doing Development Differently in the Global South - Workshop Report - CARE (CARE and British Council, 2018)

Seeking balanced ownership in changing development cooperation relationships - Keijzer, Niels; Klingebiel, Stephan; Örnemark, Charlotte; Scholtes, Fabian (Rapport 2018:08, 2018)
According to the Paris Declaration and the 2030 Agenda, ownership is a prerequisite for effective development cooperation. How can the principle of ownership be promoted in today’s complex development cooperation, in which the numbers of actors have increased? This is the subject of the Expert Group for Aid Studies report Seeking balanced ownership in changing development cooperation relationships. The report contains two country case studies – on Liberia and Rwanda – as well as interviews with the Swedish International Development Cooperation Agency (Sida) and the Ministry for Foreign Affairs, and studies on documents concerning ownership in a Swedish development cooperation context. The authors note that ownership remains relevant as a guiding principle in international development cooperation. The trend from country-to-country cooperation to various forms of support through UN bodies and specialised global funds has created new conditions and competing interests for ownership. An understanding of ownership and how it can be promoted in the complex reality of today needs to be thoroughly re-examined. The study recommends the following: 1. Starting a discussion within the OECD-DAC on effective development cooperation that has global ownership right up to the end of the process. 2. Establishing an international code of conduct in accordance with agreed ownership principles concerning development cooperation funding to and via UN bodies and global funds. 3. Sweden should formulate an explicit policy and approach for how to promote ownership in development cooperation that includes numerous partners.

Modern Slavery Prevention and Responses in South Asia: An Evidence Map - Oosterhoff, Pauline; Yunus, Raudah; Jensen, Charity; Somerwell, Francis; Pocock, Nicola (DFID, 2018)
The Asia Pacific region has the highest numbers of both slavery and child labour victims in the world. The International Labour Organization (ILO) estimates that 16.5 million and 8.4 million persons were in situations of forced labour and forced marriage respectively in Asia Pacific, among 40.3 million in modern slavery globally (ILO & Walk Free Foundation 2017). Although there is a growing body of research and evaluations on specific sub-sectors and interest in the worst forms of labour exploitation, there has not yet been a systematic scoping or synthesis of studies that would help policymakers understand ‘what works’ to reduce the prevalence of “Modern Slavery”2(MS) in the countries of interest to DFID (India, Nepal, Bangladesh, Pakistan). India alone is estimated to have the largest number of people in modern slavery in the world with nearly 8 million persons living in modern slavery, followed by 3.2 million, 592,000 and 171,000 in Pakistan, Bangladesh and Nepal respectively (Walk Free Foundation 2018). While systematic reviews on interventions to reduce prevalence of trafficking, forced or bonded labour or slavery exist, these have not focused on the target countries of interest to DFID. Previous systematic reviews have focussed on particular types of MS, such as cross border sexual exploitation globally (van der Laan et al. 2011), labour exploitation in Europe (Cockbain et al. 2018) or community based interventions for safer migration programming in low and middle income countries (LMICs) (Zimmerman et al. 2016). Several systematic reviews focus specifically on health needs and post-trafficking care or interventions (Ottisova et al. 2016; Muraya & Fry 2016; Hemmings et al. 2016; Dell et al. 2017), and research methods and tools used in trafficking in persons (TIP) and health research (Cannon et al. 2018; Doherty et al. 2016). A recent global review and evidence map of MS interventions found some interventions in the target countries, but the outcomes were not specified (Bryant & Joudo 2018). In this Evidence Map, we address this gap in evidence for India, Nepal, Bangladesh and Pakistan specifically, scoping the range of Modern Slavery interventions and outcomes for specific target populations (survivors, employers, landlords, services providers, criminal justice officials) and at different levels (individual, community, state). This map is foremost targeted to DFID and its partners in India, Nepal, Bangladesh and Pakistan to inform evidence-based policy making. We hope that it is also useful to academics and practitioners working to address modern slavery, or in intervention areas or locations described.

Evaluation of the market systems development approach: Lessons for expanded use and adaptive management at Sida Volume I: Evaluation Report - Ruffer, Tim; Bailey, Helen; Dahlgren, Stefan; Spaven, Patrick; Winters, Mark (Evaluation of the market systems development approach, 2018)
This report presents the findings of an evaluation of Sida’s management of the market systems development (MSD) approach. It aims to inform thinking on how Sida can best manage its growing portfolio of MSD programs. Beyond this, it provides insights relevant to Sida’s wider support to complex and adaptive programs. The evaluation identified several factors that affect Sida’s ability to ensure that conducive conditions are in place for effective MSD programs and good development programming more generally. Sida’s relatively flexible framework of rules, guidelines and systems for project management provide the space needed for staff to innovate and manage adaptively. But for this to happen consistently and effectively, Sida needs to invest more deliberately in building the capacity of its staff in relevant areas. In addition, leadership and incentives are key to shaping a culture of active experimentation and learning. This needs to be supported with clearer guidance for those involved in the design and appraisal of MSD projects; and strengthened oversight of project performance, including through adjustments to Sida’s contracts and funding agreements.

Evaluation of the market systems development approach: Lessons for expanded use and adaptive management at Sida Volume II: Case studies - Ruffer, Tim; Bailey, Helen; Dahlgren, Stefan; Spaven, Patrick; Winters, Mark (Evaluation of the market systems development approach, 2018)
This report presents the findings of an evaluation of Sida’s management of the market systems development (MSD) approach. It aims to inform thinking on how Sida can best manage its growing portfolio of MSD programs. Beyond this, it provides insights relevant to Sida’s wider support to complex and adaptive programs. The evaluation identified several factors that affect Sida’s ability to ensure that conducive conditions are in place for effective MSD programs and good development programming more generally. Sida’s relatively flexible framework of rules, guidelines and systems for project management provide the space needed for staff to innovate and manage adaptively. But for this to happen consistently and effectively, Sida needs to invest more deliberately in building the capacity of its staff in relevant areas. In addition, leadership and incentives are key to shaping a culture of active experimentation and learning. This needs to be supported with clearer guidance for those involved in the design and appraisal of MSD projects; and strengthened oversight of project performance, including through adjustments to Sida’s contracts and funding agreements.

Volume 3: Participatory Monitoring, Evaluation, and Learning in Complex Adaptive Environments - SACE (SACE Program, 2018)
This volume is the last in a series of papers about systems approaches in complex environments, which includes the use of the collective impact model to address large-scale social problems, and the application of participant-driven MEL techniques across 17 networks of civil society organizations. It is based on the experiences of Root Change and Chemonics, two development partners working on a USAID civic engagement project in Nigeria (2013-2018), as well as hundreds of civil society organization partners. This is the final paper in the series and aims to highlight how the adaptation of participatory monitoring, evaluation, and learning techniques (e.g., most significant change, outcome mapping, and outcome harvesting) evolved and ultimately empowered cluster members. The first paper in the series presented a brief introduction to systems approaches in advocacy settings, the SACE theory of change, and the scope of Root Change’s work as technical lead on capacity building and measurement. The second volume aims to address the innovative use of the advocacy strategy matrix, adapted from work by the Center for Evaluation Innovation, for collective impact and the Collective Impact Model, an approach that engages multiple players in working together to solve complex social problems.

Acquisition and Assistance Strategy - USAID (USAID, 2018)
The U.S. Agency for International Development (USAID) of tomorrow is one in which the Agency enables partner countries to plan, resource, and manage their own development through strengthened capacity and commitment — this is the essence of the Journey to Self-Reliance. In Fiscal Year (FY) 2018, the Agency obligated over 80 percent of its programmatic funding — a total of $17 billion — through acquisition and assistance (A&A) mechanisms. Partnering and procurement are central to how we do our work. Therefore, we must think holistically about with whom we work and how we work, if we are to achieve our ambitious goals for the USAID of tomorrow. The purpose of this document is to provide a transparent strategy that guides changes to Agency policy and practice for both our staff and implementing partners in how we approach our core A&A work. This strategy, which builds on previous and current reform efforts, outlines the shifts we will make to embrace a self-reliance model for A&A and move concretely toward the goal of ending the need for foreign assistance. GUIDING PRINCIPLES OF PARTNERING AT USAID USAID’s partnering approaches have evolved significantly over time as we have tested new and innovative ways of working. The principles outlined below support the Journey to Self-Reliance by empowering our staff and partners to produce results-driven solutions responsive to partner country needs and priorities — building capacity and commitment based on creative and entrepreneurial approaches that have already begun to develop. The Agency must move beyond our traditional approaches to embrace greater collaboration, co-design, and co-financing to improve upon our models of partnering.

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of PERL, Nigeria - Punton, Melanie; Burge, Richard (Action for Empowerment and Accountability Research Programme, 2018)
This paper examines adaptive approaches to aid programming in Nigeria. Through field research and desk reviews, we have investigated some of the assertions around the ‘adaptive management and programming’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blueprint and linear project plans. This is the second of three case studies in a series which explore if and how adaptive approaches, including rapid learning and planning responses, are particularly relevant and useful for promoting empowerment and accountability in fragile, conflict and violence-affected settings (FCVAS). This case study focuses on PERL (Partnership to Engage, Reform and Learn) in Nigeria, a five-year governance programme (2016-21) with a total budget of £100 million. It aims to promote better service delivery through bringing together government and citizens groups to collectively address governance challenges. PERL is viewed by DFID as the final stage of a 20-year investment, building on learning, experience and partnerships from 15 years of DFID-funded governance programming in Nigeria. It was designed to incorporate learning and adaptation through a ‘living’ theory of change, continuous political economy analysis at different levels, adaptive implementation by location-based delivery teams who are encouraged to be flexible and let partners take the lead, regular learning and reflection, and adaptive resourcing, HR and administrative systems. The case study draws on a conceptual framework (the ‘adaptive triangle’) that looks at three types of adaptation – adaptive management, adaptive programming and adaptive delivery – and the interconnections and tensions between them.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Parliament and the people - Rumbul, Rebecca; Moulder, Gemma; Parsons, Alex (2018)
How digital technologies are shaping democratic information flow in Sub-Saharan Africa

Evaluation and learning in complex, rapidly changing health systems: China’s management of health sector reform - Xiao, Yue; Husain, Lewis; Bloom, Gerald (Globalization and Health, 2018)
Healthcare systems are increasingly recognised as complex, in which a range of non-linear and emergent behaviours occur. China’s healthcare system is no exception. The hugeness of China, and the variation in conditions in different jurisdictions present very substantial challenges to reformers, and militate against adopting one-size-fits-all policy solutions. As a consequence, approaches to change management in China have frequently emphasised the importance of sub-national experimentation, innovation, and learning. Multiple mechanisms exist within the government structure to allow and encourage flexible implementation of policies, and tailoring of reforms to context. These limit the risk of large-scale policy failures and play a role in exploring new reform directions and potentially systemically-useful practices. They have helped in managing the huge transition that China has undergone from the 1970s onwards. China has historically made use of a number of mechanisms to encourage learning from innovative and emergent policy practices. Policy evaluation is increasingly becoming a tool used to probe emergent practices and inform iterative policy making/refining. This paper examines the case of a central policy research institute whose mandate includes evaluating reforms and providing feedback to the health ministry. Evaluation approaches being used are evolving as Chinese research agencies become increasingly professionalised, and in response to the increasing complexity of reforms. The paper argues that learning from widespread innovation and experimentation is challenging, but necessary for stewardship of large, and rapidly-changing systems.

Connect. Learn. Adapt. Repeat - Practicing adaptive management in complex, conflict-affected environments: barriers and promising practices - Queen, Emily Forsyth (2018)
To shift aid culture toward adaptive management, we can: - Stay humble, empathetic, and build skills in facilitation and listening. - Focus on working with more flexible foundations or individual donors. Or, work for more rigid donors and help make their policies more flexible. - Get clearer about goals and processes while finding ways to be less specific and more committed to local leadership about pathways to get to the goal. - Resist looking for a magic adaptive management tool and instead get clearer about when teams make what kinds of decisions and matching to tools that support that decision-making. - Validate that everyone’s perspective is a form of data and try out simple ways to document how teams learns and changes. - Broaden and ground the idea of expertise – remembering that, especially when working with folx on the margins, people are the only experts on their own life. Practitioners must also examine how dominant patriarchal, white supremacist, colonial ideas have pushed us toward wanting more control, less flexibility, and less space for equitable decision making.

Revisiting the Foundational Assumptions of Fiscal Transparency and Accountability Work - Carothers, Thomas; Brechenmacher, Saskia (International Budget Partnership, 2018)
The Fiscal Futures team recently updated the foundational assumptions of fiscal transparency and accountability work to fit today’s world. Learn more.

Old Wine in New Bottles? 6 ways to tell if a programme is really ‘doing development differently’ - Green, Duncan (From Poverty to Power, 2018)
Some top adaptive management exponents give their top tips on how to distinguish spin from reality, when looking at an avowedly AM programme

Sample criteria to select case studies for evaluation - Methods Lab (2018)
Time and budget constraints often mean that organisations are unable to evaluate all of their programmes, and large programmes, operating in multiple locations, are unable to evaluate all project sites. This tool introduces two sets of criteria to support evaluators and programme managers to select case studies or programmes for evaluation: i) information about how relevant or feasible evaluation is for individual programmes, and ii) across the overall portfolio, strategic thinking around what types of cases are most important to understand. This tool was developed by Anne Buffardi, Irene Guijt, Simon Hearn and Tiina Pasanen for use in The Methods Lab projects.

Guidance: Rigor and Reproducibility in Grant Applications | grants.nih.gov - NIH (National Institutes of Health, 2018)

Getting Past the Rhetoric #2: Managing for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

USAID ADS 201 - Program Cycle Operational Policy (Update 10/29/2018) - USAID (USAID, 2018)

Course: Introduction to Collaborating, Learning and Adapting (CLA) in the Program Cycle - USAID LEARN (USAID Learning Lab, 2018)

Getting Past the Rhetoric #1: Tendering for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

Advancing Work with the Grain at USAID - Jacobstein, David (USAID Learning Lab, 2018)
In December 2017, I wrote a blog about some of the insights gained during a workshop on Context-Driven Adaptation, where many of our sharpest field officers shared the ways that they assessed and adapted to shifts in context to keep programming relevant and effective.

Outcome Mapping FAQs - Outcome Mapping Learning Community (Outcome Mapping, 2018)
FAQ resource produced by IDRC's Evaluation Unit, with contributions from Kaia Ambrose, Sarah, Earl, Jan Van Ongevalle and Julius Nyangaga. We've added it here to answer some of your OM related questions.

Putting Gender into Political Economy Analysis: why it matters and how to do it - Brown, Emily; Haines, Rebecca; O’Neil, Tam (From Poverty to Power, 2018)
Gender specialists from Oxfam and Care introduce a new guide that covers both theory and practice of including gender in political economy analysis.
Keywords: Gender

Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective - Sweetman, Roger; Conboy, Kieran (Project Management Journal, 2018)
While agile approaches can be extremely effective at a project level, they can impose significant complexity and a need for adaptiveness at the project portfolio level. While this has proven to be highly problematic, there is little research on how to manage a set of agile projects at the project portfolio level. What limited research that does exist often assumes that portfolio-level agility can be achieved by simply scaling project level agile approaches such as Scrum. This study uses a complex adaptive systems lens, focusing specifically on the properties of projects as agents in a complex adaptive portfolio to critically appraise current thinking on portfolio management in an agile context. We then draw on a set of 30 expert interviews to develop 16 complex adaptive systems (CAS)-based propositions as to how portfolios of agile projects can be managed effectively. We also outline an agenda for future research and discuss the differences between a CAS-based approach to portfolio management and traditional approaches.

Enabling collaborative synthesis in multi-partner programmes - Cochrane, Logan; Cundill, Georgina (Development in Practice, 2018)
Multi-partner consortia have emerged as an important modality for knowledge generation to address complex sustainability challenges. Establishing eﬀective multi-partner consortia involves signiﬁcant investment. This article shares lessons from the Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA), which aims to support policy and practice for climate change adaptation through a consortium model. Key lessons include the need to facilitate collaborative spaces to build trust and identify common interests, while accepting that this is not a guarantee of success; the importance of programmatic leadership to achieve synthesis; and the value of strategic planning in supporting motivation and alignment between partners.

Representing theories of change: technical challenges with evaluation consequences - Davies, Rick (Journal of Development Effectiveness, 2018)
This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.
Keywords: Evaluation; evaluability; representation; theory of change

Timely evaluation in international development - Webster, Jayne; Exley, Josephine; Copestake, James; Davies, Rick; Hargreaves, James (Journal of Development Effectiveness, 2018)
Impact and process evaluations are increasingly used in international development; however they are generally retrospective in outlook. A more timely approach to evaluation aims to identify necessary, feasible and effective changes during a programme or intervention’s lifetime. This paper aims to identify, categorise, describe and critically appraise methods to support more timely evaluation in international development. Potential methods were identified through scoping seminar, public symposium, targeted review of the literature, and the authors’ own experiences and opinions. Findings from the different data sources were reviewed collectively by the author group and triangulated to develop an analytical framework. We identified four purposes of timely evaluation for international development, and critiqued the use of approaches against four dimensions of timeliness and flexibility. Whilst we found significant interest in more timely approaches to evaluation in international development, there was a dearth of published empirical evidence upon which to base strong recommendations. There is significant potential for timely evaluation to improve international development outcomes. New approaches to mixing and adapting existing methods, together with new technologies offer increased potential. Research is needed to provide an empirical evidence base upon which to further develop the application, across sectors and contexts, of timely evaluation in international development.
Keywords: Adaptive learning; Outcome evaluation; Programme improvement; impact evaluation

Understanding and governing learning in sustainability transitions: A review - van Mierlo, Barbara; Beers, Pieter J. (Environmental Innovation and Societal Transitions, 2018)
Many transitions scholars underscore the importance of learning in sustainability transitions, but the associated learning processes have hardly been conceptualised. The diverse, well-established research fields related to learning are broadly ignored or loosely applied. In this paper, we systematically explore four interesting learning traditions in terms of their value for gaining an in-depth understanding of learning in sustainability transitions and their relevance for fostering learning, by connecting them to key features of transitions. The selected learning traditions from different disciplinary backgrounds provide valuable insights. None of them sufficiently addresses the complexity of transitions. They include, however, a diversity of relevant learning contexts. We conclude that they have value for investigating new areas such as learning in socio-technological regimes and in later phases of a transition, while enlightening forms of learning that have not yet been fully recognised in transition studies, such as superficial learning, unlearning, and learning to resist change.
Keywords: Collaborative learning; Interactive learning; Organizational learning; Social learning; Sustainability transition

Going Local 2.0: How to Reform Development Agencies to Make Localized Aid More Than Talk - Ang, Yuen Yuen (Stanford Social Innovation Review, 2018)
More and more global aid agencies believe they should replace one-size-fits-all best practices with locally tailored solutions, but they must shift from just agreeing to “go local” to preparing development experts for the task by taking on three major problems with their internal practices.

Bringing Participation into Complexity-Aware MEL: What is the evidence? - Apgar, Marina; Higdon, Grace Lyn (2018)

Gendered voices for climate action - Fisher, Susannah; Shakya, Clare (iied Working Paper, 2018)
Including local women and men who have experienced the impacts of climate change in decision-making forums is key to developing a just process hearing local voices and experiences. The Paris Agreement signs up the international community to delivering countrydriven, gender-responsive climate action. Including local women and men will be critical to this transition and to achieving the scale and pace of change needed through both procedural and distributional justice. However, there is scarce evidence on how these voices and experiences can impact on and strengthen climate responses, or how best to enable and facilitate this participation.

Caja de Herramientas PDIA - Un enfoque “hazlo tú mismo” para resolver problemas complejos - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
(Spanish version of he PDIA toolkit) The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

PDIA Toolkit - A DIY Approach to Solving Complex Problems - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

Learning from adaptive programmes - 10 lessons and 10 case studies - Valters, Craig (Overseas Development Institute, 2018)
Internal DFID document from the DevAdapt Programme. Based on another previous document (also internal).

Collective intelligence and achieving the Sustainable Development Goals - Mulgan, Geoff (nesta, 2018)
Collective intelligence and achieving the Sustainable Development Goals

Iterative Design and Monitoring for Adaptive Management: How Causal Link Monitoring can help - Britt, Heather; Hummelbrunner, Richard; Green, Jackie (Better Evaluation, 2018)
Development actors are embracing the concept and practice of adaptive management, using evidence to inform ongoing revisions throughout implementation. In this guest blog, Heather Britt, Richard Hummelbrunner and Jackie Greene discuss a practical approach that donors and partners can use to agree on what’s most important to monitor as a project continues to evolve.

A systematic review of adaptations of evidence-based public health interventions globally - Escoffery, Cam; Lebow-Skelley, E.; Haardoerfer, R.; Boing, E.; Udelson, H.; Wood, R.; Hartman, M.; Fernandez, M. E.; Mullen, P. D. (Implementation Science, 2018)
Adaptations of evidence-based interventions (EBIs) often occur. However, little is known about the reasons for adaptation, the adaptation process, and outcomes of adapted EBIs. To address this gap, we conducted a systematic review to answer the following questions: (1) What are the reasons for and common types of adaptations being made to EBIs in community settings as reported in the published literature? (2) What steps are described in making adaptations to EBIs? and (3) What outcomes are assessed in evaluations of adapted EBIs?

Sounding clever or being smart? – How to do more with less in evaluating governance programmes - Aston, Tom (Care Insights, 2018)
About a decade ago, the development sector fell into the same trap the financial services industry did in the mid-1990s. We were all seduced by clever...

The role of research and learning in adaptive programming - Babon, Andrea; Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
Andrea Babon and Lisa Denney explore how learning partners - a common feature of aid programs - can operate and feed into programs.

Monitoring and evaluation for adaptive programming - Roche, Chris; Kelly, Linda (Devpolicy Blog from the Development Policy Centre, 2018)
Chris Roche and Linda Kelly with six take-aways on what is being tried and learnt in setting up monitoring and evaluation frameworks for adaptive programs.

A guide to agile communication - Defra digital - DEFRA Digital (Departmetn for Environment, Food & Rural Affairs (UK), 2018)
This guide is intended for: people planning communications activity on behalf of agile teams people doing the communications activity (especially blogging, presenting, or filmmaking) people who manage the people described above, who want to understand what they're doing and why The government service standard encourages teams to work in the open as much as possible, echoing item 10 in the government design principles, “make things open, it makes them better”. This guide was written to help teams do just that.

Walking the adaptive talk - Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
The first in a three-part series on adaptive aid.Lisa Denney clarifies the confusion.

Evidence to Action: Research to Address Illegal Wildlife Trade - Milner-Gulland, E. J.; Cugniere, Laure; Hinsley, Amy; Phelps, Jacob; Rolfe, Michael 't Sas; Veríssimo, Diogo (2018)
Tools and expertise to improve the evidence base for national and international Illegal Wildlife Trade policy already exist but are underutilised. Tapping into these resources would produce substantive benefits for wildlife conservation and associated sectors, enabling governments to better meet their obligations under the Sustainable Development Goals and international biodiversity conventions. This can be achieved through enhanced funding support for inter-sectoral research collaborations, engaging researchers in priority setting and programme design, increasing developing country research capacity and engaging researchers and community voices in policy processes. This briefing, addressed to policy makers and practitioners, is part of the 2018 Evidence to Action: Research to Address Illegal Wildlife Trade event programme, organised by five of the UK’s most active IWT research institutions, to support the London 2018 IWT Conference.

Learning to make a difference: Christian Aid Ireland’s adaptive programme management in governance, gender, peace building and human rights - Booth, David; Balfe, Karol; Gallagher, Róisín; Kilcullen, Gráinne; O'Boyle, Sarah; Tiernan, Alix (ODI, 2018)
This paper assesses the relevance of adaptive or trial-and-error approaches to the field of governance, peace building and human rights. Tackling the problems of poverty, vulnerability and exclusion that persist in parts of the world that continue to be affected by violence or political insecurity is difficult for several reasons. For one, because of the complexity of the prevailing social, economic and political systems, solutions to chronic problems are far from obvious. One response to this aspect of the challenge is adaptive programme design and management. This paper is the product of a multi-year collaboration between ODI and the core team of Christian Aid Ireland to assess the relevance of adaptive or trial-and-error approaches to the field of governance, peace building and human rights. It explains the basis on which Christian Aid Ireland’s current five-year programme has become committed to an adaptive approach. It then describes and seeks to draw lessons from the programme’s first year of experience, considering the possible implications for implementation over the coming years. The authors find that to get full benefits from the move to adaptive management, the new ways of working and their underlying principles will need to become more embedded in organisational practices and cultures.

Achieving value for money through procurement. Part 2: DFID’s approach to value for money through tendering and contract management - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
Summary In 2016-17, the Department for International Development (DFID) spent £1.4 billion, or 14% of its budget, through commercial suppliers on contracts ranging from school construction to family planning services and the delivery of humanitarian aid. The quality of its procurement and contract management – how it engages and manages commercial firms to support the delivery of aid programmes on time, to budget and at the appropriate quality – is a key driver of value for money for UK aid. It is also a subject of considerable Parliamentary and public interest. In recent years, DFID has implemented a range of initiatives to strengthen its procurement practices and embed commercial capability across the department – including its 2017 Supplier Review, undertaken to address concerns about excessive profit-making by DFID suppliers. This review on achieving value for money through procurement (part 2) was published in September 2018. We awarded a green-amber score and made three recommendations to government. The follow-up to this review was published in July 2020, and rated the government’s response as ‘inadequate’, as a result of DFID’s failure to put in place a formal contract management regime, despite the risks this entails for programme results. We will return to this in the next follow-up in summer 2021. Review Our review found an appropriate overall approach to procurement with good performance in most areas of tendering, but significant weaknesses in contract management. We therefore awarded a green-amber score and made three recommendations to government. Findings Since 2015, DFID has progressed towards a more mature procurement approach. DFID’s tender process follows current EU legislation and UK government guidelines and cross-government peer reviews confirm improvements in DFID’s procurement approach. The Supplier Review lent momentum to the reforms but risks having unintended consequences. Poor consultation with suppliers has heightened the risk of unintended consequences. DFID is reviewing its business processes to protect aid recipients from sexual abuse and exploitation. DFID does not always choose the most appropriate procurement process but a new strategic sourcing process has resulted in stronger procurement planning. DFID has built up its commercial capability, but this will need to be an ongoing process. The contract management function in DFID is poorly defined and contracts are frequently amended or extended beyond their advertised length and values. Inception phases are often too short for adequate preparation and planning. Progress on flexible and adaptive programming will require more innovative approaches to tendering and contract management. Recommendations Before the next major revision of its supplier code and contracting terms, or future changes that may materially affect suppliers, DFID should conduct an effective consultation process with its supplier market, to ensure informed decisions and minimise the risks of unintended consequences. DFID should accelerate its timetable for acquiring a suitable management information system for procurement, to ensure that its commercial decisions are informed by data. DFID should instigate a formal contract management regime, underpinned by appropriate training and guidance and supported by a senior official responsible for contract management across the department. The new regime should include appropriate adaptive contract management techniques, to ensure that supplier accountability is balanced with the need for innovation and adaptive management in pursuit of development results.

Integrating Food Security and Wild Caught Fisheries Management in USAID Programming. Illustrative situation Model and Results Chain - Swaminathan, Vinaya; Best, Barbara; Ajroud, Brittany (Measuring Impact, 2018)
Integrating Food Security and Wild Caught Fisheries Management in USAID Programming is an illustrative case example that demonstrates how two adaptive management programming tools—situation models and results chains—can help USAID staff and its partners to better design and implement activities that integrate food security, nutrition, and sustainable management of wild fisheries.

Building a global learning alliance on adaptive management - Wild, Leni; Ramalingam, Ben (ODI, 2018)

Q&A: Complexity-Aware Planning for Stabilization Programming - Martins, Christy (DAI - Checkpoint, 2018)

Procuring and Managing Adaptively: 5 Case Studies of Adaptive Mechanisms - Pryor, Tony (USAID Learning Lab, USAID, 2018)
Flexibility in program management is essential in all of the countries where USAID works. This is especially true in non-permissive environments (NPEs), where the ability to learn and adapt quickly to changing circumstances can help USAID staff members achieve their desired outcomes.

Using a social learning configuration to increase Vietnamese smallholder farmers’ adaptive capacity to respond to climate change - Phuong, Le Thi Hong; Wals, Arjen; Sen, Le Thi Hoa; Hoa, Nguyen Quoc; Lu, Phan Van; Biesbroek, Robbert (Local Environment, 2018)
Social learning is crucial for local smallholder farmers in developing countries to improve their adaptive capacity and to adapt to the current and projected impacts of climate change. While it is widely acknowledged that social learning is a necessary condition for adaptation, few studies have systematically investigated under which conditions particular forms of social learning are most successful in improving adaptive capacity of the most vulnerable groups. This study aims to design, implement and evaluate a social learning configuration in a coastal community in Vietnam. We make use of various methods during four workshop-based interventions with local smallholder farmers: interviews with key farmers and commune leaders, farmer-to-farmer learning, participatory observations and focus group discussions. The methods for evaluation of social learning configuration include in-depth interviews, focus group discussions and structured survey interviews. Our findings show that the social learning configuration used in this study leads to an increased problem ownership, an enhanced knowledge-base with regard to climate change impacts and production adaptation options, improved ability to see connections and interdependencies and finally, strengthened relationships and social cohesion. The results suggest that increased social learning in the community leads to increase in adaptive capacity of smallholder farmers and improves both their economic and environmental sustainability. We discuss the key lessons for designing learning configurations that can successfully enhance adaptive capacity and smallholder farmers’ agency and responsiveness to the challenges posed by climate change impacts.
Keywords: Adaptive capacity; Social learning; Vietnamese smallholder farmers

Adaptive Peacebuilding Programming Through Effective Feedback Loops: Promising Practices - Barnard-Webster, Kiely; Jean, Isabella (CDA, 2018)
This case study report was developed by CDA’s part of Peacebuilding Evaluation Consortium collaborative research on the use of feedback loops in support of adaptive programming. Feedback loops are just one element of adaptive programming and are defined and used in different ways by organizations working on social change, peace and development issues. This document includes key findings from our desk review of reports and grey literature, key informant interviews, observations documented during CDA’s advisory and learning engagements with peacebuilding partners as well as the case study on SFCG’s feedback processes in Burundi. The findings are most relevant to program and M&E staff but have implications for senior management and policymakers in light of growing interest in strengthening adaptive management.

Independent Review of Facilities: review and management response - DFAT (DFAT, 2018)

Guidelines for designing and monitoring social accountability interventions - Franco, Erika Lopez; Shankland, Alex (IDS, 2018)

Opportunities for Using Complexity-Aware Approaches to Theory of Change - Goodier, Sarah; Apgar, Marina (SDC-IDS Briefing Note 8, 2018)
The purpose of this briefing note is to review opportunities for using complexity aware approaches to Theory of Change (ToC) to inform the SDC approach. It provides an overview of complexity-aware approaches and then focuses on demonstrating how complexity thinking can support programming by building on the frameworks currently being used in the project/programme cycle management (PCM) processes. It is aimed at SDC staff, in particular Programme Officers and staff of partner organisations involved in the management of SDC interventions.

State of the Art on Use of Theory of Change in the Development Sector - Goodier, Sarah; Apgar, Marina; Clark, Louise (SDC-IDS Briefing Note 7, 2018)
The purpose of this briefing note is to add to SDC’s understanding of Theory of Change (ToC), drawing on the literature and practice to sketch out the current state of the art approach. This involves expanding on ToC beyond SDC’s current practice of using Impact Hypotheses (IH) to bridge it to operational practice and use ToC more explicitly in the project/programme cycle management (PCM) processes. Sharing the state of the art on use of ToC in the development sector, this briefing note outlines what a ToC is, what it is used for and why it is needed in the development sector. It discusses ToC as both a process and a product, providing step by step guidance on how to facilitate a ToC process. The differences between a ToC and a logframe are highlighted. Some key criteria for recognising when you have a ‘good’ ToC are also included. This brief is aimed at SDC staff, in particular Programme Officers, and staff of partner organisations involved in the management of SDC interventions.

Using adaptive monitoring, evaluation and learning in programme design - Nzegwu, Femi (INASP, 2018)

Making humanitarian response more flexible: Challenges and questions - Obrecht, Alice; Bourne, S. (ALNAP/ODI, 2018)