Beyond the tools: supporting adaptation when organisational resources and capacities are in short supply - Fünfgeld, Hartmut; Lonsdale, Kate; Bosomworth, Karyn (Climatic Change, 2018)
Climate change adaptation is increasingly concerned with how organisations develop capacity to adapt to uncertain futures. A participatory action research project conducted in Victoria, Australia, examined how health and social service organisations developed their organisational adaptive capacity through the use of adaptation decision-support tools. It can be challenging for any organisation to select and apply a decision-support tool, but this is particularly the case where resources and capacities are limited. For most organisations, climate change is only one of a complex set of dynamic stressors they must consider in meeting organisational goals. This paper shows that while decision-support tools can help co-generate knowledge and facilitate customised organisational adaptation processes, for them to be practically helpful for organisations with limited resources and capacities, intensive collaborative and discursive processes are needed to adjust such tools to fit specific organisational contexts and needs. Facilitators and participatory approaches that enable co-inquiry can play a critical role in supplementing scarce resources and initiating adaptation processes that go well beyond the scope and purpose of the decision-support tool used. Organisations working effectively with decision-support tools to adapt to climate change will need to feel ownership of them and have confidence in modifying them to suit their particular adaptation needs and organisational goals.
Keywords: Adaptive capacity; Climate change; Community services; Decision-support tools; Facilitation; Health and social services; Organizational change

Simplicity, Accountability and Relationships: Three ways to ensure MEL supports Adaptive Management - Roche, Chris (From Poverty to Power, 2018)
Based on a recent discussion in Manila, Chris Roche reflects on how Monitoring, Evaluation and Learning can better support 'adaptive programming'.

Addressing Maladaptive Coping Strategies of Local Communities to Changes in Ecosystem Service Provisions Using the DPSIR Framework - Ehara, Makoto; Hyakumura, Kimihiko; Sato, Ren'ya; Kurosawa, Kiyoshi; Araya, Kunio; Sokh, Heng; Kohsaka, Ryo (Ecological Economics, 2018)
The Driver-Pressure-State-Impact-Response (DPSIR) framework has been applied to various environmental problems at multiple spatial and temporal scales and attempts have been made to conceptually improve the framework to encompass various stakeholder perspectives. However, recent literature experiences in the field have challenged the inclusive character of the framework applications. In particular, the framework's inability to incorporate the aggregated informal responses of people affected by changes in ecosystem service provisions has not been fully addressed. This limits the framework's validity in categorizing and disseminating information for addressing particular environmental challenges. Herein, we address this problem by analyzing a case study of deforestation and its impact on non-timber forest product collections by rural residents in Cambodia. We incorporate the concept of maladaptive coping strategies into the DPSIR framework and then further elaborate Ness et al.'s (2010) approach of merging the DPSIR framework with Hägerstrand's (2001) system of nested spatial domains. This conceptualizes the incorporation of the aggregated informal responses into the system, as exemplified in the case study.
Keywords: DPSIR framework; Ecosystem services; Maladaptive coping strategy; Nested spatial domains

Scaling Up Inclusive Approaches for Marginalised and Vulnerable People - Carter, Becky; Joshi, Anu; Remme, Michelle (2018)
This rapid review summarises the evidence on how to scale up inclusive approaches to complex social change. It looks at how to design scalable inclusive change interventions, as well as how to plan and manage the scale-up process. Focusing on interventions with the aim of reaching the most marginalised and transform social norms, it covers programmes aiming to deliver inclusive outcomes for women and girls (with a particular focus on preventing violence against women and girls) and persons with disabilities. To date, many interventions seeking to change harmful gender and disability norms have been implemented as small-scale projects. There are limited experiences of scale-up and fewer evaluations of these experiences. However, there are some documented case studies as well as emerging analysis that draw out lessons learned. From this evidence base, this rapid desk review identifies eight critical issues commonly highlighted as important considerations when scaling up inclusive change interventions: 1. Opportunities for systemic approach, including integrating political and community-level scale-up, and coordinating across multiple sectors and stakeholders 2. Political support for scale-up 3. Strategic choices: balancing reach, speed, cost, quality, equity, and sustainability 4. Catalysing change: tipping points, diffusion effects, and local champions 5. Locally grounded, participatory, and adaptive approaches 6. Long-term approaches with funding models to match 7. Cost-effective and financially feasible scale-up strategies 8. Measuring impact and sustainability.

Humanitarian Innovation Guide - ELHRA (2018)
The Humanitarian Innovation Guide is a growing online resource to help individuals and organisations define humanitarian problems and successfully develop innovative solutions. ABOUT THE GUIDE The humanitarian sector is investing in exciting innovations, but it is not yet producing a steady pipeline of well-designed solutions that effectively address problems, evidence their impact, and have the potential to be scaled. As stated in a recent independent evaluation of the Humanitarian Innovation Fund (Triple Line, 2017), a review of the innovation ecosystem in 2015 found significant gaps in resources for innovation, including a shortage of guidance on the skills needed to manage successful innovation projects. These findings were echoed in the research carried out to inform this resource. As part of a grant agreement with the European Commission to provide financial and technical support to emerging humanitarian innovations, and in line with our strategic aim to develop the sector’s skills and capabilities in humanitarian innovation, this resource aims to translate our own learning, along with learning from across the sector, into a practical, grounded guide for innovators working in humanitarian contexts. Building on our unique position in the sector, the Humanitarian Innovation Guide is designed to provide targeted support to individuals and organisations attempting to develop innovative solutions to the challenges facing humanitarian assistance, resulting in a more effective humanitarian response. The Guide is written with two audiences in mind: humanitarian practitioners who are seeking to develop a new approach to their work and want to apply an innovation lens to solving problems; and social entrepreneurs from outside the sector who have identified an opportunity to engage with the sector and need a humanitarian framework to contextualise their innovation plans. We also hope that it will be a useful resource for innovation managers who are tasked with supporting innovation in their agencies, labs or networks. As the first step-by-step guide to managing innovation in the humanitarian sector, we hope that its continued development will better enable individuals, organisations and the wider sector to: Plan the activities involved in an innovation process and systematise the management of innovation. Manage a successful innovation project and generate evidence for innovation. Ensure that innovations are developed in an ethical way, with full consideration of risks and responsibilities.

MLE or MEL in adaptive programming? - Pellini, Arnaldo (Knowledge counts, 2018)

3 fallacies of embracing complexity - Ang, Yuen Yuen (UNDP Blog, 2018)
Global development is seeing an exciting paradigm shift. Increasingly, leaders and practitioners recognize that development is not a “complicated” challenge that can be neatly parsed out into separate problems and siloed departments, like assembling a car. Rather, the various tasks of development—poverty eradication, improving governance, climate action, gender equality, and so on—are all connected, making development a “complex” challenge.

Learning for social-ecological change: a qualitative review of outcomes across empirical literature in natural resource management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina; Macura, Biljana; Pahl-Wostl, Claudia (Journal of Environmental Planning and Management, 2018)

Marine Conservation Outcomes are More Likely when Fishers Participate as Citizen Scientists: Case Studies from the Mexican Mesoamerican Reef - Fulton, Stuart; Caamal-Madrigal, Jacobo; Aguilar-Perera, Alfonso; Bourillón, Luis; Heyman, William D. (Citizen Science: Theory and Practice, 2018)
Small-scale fishers on Caribbean coral reefs have exploited fish spawning aggregations (FSAs) for generations, but intense fishing has led to the loss of traditional aggregation sites. In many areas, the traditional ecological knowledge (TEK) of fishers has contributed greatly to the characterization of spawning aggregations and implementation of local conservation initiatives. TEK has identified more than 40 potential FSA sites along the coast of the Mexican Mesoamerican Reef. These sites have been characterised and scientifically validated, in some cases with traditional western science and in others, with a participatory citizen-science approach. The objective of this work is to compare the science and conservation outcomes at these FSA sites. We report that those FSA sites where scientific surveys were conducted without community participation remain unprotected. By contrast, the FSAs where local fishers were engaged in characterization and subsequent monitoring are now protected at the behest of the fishers themselves. Conservation initiatives to protect FSAs can be more effective through a combination of TEK, western science, and participatory citizen science involving local fishers.
Keywords: Citizen science; Fishers; Spawning Aggregation; Traditional Ecological Knowledge

Context-Driven Adaptation (Overview) - Jacobstein, David (USAID Learning Lab, 2018)
CONTEXT-DRIVEN ADAPTATION COLLECTION

Twinning “Practices of Change” With “Theory of Change”: Room for Emergence in Advocacy Evaluation - Arensman, Bodille; van Waegeningh, Cornelie; van Wessel, Margit (American Journal of Evaluation, 2018)
Theory of change (ToC) is currently the approach for the evaluation and planning of international development programs. This approach is considered especially suitable for complex interventions. We question this assumption and argue that ToC’s focus on cause–effect logic and intended outcomes does not do justice to the recursive nature of complex interventions such as advocacy. Supported by our work as evaluators, and specifically our case study of an advocacy program on child rights, we illustrate how advocacy evolves through recursive interactions, with outcomes that are emergent rather than predictable. We propose putting “practices of change” at the center by emphasizing human interactions, using the analytical lenses of strategies as practice and recursiveness. This provides room for emergent outcomes and implies a different use of ToC. In this article, we make a clear distinction between theoretical reality models and the real world of practices.

In pursuit of the deep and sustained shifts necessary for adaptive management - Simister, Nigel (INTRAC, 2018)
The final blog in Nigel Simister's series on adaptive management and the M&E of complex projects and programmes.

Assessing the Demand for a Global Evidence Network. Mapping Existing Initiatives and Understanding Network Lessons and Opportunities - Gandolfo, Ari; Taddese, Abeba (Results for all, 2018)

State of the Field Review: Fiscal Transparency and Accountability - Rudiger, Anja (International Budget Partnership, 2018)

USAID Risk Appetite Statement - USAID (USAID, 2018)

How Decent is Decent Work? Using SenseMaker to understand workers’ experiences - Mager, Franziska; Smith, Becca; Gujit, Irene (Oxfam, 2018)

How Adaptive Management is challenging the monitoring and evaluation of complex programmes - Simister, Nigel (INTRAC, 2018)
By Nigel Simister Adaptive management is a broad approach designed to support development or humanitarian programmes in complex or uncertain …

Fostering Learning and Effectiveness through Collaboration: A New Collaborative on Transparency, Accountability, and Participation (TAI, 2018)
What are the features, values, and practices of effective learning organizations? How do learning practices contribute to more effective programming? And, how can collaborations between academics, researchers and practitioners better support learning organizations in the global South? These are just a few of the questions that a new global learning collaborative seeks to explore. In …

What's in a name? Unpacking “participatory” environmental monitoring - Turreira-García, Nerea; Lund, Jens; Domínguez, Pablo; Carrillo-Anglés, Elena; Brummer, Mathias; Duenn, Priya; Reyes-García, Victoria (Ecology and Society, 2018)
Turreira-García, N., J. F. Lund, P. Domínguez, E. Carrillo-Anglés, M. C. Brummer, P. Duenn, and V. Reyes-García. 2018. What's in a name? Unpacking “participatory” environmental monitoring. Ecology and Society 23(2):24. https://doi.org/10.5751/ES-10144-230224

TICTeC 2018 - The Making All Voices Count programme: new lessons about donor-funded civic tech - mySociety (2018)
Keywords: Accountability; Civic Tech; IDS; TICTeC; transparency

Approaches for addressing complexity in programme theory: Experiences in applying the Actor-based Change (ABC) Framework to a variety of international development programmes and evaluations - Koleros, Andrew; Oldenbeuving, Mark (2018)

Thinking and working politically in Somalia: A case study on the Somalia Stability Fund - Laws, Ed (TWP Coommunity of Practice and ODI, 2018)

Prioritizing and Selecting Strategic Approaches in USAID Biodiversity Programming - Stem, Caroline; Swaminathan, Vinaya; Flores, Marco (USAID, 2018)
This guide supplements Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. Step 4, Brainstorming Strategic Approaches, involves generating a suite of potential strategic approaches for a design team to consider. Step 5 introduces the practice of prioritizing and selecting among these draft strategic approaches but does not provide in-depth guidance on the process and criteria for doing so.

Combating Wildlife Trafficking Case Study Compilation: Capacity Building for Enforcement and Prosecution - USAID (2018)

Program Cycle - Discussion Note: Designing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

The Dilemmas of Citizen Inclusion in Urban Planning and Governance to Enable a 1.5 °C Climate Change Scenario - Chu, Eric; Schenk, Todd; Patterson, James (Urban Planning, 2018)
Cities around the world are facilitating ambitious and inclusive action on climate change by adopting participatory and collaborative planning approaches. However, given the major political, spatial, and scalar interdependencies involved, the extent to which these planning tools equip cities to realise 1.5 °C climate change scenarios is unclear. This article draws upon emerging knowledge in the fields of urban planning and urban climate governance to explore complementary insights into how cities can pursue ambitious and inclusive climate action to realise 1.5 °C climate change scenarios. We observe that urban planning scholarship is often under-appreciated in urban climate governance research, while conversely, promising urban planning tools and approaches can be limited by the contested realities of urban climate governance. By thematically reviewing diverse examples of urban climate action across the globe, we identify three key categories of planning dilemmas: institutional heterogeneity, scalar mismatch, and equity and justice concerns. We argue that lessons from urban planning and urban climate governance scholarship should be integrated to better understand how cities can realise 1.5 °C climate change scenarios in practice.

Small-scale farmers in a 1.5°C future: The importance of local social dynamics as an enabling factor for implementation and scaling of climate-smart agriculture - Martinez-Baron, Deissy; Orjuela, Guillermo; Renzoni, Giampiero; Loboguerrero Rodríguez, Ana María; Prager, Steven D (Sustainability governance and transformation 2018, 2018)
Climate-smart agriculture (CSA) has the potential to help farmers implement both adaptation and mitigation practices. The mitigation aspect of CSA is often not considered by farmers due to a high discount rate and, as such, adaptation is usually the priority concern. This review article offers perspective on this issue and highlights two key gaps in the literature: (i) understanding of factors related to the uptake of adaptation practices with co-benefits for mitigation and, (ii) the role of social networks to better enable rapid, widespread implementation of CSA, the latter being critical to bringing CSA to scale. The systematic review treated literature on synergies between adaptation, mitigation and social networks in the rural sector, as well as case studies illustrating the importance of social networks in climate change interventions when addressing synergies in adaptation and mitigation. We find that additional research is required that explicitly focuses on how social networks and social capital may be harnessed to hasten the adoption and uptake of highly synergistic CSA practices. This will facilitate both adaptation in the near term and contribute to mitigation at scale, allowing small-scale farmers to both benefit from and contribute to a 1.5°C future.

Incubating policy for economic transformation: Lessons from Nepal - Booth, David (ODI, 2018)

Global Affairs Canada: an approach to development innovation - GAC (Global Affairs Canada, 2018)
For Global Affairs Canada, development innovation includes new or improved business models, policy practices, approaches, technologies, behavioral insights or ways of delivering products and services that benefit and empower the poorest and most vulnerable people in developing countries.

Digital Principles into practice - HDIF (HDIF, 2018)

Playbook for innovation learning. 35 diagrams to support talking and thinking about learning for innovation - Leurs, Bas; Roberts, Isobel (Nesta, 2018)

Skills, atitudes and behaviours that fuel public innovation - a guide to getting the most from Nesta's Competency Framework for Experimenting and Public Problem Solving - Nesta (Nesta, 2018)

How Does Developing Enforcement Capacity Reduce Wildlife Crime? Increasing program effectiveness by understanding common assumptions - Price, Claire; Buff, Jesse; Peabody, Shawn; Present, Tess; Lauck, Liz (USAID, 2018)
"How Does Developing Enforcement Capacity Reduce Wildlife Crime?" summarizes findings from the literature around four key assumptions about capacity building for enforcement and prosecution. Using the experiences and evidence summarized in this brief, program designers and implementing partners should be able to increase the effectiveness and efficiency of their capacity building efforts.

Thinking and Working Politically through Applied Political Economy Analysis. A guide for practitioners - Rocha Menocal, Alina; Cassidy, Marc; Swift, Sarah; Jacobstein, David; Rothblum, Corinne; Tservil, Ilona (USAID, 2018)
Thinking and Working Politically (TWP) through Applied Political Economy Analysis (PEA). A guide for practitioners Have you ever done everything right in a development program — followed every technical best practice — but still missed the mark? When this happens, it often relates to factors in the context beyond any external development actor’s ability to control.

Program Cycle - Discussion Note: Managing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Managing to Adapt: Analysing adaptive management for planning, monitoring, evaluation, and learning - Desai, Harsh; Maneo, Gabriele; Pellfolk, Erica; Schlingheider, Annika (Oxfam, 2018)
Adaptive management is at the heart of ‘Doing Development Differently’. It emerges from stakeholders’ calls for development programmes to be more flexible and responsive to their contexts. Whether it becomes a mainstreamed practice depends on how much it is

How do we know what works? Interview with Prof. Michael Woolcock, Lead Social Scientist at the World Bank - Evans, Alice (2018)
Dr Alice Evans and leading experts discuss growth, governance, & gender inequalities. Alice is a Lecturer at King's College London, and Faculty Associate at the Harvard Kennedy School.
2018-03-17

Managing Humanitarian Innovation: The cutting edge of aid - James, Eric; Taylor, Abigail (Practical Action Publishing, 2018)
The challenges facing humanitarian logistics are huge. Refugee camps present enormously challenging environments in which sudden spikes in demand, difficult to access locations, disruptions due to conflict or disasters, as well as normal supply chain problems are commonplace. This means that orders for medical and other supplies can take weeks and sometimes months to fulfil, severely impeding humanitarian operations. There is also a lack of or slow adoption of technology routinely used elsewhere. In addition, humanitarian logistics are also expensive. When customs clearance, transportation, storage, middlemen and administration are added in, the costs of basic items are often exorbitant. Managing Humanitarian Innovation presents a new approach that is beginning to transform the way humanitarian logistics are conducted. Innovation in logistics includes disrupting and improving supply chains through the use of technology, especially 3D printers, and engaging people to manage this approach. The book discusses what innovation is, and strategies for supporting it; it describes practical innovations and how they have been applied; and it outlines how innovation labs can be run. Finally it covers how to fund innovation and it suggests how humanitarian innovation might develop in the future. This book brings together the real experience of practitioners who have made innovation work. It is a collaborative work written by and for the community of people involved in humanitarian innovation, in particular in the making and manufacturing of humanitarian supplies. The book is full of practical and actionable points of value to the humanitarian community. Managing Humanitarian Innovation is essential reading for humanitarian practitioners as well as volunteers and others involved in humanitarian supplies provision. It is equally helpful to thought leaders, policy makers and educators.

Human-Centered, Systems-Minded Design - Both, Thomas (Stanford Social Innovation Review, 2018)
Both human-centered and systems-thinking methods fit within an effective design approach, and can work in conjunction to address social challenges.

Thinking big: How to use theory of change for systems change - Abercrombie, Rob; Boswell, Katie; Thomasoo, Rosanna (NPC, 2018)
We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems. We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems.

Thinking and working politically: An introduction to key ideas, examples and further reading - Laws, Ed; Marquette, Heather (2018)

Thinking and working politically: Reviewing the evidence on the integration of politics into development practice over the past decade - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

DRG Center practical tips to implement more context-adaptive programming - Jacobstein, David (#AdaptDev, 2018)
Hi #adaptdevers, The cross-sectoral programs team in the DRG Center have been working in support of ways that programming can be made more aware of, and responsive to, context considerations that have to do with incentives and relationships between different actors - often called power dynamics or political economy. Following several discussions with field folks, we were asked to come up with simple and practical tips that could help staff to implement more context-adaptive programming, or to better Work Politically to use TWP jargon. With assistance from many of our field staff and partners, we've put together three documents (to start) that have now been cleared to share publicly: • Tips on Making Your Solicitations Invite Context-Driven Adaptive Programming - suggestions spanning most sections of a typical solicitation to better weave in Thinking and Working Politically. I'm particularly excited that this document contains embedded links to excerpts from a set of solicitations that model good practice. You can also find a summary of all the excerpts from real solicitations, and links onward to the public posting of those solicitations on Fed Biz Ops or Grants.gov, here. • Tips on Power Dynamics and Theories of Change - suggestions relevant to those working on project designs and logic models. • Tips for Better Use of Advisory Councils - suggestions to set up better advisory bodies that help you to incorporate political economy more automatically into your programmatic adjustments. I hope that you'll find these practical and helpful! Feedback is always welcome. Best, David

Adaptive management: why we find it so hard to operationalise - Teskey, Graham (Abt Associates - Governance Soapbox, 2018)

An Introduction to the DCED Standard for Results Measurement - Bekkers, Nabanita Sen (2018)
Introduction used in the DCED-BEAM seminar

Using elements of DCED Standards for CLA - Mitra, Bilash; Jalil, Mohammad Muaz (2018)
Introduction used in the DCED-BEAM seminar in Nairobi

The Debate about RCTs in Development is over. We won. They lost. - Pritchett, Lant (2018)
There has been a debate in development economics over the last 20 years as some claimed the use of RCTs as a tool for independent impact evaluation would significantly improve development practice and hence development. While right about the methodological claims about the superiority of randomization to produce cleaner estimates of the LATE (local average treatment effect) of projects and programs, this, in and of itself, does not change development practice. All of the five claims needed to sustain a positive model in which RCT/IIE has a major positive impact are demonstrably false. The proponents of RCTs have responded to losing the first round decisively by changing significantly both their claims and their practice.

Why We Lie About Aid: Development and the Messy Politics of Change - Yanguas, Pablo (Zed Books, 2018)
Foreign aid is about charity. International development is about technical fixes. At least that is what we, as donor publics, are constantly told. The result is a highly dysfunctional aid system which mistakes short-term results for long-term transformation and gets attacked across the political spectrum, with the right claiming we spend too much, and the left that we don't spend enough. The reality, as Yanguas argues in this highly provocative book, is that aid isn't – or at least shouldn't be – about levels of spending, nor interventions shackled to vague notions of ‘accountability’ and ‘ownership’. Instead, a different approach is possible, one that acknowledges aid as being about struggle, about taking sides, about politics. It is an approach that has been quietly applied by innovative development practitioners around the world, providing political coverage for local reformers to open up spaces for change. Drawing on a variety of convention-defying stories from a variety of countries – from Britain to the US, Sierra Leone to Honduras – Yanguas provides an eye-opening account of what we really mean when we talk about aid.

Complexity & Development 2.0: From Agreeing We Should Adapt to Creating the Conditions that Enable Adaptation - Ang, Yuen Yuen (2018)
The field of global development has reached a critical turning point. Almost gone is the mechanical, one-size-fits-all “good governance” paradigm of the past. In its place is a growing embrace of complexity and systems thinking. While this is an encouraging shift in the right direction, the discussion mostly ends by concluding that we should adapt. Yuen Yuen Ang urges that it’s time to take our conversation on “complexity & development” to the next level: how to enable adaptation. Effective adaptation doesn’t automatically arise just because we desire it—rather, it requires certain enabling conditions. In How China Escaped the Poverty Trap (2016), she introduces a generic complexity 2.0 framework that she terms “directed improvisation.” Effective adaptation, Yuen Yuen argues, requires a paradoxical blend of top-down direction and bottom-up improvisation. Such a system can be created—and produce dramatic results and adaptive solutions—even within a closed political regime like China.

OPM’s approach to assessing Value for Money - King, Julian; OPM (Oxford Policy Management, 2018)
This document offers practical guidance for assessing value for money (VfM) in international development programmes. Since 2016, evaluation expert Julian King has been working with OPM to develop and deploy a robust approach to VfM assessment. The approach combines cutting-edge evaluation practice with concepts from economic evaluation to respond to donor requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management.

Case Study Research and Applications: Design and Methods - Yin, Dr Robert K. (SAGE Publications, Inc, 2018)
Winner of the 2019 McGuffey Longevity Award from the Textbook & Academic Authors Association (TAA) Recognized as one of the most cited methodology books in the social sciences, the Sixth Edition of Robert K. Yin′s bestselling text provides a complete portal to the world of case study research. With the integration of 11 applications in this edition, the book gives readers access to exemplary case studies drawn from a wide variety of academic and applied fields. Ultimately, Case Study Research and Applications will guide students in the successful use and application ofthe case study research method.

Diffusion Of Innovations Theory, Principles, And Practice - Dearing, James W.; Cox, Jeffrey G. (Health Affairs, 2018)
Aspects of the research and practice paradigm known as the diffusion of innovations are applicable to the complex context of health care, for both explanatory and interventionist purposes. This article answers the question, “What is diffusion?” by identifying the parameters of diffusion processes: what they are, how they operate, and why worthy innovations in health care do not spread more rapidly. We clarify how the diffusion of innovations is related to processes of dissemination and implementation, sustainability, improvement activity, and scale-up, and we suggest the diffusion principles that can be readily used in the design of interventions.
Publisher: Health Affairs

Politically informed, gender aware programming: Five lessons from practice - Derbyshire, Helen; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

From Silos to Synergy: Learning from politically informed, gender aware programs - Derbyshire, Helen; Siow, Orlanda; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

The Whistler principles to accelerate innovation for development impact - G7 (G7, 2018)
The Whistler principles to accelerate innovation for development impact : 2018 G7 Summit – Canada 2018 G7 Presidency – Charlevoix, Quebec

DFID’s approach to value for money in programme and portfolio management - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
ICAI published this review on DFID’s approach to value for money in February 2018, and as value for money is both a process and an outcome and cuts across all aspects of DFID’s operations, did not score this review. We made five recommendations and published a follow-up to this review in July 2019. All UK government departments are required to achieve value for money in their use of public funds. In recent years, DFID has been working to build value for money considerations further into its management processes and its relationships with implementers and multilateral partners, establishing itself as a global champion on value for money. Review This review was published in February. Though it was not rated, ICAI made five recommendations, and found that the Department for International Development’s approach to value for money was helping to make UK aid spending go further, but improvements are still needed. Findings This review found that DFID has strengthened its processes and systems for ensuring it gains maximum value for each pound spent, has taken swift remedial action to tackle under-performing programmes, and has become a strong global champion on value for money. The review also found that DFID has been diligent in its efforts to cut waste, detect fraud, and improve efficiency, and that this work is improving the return on the UK investment in aid. However, the review found that DFID’s approach was not adequately reporting and capturing results and value for money at the country portfolio level, or how programmes work together to deliver lasting impact, including reducing future dependency on aid. It also found that weakness in the annual review process could undermine DFID’s approach to value for money. It found that targets were frequently revised, and that there could be pressures for optimistic scoring of programmes. Recommendations Based on this review, we made the following five recommendations to help DFID improve its approach to value for money still further: DFID country offices should articulate cross-cutting value for money objectives at the country portfolio level, and should report periodically on progress at that level. Drawing on its experience with introducing adaptive programming, DFID should encourage programmes to experiment with different ways of delivering results more cost-effectively, particularly for more complex programming. DFID should ensure that principles of development effectiveness – such as ensuring partner country leadership, building national capacity and empowering beneficiaries – are more explicit in its value for money approach. Programmes should reflect these principles in their value for money frameworks, and where appropriate incorporate qualitative indicators of progress at that level. DFID should be more explicit about the assumptions underlying the economic case in its business cases, and ensure that these are taken into account in programme monitoring. Delivery plans should specify points in the programme cycle when the economic case should be fully reassessed. Senior responsible owners should also determine whether a reassessment is needed following material changes in the programme, results targets or context. Annual review scores should include an assessment of whether programmes are likely to achieve their intended outcomes in a cost-effective way. DFID should consider introducing further quality assurance into the setting and adjustment of logframe targets.

Program Cycle - Discussion Note: Adaptive Management - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Adapting to Learn and Learning to Adapt: Practical Insights from International Development Projects - Brinkerhoff, Derick W.; Frazer, Sarah; McGregor, Lisa (RTI Press, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning, and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle. It both erases the boundaries between design, implementation, and evaluation and reframes thinking to consider the complexity of development problems and nonlinear change pathways.Supportive management structures and processes are crucial for fostering adaptive management. Implementers and donors are experimenting with how procurement, contracting, work planning, and reporting can be modified to foster adaptive programming. Well-designed monitoring, evaluation, and learning systems can go beyond meeting accountability and reporting requirements to produce data and learning for evidence-based decision making and adaptive management. It is important to continue experimenting and learning to integrate adaptive programming and management into the operational policies and practices of donor agencies, country partners, and implementers. We need to devote ongoing effort to build the evidence base for the contributions of adaptive management to achieving international development results.

Adapting to learn and learning to adapt: Practical insights from international development projects - Brinkerhoff, Derick; Frazer, Sarah (RTI, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle.

The rise of the randomistas: on the experimental turn in international aid - Donovan, Kevin P. (Economy and Society, 2018)
In recent years, the use of experimental methodologies has emerged as a central means of evaluating international aid interventions. Today, proponents of randomized control trials (so-called randomistas) are among the most influential of development experts. This paper examines the growth of this thought collective, analysing how uncertainty has become a central concern of development institutions. It demonstrates that transformations within the aid industry – including the influence of evidence-based policy, the economization of development and the retreat from macro-planning – created the conditions of possibility for experimentation. Within this field, the randomistas adeptly pursued a variety of rhetorical, affective, methodological and organizational strategies that emphasized the lack of credible knowledge within aid and the ability of experiments to rectify the situation. Importantly, they have insisted on the moral worth of experimentation; indeed, the experimental ethic has been proposed as the way to change the spirit of development. Through causal certitude, they propose to reduce human suffering. The rise of experimentation has not, however, eliminated accusations of uncertainty; rather, it has redistributed the means through which knowledge about development is considered credible.
Keywords: Development; Evidence; Experimentation; aid; uncertainty

Making good on donors’ desire to Do Development Differently - Honig, Dan; Gulrajani, Nilima (Third World Quarterly, 2018)
AbstractForeign aid donors are increasingly focused on changing the way their development agencies function. This discourse has focused on desired qualities, including greater knowledge of local contextual realities, appropriate adaptation to context and greater flexibility to respond to changing circumstances. We argue that more attention needs to be devoted to the achievement of these qualities and turn to contingency theory to identify some under-exploited ways to ?do development differently?. The qualities sought by donors are emergent properties of complex organisational systems and will only be achieved through a micro-level and interlinked focus on the fundamentals of organisation.

Developmental evaluation: Bridging the gaps between proposal, program, and practice , Developmental evaluation: Bridging the gaps between proposal, program, and practice - Lawrence, Rachael B.; Rallis, Sharon F.; Davis, Laura C.; Harrington, Karen (Evaluation, 2018)
Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach., Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach.

Doing Accountability Differently: A 'Vertically Integrated' Approach - Amakom, Uzochukwu; Fashola, Temitope; Gay, Charles; Shutt, Cathy (Christian Aid, 2018)

Supporting innovation and the use of technologies in accountability initiatives: lessons from Making All Voices Count - Edwards, Duncan; Hudson, Hannah; Anderson, Colin; McGee, Rosemary; Brock, Karen (IDS, 2018)
Making All Voices Count was an international initative that harnessed the power of innovation and new technologies to support effective, accountable governance. Focusing on six countries in Africa and Asia, the programme was implemented by a consortium of implementing partners, and used funding from four donors to make grants to support new ideas that amplified the voices of citizens, and enabled governments to listen and respond. From the start, Making All Voices Count was also a learning programme. The objective of this learning was not only to bring about change during the programme’s life cycle, but also to leave a legacy that would help to ensure that future governance programmes and initiatives seeking to capitalise on the transformative potential of innovation and technology are more informed, inclusive and impactful. This programme learning report emerged from a wider process of analysing, discussing and synthesising the data and learning from the programme, which wove together evidence-based learning about technology for accountable governance initiatives with experiential learning on how best to support such work. The report highlights five of the lessons learned from Making All Voices Count about how – and how not – to run large, complex programmes that intend to support innovation in governance.

Reflection methods: Tools to make learning more meaningful - Gordijn, Femke; Eernstman, Natalia; Helder, Jan; Brouwer, Herman (Wageningen Centre for Development Innovation, 2018)
This handbook summarises methods that can be used to facilitate the process of reflection on the knowledge and experiences people acquire during a capacity development trajectory or training event. We believe that by explicitly integrating reflection in the learning process the learning will become clearer and better articulated and will contribute more strongly to meaningful change. Therefore we advise facilitators to deliberately include reflective learning sessions in their process design and implementation. This handbook can inspire you to do so and provides many methods which help to facilitate this.

Innovation lifecycle and the missing middle - Gray, Ian; McClure, Dan (Managing Humanitarian Innovation - The cutting edge of aid, 2018)

Appropriating technology for accountability: messages from Making All Voices Count - McGee, Rosemary; Edwards, Duncan; Hudson, Hannah; Anderson, Colin; Feruglio, Francesca (IDS, 2018)
Making All Voices Count was a programme designed to solve the ‘grand challenge’ of creating more effective democratic governance and accountability around the world. It used funding from four donors to support the development and spread of innovative ideas for solving governance problems – many of them involving tools and platforms based on mobile phone and web technologies. Between 2013 and 2017, the programme made grants for innovation and scaling projects that aimed to amplify the voices of citizens and enable governments to listen and respond. It also conducted research and issued research grants to explore the roles that technology can play in securing responsive, accountable government and building an evidence base. This synthesis report reviews the Making All Voices Count’s four-and-a-half years of operational experience and learning. It shares 14 key messages on the roles technologies can play in enabling citizen voice and accountable and responsive governance. These messages are presented in four sections: (1) Applying technologies as technical fixes to solve service delivery problems; (2) Applying technologies to broader, systemic governance challenges ; (3) Applying technologies to build the foundations of democratic and accountable governance systems; (4) Applying technologies for the public ‘bad’, when tech can be dangerous for democracy. The tech optimism of the era in which the programme was conceived can now be reappraised from the better-informed vantage point of hindsight. Making All Voices Count’s wealth of diverse and grounded experience and documentation provides an evidence base that should enable a more sober and mature position of tech realism as the field of tech for accountable governance continues to evolve.

About the BEAM Exchange (BEAM Exchange, 2018)

Collaboration for Impact (2018)
The site seeks to accelerate the adoption of system collaboration and Collective Impact in Australia. It does so by creating knowledge, network and tools; shining a light on successful Collective Impact initiatives; and building an Australian community of practice.

Donor Committee for Enterprise Development (DCED, 2018)
The DCED is a forum for learning about the most effective ways to fulfil the SDGs – based on practical experience in Private Sector Development (PSD).

Feedback Commons (Keystone Accountability, 2018)

MIRADI: Adaptive Management Software for Conservation Projects (2018)

NetworkWeaver (NetworkWeaver, 2018)
Weaving Smart Networks

Swiss Programme for Research on Global Issues for Development (r4d programme) - NFP [Nr.] (2018)
Research and innovation are decisive factors for sustainable global development. With their knowledge, skills, experience and worldwide network of partners, researchers can make an important contribution towards the solution of global problems.

Lean Data Approaches to Measure Social Impact - ACUMEN (NovoEd, 2018)

An introduction to systems thinking and tools for systems thinking - Allen, Will; Kilvington, Margaret (Learning fro Sustainability, 2018)
Systems thinking is an approach to integration that is based on the belief that the component parts of a system will act differently when isolated from the system’s environment or other parts of the system. THIS PAGE PROVIDES PLENTY OF RESOURCES ON SYSTEM THINKING

Making humanitarian response more flexible: bibliography - ALNAP (2018)

Combining Big Data and Thick Data to Improve Services Delivery - Ang, Yuen Yuen (IBM Center for The Business of Government, 2018)

Evaluating interventions that prevent or counter violent extremism: A practical guide - Hofman, Joanna; Sutherland, Alex (RAND Corporation, 2018)

Evaluating Systems Change Results: an inquiry framework - Cabaj, Mark (Tamarack Institute, 2018)

What's missing? Adding context to the urban response toolbox - Campbell, Leah (ALNAP/ODI, 2018)

Global governance and local peace: accountability and performance in international peacebuilding - Campbell, Susanna (Cambridge University Press, 2018)
Local peacebuilding and global accountability – The country context–Burundi from 1999 to 2014 – Ingos in peacebuilding–globally unaccountable, locally adaptive – International organizations in peacebuilding–globally accountable, locally constrained – Bilateral development donors–accountable for global targets, not local change
OCLC: 1048387754

2018 Map of the Complexity Sciences - Castellani, Brian (Durham University, 2018)
A map that provides a macroscopic, trans-disciplinary introductions to the complexity sciences.

Strengthening Advocacy and Civic Engagemetn in Nigeria - Chemonics (Chemonics International, 2018)

Urban climate adaptation and the reshaping of state–society relations: The politics of community knowledge and mobilisation in Indore, India - Chu, Eric K (Urban Studies, 2018)
Current research on climate change adaptation in cities highlights the role of local governments in facilitating adaptation actions, but rarely assesses whether (and if so, how) local communities organise around emerging climate priorities to affect political change. This paper explores changing state–society relationships through the reconstitution of community collectives and advocacy organisations for advancing climate change adaptation in the Indian city of Indore. The paper shows that communities are indeed recognising the need for adaptation but are, at the same time, integrating adaptation actions with existing strategies for advocating development rights. Communities are also rebuilding alliances between municipal and local institutions for public service and infrastructure provision, which point to the centrality of community politics in urban climate adaptation processes. However, such mobilisations are often dependent on existing political networks and a legacy of advocacy around poverty alleviation needs, which sideline more transformative agendas around inclusiveness, equity, and resilient urban futures.

Follow the rabbit: Field Guide to Systemic Design - CoLab (Government of Alberta, 2018)
This Field Guide is designed to support budding systemic designers to facilitate and lead systemic design projects. It’s designed for systemic designers who have basic familiarity with SD concepts and are looking for some practical tips and tools to put theory into action. While this Guide was designed with Government of Alberta staff in mind, the content applies across a range of issue areas, sectors, and intersections. The Guide goes through a systemic design project from concept to implementation. It takes you through the workshop planning process, and discusses workshop roles and client relations. In the FAQs, you’ll find explanations to some commonly asked questions about systemic design concepts to help you introduce others to SD and bring them along with you. You’ll get the most out of this field guide if you approach it with a systemic design mindset – open, willing to try things, a desire to learn, and a ‘yes, and’ orientation. Think of this field guide as an early stop in your systemic design journey: it’s not the end of your learning – it’s a jumping off point. In the Additional Resources section, you can connect to more in-depth explorations of concepts and practical applications.

Rwanda Multi-Donor Civil Society Support Programme (2015-2021) - DFID (Development Tracker, 2018)
Project data for the Rwanda Multi-Donor Civil Society Support Programme (2015-2021). Strengthened civil society engagement on critical social cohesion, reconciliation and governance issues in Rwanda. DFID will provide funding and technical support to Rwandan civil society organisations to support the design and implementation of governance and reconciliation focused initiatives, and to support more effective engagement (influencing) with government on these issues.

Adding Up to Peace: The Cumulative Impacts of Peace Initiatives - Diana Chigas; Peter Woodrow (CDA Collaborative Learning Projects, 2018)
Adding Up to Peace: The Cumulative Impacts of Peace Initiatives aims to identify how cumulative impacts in peace practice operate at all levels, in order to provide practical lessons for policymakers, donors and practitioners to develop more effective strategies for greater progress towards peace. This book builds on CDA’s Reflecting on Peace Practice Project (RPP), launched to answer the question: What works—and what doesn’t work—in peacebuilding? It seeks to deepen our understanding of how multiple peacebuilding initiatives in a conflict zone interacted and added up (or didn’t), to result in progress towards larger societal level peace, or Peace Writ Large. The findings are a product of sixteen case studies conducted between 2007 and 2012, gathering the perceptions of both local and international stakeholders. The finalization of this book was generously funded by Humanity United. The opinions expressed are those of the authors and do not necessarily reflect the views of Humanity United or of CDA Collaborative Learning Projects.

Principles for Digital Development - digitalprinciples.org (2018)

Food security indicators - FAO (ESS Website, 2018)

Adaptive Development Switchboard - Final Report (Internal Document) - Feedback Labs (LearnAdapt Programme, 2018)

Switchboard Survey Analysis (Internal Document) - Feedback Labs (LearnAdapt Programme, 2018)

FeverBee’s Online Community Strategy Template - FeverBee (FeverBee, 2018)

Survey Template - Help decide the future of the [name] Community Survey - FeverBee (FeverBee, 2018)

The usability of climate information in sub-national planning in India, Kenya and Uganda: the role of social learning and intermediary organisations - Fisher, Susannah; Dodman, David; Epp, Marissa Van; Garside, Ben (Climatic Change, 2018)
Abstract Research on using climate information has often focused on the interaction between users and producers and the technical fit of information for real decision-making. However, due to resource and capacity constraints within both user and producer communities, this approach will not always be feasible or indeed necessary depending on the decisions at hand. These contexts have been relatively under-explored by scholars, and this paper provides an original empirical contribution using three case studies of sub-national governments in India, Kenya and Uganda. In the paper, we analyse how social learning supports changing the usability of climate information and the role of intermediary organisations in these processes. Firstly, the paper shows that intermediaries often choose to build the commitment to project aims rather than using climate information as an entry point to working on climate change, and this allows them to instigate challenging learning processes. Secondly, there are barriers to iterative processes and critical reflection with government stakeholders but these processes can gain traction when built into institutional practices such as formal M&E processes. Lastly, social learning can broaden the framing of climate change from a single sector issue to a multi-sectoral one. We conclude by arguing that bringing together scholarship on social learning with that on the usability of climate information can deepen understanding of the dynamic context in which the information becomes usable. The evidence from the case studies shows that learning processes can alter this context across scales.

The relationship between adaptive management of social-ecological systems and law: a systematic review - Frohlich, Miguel F.; Jacobson, Chris; Fidelman, Pedro; Smith, Timothy F. (Ecology and Society, 2018)
Adaptive management has been considered a valuable approach for managing social-ecological systems involving high levels of complexity and uncertainty. However, many obstacles still hamper its implementation. Law is often seen as a barrier for moving adaptive management beyond theory, although there has been no synthesis on the challenges of legal constraints or how to overcome them. We contribute to filling this knowledge gap by providing a systematic review of the peer-reviewed literature on the relationship between adaptive management and law in relation to social-ecological systems. We analyze how the scholarship defines the concept of adaptive management, identifies the legal barriers to adaptive management, and the legal strategies suggested for enabling this approach. Research efforts in this domain are still highly geographically concentrated in the United States of America, unveiling gaps concerning the analysis of other legal jurisdictions. Overall, our results show that more flexible legal frameworks can allow for adaptive management without undermining the role of law in providing stability to social interactions. Achieving this balance will likely require the reform of existing laws, regulations, and other legal instruments. Legal reforms can facilitate the emergence of adaptive governance, with the potential to support not only adaptive management implementation but also to make law itself more adaptive.

Our priorities in international assistance - GAC (GAC, 2018)
For Global Affairs Canada, development innovation includes new or improved business models, policy practices, approaches, technologies, behavioral insights or ways of delivering products and services that benefit and empower the poorest and most vulnerable people in developing countries.

GIZ's Evaluation Policy: Principles, guidelines and requirements of our evaluation practice - GIZ (GIZ, 2018)

GIZ’s evaluation system - GIZ Evaluation Unit (GIZ GmbH, 2018)
This provides a general description of GIZ’s new evaluation system, which is designed to implement our new policy and to achieve the objectives of evaluation reform. This general description is accompanied by two other documents that provide supplementary details of GIZ’s key evaluation instruments: project evaluations for BMZ business and corporate strategic evaluations. They are geared in particular to GIZ staff members who commission, implement or support evaluations and to evaluators who conduct evaluations on behalf of GIZ as well as repre-sentatives of commissioning parties, clients and cooperation partners. The current versions are very much a ‘work in progress’ in many regards. We are well aware that we will only be able to meet our own high expectations of our evaluations if we continue to develop their quality in dialogue with project staff, our commissioning parties, clients and partners and with evaluation practitioners and experts from the academic, scientific and research community. We look forward to taking on this task and to sharing our experience with all interested parties.

GLAM Monitoring and Learning Strategy (internal document) - GLAM (ODI, 2018)

Summer School Course - Adaptive Management - Working Effectively in the Complexity of International Development (weekplan) - Green, Duncan; Guijt, Irene (Oxfam, 2018)

Leaving No One Behind in a Digital World - Hernandez, Kevin; Roberts, Tony (Institute of Development Studies, 2018)

Measuring Up: Evaluating the Impact of P/CVE Programs - Holmer, Georgia; Bauman, Peter (United States Institute of Peace, 2018)
This report considers the various conceptual and practical challenges in measuring the impact and value of programs designed to prevent and counter violent extremism (P/CVE). It examines potential solutions and emphasizes the significance of efforts to assess changes in attitudes, behaviors, and relationships. The report was developed in tandem with “Taking Stock: Analytic Tools for Understanding and Designing P/CVE Programs” and seeks to help advance more rigor and sustainability in P/CVE programming.

Navigation by Judgment: Why and when Top Down Management of Foreign Aid Doesn't Work - Honig, Dan (Oxford University Press, 2018)
Foreign aid organizations collectively spend hundreds of billions of dollars annually, with mixed results. Part of the problem in these endeavors lies in their execution. When should foreign aid organizations empower actors on the front lines of delivery to guide aid interventions, and when should distant headquarters lead? In Navigation by Judgment, Dan Honig argues that high-quality implementation of foreign aid programs often requires contextual information that cannot be seen by those in distant headquarters. Tight controls and a focus on reaching pre-set measurable targets often prevent front-line workers from using skill, local knowledge, and creativity to solve problems in ways that maximize the impact of foreign aid. Drawing on a novel database of over 14,000 discrete development projects across nine aid agencies and eight paired case studies of development projects, Honig concludes that aid agencies will often benefit from giving field agents the authority to use their own judgments to guide aid delivery. This "navigation by judgment" is particularly valuable when environments are unpredictable and when accomplishing an aid program's goals is hard to accurately measure. Highlighting a crucial obstacle for effective global aid, Navigation by Judgment shows that the management of aid projects matters for aid effectiveness.
Google-Books-ID: GT5MDwAAQBAJ

Building a Learning Community in Liberia Through Partnerships at iCampus - iCampus (USAID LEARN, 2018)
Accountability Lab Liberia (ALab) and iLab Liberia established iCampus- a shared innovation, co-working and community space for organizations focusing on the intersection of technology, accountability and social change in Liberia. ALab implements DAI’s Learning activities at iCampus, and it is referred to as the Strategic Learning Partner of USAID Liberia Accountability and Voice Initiative (LAVI). LAVI is a five year USAID program with an overarching goal to strengthen multi-stakeholder partnerships to advocate for and monitor policy and accountability reforms. The iCampus CLA case scenario captures joint efforts of Accountability Lab Liberia, iLab Liberia and USAID LAVI, to ensure that learning and methodologies are shared and applied by development actors; address common capacity challenges that particularly hinder civil society from engaging in evidence-based and issues-based advocacy using various approaches, including network-building, creation of a cross-sectoral learning space- through collaboration and learning. In 2017, iCampus conducted a learning mapping survey to understand how organizations are learning in Liberia. The result indicated that frameworks and concepts of organizational learning are not yet well understood or used to guide strategic or programmatic practices, by either Liberian or international organizations. ALab, iLab and USAID LAVI then adopted a set of strategies, that led to the implementation of a CLA, enabling the establishment of the first multi-sectoral learning community in Liberia.

Tips for Finding Unusual Allies and Building Innovative Alliances - Jacobstein, David (USAID Learning Lab, 2018)
One of the truisms of thinking and working politically (TWP) is that it requires looking differently at how stakeholders relate to a given development challenge or process, and building coalitions of the “right actors at the right time” who can drive forward progress while working with the grain of the context. While it’s easy to call for coalitions for change and diverse stakeholder engagement, identifying allies beyond those already seized with an issue, and finding ways to collaborate with stakeholders who may have different reasons for joining a coalition, is a challenging task. These are some suggested tips to improve working in that fashion.

The water of Systems Change - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Foundations involved in systems change can increase their odds for success by focusing on the least explicit but most powerful conditions for change, while also turning the lens on themselves. The Water of Systems Change aims to clarify what it means to shift these conditions. We offer the “inverted triangle” framework as an actionable model for funders and others interested in creating systems change, particularly those who are working to advance equity. Top Takeaways Systems change is about advancing equity by shifting the conditions that hold a problem in place. To fully embrace systems change, funders should be prepared to see how their own ways of thinking and acting must change as well. Shifts in system conditions are more likely to be sustained when working at three different levels of change: explicit, semi-explicit, and implicit.

The water of Systems Change: Action learning exercise - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Based on the “inverted triangle” framework presented in The Water of Systems Change, this activity is designed to help individuals think systemically about social change, explore what is happening below the surface on issues they care about, and determine how they and their organizations can pursue large-scale change in a disciplined and holistic manner. The exercise is divided into 3 parts: Part I uses the “inverted pyramid” introduced in The Water of Systems Change to perform an external assessment of opportunities to make progress on the social or environmental issue you are focused on. Part II uses the same framework to consider internal conditions within yourself and your organization that should change in order for you to better support progress on your issue. Part III takes what was developed in Parts I and II and asks “What to do next?”

Regional Healthcare Ecosystem Analyst for Healthcare Associated Infections - Lee, Bruce Y. (Grantome, 2018)
Understanding and preventing the spread of both endemic and emerging healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Our work has shown that the many disparate inpatient healthcare facilities in a region can form a complex healthcare ecosystem connected by both direct and indirect patient sharing allowing pathogens in one health care facility to readily spread to other facilities. Our goal is to further develop RHEA (Regional Healthcare Ecosystem Analyst) into a user-friendly software tool that decision makers (e.g., policy makers, funders, product developers and manufacturers, healthcare administrators, infection prevention specialists, researchers, and educators) can readily use to help healthcare ecosystems prevent and control the spread of an endemic pathogen, methicillin- resistant Staphylococcus aureus (MRSA), and an emerging pathogen, carbapenem-resistant Enterobacteriaceae (CRE). This next generation of RHEA will bring multiple innovations by: 1) further elucidating the interconnectedness of the ecosystem and showcasing the value of cooperation among facilities versus the current individual facility approach to infectious disease control, 2) incorporating new healthcare ecosystem responses for endemic MRSA and emerging CRE, 3) continuing our work integrating economic and operational models into a framework of infectious disease epidemiological models, 4) imbuing virtual patients with characteristics linked to MRSA and CRE transmission and outcome risk, 5) building a comprehensive """"""""virtual laboratory"""""""" to help address many existing and future healthcare ecosystem infectious disease questions, and 6) building a user-friendly modeling tool that decision makers can use. The project will continue our team's longstanding modeling work and developing computational tools for decision makers via three specific aims. First, completing Specific Aim 1 will expand RHEA by adding the following capabilities: i) integrated clinical outcome and economic models, ii) more extensive and detailed patient characteristics linked to changes in infection risk and costs, iii) expanded HAI control measures, and iv) stochastic and adaptive disease parameters to represent emerging and evolving diseases. Next, Specific Aim 2 will use our newly expanded RHEA framework to model a sample endemic pathogen, MRSA, and a sample emerging pathogen, CRE to identify optimal control strategies even when pathogen characteristics are evolving. Finally, Specific Aim 3 will involve developing a user-friendly interface for RHEA and deploying it as a healthcare ecosystem computational modeling tool that various stakeholders (e.g., policy makers, healthcare administrators, infection control specialists, funders, and product manufacturers) can readily use to make decisions regarding the control of healthcare-associated infections. Public Health Relevance Understanding and preventing the spread of healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Simulation models can serve as virtual laboratories to help identify best practice solutions for containing common [such as methicillin-resistant Staphylococcus aureus (MRSA)] and emerging [e.g., carbapenem-resistant Enterobacteriaceae (CRE)] causes of healthcare associated infections (HAIs). Our goal is to develop our software RHEA (Regional Healthcare Ecosystem Analyst) into a computational modeling tool that can be used directly by decision makers to identify, develop, and evaluate strategies and interventions to reduce HAIs across a large geographic region.

The landscape of innovation approaches - Leurs, Bas (States of Change, 2018)
An overview of innovation methods and approaches we’ve come across in government innovation practice.

Towards transformative social learning on the path to 1.5 degrees - Macintyre, Thomas; Lotz-Sisitka, Heila; Wals, Arjen; Vogel, Coleen; Tassone, Valentina (Current Opinion in Environmental Sustainability, 2018)

Developing and Using Useful ToCs - Mayne, John (2018)
Developing useful theories of change (ToCs) for anintervention, especially complex interventions, is not straightforward nor something done in a couple of hourswith limited effort. Agreement is needed on a number of basic concepts and terms, key challenges need to be addressed, and there are numerous issues that need to be considered.Butthe effort is worth the investment of resources and time.Theory-based evaluation approaches need good ToCs.Some of the ideas here are discussed in the context of agricultural research for nutrition and health interventions by Mayne and Johnson (2015) (10) Developing and Using Useful ToCs. Available from: https://www.researchgate.net/publication/323868372_Developing_and_Using_Useful_ToCs [accessed Jun 13 2018].

Using evidence to influence policy: Oxfam’s experience - Mayne, Ruth; Green, Duncan; Guijt, Irene; Walsh, Martin; English, Richard; Cairney, Paul (Palgrave Communications, 2018)
Policymaking is rarely ‘evidence-based’. Rather, policy can only be strongly evidence-informed if its advocates act effectively. Policy theories suggest that they can do so by learning the rules of political systems, and by forming relationships and networks with key actors to build up enough knowledge of their environment and trust from their audience. This knowledge allows them to craft effective inﬂuencing strategies, such as to tell a persuasive and timely story about an urgent policy problem and its most feasible solution. Empirical case studies help explain when, how, and why such strategies work in context. If analysed carefully, they can provide transferable lessons for researchers and advocates that are seeking to inform or inﬂuence policymaking. Oxfam Great Britain has become an experienced and effective advocate of evidence-informed policy change, offering lessons for building effective action. In this article, we combine insights from policy studies with speciﬁc case studies of Oxfam campaigns to describe four ways to promote the uptake of research evidence in policy: (1) learn how policymaking works, (2) design evidence to maximise its inﬂuence on speciﬁc audiences, (3) design and use additional inﬂuencing strategies such as insider persuasion or outsider pressure, and adapt the presentation of evidence and inﬂuencing strategies to the changing context, and (4) embrace trial and error. The supply of evidence is one important but insufﬁcient part of this story.

Evaluation Building Blocks: A Guide - McKegg, K.; Oakden, J.; Wehipeihana, N.; King, Julian (Kinnect Group, 2018)
This guide presents the Kinnect Group’s approach to evaluation. Developed through ten years of collaborative work, it has been well tested. While there are many other guides to evaluation and different ways to do it, our approach emphasises the place of evaluative reasoning in evaluation. The guide draws on the work of many evaluation theorists, as well as our practice-based body of knowledge. We hope that using the building blocks as explained in the guide will help you in your endeavour to do credible and useful evaluation. We find this approach works for us. Our clients tell us it gives them meaningful and insightful findings that they can use to take action. Our view to intellectual property is simple. What you read is yours to use. We just ask that you cite the guide when you draw from it. For those of you who engage with this guide and use it in your practice, we look forward to hearing from you. We are particularly interested in feedback where you find aspects of the guide work well for you. In that way we can all continue to build and evolve our practice.

The Indispensable Community: Why Some Brand Communities Thrive When Others Perish - Millington, Richard (Feverbee, 2018)
How to Build Bigger, Better, and More Active Online CommunitiesBuzzing Communities cuts through the fluff to offer a clear process for creating thriving online communities. This book combines a century of proven science, dozens of real-life examples, practical tips, and trusted community-building methods. This step-by-step guide includes a lifecycle for tracking your progress and a framework for managing your organization's community efforts. This Book Will Help You to Understand what the members of your community really want. Dramatically increase the number of newcomers that become regulars. Avoid the mistakes most organizations make when they try to build online communities. Develop a fantastic, user-friendly website for your members. Grow your online community to critical mass and beyond Keep members engaged and active in your community. Measure the community's return on investment and explain the benefits to your organization.

States of Change - Learning programme - Nesta (Nesta, 2018)

Dynamic gridlock: Adaptive Humanitarian Action in the Democratic Republic of Congo - Obrecht, Alice (ODI/ALNAP, 2018)

OECD Development Assistance Committee Peer Review of Canada - OECD (OECD, 2018)

Evaluating the Design of Behavior Change Interventions: A Case Study of Rhino Horn in Vietnam - Olmedo, Alegría; Sharif, Vian; Milner‐Gulland, E. J. (Conservation Letters, 2018)
Behavioral change interventions are increasingly widely used in conservation. Several projects addressing rhino horn consumption were recently launched in Vietnam. We used key informant interviews, document analysis, and marketing theory to explore their strategies for intervention design, implementation, monitoring, and evaluation. We developed a framework to evaluate whether they followed best practice and identify implementation challenges. Interventions could make greater use of key project design steps, including basing interventions on robust research to understand the behavior in question, identifying the target audience whose behavior interventions aim to change, and developing measures that can provide reliable evidence of success or not. Challenges include the need for law enforcement to complement campaigns; improving cooperation between NGOs; and clearly defining aims of demand-reduction initiatives. Using best practice from other fields and considering demand reduction within the wider context of wildlife, trade policy will help address these challenges.
Keywords: Awareness; Ilegal wildlife trade; Project design; demand reduction; social marketing

Knowledge Management strategies and processes in Agile Software Development: a systematic literature review - Ouriques, Raquel Andrade Barros; Wnuk, Krzysztof; Gorschek, Tony; Svensson, Richard Berntsson (CoRR, 2018)
Knowledge-intensive companies that adopt Agile Software Development (ASD) relay on efficient implementation of Knowledge Management (KM) strategies to promotes different Knowledge Processes (KPs) to gain competitive advantage. This study aims to

Outcome Harvesting. Understanding social change results in complex circumstances - outcomeharvesting.net (2018)
This website is a source of applications, events and resources to support the development of a community of practitioners of Outcome Harvesting. BetterEvaluation is one of three sister sites of OutcomeHarvesting.net

Illegal Wildlife Trade - Frameworks - Oxford Martin Programme on the Illegal Wildlife Trade (Oxford Martin Programme on the Illegal Wildlife Trade, 2018)
Our frameworks will enable a better understanding of wildlife product consumer preferences and motivations to effectively influence the system.

Doing Development Differently at Scale - Pellini, Arnaldo; Karetji, Petrarca C.; Soekadis, Ade (Knowledge, Politics and Policymaking in Indonesia, 2018)
In recent decades there has been an increasing recognition that politics and political institutions matter for development. There is also a much greater interest in contextually grounded approaches. This has stemmed from an acknowledgement that purely technocratic approaches to development often result in failure because they do not take into account the nature of political institutions. Nor do they take account of the context in a particular developing country and the interests and incentives of powerful national actors. Policy processes are embedded in specific social, political and organisational contexts. Approaches that focus on implementing universal best practices in evidence-informed policymaking are unlikely to be successful. Instead, what is needed is an approach that takes the local context as the starting point for understanding what issues are relevant to policymakers and developing contextually appropriate solutions. The authors of this chapter reflect on the management approaches and systems that may be required to enable and support large-scale development programmes to be flexible and adaptive to the local policy context and circumstances. The chapter argues that such programmes struggle to adopt adaptive management principle and that to do that at scale requires some changes in the way such programmes are managed.
Keywords: Adaptive Management; Doing development differently; Evidence-informed policymaking; Indonesia; Knowledge sector; Thinking and working politically

Review of Selected DFAT Facilities: Independent Consultant Report to DFAT, Key Findings - Pieper, Lynn (DFAT, 2018)
For the purposes of this report, a facility is defined as an aid delivery mechanism that provides flexible (adaptive and responsive) services managed in an integrated way. Objectives (or endof-facility outcomes) are specified, but the pathways to deliver them are left unspecified. The facility is a highly relevant model for delivering Australian aid effectively. Achievement of the Sustainable Development Goals depends on flexible approaches that work across sectors and that integrate significant cross-cutting themes such as gender equality and social inclusion. Efficient DFAT management of a $4 billion aid program requires a shift to fewer and larger initiatives, to make best use of limited internal management resources while still enabling policy and program choices that can have real impact. Facilities and other flexible delivery mechanisms offer significant potential for better development results. They can: enable collaborative and responsive partnership approaches to gain traction; allow activities to experiment and adapt based on progress, demand and contextual changes; and provide the opportunity for outcome-focused coherence across sectors, enabling the whole to be more than the sum of the parts. Facilities are not new, but they are different today. Facilities have existed since at least the mid-1990s. What is new is that some facilities today are very large; and the flexibility they enable is increasingly and consciously being used to strengthen links between the technical and the political, for more effective development results. This is a positive trend, but it adds enormously to their complexity and visibility, creates new risks, and has resulted in role confusion (especially in early years of implementation) between DFAT and its contractors.

Positive Deviance Initiative - Positive Deviance Initiative (2018)

Poverty Stoplight - povertystoplight.org (2018)
What is the Poverty Stoplight? The Stoplight is a tool that seeks to activate the potential of families and communities to lift themselves out of poverty. Using a technology platform, it offers a self-assessment survey and intervention model that enables people to develop practical solutions to overcome their specific needs. We work with organizations from different sectors around the world and bring together a network of powerful actors with one clear mission: eliminate poverty worldwide. The Stoplight Community is comprised of government agencies, private companies, small and medium-sized enterprises, non-profits, cooperatives, microfinance organizations, academic institutions, and sports clubs, among others.

Decision-Making and Data Use Landscaping [at DFID] - Powell, Josh; Orton-Vipond, Sarah; Bhatia, Vinisha; Kilroy, Annie (Development Gateway, 2018)
As DFID aims to harness the Data Revolution, ensuring that data1 drive decision-making, public accountability, and the achievement of the Sustainable Development Goals (SDGs), ensuring that systems, processes, and skills for data are aligned with these objectives is paramount. Across sector policy teams, country offices, and various analytical and technical cadres, different strengths and weaknesses, as well as needs and ambitions exist. To inform a strategic approach to data, as framed in its forthcoming Data Roadmap, DFID collaborated with Development Gateway to perform a Decision and Data Use Landscaping study. This report details lessons learned from approximately 60 interviews across 4 DFID country offices, all sector policy teams, senior managers, and various analytical and technical cadres and offices.

Snapshot of Adaptive Management in Peacebuilding Programs - Queen, Emily Forsyth; Baumgardner-Zuzik, Jessica; Hume, Elizabeth; Greenberg, Melanie (Alliance for Peacebuilding, 2018)
The Alliance for Peacebuilding developed the report Snapshot of Adaptive Management in Peacebuilding Programs with support from Humanity United. This report examines how existing organizational programs are designing and learning from adaptive management in a conflict effected and fragile states. It further provides practical recommendations for applying adaptive management to peacebuilding programs based on synthesis … Continue reading "Snapshot of Adaptive Management in Peacebuilding Programs"
Keywords: KEY

What are you afraid of: Collective leadership and its learning implications - Raelin, Joseph A (Management Learning, 2018)
In this provocation, the author attempts to cite the advantages of collective leadership while acknowledging the objections and fears of challengers. Collective leadership is seen as remote because it defies the traditional view of leadership as an individualistic attractive quality that not only protects us but is efficient when applied. Nevertheless, the collective alternative may not only be advisable but required in a connected world featuring a networked economy. The contemporary socio-politico-economic environment requires the contribution of, creativity from, and collaboration among multiple agents providing a dynamic concentration of management and knowledge. If we are to accept and recognize the contribution of a collective leadership, its development would require an entirely different learning model. In particular, collective leadership development occurs as an acute immersion into the practices that are embedded within in situ material–discursive relations—in other words, among people, objects, and their institutions.

What We Do: Getting Beyond Statistics - Sense Guide (Sensemaker narrative monitoring, 2018)
Our approach Understanding daily life reality with micro-narratives Narratives and more specifically micro-narratives are a fundamental and ancient way by which humans interpret their experience and make decisions. SenseMaker® provides the ability to capture and understand those narratives. Through the web or app environment the software allows the capture of pictures, recordings and writing in various combinations to reflect how the respondents are making sense of the world. Reducing cognitive bias with self signification In a patented method, the respondent then interprets their own story into a series of abstract constructs (‘signifiers’) that feel more like a game than a survey, but allow profound meaning to emerge. This interpretation adds layers of meaning rather than simply interpreting the story and provides quantitative data to detect visual patterns among stories. The patterns are linked back to the original material enabling a deeper dive into individual stories. If the researcher first look for patterns in the metadata using statistical or visual tools, he or she is less likely to be biased by content and prematurely converge on an interpretation. Evidence based insights that enables action The output of SenseMaker® is statistical data backed up by explanatory narrative. This means that advocacy is an integral part of the system. Numbers on their own appear objective but are not persuasive; anecdotes on their own may be persuasive but are not objective. SenseMaker® puts the two together and provides a powerful means of persuasion. It also enables action. Instead of saying “How do we create a culture of X?” we say “How do we create more stories like this and fewer stories like that?” Then, as actions are initiated, we see the impact in real time.

Exploring new territories for evaluation - Sharp, Cathy (Collective Leadership for Scotland, 2018)
Drawing on action research, this paper recasts evaluation as ‘action inquiry’, an embedded evaluative learning practice that can help navigate complexity when enacting collective leadership. It is offered as an invitation to inquiry amongst a reasonably well-informed audience of policy makers and practitioners who work in and for public services. It will particularly interest those who provide research, evaluation and facilitation support, and those seeking to develop a more relational approach to research and evaluation. Action inquiry is a model of practising change together in environments where ‘nothing is clear, and everything keeps changing’ that significantly challenges the prevailing discourse on evaluation. Action inquiry can be wrapped around and enmeshed within initiatives and programmes that work with complexity - anywhere where success will depend on the quality of relationships that can be developed. The paper reviews some important interrelated concepts that underpin the ideals of collective leadership and public service reform and which confront deeply embedded traditional notions of leadership, expertise and participation. These offer important challenges to ideas about how change happens and recognise that relationships are at the heart of practising change. This warrants a re-examination of the high expectations of evidence-based or informed practice. Collective leadership makes new demands of evidence as it rests on help to determine ‘wise actions’ in real-life situations. This confronts the practical reality of how to work together in conditions often expressed as ‘dynamic’ or ‘turbulent’ and the added human complexities of power, emotions and relationships; too often these elements are denied or avoided aspects of a change process. Facilitated action inquiry makes these elements part of the conversations, in the midst of ‘work-as-we-are-doing-it’, to increase areas of choice for individuals and a group as a whole. Within public policy, there is an overwhelming amount of evidence about ‘what works’ yet change seems to be stubborn and slow. The paper explores some of the deep-rooted vestiges of a ‘hierarchy of evidence’ and assumptions about standardisation and generalisability that act as a ‘barrier to transformation’. These include the narrow framing of what counts as evidence and consequent relegation of community perspectives, lived experience and practice-based evidence. The paper acknowledges the clear appetite for different approaches to evaluation, especially those that better reflect deeply held values and avoid creating a culture of ‘gaming’, rooted in fear of failure and loss of funding, at the expense of learning. The need for new forms of developmental evaluative thinking, collaborative inquiry and action research to create embedded learning is well overdue. Action inquiry is a desirable and necessary response to the complex situations and challenges of human services and recognises the essentialness of knowledge co-production. It is a model of co-creation at every stage and endorses the idea that people learn from participation in evaluation and by testing theories of change through action. Action inquiry builds on the idea of inquiry, or a moment-to-moment awareness and quality of attention and draws from several elements of action research practice. It sees inquiry as an intervention in itself, one that furthermore, explicitly seeks to enhance the probability of the success of a programme, focus on learning, the collaborative development of practice-based knowledge and positive relationships. The paper highlights the importance of building inquiry into living systems, the role of facilitation, systemic inquiry, and evaluative thinking. It proposes an expansion of ideas of appreciation as a relational and collaborative practice that is a driver of emergence. Social recognition that acknowledges someone’s social value to the community and implies mutual moral obligations to cooperation and participation is particularly crucial in a work context that requires successful coordination and multiple contributions to achieve results across hierarchies of position, professional rank and sectors. Hence, appreciation goes beyond the idea of positivity to include social recognition, valuing more explicit forms of inquiry, building participants’ aspirations to design new social systems and acting in new ways to embed change. In developing this discussion, the paper contributes to emerging dialogues about the need for a model of ‘5th generation evaluation’. Such a model would be based on the idea that appreciative and challenging inquiry that is contextual, relational and open-minded will create better opportunities for change and development. The paper sets out some ‘provocative propositions’ that can help us to navigate this terrain, perhaps of a fledgling ‘5th generation approach’ to inquiry. Facilitated action inquiry can hold the key to developing both new knowledge and an adaptive, collaborative and improvisational skill-set, able to respond in new ways to systemic and complex issues on the ground. It’s common to hear the expression ‘it’s all about relationships’ and it is clearly time to shift our focus to relationships; not relationships as ‘things’, but as co-created and dynamic relational processes in which we are embedded. In this way we can bring new qualities to our talking to each other about our various and shared visions of a better future.

Exploring new territories for evaluation - Provocative propositions - Sharp, Cathy (2018)

Tips on Learning from Context: Formal and Informal Approaches to Understanding the Local Political Economy - Swift, Sarah (USAID, 2018)
Successfully adapting your programmatic efforts and policy engagement to the context depends on maintaining your understanding of that context. Given this, continuous learning and feedback loops–not only about your programming, but also about the environment you are working within–are important components of USAID’s work. Since our environments are always changing, in ways big and small, this can be intimidating. One can imagine a scenario where learning consumes the limited time and budgets available, especially for small programs. The question becomes: How can we learn enough, at the right times, to limit missed opportunities and warning signs, while avoiding being consumed by data collection and analysis that never influences our work? This document capitalizes on the experiences of USAID staff as well as emerging learning from other donors and researchers to highlight a range of approaches–formal and informal, time-bound and continuous–that can support ongoing learning within the operational tempo of a busy Mission team or Operating Unit.

Werner Ulrich's Homepage - Ulrich, Werne (2018)
This website provides a variety of resources from Werner Ulrich's work in a range of philosophical and research areas with a particular focus on his own work in critical systems thinking and practice or, Critical Systems Heuristics (CSH).

A Framework for Freshwater Ecosystem Management - UN Enviornment (2018)

Discussion Note: Complexity-Aware Monitoring - USAID (USAID, 2018)
This Discussion Note complements ADS 201 and outlines general principles and promising approaches for monitoring complex aspects of USAID development assistance. Complexity-aware monitoring is a type of complementary monitoring that is useful when results are difficult to predict due to dynamic contexts or unclear cause and-effect relationships. Key principles of the Program Cycle include applying analytic rigor, managing adaptively, and utilizing a range of approaches to achieve results. ADS 201.3.5.5 identifies three types of program monitoring – performance, context, and complementary. All USAID programming incorporates performance monitoring and should include context monitoring. Performance monitoring “is the ongoing and systematic collection of performance indicator data and other quantitative or qualitative information to reveal whether implementation is on track and whether expected results are being achieved.” Context monitoring is “[t]he systematic collection of information about conditions and external factors relevant to the implementation and performance of an operating units (OU’s) strategy, projects, and activities.” As stated in ADS 201.3.5.5, complementary monitoring may be used by missions and Washington OUs to complement performance and context monitoring in situations where results are difficult to predict due to dynamic contexts or unclear cause-andeffect relationships. This Discussion Note provides an explanation of when to use complementary monitoring approaches that are complexity-aware and summarizes the three principles of complexity-aware monitoring.

The Global Wildlife Program - Knowledge Platform - 2016-2018 - WB (The World Bank, 2018)

Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping - Yang, Ting (2018)
Under the current results-driven development agenda, sound evaluation, and a corresponding evaluation toolkit, need to be in place to examine whether and to what extent development interventions have achieved their targeted objectives and results, and to generate lessons for further development learning and improvement. My review of the literature shows that innovative and appropriate evaluation approaches are needed to address key challenges in evaluation such as the tension between learning and accountability objectives, the need to unpack the mechanisms linking outputs and outcomes or goal, and to add an actor perspective. Irrespective of project type, the Logical Framework Approach (LFA) is often a standard requirement of major official donor agencies on projects they fund, so as to fulfil bureaucratic imperatives. However, it is often considered inadequate in addressing key challenges in development evaluation. Given the dominant status of the LFA with such strong support from donors, it is helpful to seek a ‘middle way’: a combination of the LFA with other approaches in order to address some of its inadequacies, while satisfying donor agencies’ requirements. A synthesis of the LFA and Outcome Mapping (OM) is one such option. This thesis explores the practical value and usefulness of a synthesis model empirically. Applying the model in two case study aid projects, I found that it serves well as a theory-based evaluation tool with a double-stranded (actor strand and results chain) theory of change. The model helps reconcile learning and accountability and add explanatory power and an explicit actor perspective. It also helps establish causation and enable attribution claims at various results levels with its different elements. The model has some limitations but my results suggest it can be usefully adopted. The choice of its application depends on project evaluation context and purpose in specific cases.
Book Title: Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping

Engaging Stakeholders in Planning for Sea Level Rise and Resilience - Yusuf, Juita-Elena (Wie); John, Burton St; Covi, Michelle; Nicula, J. Gail (Journal of Contemporary Water Research & Education, 2018)
This case study describes a region-wide, multi-sectoral, and whole-of-community stakeholder engagement approach for addressing sea level rise (SLR) and flooding. This approach was implemented through a university-led community engagement event, the Hampton Roads Resilient Region Reality Check (H4RC), which allowed an examination of its effectiveness as a mechanism for capturing community-wide perceptions regarding SLR, flooding, and associated risks; engaging stakeholders in discussion within and across different groups; and assessing community willingness to address flooding and SLR. The results show that the event helped participants broaden their perspectives and understanding of flooding and SLR. In an approach that called for participants to engage in social learning across social networks, the event had some effect on individual efficacy. However, there was little impact on participants' already-established perception that the region does not possess significant willingness to take action.
Keywords: Social learning; flooding; resilience; social capital; stakeholder engagement

Case study - Lepra - Adaptive programming in “reaching the unreached” - UK Aid Direct (DFID, 2017)

Impact Evaluation of Development Interventions: A Practical Guide - White, Howard; Raitzer, David (Asian Development Bank, 2017)
This book offers guidance on the principles, methods, and practice of impact evaluation. It contains material for a range of audiences, from those who may use or manage impact evaluations to applied researchers.
Accepted: 2017-12-26 Last Modified: 2020-07-22T18:28+08:00

Addressing challenges in communicating adaptation practices to smallholder farmers in Kenya through a radio intervention - Mwaniki, Fiona Nyawira; Gichuki, Charity; Mwangi, Maina; Mburia, Pamela; Wandago, Benson (Journal of Agriculture and Environment for International Development (JAEID), 2017)

Conceptualizing community resilience to natural hazards – the emBRACE framework - Forrester, John Martin; Kruse, Sylvia; Abeling, Thomas; Deeming, Hugh; Fordham, Maureen; Forrester, John; Jülich, Sebastian; Karanci, A. Nuray; Kuhlicke, Christian; Pelling, Mark; Pedoth, Lydia; Schneiderbauer, Stefan (Natural Hazards and Earth System Sciences, 2017)
Abstract. The level of community is considered to be vital for building disaster resilience. Yet, community resilience as a scientific concept often remains vaguely defined and lacks the guiding characteristics necessary for analysing and enhancing resilience on the ground. The emBRACE framework of community resilience presented in this paper provides a heuristic analytical tool for understanding, explaining and measuring community resilience to natural hazards. It was developed in an iterative process building on existing scholarly debates, on empirical case study work in five countries and on participatory consultation with community stakeholders where the framework was applied and ground-tested in different contexts and for different hazard types. The framework conceptualizes resilience across three core domains: (i) resources and capacities, (ii) actions and (iii) learning. These three domains are conceptualized as intrinsically conjoined within a whole. Community resilience is influenced by these integral elements as well as by extra-community forces comprising disaster risk governance and thus laws, policies and responsibilities on the one hand and on the other, the general societal context, natural and human-made disturbances and system change over time. The framework is a graphically rendered heuristic, which through application can assist in guiding the assessment of community resilience in a systematic way and identifying key drivers and barriers of resilience that affect any particular hazard-exposed community.

Monitoring and evaluation: five reality checks for adaptive management - Pasanen, Tiina (ODI Insight, 2017)

Mission-Based Monitoring, Evaluation and Learning (MEL) Platforms Assessment Report - Arntson, Laura; Giannoni, Tonya; Peek, Nancy; Saarlas, Kristin (USAID, 2017)
In 2016, the Bureau of Policy, Planning and Learning (PPL) commissioned an internal stocktaking of USAID's mission-based MEL (Monitoring, Evaluation, and Learning) Platforms.

Theory of Change Analysis: Building Robust Theories of Change - Mayne, John (Canadian Journal of Program Evaluation, 2017)
Models for theories of change vary widely as do how they are used. What constitutes a good or robust theory of change has not been discussed much. This article sets out and discusses criteria for robust theories of change. As well, it discusses how these criteria can be used to undertake a vigorous assessment of a theory of change. A solid analysis of a theory of change can be extremely useful, both for designing or assessing the designs of an intervention as well as for the design of monitoring regimes and evaluations. The article concludes with a discussion about carrying out a theory of change analysis and an example.

Adaptive management intentions with a reality of evaluation: Getting science back into policy - Hasselman, Lyndal (Environmental Science & Policy, 2017)
In Australia’s Murray-Darling Basin water reform has been contentious as government attempts to reconcile historical over allocation of water to irrigation with the use of water for environmental outcomes. However, in many aspects, scientific knowledge of the environment is either imperfect, incomplete or environmental responses are unpredictable, with this uncertainty preventing definitive policy and closure of political arguments. In response to uncertainty and knowledge gaps, adaptive management has been written into the legislation, along with provisions for periodic evaluation. This research ascertains how adaptive management is understood by policy makers, with this indicative of future implementation of adaptive management. The way in which adaptive management is constructed by policy makers is determined through legislation, public speeches, government reports and semi-structured interviews. The findings demonstrate that adaptive management has been subsumed by evaluation. The loss of adaptive management as a distinct concept is seen as a loss of science and discovery from the policy process, with the dominance of evaluation discussed as limiting innovation and reinforcing a ‘muddling through’ of policy.
Keywords: Accountability; Adaptive Management; Evaluation; Science; Uncertainty

The Role of External Actors in Supporting Social and Political Action towards Empowerment and Accountability with a Focus on Fragile, Conflict- and Violence-Affected Settings - Christie, Angela; Burge, Richard (IDS and ITAD, 2017)
This paper explores the role and experience of external actors, particularly donors, in supporting social and political action in fragile, conflict and violence affected settings. Evidence is distilled from a wide range of synthesised sources to generate relevant findings and questions in relation to what we know and what we don’t. Included among the source material is a 2016 macro-evaluation of DFID’s empowerment and accountability (E&A) programmes which examined over 50 DFID funded projects. Themes which emerge relate to: how external actors need to think about the context and work politically; who are the most appropriate social and political actors to support in E&A; whether a direct or indirect approach to support for E&A achieves more tangible outcomes; whether external actors should move beyond short-term tools and tactics focused on one-sided engagement; and whether programmes should be designed around more strategic, multi-faceted interventions. The paper concludes with identifying a number of gaps in the evidence which are translated into a range of questions which could potentially inform the Action for Empowerment and Accountability (A4EA) research programme.

Learning how to go local: Lessons from six learning journeys for the Open Government Partnership - Moses, Michael; Soal, Sue (2017)
This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP). The evidence from L-MAVC suggests that supporting citizen engagement with, and use of, OGP, and improving the extent to which OGP commitments are shaped by and matter to citizens in subnational districts, is not straightforward. Findings suggest that efforts to broaden and deepen citizen engagement with OGP, including at subnational levels, may be more effective when combined with support that helps local OGP champions iteratively learn and adapt, and discover and apply localisation models that fit best in their contexts. OGP and its partners may strengthen the impact of the initiative, and indeed, the impact of those working to leverage OGP at and below country level, by making structured learning support more available to local reformers. Targeted advocacy, focused on institutionalising collaborative OGP processes, and on linking subnational action with National Action Plans (NAPs), may also be useful.

Learning to Make All Voices Count: Lessons for OGP, donors, and practitioners - Moses, Michael; Soal, Sue (2017)
The Open Government Partnership (OGP), donors and multilaterals, and social accountability practitioners across the world are among various constituencies attempting to harness and actualise emerging insights about the nature of successful governance reform. But each of these groups faces challenges as they do so. This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP). Two sets of lessons emerge from the experience of L-MAVC. First, supporting citizen engagement and government accountability in subnational contexts, and localising OGP in ways that matter to citizens, is not straightforward. Doing so successfully entails engaging with, navigating and shaping political and power dynamics in those contexts, and iteratively adapting to emerging lessons and challenges. Second, the effectiveness of adaptive ways of working depends in part on the extent to which they offer opportunities for cross-context peer learning, support the regular collection and use of data, and are themselves adaptive. These lessons have implications for the broader community of actors working to support governance reform, including OGP and its partners, donors and multilateral institutions, and practitioners and policy-makers. If these actors are to contribute more effectively to reforms that affect citizens’ lives, substantial changes – with respect to the nature of support provided to domestic stakeholders, grant-making practices, and practitioner approaches – may be warranted.

Supporting local learning and adaptation: understanding the effectiveness of adaptive processes - Moses, Michael; Soal, Sue (2017)
This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP).

Independent Evaluation of SDC’s Results-Based Management System with a Focus on Poverty Reduction - Schmidt, Martin; Palenberg, Markus; Vähämäki, Janet (SDC, 2017)
The SDC's results-based management system ensures that the processes and instruments used for the design and implementation of programs and projects contribute to achieving the desired results (outputs, outcomes and impact). The independent evaluation examines the extent to which these processes and tools have fostered the results culture within the organization, and improved competencies for results-based management decisions, learning and communication. In addition to the findings, conclusions and recommendations, the evaluation report includes the management response of SDC’s Directorate.

The five trademarks of agile organizations - Wouter Aghina; Karin Ahlbäck; Aaron De Smet; Clemens Fahrbach; Christopher Handscomb; Gerald Lackey; Michael Lurie; Monica Murarka; Olli Salo; Elizabeth Seem; Jannik Woxholth (McKinsey anc Company, 2017)
Our experience and research demonstrate that successful agile organizations consistently exhibit the five trademarks described in this article. The trademarks include a network of teams within a people-centered culture that operates in rapid learning and fast decision cycles which are enabled by technology, and a common purpose that co-creates value for all stakeholders. These trademarks complement the findings from The McKinsey Global Survey Results: How to create an agile organization.

Webimar - Adaptive Management at the Strategy Level: Portfolio Reviews and Mid Course Stocktaking - USAID (USAID, 2017)
On Wednesday, November 15, 2017 at 8:00 a.m. EST, the Bureau for Policy, Planning and Learning (PPL) held a one-hour webinar exploring Strategy-level Portfolio Reviews and Mid Course Stocktaking.

Walking the Long Road Together - Stilger, Bob (Afternow: When We Cannot See the Future Where Do We Begin?, 2017)
On March 11, 2011, overwhelming and incomprehensible disaster struck the northeast coast of Japan. Life for those in the region would never be the same. This book is about the awakening that follows disaster. About the minutes and months and years that come after now. It is about what happens when we're smacked on the side of the head and open our eyes, startled out of the trance in which we have been living our days. It is about the opportunities always present, often invisible, to create the lives we want, now. AfterNow chronicles the author's journey with the Japanese people over 6 years – his own story of awakening after plunging into this disaster and the stories from people who found where to take their first step, and the next. It offers the tools and processes and worldview people discovered to create what comes after now. It is built around two big ideas. The first is that after disaster, we find our way forward, together. We come awake, together. Disaster obliterates the past, plunges the present into chaos and cocoons the future. We need each other to see and build the new. The second idea is that we don't have to wait for the tragedy of disaster to make the communities and lives we want. We can engage each other with respect, curiosity and generosity and begin to co-create what we want, now. We live in a period of precipitous, unpredictable change. The book is for those who want to make this time more livable and less insane. In Japan and all over the world, we are living in the messy middle where old forms are falling apart and new possibilities are in early stages. The ground is pulled out from under us on a regular basis. Our work right now is to learn to coexist with the messiness. We need to keep trying things, to keep learning. We need to remain focused on our purpose and follow the braided strand of intention and surrender as we find our way forward. embracing radical uncertainty, showing up as fully as we can each moment, each breath.

Adaptiveness through ‘simplest tools and practices’ - Prieto Martin, Pedro (Institute of Development Studies, 2017)
In recent years, more and more influential development organisations have been openly recognising the central role that adaptive management capacities – the ability to keep improving strategies and actions as programmes unfold – play for the success of complex interventions. As a result, there has been a rich exchange of ideas and experiences on how to promote adaptiveness in development. But development organisations and professionals are having a hard time translating the many adaptive theories and recommendations into improved practices and outcomes. They are generally failing to adjust the design and operation of programmes to accommodate incipient lessons learnt and the unexpected changes in the context. Nowadays, most programme adaptations still take the form of a change of direction once it is clear that things have gone really wrong. Why is so difficult to put what we know about adaptiveness into practice? And more importantly: what can be done to improve this situation?

Facilities deserve a place in development - Lacy, Jacqui de (Devpolicy Blog from the Development Policy Centre, 2017)
There are different ways to deliver aid programs, DFAT often uses facilities in its larger relationships, what are the rationales and risks behind this?

Is there a new Washington Consensus? An analysis of five World Development Reports - Evans, Alice (From Poverty to Power, 2017)
Is there a new Washington Consensus? Alice Evans analyses the last five World Development Reports and finds significant changes in orthodoxy, but also big gaps

Scenario-based strategizing: Advancing the applicability in strategists' teams - Lehr, Thomas; Lorenz, Ullrich; Willert, Markus; Rohrbeck, René (Technological Forecasting and Social Change, 2017)
For over 40years, scenarios have been promoted as a key technique for forming strategies in uncertain environments. However, many challenges remain. In this article, we discuss a novel approach designed to increase the applicability of scenario-based strategizing in top management teams. Drawing on behavioural strategy as a theoretical lens, we design a yardstick to study the impact of scenario-based strategizing. We then describe our approach, which includes developing scenarios and alternative strategies separately and supporting the strategy selection through an integrated assessment of the goal-based efficacy and robustness. To facilitate the collaborative strategizing in teams, we propose a matrix with robustness and efficacy as the two axes, which we call the Parmenides Matrix. We assess the impact of the novel approach by applying it in two cases, at a governmental agency (German Environmental Ministry) and a firm affected by disruptive change (Bosch, leading global supplier of technology and solutions).
Keywords: Behavioural strategy; Scenario-based strategizing; Scenarios; Strategic foresight; Uncertainty

How INGOs are Doing Development Differently - Algoso, Dave (Care, IRC, Mercy Corps, Oxfam & World Vision, 2017)

Market Systems Development - Operational Guidance Note - DFAT (DFAT, 2017)

The Futures Toolkit: Tools for Futures Thinking and Foresight Across UK Government - HM Government (2017)

Managing Facilities: a stock-take from the first 12 months - Tyrrel, Lavinia; Teskey, Graham; de Lacy, Jacqui (Abt Associates, 2017)

Valuing peace: delivering and demonstrating mediation results - Dilemmas & options for mediators - Wadley, Ian (Centre for Humanitarian Dialogue, 2017)
Essential points for practitioners and donors • Mediation offers a cost-effective and proven method for resolving armed conflict. Between 1985 and 2015, 75 per cent of armed conflicts in the world were resolved through agreement rather than by force. In most cases these processes will have involved third party facilitation or support. • Professional mediators understand the high stakes involved in their work to prevent, mitigate and resolve armed conflict. In addition, they and their financial supporters are increasingly required to demonstrate ‘value-for-money’ to ensure continued funding. • However, traditional monitoring and evaluation (M&E) methods are not well suited to this task, typically imposing artificially linear project models on a dynamic conflict situation, as well as compliance reporting that moves attention away from real value. • Traditional M&E methods tend to focus on documenting the past and generating vast amounts of data, rather than enabling timely adaptation of the project in the present. • Traditional M&E approaches rely heavily on external evaluation consultants. Even in the best of cases this may interfere with the mediation process and impose a heavy time burden on the project team, leading to low acceptance of traditional M&E approaches by mediation practitioners. • In contrast, an ideal M&E approach for mediation should deliver useful insights in even the most dynamic and sensitive mediation environments, impose a light reporting burden, and be readily accepted by mediation teams. It should protect discretion and trust, enable rapid adaptation, and also provide some assurance that donor funds are being well spent.

Using what we know: How to ensure tech projects meet the brief - Walker, Tom (Making All Voices Count, 2017)
Making tech effective - building on what we already know

Are you doing what’s needed to get the state to respond to its citizens? Or are you part of the problem? - Herringshaw, Vanessa (Making All Voices Count, 2017)
Three challenges from Making All Voices Count research on responsive governance

Principles-Focused Evaluation: The GUIDE - Patton, Michael Quinn (Guilford Press, 2017)
How can programs and organizations ensure they are adhering to core principles–and assess whether doing so is yielding desired results? From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings. Patton explains why principles matter for program development and evaluation and how they can serve as a rudder to navigate the uncertainties, turbulence, and emergent challenges of complex dynamic environments. In-depth exemplars illustrate how the unique GUIDE framework is used to determine whether principles provide meaningful guidance (G) and are useful (U), inspiring (I), developmentally adaptable (D), and evaluable (E). User-friendly features include rubrics, a P-FE checklist, firsthand reflections and examples from experienced P-FE practitioners, sidebars and summary tables, and end-of-chapter application exercises.

Scaling Agile @ LEGO and Spotify – my talk at EA träff - Kniberg, Henrik (Crisp, 2017)

Bridging Real-Time Data and Adaptive Management: Ten Lessons for Policy Makers and Practitioners - Ben Ramalingam; Inka Barnett; Kevin Hernandez; Panthea Lee; Anna Levy; Carrie Oppenheimer; Dennis Whittle; Craig Valters; Leni Wild (USAID, 2017)
The ongoing digital revolution has seen rapid growth in the deployment of technology enabled real-time data initiatives in international development and humanitarian work, developed with the goal of accelerating decision-making processes and enhancing aid effectiveness and efficiency.

Theories of Change for Promoting Empowerment and Accountability in Fragile and Conflict-Affected Settings - Green, Duncan (IDS, 2017)
This paper explores the current state of thinking among a range of aid actors (multilaterals, bilateral, applied scholars and international non-governmental organisations) on how to promote empowerment and accountability in fragile, conflict and violence affected settings. It seeks to identify trends, gaps and weaknesses in that thinking, and propose research questions and hypotheses to test. Three underlying sources of confusion are identified that are hindering progress on both understanding empowerment and accountability in fragile, conflict and violence affected settings, and taking helpful action to promote it. They are: Theory of endogenous change (e.g. on how empowerment and accountability arise in situ) versus the theory of action of an external intervention; Fragility versus conflict: there is no clear justification for combining these different aspects into a single category; and Empowerment versus accountability: donor analysis and practice has been overwhelmingly weighted towards accountability, exhibiting limited understanding or interest in the nature of power.
Keywords: A4EA; External actors; Participation

Interview protocol: Most significant turning points - Prieto Martin, Pedro; Faith, Becky (Institute of Development Studies, 2017)
This interview protocol was used for a research project on adaptiveness in technology for governance initiatives in Kenya. For more information, please read the research report at: Prieto Martin, P.; Hernandez, K.; Faith, B. and Ramalingam, B. (2017) Doing Digital Development Differently: Lessons in adaptive management from technology for governance initiatives in Kenya, MAVC Research Report, Brighton: Institute of Development Studies, ids.ac.uk/project/making-all-voices-count
Keywords: IMPORTANT

Doing Digital Development Differently: Lessons in adaptive management from technology for governance initiatives in Kenya - Prieto Martin, Pedro; Hernandez, Kevin; Faith, Becky; Ramalingam, Ben (IDS, 2017)
Development projects don’t always work as planned. This has long been acknowledged by those in the sector, and has led to several approaches that seek to solve complex development problems through enabling and encouraging greater adaptiveness and learning within projects (e.g. Doing Development Differently and Problem-Driven Iterative Adaptation). Digital development projects experience many of these issues. Using technology for transparency and accountability (Tech4T&A) projects in Kenya as case studies, our research analysed the many different theoretical approaches to learning and adaptation, and then tested how these play out in reality. Firstly, we conducted an extensive review of the literature on the spectrum of approaches to adaptive learning. The findings were used to develop a framework through which to analyse adaptiveness at the different layers of complexity in projects (e.g. software design and development, programme design and management). The second part of the research consisted of interviews and focus group discussions with participants in Tech4T&A projects in Kenya. Respondents helped us identify the main characteristics of adaptiveness in their projects (e.g. who needs to adapt, and how and when) and the challenges and issues that inhibit projects’ abilities to be adaptive. This process also revealed how accountability interplays with adaptiveness, and considered how better collaboration flows can enable adaptiveness. From our literature review and empirical study, we draw several conclusions for increasing adaptiveness in digital development projects. These include simplifying the many adaptive theories that abound, increasing responsiveness to project beneficiaries and stakeholders, and for stakeholders to keep on experimenting, networking and advocating.
Keywords: IMPORTANT

How to create an agile organization - survey - Salo, Olli; Ahlbäck, Karin; Fahrbach, Clemens; Murarka, Monica (McKinsey & Co., 2017)
Eighteen practices for organizational agility The survey asked respondents about a series of specific actions that underlie each of the 18 practices (9 of them stable, and 9 dynamic) of organizational agility; all of the practices are summarized in the table below. To rate respondents’ organizations, we asked how frequently their performance units engaged in each action that supports a given practice.

Real World SAFe – Leapfrogging a successful waterfall company into Scaled Agile - Skarin, Mattias (CRISP, 2017)

The interplay between social learning and adaptive capacity in climate change adaptation: A systematic review - Phuong, Thi Hong Le; Biesbroek, G. Robbert; Wals, Arjen E.J. (NJAS - Wageningen Journal of Life Sciences, 2017)
Successful implementation climate change adaptation depends to a large extent on the capabilities of individuals, organizations, and communities to create and mobilize the adaptive capacity (AC) of their socio-ecological system. Creating and mobilizing AC is a continuous process that requires social learning (SL). Although rich with empirical cases, the literature theorizing and empirically investigating the relationship between AC and SL is highly fragmented. This paper aims to critically examine the peer-reviewed literature that focusses on SL and AC in the context of climate change adaptation (CCA). Special attention is paid to the interplay between the two. Understanding this interplay can help improve our understanding of how CCA takes place in practice and advances theoretical debates on CCA. Systematic review methods are used to analyse 43 papers (1997–2016). Our findings reveal three perspectives that each play an important role in different contexts: an AC-focused perspective, a SL-focused perspective, and a hybrid perspective. These differences in conceptualizations of the relationship between SL and AC may seem trivial at first, but they have consequences for the design of learning-based interventions aimed at helping communities respond to climate change. It appears that such interventions need to be preceded by an analysis of the climate change context in order to decide whether to emphasize AC, SL or both simultaneously.
Keywords: Adaptive capacity; Climate change adaptation; Social learning; Systematic review

A Rubric to Evaluate Citizen-Science Programs for Long-Term Ecological Monitoring - Tredick, Catherine A.; Lewison, Rebecca L.; Deutschman, Douglas H.; Hunt, Timothy ANN; Gordon, Karen L.; Von Hendy, Phoenix (BioScience, 2017)
Abstract. Citizen-science (CS) programs provide a cost-effective way to collect monitoring data over large temporal and spatial scales. Despite the recent prol

Enabling collaboration and synthesis: in brief - Cochrane, Logan; Cundill Kemp, Georgina; Landry, Marie-Eve; Lee, Rebecca (INBRIEF, 2017)
Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA) aims to build the resilience of vulnerable populations in climate change hotspots by building new knowledge and capacities to support better informed policy and practice. The program connects more than 450 researchers and practitioners from over 40 organizations. Initially, CARIAA was not directive in terms of the specific topics or forms of synthesis. This approach allowed new ideas to emerge from interactions between members of the network. However, as the brief outlines, lessons learned at mid-term regarding cross- consortia collaboration and synthesis indicate that greater programmatic leadership is required.

The 2017 Reader on Results Measurement. An introduction to the DCED Standard - DCED (DCED, 2017)

An introduction to the Learning Architecture - HLA (Humanitarian Leadership Academy, 2017)
The Learning Architecture is built on a flexible Learning Methodology and provides principles, technologies and behaviours of Scaffolded Social Learning.

Developmental Evaluation in Practice: Tips, Tools, and Templates - USAID (USAID, 2017)

How to Make ‘Cash Plus’ Work: Linking Cash Transfers to Services and Sectors - Roelen, Keetie; Devereux, Stephen; Abdulai, Abdul-Gafaru; Martorano, Bruno; Palermo, Tia; Ragno, Luigi Peter (UNICEF Office of Research, 2017)
The broad-ranging benefits of cash transfers are now widely recognized. However, the evidence base highlights that they often fall short in achieving longer-term and second-order impacts related to nutrition, learning outcomes and morbidity. In recognition of these limitations, several ‘cash plus’ initiatives have been introduced, whereby cash transfers are combined with one or more types of complementary support. This paper aims to identify key factors for successful implementation of these increasingly popular ‘cash plus’ programmes, based on (i) a review of the emerging evidence base of ‘cash plus’ interventions and (ii) an examination of three case studies, namely, Chile Solidario in Chile, IN-SCT in Ethiopia and LEAP in Ghana. The analysis was guided by a conceptual framework proposing a menu of ‘cash plus’ components. The assessment of three case studies indicated that effective implementation of ‘cash plus’ components has indeed contributed to greater impacts of the respective programmes. Such initiatives have thereby addressed some of the non-financial and structural barriers that poor people face and have reinforced the positive effects of cash transfer programmes. In design of such programmes, further attention should be paid to the constraints faced by the most vulnerable and how such constraints can be overcome. We conclude with recommendations regarding the provision of complementary support and cross-sectoral linkages based on lessons learned from the case studies. More research is still needed on the impact of the many variations of ‘cash plus’ programming, including evidence on the comparative roles of individual ‘plus’ components, as well as the knowledge, attitudes and behaviour pathways which influence these impacts.
Series: Innocenti Working Papers Volume: 2017/10

Extreme Teaming: Lessons in Complex, Cross-Sector Leadership - Edmondson, Amy C.; Harvey, Jean-Francois (Emerald Group Publishing Limited, 2017)
Extreme Teaming Lessons in Complex, Cross-Sector Leadership Today’s global enterprises increasingly involve collaborative work by teams of experts operating across different professions, organizations, and industries. Extreme Teaming provides new insights into the world of complex, cross industry projects and the ways they must be managed. Leading experts Amy Edmondson and Jean-François Harvey analyze contemporary cases that expose the complex demands of cross-boundary collaboration on management, and inform our understanding of teams. Containing powerful insights and practical guidelines that allow managers to bridge professional divides and organizational boundaries in order to work together effectively, this is a new exploration of the challenges involved in today’s global enterprises. The authors demonstrate that the work done in the modern organization is less and less about looking inward and creating strong teams inside the company, and more about teaming across boundaries – that often are in flux. Extreme Teaming is a must-read book for all courses related to leading open innovation; teamwork and collaboration; project management; and cross-boundary work.

Strengthening the results chain: Synthesis of case studies of results-based management by providers - Zwart, Rosie (OECD, 2017)
This paper presents an analysis of evidence from seven case studies of results-based management by development co-operation providers. Analysis of themes from the case studies reveal six interrelated challenges which providers face in their efforts to manage for the results of development co-operation. The six challenges are: linking results to development goals, ensuring the purpose of results systems is well-defined, weighing up the benefits of aggregating and attributing results from standard indicators, enabling country ownership, using performance information alongside results information, and building and embedding a results culture. Providers continue to adopt a range of approaches to pursue a focus on results and there are many examples of good practice. The case studies suggest that in a complex development landscape some providers are prioritising the use of aggregated results information for domestic accountability, communication, and performance management over their use for learning and policy direction. In this context, the paper argues that in agency-wide results frameworks development co-operation results are often detached (or de-contextualised) from development results and discusses the implications of this, including the use of standard indicators to measure aggregated outputs. The paper uses case study evidence to discuss and suggest practical ways providers can build and maintain a strong results focus which enables analysis, insights and learning, and has achievement of development outcomes as its objective.

Systems Approaches to Public Sector Challenges: Working with Change - OECD (OECD, 2017)

One step back, two steps forward: CARE’s journey towards doing development differently - Aston, Tom (Care Insights, 2017)
The Doing Development Different (DDD) community emerged in August 2014 and advocates that (a) the barriers to development are as much political as tec...

NGOs Doing Development Differently - Green, Duncan (From Poverty to Power, 2017)
Report back from a meeting of international NGOs to set up a research and practice network on 'Doing Development Differently' that can complement other actors

Policy experimentation and innovation as a response to complexity in China’s management of health reforms - Husain, Lewis (Globalization and Health, 2017)
There are increasing criticisms of dominant models for scaling up health systems in developing countries and a recognition that approaches are needed that better take into account the complexity of health interventions. Since Reform and Opening in the late 1970s, Chinese government has managed complex, rapid and intersecting reforms across many policy areas. As with reforms in other policy areas, reform of the health system has been through a process of trial and error. There is increasing understanding of the importance of policy experimentation and innovation in many of China’s reforms; this article argues that these processes have been important in rebuilding China’s health system. While China’s current system still has many problems, progress is being made in developing a functioning system able to ensure broad population access. The article analyses Chinese thinking on policy experimentation and innovation and their use in management of complex reforms. It argues that China’s management of reform allows space for policy tailoring and innovation by sub-national governments under a broad agreement over the ends of reform, and that shared understandings of policy innovation, alongside informational infrastructures for the systemic propagation and codification of useful practices, provide a framework for managing change in complex environments and under conditions of uncertainty in which ‘what works’ is not knowable in advance. The article situates China’s use of experimentation and innovation in management of health system reform in relation to recent literature which applies complex systems thinking to global health, and concludes that there are lessons to be learnt from China’s approaches to managing complexity in development of health systems for the benefit of the poor.

Can we know better? Reflections for Development - Chambers, Robert (Practical Action, 2017)
This book is intended for all who are committed to human wellbeing and who want to make our world fairer, safer and more fulfilling for everyone, especially those who are 'last'. It argues that to do better we need to know better. It provides evidence that what we believe we know in international development is often distorted or unbalanced by errors, myths, biases and blind spots. Undue weight has been attached to standardised methodologies such as randomized control trials, systematic reviews, and competitive bidding: these are shown to have huge transaction costs which are rarely if ever recognized in their enormity. Robert Chambers contrasts a Newtonian paradigm in which the world is seen and understood as controllable with a paradigm of complexity which recognizes that the real world of social processes and power relations is messy and unpredictable. To confront the challenges of complex and emergent realities requires a revolutionary new professionalism. This is underpinned by a new combination of canons of rigour expressed through eclectic methodological pluralism and participatory approaches which reverse and transform power relations. Promising developments include rapid innovations in participatory ICTs, participatory statistics, and the Reality Check Approach with its up-to-date and rigorously grounded insights. Fundamental to the new professionalism, in every country and context, are reflexivity, facilitation, groundtruthing, and personal mindsets, behaviour, attitudes, empathy and love. Robert Chambers surveys the past world of international development, and his own past views, with an honest and critical eye, and then launches into the world of complexity with a buoyant enthusiasm. He draws on almost six decades of experience in varied roles in Africa, South Asia and elsewhere as practitioner, trainer, manager, teacher, evaluator and field researcher, also working in UNHCR and the Ford Foundation. He is a Research Associate and Emeritus Professor at the Institute of Development Studies, University of Sussex, his base for many years. Can We Know Better? is essential reading for researchers and students of development, for policy makers and evaluators, and for all those working towards the better world of the Sustainable Development Goals.

Supporting accountability in fragile settings: A review for the Somalia Implementation and Analysis in Action of Accountability Programme - Nixon, Hamish; Buffardi, Anne; Wales, Joseph; Pasanen, Tiina (ODI, 2017)

Lessons from a trial of the Success Case Method - McGuinness, Liz (Better Evaluation, 2017)
The Success Case Method approach is useful for documenting stories of impact and for understanding the factors that help or hinder impact. It is particularly useful for uncovering the contextual forces that influence impact. Originally designed for evaluating corporate training programs, the Success Case Method is now being applied to other programs including international development interventions. Last year, I provided technical assistance to a pilot of the Success Case Method as part of the USAID-funded Complexity-Aware M&E Trials.

Agility and Evolution. How Mercy Corps Adapts at the Organizational Level - Mercy Corps (2017)
How Mercy Corps Adapts at the Organizational Level

Two Paths to Supporting Grassroots Innovation - Cooper, Nathan; Hazeldine, Shaun; Quaggiotto, Giulio (Stanford Social Innovation Review, 2017)
An innovation experiment in Indonesia yields insights on how international development organizations can effectively foster innovation within the communities they aim to help.

Evaluating complex interventions: A theory-driven realist-informed approach - Douthwaite, Boru; Mayne, John; McDougall, Cynthia; Paz-Ybarnegaray, Rodrigo (Evaluation, 2017)
There is a growing recognition that programs that seek to change people’s lives are intervening in complex systems, which puts a particular set of requirements on program monitoring and evaluation. Developing complexity-aware program monitoring and evaluation systems within existing organizations is difficult because they challenge traditional orthodoxy. Little has been written about the practical experience of doing so. This article describes the development of a complexity-aware evaluation approach in the CGIAR Research Program on Aquatic Agricultural Systems. We outline the design and methods used including trend lines, panel data, after action reviews, building and testing theories of change, outcome evidencing and realist synthesis. We identify and describe a set of design principles for developing complexity-aware program monitoring and evaluation. Finally, we discuss important lessons and recommendations for other programs facing similar challenges. These include developing evaluation designs that meet both learning and accountability requirements; making evaluation a part of a program’s overall approach to achieving impact; and, ensuring evaluation cumulatively builds useful theory as to how different types of program trigger change in different contexts.

From Design Thinking to Systems Change - Conway, Rowan; Masters, Jeff; Thorold, Jake (RSA, 2017)
This report takes the Small Business Research Initiative (SBRI), a twophase pre-procurement innovation programme that aims to match social challenges with new ideas, as its primary case study. It suggests augmenting the excellent design thinking deployed through SBRI with a think like a system, act like an entrepreneur lens in order to drive better social outcomes from SBRI-originating innovations. Programmes like SBRI have great potential to drive change and address pressing challenges, but must be guided by a more developed understanding of how change happens. The stakes are too high to not raise our game when it comes to social innovation. Wicked problems can be overcome but will require sophisticated theories of change able to account for the complexity and unpredictability of modern life. We offer think like a system, act like an entrepreneur as a contribution to this effort. This report is based on the following research: •• Desk based review of relevant literature; •• A series of structured interviews with participants in SBRI competitions; and •• An expert round table that brought together policymakers, commissioners, procurement experts and entrepreneurs to consider and develop initial findings.
Keywords: ⛔ No DOI found

How to set up and manage an adaptive programme - Lessons from the Action on Climate Today (ACT) Programme - Cooke, Katherine (OPM, 2017)

Governance for Growth in Vanuatu: Review of a decade of thinking and working politically - Hadley, Sierd; Tilley, Helen (ODI, 2017)

Incorporating Geospatial Analysis into USAID Biodiversity Program Design - Higgins, Mark; Salafsky, Nick; Adeney, Marion; Petrova, Silvia (USAID, 2017)
Incorporating Geospatial Analysis into USAID Biodiversity Program Design is a biodiversity case example that describes the use of geospatial data and analysis for program design, including examples and lessons learned.

Thinking and Working Politically: Lessons from FOSTER in Nigeria - Lopez Lucia, Elisa; Buckley, Joanna; Marquette, Heather; McCulloch, Neil (DLP Program, 2017)
The Facility for Oil Sector Transparency and Reform (FOSTER) was a £14 million programme that has helped Nigeria to transform its governance of the oil and gas industry. FOSTER ran from 2011 to mid-2016, and used an explicit ‘thinking and working politically’ (TWP) approach. It was funded by the UK Department for International Development (DFID) and managed by Oxford Policy Management (OPM). This paper seeks to identify the factors that drove – or constrained – FOSTER’s achievements, and asks what this can tell us about TWP, particularly in challenging political and sectoral contexts. FOSTER sought to help strengthen oversight and accountability in Nigeria’s oil sector. It aimed to support reformers within government institutions that ‘supply’ accountability (those governing how oil and gas revenues are collected and managed), and to support civil society organisations, parliament, the media and the Nigeria Extractive Industries Transparency Initiative to ‘demand’ reform. In addition, FOSTER commissioned a series of studies and provided media training to help broaden understanding of the sector and highlight the need for reform. This paper examines the outcomes from five ‘clusters’ of FOSTER interventions. The FOSTER team viewed the first three of these in the list below as successful, whereas the latter two did not deliver on expectations but offer important opportunities for learning: • Support to the Nigerian Extractive Industries Transparency Initiative • Support to demand-side actors to promote transparency and accountability in the oil sector • Support for the passage of the Petroleum Industry Bill • An oil spill-mapping social media project • Support to the Department of Petroleum Resources The analysis drew on 44 semi-structured interviews conducted during a month of fieldwork in Abuja and Lagos; on reviews of the programme’s monitoring, evaluation and learning frameworks; and on newspaper articles and grey literature on Nigeria’s oil sector.2

Case studies of results-based management by providers: Canada - OECD (OECD, 2017)

Case studies of results-based management by providers: World Bank Group - OECD (OECD, 2017)