What we’ve learned about adaptive management from our Somalia education programming - Heales, Charlotte (Care Insights, 2020)
Adaptive management in its various incarnations has long been a focus of a development community that is more and more frequently bumping up against the barriers of complexity, and looking for ways to overcome its challenges. In a field where we consistently have to deal with multifaceted problems,...

What is impact? - Hearn, Simon; Anne, Buffardi (2016)
• Impact is a multi-dimensional concept. Some definitions focus on very precise understandings of impact, while others cast a much broader net. • How impact is defined and used has a significant effect on the design, management and evaluation of development programmes. • Development programmes should hold explicit conversations with different stakeholders about how impact is used and understood, in order to come to a shared understanding. • There are six dimensions of impact that may help development programmes be clearer about what they mean.

Not everything that connects is a network - Hearn, Simon; Mendizabal, Enrique (ODI, 2011)
In the public policy context, networks have been predominant factors in policy formulation, innovation and global governance. While not a new phenomenon in the development landscape, networks are becoming increasingly prevalent. Donors, for example, are turning to networks to deliver aid interventions, NGOs are working through networks for collective advocacy and researchers collaborate across networks for greater policy influence. But are networks always the most appropriate vehicle? Where they are appropriate, how can we make the best use of them? This Background Note argues for a more rigorous understanding of their nature, particularly their value (and costs), and presents a revised Network Functions Approach as a model for rationalised investment in networks.

Making Outcome Mapping Work - Volume 2 - Innovations in Participatory Planning, Monitoring and Evaluation - Hearn, Simon; Schaeffer, Heidi; van Ongevalle, JAn (Outcome Mapping Learning Community, 2009)

Communities of practice: Linking knowledge, policy and practice - Hearn, Simon; White, Nancy (ODI, 2009)
This paper describes the basic characteristics of CoPs and provides a rationale for their growing importance in international development. It also suggests some ways in which CoPs can be supported by development agencies, research institutes and donors to strengthen the linkages between knowledge, policy and practice.

Failure, Success and Improvisation of Information Systems Projects in Developing Countries - Heeks, Richard (Institute for Development Policy and Management, 2002)
Research on the Information Society, the Digital Divide and Information and Communication Technologies for development

Information Systems and Developing Countries: Failure, Success, and Local Improvisations - Heeks, Richard (The Information Society, 2002)
This article presents evidence that–alongside the successes– many information systems in developing countries can be categorized as failing either totally or partially. It then develops a new model that seeks to explain the high rates of failure. The model draws on contingency theory in order to advance the notion of design-actuality gaps: the match or mismatch between IS designs and local user actuality. This helps identify two high-risk archetypes that affect IS in developing countries: country context gaps and hard-soft gaps. The model is also of value in explaining the constraints that exist to local IS improvisations in developing countries. Overall, the article shows how model and theory help understand IS cases in developing countries, and equally, how those cases provide valuable data to help develop IS models and theories.
Keywords: Developing Country; Evaluation; Failure; Information System; implementation

Most egovernment-for-development projects fail: how can risks be reduced? - Heeks, Richard (Institute for Development Policy and Management, 2003)
Research on the Information Society, the Digital Divide and Information and Communication Technologies for development

Success and Failure in eGovernment Projects - Heeks, Richard (Institute for Development Policy and Management, 2008)

Impact assessment of ICT-for-development projects a compendium of approaches - Heeks, Richard; Molla, Alemayehu (University of Manchester. Institute for development policy and management (IDPM), 2009)
OCLC: 686761171

Deliberation and Development: Rethinking the Role of Voice and Collective Action in Unequal Societies - Heller, Patrick; Rao, Vijayendra (World Bank Publications, 2015)
This book marries two fields that rarely converse with one another:deliberative democracy and development studies. The study ofdeliberation―which explores normative and practical questions aroundgroup-based decision making through discussion or debate―has emergedas a critical area of study over the past two decades. Concurrently, the fieldof development has seen a spurt of interest in community-led developmentand participation premised on the ability of groups to arrive at decisionsand manage resources via a process of discussion and debate. Despite thegrowing interest in both fields, they have rarely engaged with one another.This book, which brings together new essays by some of the leading scholarsin the field, deepens our understanding of participatory decision makingin developing countries while initiating a new field of study for scholarsof deliberation. In the process, it sheds light on how to best design andimplement policies to strengthen the role of participation in development.

RAND Program Evaluation Toolkit for Countering Violent Extremism - Helmus, Todd; Matthews, Miriam; Ramchand, Rajeev; Beaghley, Sina; Stebbins, David; Kadlec, Amanda; Brown, Michael; Kofner, Aaron; Acosta, Joie (RAND Corporation, 2017)

HERMES (Highly Extensible Resource for Modeling Event-Driven Supply Chains) - HERMES (hermes.psc.edu, 2015)
Systems modeling is a tool for policymakers and program managers to capture all the direct and indirect effects of changes to a supply chain, identify sustainable solutions to the root causes of issues and save time, effort and resources in costly trial and error. Without systems modeling, evaluating the supply chain, identifying gaps, and implementing solutions can be insufficient, unsustainable and costly. Stock2 Vaccine supply chains are complex systems, comprising all the equipment, personnel, policies and processes needed to deliver a vaccine from its point of origin to the population. Understanding how the various components of a vaccine supply chain interact with each other is critical to evaluating supply chain function, identifying the root causes of issues and formulating sustainable solutions. HERMES (Highly Extensible Resource for Modeling Event-Driven Supply Chains) is a software program that allows users to generate a detailed computer simulation model of a supply chain

Towards evidence-informed adaptive management - Hernandez, Kevin; Ramalingam, Ben; Wild, Leni (ODI/GLAM, 2019)
Development and humanitarian organisations seeking to be adaptive have emphasised the need to be transparent about complexity and uncertainty; to be honest about their inability to control what happens; and to design programmes that change over time to become more appropriate and relevant. At their heart, adaptive management approaches emphasise the ability to lean, 'unlearn' and adapt programming accordingly. The cornerstone of effective learning is the creation, gathering, accumulation, interpretation and use of data and evidence. This working paper provides development professionals with tools, strategies and ideas to help them use evidence for adaptive management in practical and evidence-informed ways. Key messages - Evidence is central to effective and rigorous adaptive management. However, despite this central importance, exactly how evidence has been used to inform decisions for adapting development and humanitarian programmes in the past remains unobservable to many. - There is a need to strengthen and document evidence-informed adaptive management. This working paper proposes a roadmap to do this. - Those seeking to use evidence for adaptive management will need to manage trade-offs between ensuring a rigorous, documented (and auditable) trail of evidence-informed actions, being pragmatic about the time and resources allocated to documentation and recognising that it may be necessary to proceed without rigorous evidence when it is unavailable.

Leaving No One Behind in a Digital World - Hernandez, Kevin; Roberts, Tony (Institute of Development Studies, 2018)

Are you doing what’s needed to get the state to respond to its citizens? Or are you part of the problem? - Herringshaw, Vanessa (Making All Voices Count, 2017)
Three challenges from Making All Voices Count research on responsive governance

Mentoring Programmes: Supporting Effective Technology Use in Transparency and Accountability Organisations - Herringshaw, Vanessa; Faith, Becky (Transparency & Accountability Initiative, 2015)
The global movement to hold governments and companies accountable is growing rapidly, and technology can play a vital role. Some actors harness this potential to brilliant effect. But many others waste precious money and staff time on technology that isn’t a good fit for their aims or capacity. Mentorships can be a really effective way …

Complexity-Aware Monitoring and Evaluation - Hertz, Tilman; Brattander, Eva; Rose, Loretta (Journal of MultiDisciplinary Evaluation, 2021)
Background: Addressing today’s sustainability challenges requires adopting a systemic approach where social and ecological systems are treated as integrated social-ecological systems. Such systems are complex, and the international development sector increasingly recognises the need to account for the complexity of the systems that they seek to transform. Purpose: This paper sketches out the elements of a complexity-aware monitoring and evaluation (M&E) system for international development programmes in the area of sustainable development.  Setting: Not applicable. Data Collection and Analysis: The authors draw on existing literature on complexity and evaluation and on their own experience from working in the field of M&E. Findings: An M&E system should not be seen simply as a tool to track compliance against a pre-determined theory of change. Instead, it is most useful as a real-time approach, constantly defining and re-defining narratives for change that help push systems along trajectories of interest. Dealing with complexity involves embracing uncertainty; and this challenges established notions of accountability—something which funders and implementers must begin to redefine together. Keywords: monitoring; evaluation; complexity; social-ecological systems; international development programmes; narratives for change; theory of change
Number: 41

Monitoreo ciudadano en México: Participación ciudadana para mejorar la provisión de servicios públicos - Hevia, Felipe (CIDE, 2016)
Existe un amplio consenso sobre la importancia de los sistemas de monitoreo y evaluación para la mejora de políticas, programas y servicios públicos. Sin embargo, en la literatura especializada sorprende el escaso interés por analizar un tipo

Understanding Social Accountability: Politics, Power and Building New Social Contracts - Hickey, Sam; King, Sophie (The Journal of Development Studies, 2016)
Calls to deepen levels of social accountability within social protection interventions need to be informed by the now extensive experience of promoting social accountability in developing countries. Drawing on a systematic review of over 90 social accountability interventions, including some involving social protection, this paper shows that politics and context are critical to shaping their success. We argue that the politics of social protection and of social accountability resonate strongly with the broader project of transforming state-society relations in developing countries. This requires a reconceptualisation of social accountability and social protection in terms of the broader development of ‘social contracts’, and that the current emphasis on promoting bottom-up forms of accountability needs to be balanced by efforts to strengthen and legitimise public authority in developing countries.

Incorporating Geospatial Analysis into USAID Biodiversity Program Design - Higgins, Mark; Salafsky, Nick; Adeney, Marion; Petrova, Silvia (USAID, 2017)
Incorporating Geospatial Analysis into USAID Biodiversity Program Design is a biodiversity case example that describes the use of geospatial data and analysis for program design, including examples and lessons learned.

Adaptive Leadership: Accelerating Enterprise Agility - Highsmith, Jim (Addison-Wesley Professional., 2013)

Adaptive Software Development: A Collaborative Approach to Managing Complex Systems - Highsmith, Jim (Dorset House Publishing, 2000)
In today's turbulent e-business world, software project teams that survive and thrive won't be those that continue their traditions of optimization, efficiency, and control, but those that exhibit adaptability, speed, and collaboration. Adaptive Software Development is targeted at software teams where competition creates extreme pressure on the delivery process. Four goals of the book are * to support an adaptive culture in which change and uncertainty are assumed to be the natural state * to introduce frameworks to guide the iterative process of managing change * to institute collaboration, the interaction of people on interpersonal, cultural, and structural levels * to add rigor and discipline to the RAD approach, making it scalable to the uncertainty and complexity of real-world undertakings. This innovative text, grounded in the science of complex adaptive systems theory, offers a practical, realistic approach to managing the high-speed, high-change projects characteristic of our highly uncertain economy.

Agile Project Management: Creating Innovative Products - Highsmith, Jim (Addison Wesley, 2009)
Best practices for managing projects in agile environments―now updated with new techniques for larger projectsToday, the pace of project management moves faster. Project management needs to become more flexible and far more responsive to customers. Using Agile Project Management (APM), project managers can achieve all these goals without compromising value, quality, or business discipline. In Agile Project Management, Second Edition, renowned agile pioneer Jim Highsmith thoroughly updates his classic guide to APM, extending and refining it to support even the largest projects and organizations. Writing for project leaders, managers, and executives at all levels, Highsmith integrates the best project management, product management, and software development practices into an overall framework designed to support unprecedented speed and mobility. The many topics added in this new edition include incorporating agile values, scaling agile projects, release planning, portfolio governance, and enhancing organizational agility. Project and business leaders will especially appreciate Highsmith’s new coverage of promoting agility through performance measurements based on value, quality, and constraints. This edition’s coverage includes: Understanding the agile revolution’s impact on product development Recognizing when agile methods will work in project management, and when they won’t Setting realistic business objectives for Agile Project Management Promoting agile values and principles across the organizationUtilizing a proven Agile Enterprise Framework that encompasses governance, project and iteration management, and technical practicesOptimizing all five stages of the agile project: Envision, Speculate, Explore, Adapt, and CloseOrganizational and product-related processes for scaling agile to the largest projects and teamsAgile project governance solutions for executives and management The “Agile Triangle”: measuring performance in ways that encourage agility instead of discouraging itThe changing role of the agile project leader

Messy, Exciting, and Anxiety-Ridden: Adaptive Software Development - Highsmith, Jim (American Programmer, 1997)

Knowledge Networks: Innovation Through Communities of Practice - Hildreth, Paul; Kimble, Chris (IGI Global, 2003)
Knowledge Networks: Innovations Through Communities of Practice draws on the experience of people who have worked with CoPs in the real world and to present their combined wisdom in a form that is accessible to a wide audience. CoPs are examined from a practical, rather than a purely academic point of view. The book also examines the benefits that CoPs can bring to an organization, provides a number of case studies, lessons learned and sets of guidelines. It also looks at virtual CoPs and to the future by asking 'what next?' This book is a resource for all people who work with CoPs - both in academia and in the real world.

Sensing and Cyberinfrastructure for Smarter Water Management: The Promise and Challenge of Ubiquity - Hill David; Kerkez Branko; Rasekh Amin; Ostfeld Avi; Minsker Barbara; Banks M. Katherine (Journal of Water Resources Planning and Management, 2014)

The Environment and Disease: Association or Causation? - Hill, Austin Bradford (Proceedings of the Royal Society of Medicine, 1965)

Engaging Farmers in Climate Change Adaptation Planning: Assessing Intercropping as a Means to Support Farm Adaptive Capacity - Himanen, Sari J.; Mäkinen, Hanna; Rimhanen, Karoliina; Savikko, Riitta (Agriculture, 2016)
Agriculture is one of the most vulnerable and adaptation-prone sources of livelihood facing climate change. Joint adaptation planning by farmers and researchers can help develop practically feasible and environmentally and economically sound adaptation actions as well as encourage the proactive building of farm adaptive capacity. Here, the perceptions of Finnish farmers and rural stakeholders regarding intercropping, the cultivation of two or more crop genotypes together in time and space, as a means to prepare for climate change, were collected in an open workshop. Our aim was to identify the potentials and challenges associated with intercropping, its role as an adaptation strategy, and in farm adaptive capacity. Qualitative analysis revealed better yield security, increased nutrient and protein self-sufficiency, soil conservation and maintenance, reduced pathogen pressure and regulation of water dynamics as the main perceived potentials of intercropping. Potentials relating to the farm economy and environment were also recognized. The main challenges associated with intercropping were related to the lack of information on crop variety performance and optimal yielding in mixtures, industry and policy requirements for seed purity, more complicated crop management and harvesting, and the economic risks associated with experimenting with novel mixtures. Nitrogen-fixing legumes; deep-rooted species, such as lucerne (Medicago sativa L.); special crops, such as herbs in forage mixtures; and autumn-sown winter oilseeds and cereals were highlighted as the most promising intercrops. Because the recognized potentials relate to the safeguarding of field cropping from anticipated climate change and the associated weather variability, we conclude that intercropping can serve as one adaptation strategy to strengthen the adaptive capacity of Finnish farms. However, assuring markets and policies that allow the development of intercropping, performing experiments to assess the benefits and implement options in practice, and providing farmers and farm advisors with more knowledge on the method represent the critical prerequisites for the broader adoption of intercropping.
Keywords: Adaptation planning; Adaptive capacity; Climate change; ecological intensification; intercropping; yield security

Development Projects Observed - Hirschman, Albert O. (Brookings Institution, 1967)
The experience accumulated in the wake of more than two decades of sustained effort to promote growth and change in the low-income countries presents a rich field for scholarly inquiry and new insights into the development process. The success and failures of such projects, the new skills and attitudes they impart, and the internal tensions they sometimes generate obviously have an important bearing on the next stages of a county's development effort. Yet little has become known about these truly formative experiences which are due to the behavior —and misbehavior —of development projects. In this recent volume, Professor Albert O. Hirschman turns his attention to the ways in which decision making is molded, activated, or hampered by the specific nature of the project that is undertaken; for example, the establishment and operation of a pulp and paper mill in east Pakistan, an irrigation project in Peru, railway expansion in Nigeria, and other development undertakings. In some parts of the present inquiry Hirschman elaborates on his earlier writings in this series; and occasionally, he qualifies or modifies his previous conclusions; the bulk of the study explores new territory.

The principle of the hiding hand - Hirschman, Albert O. (National Observer, 1967)

An introduction to the Learning Architecture - HLA (Humanitarian Leadership Academy, 2017)
The Learning Architecture is built on a flexible Learning Methodology and provides principles, technologies and behaviours of Scaffolded Social Learning.

Adaptive Management Practice in the UK Government - The MUVA case - HLS (Human Learning Systems, 2019)
Case study about the MUVA programme in Mozambique. (Maybe it "misses the point of AP which is not learning for learning. Is learning for impact. The word impact doesn’t even come up once!") Adaptive Management programming within the Foreign & Commonwealth Development Office demonstrates that the UK Government has examples of optimising for learning within its existing management practice. However, currently, the adaptive management practices are unhelpfully framed by an approach which limits both their effectiveness and scope. The programmes use learning as their metastrategy. They succeed in connecting practicebased learning with strategic learning, and make a shift towards reframing accountability as accountability for learning. This learning strategy is enabled by funding and contract management arrangements which prioritise learning. Both at macro-level of programme management and micro level of de-risking experimentation and enabling necessary failure by decoupling people’s job security from potential failure.

The Futures Toolkit: Tools for Futures Thinking and Foresight Across UK Government - HM Government (2017)

The Hidden Life of Theories of Change - Ho, Wenny; Tamas, Peter; van Wessel, Margit (Hivos, 2020)
Theory of Change is thought to be very useful for learning and adaptive management of complex interventions such as advocacy. Nevertheless, the use of Theory of Change is also under critique. One common criticism is that Theory of Change is often used as a framework that fixes agreements rather than as a living, guiding tool that helps reflection and adaptation. However, while such criticism stresses forms of control, little research has looked at the way Theory of Change and advocacy practice relate. This is a pertinent issue considering that formally agreed Theories of Change and realities on the ground can be very different. This raises questions: Do advocates work in ways different from what Theory of Change states, and if so, how, and why? How does the way they strategize relate to formal Theories of Change? With what implications? In this brief, we explore these more hidden aspects of the life of Theories of Change.

Stop Trying to Save the World: Big ideas are destroying international development - Hobbes, Michael (New Republic, 2014)
Gives some examples of poorly designed interventions (e.g. The play pump)

Trapped in a Treadmill: Bureaucratic Constraints on Aid Programs - Hoben, Allen (Harvard International Review, 1992)
Publisher: Harvard International Review

Network Weaver Handbook - Holley, June (Network Weaver, 2012)

Transformative Networks Are Multiscalar - Holley, June (NetworkWeaver, 2018)
This is an excerpt from the Network Weaver Handbook. I’ll be writing an update with my latest research and thinking on the topic in the coming weeks so stay tuned! June Holley How does tr…

Adaptive environmental assessment and management - Holling, C. S. (Wiley, 1978)
Keywords: Ecology; Economic development; Environmental impact analysis; Environmental protection

What Barriers? What Bridges? - Holling, C.S. (Barriers and Bridges to the Renewal of Ecosystems and Institutions, 1995)
This volume uses a series of case studies to test an emerging theory of complex adaptive systems that forms the basis for explaining the interrelated dynamics of ecosystems, institutions and society. It deals equally with institutional organization and ecosystem structure.

Measuring Up: Evaluating the Impact of P/CVE Programs - Holmer, Georgia; Bauman, Peter (United States Institute of Peace, 2018)
This report considers the various conceptual and practical challenges in measuring the impact and value of programs designed to prevent and counter violent extremism (P/CVE). It examines potential solutions and emphasizes the significance of efforts to assess changes in attitudes, behaviors, and relationships. The report was developed in tandem with “Taking Stock: Analytic Tools for Understanding and Designing P/CVE Programs” and seeks to help advance more rigor and sustainability in P/CVE programming.

How AI Fits into Lean Six Sigma - Holweg, Matthias; Davenport, Thomas H.; Snyder, Ken (Harvard Business Review, 2023)
AI already is being used in some areas of process improvement, and the usage of this technology — including generative AI — promises to grow. That’s because it can perform tasks faster and much less expensively than humans alone. But it will never fully replace people — and that poses management challenges.
Section: Operations and supply chain management

Actually Navigating by Judgment: Towards a new paradigm of donor accountability where the current system doesn’t work - Honig, Dan (Center for Global Development, 2020)
This working paper explores how donors can move towards greater Navigation by Judgment, highlighting the actions people inside and outside aid agencies can work to make change—encouraging more Navigation by Judgment on the margin, starting today.

Managing Better: What All of Us Can Do to Encourage Aid Success - Honig, Dan (Center for Global Development, 2020)
Management by way of top-down controls and targets sometimes gets in the way of aid donors’ aims, undermining project success. These unhelpful controls often stem from a need to account for performance; legislatures or executive boards induce agencies to exercise tight process controls and orient projects towards what is measurable and reportable.

Navigation by Judgment: Why and when Top Down Management of Foreign Aid Doesn't Work - Honig, Dan (Oxford University Press, 2018)
Foreign aid organizations collectively spend hundreds of billions of dollars annually, with mixed results. Part of the problem in these endeavors lies in their execution. When should foreign aid organizations empower actors on the front lines of delivery to guide aid interventions, and when should distant headquarters lead? In Navigation by Judgment, Dan Honig argues that high-quality implementation of foreign aid programs often requires contextual information that cannot be seen by those in distant headquarters. Tight controls and a focus on reaching pre-set measurable targets often prevent front-line workers from using skill, local knowledge, and creativity to solve problems in ways that maximize the impact of foreign aid. Drawing on a novel database of over 14,000 discrete development projects across nine aid agencies and eight paired case studies of development projects, Honig concludes that aid agencies will often benefit from giving field agents the authority to use their own judgments to guide aid delivery. This "navigation by judgment" is particularly valuable when environments are unpredictable and when accomplishing an aid program's goals is hard to accurately measure. Highlighting a crucial obstacle for effective global aid, Navigation by Judgment shows that the management of aid projects matters for aid effectiveness.
Google-Books-ID: GT5MDwAAQBAJ

Making good on donors’ desire to Do Development Differently - Honig, Dan; Gulrajani, Nilima (Third World Quarterly, 2018)
AbstractForeign aid donors are increasingly focused on changing the way their development agencies function. This discourse has focused on desired qualities, including greater knowledge of local contextual realities, appropriate adaptation to context and greater flexibility to respond to changing circumstances. We argue that more attention needs to be devoted to the achievement of these qualities and turn to contingency theory to identify some under-exploited ways to ?do development differently?. The qualities sought by donors are emergent properties of complex organisational systems and will only be achieved through a micro-level and interlinked focus on the fundamentals of organisation.

The Limits of Accounting-Based Accountability in Education (and Far Beyond): Why More Accounting Will Rarely Solve Accountability Problems - Honig, Dan; Pritchett, Lant (Center for Global Development, 2019)
Accountability is rightly at the center of the conversation regarding how to improve governance systems, particularly health and education systems. But efforts to address accountability deficits often focus primarily on improving what can be counted and verified—what we term “accountingbased accountability.” We argue that introducing greater accounting-based accountability will only very rarely be the appropriate solution for addressing accountability problems. We illustrate this by exploring the role of Accountability ICT in (not) improving education system performance. Strengthening “real” accountability is not the same as improving data systems for observation and verification, and often attempts at the latter undermine the former. The development discourse’s frequent semantic misunderstanding of the term “accountability” has pernicious effects on system reform efforts and ultimately global welfare.

Navigating by Judgment: Organizational Structure, Autonomy, and Country Context in Delivering Foreign Aid - Honig, Daniel (Harvard University, Graduate School of Arts & Sciences, 2015)
This dissertation examines when initiatives by International Development Organizations (IDOs) are more, and less, successful. The core argument is that allowing field-level agents to drive initiatives – what I call organizational Navigation by Judgment – will often be the most effective way to deliver aid. This inverts what a classical application of the principal agent model – the workhorse of studies of public management and bureaucracy – would predict, with better performance resulting from less control. In the delivery of foreign aid the costs of monitoring to the principal are often overshadowed by the deleterious effects of the monitoring itself. The core of the argument is that development implementation requires soft information, tacit knowledge, and flexibility that are crowded out by tight controls or an organizational navigation strategy focused on short term measurement and targets. As a result there are increasing returns to Navigation by Judgment in environments that are uncertain or difficult to understand from the outside and tasks where outputs are difficult to observe and/or poorly correlated with long term intervention goals. Insecure political authorizing environments which constrain the autonomy of IDOs prevent these organizations from Navigating by Judgment in situations where this is the best strategy. Empirically, this dissertation examines a cross-IDO dataset of projects (including over 14,000 projects over 50 years over 9 organizations), which I have assembled. It also examines eight cases of development interventions in Liberia and South Africa. These cases are matched pairs comparing the performance and navigation strategies of the US Agency for International Development (a low autonomy IDO) and the UK’s Department for International Development (a higher autonomy IDO) in capacity building and health sector interventions.
Keywords: IMPORTANT

When Reporting Undermines Performance: The Costs of Politically Constrained Organizational Autonomy in Foreign Aid Implementation - Honig, Daniel (International Organization, 2019)

Signal Left, Turn Right: Central Rhetoric and Local Reform in China - Huang, Haifeng (Political Research Quarterly, 2013)
How have local governments in China been able to break through central policy restrictions in a unitary and authoritarian political system? Why is China's official discourse in the reform era often so conservative and unfavorable to reform? The author argues the two issues are components of a signaling game between China's central government and local officials, in which local officials know that the center may be reformist, but the reformist center imitates the rhetoric of a conservative center to control the pace of local liberalization. The result is a gradualist reform of "signaling left, turning right," with glaring incongruity of speech and actions in the process.

Mind the gaps: What's missing in political economy analysis and why it matters - Hudson, David; Marquette, Heather (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Everyday Political Analysis - Hudson, David; Marquette, Heather; Waldock, Sam (Developmental Leadership Program, 2016)
This short note introduces a stripped-back political analysis framework designed to help frontline development practitioners make quick but politically-informed decisions. It aims to complement more in-depth political analysis by helping programming staff to develop the 'craft' of political thinking in a way that fits their everyday working practices. Everyday Political Analysis involves two steps: Understanding interests: What makes people tick? Understanding change: What space and capacity do people have to effect change? For each step five questions, accompanied by prompts, aim to help staff to conduct quick political analysis. The EPA framework can be used at any stage of the aid management cycle, and can help users to respond rapidly to unexpected change. We are keen to hear back from people on their experience of using EPA to help us adapt the framework. Was it useful (or not)? Do people tend to use just one or both steps? Are there missing statements or prompts that would improve the analysis? Please email us at info [at] dlprog.org.

What works for Social Accountability? Findings from DFID’s Macro Evaluation - Hughes, Claire (Itad, 2017)

Learning and not learning from experience in rural project planning - Hulme, David (Public Administration and Development, 1989)
The theme of learning from experience as a means of improving the effectiveness of rural development projects and programmers has been common in recent years. Considerable effort has been put into refining, monitoring and evaluation systems to enhance organizational learning processes. However, an emphasis on normative approaches to evaluation and learning from experience has led to the neglect of research into the actual processes by which rural development agencies utilize experience. The case study presented here points to the shortcomings of such approaches and illustrates the partisan manner in which individuals and organizations treat the lessons of experience. Actively ‘not learning from experience’ is as much a part of organizational processes as learning from experience. This paper examines the implications of this finding and reviews alternative approaches to improving experiential learning in rural development activities. It is found that such a perspective does not generate the innocuous technical prescriptions characteristic of conventional approaches, but a number of useful directions for further research can be identified.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/pad.4230090102

Beyond Logframe: Critique, Variations and Alternatives - Hummelbrunner, Richard (Beyond Logframe; Using Systems Concepts in Evaluation, 2010)
Over the last decades, the Logical Framework Approach (LFA) has become universally known and has assumed a key role for planning and managing development interventions. LFA, however, is not uncontroversial and the approach has been subject to criticism, concerning both its theoretical foundations and practical use. Despite these criticisms LFA’s position has not been fundamentally weakened and while many donors acknowledge its limits and weaknesses, they maintain (some would say impose) its use as a planning and monitoring tool. This chapter reviews some of the experience gained with LFA and outlines major attempts to develop variations – or move beyond it altogether. The first section briefly describes the LFA concept and summarizes the main points of critique. Section 2 then explores some variations which have been developed in response to this critique and to improve LFA as a management tool. Section 3 proposes a systemic alternative to logframe and Section 4 outlines alternatives to LFA which have recently been introduced in German development aid.

Process Monitoring of Impacts: Towards a new approach to monitor the implementation of Structural Fund Programmes - Hummelbrunner, Richard; Huber, Wolf; Arbter, Roland (ÖAR Regionalberatung, 2005)

What can Australia learn from the public service revolution taking hold in Europe? - Hurcombe, Sarah (Centre For Public Impact (CPI), 2021)
Sarah Hurcombe shares what she's learning from the public service revolution building momentum in Europe.

Logics of Government Innovation and Reform Management in China - Husain, Lewis (STEPS centre, 2015)
Since the beginning of reforms in the late 1970s, China has developed rapidly, transforming itself into a middle-income country, raising hundreds of millions out of poverty and, latterly, developing broad-based social protection systems. The country’s approach to reform has been unorthodox, leading many to talk of a specific Chinese model of development. This paper analyses the role of innovation (chuangxin) and experimentation in the Chinese government repertoire and their contribution to management of change during the rapid, complex and interconnected reforms that China is undergoing. ‘Innovation’ is understood as the process of generation, putting into use, and spread, of new ideas. This contemporary focus on innovation is an extension of an older Chinese government attachment to sub-national initiative in policy formulation and development that goes back to the beginnings of the PRC and before. Central government backing for, and endorsement of, proactive agency on the part of sub-national governments responds to a belief that China is too large, and conditions around the country too diverse, to allow adoption of ‘one size fits all’ policy. Sub-national governments are expected to show initiative in adapting policy locally, and creating locally-useable policy solutions within the overall scope of central policy mandates/ paradigms. The paper argues that innovation by sub-national government is systemically embedded: while central government sets the policy agenda, local governments are frontline managers, and develop a range of policy practices. Differences in conditions between localities mean that multiple variant policy practices are often in circulation at any one time. While innovation is not quantifiable in the aggregate, there is much controlled experimentation, freewheeling innovation, and trial and error, all of which are part of a search for new policy fixes and institutional solutions. Many forms of policy transfer and learning are in evidence, including much central learning from sub-national models, as well as sub-national circulation of a range of innovative policy practices. While much government innovation is not ‘original’, and may be ‘inefficient’ or of little systemic usefulness, overall, the churn of government innovation remains valuable in underpinning systemic adaptation and reform. The paper situates the analysis of government innovation within a larger framework on the functioning of Chinese government and international literature on policy transfer, and outlines an agenda for future research on the structural bases of Chinese government innovation and its contribution to adaptive management.

Policy experimentation and innovation as a response to complexity in China’s management of health reforms - Husain, Lewis (Globalization and Health, 2017)
There are increasing criticisms of dominant models for scaling up health systems in developing countries and a recognition that approaches are needed that better take into account the complexity of health interventions. Since Reform and Opening in the late 1970s, Chinese government has managed complex, rapid and intersecting reforms across many policy areas. As with reforms in other policy areas, reform of the health system has been through a process of trial and error. There is increasing understanding of the importance of policy experimentation and innovation in many of China’s reforms; this article argues that these processes have been important in rebuilding China’s health system. While China’s current system still has many problems, progress is being made in developing a functioning system able to ensure broad population access. The article analyses Chinese thinking on policy experimentation and innovation and their use in management of complex reforms. It argues that China’s management of reform allows space for policy tailoring and innovation by sub-national governments under a broad agreement over the ends of reform, and that shared understandings of policy innovation, alongside informational infrastructures for the systemic propagation and codification of useful practices, provide a framework for managing change in complex environments and under conditions of uncertainty in which ‘what works’ is not knowable in advance. The article situates China’s use of experimentation and innovation in management of health system reform in relation to recent literature which applies complex systems thinking to global health, and concludes that there are lessons to be learnt from China’s approaches to managing complexity in development of health systems for the benefit of the poor.

Participatory design with marginalized people in developing countries: Challenges and opportunities experienced in a field study in Cambodia - Hussain, Sofia; Sanders, Elizabeth B.-N.; Steinert, Martin (International Journal of Design, 2012)

International Public Participation Models 1969-2020 - Hussey, Sally (Bang The Table, 2020)
International Public Participation Models 1969 – 2020 provides an essential resource of 60 different models to better map public participation in practice and theory.

Shoulder to Shoulder - Hymowitz, Dan (Tony Blair Africa Governance Initiative, 2016)

"That's how the light gets in": Making Change in Closing Political Environments - IBP (International Budget Partnership, 2017)
This collection of learning and reflection essays from the International Budget Partnership's 2016 Annual Report illustrate the multidimensional nature of budget work and democratic engagement. Read more.

Achieving value for money through procurement. Part 2: DFID’s approach to value for money through tendering and contract management - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
Summary In 2016-17, the Department for International Development (DFID) spent £1.4 billion, or 14% of its budget, through commercial suppliers on contracts ranging from school construction to family planning services and the delivery of humanitarian aid. The quality of its procurement and contract management – how it engages and manages commercial firms to support the delivery of aid programmes on time, to budget and at the appropriate quality – is a key driver of value for money for UK aid. It is also a subject of considerable Parliamentary and public interest. In recent years, DFID has implemented a range of initiatives to strengthen its procurement practices and embed commercial capability across the department – including its 2017 Supplier Review, undertaken to address concerns about excessive profit-making by DFID suppliers. This review on achieving value for money through procurement (part 2) was published in September 2018. We awarded a green-amber score and made three recommendations to government. The follow-up to this review was published in July 2020, and rated the government’s response as ‘inadequate’, as a result of DFID’s failure to put in place a formal contract management regime, despite the risks this entails for programme results. We will return to this in the next follow-up in summer 2021. Review Our review found an appropriate overall approach to procurement with good performance in most areas of tendering, but significant weaknesses in contract management. We therefore awarded a green-amber score and made three recommendations to government. Findings Since 2015, DFID has progressed towards a more mature procurement approach. DFID’s tender process follows current EU legislation and UK government guidelines and cross-government peer reviews confirm improvements in DFID’s procurement approach. The Supplier Review lent momentum to the reforms but risks having unintended consequences. Poor consultation with suppliers has heightened the risk of unintended consequences. DFID is reviewing its business processes to protect aid recipients from sexual abuse and exploitation. DFID does not always choose the most appropriate procurement process but a new strategic sourcing process has resulted in stronger procurement planning. DFID has built up its commercial capability, but this will need to be an ongoing process. The contract management function in DFID is poorly defined and contracts are frequently amended or extended beyond their advertised length and values. Inception phases are often too short for adequate preparation and planning. Progress on flexible and adaptive programming will require more innovative approaches to tendering and contract management. Recommendations Before the next major revision of its supplier code and contracting terms, or future changes that may materially affect suppliers, DFID should conduct an effective consultation process with its supplier market, to ensure informed decisions and minimise the risks of unintended consequences. DFID should accelerate its timetable for acquiring a suitable management information system for procurement, to ensure that its commercial decisions are informed by data. DFID should instigate a formal contract management regime, underpinned by appropriate training and guidance and supported by a senior official responsible for contract management across the department. The new regime should include appropriate adaptive contract management techniques, to ensure that supplier accountability is balanced with the need for innovation and adaptive management in pursuit of development results.

DFID’s approach to delivering impact - ICAI (Independent Commission for Aid Impact (ICAI), 2015)
UK aid, at its best, makes a real and positive difference to the lives and livelihoods of poor people around the world. Ensuring the best possible performance across a large and multifaceted aid programme is, however, a complex management challenge. This report reviews ICAI’s previous 44 reports and looks at how well DFID ensures positive, long-term, transformative impact across its work.

DFID’s approach to value for money in programme and portfolio management - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
ICAI published this review on DFID’s approach to value for money in February 2018, and as value for money is both a process and an outcome and cuts across all aspects of DFID’s operations, did not score this review. We made five recommendations and published a follow-up to this review in July 2019. All UK government departments are required to achieve value for money in their use of public funds. In recent years, DFID has been working to build value for money considerations further into its management processes and its relationships with implementers and multilateral partners, establishing itself as a global champion on value for money. Review This review was published in February. Though it was not rated, ICAI made five recommendations, and found that the Department for International Development’s approach to value for money was helping to make UK aid spending go further, but improvements are still needed. Findings This review found that DFID has strengthened its processes and systems for ensuring it gains maximum value for each pound spent, has taken swift remedial action to tackle under-performing programmes, and has become a strong global champion on value for money. The review also found that DFID has been diligent in its efforts to cut waste, detect fraud, and improve efficiency, and that this work is improving the return on the UK investment in aid. However, the review found that DFID’s approach was not adequately reporting and capturing results and value for money at the country portfolio level, or how programmes work together to deliver lasting impact, including reducing future dependency on aid. It also found that weakness in the annual review process could undermine DFID’s approach to value for money. It found that targets were frequently revised, and that there could be pressures for optimistic scoring of programmes. Recommendations Based on this review, we made the following five recommendations to help DFID improve its approach to value for money still further: DFID country offices should articulate cross-cutting value for money objectives at the country portfolio level, and should report periodically on progress at that level. Drawing on its experience with introducing adaptive programming, DFID should encourage programmes to experiment with different ways of delivering results more cost-effectively, particularly for more complex programming. DFID should ensure that principles of development effectiveness – such as ensuring partner country leadership, building national capacity and empowering beneficiaries – are more explicit in its value for money approach. Programmes should reflect these principles in their value for money frameworks, and where appropriate incorporate qualitative indicators of progress at that level. DFID should be more explicit about the assumptions underlying the economic case in its business cases, and ensure that these are taken into account in programme monitoring. Delivery plans should specify points in the programme cycle when the economic case should be fully reassessed. Senior responsible owners should also determine whether a reassessment is needed following material changes in the programme, results targets or context. Annual review scores should include an assessment of whether programmes are likely to achieve their intended outcomes in a cost-effective way. DFID should consider introducing further quality assurance into the setting and adjustment of logframe targets.

DFID’s partnerships with civil society organisations - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2019)
DFID values civil society organisations (CSOs), but its funding and partnership practices do not fully support the long-term health of the civil society sector.

How DFID learns - ICAI (Independent Commission for Aid Impact (ICAI), 2014)
Excellent learning is essential for UK aid to achieve maximum impact and value for money. We take learning to mean the extent to which DFID uses information and experience to influence its decisions. Each ICAI review assesses how well learning takes place. Our reports to date indicate a mixed performance. This review seeks to identify the way DFID learns and what inhibits it from doing so consistently. We drew on our reviews, assessed data from DFID’s own surveys and carried out interviews inside and outside the department. Review DFID generates considerable volumes of information, much of which, such as funded research, is publicly available. DFID does not clearly or consistently link this investment to how it can deliver better impact. We made five recommendations and gave an amber-red score. Findings DFID does not clearly identify how its investment in learning links to its performance and delivering better impact. DFID has the potential to be excellent at organisational learning if its best practices become common. DFID staff learn well as individuals. They are highly motivated and DFID provides opportunities and resources for them to learn. DFID is not yet, however, managing all the elements that contribute to how it learns as a single, integrated system. DFID does not review the costs, benefits and impact of learning. Insufficient priority is placed on learning during implementation. The emphasis on results can lead to a bias to the positive. Learning from both success and failure should be systematically encouraged. Recommendations DFID needs to focus on consistent and continuous organisational learning based on the experience of DFID, its partners and contractors and the measurement of its impact, in particular during the implementation phase of its activities. All DFID managers should be held accountable for conducting continuous reviews from which lessons are drawn about what works and where impact is actually being achieved for intended beneficiaries. All information commissioned and collected (such as annual reviews and evaluations) should be synthesised so that the relevant lessons are accessible and readily usable across the organisation. The focus must be on practical and easy-to-use information. Knowhow should be valued as much as knowledge. Staff need to be given more time to acquire experience in the field and share lessons about what works and does not work on the ground. DFID needs to continue to encourage a culture of free and full communication about what does and does not work. Staff should be encouraged always to base their decisions on evidence, without any bias to the positive.

Building a Learning Community in Liberia Through Partnerships at iCampus - iCampus (USAID LEARN, 2018)
Accountability Lab Liberia (ALab) and iLab Liberia established iCampus- a shared innovation, co-working and community space for organizations focusing on the intersection of technology, accountability and social change in Liberia. ALab implements DAI’s Learning activities at iCampus, and it is referred to as the Strategic Learning Partner of USAID Liberia Accountability and Voice Initiative (LAVI). LAVI is a five year USAID program with an overarching goal to strengthen multi-stakeholder partnerships to advocate for and monitor policy and accountability reforms. The iCampus CLA case scenario captures joint efforts of Accountability Lab Liberia, iLab Liberia and USAID LAVI, to ensure that learning and methodologies are shared and applied by development actors; address common capacity challenges that particularly hinder civil society from engaging in evidence-based and issues-based advocacy using various approaches, including network-building, creation of a cross-sectoral learning space- through collaboration and learning. In 2017, iCampus conducted a learning mapping survey to understand how organizations are learning in Liberia. The result indicated that frameworks and concepts of organizational learning are not yet well understood or used to guide strategic or programmatic practices, by either Liberian or international organizations. ALab, iLab and USAID LAVI then adopted a set of strategies, that led to the implementation of a CLA, enabling the establishment of the first multi-sectoral learning community in Liberia.

Enabling citizen-driven improvement of public services. Leveraging Technology to Strengthen Accountability in Nigerian Healthcare - ICT4SA (World Bank and Reboot, 2015)
Effective public service delivery begins with knowing whether the services offered are working as intended. We launched a system to enable citizen input on the delivery of public services.

How to Apply Agile Principles to International Development M&E - ICTworks (ICT Works, 2016)
We all want to be good at our jobs. We want to accomplish the things we set out to do. If we aren’t accomplishing them, we want to figure out why or try new solutions. The trend toward Adaptive M&E is exactly that: a desire to be better at our jobs. Similar trends exist in the software world (agile) and in manufacturing and start-ups (lean). But by any name, this process of seeking to improve is about speeding up decision-making and solution delivery by focusing on incremental, iterative planning and execution. I presented on agile with Monalisa Salib of USAID Learning Lab at MERL Tech 2016. I talked about creating software; she talked about creating evaluation tools for USAID missions, but we were describing the same basic process: Develop, Release, Reflect, and Adapt. You can see our slide deck for more details, but here are the key discussion takeaways that won’t show up there: 1: Eyes on the Prize Any effort should start with a clear definition of what you’re hoping to achieve.
Keywords: IMPORTANT

Should the Principles of Digital Development be Agile? - ICTworks (ICT Works, 2016)
Recently, Abt Associates endorsed the “Principles of Digital Development.” These nine principles have been widely adopted by international development funders and practitioners to absorb and disseminate technology best practices in the field of international development. More than 50 organizations ranging from various offices in the United Nations and the U.S. Agency for International Development (USAID) down to niche technology providers have endorsed the principles. The principles are aimed at moving the field away from a disconnected series of technology pilots, each of which are largely ad hoc and duplicate many of the same lessons, and toward scalability and sustainability. Ann Mei Chang, the Executive Director of the U.S. Global Development Lab at USAID in her foreword to the recent report “From Principle to Practice: Implementing the Principles for Digital Development”, characterized the problem that these principles are trying to address as follows: “Pilots have failed to move

The field guide to human-centered design: design kit - IDEO (IDEO, 2015)
Keywords: Design; IMPORTANT; Methode

The International Development Innovation Alliance - IDIA (R4D, 2017)
Brochure from the International Development Innovation Alliance

Evaluation at IDRC - IDRC (IDRC, 2017)

A ‘real-time’ and anthropological response to the Ebola crisis - IDS (IDS, 2017)
Impact Summary The Ebola epidemic that began in the Guinea-Sierra Leone-Liberia border region in December 2013 spread fast through the villages, cities and trade routes of this highly-peopled,...

An Upside Down View of Governance - IDS (Centre for the Future State, IDS, 2010)
Informal institutions and personalised relationships are usually seen as governance problems. However the research presented in this synthesis paper suggests that they can also be part of the solution...

Towards excellence: Policy and action research for sustainable development - iied (The International Institute for Environment and Development, 2012)

The road to results: designing and conducting effective development evaluations - Imas, Morra; G, Linda; Rist, Ray C. (The World Bank, 2009)
The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.

QUIP: Understanding clients through in-depth interviews - IMP-ACT (Institute of Development Studies, 2004)
This Practice Note by Imp-Act gives a step-by-step guide to developing and conducting in-depth interviews using the QUIP approach, and analysing the information and making conclusions based on what you have learned.

From a last mile century to a first mile revolution: the future is OSLO - Indy Johar (Medium, 2013)
The Future is OSLO

Locally driven development: Overcoming the obstacles - Ingram, George (Brookings Institution, 2022)
Locally led development is a complex process that the development community, in the U.S. and around the world, has spent several decades trying to get right. Yet, despite all the experience and lessons learned, it feels like we are barely beyond the starting line. This publication aims to contribute to the ongoing dialogue on locally led development, especially as to how the United States can address the obstacles posed by U.S. law, regulation, policy, and practice. It consists of two parts: • An essay by George Ingram that notes the path that has taken us to this point, identifies key obstacles, and invites a discussion of how to overcome impediments and move forward. • A set of 15 commentaries written by development experts that add a range of perspectives and nuances to the discussion

Rethinking monitoring and evaluation in complex systems — when learning is a result in itself - Innovation, UNDP (Medium, 2022)
By Søren Vester Haldrup, UNDP’s Strategic Innovation Unit

Introduction to International Futures - International Futures at the Pardee Center (International Futures Help System, 2016)
INTERNATIONAL FUTURES HELP SYSTEM Introduction to IFs Purposes Visual Representation of IFs Issues and Modules Quick Survey of IFs Issues and Modules IFs Background IFs Geographic Representation of the World IFs Time Horizon Instructional Use Acknowledgements Feedback Support for IFs Use Development Mode Features

The Boda Boda Talk Talk Module - Internews (Internews & USAID, 2017)
Keywords: IMPORTANT

M&E Universe - intrac (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. It can be explored through an online platform (intrac.org/universe) that is compatible with most web browsers. The M&E Universe is designed for M&E practitioners with different levels of experience and expertise in M&E, from those new to M&E who want an entry level into the subject to experienced practitioners wanting to broaden their knowledge. Initial contact with the Map will provide people with a starting point for understanding different aspects of M&E and how they link to each other. More experienced practitioners can browse the Map to identify more advanced subjects of interest, such as sampling methods, different forms of evaluation, organisational M&E systems and complex methodologies for data collection and analysis.

The M&E (Monitoring & Evaluation) Universe - INTRAC (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. To begin exploring the Universe right away, use the button below. To find out more, read on.

ADAPT: Analysis Driven Agile Programming Techniques - IRC (International Rescue Committee (IRC), 2016)
A growing body of research indicates that aid agencies are most successful when able to operate flexibly, particularly in fragile environments. Yet our systems and tools are often too rigid to effectively address complex problems, and program incentives frequently undermine adaptation instead of supporting it. To drive improvements in impact we need to be better able to analyse the dynamics of a given situation, anticipate how these might evolve, and be sufficiently agile to adapt to changes in context and need.

Social network analysis handbook: connecting the dots in humanitarian programs - IRC (International Rescue Committee, 2016)
The following handbook is designed to provide a step by step guide to the application of Social Network Analysis for the IRC.
Keywords: IMPORTANT

Stakeholder and Social Network Analysis - Guidance Note - IRC (International Rescue Committee, 2019)
Stakeholder Analysis is used to identify the actors and relationships that influence project outcomes. This guidance, from IRC, can help you determine how to work and who to partner, coordinate or engage with in order to best achieve the outcome. It builds on existing stakeholder information and typically will include a participatory internal meeting or workshop.

How should donors manage adaptively? Market Systems Development as a case study. - Itad (Itad, 2018)
Itad has recently completed a strategic evaluation for Sida to help them work through how they can best manage programmes that are adaptive and apply systems approaches - the conclusions from the evaluation about what funders need to do to manage adaptively are of broader relevance.

Redesigning Field Papers’ User Interface - Jacks, Lindsey (Cadasta, 2016)
For the past three months, I've been working with Cadasta and Stamen on the atlas creation pages of the Field Papers map annotation tool. The end result is now live on the Field Papers website. We took the four step “wizard” process for creating an atlas, combined it all into a single-page, and...
Keywords: IMPORTANT

Facilitating collaborative problem solving with human-centred design: the Making All Voices Count governance programme in 12 countries of Africa and Asia - Jackson, Carl (Knowledge Management for Development Journal, 2015)
Keywords: IMPORTANT

Three Approaches to Monitoring: Feedback Systems, Participatory Monitoring and Evaluation and Logical Frameworks - Jacobs, Alex; Barnett, Chris; Ponsford, Richard (IDS Bulletin, 2010)
This article compares key attributes, strengths and weaknesses of three different approaches to monitoring development interventions: the logical framework approach, participatory monitoring and evaluation (PM&E) and feedback systems. Academic and practitioner literature describes how logframes meet the needs of senior decision-makers to summarise, organise and compare projects. PM&E meets the needs of field staff to work sensitively with intended beneficiaries and support their learning and empowerment. Feedback systems appear to link the two, providing performance data for managers and creating incentives for implementing staff to focus on their intended beneficiaries. Feedback systems build on the rich heritage of PM&E and are compatible with logframes. They may help provide a manageable and effective approach to accountability that links the means and the ends of development interventions. Feedback systems are at an early stage of development. There is a lot to learn about how and where they work best.

An Adaptive Capacity Guide Book: assessing, building and evaluating the capacity of communities to adapt in a changing climate - Jacobs, B.; Nelson, R.; Kuruppu, N.; Leith, P. (University of Technology and University of Tasmania, 2015)
A capacity to adapt to change is essential for managing Australia’s natural resources. The individuals, communities and organisations who manage our natural resources all have an innate capacity to adapt to change. Changes in climate, markets and technology have shaped the way we adapt the management of natural resources in urban, rural and coastal landscapes. Some of these changes are predictable and easy to manage. Others are expected, but their timing and magnitude are uncertain. Whatever the future holds, this guide can be used to build our capacity to meet future change with confidence.

Advancing Work with the Grain at USAID - Jacobstein, David (USAID Learning Lab, 2018)
In December 2017, I wrote a blog about some of the insights gained during a workshop on Context-Driven Adaptation, where many of our sharpest field officers shared the ways that they assessed and adapted to shifts in context to keep programming relevant and effective.

Context-Driven Adaptation (Overview) - Jacobstein, David (USAID Learning Lab, 2018)
CONTEXT-DRIVEN ADAPTATION COLLECTION

DRG Center practical tips to implement more context-adaptive programming - Jacobstein, David (#AdaptDev, 2018)
Hi #adaptdevers, The cross-sectoral programs team in the DRG Center have been working in support of ways that programming can be made more aware of, and responsive to, context considerations that have to do with incentives and relationships between different actors - often called power dynamics or political economy. Following several discussions with field folks, we were asked to come up with simple and practical tips that could help staff to implement more context-adaptive programming, or to better Work Politically to use TWP jargon. With assistance from many of our field staff and partners, we've put together three documents (to start) that have now been cleared to share publicly: • Tips on Making Your Solicitations Invite Context-Driven Adaptive Programming - suggestions spanning most sections of a typical solicitation to better weave in Thinking and Working Politically. I'm particularly excited that this document contains embedded links to excerpts from a set of solicitations that model good practice. You can also find a summary of all the excerpts from real solicitations, and links onward to the public posting of those solicitations on Fed Biz Ops or Grants.gov, here. • Tips on Power Dynamics and Theories of Change - suggestions relevant to those working on project designs and logic models. • Tips for Better Use of Advisory Councils - suggestions to set up better advisory bodies that help you to incorporate political economy more automatically into your programmatic adjustments. I hope that you'll find these practical and helpful! Feedback is always welcome. Best, David

Tips for Finding Unusual Allies and Building Innovative Alliances - Jacobstein, David (USAID Learning Lab, 2018)
One of the truisms of thinking and working politically (TWP) is that it requires looking differently at how stakeholders relate to a given development challenge or process, and building coalitions of the “right actors at the right time” who can drive forward progress while working with the grain of the context. While it’s easy to call for coalitions for change and diverse stakeholder engagement, identifying allies beyond those already seized with an issue, and finding ways to collaborate with stakeholders who may have different reasons for joining a coalition, is a challenging task. These are some suggested tips to improve working in that fashion.

Evaluating programming that thinks and works politically: Challenges and emerging practice - Jacobstein, David; Swift, Sarah (New Directions for Evaluation, 2022)
Issues of power are not new to program evaluation. What is new is a consideration of how programming uses insights into incentives that shape and adapt implementation. How should one evaluate in a way that explicitly assesses the ways in which a program considers power? One of the innovative topics deriving from the democracy and governance space is the approach of thinking and working politically (TWP) which is seeing increased use in development programming. TWP suggests different mental models and practical approaches to achieving development objectives in ways that are more contextually grounded and informed by power dynamics. This article describes several of the core challenges to evaluation of TWP and also a rubric of considerations for more effective evaluation practices in this emerging field.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/ev.20527

Managing Humanitarian Innovation: The cutting edge of aid - James, Eric; Taylor, Abigail (Practical Action Publishing, 2018)
The challenges facing humanitarian logistics are huge. Refugee camps present enormously challenging environments in which sudden spikes in demand, difficult to access locations, disruptions due to conflict or disasters, as well as normal supply chain problems are commonplace. This means that orders for medical and other supplies can take weeks and sometimes months to fulfil, severely impeding humanitarian operations. There is also a lack of or slow adoption of technology routinely used elsewhere. In addition, humanitarian logistics are also expensive. When customs clearance, transportation, storage, middlemen and administration are added in, the costs of basic items are often exorbitant. Managing Humanitarian Innovation presents a new approach that is beginning to transform the way humanitarian logistics are conducted. Innovation in logistics includes disrupting and improving supply chains through the use of technology, especially 3D printers, and engaging people to manage this approach. The book discusses what innovation is, and strategies for supporting it; it describes practical innovations and how they have been applied; and it outlines how innovation labs can be run. Finally it covers how to fund innovation and it suggests how humanitarian innovation might develop in the future. This book brings together the real experience of practitioners who have made innovation work. It is a collaborative work written by and for the community of people involved in humanitarian innovation, in particular in the making and manufacturing of humanitarian supplies. The book is full of practical and actionable points of value to the humanitarian community. Managing Humanitarian Innovation is essential reading for humanitarian practitioners as well as volunteers and others involved in humanitarian supplies provision. It is equally helpful to thought leaders, policy makers and educators.

Understanding Strategic Capacity in Constituency-Based Organizations - Jane Booth-Tobin; Kal Munis; Lynsy Smithson-Stanley; Hahrie Han (The P3 Lab, Johns Hopkins University, 2021)
Movement organizations work in inherently uncertain political environments. Whether an organization is advocating for a new minimum wage, working to close a private prison, or seeking to influence an election, the terrain they are operating on shifts nearly every day. That is increasingly true as political uncertainty rises in the 21st century, particularly for historically race-class subjugated communities. Any movement-based organization seeking to build, exercise, and win political power must have sophisticated strategic capacities to be able to navigate these uncertain, dynamic, and constantly shifting political environments. Yet, our knowledge of how movements can nurture the kind of strategic capacities that allows them to build constituencies and leadership that can operate in the flexible ways needed for these dynamic circumstances is limited. This report seeks to synthesize what is currently known about organizations that successfully build and wield strategic capacity, with a particular eye toward how it might apply to constituency-based organizations. The report concludes with an assessment and facilitated conversation guide to support movements and movement organizations in understanding how developed (or not) their strategic capacities are.

Why are effective feedback mechanisms in cash transfers so important? - Jannat, Mahiratul (CLARISSA, 2023)
The CLARISSA Social Protection Intervention was set us as an innovative social policy intervention for tackling social ills, with a...

Failing Forward: How CARE is focusing on what goes wrong to improve impact - Janoch, Emily (USAID LEARN, 2019)
CARE's Failing Forward initiative is sparking opportunities to showcase the ideas that don't work so we can spend more time implementing the ones that do. It's changing the conversation inside the organization, and leading to changes in the way we design and implement programs. It's also allowing us to make connections across a global portfolio of more than 900 projects, and with new and different partners to learn from their experience.

Failing Forward: How CARE is Focusing on What Goes Wrong to Improve Impact - Janoch, Emily (CARE, 2019)
CARE's Failing Forward initiative is sparking opportunities to showcase the ideas that don't work so we can spend more time implementing the ones that do. It's changing the conversation inside the organization, and leading to changes in the way we design and implement programs.

Examining the results and adaptation ideas in foreign aid - Janus, Heiner (University of Manchester, 2020)
This thesis applies ideational and institutional theories to analyse how two specific ideas, results and adaptation, have changed the theory and practice of development cooperation. The thesis addresses the question of why the results and adaptation ideas are often treated as binaries and how this debate has evolved historically. In a first theoretical paper, the evolution of results and adaptation is conceptualised as a combination of institutional layering and diffusion within development organisations. The second theoretical paper applies ideational theory, in particular, the coalition magnet framework, to China as a donor country. The empirical papers apply ideational and institutional theories to study aid projects funded by the World Bank and China in the Rwandan agriculture sector. The third paper analyses through which mechanism, results-based principal-agent relationships or problem-driven iterative adaptation, the World Bankâs Program for Results in the agriculture sector in Rwanda has led to increased agricultural productivity. The paper combines causal process tracing and contribution analysis to investigate two underlying theories of change of the Program for Results. The fourth paper applies the same framework and methodology to the Chinese Agricultural Technology Demonstration Center in Rwanda. The fifth paper compares both projects, the World Bank project and the Chinese project. The thesis finds that the ideas of results and adaptation are often presented as mutually exclusive mainly at the general level of public philosophies or paradigms, but show overlap and potential for integration on the level of framing policy problems and policy solutions. The thesis also demonstrates that there is unexplored potential for convergence between China and Development Assistance Committee donors around âcoalition magnetâ ideas. The empirical part of the thesis reveals how results-based and adaptive causal mechanisms co-exist within given aid interventions by the World Bank and China, how these interact and how they ultimately contribute to achieving development outcomes. The key finding is that the broader political context of the Rwandan agricultural sector is the main factor for determining development outcomes, which neither the World Bank project nor the Chinese projects take into account. The comparison of the World Bankâs and Chinaâs interventions finds that donor organisations need to address how results-based ideas in combination adaptive development ideas can be better tailored to fit into the specific context of the Rwandan agriculture sector.

Social Design and Neocolonialism - Janzer, Cinnamon L.; Weinstein, Lauren S. (Design and Culture, 2014)
This article examines the current field of social design: its claims, practices, and methodologies. Findings discovered through qualitative research illuminate the current application of social design practices and offer critique around their use in the social sphere. This article argues that designers must be sensitive to a variety of complex social and cultural cues and structures or they risk contributing to, or practicing, design neocolonialism. The article offers two key theoretical suggestions to further the emerging field's progress. First, social design must shift its focus from one that is human-centered to one that is situation-centered. Second, it is imperative that social design develops a shared framework for understanding, executing, and evaluating its initiatives and interventions. Additionally, this article introduces a matrix to serve as an early iteration of a shared framework.
Keywords: Design Methodology; Design Thinking; Framework; Human-centered design; IMPORTANT; social design

Co-Creating Digital Public Services - Jarke, Juliane (Co-creating Digital Public Services for an Ageing Society: Evidence for User-centric Design, 2021)
This chapter reviews key literature and concepts relating to the co-creation of digital public services. For this task, it is firstly important to consider what kind of digital public services may be suitable for co-creation. In order to do so, the first section of this chapter defines what a digital public service is (e.g. with respect to different types of service providers, different types of services and service delivery) and considers what kind of digital public services allow for meaningful citizen participation. To better conceptualise different degrees of participation, the subsequent section reviews Arnstein’s (1969) “ladder of citizen participation” and related work. This allows distinguishing between different degrees of non-participation, (consultative) participation and beyond. Thirdly, the chapter reviews traditional participatory approaches that provide the basis to co-creating of digital public services: (1) co-production of public services, (2) co-design and (3) civic open data use. The chapter summarises and compares the different rationales for participation in these approaches, and reviews how they understand the sharing of control, the sharing of knowledge and the enabling of change.
Keywords: Civic Tech; Co-creation; Co-design; Co-production; Digital public services; Open data; Open government; Participation; Participatory design; User-centric services; e-services

Co-creating Digital Public Services for an Ageing Society: Evidence for User-centric Design - Jarke, Juliane (Springer International Publishing, 2021)
This open access book attends to the co-creation of digital public services for ageing societies. Increasingly public services are provided in digital form; their uptake however remains well below expectations. In particular, amongst older adults the need for public services is high, while at the same time the uptake of digital services is lower than the population average. One of the reasons is that many digital public services (or e-services) do not respond well to the life worlds, use contexts and use practices of its target audiences. This book argues that when older adults are involved in the process of identifying, conceptualising, and designing digital public services, these services become more relevant and meaningful.The book describes and compares three co-creation projects that were conducted in two European cities, Bremen and Zaragoza, as part of a larger EU-funded innovation project. The first part of the book traces the origins of co-creation to three distinct domains, in which co-creation has become an equally important approach with different understandings of what it is and entails: (1) the co-production of public services, (2) the co-design of information systems and (3) the civic use of open data. The second part of the book analyses how decisions about a co-creation project’s governance structure, its scope of action, its choice of methods, its alignment with strategic policies and its embedding in existing public information infrastructures impact on the process and its results. The final part of the book identifies key challenges to co-creation and provides a more general assessment of what co-creation may achieve, where the most promising areas of application may be and where it probably does not match with the contingent requirements of digital public services. Contributing to current discourses on digital citizenship in ageing societies and user-centric design, this book is useful for researchers and practitioners interested in co-creation, public sector innovation, open government, ageing and digital technologies, citizen engagement and civic participation in socio-technical innovation.

We Rise - Movement Building Reimagined - JASS (Just Associates, 2017)
In our virtual toolkit, We Rise: Movement Building Reimagined, we describe in detail four interconnected cycles of movement building – Rising Up, Building Up, Standing Up, and Shaking Up. At the heart of these cycles lies an analysis of how to challenge and transform power. Each cycle features key ideas, relevant tools, and practical tips from our work and activists in our network that movement builders around the world can learn from and adapt in their own work.

The Future is a Choice: The Oxfam Framework and Guidance for Resilient Development - Jeans, Helen; Thomas, Sebastien; Castillo, Gina (Policy & Practice, 2016)
This guide provides a framework for Oxfam staff to design programmes and campaigns that contribute to resilient development. Oxfam defines resilience as ‘the ability of women and men to realize their rights and improve their well-being despite shocks, stresses

Adaptive Management - Jenal, Marcus; Cunningham, Shawn (Annual Reflection 2019, 2019)

Causality and attribution in market systems development - Jenal, Marcus; Liesner, Mollie (BEAM, 2017)
Resources that contain evidence of market systems interventions. Recently updated.

Human trafficking in South Asia: Assessing the effectiveness of interventions - Jensen, Charity; Oosterhoff, P.; Pocock, N. (FCDO, 2020)
This Rapid Evidence Assessment (REA) examines current evidence on the effectiveness of interventions to combat human trafficking in four South Asian countries (Bangladesh, India, Nepal, and Pakistan). This REA is being carried out as part of a wider assignment for the UK Department for International Development (DFID), with the overall objective of synthesising evidence on the effectiveness of interventions that tackle modern slavery in South Asia. Two REAs were conducted on different types of modern slavery, one on human trafficking for labour and sexual exploitation, and another on child labour (Idris et al., 2020). The research question for this REA is: ‘What has been the effect of interventions to combat and/or reduce sexual and labour exploitation in Bangladesh, Pakistan, India, and Nepal?’ Trafficking in persons is a form of ‘modern slavery’, which is an umbrella term for the variety of situations in which someone is forcibly controlled by an individual or group for the purpose of exploitation. The Global Slavery Index estimated that, on any given day in 2016, 40.3 million people were victims of modern slavery, including 24.9 million people in forced labour and 15.4 million people in forced marriage. Of the estimated almost 25 million people in modern slavery in Asia, 66% were exploited for labour (Global Slavery Index, 2018).

Critical friends - real time insights for shaping strategy - Johnson, Debbie; Nathan, Geeta; Rahman, Syahirah Abdul (Chapters, 2022)
This chapter focuses on facilitation given by the Innovation Caucus to provide expert academic critique to inform Innovate UK's strategy for UK business innovation. As Innovate UK's strategy developed, it became evident that several policy domains needed critical insights and evidence. An academic critical friend provided the latest academic insights, evidence and wider perspective of the actors in the UK Innovation system, insights of which policy makers often lack. The chapter gave case studies of Innovation Caucus' work with Innovate UK in facilitating extensive research expertise and helping policy makers to open dialogue. It also describes 'The Innovators' Breakfast Club', a webinar series organised by Innovation Caucus, co-developed with Innovate UK, which created live face-to-face dialogue between academic experts and Innovate UK strategy/policy leads. This example showed how critical friends are important in facilitating the initial dialogues needed to build evidence for policy making. The dialogue builds the foundation for a virtuous cycle of learning. The approach provides an opportunity for academic experts to gain insights into the priorities and dilemmas facing policy makers, to shape future academic research and refine the skill set needed to become critical friends.
Publisher: Edward Elgar Publishing

Integrating Local Knowledge in Development Programming - Johnson, Madelyn; Maunder, Ishan; Pinga, Andie (USAID, 2022)
The objective of this report, Integrating Local Knowledge in Development Programming is to share knowledge of how development donors and implementing organizations leverage local knowledge to inform programming. In a recent speech at Georgetown University, United States Agency for International Development (USAID) Administrator Samantha Power said, “As Americans with a fraught history living up to our own values, we’ve got to approach this work with intention and humility. But the entire development community needs to interrogate the traditional power dynamics of donor-driven development and look for ways to amplify the local voices of those who too often have been left out of the conversation.” To that end, USAID’s Agency Knowledge Management and Organizational Learning (KMOL) function facilitated conversations with multilateral and bilateral donors and local organizations to understand how organizations define, utilize, and incorporate local knowledge into their programmatic and operational activities. Using qualitative tools to gather data for this report, the research team explored five overarching themes: 1. Local Knowledge Nomenclature and Definitions 2. Best Practices 3. Outcomes 4. Ethics and Power Dynamics 5. Challenges

The Adaptive Management System for the Tasmanian Wilderness World Heritage Area — Linking Management Planning with Effectiveness Evaluation - Jones, Glenys (Adaptive Environmental Management, 2009)
This paper provides a 30 year retrospective on the development of the adaptive management system for the Tasmanian Wilderness World Heritage Area (Australia). It describes the historical background, key influences and stages that paved the way to establishment of adaptive management. It outlines how effectiveness monitoring, evaluation and reporting are integrated with the management plan for the Area to establish an ongoing adaptive management cycle. The chapter presents figures and tools for adaptive management, including 5 useful questions for guiding the integration of effectiveness monitoring, evaluation and reporting into management plans and programs. Strengths and weaknesses of the adaptive management system are discussed. Key lessons and insights distilled from this experience are offered, including the importance of planned monitoring of management effectiveness; the role of stakeholder assessments; and the factors that can assist in sustaining longterm strategic programs despite ongoing institutional change. The chapter concludes with suggestions for fostering an enabling environment for adaptive management.
Keywords: Adaptive Management; Management Intent; Reserve Management; World Heritage

A guide to monitoring and evaluating policy influence - Jones, Harry (ODI, 2011)

Making Outcome Mapping Work - Evolving experiences from around the World - Jones, Harry (Outcome Mapping Learning Community, 2007)

Taking responsibility for complexity: how implementation can achieve results in the face of complex problems - Jones, Harry (ODI, 2011)
OCLC: 837825712

Doing Urban Development Differently - Jones, Harry; Adhikari, Bishnu (From Poverty to Power, 2017)
Guest post from Harry Jones and Bishnu Adhikari, both of Palladium on what urban aid and development can learn from the Doing Development Differently movement

Adaptive environmental assessment and management: a new approach to environmental impact assessment - Jones, Michael L.; Greig, Lorne A. (New directions in environmental impact assessment in Canada, 1985)

Systemic Design Principles for Complex Social Systems - Jones, Peter H. (Social Systems and Design, 2014)
Keywords: IMPORTANT

Don’t Build It: A Guide For Practitioners In Civic Tech / Tech For Development - Jordan, Luke (Grassroot and MIT Governance Lab, 2021)
If you just remember these... If you can avoid building it, don’t build it; if you have to build it, hire a CTO, ship early, and mature long; and no matter what, draw on a trusted crew, build lean and fast, and get close to and build with your users as soon as possible. — This guide aims to help you avoid bad projects, structure the team right, ship and learn quicker, and mature longer. The guide starts with project selection, including why the best project to select is no project at all. It moves on to team structure, and the extreme importance of a full-time senior tech lead (or chief technology officer (CTO), understood as an excellent engineering manager). It then covers timelines, emphasizing shipping early but having enormous patience getting to maturity, above all in finding product-use-fit, and avoiding vanity metrics. The guide then goes into some detail on hiring, covering the CTO role, senior contractors, designers and young engineers. The longest section, by some distance, is that on hiring. Hiring is the one thing considered critical in every piece of the lore, by founders and investors and managers alike, across all sectors. It is also the field in which I think I got it mostly right, and for reasons I can explain in ways that I believe will be helpful.

Doing Anti-corruption Differently - Jorge (www.globalintegrity.org, 2016)
By Alan Hudson, Executive Director Corruption and how to tackle it is center-stage in London this week, with the spotlight brighter than ever as a result of the Panama Papers. This is welcome news. The Anti-Corruption Summit, hosted by the...

Reading the Local Context: A Causal Chain Approach to Social Accountability - Joshi, Anuradha (IDS Bulletin, 2014)
There is a general consensus that ‘context’ matters for development outcomes, yet we have little understanding of how exactly ‘context’ affects outcomes. This article focuses on the question of ‘context’ in social accountability (SA) initiatives by separating macro- and micro-contextual factors. On the macro side (country level), accountability processes need to take into account broad factors such as national histories of citizen–state engagement. On the micro side, local factors can drive the extent to which SA initiatives are successful, even within otherwise broadly similar national contexts. The article outlines the basic components of accountability and proposes a ‘causal chain'strategy to better understand the micro-context. This would allow existing evidence to be reorganised to assess the promise of existing and new initiatives by deconstructing the various mini-causal pathways (i.e. in the micro-context) and understanding the contextual conditions that make them work.
Keywords: IMPORTANT

Introduction - Localising Governance: An Outlook on Research and Policy - Joshi, Anuradha; Schultze-Kraft, Markus (IDS Bulletin, 2014)

Watering the Grassroots: A Strategy for Social Movement Support - Joyce, Mary (Transparency & Accountability Initiative, 2015)
In this third and final think piece exploring the role of grassroots organizations and movements for state accountability (find the previous pieces here and here), the author Mary Joyce, proposes new thinking about how funders and other external organizations can best support social movements. Funding and other support for popular organizations and movements is not straightforward, and there are potential risks and distortions involved. Interested supporters need to clearly identify and articulate these obstacles in their discussions with movement activists before pursuing and funding or other support activities. This think piece outlines several potential avenues of support: small, flexible grants; funding intermediary organizations; providing external consultants or researchers to work with movements; and other options as well. These suggestions provide ideas for funders and other organizations seeking to move beyond projects to supporting robust accountability ecosystems, in which grassroots organizations and movements play a critical role.

Mobilizing Accountability: A Learning Agenda for Grassroots Organizations and Social Movements Addressing State Accountability - Joyce, Mary; Halloran, Brendan (Transparency & Accountability Initiative, 2015)

A Movements Perspective on Transparency and Accountability - Joyce, Mary; Walker, Tom (Transparency & Accountability Initiative, 2015)
This Think Piece describes social movements pursuing government accountability and the challenges and opportunities to supporting them.

A Treatise on Efficacy: Between Western and Chinese Thinking - Jullien, Francois (University of Hawaii Press, 2004)
In this highly insightful analysis of Western and Chinese concepts of efficacy, Francois Jullien subtly delves into the metaphysical preconceptions of the two civilizations to account for diverging patterns of action in warfare, politics, and diplomacy. He shows how Western and Chinese stategies work in several domains (the battle-field, for example) and analyzes two resulting acts of war. The Chinese strategist manipulates his own troops and the enemy to win a battle without waging war and to bring about victory effortlessly. Efficacity in China is thus conceived of in terms of transformation (as opposed to action) and manipulation, making it closer to what is understood as efficacy in the West. Jullien's brilliant interpretations of an array of recondite texts are key to understanding our own conceptions of action, time, and reality in this foray into the world of Chinese thought. In its clear and penetrating characterization of two contrasting views of reality from a heretofore unexplored perspective, Treatise on Efficacy will be of central importance in the intellectual debate between East and West.

Design in the Organization: Parts and Wholes - Junginger, Sabine (Research Design Journal, 2009)
Inroduces the stages of adoption of Design in organizations, with a visual tool.

Don't Lead Alone: Think Like a System, Act Like a Network, Lead Like a Movement! - Justis, Cleveland; Student, Daniel (Fast Company Press, 2023)
Think. Act. Lead.It seems simple enough. But understanding your desired impact and how it fits into a larger picture, connecting your work to others and finding new collaborators, and bringing those collaborators together and moving them in a unified direction is never easy.Governments, businesses, and nonprofits all have unique approaches and ideas that many of us learn through our work. Yet, we rarely consider the skills needed to create and maintain the partnerships between them. Most of us learn those skills through trial, error, and often, failure. Worse, we typically stay in our self-reinforcing silos, sharing perspectives and frustrations with like-minded people, limiting our vision of what our work can become. By partnering with other sectors, we combine and adapt approaches to solve complex problems, and leaders in any industry can create large-scale change.Cleveland Justis and Daniel Student share a road map for effective partnerships that increase impact and profitability. Using real-life examples and practice exercises, the authors teach how to acquire and use skills to solve complex problems and propel your organization forward by combining a multitude of perspectives, split into three sections:Think Like a SystemAct Like a NetworkLead Like a MovementIt’s time to get out of our silos. Don’t lead alone.

Leading Effectively in a VUCA Environment: A is for Ambiguity - Kail, Col Eric G. (Harvard Business Review, 2011)
This is the last in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Diversity and global reach introduce ambiguity to the environment; therefore opportunities and challenges must be appreciated from multiple aspects, not just our own […]
Keywords: Leadership; Leading teams

Leading Effectively in a VUCA Environment: C is for Complexity - Kail, Col Eric G. (Harvard Business Review, 2010)
This is the third in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Our complex environment demands a perspective that goes beyond viewing threats and opportunities as collective; we must see them as interactive. Leading through […]
Keywords: Leadership; Leadership development

Leading in a VUCA Environment: U is for Uncertainty - Kail, Col Eric G. (Harvard Business Review, 2010)
This post is part of an HBR Spotlight examining leadership lessons from the military. It’s the second in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. The frenetic pace of our environment, brought on by volatility, […]
Keywords: Leadership

Leading in a VUCA Environment: V Is for Volatility - Kail, Col Eric G. (Harvard Business Review, 2010)
This post is part of an HBR Spotlight examining leadership lessons from the military This is the first in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Do challenges and opportunities that once took days or […]
Keywords: Leadership

Linking Assessment to Instruction: Using Dynamic Indicators of Basic Early Literacy Skills in an Outcomes-Driven Model - Kaminski, Ruth; Cummings, Kelli (Dynamic Measurement Group, 2008)
As educators increasingly are held responsible for student achievement, school personnel struggle to find ways to effectively document student responsiveness to interventions and track progress toward important outcomes. While many educators focus on high-stakes tests as a means of documenting student achievement of important outcomes, other assessment approaches may be better suited to assessing student progress. Assessment that can be used to adapt teaching to meet student needs is called formative assessment. Because the primary purpose of formative assessment is to support student learning, it may arguably be considered the most important assessment practice in which educators engage. This paper will focus on linking assessment to instruction to improve student outcomes through the use of Dynamic Indicators of Basic Early Literacy Skills (DIBELS) within an Outcomes-Driven Model.

Facilitator's Guide to Participatory Decision-Making - Kaner, Sam (John Wiley & Sons, 2014)
Unleash the transformative power of face to face groups The third edition of this ground–breaking book continues to advance its mission to support groups to do their best thinking. It demonstrates that meetings can be much more than merely an occasion for solving a problem or creating a plan. Every well–facilitated meeting is also an opportunity to stretch and develop the perspectives of the individual members, thereby building the strength and capacity of the group as a whole. This fully updated edition of The Facilitator′s Guide to Participatory Decision–Making guides readers through the struggle and the satisfaction of putting participatory values into practice, helping them to fulfill the promise of effective group decision–making. With previous editions already embraced by business and community leaders and consulting professionals around the world, this new book is even more insightful and easy to use. New for this edition: 60 pages of brand new skills and tools Many new case examples Major expansion and reorganization of the advanced sections of the book. New chapter: Teaching A Group About Group Dynamics Doubled in size: Classic Facilitator Challenges. Substantially improved: Designing Realistic Agendas now three chapters, with wise, insightful answers to the most vexing questions about meeting design.

Collective Impact - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2011)
Large-scale social change requires broad cross-sector coordination, not the isolated intervention of individual organizations.

Embracing Emergence: How Collective Impact Addresses Complexity - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2013)
Collective impact is upending conventional wisdom on how we achieve social progress.

The water of Systems Change - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Foundations involved in systems change can increase their odds for success by focusing on the least explicit but most powerful conditions for change, while also turning the lens on themselves. The Water of Systems Change aims to clarify what it means to shift these conditions. We offer the “inverted triangle” framework as an actionable model for funders and others interested in creating systems change, particularly those who are working to advance equity. Top Takeaways Systems change is about advancing equity by shifting the conditions that hold a problem in place. To fully embrace systems change, funders should be prepared to see how their own ways of thinking and acting must change as well. Shifts in system conditions are more likely to be sustained when working at three different levels of change: explicit, semi-explicit, and implicit.

The water of Systems Change: Action learning exercise - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Based on the “inverted triangle” framework presented in The Water of Systems Change, this activity is designed to help individuals think systemically about social change, explore what is happening below the surface on issues they care about, and determine how they and their organizations can pursue large-scale change in a disciplined and holistic manner. The exercise is divided into 3 parts: Part I uses the “inverted pyramid” introduced in The Water of Systems Change to perform an external assessment of opportunities to make progress on the social or environmental issue you are focused on. Part II uses the same framework to consider internal conditions within yourself and your organization that should change in order for you to better support progress on your issue. Part III takes what was developed in Parts I and II and asks “What to do next?”

How and Why Practitioners Think and Work Politically - Evidence from Chemonics Programming Across Sectors - Kantelberg, Renee; Swift-Morgan, Jennifer; Watson, Bryce (Chemonics International, 2022)
Most development practitioners have long recognized that deep contextual knowledge is crucial to understanding how projects interact with their local systems and, in turn, to navigating these systems. Moreover, this knowledge must complement projects' technical solutions, or they will fall flat and may even undercut project objectives as they clatter down. What, then, explains practitioners' particular interest in TWP as an explicit strategy and more than just "doing good development"? This report responds to that question and to the many calls for a more comprehensive picture of TWP by presenting new evidence of the various forms that TWP may take in practice. The evidence comes from a 2022 study that Chemonics undertook to foster more robust learning about TWP. Specifically, we closely examined Chemonics implemented projects that used or are using various forms of TWP in nine countries: Bangladesh, Iraq, Mozambique, the Philippines, Pakistan, Syria, Timor-Leste, and Tunisia. In conducting the study, we interviewed multiple staff from these projects. We complemented what we learned from these projects with a review of eight additional Chemonics- implemented projects applying TWP that had received dedicated support from Chemonics’ Center for Politically Informed Programming (the Center). We consider these findings alongside those of the recent (2022) USAID-Chemonics study on political economy analysis (PEA) usage to identify and articulate what is different and more effective about PEA processes and TWP practices that have received more support.

Design reality gap issues within an ICT4D project: an assessment of Jigawa State Community Computer Center - Kanya, Rislana Abdulazeez; Good, Alice (2013)
This paper evaluates the Jigawa State Government Community Computer centre project using the design reality gap framework. The purpose of this was to analyse the shortfall between design expectations and implementation realities, in order to find out the current situation of the project. Furthermore to analyse whether it would meet the key stakeholder’s expectation. The Majority of Government ICT Projects is classified as either failure or partial failure. Our research will underpin a case study of Jigawa State Community Computer centre project. To support our argument we conducted a qualitative case study in which we conducted two interviews, and a survey to find out the current status of the project. Our findings indicated that the project can be classified as a partial failure because few of the centres, operating in some areas of the community, offered socio-economic advancement. Our results also indicated that the project design reality gap is quite significant. This gap occurred due to poor planning and implementation of the project. Our research reveals several challenges that could impact upon the successfulness of the project provide a foundation for further research and add to existing literature. The challenges associated with the project we identify include poor state of power supply, lack of community engagement during the project planning and implementation, lack of commitment from the Local Government Administration. Our research has potential in adding ICT4D literature, reveals how ICT4D project evaluation can be carried out using design reality gap framework and provides guideline for policy makers.

Calibrating conservation: new tools for measuring success - Kapos, Valerie; Balmford, Andrew; Aveling, Rosalind; Bubb, Philip; Carey, Peter; Entwistle, Abigail; Hopkins, John; Mulliken, Teresa; Safford, Roger; Stattersfield, Alison; Walpole, Matt; Manica, Andrea (Conservation Letters, 2008)
Conservation practitioners, policy makers, and donors agree that there is an urgent need to identify which conservation approaches are most likely to succeed in order to use more effectively the limited resources available for conservation. While recently developed standards of good practice in conservation are helpful, a framework for evaluation is needed that supports systematic analysis of conservation effectiveness. A conceptual framework and scorecard developed by the Cambridge Conservation Forum help to address common constraints to evaluating conservation success: unclear objectives, ineffective information management, the long time frames of conservation outcomes, scarcity of resources for evaluation, and lack of incentives for such evaluation. For seven major categories of conservation activity, the CCF tools help clarify conservation objectives and provide a standardized framework that is a useful basis for managing information about project outcomes and existing conservation experience. By identifying key outcomes that can predict conservation success and can be assessed in relatively short time frames, they help to make more efficient use of scarce monitoring and evaluation resources. With wide application, the CCF framework and evaluation tool can provide a powerful platform for drawing on the experience of past and ongoing conservation projects to identify quantitatively factors that contribute to conservation success.
Keywords: Conservation effect; Conservation outcomes; Evaluation; Evidence-based conservation; Monitoring; conservation impact; framework; indicators; scorecard

How to make a multilayer pie chart in Excel - Karina Adcock (2021)
Create a multilevel donut chart in excel ——————————————————————————– #exceltips #exceltutorials #excelcharts SUBSCRIBE: https://goo.gl/c46YPs Microsoft Office 365, Beta Channel, Version 2104 ——————————————————————————— IF YOU LIKED THIS VIDEO YOU MAY ALSO LIKE: - Recreating a pie chart from a newspaper in PowerPoint • How to make a pie...

Learning from Life Story Collection and Analysis With Children Who Work in the Worst Forms of Child Labour in Nepal - Karki, Shanta; Apgar, Marina; Snijder, Mieke; Sharma, Ranjana (Institute of Development Studies, 2022)
The CLARISSA Nepal team collected and analysed 400 life stories of children and young people engaged in or affected by the worst forms of child labour (WFCL), particularly in the “Adult Entertainment” sector in Nepal, which includes children working in Dohoris (restaurants playing folk music), dance bars, spa-massage parlours, khaja ghars (tea/snack shop) and guest houses. Stories were also collected from children in CLARISSA’s focus neighbourhoods, children in this category include street connected children and those working in transportation, party palaces, domestic labour and construction sites. Of the 400 stories collected, 350 were collected by adult researchers and 50 were collected by children themselves.
Accepted: 2022-11-04T12:22:13Z Publisher: Institute of Development Studies

Applying the River of Life Method to Support Reflection and Learning in Terre des hommes Nepal - Karki, Shanta; Giri, Roju; Neupane, Sudarshan; Snijder, Mieke; Apgar, Marina (Institute of Development Studies, 2023)
The RoL method is a visual narrative method that helps people tell stories of the past, present, and future. Individuals can use this method to introduce themselves in a fun and descriptive way. A group can use it to understand and reflect on the past and imagine the future of a project. Besides, it can also be used to build a shared view of a process over time while acknowledging different and perhaps contradictory perspectives. The method uses drawings rather than text, making it useful in groups that do not share a common language. Metaphors from a river are used to explore aspects of a story – such as whirlpools depicting challenges or lakes suggesting a sense of calm etc. When used in a group, it is an active method, engaging people in the process of storytelling and listening through visualising their experiences and using metaphors to explore in depth. In CLARISSA, we adapted the RoL method to document our collective understanding of the story of implementation of the programme as part of the programme’s monitoring, evaluation and learning component. The purpose was to surface the details of our process of the systemic Action Research that we are undertaking with children in the worst forms of child labour and business owners. We used the same river metaphors as is often applied when the method is used with individuals.
Accepted: 2023-09-18T10:13:55Z Publisher: Institute of Development Studies

Why is it so hard for non-state actors to be heard? Inside Tanzania's education policies - Katera, Lucas (MAVC, 2015)
Lessons from policy in Ghana, Kenya, South Africa and Tanzania

Obliquity: Why Our Goals Are Best Achieved Indirectly - Kay, John (Penguin Books, 2010)
"John Kay tells a fast-paced detective story as he searches for the surprising secret to success...Brilliant." -Tim Harford, author of The Logic of Life In this revolutionary book, economist John Kay proves a notion that feels at once paradoxical and deeply commonsensical: the best way to achieve any complex or broadly defined goal, from happiness to preventing forest fires, is the indirect way. We can learn how to achieve our objectives only through a gradual process of risk taking and discovery-what Kay calls obliquity. The author traces this seemingly counterintuitive path to success as it manifests itself in nearly every aspect of life, including business, politics, sports, and more.

Diseño transformacional de proyectos - Kehrer, Daniel (GIZ, 2020)
There are many definitions of the term ‘transformation’ or ‘transformational change’. The first section of the report develops a basic understanding of transformations or transitions (used synonymously) viewed from various perspectives. In this, transformations are defined as processes that use disruptive innovations to change systems into fundamentally new systems that subsequently form the new mainstream. Section two describes existing approaches to environmental and climate finance in international cooperation and discusses them in light of the proposed definition. All of the approaches have the potential to be further refined and in that process often to increase the precision of what is understood by each type of transformation. The definitions already state which criteria and indicators are referred to and how relevant they are. There is wide diversity in the type of criteria and indicators used by the various organisations, and how they are classified, but certain common features can be identified and with the aid of the literature on transformations they can be combined to form a comprehensive framework. With this in mind, the derivation of quality criteria for transformative interventions is explained in section 3.1. Transformational change at one and the same time calls for big decisions and innumerable projects in a particular field of transformation; the projects cannot be planned on the drawing board but still should be coordinated with each other. Section 3.2 offers guidance on this. Section 3.3 argues in favour of focusing more closely on the ‘process promise’ and employing a more iterative and more adaptable commissioning procedure. Finally, section 3.4 introduces two types of indicators under the various criteria: design indicators, which measure the quality of interventions that are aimed at influencing transformations (process orientation), and outcome indicators, which measure the process and/or progress of a transformation itself.

Transformative project design - Kehrer, Daniel (GIZ, 2020)
There are many definitions of the term ‘transformation’ or ‘transformational change’. The first section of the report develops a basic understanding of transformations or transitions (used synonymously) viewed from various perspectives. In this, transformations are defined as processes that use disruptive innovations to change systems into fundamentally new systems that subsequently form the new mainstream. Section two describes existing approaches to environmental and climate finance in international cooperation and discusses them in light of the proposed definition. All of the approaches have the potential to be further refined and in that process often to increase the precision of what is understood by each type of transformation. The definitions already state which criteria and indicators are referred to and how relevant they are. There is wide diversity in the type of criteria and indicators used by the various organisations, and how they are classified, but certain common features can be identified and with the aid of the literature on transformations they can be combined to form a comprehensive framework. With this in mind, the derivation of quality criteria for transformative interventions is explained in section 3.1. Transformational change at one and the same time calls for big decisions and innumerable projects in a particular field of transformation; the projects cannot be planned on the drawing board but still should be coordinated with each other. Section 3.2 offers guidance on this. Section 3.3 argues in favour of focusing more closely on the ‘process promise’ and employing a more iterative and more adaptable commissioning procedure. Finally, section 3.4 introduces two types of indicators under the various criteria: design indicators, which measure the quality of interventions that are aimed at influencing transformations (process orientation), and outcome indicators, which measure the process and/or progress of a transformation itself.

Transforming our work: Getting ready for transformational projects - Kehrer, Daniel; Flossmann-Kraus, Ursula; Ronco Alarcon, Sabrina Valeria; Albers, Vivien; Aschmann, Gwendolin (GIZ, 2020)

Seeking balanced ownership in changing development cooperation relationships - Keijzer, Niels; Klingebiel, Stephan; Örnemark, Charlotte; Scholtes, Fabian (Expert Group for Aid Studies, 2018)
According to the Paris Declaration and the 2030 Agenda, ownership is a prerequisite for effective development cooperation. How can the principle of ownership be promoted in today’s complex development cooperation, in which the numbers of actors have increased? This is the subject of the Expert Group for Aid Studies report Seeking balanced ownership in changing development cooperation relationships. The report contains two country case studies – on Liberia and Rwanda – as well as interviews with the Swedish International Development Cooperation Agency (Sida) and the Ministry for Foreign Affairs, and studies on documents concerning ownership in a Swedish development cooperation context. The authors note that ownership remains relevant as a guiding principle in international development cooperation. The trend from country-to-country cooperation to various forms of support through UN bodies and specialised global funds has created new conditions and competing interests for ownership. An understanding of ownership and how it can be promoted in the complex reality of today needs to be thoroughly re-examined. The study recommends the following: 1. Starting a discussion within the OECD-DAC on effective development cooperation that has global ownership right up to the end of the process. 2. Establishing an international code of conduct in accordance with agreed ownership principles concerning development cooperation funding to and via UN bodies and global funds. 3. Sweden should formulate an explicit policy and approach for how to promote ownership in development cooperation that includes numerous partners.

Navigating with Action Inquiry (Collective Leadership Animations) - Keira Oliver (2020)
"Have you ever wondered if there might be a better way to work together? Perhaps you would like to find ways to avoid habits, or patterns of behaviour, that whilst you say you don’t like them, you seem unable to escape." Written & narrated by Cathy Sharp (Research for Real) and animated by Keira Oliver (Collective Leadership for Scotland) and her son (10yr) in an animation-sprint style (created quickly, but with care), this film summarises the ideas and practices of action inquiry. It introduces a set of statements designed to stretch, challenge and encourage us to talk about these ideas to find better ways to work together.

Inclusion in Making All Voices Count - Kelbert, Alexandra (Making All Voices Count, 2014)
Part of a sequenced learning process for MAVC's Research and Evidence Component, the summary of a thematic discussion led by researcher Evangelia Berdou.

Thinking and working with political settlements - Kelsall, Tim (ODI, 2016)
• In recent years, Political Settlements Analysis (PSA) has become increasingly influential in academic and policy circles • Despite its intuitive appeal, it seems difficult to use in practice • PSA has a natural affinity with Adaptive Development, Thinking and Working Politically, and Doing Development Differently approaches • By answering the simple diagnostic questions supplied here, development partners can identify the types of political settlements in which they work, and draw some broad operational implications

John F. Kennedy Address at Rice University on the Space Effort - Kennedy, John F. (Public Papers of the Presidents of the United States, 1962)

A market system by any other name would smell as sweet - Kessler, Adam; Conroy, Kevin (BEAM Exchange, 2019)
How does Doing Development Differently (DDD) and Problem Driven Iterative Adaption (PDIA) connect to core principles of the MSD approach?

Constituent Voice: Technical Note 1 - Keystone Accountability (Keystone Accountability, 2014)

Teams that Do Development Differently - Khan, Jehanzeb; Fisher, Annette (Global Policy Journal, 2017)

Monitoring and Result Measurement for Adaptive Programming - How to Use Data to Manage a MSD Program: Lessons from PRISMA - Khan, Khaled; Seely, Kevin; Ridwan, Mustika; Mulya, Bodhiya (PRISMA, 2019)
Using monitoring data to improve interventions is harder than it seems. Decision-makers are often busy implementing activities, unclear about their roles in data collection and analysis, and uncertain what data matters most or when. PRISMA, an AUD77 million agricultural Market Systems Development (MSD) programme funded by DFAT Australia, has encountered these challenges. With the programme completing its first five year phase, this case study shares ten key lessons divided into three sections: shaping the culture, developing systems, and top management decisions. These lessons aim to help program, sector and intervention managers make better use of monitoring data to improve interventions.

Making politics work for development: harnessing transparency and citizen engagement - Khemani, Stuti; Ferraz, Claudio; Finan, Frederico S.; Johnson, Stephenson; Louise, Corinne; Abrahams, Scott David; Odugbemi, Adesinaola Michael; Dal Bó, Ernesto; Thapa, Dikshya (The World Bank, 2016)
Too often, government leaders fail to adopt and implement policies that they know are necessary for sustained economic development. They are encumbered by adverse political incentives, which prevent them from selecting good policies, and they run the risk of losing office should they try to do the right thing. Even when technically sound policies are selected by leaders, implementation can run into perverse behavioral norms among public officials and citizens, who seek to extract private benefits from the public sector. Such behavior might be supported by widespread beliefs that corruption is the norm. Even countries with low corruption and strong institutions experience problems of political incentives and behavior that prevent the public sector from solving shared problems. Ideological polarization among citizens and capture by special interests can lead to policy gridlock and the failure of the state to provide public goods, even in advanced economies. Even educated citizens can hold ideological beliefs about the role of public policy that lead them to deny technical evidence contrary to these beliefs. Too often, government leaders fail to adopt and implement policies that they know are necessary for sustained economic development. Political constraints can prevent leaders from following sound technical advice, even when leaders have the best of intentions. Making Politics Work for Development: Harnessing Transparency and Citizen Engagement focuses on two forces—citizen engagement and transparency—that hold the key to solving government failures by shaping how political markets function. In today’s participative world, citizens are not only queueing at voting booths, but are also taking to the streets and using modern communication technology to select, sanction, and pressure the leaders who wield power within government. This political engagement can function in highly nuanced ways even within the same formal institutional context and across the political spectrum, from autocracies to democracies. Political engagement becomes unhealthy when leaders are selected and sanctioned on the basis of their provision of private benefits rather than public goods, giving rise to a range of government failures. The solutions to these failures lie in fostering healthy political engagement within any institutional context, and not in circumventing or suppressing it. Transparency—citizen access to publicly available information about the actions of those in government and the consequences of these actions—can play a crucial role by nourishing political engagement. The report distills policy lessons for governments, international development partners, and civil society on how best to target transparency initiatives so that the provision of public goods becomes the focus of political contestation. Even so, unhealthy political engagement may persist. But to build institutions that are capable of tackling public goods problems, politics needs to be addressed and cannot be side-stepped. Targeted transparency is one way to move in the right direction: it complements everything else policy makers do and holds the potential to make politics work for development rather than against it. " This pathbreaking report places politics at the heart of the development dialogue—exactly where it belongs. It provides constructive ideas for harnessing the forces of transparency and citizen engagement in ways that are suited to diverse institutional contexts so that reform leaders can overcome political constraints to their countries’ development goals. " Asli Demirgüç-Kunt, Director of Research, Development Research Group, The World Bank "This book not only provides an authoritative statement of what we know about how to align political incentives with the interests of society, but it does so with an eye to making change happen even in the face of political opposition. The World Bank will never be the same again. " James Robinson, University Professor, Harris School of Public Policy, University of Chicago " A lesson for us at the World Bank also comes out of this research. We can do more…to work with our clients to diminish political constraints to achieving development goals…To do this we have to overcome the fear of talking about politics, and confront it as part of the challenge of development. That is what we are doing through this report. " Kaushik Basu, Senior Vice President and Chief Economist, The World Bank

Introduction to Systems Thinking - Kim, Daniel H (Pegasus Communications, 1999)

Adaptive management of an environmental watering event to enhance native fish spawning and recruitment - King, A. J.; Ward, K. A.; O’connor, P.; Green, D.; Tonkin, Z.; Mahoney, J. (Freshwater Biology, 2010)
1. A common goal of many environmental flow regimes is to maintain and/or enhance the river’s native fish community by increasing the occurrence of successful spawning and recruitment events. However, our understanding of the flow requirements of the early life history of fish is often limited, and hence predicting their response to specific managed flow events is difficult. To overcome this uncertainty requires the use of adaptive management principles in the design, implementation, monitoring and adjustment of environmental flow regimes. 2. The Barmah-Millewa Forest, a large river red gum forest on the Murray River floodplain, south-east Australia, contains a wide variety of ephemeral and permanent aquatic habitats suitable for fish. Flow regulation of the Murray River has significantly altered the natural flood regime of the Forest. In an attempt to alleviate some of the effects of river regulation, the Forest’s water regime is highly managed using a variety of flow control structures and also receives targeted Environmental Water Allocations (EWA). In 2005, the largest environmental flow allocated to date in Australia was delivered at the Forest. 3. This study describes the adaptive management approach employed during the delivery of the 2005 EWA, which successfully achieved multiple ecological goals including enhanced native fish spawning and recruitment. Intensive monitoring of fish spawning and recruitment provided invaluable real-time and ongoing management input for optimising the delivery of environmental water to maximise ecological benefits at Barmah-Millewa Forest and other similar wetlands in the Murray-Darling Basin. 4. We discuss possible scenarios for the future application of environmental water and the need for environmental flow events and regimes to be conducted as rigorous, large-scale experiments within an adaptive management framework.
Keywords: floodplain river; regulated flows

Bradford Hill Criteria for Causal Inference - King, Julian (2015)
We think we’re good at determining causality, but we suck at it One of the great challenges in evaluation is determining whether the results we’re seeing are because of the program we’re evaluating, some other influences out there in the big world, or random chance. At one level, this is an everyday, common sense task. As a species we’ve been making judgments about causation for a million years or so. Unfortunately, though, the way we are wired does not predispose us to logical thinking. We are inclined to be led astray by all sorts of biases and heuristics. Over time, the rocket science for dealing with causation has become more sophisticated – a key example being the experimental study design or randomised controlled trial (RCT). And our evidence base about what works has been enriched as a result. But deep down we’re still biased, heuristical beings and not very good at thinking things through. We’ve become so enthusiastic about experimental designs we’re a little inclined to think they are the only way to determine whether A causes B. Such a rigid view is no much use in the real world, where there are all sorts of ethical, conceptual, practical and economic barriers that mean we can’t always conduct RCTs. Even where technically possible, they are not necessarily the best tool for every job.

Different kinds of rubrics - King, Julian (Evaluation and Value for Money, 2023)
Generic, analytic, holistic, orbic, asterisc, escalieric, cephalopodic

Evaluative reasoning in complexity - King, Julian (Evaluation and Value for Investment, 2023)

Sense-making with stakeholders and rubrics - King, Julian (Evaluation and Value for Investment, 2023)
Principles and processes

Value for Investment. A Practical Evaluation Theory - King, Julian (Kinnect Group, 2016)
I am a public policy consultant from Auckland, New Zealand. My practice specializes in evaluation and economic analysis. In this booklet I set out a model for evaluating value for investment (VFI) in social programs. The model defines VFI as an evaluative question about an economic problem. It uses explicit evaluative reasoning to provide a clear answer to the VFI question. Methods are matched to context, to provide the specific mix of evidence (economic and/or other) needed to support a wellreasoned, well-evidenced evaluative judgment.

Value for Investment: Application and Insights. Youth Primary Mental Health and Addictions Evaluation - King, Julian; Crocket, Alicia; Field, Adrian (Dovetail Consulting, 2023)
What’s in the guide? This new document provides: An overview of the VfI approach, including the conceptual principles and processes underpinning it A worked example of the approach in action: evaluating the Youth Primary Mental Health and Addictions initiative in New Zealand Transferrable learning for others considering the use of the VfI approach.

Assessing Value for Money: the Oxford Policy Management Approach - King, Julian; Daniel Wate; Esther Namukasa; Alex Hurrell; Frances Hansford; Patrick Ward; Shiva Faramarzifar (Oxford Policy Management, 2023)
This document offers practical guidance for assessing the Value for Money (VfM) of government- and donor-financed programmes and policy interventions. In line with OPM’s focus and mission, it has been predominantly applied in the international development sector, but the approach upon which it is based is also used in the context of domestic public policy and programmes.1 There is increasing scrutiny on VfM in international development, but a lack of appropriate methods to support its assessment. There is a risk of reaching invalid conclusions if VfM evaluation is tied to a narrow set of indicators devoid of any evaluative judgement—for example, by emphasising the most readily quantifiable measures rather than the most important (but harder to quantify) aspects of performance, or by focusing on the quantification of outputs and outcomes at the expense of more nuanced consideration of their quality, value, and importance. The approach presented in this guide combines theory and practice from evaluation and economics to respond to requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management. It involves developing and implementing a framework for: • organising evidence of performance and VfM; • interpreting the evidence on an agreed basis; and • presenting a clear and robust performance story. This guide sets out a framework for making and presenting judgements in a way that opens both the reasoning process and the evidence to scrutiny. The approach is designed to be used in alignment with broader monitoring, evaluation, and learning (MEL) systems—both for efficiency's sake, and to ensure conceptual coherence between VfM evaluation and wider MEL work. The VfM framework achieves these aims by: • using explicit criteria (aspects of performance) and standards (levels of performance) to provide a transparent basis for making sound judgements about performance and VfM; • combining quantitative and qualitative forms of evidence to support a richer and more nuanced understanding than can be gained from the use of indicators alone; • accommodating economic evaluation (where feasible and appropriate) without limiting the analysis to economic methods and metrics alone; and • incorporating and building on an approach to VfM evaluation which is familiar to international aid donors.

Participatory evaluation design and sense-making - making meaning through co-constructed lenses - King, Julian; Elliott, Kerry; Hollingsworth, Hilary (Evaluation and Value for Investment, 2023)
Based on a presentation at Australian Evaluation Society International Evaluation Conference, Brisbane, 28 September 2023. The importance of participatory approaches to evaluation is well-understood. Involving the right people and balancing voices at the stakeholder table can help to make evaluations more valid, credible, useful, and actually used. Not all evaluations, however, are done in participatory ways. This presentation shares the experience of three evaluators in two recent projects with clients and stakeholders who were unaccustomed to participatory evaluation. In both cases, new ways of working were introduced, requiring participants to come into the evaluation tent, collaborate and learn with us. Engagement processes deliberately focused on incrementally building deep stakeholder input into evaluation design - including key evaluation questions, context analysis, program theory, rubrics, methods of data gathering, and reporting formats. The resulting evaluation frameworks represent an agreed, shared set of lenses for making sense of the evidence. Through this process, relationships and trust were cemented, stakeholders understood the evaluation process and endorsed the resulting frameworks. The client and sector have become more interested, more engaged stakeholders and more savvy evaluation participants and consumers. As the evaluations progress, the evaluation design builds in ongoing stakeholder involvement in reviewing emergent footprints of system change and making evaluative judgements. Participatory approaches are many, varied, and flexible. We will share our reflections and generalisable learning from the participatory approaches we applied in these evaluations. We will invite the audience to reflect on their own practices and experiences, and provoke them to consider whether participatory evaluation is 'just' a methodological option or a foundational element of good evaluation.

OPM’s approach to assessing Value for Money - King, Julian; OPM (Oxford Policy Management, 2018)
This document offers practical guidance for assessing value for money (VfM) in international development programmes. Since 2016, evaluation expert Julian King has been working with OPM to develop and deploy a robust approach to VfM assessment. The approach combines cutting-edge evaluation practice with concepts from economic evaluation to respond to donor requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management.

Building Democracy from Below: Lessons from Western Uganda - King, Sophie; Hickey, Sam (The Journal of Development Studies, 2016)
How to achieve democratisation in the neo-patrimonial and agrarian environments that predominate in sub-Saharan Africa continues to present a challenge for both development theory and practice. Drawing on intensive fieldwork in Western Uganda, this paper argues that Charles Tilly’s ‘democratisation as process’ provides us with the framework required to explain the ways in which particular kinds of association can advance democratisation from below. Moving beyond the current focus on how elite-bargaining and certain associational forms may contribute to liberal forms of democracy, this approach helps identify the intermediate mechanisms involved in building democracy from below, including the significance of challenging categorical inequalities, notably through the role of producer groups, and of building trust networks, cross-class alliances and synergistic relations between civil and political society. The evidence and mode of analysis deployed here help suggest alternative routes for supporting local efforts to build democracy from below in sub-Saharan Africa.
Keywords: FRUGAL

Adaptive Programming and going with the grain: IMAGINE's new water governance model in Goma, DRC - Kirk, Tom; Green, Duncan; Stys, Patrycja; Mosquera, Tom (Development Policy Review, 2023)
Motivation This paper explores adaptive approaches to development programmes that aim at improving service provision in underperforming sectors in fragile and conflict affected states (FCAS). It does this through a case study of the Integrated Maji Infrastructure and Governance Initiative for eastern Democratic Republic of the Congo's (IMAGINE) public-private partnership model for water provision. Purpose The processes and decisions that culminated in IMAGINE's model emphasize the need for programming that is culturally and politically aware, responsive to events, learns in real-time, is entrepreneurial, and works with the grain of local institutions to support change. Detailed case studies of such ways of working are crucial for programmes that seek to challenge and reform the status quo in FCAS. Methods and approach The paper is based on 42 semi-structured interviews conducted in the summers of 2019 and 2020. They reflect the broad spectrum of actors – individuals, public authorities, and organisations – involved in IMAGINE's evolution. Findings The narrative focuses on IMAGINE's attempts to professionalise and commercialise Goma's water sector. It shows how as IMAGINE repeatedly adapted to ground realities, it took on the characteristics of a public authority, thereby, engendering backlashes that threated its longer-term goals. However, by revisiting its initial values and logics it was able to get things done and achieve it aims. Policy implications IMAGINE's story suggests that adaptive programmes should put politically savvy local development professionals in key positions and enable them to carefully construct coalitions of allies across the systems they aim to disrupt. This may also require them to revisit and adapt their initial ideas, guiding principles and values as greater understandings of development problems are gained. A pubic authorities lens, attuned to the logics programmes seek to address and introduce to FCAS, may help analysts to foreground the implications of such adaptations.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/dpr.12691

Guidelines for writing a case study on implementation (Book Project: Smart Implementation in Governance) - Kirsch, Renate (GIZ GmbH, 2015)

Transformation, politics and implementation: smart implementation in governance programs - Kirsch, Renate; Siehl, Elke; Stockmayer, Albrecht (Nomos, 2017)
Working in environments characterised by a high degree of uncertainty, uncontrollability and unpredictability, development agents try to organise complex realities into manageable units. What principles influence the decision on adequate approaches and necessary steps? Through theoretical considerations and nine case studies, the GIZ traces implementation processes and identifies underlying guiding principles which provide the flexibility and adaptability that is necessary for acting in complex contexts. Main findings show that an adaptive and reflexive management structure is crucial for successful implementation. Quick iteration and tight feedback loops facilitate adaptation and reorientation. Contextsensitive knowledge and constant monitoring create a space for learning and innovation. A joint vision for the future which is used for orientation purposes and can be modified according to new findings and developments fosters fruitful cooperation.
OCLC: 1000398466

Time for a Donor Funding Charter? - kiwanja.net (Donor's Chapter, 2014)

Lessons for Effective resilience programs: a case study of the RAIN program in Ethiopia - Kleiman, Shanti (Mercy Corps, 2013)
The RAIN program experience affirms the importance of multi-year and flexible funding as key program design features if progress in resilience building is to be supported in areas with high levels of structural and temporal vulnerability. These features enable management to respond effectively to changing circumstances in order to better meet the needs of communities and to create the necessary conditions for relief-to-development strategies to take hold. Finally, this study found that deliberate and effective coordination between donor agencies can ensure that development gains achieved during one program period are directly leveraged by subsequent programs, thereby increasing the effectiveness of resilience programs.

Improving development aid design and evaluation: Plan for sailboats, not trains - Kleinfeld, Rachel (Carnegie Endowment for International Peace, 2015)
How do reforms that require political engagement differ from traditional technical reforms? Why is political engagement different, and what are the implications for design and evaluation? How should development programmes that engage politics be designed? And how can those who fund or implement such programmes evaluate whether their efforts are contributing to reform? This report …
Keywords: IMPORTANT

Agile – where are we at? - Kniberg, Henrik (2017)

Alignment at Scale - Kniberg, Henrik (2016)

Lean from the Trenches: Managing Large-Scale Projects with Kanban - Kniberg, Henrik (Pragmatic Bookshelf, 2011)
You know the Agile and Lean development buzzwords, you've read the books. But when systems need a serious overhaul, you need to see how it works in real life, with real situations and people. Lean from the Trenches is all about actual practice. Every key point is illustrated with a photo or diagram, and anecdotes bring you inside the project as you discover why and how one organization modernized its workplace in record time.Lean from the Trenches is all about actual practice.Find out how the Swedish police combined XP, Scrum, and Kanban in a 60-person project. From start to finish, you'll see how to deliver a successful product using Lean principles. We start with an organization in desperate need of a new way of doing things and finish with a group of sixty, all working in sync to develop a scalable, complex system. You'll walk through the project step by step, from customer engagement, to the daily "cocktail party," version control, bug tracking, and release. In this honest look at what works–and what doesn't–you'll find out how to:Make quality everyone's business, not just the testers.Keep everyone moving in the same direction without micromanagement.Use simple and powerful metrics to aid in planning and process improvement.Balance between low-level feature focus and high-level system focus.You'll be ready to jump into the trenches and streamline your own development process.

Scaling Agile @ LEGO and Spotify – my talk at EA träff - Kniberg, Henrik (Crisp, 2017)

Spotify Rhythm - how we get aligned - Kniberg, Henrik (AvailAgility, 2016)
Last month, Henrik Kniberg posted slides from a talk he gave at Agile Sverige on something called Spotify Rhythm - "Spotify’s current approach to getting aligned as a company". While looking through the material, it struck me that what he was describing was a form of Strategy Deployment. This interpretation is based purely on those slides - I haven't had a chance yet to explore this more deeply with Henrik or anyone else from Spotify. I hope I will do some day, but given that caveat, here's how I currently understand the approach in terms of the X-Matrix Model.

The unofficial SCRUM checklist - Kniberg, Henrik (CRISP, 2010)

Scaling Agile @ Spotify with Tribes, Squads, Chapters & Guilds - Kniberg, Henrik; Ivarsson, Anders (Spotify, 2012)

A Whole New World - Funding and Commissioning in Complexity - Knight, Annabel Davidson; Lowe, Toby; Brossard, Marion; Wilson, Julie (Collaborate & Newcastle University, 2017)
Collaborate and Newcastle University Business School Publish Research into Complexity-Friendly Funding

Changing humanitarian action? - Knox-Clarke, Paul (ALNAP/ODI, 2017)
We live in times of profound change. This has had a great impact on humanitarian needs, and the approaches taken to meet these needs. Changes in technology, ecology, politics, economics and demographics have shaped, and will continue to shape, humanitarian action. Many humanitarians and observers of humanitarian action have suggested that change initiatives in the sector have been unambitious and unsuccessful. Indeed, many people think that the humanitarian system is unable, or unwilling, to make the changes that are required to remain effective and relevant in a rapidly changing world. Following the World Humanitarian Summit many stakeholders have made commitments to significant changes. But can the system change? And if so, how? As a network which exists to support change and improvement, it seems appropriate that ALNAP meets to consider how change occurs in the humanitarian system, and how it can be done better. Find out more about the 31st Annual Meeting by reading the concept note, or by visiting alnap.org/31am.

Foreign Aid and Its Unintended Consequences - Koch, Dirk-Jan (Routledge, 2023)
Foreign aid and international development frequently bring with it a range of unintended consequences, both negative and positive. This book delves into these consequences, providing a fresh and comprehensive guide to understanding and addressing them. The book starts by laying out a theoretical framework based on complexity thinking, before going on to explore the ten most prevalent kinds of unintended effects of foreign aid: backlash effects, conflict effects, migration and resettlement effects, price effects, marginalization effects, behavioural effects, negative spillover effects, governance effects, environmental effects, and ripple effects. Each chapter revolves around a set of concrete case studies, analysing the mechanisms underpinning the unintended effects and proposing ways in which policymakers, practitioners, and evaluators can tackle negative side effects and maximize positive side effects. The book also includes personal testimonies, a succinct overview of unintended effects, and suggestions for further reading. Providing a clear overview of what side effects to anticipate when planning, executing, and evaluating aid, this book will be an important resource for students, development practitioners, and policymakers alike.

Joint Programming in Conflict-Affected and Fragile States - Koenig, Sibylle; Brusset, Emery (Joint Programming - EU, 2019)
On the Joint Programming Practices from the EU in fragile settings

Beyond the Pioneer: Getting inclusive industries to scale - Koh, Harvey; Hedge, Nidhi; Karamchandani, Ashish (Deloitte Touche Tohmatsu India Private Ltd (DTTIPL), 2014)

Experiential Learning: Experience as the Source of Learning and Development - Kolb, David (Pearson FT Press, 2015)

Experiential Learning: Experience as the Source of Learning and Development - Kolb, David A. (Prentice Hall, 1983)
Drawing from the intellectual origins of experiential learning in the works of John Dewey, Kurt Lewin, and Jean Piaget, this comprehensive and systematic book describes the process of experiential learning. The author proposes a model of the underlying structures of the learning process based on research in psychology, philosophy, and physiology, and bases its typology of individual learning styles and corresponding structures of knowledge in different academic disciplines and careers on this structural model. He also applies experiential learning to higher education and lifelong learning, particularly with regard to adult education.

Rethinking systemic change in practice - perspectives from NUTEC-MD in northern Uganda - Koleros, Andrew (BEAM Exchange, 2016)
Document description This document is currently being finalised and will be published shortly. Please try again soon. Recent research by The BEAM Exchange seeks to understand theoretical perspectives on how market systems approaches can contribute to inclusive economic development through systemic change. It produced three main insights. Economies are evolving systems, building on the mechanisms of variety creation, selection and amplification. Current economic performance, including aspects like the inclusiveness of growth and economic evolution, are shaped by the ability of a society to explore different options for institutional arrangements and adjust them over time. This process of evolution is complex. While some aspects can be designed and managed, others need to be explored through a process of learning and adjustment. This paper responds to these insights by providing a practitioner perspective through the lens of one programme: “Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD)”, implemented by Palladium Group. It begins with a brief introduction to the programme and key aspects of its design phase. It then provides a summary of the three main research insights, with reflections on their applicability for programme design based on the NUTEC-MD experience. Finally, it provides some conclusions for the wider practitioner community based on this case.

Using Actor-Based Theories Of Change to Conduct Robust Contribution Analysis in Complex Settings - Koleros, Andrew; Mayne, John (Canadian Journal of Program Evaluation, 2019)
The use of theories of change (ToCs) is a hallmark of sound evaluation practice. As interventions have become more complex, the development of ToCs that adequately unpack this complexity has become more challenging. Equally important is the development of evaluable ToCs, necessary for conducting robust theory-based evaluation approaches such as contribution analysis (CA). This article explores one approach to tackling these challenges through the use of nested actor-based ToCs using the case of an impact evaluation of a complex police-reform program in the Democratic Republic of Congo, describing how evaluable nested actor-based ToCs were built to structure the evaluation.
Keywords: Behavioural strategy; COM-B

The Actor-Based Change Framework: A Pragmatic Approach to Developing Program Theory for Interventions in Complex Systems - Koleros, Andrew; Mulkerne, Sean; Oldenbeuving, Mark; Stein, Danielle (American Journal of Evaluation, 2020)
Despite a wide body of literature on the importance of program theory and the need to tackle complexity to improve international development programming, the use of program theory to underpin interventions aimed at facilitating change in complex systems remains a challenge for many program practitioners. The actor-based change framework offers a pragmatic approach to address these challenges, integrating concepts and frameworks drawn from complexity science and behavioral change literature to develop robust program theory for complex interventions. This article presents the conceptual framework for the approach and describes how it has been applied in practice on an evaluation of a security and justice program in Nepal. It concludes with a discussion of the strengths and weaknesses of the approach in practice and how it can be applied more widely to improve program theory for interventions in complex systems.