A leaders's guide to after-action reviews - U.S. Army (Department of the Army, 1993)
An after-action review (AAR) is a professional discussion of an event, focused on performance standards, that enables soldiers to discover for themselves what happened, why it happened, and how to sustain strengths and improve on weaknesses. It is a tool leaders and units can use to get maximum benefit from every mission or task. It provides- • Candid insights into specific soldier, leader, and unit strengths and weaknesses from various perspectives. • Feedback and insight critical to battle-focused training. • Details often lacking in evaluation reports alone. Evaluation is the basis for the commander's unit-training assessment. No commander, no matter how skilled, will see as much as the individual soldiers and leaders who actually conduct the training. Leaders can better correct deficiencies and sustain strengths by carefully evaluating and comparing soldier, leader, and unit performance against the standard. The AAR is the keystone of the evaluation process. Feedback compares the actual output of a process with the intended outcome. By focusing on the task's standards and by describing specific observations, leaders and soldiers identify strengths and weaknesses and together decide how to improve their performances. This shared learning improves task proficiency and promotes unit bonding and esprit. Squad and platoon leaders will use the information to develop input for unittraining plans. The AAR is a valid and valuable technique regardless of branch, echelon, or training task. Of course, AARs are not cure-alls for unit-training problems. Leaders must still make on-the-spot corrections and take responsibility for training their soldiers and units. However, AARs are a key part of the training process. The goal is to improve soldier, leader, and unit performance. The result is a more cohesive and proficient fighting force. Because soldiers and leaders participating in an AAR actively discover what happened and why, they learn and remember more than they would from a critique alone. A critique only gives one viewpoint and frequently provides little opportunity for discussion of events by participants. Soldier observations and comments may not be encouraged. The climate of the critique, focusing only on what is wrong, prevents candid discussion of training events and stifles learning and team building.

Managing Facilities: a stock-take from the first 12 months - Tyrrel, Lavinia; Teskey, Graham; de Lacy, Jacqui (Abt Associates, 2017)

Uncertainty and COVID-19: A turning point for Monitoring Evaluation, Research and Learning? - A discussion note for aid actors, policymakers and practitioners - Tyrrel, Lavinia; Roche, Chris; Jackson, Elisabeth (Abt Associates, 2020)
The COVID-19 pandemic has significantly shifted the context in which aid and development is being delivered. The global scale of the pandemic and the speed at which it is spreading mean that the ‘normal’ economic, ideological and organisational influences which shape (if not determine) aid delivery are in flux. This means that – for a relatively short-period – there is scope for aid actors to work collectively to embed more locally-led, politically-informed and adaptive forms of MERL in aid and development practice. These forms of Monitoring Evaluation Research and Learning (MERL) are not only well-suited to the current global pandemic. They also offer ways for aid program decision makers and practitioners to make sense of the complex and uncertain contexts in which much development work takes place. Applying locally-led, politically-informed and adaptive forms of MERL in the COVID-19 context and beyond requires a shift in mindset and approaches. Situations of complexity, in which it is difficult to predict the relationships between cause and effect, do not lend themselves to linear approaches and fixed indicators. Instead, they require ‘navigation by judgement’, ongoing learning and adaptation and greater privileging of local knowledge, and of the perspectives of those who are often excluded. Rather than being focused on upwards accountability, simple numbers and good news stories, the core function of MERL in this context is to support a better understanding – in real-time – of the changing operating context, to generate learning about the immediate impact of policy and program responses and their longer-term effects, and to inform decision making by front line staff. Whether the opportunities afforded by this ‘critical juncture’ are realised will depend on the degree to which those in the aid and development sector use this opportunity to promote a shift in the deep incentive structures within which development agencies are embedded. On the one hand, the pandemic underscores the limits of the linear understandings of change which underpin many orthodox approaches to planning, design and associated MERL. On the other hand, there is a vested interest in the status quo amongst many organisations, consultants, researchers and MERL practitioners. This is because approaches which promote locally-led development inevitably require those in power to relinquish control. While a range of factors make this shift difficult, there is more scope to change internal ways of working in development agencies than is commonly acknowledged. There is no time like the present to advocate for a ‘new normal’ for MERL.

Dealing with uncertainty: Reflections on donor preferences for pre-planned project models - Tyrrel, Lavinia; Cole, William (2016)
Keywords: IMPORTANT

Getting Past the Rhetoric #1: Tendering for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

Getting Past the Rhetoric #2: Managing for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

What's in a name? Unpacking “participatory” environmental monitoring - Turreira-García, Nerea; Lund, Jens; Domínguez, Pablo; Carrillo-Anglés, Elena; Brummer, Mathias; Duenn, Priya; Reyes-García, Victoria (Ecology and Society, 2018)
Turreira-García, N., J. F. Lund, P. Domínguez, E. Carrillo-Anglés, M. C. Brummer, P. Duenn, and V. Reyes-García. 2018. What's in a name? Unpacking “participatory” environmental monitoring. Ecology and Society 23(2):24. https://doi.org/10.5751/ES-10144-230224

Doing weeknotes - What weeknotes are, how weeknotes work, and how to start writing weeknotes of your own - Turnbull, Giles (Use the Human Voice, 2024)
Doing weeknotes brings together various things I’ve written about weeknotes in different places. This text expands on things I wrote in The agile comms handbook, as well as various blog posts. Quite a lot of it is brand new. - Weeknotes for beginners - Why write weeknotes - The weeknotes rules - Weeknotes within the corporate environment - What weeknotes can bring about - Examples of good weeknotes - How to write weeknotes - Weeknotes tips and tricks - Further reading

What does ‘adaptive programming’ mean in the health sector? - Tulloch, Olivia (ODI, 2015)
• There is considerable interest in the concept of adaptive development and what it may look like in different sectors, including health. • Adaptive types of programming from the health sector are relatively advanced; as we work towards the Sustainable Development Goals (SDGs), experiences in health can provide useful lessons for other areas of development. • The international health community may not use the label ‘adaptive development’, but many are already conducting adaptive work. ‘Quality improvement’ is one such tried and tested approach. • Quality improvement is problem-driven, iterative and flexible. The methodology and principles can be used to identify, test and implement changes in any context or part of a health system. • Quality improvement is being used successfully, but there is still limited experience and evidence of how to apply its values and philosophy beyond the project level and embed it within national structures and systems. • Systems thinking and analysis of the political economy environment may help embed complex interventions like quality improvement and sustain their achievements

Exploring the prospects for adaptive governance in marine transboundary conservation in East Africa - Tuda, Arthur Omondi; Kark, Salit; Newton, Alice (Marine Policy, 2019)
This article explores the prospects for adaptive governance in a proposed marine transboundary conservation initiative in East Africa. Adaptive governance that involves interdependent state and non-state actors learning and taking action on joint environmental problems is suggested for effective transboundary resource governance. Using the concept of adaptive co-management, the current multi-stakeholder marine governance systems in southern Kenya and northern Tanzania are compared to illuminate opportunities and constraints for adaptive marine transboundary conservation governance between Kenya and Tanzania. The concept of networks and the formal method of social network analysis (SNA) are applied as the main methodological device. Using questionnaire and semi-structured interviews, social network data of 70 organizations (local resources users, government agencies and NGOs) was generated from Kenya (n = 33) and Tanzania (n = 37). Results show the existence of strong collaboration networks for marine resource governance in both Kenya and Tanzania. Social proximity is the common driver of network formation. Collaboration networks in Kenya and Tanzania have contributed to enhanced learning among marine resource managers. Conclusions point to the need to focus on common challenges relating to low levels of rule-compliance, limited access to information on the state of resources and poor integration of science into marine management decisions. Finally, differences in views regarding the state of marine ecosystems need to be addressed to improve prospects for joint problem-solving in marine transboundary conservation.
Keywords: Adaptive co-management; Adaptive governance; Collaboration; Marine transboundary conservation; Social network analysis

The Role of Outcome Mapping in Developing a Rural Telemedicine System - Tucker, William; Blake, Edwin (University of the Western Cape, 2008)
We describe the use of Outcome Mapping to guide the design of a rural telemedicine consultation system in South Africa. While Outcome Mapping was not primarily intended to guide design, we show that it tied in well with a cyclical participatory design method for an Information and Communication Technology for Development project

Monitoring and evaluation of policy influence and advocacy - Tsui, Josephine; Hearn, Simon; Young, John (ODI, 2014)
Policy influence and advocacy are increasingly regarded as a means of creating sustainable policy change in international development. It is often also seen as a difficult area to monitor and evaluate. Yet there is an increasingly rich strand of innovation in options to monitor, evaluate and learn from both the successes and failures of policy influence and advocacy interventions. This paper explores current trends in monitoring and evaluating policy influence and advocacy; discusses different theories of how policy influence happens; and presents a number of options to monitor and evaluate different aspects of advocacy interventions. Case studies describe how some organisations have used these options in practice to understand their impact and improve their advocacy strategies.

Monitoring, Evaluation and Learning approaches in an adaptive management context - Tsui, Josephine (EPS PEAKS, ODI, 2016)

Micropolitics in collective learning spaces for adaptive decision making - Tschakert, Petra; Das, Partha Jyoti; Shrestha Pradhan, Neera; Machado, Mario; Lamadrid, Armando; Buragohain, Mandira; Hazarika, Masfique Alam (Global Environmental Change, 2016)
Recent advances on power, politics, and pathways in climate change adaptation aim to re-frame decision-making processes from development-as-usual to openings for transformational adaptation. This paper offers empirical insights regarding decision-making politics in the context of collective learning through participatory scenario building and flexible flood management and planning in the Eastern Brahmaputra Basin of Assam, India. By foregrounding intergroup and intragroup power dynamics in such collective learning spaces and how they intersect with existing micropolitics of adaptation on the ground, we examine opportunities for and limitations to challenging entrenched authority and subjectivities. Our results suggest that emancipatory agency can indeed emerge but is likely to be fluid and multifaceted. Community actors who are best positioned to resist higher-level domination may well be imbricated in oppression at home. While participatory co-learning as embraced here might open some spaces for transformation, others close down or remain shut.
Keywords: Co-learning; Flood management; Participatory scenarios; Politics of adaptation; Power

Outcome mapping for health system integration - Tsasis, Peter; Evans, Jenna; Forrest, David; Jones, Richard Keith (Journal of Multidisciplinary Healthcare, 2013)
Health systems around the world are implementing integrated care strategies to improve quality, reduce or maintain costs, and improve the patient experience. Yet few practical tools exist to aid leaders and managers in building the prerequisites to integrated care, namely a shared vision, clear roles and responsibilities, and a common understanding of how the vision will be realized. Outcome mapping may facilitate stakeholder alignment on the vision, roles, and processes of integrated care delivery via participative and focused dialogue among diverse stakeholders on desired outcomes and enabling actions. In this paper, we describe an outcome-mapping exercise we conducted at a Local Health Integration Network in Ontario, Canada, using consensus development conferences. Our preliminary findings suggest that outcome mapping may help stakeholders make sense of a complex system and foster collaborative capital, a resource that can support information sharing, trust, and coordinated change toward integration across organizational and professional boundaries. Drawing from the theoretical perspectives of complex adaptive systems and collaborative capital, we also outline recommendations for future outcome-mapping exercises. In particular, we emphasize the potential for outcome mapping to be used as a tool not only for identifying and linking strategic outcomes and actions, but also for studying the boundaries, gaps, and ties that characterize social networks across the continuum of care.

What is the Outcomes Star? - Triangle (Triangle, 2022)
The Outcomes Stars are a suite of evidence-based outcomes measurement and keywork tools, which drive an ‘enabling help’ approach to service delivery. They support a person-centred, collaborative and trauma informed approach and give service users, workers, managers and commissioners vital information about needs and progress. Since the first version was published in 2006, the unique features of the Outcomes Star contributed to its popularity and widespread use, with over 1,000 organisations with licenses to use the Star including over 500 charities and 170 local authorities

A Rubric to Evaluate Citizen-Science Programs for Long-Term Ecological Monitoring - Tredick, Catherine A.; Lewison, Rebecca L.; Deutschman, Douglas H.; Hunt, Timothy ANN; Gordon, Karen L.; Von Hendy, Phoenix (BioScience, 2017)
Abstract. Citizen-science (CS) programs provide a cost-effective way to collect monitoring data over large temporal and spatial scales. Despite the recent prol

Theory-Based Approaches to Evaluation: Concepts and Practices - Treasury Board of Canada Secretariat (Government of Canada, 2021)
This document introduces some of the key concepts of theory-based approaches to evaluation. It is hoped that readers will be encouraged by the information and advice provided in this document and will explore the use (e.g., through pilot evaluations) of theory-based approaches to evaluation in a federal setting. To support this, Sections 1.0 to 8.0 of the document describe the general application of theory-based approaches to evaluation, and Sections 9.0 and 10.0 discuss the potential application of theory-based approaches to a range of federal programs. This document is neither an exhaustive training program in theory-based evaluation nor a step-by-step guide to undertaking a theory-based evaluation. Evaluators who wish to integrate theory-based approaches into their practices are encouraged to pursue additional readings (including those referenced in this document) and, as appropriate, to seek additional support in undertaking a theory-based evaluation.
Last Modified: 2021-03-22

Integrating farmers’ adaptive knowledge into flood management and adaptation policies in the Vietnamese Mekong Delta: A social learning perspective - Tran, Thong Anh; Rodela, Romina (Global Environmental Change, 2019)
Flood management and adaptation are important elements in sustaining farming production in the Vietnamese Mekong Delta (VMD). While over the past decades hydraulic development introduced by the central government has substantially benefited the rural economy, it has simultaneously caused multiple barriers to rural adaptation. We investigate the relational practices (i.e., learning interactions) taking place within and across the flood management and adaptation boundaries from the perspective of social learning. We explore whether and how adaptive knowledge (i.e., experimental and experiential knowledge) derived from farmers’ everyday adaptation practices contributes to local flood management and adaptation policies in the selected areas. We collected data through nine focus groups with farmers and thirty-three interviews with government officials, environmental scientists, and farmers. Qualitative analysis suggests that such processes are largely shaped by the institutional context where the boundary is embedded. This study found that while the highly bureaucratic operation of flood management creates constraints for feedback, the more informal arrangements set in place at the local level provide flexible platforms conducive to open communication, collaborative learning, and exchange of knowledge among the different actors. This study highlights the pivotal role of shadow systems that provide space for establishing and maintaining informal interactions and relationships between social actors (e.g., interactions between farmers and extension officials) in stimulating and influencing, from the bottom-up, the emergence of adaptive knowledge about flood management and adaptation in a local context.
Keywords: Adaptation; Flood management; Knowledge brokers; Mekong Delta; Shadow systems; Social learning; Vietnamese

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research - Torrance, Harry (Journal of Mixed Methods Research, 2012)
Over the past 10 years or so the “Field” of “Mixed Methods Research” (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings by generating and comparing different sorts of data, and different respondents’ perspectives, on the topic under investigation. Respondent validation has sometimes been included in such processes, but it is an element that has not attracted significant attention from the MMR community. The article argues that attention to respondent validation is a significant issue for methodological debate and that it should be an important aspect of the development of democratic participation in MMR.

Designing Participatory Meetings and Brownbags: A TOPS Quick Guide to Linking Development Practitioners - TOPS (Technical and Operational Performance Support Program, USAID, 2013)
Visit this resource for ideas on designing meetings and brownbags that are engaging and build inopportunities for participant dialogue.

Information and Communications Technology for Development (ICT4D)-A design challenge? - Tongia, Rahul; Subrahmanian, Eswaran (2006 International Conference on Information and Communication Technologies and Development, 2006)
Keywords: IMPORTANT

Development Policy and Impact Evaluation: Learning and Accountability in Private Sector Development - Ton, Giel (Handbook of Development Policy, 2021)
There is broad recognition of the challenges in evaluating policy and programmes on their contribution to sustainable development. Impact evaluations of PSD programmes are carried out at the behest of a particular configuration of interest groups with different expectations. Some groups want to know whether a programme has worked, others want to know how to do these programmes better, others fear that PSD programmes might result in sub-optimal or adverse development outcomes in recipient countries, and some want to be sure that the programme benefits the private sector in the donors' domestic economies. This chapter discusses these with reference to private sector development programmes and explores how contribution analysis, which is a structured stepwise process of theory-based evaluation, can address these challenges and generate findings to improve learning and accountability.
Accepted: 2021-11-05T12:43:15Z Journal Abbreviation: Chapter 33: Development policy and impact evaluation: learning and accountability in private sector development

Nairobi Is Organizing- Grassroots Organizing &Public Participation for Social Change - TISA (2015)
The Institute for Social Accountability

Doing adaptive management at Sida - Tim Ruffer; Helen Bailey; Stefan Dahlgren; Patrick Spaven; Mark Winters (SIDA, 2019)
Lessons from the market systems development approach The evaluation focuses on Sida’s management of MSD projects. The projects are applying the MSD approach with an aim to: - contribute to improved MSD programming by Sida through better management practices across the project cycle - generate recommendations on how Sida can create conducive conditions for systems approaches and adaptive programming more generally. The brief assesses Sida’s organisational capacity for adaptive management in three dimensions: - leadership and culture - staff capacities - skills, and systems and procedures

What We Know About Traditional MERL Tech - Insights from a Scoping Review - Tilton, Zach; Harnar, Michael; Raftree, Linda; Perrin, Paul; Bruening, Gretchen; Banerji, Soham; Gordley, John; Foster, Hanna; Behr, Michele (Western Michigan University, 2020)
This paper explores the peer-reviewed evidence base of “traditional” technology-enabled monitoring, evaluation, research, and learning (MERL Tech) in international development assistance from 2015 to 2019. The authors conducted a scoping review that searched seven databases, screened 3,054 reference titles and abstracts, coded 886 abstracts, and extracted and analyzed conclusions and recommendations from the full texts of 256 studies. The findings reveal the most frequently reported technologies, MERL activities, and the sub-sectors, and the geographies where those tech-enabled activities occur. Gaps in the evidence for specific technologies, MERL activities, and sectors are mapped. The data reveals which technologies are trusted more than others and reported barriers to effective MERL Tech implementation and areas that researchers suggest for further investigation. The results suggest that the evidence from peer-reviewed studies is not proportional to estimated MERL Tech activity, significant publication bias exists, and further knowledge synthesis of unindexed grey literature is needed to provide a more comprehensive and possibly accurate description of MERL Tech practice.

A flowering of approaches to complexity and development? - Thorpe, Ian (KM on a dollar a day, 2015)
We are an important juncture in development at the moment with the Sustainable Development Goals due to be finalized later this year, and with discussion now turning full swing into what needs to h…

Finding out fast: investigative skills for policy and development - Thomas, Alan; Chataway, Joanna; Wuyts, Marc (Sage, 1998)

Horizontal Evaluation: Stimulating social learning among peers - Thiele, G; velasco, C; Manrique, K (2006)
Horizontal evaluation is a flexible evaluation method that combines self-assessment and external review by peers. We have developed and applied this method for use within an Andean regional network that develops new methodologies for research and development (R&D). The involvement of peers neutralizes the lopsided power relations that prevail in traditional external evaluations, creating a more favourable atmosphere for learning and improvement. The central element of a horizontal evaluation is a workshop that brings together a group of ‘local participants’ who are developing a new R&D methodology and a group of ‘visitors’ or ‘peers’ who are also interested in the methodology. The workshop combines presentations about the methodology with field visits, small group work and plenary discussions. It elicits and compares the perceptions of the two groups concerning the strengths and weaknesses of the methodology; it provides practical suggestions for improvement, which may often be put to use immediately; it promotes social learning among the different groups involved; and it stimulates further experimentation with and development of the methodology in other settings.

Storytelling for Systems Change: insights from the field - Thea Snow; David Murikumthara; Teya Dusseldorp; Rachel Fyfe; Lila Wolff; Jane McCracken (Centre for Public Impact, 2022)
Capturing the impact of community-led work The Centre for Public Impact, Dusseldorp Forum, and Hands Up Mallee have been exploring how stories can be used to more effectively communicate the impact of community-led systems change work. Community-led place based initiatives are modelling new ways of working - shifting away from top down, program-focussed approaches towards an approach grounded in systems thinking and community-led innovations. However, while these stories of change are sitting in communities, they’re often not being told or celebrated. We wanted to understand why this is, and what might be done to better enable these stories to be shared and heard. The story of storytelling We talked to a range of people to uncover the story of storytelling - including collective impact backbone team members, community members, storytelling experts, and those working in and around community-led systems change initiatives across Australia. We explored the roles stories play in different communities; what good storytelling looks like; what barriers to storytelling might be; and what role stories can play in supporting systems change. Our findings We have learned through this project that stories can be used both to change the system and to evaluate, understand and showcase the change that is occurring in communities. We have heard that different stories require different approaches – stories that are seeking to enable change look different to those that are seeking to celebrate change.

The Operational Guide - for the making markets work for the poor (M4P) approach (Second Edition) - The Springfield Centre (SDC & DFID, 2015)
In 2008, SDC and DFID published three documents aimed at improving the understanding and use of the Making Markets Work for the Poor (M4P) approach: the M4P Synthesis, M4P Perspectives and M4P Operational Guide. Since then the field has grown, diversified and, importantly, learned much more. A second edition was commissioned to capture that learning, maintain the momentum and realise the ambition that development can still 'do better'. The second edition provides an accessible resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide effective intervention in – and development of – market systems. It addresses common challenges with examples of good practice based on practitioner experience. Who is it for? The Operational Guide is for people whose job entails trying to make market systems work better for poor women and men. These people include: Individuals currently involved in funding or implementing the approach. Development agencies wishing to incorporate market systems thinking and practice in their work. National stakeholders that wish to play a more strategic and catalytic role within market systems. What is new? Application, application, application! Whilst the key principles and frameworks will be familiar, the advice on their operational application – from start to finish – has been significantly bolstered Enhanced guidance on facilitation. Greater emphasis on what constitutes good facilitation practice, building on a wealth of practitioner experience More real-life examples. The Operational Guide is laced with examples from programmes past and present, working in a diverse array of systems Peer learning focus. Direct insights from practitioners, highlighting 'bumps in the road' and how to avoid them. The Guide aims to provide an accessible operational resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide the process of effective intervention in – and development of – market systems, addressing common challenges with examples of good practice based on practitioner experience. HOW SHOULD IT BE USED? The Guide explores, sequentially, the key elements of the implementation process: strategy, diagnosis, vision, intervention, measurement and management. It is not intended to be read from cover to cover; readers can go directly to the chapter most relevant to their needs without having read preceding chapters. However each chapter does build upon the preceding one and may refer to other chapters. THE GUIDE IS STRUCTURED AS FOLLOWS: INTRODUCTION Overview of the objectives, structure and format of the Guide CONTEXT A reminder of what market systems development means 1. STRATEGY Core principles and framework for setting programme strategy 2. DIAGNOSIS Core principles and framework for diagnosing system constraints 3. VISION Core principles and frameworks for defining and planning intervention 4. INTERVENTION Core principles and framework to guide effective intervention 5. MEASUREMENT Core principles and framework for measuring results 6. MANAGEMENT Key considerations in managing market systems development programmes GLOSSARY Definition of key terms used in market systems development

Organisational Performance Index - The Kenya Institute of Management (2014)
The OPI Business Excellence Model exists to help organizations improve their performance and succeed in the competitive global marketplace. We are dedicated to improving African organizations regardless of sector, size or structure. The OPI was developed in response to feedback from organization participating in Company of the Year Award (COYA) and SME of the Year Award (SMOYA), who called on the Kenya Institute of Management (KIM) to refine the assessment methodology in order to emphasize the relationship between instilling smart business processes and generating strong business results. Whilst there are numerous management tools and techniques commonly used, the OPI Excellence Model is a practical, non-prescriptive framework which provides a holistic view of the organisation and it can be used to determine how these different methods fit together and complement each other. The Model can therefore be used in conjunction with any number of these tools, based on the needs and function of the organisation, as an overarching framework for developing sustainable excellence. We also administer the Annual Company of the Year Awards (COYA) and the SME of the Year Awards (SMOYA). Our key services are to identify and recognize role-model organizations, share best management practices, and help organizations achieve best-in-class performance levels. The OPI is an excellence model that generates a rating between 1 and 10, which sets a minimum score that an organisation must attain to remain competitive. The attainment of a minimum Organisation Performance Index ( OPI) demonstrates that organisations have applied an organisational strategy that drives effectiveness and competitiveness; failure to attain the minimum OPI demonstrates the organisation has not engaged the processes required to enable world class organisational performance.

Assessing the use of technological tools and strategies by Oxfam Novib partners in Angola, Burundi, Egypt, Niger, Pakistan, Rwanda and Uganda - The Engine Room (2014)
This report presents findings and insights from the Oxfam Novib pilot module of TechScape, which assessed how Oxfam Novib partners in seven countries related to the use of technology in their work. This report does not aim to draw conclusions about the nature of technology use by Oxfam Novib partners per se, or even the partners included in this assessment. The dramatic difference in organizational activities, contexts and objectives are too great for that. Detailed analysis of how partners are relating to technology in their work, and specific recommendations for greater efficiency and impact are presented in the TechScape Country Briefs. This report aims instead: • to describe the context in which the assessments took place, • to propose insights gained from the cumulative process about measurement, learning and capacity development, and • to identify opportunities for Oxfam Novib to pursue capacity development and knowledge sharing between countries and across the network, through mechanisms that minimize resource demands and directly target documented needs.

Primer: Technology to monitor and share information on rainforests and forest people's rights - The Engine Room (The Engine Room & Rainforest Foundation Norway, 2016)

The fashion for agile management is spreading - The Economist (The Economist, 2018)
Executives need to be a cross between Spider-Man and Simone Biles

Participation in ICT Development Interventions: Who and How? - Thapa, Devinder; Sæbø, Øystein (The Electronic Journal of Information Systems in Developing Countries, 2016)
The aim of participatory development (PD) in the context of using Information and Communication Technologies (ICT) for development (ICT4D) is to empower underprivileged communities and disadvantaged segments of the stakeholders. The literature on ICT4D is replete with empirical evidence showing that ICT interventions often fail since they are often externally initiated, with very limited involvement from the affected (Heeks, 2002). Clearly, the principles and concepts of PD are relevant to ICT4D. However, we should not consider PD a panacea but need to understand the caveats and processes by which PD happens. Questions to ask include: What are the various challenges in PD? Who are the relevant stakeholders? Why and how do actors enrol in the project? How do we create sustainable ICT4D projects through PD? To understand these research questions, we present a case analysis of a project in Nepal called the Nepal Wireless Networking Project (NWNP). Investigating the specific initiatives that they enabled, telemedicine, education and jobs, we propose that the key participants in the NWNP were activist actors and the affected and that activists drew upon existing Social Capital to enrol the affected through a process explained by Actor Network Theory (ANT). In the process, they built other forms of Social Capital, which in turn extended the benefits of PD to several mountain villages.

Towards characterizing the adaptive capacity of farmer-managed irrigation systems: learnings from Nepal - Thapa, Bhuwan; Scott, Christopher; Wester, Philippus; Varady, Robert (Environmental change assessments, 2016)
Small-scale irrigation systems managed by farmers are facing multiple challenges including competing water demand, climatic variability and change, and socioeconomic transformation. Though the relevant institutions for irrigation management have developed coping and adaptation mechanisms, the intensity and frequency of the changes have weakened their institutional adaptive capacity. Using case examples mostly from Nepal, this paper studies the interconnections between seven key dimensions of adaptive capacity: the five capitals (human, financial, natural, social, and physical), governance, and learning. Long-term adaptation requires harnessing the synergies and tradeoffs between generic adaptive capacity that fosters broader development goals and specific adaptive capacity that strengthens climate-risk management. Measuring and addressing the interrelations among the seven adaptive-capacity dimensions aids in strengthening the long term sustainability of farmer-managed irrigation systems.

Thinking and working politically with technology: State of the art meets art of the state - Thampi, Gopa; Nixon, Nicola (From Poverty to Power, 2020)
Based on its work in Sri Lanka, The Asia Foundation argues for greater attention to the local political dynamics into which digital solutions are introduced

Implementing adaptive management: A front-line effort — Is there an emerging practice? - Teskey, Graham; Tyrrel, Lavinia (Abt Associates, 2021)
Among the many principles that currently inform donor-funded development initiatives, three appear to stand out: they should be politically informed, locally led, and adaptive. There is as yet little practical guidance for aid implementers regarding how to operationalise these approaches. What will it take to shift practice away from linear and planned approaches, towards models which foster local leadership and which engage with emergent and complex systems? This paper suggests that the answer is not to throw out the discipline of the logical framework, results frameworks, or theories of change. Rather they need to be handled rather more reflectively and ‘elastically’. The purpose of this paper is to set out how this can be achieved, and to propose 15 tools for donors, implementors and front-line staff to apply adaptive management (AM) in practice, at critical stages of the project cycle and within the dominant aid paradigm. This is what we are calling PILLAR: politically informed, locally led and adaptive responses. We are framing PILLAR to cover the full project cycle (design, implementation and review), hence the nomenclature of an ‘end to end’ approach. Our hope is that these tools will eventually replace the current planned, log-frame driven and top-down approach to aid design and delivery which dominates the development sector.

Thinking and working politically in large, multi-sector Facilities: lessons to date - Teskey, Graham; Tyrrel, Lavinia (Abt Associates, 2017)

Adaptive management: why we find it so hard to operationalise - Teskey, Graham (Abt Associates - Governance Soapbox, 2018)

Implementing the new development agenda - Wrap up - Teskey, Graham (2017)

In praise of... Logframes - Teskey, Graham (From Poverty to Power, 2021)
In all the jobs I have held, the only training that has ever stayed with me was a three-day course on logframes, held in a very pleasant beach hotel on Fiji’s beautiful coral coast. This was a few months after I joined what was then the Overseas Development Administration, DFID’s forerunner. Three days on logframes. Yes really. Our Pacific team were gathered together to learn this new skill. The course was designed not only to help us think rigorously about how change happens, but also to ensure that we had a shared understanding of what constitutes good design. Twenty-five years later I am aware that logframes are out of fashion: references to the ‘tyranny of the logframe’ abound, its vertical determinism, and its lack of flexibility. Donors seem to have replaced logframes with things called ‘Program Logics’, as in the schematic below. You don’t have to be able to read it to get the picture… (and it’s logframes that are supposed to be too vertical…?).

Thinking and Working Politically – Are We Seeing the Emergence of a Second Orthodoxy? - Teskey, Graham (Abt Associates, 2017)
There now is a persuasive volume of evidence that demonstrates that capacity and technical knowledge alone are insufficient to change deeply entrenched political interests and bureaucratic norms. These critiques demonstrate that an understanding of power asymmetries is frequently the critical missing ingredient in project design and implementation. Many eminent thinkers have looked at the difference between success and failure in development, and all point to the primacy of domestic politics. This point has not been lost on development agencies and some have tried to provoke greater attention to the role that politics plays. However, this recognition is yet to pass into the mainstream of development practice. Despite the slow but sure accretion of this knowledge the international community seems to be wedded to doing development traditionally. The purpose of this paper is to consider the extent to which a ‘second orthodoxy’ is slowly emerging which can stand alongside, and in some cases may supplant, the ‘first orthodoxy’ of the traditional project framework. Care has to be taken in making this argument, as there is certainly no consensus within the development community on its importance, and even among advocates, there are slightly differing interpretations of what this second orthodoxy looks like. Further, it is not absolutely clear that the two orthodoxies can co-exist. The paper does not call for any ‘paradigm shift’ in how development practitioners conceptualise programs and projects, nor does it demand that the project framework be scrapped; the former would be impossible and the latter undesirable. Equally readers will find no claims that Doing Development Differently or ‘Thinking and Working Politically’ will always and everywhere guarantee better development outcomes. Rather, the paper seeks to summarise how the two orthodoxies differ, where the second orthodoxy now stands, and propose how it can be taken forward in practical terms.

Thinking and working politically: What have we learned since 2013 - Teskey, Graham (TWP Community of Practice, 2021)
The Thinking and Working Politically (TWP) Community of Practice (CoP) was established at a small meeting tacked on at the end of a meeting of Governance Advisers working for the United Kingdom’s Department of International Development (DFID) on South and South-East Asian countries, held in Delhi in November 2013. Since then, a number of meetings have been held throughout the world, each addressing different issues; ‘TWP’ has entered the lexicon of mainstream development; the CoP has expanded to more than 300 people; a Washington DC chapter has been established; and the International CoP has been granted modest funding from DFID’s successor, the Foreign, Commonwealth and Development Office (FCDO) and from Australia’s Department of Foreign Affairs and Trade (DFAT). It is legitimate to ask, however, what has been achieved operationally: how have the ideas underpinning TWP affected operational practice? This short paper traces the evolution of the idea and practice of TWP from 2013 to late 2021, and identifies what we have learned. What has been successful, and what has not? I asked in 2017 whether TWP had become a second orthodoxy (Teskey, 2017). Did this represent hubris or was 2017 in some ways the apogee of what might rather grandly be called the TWP ‘movement’?

What is Political Economy Analysis (PEA) and why does it matter in development? - Teskey, Graham (From Poverty to Power, 2020)
Graham Teskey shares a great internal links round up and guide to 'political economy analysis'

2015 Rhode Island Wildlife Action Plan - Chapter 5 Monitoring and Adaptive Management - Terwilliger Consulting (State of Rhode Island, 2015)

Inside Foreign Aid - Tendler, Judith (The Johns Hopkins University Press, 1975)
A classic, important study in the anthropology of development, grounded in the author's own work within USAID, and analysis of the organizational and institutional pressures that constrain and shape development agency employees' cognition and action.
Keywords: IMPORTANT

Measuring Results & the DCED Standard - Tanburn, Jim (2014)
This page gives an introduction to the DCED Standard, which is a framework that helps practitioners to measure results in Private Sector Development (PSD).

Evaluating Community Impact: Capturing and Making Sense of Community Outcomes - Tamarack Institute (2017)

Developmental Evaluation - Tamarack Community (2012)
This webpage from Tamarack Community provides links to audio files of an interview between Mark Cabaj and Michael Patton in which they discuss the topic of development evaluation. This is an "approach that has proven particularly useful and effective at addressing the unique challenges of evaluating the real nature of community change work. Learning Objectives: To deepen appreciation for the role of evaluation and evaluation thinking To explore the distinctions between various types of evaluation To understand more about developmental evaluation and its use To investigate concepts, tools and resources available to support working with developmental evaluation methods" (Tamarack Community)

The New New Product Development Game - Takeuchi, Hirotaka; Nonaka, Ikujiro (Harvard Business Review, 1986)
In today’s fast-paced, fiercely competitive world of commercial new product development, speed and flexibility are essential. Companies are increasingly realizing that the old, sequential approach to developing new products simply won’t get the job done. Instead, companies in Japan and the United States are using a holistic method—as in rugby, the ball gets passed within […]

Beyond Ballotocracy: Citizens' Voices and the Many Faces of Unruly Politics - Tadros, Mariz (IDS Bulletin, 2014)

Black Box Thinking: The Surprising Truth About Success - Syed, Matthew (Hachette UK, 2015)
The Sunday Times No.1 Bestseller From the Bestselling Author of BounceWhat links the Mercedes Formula One team with Google?What links Team Sky and the aviation industry?What connects James Dyson and David Beckham?They are all Black Box Thinkers.Black Box Thinking is a new approach to high performance, a means of finding an edge in a complex and fast-changing world. It is not just about sport, but has powerful implications for business and politics, as well as for parents and students. In other words, all of us.Drawing on a dizzying array of case studies and real-world examples, together with cutting-edge research on marginal gains, creativity and grit, Matthew Syed tells the inside story of how success really happens - and how we cannot grow unless we are prepared to learn from our mistakes.
Google-Books-ID: f1eNBQAAQBAJ
Keywords: Psychology; Sports & Recreation / Sports Psychology; Strategic Planning

Tips on Learning from Context: Formal and Informal Approaches to Understanding the Local Political Economy - Swift, Sarah (USAID, 2018)
Successfully adapting your programmatic efforts and policy engagement to the context depends on maintaining your understanding of that context. Given this, continuous learning and feedback loops–not only about your programming, but also about the environment you are working within–are important components of USAID’s work. Since our environments are always changing, in ways big and small, this can be intimidating. One can imagine a scenario where learning consumes the limited time and budgets available, especially for small programs. The question becomes: How can we learn enough, at the right times, to limit missed opportunities and warning signs, while avoiding being consumed by data collection and analysis that never influences our work? This document capitalizes on the experiences of USAID staff as well as emerging learning from other donors and researchers to highlight a range of approaches–formal and informal, time-bound and continuous–that can support ongoing learning within the operational tempo of a busy Mission team or Operating Unit.

Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective - Sweetman, Roger; Conboy, Kieran (Project Management Journal, 2018)
While agile approaches can be extremely effective at a project level, they can impose significant complexity and a need for adaptiveness at the project portfolio level. While this has proven to be highly problematic, there is little research on how to manage a set of agile projects at the project portfolio level. What limited research that does exist often assumes that portfolio-level agility can be achieved by simply scaling project level agile approaches such as Scrum. This study uses a complex adaptive systems lens, focusing specifically on the properties of projects as agents in a complex adaptive portfolio to critically appraise current thinking on portfolio management in an agile context. We then draw on a set of 30 expert interviews to develop 16 complex adaptive systems (CAS)-based propositions as to how portfolios of agile projects can be managed effectively. We also outline an agenda for future research and discuss the differences between a CAS-based approach to portfolio management and traditional approaches.

Creating adaptive policies: a guide for policymaking in an uncertain world - Swanson, Darren; Bhadwal, Suruchi (IDRC, 2009)
OCLC: ocn421532510
Keywords: Adaptive natural resource management; Environmental policy; Government policy; Sustainable development

Integrating Food Security and Wild Caught Fisheries Management in USAID Programming. Illustrative situation Model and Results Chain - Swaminathan, Vinaya; Best, Barbara; Ajroud, Brittany (USAID, 2018)
Integrating Food Security and Wild Caught Fisheries Management in USAID Programming is an illustrative case example that demonstrates how two adaptive management programming tools—situation models and results chains—can help USAID staff and its partners to better design and implement activities that integrate food security, nutrition, and sustainable management of wild fisheries.

SCRUM Development Process - Sutherland, Jeffrey (Business object design and implementation: OOPSLA '95 workshop proceedings, 1995)
OCLC: 845294232
Keywords: Computer security Congresses; Softwareentwicklung

Scrum: The Art of Doing Twice the Work in Half the Time - Sutherland, Jeff (Crown Business, 2014)
We live in a world that is broken. For those who believe that there must be a more agile and efficient way for people to get things done, here from Scrum pioneer Jeff Sutherland is a brilliantly discursive, thought-provoking book about the leadership and management process that is changing the way we live. In the future, historians may look back on human progress and draw a sharp line designating "before Scrum" and "after Scrum." Scrum is that ground-breaking. It already drives most of the world's top technology companies. And now it's starting to spread to every domain where leaders wrestle with complex projects. If you've ever been startled by how fast the world is changing, Scrum is one of the reasons why. Productivity gains of as much as 1200% have been recorded, and there's no more lucid - or compelling - explainer of Scrum and its bright promise than Jeff Sutherland, the man who put together the first Scrum team more than twenty years ago. The thorny problem Jeff began tackling back then boils down to this: people are spectacularly bad at doing things with agility and efficiency. Best laid plans go up in smoke. Teams often work at cross purposes to each other. And when the pressure rises, unhappiness soars. Drawing on his experience as a West Point-educated fighter pilot, biometrics expert, early innovator of ATM technology, and V.P. of engineering or CTO at eleven different technology companies, Jeff began challenging those dysfunctional realities, looking for solutions that would have global impact. In this book you'll journey to Scrum's front lines where Jeff's system of deep accountability, team interaction, and constant iterative improvement is, among other feats, bringing the FBI into the 21st century, perfecting the design of an affordable 140 mile per hour/100 mile per gallon car, helping NPR report fast-moving action in the Middle East, changing the way pharmacists interact with patients, reducing poverty in the Third World, and even helping people plan their weddings and accomplish weekend chores. Woven with insights from martial arts, judicial decision making, advanced aerial combat, robotics, and many other disciplines, Scrum is consistently riveting. But the most important reason to read this book is that it may just help you achieve what others consider unachievable - whether it be inventing a trailblazing technology, devising a new system of education, pioneering a way to feed the hungry, or, closer to home, a building a foundation for your family to thrive and prosper.

The high cost of accurate knowledge - Sutcliffe, Kathleen M.; Weber, Klaus (Harvard Business Review, 2003)
Many business thinkers believe it's the role of senior managers to scan the external environment to monitor contingencies and constraints, and to use that precise knowledge to modify the company's strategy and design. As these thinkers see it, managers need accurate and abundant information to carry out that role. According to that logic, it makes sense to invest heavily in systems for collecting and organizing competitive information. Another school of pundits contends that, since today's complex information often isn't precise anyway, it's not worth going overboard with such investments. In other words, it's not the accuracy and abundance of information that should matter most to top executives–rather, it's how that information is interpreted. After all, the role of senior managers isn't just to make decisions; it's to set direction and motivate others in the face of ambiguities and conflicting demands. Top executives must interpret information and communicate those interpretations–they must manage meaning more than they must manage information. So which of these competing views is the right one? Research conducted by academics Sutcliffe and Weber found that how accurate senior executives are about their competitive environments is indeed less important for strategy and corresponding organizational changes than the way in which they interpret information about their environments. Investments in shaping those interpretations, therefore, may create a more durable competitive advantage than investments in obtaining and organizing more information. And what kinds of interpretations are most closely linked with high performance? Their research suggests that high performers respond positively to opportunities, yet they aren't overconfident in their abilities to take advantage of those opportunities.
Keywords: Administrative Personnel; Data Collection; Decision Making; Organizational; Economic Competition; Information Management; Investments; Marketing; Organizational Innovation; United States

Learning for social-ecological change: a qualitative review of outcomes across empirical literature in natural resource management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina; Macura, Biljana; Pahl-Wostl, Claudia (Journal of Environmental Planning and Management, 2018)

Process and Contextual Factors Supporting Action-Oriented Learning: A Thematic Synthesis of Empirical Literature in Natural Resource Management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina (Society & Natural Resources, 2019)
Despite a long-term focus on learning in natural resource management (NRM), it is still debated how learning supports sustainable real-world NRM practices. We offer a qualitative in-depth synthesis of selected scientific empirical literature (N = 53), which explores factors affecting action-oriented learning. We inductively identify eight key process-based and contextual factors discussed in this literature. Three patterns emerge from our results. First, the literature discusses both facilitated participation and self-organized collaboration as dialogical spaces, which bridge interests and support constructive conflict management. Second, the literature suggests practice-based dialogs as those best able to facilitate action and puts a strong emphasis on experimentation. Finally, not emphasized in existing reviews and syntheses, we found multiple evidence about certain contextual factors affecting learning, including social-ecological crises, complexity, and power structures. Our review also points at important knowledge gaps, which can be used to advance the current research agenda about learning and NRM.
Keywords: Ecosystem governance; Social learning; intermediaries; social-ecological systems; structural constraints

Glass Half Full: Civic Space and Contestation in Bangladesh, Sri Lanka and Nepal - Surie, Mandakini D.; Saluja, Sumaya; Nixon, Nicola (The Asia Foundation, 2023)
The past decade has witnessed a surge of interest in and concern over the global trend toward democratic regression. In South Asia, regulatory and institutional frameworks have become increasingly restrictive, curbing the ability of citizens and civil society organizations to occupy and use civic spaces to organize, express themselves, and participate in decisions that affect the lives of people whose interests they serve. Of course, this is only one half of the story. The other half is how citizens, collectives, and organizations adapt by carving out spaces where they can maintain—or even expand—the boundaries of their engagement in local and national civic spaces. In this paper, we examine how civic spaces are evolving in three South Asian countries—Bangladesh, Sri Lanka, and Nepal—drawing on the experiences and perspectives of civil society representatives. The paper concludes with recommendations for donors and development practitioners on how they can make relevant investments that will strengthen civic spaces and support democratic resilience in the region.

Systems Thinking For Social Change: A Practical Guide to Solving Complex Problems, Avoiding Unintended Consequences, and Achieving Lasting Results - Stroh, David Peter (Chelsea Green Publishing, 2015)
Donors, leaders of nonprofits, and public policy makers usually have the best of intentions to serve society and improve social conditions. But often their solutions fall far short of what they want to accomplish and what is truly needed. Moreover, the answers they propose and fund often produce the opposite of what they want over time. We end up with temporary shelters that increase homelessness, drug busts that increase drug-related crime, or food aid that increases starvation. How do these unintended consequences come about and how can we avoid them? By applying conventional thinking to complex social problems, we often perpetuate the very problems we try so hard to solve, but it is possible to think differently, and get different results. Systems Thinking for Social Change enables readers to contribute more effectively to society by helping them understand what systems thinking is and why it is so important in their work. It also gives concrete guidance on how to incorporate systems thinking in problem solving, decision making, and strategic planning without becoming a technical expert. Systems thinking leader David Stroh walks readers through techniques he has used to help people improve their efforts to end homelessness, improve public health, strengthen education, design a system for early childhood development, protect child welfare, develop rural economies, facilitate the reentry of formerly incarcerated people into society, resolve identity-based conflicts, and more. The result is a highly readable, effective guide to understanding systems and using that knowledge to get the results you want.

Theory of Action: Creating Craddle to Career Proof Points - Strive Together (Strive Together, 2014)
StriveTogether’s Theory of Action provides a framework for improving educational outcomes and ensuring a community transforms how it serves children.

Propel - Strhive (2023)
Learn from experience. Together. In the complex landscape of international development, organisations need a way to learn from their experiences and build on what works. Propel is the software solution that revolutionises the way organisations capture, access, and reuse learnings to adapt, innovate, and create lasting change on a global scale. Let's stop reinventing the wheel and build on what works, together.

FOCEVAL – Promoting Evaluation Capacities in Costa Rica:: Smart(er) Implementation with Capacity WORKS? - Storm, Sabrina (Transformation, Politics and Implementation, 2017)
The National Monitoring and Evaluation System of Costa Rica and its corresponding laws were established during the 1990s. Since then, the country has endeavored to implement monitoring and evaluation (M&E) activities as part of its public policy framework. Nevertheless, hardly any systematic evaluations had been conducted, and monitoring activities had been reduced mainly to the institutional self-reporting of implementation compliance. Persisting regional disparities and growing levels of inequality among the population raised the level of pressure on the government to present reliable information on the effectiveness of public interventions. Hence, results-oriented evaluations were promoted by some Costa Rican departments as

Behind the scenes: International NGOs’ influence on reproductive health policy in Malawi and South Sudan - Storeng, Katerini T.; Palmer, Jennifer; Daire, Judith; Kloster, Maren O. (Global Public Health, 2019)
Global health donors increasingly embrace international nongovernmental organisations (INGOs) as partners, often relying on them to conduct political advocacy in recipient countries, especially in controversial policy domains like reproductive health. Although INGOs are the primary recipients of donor funding, they are expected to work through national affiliates or counterparts to enable ‘locally-led’ change. Using prospective policy analysis and ethnographic evidence, this paper examines how donor-funded INGOs have influenced the restrictive policy environments for safe abortion and family planning in South Sudan and Malawi. While external actors themselves emphasise the technical nature of their involvement, the paper analyses them as instrumental political actors who strategically broker alliances and resources to shape policy, often working ‘behind the scenes’ to manage the challenging circumstances they operate under. Consequently, their agency and power are hidden through various practices of effacement or concealment. These practices may be necessary to rationalise the tensions inherent in delivering a global programme with the goal of inducing locally-led change in a highly controversial policy domain, but they also risk inciting suspicion and foreign-national tensions.

Two Loops – Excerpted from - Stilger, Bob

Walking the Long Road Together - Stilger, Bob (Afternow: When We Cannot See the Future Where Do We Begin?, 2017)
On March 11, 2011, overwhelming and incomprehensible disaster struck the northeast coast of Japan. Life for those in the region would never be the same. This book is about the awakening that follows disaster. About the minutes and months and years that come after now. It is about what happens when we're smacked on the side of the head and open our eyes, startled out of the trance in which we have been living our days. It is about the opportunities always present, often invisible, to create the lives we want, now. AfterNow chronicles the author's journey with the Japanese people over 6 years – his own story of awakening after plunging into this disaster and the stories from people who found where to take their first step, and the next. It offers the tools and processes and worldview people discovered to create what comes after now. It is built around two big ideas. The first is that after disaster, we find our way forward, together. We come awake, together. Disaster obliterates the past, plunges the present into chaos and cocoons the future. We need each other to see and build the new. The second idea is that we don't have to wait for the tragedy of disaster to make the communities and lives we want. We can engage each other with respect, curiosity and generosity and begin to co-create what we want, now. We live in a period of precipitous, unpredictable change. The book is for those who want to make this time more livable and less insane. In Japan and all over the world, we are living in the messy middle where old forms are falling apart and new possibilities are in early stages. The ground is pulled out from under us on a regular basis. Our work right now is to learn to coexist with the messiness. We need to keep trying things, to keep learning. We need to remain focused on our purpose and follow the braided strand of intention and surrender as we find our way forward. embracing radical uncertainty, showing up as fully as we can each moment, each breath.

An introduction to multi-stakeholder partnerships - Stibbe, Darian; Prescott, Dave (The Partnering Initiative, 2016)
This briefing document for the GPEDC High Level Meeting in November 2016 offers a definition of multi-stakeholder partnerships (MSPs) and shows how they are being used, where they have come from, and what the different sectors bring to the table. It provides an overview of the challenges the present, what they require from individuals and organisations, and how they get started. The report was written with the support of the PEP Initiative, and funded by the Netherlands Ministry of Foreign Affairs.

A Critique of the Claims About Mobile Phones and Kerala Fisherman. The Importance of the Context of Complex Social Systems - Steyn, Jacques (The Electronic Journal of Information Systems in Developing Countries, 2016)
This paper challenges some fundamental aspects of research and conclusions relating to the use of technology for community development. Views of technology, in this case the mobile phone, as a tool for increased economic welfare are often skewed due to extreme reductionism, ambiguous interview questions and poor data sources. Research of complex social systems or sub-systems give the wrong answers when reductionist methodologies are used. To demonstrate such shortcomings, the 2007 paper of Robert Jensen serves as an example. His conclusion that mobile phones enable Kerala fishermen to increase their economic welfare is the most cited paper on ICT4D topics, but there are fundamental methodological and logical problems with the claim, while other research came to contradictory conclusions. This critique is presented on many levels: ideological, paradigmatic, methodology, logical, statistical and semantic.

Using Information on Results in Program Management – The case of Samarth-NMDP in Nepal - Stewart, Tim; Joshi, Sanju; Miehlbradt, Alexandra (The Donor Committee for Enterprise Development, 2015)
Keywords: Case Report

The direction of evolution: The rise of cooperative organization - Stewart, John E. (Biosystems, 2014)
Two great trends are evident in the evolution of life on Earth: towards increasing diversification and towards increasing integration. Diversification has spread living processes across the planet, progressively increasing the range of environments and free energy sources exploited by life. Integration has proceeded through a stepwise process in which living entities at one level are integrated into cooperative groups that become larger-scale entities at the next level, and so on, producing cooperative organizations of increasing scale (for example, cooperative groups of simple cells gave rise to the more complex eukaryote cells, groups of these gave rise to multi-cellular organisms, and cooperative groups of these organisms produced animal societies). The trend towards increasing integration has continued during human evolution with the progressive increase in the scale of human groups and societies. The trends towards increasing diversification and integration are both driven by selection. An understanding of the trajectory and causal drivers of the trends suggests that they are likely to culminate in the emergence of a global entity. This entity would emerge from the integration of the living processes, matter, energy and technology of the planet into a global cooperative organization. Such an integration of the results of previous diversifications would enable the global entity to exploit the widest possible range of resources across the varied circumstances of the planet. This paper demonstrates that it's case for directionality meets the tests and criticisms that have proven fatal to previous claims for directionality in evolution.
Keywords: Direction of evolution; Evolution of a global entity; Evolution of cooperation; Evolutionary progress; Major evolutionary transitions

Broadening the range of designs and methods for impact evaluations - Stern, Elliot; Stame, Nicoletta; Mayne, John; Forss, Kim; Davies, Rick; Befani, Barbara (DFID, 2012)

Innovation, Sustainability, Development: A New Manifesto - STEPS Centre (STEPS Centre, 2010)
Our Manifesto project publication is available in print, on CD or to view online. Innovation, Sustainability, Development: A New Manifesto recommends new ways of linking science and innovation to development for a more sustainable, equitable and resilient future. The multimedia version, with added audio, video and background documents, is available on CD and online.

Prioritizing and Selecting Strategic Approaches in USAID Biodiversity Programming - Stem, Caroline; Swaminathan, Vinaya; Flores, Marco (USAID, 2018)
This guide supplements Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. Step 4, Brainstorming Strategic Approaches, involves generating a suite of potential strategic approaches for a design team to consider. Step 5 introduces the practice of prioritizing and selecting among these draft strategic approaches but does not provide in-depth guidance on the process and criteria for doing so.

Virtuous cycles of learning: Using formative, embedded, and diagnostic developmental assessments in a large-scale leadership program - Stein, Z.; Dawson, Theo; Van Rossum, Zachary; Rothaizer, Joel; Hill, S. (Journal of Integral Theory and Practice, 2014)
This article presents preliminary results from a series of ongoing action-research projects involving the use of embedded diagnostic developmental assessments (called LectaTests™) in leadership education contexts. These findings are presented to support a particular metatheoretical approach to learning and education in which embedded assessments form a crucial part of ongoing virtuous cycles of action, feedback, support, and learning. We present two types of evidence. First, we compare developmental growth across eight program evaluations in which LectaTests were and were not embedded. Second, we examine how embedding LectaTests in a large-scale leadership development program affected the growth of managers and their direct reports. We review these findings with an eye toward detecting the benefits of using developmental assessment as embedded diagnostics alongside their use as research instruments. We begin by using Integral Theory to structure a discussion about the ideal function of developmental assessments in educational contexts.

Understanding ‘theory of change’ in international development: A review of existing knowledge - Stein, Danielle; Valters, Craig (LSE, 2012)
This is a review by Danielle Stein and Craig Valters of the concepts and debates within ‘Theory of Change’ (ToC) material, resulting from a search and detailed analysis of available donor, agency and expert guidance documents. The review was undertaken as part of a Justice and Security Research Program (JSRP) and The Asia Foundation (TAF) collaborative project, and focuses on the field of international development.

Appreciative Inquiry: Organization Development and the Strengths Revolution - Stavros, Jacqueline M.; Godwin, Lindsey N.; Cooperrider, David L. (Practicing Organization Development, 2015)
A ppreciative Inquiry (AI) is a theory and practice of inquiry-and-changethat shifts the perspective of organization development (OD) methodsby suggesting that the very act of asking generative questions has pro-found impact in organizational systems. Inquiry and change are not separatemoments. Our questions focus our attention on what is “there” to be noticed.Reflecting its social constructionist roots (Cooperrider, Barrett, and Srivastva1995; Gergen 1995), which suggest that words create worlds, AI offers a newchange imperative by suggesting that we be aware of the negativity bias thatpervades our investigations into organizational life and instead shift our focusto the good, the better, and the possibilities that often go undernoticed in oursystems. Building on Gergen (1995) and Cooperrider and Avital (2003), Cooper-rider and Godwin (2012) summarize, “AI posits that human systems move in thedirection of the questions they most frequently and authentically ask; knowl-edge and organizational destiny are intimately interwoven; what we know andhow we study it has a direct impact on where we end up” (740).Leveraging the power of generative questions, AI changes the focus of whatwe typically study in organizational life, questioning the prevailing mindset that“organizations are problems to be solved,” (Cooperrider and Srivastva 1987).Instead, AI suggests that “organizations are mysteries and miracles of humanrelatedness; they are living systems, alive and embedded in ever-wideningwebs of infinite strength and limitless human imagination. Organizations, ascenters of human connectivity and collaboration, are ‘universes of strengths,’” (Cooperrider and Godwin 2010, 10). AI invites change agents to look intotheir organizations with “appreciative eyes”—scanning the system for thingsfor which to be grateful, seeking out what is next and what is possible, andfocusing on valuing those things of value worth valuing. AI theorists posit thatsuch a shift in our approach to organizational change is needed if we are toinspire our imaginative capacities to their fullest potential.

Why Greatness Cannot Be Planned: The Myth of the Objective - Stanley, Kenneth O.; Lehman, Joel (Springer, 2015)
Why does modern life revolve around objectives? From how science is funded, to improving how children are educated – and nearly everything in-between – our society has become obsessed with a seductive illusion: that greatness results from doggedly measuring improvement in the relentless pursuit of an ambitious goal. In Why Greatness Cannot Be Planned, Stanley and Lehman begin with a surprising scientific discovery in artificial intelligence that leads ultimately to the conclusion that the objective obsession has gone too far. They make the case that great achievement can't be bottled up into mechanical metrics; that innovation is not driven by narrowly focused heroic effort; and that we would be wiser (and the outcomes better) if instead we whole-heartedly embraced serendipitous discovery and playful creativity.Controversial at its heart, yet refreshingly provocative, this book challenges readers to consider life without a destination and discovery without a compass.

Adaptive management of natural resources: theory, concepts, and management institutions. - Stankey, George H.; Clark, Roger N.; Bormann, Bernard T. (U.S. Department of Agriculture, Forest Service, Pacific Northwest Research Station, 2005)
This report reviews the extensive and growing literature on the concept and application of adaptive management. Adaptive management is a central element of the Northwest Forest Plan and there is a need for an informed understanding of the key theories, concepts, and frameworks upon which it is founded. Literature from a diverse range of ﬁelds including social learning, risk and uncertainty, and institutional analysis was reviewed, particularly as it related to application in an adaptive management context. The review identiﬁes opportunities as well as barriers that adaptive management faces. It concludes by describing steps that must be taken to implement adaptive management.

Chaos Report 2015 - Standish Group (Standish Group, 2015)

Chaos Report 2020 - Standish Group (Standish Group, 2020)

Multiple case study analysis - Stake, Robert E. (The Guilford Press, 2006)
Examining situational complexity is a vital part of social and behavioral science research. This engaging text provides an effective process for studying multiple cases–such as sets of teachers, staff development sessions, or clinics operating in different locations–within one complex program. The process also can be used to investigate broadly occurring phenomena without programmatic links, such as leadership or sibling rivalry. Readers learn to design, analyze, and report studies that balance common issues across the group of cases with the unique features and context of each case. Three actual case reports from a transnational early childhood program illustrate the author's approach, and helpful reproducible worksheets facilitate multicase recording and analysis.
Keywords: Case method; Cross-cultural studies; Education; Europe; Eastern; Research Methodology; Step by Step (Program)

Participation as assemblage: Introducing assemblage as a framework for analysing participatory processes and outcomes - Stage, Carsten; Ingerslev, Karen (Conjunctions. Transdisciplinary Journal of Cultural Participation, 2016)
The article presents a yet unexplored framework for analysing the multidimensionality and dis/connections of participatory processes and their outcomes by using the concept of the ‘assemblage’ (DeLanda, 2006). The case is an eight-month collaboration between a task force initiated by Central Denmark Region, the socio-economic company Sager der Samler, and citizens. The collaboration is aimed at bringing together and working across various institutional and user perspectives to act on a societal challenge. The analysis is theoretically based on a review of existing theories of participation and typologies for analysing and evaluating participation. In particu- lar, the analysis focuses on the assemblage approach as a way of acknowledging the institutional, affective, mate- rial and power-related complexity of participatory processes. The assemblage approach helps to analytically stress that the process under investigation should be evaluated both with a more traditional focus on decision-making or power allocation, as well as taking into account the social, personal-affective and material benefits produced, and the potential for change in the relationship between public administration and citizens.

Agile distributed software development in nine Central European teams: challenges, benefits and recommendations - Stadler, Manuel; Vallon, Raoul; Pazderka, Martin; Grechenig, Thomas (Information Technology, 2019)

Strategic Management and Organisational Dynamics: The Challenge of Complexity - Stacey, Ralph D. (Pitman, 2000)
In the third edition of this successful text, Ralph Stacey continues to question the view that organisations operate and succeed in relatively stable environments. He argues that in order to succeed in uncertainty and continual change, organisations need to create new perspectives and learn from the chaos within which they operate. This edition continues to focus on this radically different approach to strategic management. The central tenets of this approach have to do with unpredictability and the limitations of control, and therefore it argues against the rational models of planning and control covered in other strategy textbooks. This is done by emphasising the importance of narrative, conversation and learning from one's own experience as the central means by which we can gain understanding and knowledge of strategy in organisations. - Sharper distinction between systemic and process thinking with new chapters on the philosophical origins of systems and process thinking, second order and critical system thinking. - new material on theory of complex responsive processes, particularly to do with control, leadership and ethics. - Includes 7 management narratives, ie, personal ac
Google-Books-ID: z7haAAAAYAAJ
Keywords: Organizational Behavior; Strategic Planning

Beyond "Lack of Political Will": Elaborating Political Economy Concepts to Advance "Thinking and Working Politically" Comment on "Health Coverage and Financial Protection in Uganda: A Political Economy Perspective" - Ssennyonjo, Aloysius (International Journal of Health Policy and Management, 2022)
Political economy analysis (PEA) has been advanced as critical to understanding the political dimensions of policy change processes. However, political economy (PE) is not a theory on its own but draws on several concepts. Nannini et al, in concert with other scholars, emphasise that politics is characterised by conflict, contestation and negotiation over interests, ideas and power as various agents attempt to influence their context. This commentary reflects how Nannini et al wrestled with these PEA concepts - summarised in their conceptual framework used for PEA of the Ugandan case study on financial risk protection reforms. The central premise is that a common understanding of the PEA concepts (mainly structure-agency interactions, ideas, interests, institutions and power) forms a basis for strategies to advance thinking and working politically. Consequently, I generate several insights into how we can promote politically informed approaches to designing, implementing and evaluating policy reforms and development efforts.

Starting out on Social Return on Investment - SROI Network; Aitken, Hall (2014)
This guide, created by the SROI Network in collaboration with Hall Aitken, is aimed at providing guidance to those who have never used SROI on where to begin. The guide provides practical steps to beginning the process of SROI and includes links to tools aimed at supporting its implementation. Excerpt "Most public, private and third sector organisations have a pretty good idea of the costs of what they do. Annual accounts, management accounts, budget reports and a whole accountancy profession add up to a great deal of effort to make sure this is the case. Some organisations are quite good at counting what they do with these resources. They can track the number of users or contacts, or customers. Many can provide some evidence that these activities lead to some sort of change. But very few can explain clearly why all this matters. What would happen if they did not exist? What is the real value of what they do? Social Return on Investment sets out to redress the balance by looking at value not just cost." Contents Part one – why, what and how? Why does social value matter? What is SROI? How do I do SROI? Next steps Part two – progress tool Part three – practical next steps Steps to involve stakeholders Steps to understand what changes Steps to value the things that matter Steps to only include what is material Steps to avoid overclaiming Steps to be transparent Steps to verify the result

SROI Self-assessment tool - SROI Network (2016)
The online self assessment tool was created by the SROI Network in collaboration with Hall Aitken to help users judge how well their evaluation practices adhere to principles of best practice. The tool is comprised of a seven stage questionnaire, showing results as a spider chart illustrating areas of strength and areas for improvement. The questionnaire itself is structured around the seven principles of SROI. These principles include ‘involve stakeholders’, ‘be transparent’ and ‘do not overclaim’, and together make up the core framework around which SROI is based. Users receive a score for each principle, and an overall average, giving them an idea of to what extent they have successfully applied the principles. High scoring users can then use their score to guide them towards applying for assurance and accreditation. The tool provides guidance, support and more advice to people who want to improve the way in which their organisation measures their social value and assesses their service delivery but don’t know where to start.

Applying Systems Thinking via Systemigrams™ for Defining the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) Project - Squires, Alice; Pyster, Art; Sauser, Brian; Olwell, David; Enck, Stephanie; Gelosh, Don; Anthony, Jim (INCOSE International Symposium, 2010)
Systems thinking is commonly accepted as the backbone of a successful systems engineering approach. As such, the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) team chose to leverage a systems thinking based tool, called Systemitool, to describe our project to the vast audience that would potentially become involved directly or indirectly in the success of the project. This paper describes the process and steps used by the authors and the BKCASE team to develop the project's systemic diagram, or Systemigram™, and the story behind the project, the products, and the vision of the BKCASE project. The goal of the paper is to provide guidance so that readers can leverage the lessons learned from this effort to successfully develop their own project definitions and stories.

Our Data, Our Process: Re-imagining the Community-Led Monitoring and Evaluation Discussion Samahan para sa Pagsulong at Pag -unlad ng Capaculan (SPPC), Nancy Bobadilla, Gunjan Veda - SPPC, Samahan para sa Pagsulong at Pag -unlad ng Capaculan; Bobadilla, Nancy; Veda, Gunjan (Asia Pacific Journal of Evaluation, 2024)

Applying Systems Thinking to Education: The RISE Systems Framework - Spivack, Marla (Research on Improving Systems of Education (RISE), 2021)
Many education systems in low- and middle-income countries are experiencing a learning crisis. Many efforts to address this crisis do not account for the system features of education, meaning that they fail to consider the ways that interactions and feedback loops produce outcomes. Thinking through the feedback relationships that produce the education system can be challenging. The RISE Education Systems Framework, which is sufficiently structured to give boundaries to the analysis but sufficiently flexible to be adapted to multiple scenarios, can be helpful. The RISE Framework identifies four key relationships in an education system: politics, compact, management, and voice and choice; and five features that can be used to describe these relationships: delegation, finance, information, support, and motivation. This Framework can be a useful approach for characterising the key actors and interactions in the education system, thinking through how these interactions produce systems outcomes, and identifying ways to intervene that can shift the system towards better outcomes.

Thoughts on the use of hypotheses in adaptive management - Sparkman, Timothy (BEAM Exchange, 2015)
New insights, opinions and perspectives on market systems development, from experts and practitioners.

Impact Management Software & Measurement Platform - Sopact
Impact Management platform is designed for social impact investing funds, grantmakers & public agency to provide comprehensive social impact measurement & impact management.

Strengthen Your Team’s CLA Practices: Introducing the CLA Maturity Tool for USAID Implementers - Social Impact , Inc (2023)
The Collaborating, Learning & Adapting (CLA) Maturity Tool has been used by USAID operating units since 2015. The tool enables staff to self-assess their current CLA practice and plan ways to improve their internal and external collaboration, organizational learning efforts, and adaptive management practices. Recently, SI built on this resource to create the CLA Maturity Tool for implementing partners (IPs) to provide a version that speaks more directly to the experience of international and local organizations. Learn more here.

Managing complexity (and chaos) in times of crisis. A field guide for decision makers inspired by the Cynefin framework - Snowden, Dave; Rancati, Alessandro (Publications Office of the European Union, 2021)
This field guide helps to navigate crises using the Cynefin framework as a compass. It proposes a four-stage approach through which we can: - assess the type of crisis and initiate a response; - adapt to the new pace and start building sensing networks to inform decisions; - repurpose existing structures and working methods to generate radical innovation; - transcend the crisis, formalise lessons learnt and increase resilience. The guide stresses the importance of setting and managing boundaries, building informal structures, keeping options open, distributing engagement and keeping an ongoing assessment of the evolving landscape. Action items, real life examples and demonstrations complement the references to the developing theoretical framework.

A Leader’s Framework for Decision Making - Snowden, Dave; Boone, Mary E. (Harvard Business Review, 2007)

Cynefin St David’s Day 2020 (1 of 5) - Snowden, Dave (Cognitive Edge, 2020)
Series of blog posts discussing the last version (as of 2020) of the Cynefin framework.

Naturalizing sensemaking - Snowden, Dave (Informed by Knowledge: Expert Performance in Complex Situations, 2010)
The focus of this book is on how experts adapt to complexity, synthesize and interpret information in context, and transform or "fuse" disparate items of information into coherent knowledge. The chapters examine these processes across experts (e.g. global leaders, individuals in extreme environments, managers, police officers, pilots, commanders, doctors, inventors), across contexts (e.g. space and space analogs, corporate organizations, command and control, crisis and crowd management, air traffic control, the operating room, product development), and for both individual and team performance. Successful information integration is a key factor in the success of diverse endeavors, including team attempts to climb Mt. Everest, crowd control in the Middle East, and remote drilling operations. This volume is divided into four sections, each with a specific focus on an area of expert performance, resulting in a text that covers a wide range of useful information. These sections present well-researched discussions, such as: the management of complex situations in various fields and decision contexts; technological and training approaches to facilitate knowledge management by individual experts and expert teams; new or neglected perspectives in expert decision making; and the importance of ‘modeling’ expert performance through techniques and frameworks such as Cognitive Task Analysis, computational architectures based on the notion of causal belief mapping such as ‘Convince Me,’ or the data/frame model of sensemaking. The volume provides essential reading for researchers and practitioners of Naturalistic Decision Making and those who study Expertise; Organizational and Cognitive Psychologists; and researchers and students in Business and Engineering.

How are Research for Development Programmes Implementing and Evaluating Equitable Partnerships to Address Power Asymmetries? - Snijder, Mieke; Steege, Rosie; Callander, Michelle; Wahome, Michel; Rahman, M. Feisal; Apgar, Marina; Theobald, Sally; Bracken, Louise J.; Dean, Laura; Mansaray, Bintu; Saligram, Prasanna; Garimella, Surekha; et al. (The European Journal of Development Research, 2023)
The complexity of issues addressed by research for development (R4D) requires collaborations between partners from a range of disciplines and cultural contexts. Power asymmetries within such partnerships may obstruct the fair distribution of resources, responsibilities and benefits across all partners. This paper presents a cross-case analysis of five R4D partnership evaluations, their methods and how they unearthed and addressed power asymmetries. It contributes to the field of R4D partnership evaluations by detailing approaches and methods employed to evaluate these partnerships. Theory-based evaluations deepened understandings of how equitable partnerships contribute to R4D generating impact and centring the relational side of R4D. Participatory approaches that involved all partners in developing and evaluating partnership principles ensured contextually appropriate definitions and a focus on what partners value.

Using a ‘Partnership Rubric’ in Participatory Evaluations - Snijder, Mieke; Hicks, Jacky; Paul, Sukanta; Arulanantham, Amit; Apgar, Marina; Afroze, Jiniya; Karki, Shanta; Mareschal, Sophie; Prieto Martín, Pedro; Uddin, Forhad; Veitch, Helen (Institute of Development Studies, 2023)
Programmes that aim to tackle complex societal issues, such as the worst forms of child labour, require rich partnerships that bring together different perspectives. CLARISSA’s consortium partnership adopts an empowerment approach to the interventions we deliver and our ways of working together. Part of this approach involves ongoing reflection and learning about how we work together in our partnership, and how this can be adapted if needed. This learning note focuses on a method used in CLARISSA to both reflect on and strengthen how we work in partnerships – the partnership rubric. We found that using the rubric flexibly was key to mitigating some of the challenges of such a complex consortium. This included using it in different sizes of forum, with different levels of preparation. Periodically adapting it for country context and as new partners came on board also helped ensure a shared sense of our preferred ways of working as the project progressed.
Accepted: 2023-07-13T10:20:02Z Publisher: Institute of Development Studies

How Does Participatory Action Research Generate Innovation? Findings from a Rapid Realist Review - Snijder, Mieke; Apgar, J. Marina (Institute of Development Studies, 2021)
This Emerging Evidence Report shares evidence of how, for whom, and under what circumstances, Participatory Action Research (PAR) leads to innovative actions. A rapid realist review was undertaken to develop programme theories that explain how PAR generates innovation. The methodology included peer-reviewed and grey literature and moments of engagement with programme staff, such that their input supported the development and refinement of three resulting initial programme theories (IPTs) that we present in this report. Across all three IPTs, safe relational space, group facilitation, and the abilities of facilitators, are essential context and intervention components through which PAR can generate innovation. Implications from the three IPTs for evaluation design of the CLARISSA programme are identified and discussed. The report finishes with opportunities for the CLARISSA programme to start building an evidence base of how PAR works as an intervention modality, such as evidencing group-level conscientisation, the influence of intersecting inequalities, and influence of diverse perspectives coming together in a PAR process.
Accepted: 2021-07-23T08:48:45Z

External Review of the Building Effective and Accessible Markets (BEAM) programme - Snedden, Ewan; Freer, Gordon; Moffatt, Michelle (WYG International, 2016)

Outcome mapping: A method for tracking behavioural changes in development programs - Smutylo, Terry (2005)
This guide published by the Institutional Learning and Change (ILAC) Initiative provides a detailed overview of using outcome mapping as an evaluation tool. Contents Expressing results as changes in behaviour Outcome mapping terms The three stages of outcome mapping Figure 1. The three stages and twelve steps of outcome mapping Stage 1. Intentional design Figure 2. The four basic questions of the intentional design stage Stage 2. Outcome and performance monitoring Stage 3. Evaluation planning Using outcome mapping The Ceja Andina Project The Agro-industry and Market Development project for Arracacha

Ten years of Outcome Mapping adaptations and support - Smith, Richard; Mauremootoo, John; Rassmann, Kornelia (Outcome Mapping Learning Community, 2012)
An analysis of how and where Outcome Mapping has been applied, how users have experienced OM and the support options available and required for its use. This research was commissioned by the OMLC Stewards.

10 years of Outcome Mapping - Smith, R; Mauremootoo, John; Ambrose, K.; Hearn, Simon (2012)
This webinar from the Outcome Mapping Learning Community (OMLC) presents the key findings from research conducted into the extent of Outcome Mapping use and the support required for its implementation.

Chris Argyris: theories of action, double-loop learning and organizational learning - Smith, Mark K. (The encyclopedia of pedagogy and informal education, 2013)
Chris Argyris: theories of action, double-loop learning and organizational learning. The work of Chris Argyris (1923-2013) has influenced thinking about the relationship of people and organizations…

40 Agile Methods in 40 Minutes - Smith, Craig (2014)
My presentation from Scrum Australia 2014 called “40 Agile Methods in 40 Minutes” is available on Slideshare. With 73% of the world using Scrum as their predominant Agile method, this session will …

40 Agile Methods in 40 Minutes - Smith, Craig (2015)

Participation for Humanitarian Innovation - Background Paper - Smith, Amy; Thompson, Martha; Saida Benhayoune; Crespo Cardona, Omar (Elrha, 2023)
A resource designed to help organisations, teams and individuals manage innovation journeys responsibly and successfully. We have partnered with MIT D-Lab to develop a new resource to drive greater diversity and inclusion within project design and implementation. The Participation for Humanitarian Innovation (PfHI) toolkit sets out a robust approach to setting expectations for and monitoring the degree of participation within research and innovation projects for, with, and by people affected by crisis. The PfHI toolkit is composed of five tools: Opportunity Adviser: Identify and prioritise the desired benefits of participation while weighing the potential barriers. Participation Matrix: Agree on the precise degree of participation to target at a given project stage. Resource Navigator: Select tools and processes to address the needs of stakeholders, the project objectives and context. Quality Guidance: Ensure engagements are delivered to the highest standard. Assessment Matrix: Collectively evaluate the degree of participation achieved during an activity or project phase, learn and adapt. By applying these tools before, during and after a research and/or innovation project, implementors can ensure that stakeholders/end-users are included and participating at the highest possible degree. We encourage users of the PfHI toolkit to consider how else to integrate the tools into existing practices. For instance, the Evaluation Matrix could be used to supplement existing MEAL activities to: Establish baselines to measure changes in participation over time. Track the degree of participation/engagement of stakeholders. Regularly assess the degree of participation. Seek feedback from participants about the degree of their participation. Monitor the progress of activities related to stakeholder engagement. Our Participation for Humanitarian Innovation toolkit represents our ongoing commitment to responsible research and innovation across our portfolio of grants and for the humanitarian sector more broadly. We hope you will consider downloading and using the toolkit on your next project.

Participation for Humanitarian Innovation - Toolkit - Smith, Amy; Thompson, Martha; Saida Benhayoune; Crespo Cardona, Omar (Elrha, 2023)
A resource designed to help organisations, teams and individuals manage innovation journeys responsibly and successfully. We have partnered with MIT D-Lab to develop a new resource to drive greater diversity and inclusion within project design and implementation. The Participation for Humanitarian Innovation (PfHI) toolkit sets out a robust approach to setting expectations for and monitoring the degree of participation within research and innovation projects for, with, and by people affected by crisis. The PfHI toolkit is composed of five tools: Opportunity Adviser: Identify and prioritise the desired benefits of participation while weighing the potential barriers. Participation Matrix: Agree on the precise degree of participation to target at a given project stage. Resource Navigator: Select tools and processes to address the needs of stakeholders, the project objectives and context. Quality Guidance: Ensure engagements are delivered to the highest standard. Assessment Matrix: Collectively evaluate the degree of participation achieved during an activity or project phase, learn and adapt. By applying these tools before, during and after a research and/or innovation project, implementors can ensure that stakeholders/end-users are included and participating at the highest possible degree. We encourage users of the PfHI toolkit to consider how else to integrate the tools into existing practices. For instance, the Evaluation Matrix could be used to supplement existing MEAL activities to: Establish baselines to measure changes in participation over time. Track the degree of participation/engagement of stakeholders. Regularly assess the degree of participation. Seek feedback from participants about the degree of their participation. Monitor the progress of activities related to stakeholder engagement. Our Participation for Humanitarian Innovation toolkit represents our ongoing commitment to responsible research and innovation across our portfolio of grants and for the humanitarian sector more broadly. We hope you will consider downloading and using the toolkit on your next project.

I know what I know (but how do I know what I don’t?) - Smit, Debbie; de Lanerolle, Indra; Braam, Tamara; Byrne, Deborah; Legong, Gontse (MAVC, 2017)
An important support function of Making All Voices Count South Africa is to design, plan and facilitate community of practice gatherings for sustained learning and sharing across Making All Voices Count grantees. This report aims to capture the content of a one-day Making All Voices Count South African Community of Practice (CoP) Meeting held in November 2016. The South African MAVC CoP has been running for three years and has met between two and four times a year. It is a space for MAVC grantees and others working to foster innovation in the fields of transparency and accountability, to share experiences and knowledge, and collaborate in learning and improving work.

Impact networks: measuring towards success - Small Foundation (Small Foundation, 2021)
How does Small Foundation think about the impact…

Small Foundation Network Partner Evaluation Toolkit: Network Evaluation for Network Coordinators - Small Foundation (2021)
This Toolkit This Toolkit presents an approach to network evaluation that is designed for network coordinators. This Toolkit provides guidance for network coordinators on how to: • More effectively use information they are already collecting as part of their routine coordination duties; • Collect other useful data that would support their network’s health and development; • Integrate network evaluation tasks into network activities, like convenings, to streamline the process; • Use data to effectively coordinate, grow, and sustain their networks. The Toolkit also provides examples of surveys, questionnaires, and dashboards, as well as tips for easy implementation.

Small Foundation Network Partner Evaluation Toolkit Network Evaluation for Network Coordinators Frequently Asked Questions - Small Foundation (Small Foundation, 2021)
This Frequently Asked Questions (FAQ) document is written for Small Foundation network partners. It accompanies Network Partner Evaluation Toolkit, which outlines four evaluation tools that Small Foundation is encouraging, and supporting, its network partners to use to improve their operations and, ultimately, increase their impact. This FAQ document answers typical questions about these evaluation tools and provides additional detailed recommendations for how network coordinators can effectively implement them. This document has five sections: 1) A brief introduction to network theory and the value of evaluation for network coordinators. 2) An overview of the four evaluation tools and answers general questions about incorporating evaluation into network coordination duties. 3) Recommendations regarding the Network Coordinator Administrative Information (tool #1). 4) Information about Social Network Analysis (tool #2). 5) Recommendations regarding the Network Participant Survey (tool #3). 6) Information about the Collaborative Activity Dashboard (tool #4).

Built to improve: Leveraging realtime M&E for adaptive youth employment programming - Skelton, John (Mercy Corps, 2016)
Recognising that aid and development programming takes place in complex contexts, Mercy Corps is increasingly seeking to understand how best to manage programs which iterate, adapt and respond to the consistently evolving settings in which we work. This brief Practice Paper provides some examples of what adaptive management looks like in practice on the Prospects youth employment program in Liberia. It does not seek to function as a manual or set of guidelines, but simply provides some practical examples and insights into how a youth employment program governed by principles of adaptive management operates.

Real World SAFe – Leapfrogging a successful waterfall company into Scaled Agile - Skarin, Mattias (CRISP, 2017)

Top-down vs. Bottom-up Hierarchy: Or, How to Design a Self-Managed Organization - Sisney, Lex (Organizational Physics - Systems thinking for breakthrough business performance, 2016)
Top-down vs. Bottom-up Hierarchy: Or, How to Design a Self-Managed Organization

Review Article: Albert O. Hirschman: Development Projects Observed - Singer, Dr H. W. (1969)

Risk navigation for Thinking and Working Politically: The work and disappearance of Sombath Somphone - Sims, Kearrin (Development Policy Review, 2020)
Abstract Motivation On December 15, 2012 Sombath Somphone was abducted at a police checkpoint in his home city of Vientiane, the capital of Laos; his whereabouts remain unknown. This article considers his work and disappearance through the lens of Thinking and Working Politically (TWP) approaches to development. The article is supportive of TWP, but emphasizes the significant risks of politicized programming in authoritarian contexts. Purpose By examining the case of Sombath Somphone, the article seeks to offer insights for safer, and more effective, TWP programming. It considers how specific events in authoritarian contexts can suddenly reposition development workers and/or organizations as political dissidents. Approaches and Methods The argument draws on analysis of grey literature; conversational and observational knowledge accrued during 18 months of fieldwork in Laos between 2011 and 2018; on‐going formal and informal interviews with members of Laos’ civil society sector; and extensive dialogue with Sombath Somphone’s wife, Ng Shui Meng. Findings The article identifies four key factors that contributed to the enforced disappearance of Sombath Somphone: international exposure; timing; particular elites; and strategies of oppression. It highlights the need for further consideration of how to anticipate and mitigate the dangers of politically oriented development work, as well as the different forms of risk experienced by local and international development actors working in authoritarian contexts. Policy Implications TWP has much to offer to development practice, but its contributions should not threaten the safety of local development actors. More attention must be given to preventing and mitigating such risks.

Development Delusions and Contradictions: An Anatomy of the Foreign Aid Industry - Sims, David (Palgrave Macmillan, 2022)
This book analyses the shortcomings of the Western development aid programme. Through exploring the evolution of aid over more than seven decades, development is examined as an industry with a variety of motives and actors. The driving forces and dynamics in the relationship between aid and economic development are highlighted in relation to faulty development structures and misaligned aims. With a particular focus on Egypt, radical questions are posed on how global aid and development can be improved, including how it can respond to the COVID-19 pandemic.This book aims to present an alternative aid framework to help overcome the dysfunctionality of the current international development system. It will be of interest to researchers and policymakers working within development economics and development policy.

Adaptive Bureaucracies: lessons from DFID to the world - Simpson, Lea (LearnAdapt, 2020)
How many times have you worked on something that you know is failing, or just isn’t going as well as we’d all have hoped, but haven’t had…

SystemCraft - a primer: How to Tackle our Toughest Problems - Simpson, Kate; Randall, Ian (Wasafiri, 2020)
Systemcraft is our applied framework to help leaders and organisations get started and keep going when faced with complex problems. It is built on our practical experience. It draws on a broad body of research, action and theory from the worlds of complexity thinking, systems theory, adaptive management, leadership development, social movements, development theory and beyond. Systemcraft has been designed to make systems thinking something any leader can apply when they find themselves faced with a complex problem and asking, ‘So what do I do next?’

Routledge international handbook of participatory design - Simonsen, Jesper; Robertson, Toni (Routledge, 2013)
"Participatory Design is about the direct involvement of people in the co-design of the technologies they use. Its central concern is how collaborative design processes can be driven by the participation of the people affected by the technology designed. Embracing a diverse collection of principles and practices aimed at making technologies, tools, environments, businesses, and social institutions more responsive to human needs, the International Handbook of Participatory Design is a state-of-the-art reference handbook for the subject. The Handbook brings together a multidisciplinary and international group of highly recognized and experienced experts to present an authoritative overview of the field and its history and discuss contributions and challenges of the pivotal issues in Participatory Design, including heritage, ethics, ethnography, methods, tools and techniques and community involvement. The book also highlights three large-scale case studies which show how Participatory Design has been used to bring about outstanding changes in different organisations. The book shows why Participatory Design is an important, highly relevant and rewarding area for research and practice. It will be an invaluable resource for students, researchers, scholars and professionals in Participatory Design"–
OCLC: 754734489

Digital Democracy: The Tools Transforming Political Engagement - Simon, Julie; Bass, Theo; Boelman, Victoria; Mulgan, Geoff (NESTA, 2017)
This paper shares lessons from Nesta’s research into some of the pioneering innovations in digital democracy which are taking place across Europe and beyond

Learning and Accountability - Simister, Nigel; Scholz, Vera (INTRAC, 2020)
Most people agree that monitoring and evaluation (M&E) should be used for both learning and accountability. However, there is no consensus about which one is more important. The debate matters as there is sometimes tension between the two purposes. In the past there has often been a disconnect between M&E and learning. Many M&E systems are primarily designed to enable accountability to donors.

Beyond Logframes - Simister, Nigel (Intrac, 2017)
The logical framework, otherwise known as a logframe, is a commonly used planning tool. Initially designed for use within simple projects, it is increasingly being applied to complex programmes and organisations. In these cases the logical framework has limitations. There are several options that can help overcome these limitations. These include expanding the logframe, and using multiple logframes.

How Adaptive Management is challenging the monitoring and evaluation of complex programmes - Simister, Nigel (INTRAC, 2018)
By Nigel Simister Adaptive management is a broad approach designed to support development or humanitarian programmes in complex or uncertain …

In pursuit of the deep and sustained shifts necessary for adaptive management - Simister, Nigel (INTRAC, 2018)
The final blog in Nigel Simister's series on adaptive management and the M&E of complex projects and programmes.

Summarising portfolio change: results frameworks at organisational level - Simister, Nigel (Intrac, 2016)

Learning to ADAPT: monitoring and evaluation approaches in climate change adaptation and disaster risk reduction – challenges, gaps and ways forward - Silva Villanueva, Paula (IDS, 2011)
This working paper is a methodological contribution to the emerging debate on monitoring and evaluation (M&E) in the context of climate change adaptationand disaster risk reduction. Effectively managing disaster risk is critical for adapting to the impacts of climate change, however disasters risk reduction M&E practice may be limited in capturing progress towards adaptation. The unique nature of adaptation to climate change calls for experience-based learning M&E processes for discovering the key insights into adaptive capacity and its links to adaptation processes, and to risk and vulnerability reduction at large. The ADAPT guiding principles and indicators set the foundations towards this end.

How to Monitor and Evaluate an Adaptive Programme: 7 Takeaways - Sikustahili, Gloria; Adkins, Julie; Makongo, Japhet; Milligan, Simon (From Poverty to Power, 2020)
Monitoring and Evaluation needs to be different to support the new generation of 'adaptive programmes' in aid. 4 M&E specialists in Tanzania explain how.

Thinking and Working Politically in development - Coalitions for Change in The Philippines - Sidel, John T.; Faustino, Jaime (The Asia Foundation, 2020)
The Asia Foundation and the Australian Embassy in the Philippines today released a new publication, Thinking and Working Politically in Development: Coalitions for Change in the Philippines. Written by London School of Economics and Political Science Professor John T. Sidel and The Asia Foundation’s Jaime Faustino, the book examines the first phase of the Coalitions for Change program (2012-2018) and the contributions to key development policy reforms in the Philippines. The book is a rigorous treatment of the Coalitions for Change program’s transformative policy reforms—alongside lessons from its failures—across diverse policy arenas and in a wide variety of cities and provinces. The chapters are organized thematically: excise tax reform (Chapter 2), land governance reform (Chapter 3), education (Chapter 4), electoral reform (Chapter 5), disaster risk reduction and management (Chapter 6), and subnational governance reform and conflict resolution in Mindanao (Chapter 7). The co-authors together combine an independent, academic perspective on the program’s impacts (Sidel) with a front-row view of doing policy reform in the Philippines – both its political and technical dimensions (Faustino). Based on the empirical research and comparative analysis undertaken by the authors, the book articulates – and substantiates – a strong set of arguments that help to explain the program’s mixed pattern of achievements and disappointments. Overall, the book concludes that the seven-year program achieved significant and sustainable impact using problem-driven, adaptive, and iterative approaches to developmental change. The authors assert the program was at the forefront of notable development approaches: aid effectiveness and development around thinking and working politically, doing development differently, and adaptive programming. Graham Teskey, an early advocate of ‘thinking and working politically’ explores how development agencies can replicate the conditions for success in his Afterword. With illustrative case studies and analyses, the book provides valuable lessons for policymakers, scholars, bilateral agencies, think-tanks, and anyone interested in successfully maneuvering the shifting dimensions of development in the Philippines and elsewhere.

Achieving reforms in oligarchical democracies: the role of leadership and coalitions in the Philippines - Sidel, John T. (Developmental Leadership Program, 2014)
This paper examines the role of developmental leadership in two major reforms introduced in the Philippines in 2012: the passage into law in December of excise tax reform which significantly raised taxes on cigarettes and alcohol – generally referred to as the Sin Tax Reform – and, in July, the re-registration of voters in the Autonomous Region of Muslim Mindanao (ARMM). These reforms have a) strengthened government finances and healthcare; and b) improved the quality of elections and promoted good governance and conflict resolution in the southern Philippines. Key points: These reforms were not achieved exclusively through the executive leadership of Philippine President Benigno Aquino III, this paper argues. A broader form of developmental leadership was critical to their passage into legislation and their subsequent implementation, made up of reform coalitions that incorporated elements of government, the legislature, and civil society. While these coalitions were diverse and flexible in their form and composition, their core strength came from established advocacy groups and experienced activists. These groups and activists used highly labour-intensive, specialized and complex forms of mobilization. The success of these reform coalitions, it is argued, has implications for economic and governance reform in the developing world, particularly in systems characterised by oligarchical democracy, where competition for elected office is closely linked to the entrenched interests of business and industry.

Amateur hour: CfC's 'surprising' success in addressing school congestion in the philippines - Sidel, John T. (Asia Foundation, 2017)
The international development community has increasingly embraced the idea that finding durable solutions to complex development problems requires new ways of working that move beyond industry norms. This paper makes an important contribution to the current debate by outlining an innovative monitoring system called Strategy Testing (ST). This is the third paper in the Working Politically in Practice paper series, launched together with the Australian Department of Foreign Affairs and Trade.
Keywords: IMPORTANT

Digital authoritarianism in Bangladesh: Weaponising a draconian law to silence dissent in the pandemic era | Association for Progressive Communications - Siddiki, Zayed (2022)

Webinar - Practicing Thinking and Working Politically (TWP): Voices from the Field - SID (Society for International Development., 2020)
Current thinking on effective international development interventions highlights the importance of “thinking and working politically” (TWP). Among the emerging lessons of experience is that thinking politically, using tools such as political economy analysis, is more easily undertaken than working politically. How can the two pillars of TWP be effectively integrated? What challenges exist and how have practitioners confronted them? This session focuses on listening to voices from the field to explore answers to these questions. The organizers solicited proposals from implementers, reaching out to SID-W members and the Washington, D.C.-based TWP community of practice. They selected the following four projects that illustrate different approaches to practicing TWP. • Mercy Corps: Integrated Maji Infrastructure and Governance Initiative for Eastern Congo, Democratic Republic of the Congo • Asia Foundation: Tourism Strategy Project, Timor-Leste • Counterpart International: Rights and Dignity Project, El Salvador • RTI International: Knowledge Sector Initiative, Indonesia Their voices will be bookended by Sarah Frazer (RTI International), who will summarize a recent study, Thinking and Working Politically: Lessons from Diverse and Inclusive Applied Political Economy Analysis, and Alina Rocha Menocal (Overseas Development Institute), who will provide commentary on the four projects and the study findings. Ann Hudock (Counterpart International) will moderate.

System Innovation Network - Si Network (Si Network, 2020)
The Si Network is an online platform for building the developing of systems innovation - connecting people around the world to learn and apply the ideas and methods of systems innovation towards addressing complex challenges and building better systems that work for all. Not sure what systems innovation is? Systems innovation is a new approach to innovation that tries to tackle complex social and environmental challenges through the use of more holistic & innovation driven approaches. It is a kind of innovation that aims to change the underlying structure of a system, thus potentially enabling a more transformational kind of change - systems change - rather than incremental "innovation as usual". What Do You Do? We are building an ecosystem of individuals and organizations co-learning and co-creating systems innovation across geographies and sectors. This ecosystem is enabled by our online platform which provides educational content, toolkits, organizes events and projects as well as provides various support services for organizations. Purpose Statement Our purpose is to build the world’s capacity for systems innovation - so as to better understand and address complex challenges and co-create a world where systems work for all. We envision a world where everyone thinks in systems and has an understanding of complex systems. From this understanding, we are able to design and develop regenerative systems that work for everyone. Our mission is to grow the field of systems innovation as a pathway to co-learn the ideas of systems thinking and apply them to co-creating new systems Who's Involved? We are a networked organization of some 17K+ members forming part of 20+ hubs in major cities around the world. Our community is broad and diverse in areas of work and interest from designers, innovators, and entrepreneurs, to researchers and management but they all share a common interest in learning and applying systems thinking ideas. The Si platform is developed and managed by a small core team based in London UK. We are registered as a business but operate as a social enterprise focused on our purpose of advancing the area of systems innovation in theory and practice. Core Value Creativity - We put creativity at the centre of what we do. Holding a space for curiosity, diversity of views, exploration and critical thinking as a pathway to transformative innovation. Openness - We strongly believe in openness in our ways of being, thinking and organizing as a sustainable pathway to creating an adaptive, scalable and dynamic community. Growth Mindset - We embrace challenges as opportunities for continuous personal and collective learning and development, with a never-ending potential to grow and start with a new beginning. Perseverance - When facing uncertainty and failure, perseverance is what is needed to maintain commitment and a resilient pathway aligned with our purpose. Care - Care is one of our core principles. We foster relationships based on honesty and empathy, striving to be present and conscious in what we do and taking responsibility for the effects of our actions.

Online Learning and collaborative platform for systems thinking and systems change - SI (Systems Innovation, 2021)

Improving the Evaluability of INGO Empowerment and Accountability Programmes - Shutt, Cathy; McGee, Rosemary (Centre for Development Impact, 2013)

Towards an Alternative Development Management Paradigm? - Shutt, Cathy (Expertgruppen för biståndsanalys (EBA), 2016)
Demonstrating results has been a concern in international development cooperation ever since it was started and in recent years there has been an increased focus on achieving and reporting on “results”. Despite the fact that everyone involved in development cooperation wants to make a difference there has been a growing criticism from practitioners about the “results agenda” based on a concern that the approaches used are not fit for purpose. In the EBA-report, Cathy Shutt, at the University of Sussex, scrutinizes the recent critical debate about results based management, and the main arguments and motives behind the criticism. She shows that the debate is not only a matter of obsessive measurement and reporting of meaningless numbers for political accountability, but also a matter of problematic assumptions and how we think about development, evidence and learning. In the report, Shutt also explores what could be learned from those who are not just critiquing results based management approaches but also proposing alternatives. Are these new alternatives an answer to the criticism?
Keywords: IMPORTANT

Bringing children into the life story collection process - Shrestha, Kapil (CLARISSA, 2021)
The CLARISSA Social Protection (SP) intervention provided six months of unconditional cash transfers to every household in the Gojmohol neighbourhood,...

The Art of Agile Development - Shore, James; Warden, Shane (O'Reilly Media, 2007)
The Art of Agile Development contains practical guidance for anyone considering or applying agile development for building valuable software. Plenty of books describe what agile development is or why it helps software projects succeed, but very few combine information for developers, managers, testers, and customers into a single package that they can apply directly. This book provides no-nonsense advice on agile planning, development, delivery, and management taken from the authors' many years of experience with Extreme Programming (XP). You get a gestalt view of the agile development process, including comprehensive guidance for non-technical readers and hands-on technical practices for developers and testers. The Art of Agile Development gives you clear answers to questions such as: How can we adopt agile development? Do we really need to pair program? What metrics should we report? What if I can't get my customer to participate? How much documentation should we write? When do we design and architect? As a non-developer, how should I work with my agile team? Where is my product roadmap? How does QA fit in? The book teaches you how to adopt XP practices, describes each practice in detail, then discusses principles that will allow you to modify XP and create your own agile method. In particular, this book tackles the difficult aspects of agile development: the need for cooperation and trust among team members. Whether you're currently part of an agile team, working with an agile team, or interested in agile development, this book provides the practical tips you need to start practicing agile development. As your experience grows, the book will grow with you, providing exercises and information that will teach you first to understand the rules of agile development, break them, and ultimately abandon rules altogether as you master the art of agile development."Jim Shore and Shane Warden expertly explain the practices and benefits of Extreme Programming. They offer advice from their real-world experiences in leading teams. They answer questions about the practices and show contraindications - ways that a practice may be mis-applied. They offer alternatives you can try if there are impediments to applying a practice, such as the lack of an on-site customer.–Ken Pugh, Author of Jolt Award Winner, Prefactoring "I will leave a copy of this book with every team I visit."–Brian Marick, Exampler Consulting
Keywords: IMPORTANT

Conflict Aid Goes “Lean” - Shinkle, Whitney (Stanford Social Innovation Review, 2017)
Iterative design methods are essential to development work—even (or especially) in regions marked by war and violence.

Scenarios: An Explorer's Guide - Shell International (Shell International BV, 2008)
Exploring the Future The future is ‘terra incognita’: although we may be able to guess the outcome of events that lie close to us, as we project beyond this we enter an unmapped zone full of uncertainty. Paradoxically, the range of options this reveals can seem paralysing. No one can definitively map the future, but we can explore the possibilities in ways that are specifically intended to support decision-making. At Shell we use scenario building to help us wrestle with the developments and behaviours that shape what the future may hold and prepare ourselves more effectively. We also believe it can inspire individuals and organisations to play a more active role in shaping a better future - for themselves, or even on a global scale. In this book, we use a metaphor of exploration and map-making to describe how we think about building scenarios. Like a set of maps describing different aspects of a landscape, scenarios provide us with a range of perspectives on what might happen, helping us to navigate more successfully. Exploration - of a territory or the future - involves both analytical thinking rooted in whatever facts are clear, and also informed intuition. This book describes the approach used to develop a set of global scenarios, ‘People and Connections’ several years ago under the guidance of Ged Davis. Since then, scenarios guided by Albert Bressand have been published, and more recently Shell has published a summary of its Energy Scenarios, ‘Scramble’ and ‘Blueprints’, developed under the guidance of the current leadership. These have built on, and extended, our approach. Indeed, Shell has been working with scenarios for almost 40 years, and we are still learning. Since the environment we live and work in is constantly changing, building scenarios demands continual innovation and creativity.

Is your evidence robust enough? Questions for policy makers and practitioners - Shaxson, Louise (Evidence & Policy: A Journal of Research, Debate and Practice, 2005)
This article examines the reasons we need evidence for policy, discusses where evidence is needed in the policy-making process, and the nature of the evidence base for strategy and policy. Working relationships between policy makers and their advisers are key: as policy makers come from a variety of backgrounds, developing a common language helps set discussions about the robustness of the evidence base on a sound footing. The article identifies five components of robustness, proposes a series of questions that could be used to address them and discusses the implications for the processes of policy making.

Achieving disability inclusive employment – Are the current approaches deep enough? - Shaw, Jackie; Wickenden, Mary; Thompson, Stephen; Mader, Philip (Journal of International Development, 2022)
Diverse approaches to promoting disability inclusive employment aim to transform workplaces into truly inclusive environments, usually with intervention strategies targeting two main groups: employers and jobseekers with disabilities. However, they do not always consider other relevant stakeholders or address the relationships and interactions between diverse actors in the wider social ecosystem. These approaches often neglect deeper ‘vexing’ difficulties which block progress towards disability inclusive work environments. Most interventions rightly embrace hegemonic ‘social models of disability’ and use human rights arguments but may neglect entrenched structural factors. Disability inclusive employment is complex, with unaddressed invisible aspects that continue to limit progress. We explore some key relevant disability concepts and then interrogate evidence from the ‘Inclusion Works’ programme working in four middle- and low-income countries, considering some intractable barriers underlying the slow movement towards inclusive employment. Finally, we propose that a more participatory action orientated approach involving disabled people and others is needed to both generate deeper understanding and provide pathways towards new solutions to obstinate problems through progressive action learning processes in context. Programmatic interventions that work across the levels of the ecosystem and address power relations and interactions between stakeholders could lead to more substantial forms of disability inclusive employment.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/jid.3692

Opportunities and challenges for DAC members in ‘adapting to context’ - Sharp, Samuel; Wild, Leni (2021)
Key Messages New principles for OECD DAC members on ‘Managing for Sustainable Development Results’ emphasise tailoring result management approaches to different contexts; balancing internal compliance with empowerment at ground level; and adapting implementation in the pursuit of long-term outcomes. However development organisations face numerous challenges in aligning with these principles in practice. Reporting and evidence collection processes do not consistently encourage adaptive practice, reflecting their orientation towards accountability over learning. Context analysis is common during programme design, but used less on an ongoing basis. Popular tools –such as logical frameworks and theories of change - are often intepreted in linear ways, not as ‘living documents’ that react and change over time. Organisations need to meaningfully empower staff to work adaptively, including examining incentives and cultures that can make staff more comfortable with traditional results management. Even when senior leadership is supportive of adaptive ways of working, they can lack a clear understanding of the resourcing required and appropriate governance and management processes. Development organisations and their partners have attempted to address these challenges through the use of different monitoring and evaluation tools and methods, changes to reporting frameworks and templates, and initiatives to create positive incentives and motivate staff, leadership and partners at different levels.
Keywords: _tablet

How DFID can better manage complexity in development programming - Sharp, Samuel; Valters, Craig; Whitty, Brendan (ODI, 2019)
The United Kingdom’s (UK) Department for International Development (DFID) is an ambitious government department that is committed to reducing poverty and conflict overseas. Many of the issues on which DFID works are complex; whether focused on climate change, gender equality, health or other priorities, simple solutions rarely exist. And to tackle these complex challenges, DFID staff must interact with unpredictable systems of political, organisational and individual behaviours and incentives. There is a risk that complex problems spur more complicated programmes; that the complexity of development challenges is addressed through designing programmes with too many projects and implementers. While there may be valid reasons for this, too many of these complicated programmes will overburden staff. This briefing note is the outcome of an ongoing process within DFID to confront these issues and answer the question: how can DFID design and manage programmes to address complex development challenges without creating too much staff workload? Key messages DFID deals with complex problems, which require flexible systems to support testing, learning and adaptation. • Complex problems do not necessarily require workload-heavy delivery structures, but simpler approaches depend on delivery partners’ experience and competence. • However, programmes that tackle complex problems do require more hands-on engagement and face more workload from inflexible compliance requirements. We suggest that DFID and similar agencies: • Pay closer attention to delivery options in programme design, making use of existing options where possible and, where not, fostering local organisations through long-term investments. • Encourage programme designers to articulate how ambition matches resources and consider ‘good enough’ design. • Reduce the burden of compliance by cultivating partner autonomy, reassessing results and valuefor-money requirements and promoting more flexible contracting and procurement. • Plan and prioritise management resources across a portfolio of programmes to make sure they can be focused in the right areas, where the complexity of the problem requires greater engagement.

Evidence-led adaptive programming: Lessons from MUVA - Sharp, Samuel; Riemenschneider, Nils; Selvester, Kerry (ODI, 2022)
Calls for more ‘adaptive programming’ have been prominent in international development practice for over a decade. Learning-by-doing is a crucial element of this, but programmes have often found it challenging to become more learning oriented. Establishing some form of reflective practice, against countervailing incentives, is difficult. Incorporating data collection processes that generate useful, timely and practical information to inform these reflections is even more so.This paper explores MUVA - an adaptive female economic empowerment programme in Mozambique. MUVA, we suggest, is atypically evidence-led. It combines systematic, inclusive reflective practice with extensive real-time data collection. We describe the fundamental features of MUVA’s monitoring, evaluation and learning (MEL) approach that supported this. One, how data collection and analysis are synchronised with set cycles for learning and adapting projects. Two, how MEL systems are designed to prioritise actionable learning, with data collection oriented more to the needs of implementing staff than to the reporting requirements of funders.This approach was enabled by building collective ownership over the programme’s objectives and the purpose of MEL from the outset. Implementers are asked about their motivations, and these are related to the programme’s Theory of Change. The evidence culture is supported by the proximity of MEL staff to implementing staff; and through structuring upwards accountability to funders around justifying evidence-based adaptations instead of reporting on more narrow indicators. We conclude by considering the relevance, or not, of MUVA’s approach to programmes in other contexts or issue areas trying to replicate a similarly evidence-informed approach to adaptive management. Key messages Learning-by-doing is essential to adaptive programming, but it can be challenging to establish data collection processes that generate useful, timely and practical information. MUVA – a female economic empowerment programme in Mozambique – has an atypically evidence-led adaptive management approach. This has two fundamental features. One, data collection and analysis are synchronised with set cycles for learning and adapting projects. Two, data collection is oriented more to the needs of implementing staff than to the reporting requirements of funders. Monitoring, evaluation and learning (MEL) systems are designed to prioritise actionable learning. This approach was enabled by building collective ownership over the programme’s objectives and the purpose of MEL from the outset. Implementers are asked about their motivations, and these are related to the programme’s Theory of Change. The evidence culture is supported by the proximity of MEL staff to implementing staff; and through structuring upwards accountability to funders around justifying evidence-based adaptations instead of reporting on more narrow indicators.

Lessons learned from PERL and partners' response to the COVID-19 crisis - Sharp, Samuel; Nwachukwu, Tochukwu; Srivatsa, Sripriya Iyengar (PERL Programme, 2021)
The first case of COVID-19 in Nigeria was confirmed on 27 February 2020, with the first lockdown orders issued on 30 March 2020. The pandemic and resultant containment measures have had farreaching socio-cultural, economic, financial and political implications, globally as well as in Nigeria. For the Partnership to Engage, Reform and Learn (PERL) and its partners, the pandemic has required considerable adaptation of their strategic approach and working practices. This report reflects on how COVID-19 changed the operating context for PERL’s partners, how PERL responded and what lessons have been learned across delivery teams. For government partners, the most substantial impacts have been to budgets, struck by falling oil prices and reduced economic activity. Universally, states have had to adjust budgets and reforecast, revising budgets downwards and shifting the focus of expenditure towards healthcare. The World Bank’s State Fiscal Transparency, Accountability and Sustainability (SFTAS) Programme has generated powerful incentives for this budget revision, which PERL has been able to work alongside. A range of new governance structures – such as public response committees and task forces – have been established to deal with various aspects of COVID-19 policy, and PERL has had to grapple to maintain its ongoing engagement with these. For civil society organisations (CSOs), the closure of offices from 30 March 2020 has changed the nature of engagement with government. CSOs often developed innovative approaches to maintaining access, including use of social media and direct calls. But the shift to virtual working has been challenging for many CSOs, both in terms of covering the costs of data for virtual meetings and the risks of disengagement and marginalisation for some organisations. In response to this changed context, from March 2020 PERL began to restrategise. The flexible nature of the programme’s workplans, progress markers and budgets enabled activities to be adjusted in a relatively timely manner, with a new workplan approved by the end of April 2020. Central PERL management developed a COVID-19 response strategy which provided a broad framework for adaptations, but allowed substantial autonomy to state and regional teams to lead on reprioritisation according to their understanding of the local context. This was valued by both management and delivery staff. Challenges manifested themselves more in effectively delivering on these adapted workplans than in the process of restrategising – due to two rounds of budget cuts, the merger of DFID and the FCO to form the Foreign, Commonwealth and Development Office (FCDO) and the difficulties of engaging partners virtually. Overall, the pandemic undoubtedly delayed activities (by roughly three months for deprioritised areas of work), but resulted in an array of new, tailored interventions under its broad categories of work. Interventions relating to the health sector became more prevalent, as did work supporting budget adjustments. Domestic resource mobilisation and education interventions were often adjusted to be more relevant to the COVID context or experienced delay. The report provides short illustrative case studies of PERL’s adaptations to: support budget revisions; work with media partners on COVID-19 sensitisation; tracking and advocacy for palliative distribution; and support for the introduction of tax relief. There is some evidence, albeit partial, that PERL was able to take advantage of windows of opportunity offered by the pandemic to drive ahead with certain ongoing reform initiatives.

USAID/Colombia Introduces Political Economy Analysis to Better Adapt Programming to Local Contexts - Sharp, Preston (USAID, 2015)

How do we know we are doing good work? - Sharp, Cathy; McLaughlin, Dot; Whitley, Janet; Lawson, Karen (Collective Leadership for Scotland, 2022)
Collective leadership feels timely and important in an uncertain, fast changing, and challenging world. This report comes at this heightened moment of urgency and appetite for renewal, bringing potential to do things differently in public services and communities. The opportunities and challenges of true collaboration-in-practice, in the absence of blueprints, mean that it has never been more necessary to change ways of working and foreground learning. As outcomes remain important, and time and resources are scarcer than ever, the approach of collective leadership makes the creation of impact a shared, conscious, and actionable choice. A pathway to ultimate impact at scale is co-created through dialogue about expectations and contributions, and by design, not assuming change will happen because we have good intentions. Collective Leadership for Scotland (CLfS) has a strong vision and enjoys continuing active interest, drawing together participants from a variety of agencies working in public services. People are looking for fresh thinking, space and time for reflection, connection with others, a chance to think about how to tackle difficulties, and to test out what it takes to do, and continue to do, the work of collaborative public service. These motivations are deepened and brought into sharper focus by the pandemic, with an added interest in developing skills in online facilitation. CLfS contributes to building a critical mass for system change, to help to sustain the ambitions of the Christie Commission and the delivery of the National Outcomes for Scotland. There remains further potential to realise wider and deeper impact amongst organisations, communities, and wider systems. The conclusions of this report are likely to have wider resonance beyond interests in the CLfS programmes. This report deepens understanding of some of the challenges of commissioning, convening, and the scope for deeper impact through building reflective and relational leadership practices. It also outlines social and experiential sensemaking and facilitation practices to strengthen the action inquiry approach as a deliberate learning strategy, building cultures that support new forms of collaborative inquiry and systemic action research.

Be a participant not a spectator - Sharp, Cathy (The Evaluator - UK Evaluation Society, 2022)
My focus here is on the realities of evaluating in complexity where ‘nothing is clear, and everything keeps changing’. I outline how I use a series of ‘provocations’ that allow people to choose their own starting point. Sharing those choices fuels conversations that discover, explore, and co-create (rather than manage) our mutual expectations and assumptions and track how these might themselves be influenced by the work as it unfolds. This account draws on a review of literature and my practice experience, including reflections from others brought into local, national, and international conversations about what it means for evaluation to recognise complexity.

Exploring new territories for evaluation - Sharp, Cathy (Collective Leadership for Scotland, 2018)
Drawing on action research, this paper recasts evaluation as ‘action inquiry’, an embedded evaluative learning practice that can help navigate complexity when enacting collective leadership. It is offered as an invitation to inquiry amongst a reasonably well-informed audience of policy makers and practitioners who work in and for public services. It will particularly interest those who provide research, evaluation and facilitation support, and those seeking to develop a more relational approach to research and evaluation. Action inquiry is a model of practising change together in environments where ‘nothing is clear, and everything keeps changing’ that significantly challenges the prevailing discourse on evaluation. Action inquiry can be wrapped around and enmeshed within initiatives and programmes that work with complexity - anywhere where success will depend on the quality of relationships that can be developed. The paper reviews some important interrelated concepts that underpin the ideals of collective leadership and public service reform and which confront deeply embedded traditional notions of leadership, expertise and participation. These offer important challenges to ideas about how change happens and recognise that relationships are at the heart of practising change. This warrants a re-examination of the high expectations of evidence-based or informed practice. Collective leadership makes new demands of evidence as it rests on help to determine ‘wise actions’ in real-life situations. This confronts the practical reality of how to work together in conditions often expressed as ‘dynamic’ or ‘turbulent’ and the added human complexities of power, emotions and relationships; too often these elements are denied or avoided aspects of a change process. Facilitated action inquiry makes these elements part of the conversations, in the midst of ‘work-as-we-are-doing-it’, to increase areas of choice for individuals and a group as a whole. Within public policy, there is an overwhelming amount of evidence about ‘what works’ yet change seems to be stubborn and slow. The paper explores some of the deep-rooted vestiges of a ‘hierarchy of evidence’ and assumptions about standardisation and generalisability that act as a ‘barrier to transformation’. These include the narrow framing of what counts as evidence and consequent relegation of community perspectives, lived experience and practice-based evidence. The paper acknowledges the clear appetite for different approaches to evaluation, especially those that better reflect deeply held values and avoid creating a culture of ‘gaming’, rooted in fear of failure and loss of funding, at the expense of learning. The need for new forms of developmental evaluative thinking, collaborative inquiry and action research to create embedded learning is well overdue. Action inquiry is a desirable and necessary response to the complex situations and challenges of human services and recognises the essentialness of knowledge co-production. It is a model of co-creation at every stage and endorses the idea that people learn from participation in evaluation and by testing theories of change through action. Action inquiry builds on the idea of inquiry, or a moment-to-moment awareness and quality of attention and draws from several elements of action research practice. It sees inquiry as an intervention in itself, one that furthermore, explicitly seeks to enhance the probability of the success of a programme, focus on learning, the collaborative development of practice-based knowledge and positive relationships. The paper highlights the importance of building inquiry into living systems, the role of facilitation, systemic inquiry, and evaluative thinking. It proposes an expansion of ideas of appreciation as a relational and collaborative practice that is a driver of emergence. Social recognition that acknowledges someone’s social value to the community and implies mutual moral obligations to cooperation and participation is particularly crucial in a work context that requires successful coordination and multiple contributions to achieve results across hierarchies of position, professional rank and sectors. Hence, appreciation goes beyond the idea of positivity to include social recognition, valuing more explicit forms of inquiry, building participants’ aspirations to design new social systems and acting in new ways to embed change. In developing this discussion, the paper contributes to emerging dialogues about the need for a model of ‘5th generation evaluation’. Such a model would be based on the idea that appreciative and challenging inquiry that is contextual, relational and open-minded will create better opportunities for change and development. The paper sets out some ‘provocative propositions’ that can help us to navigate this terrain, perhaps of a fledgling ‘5th generation approach’ to inquiry. Facilitated action inquiry can hold the key to developing both new knowledge and an adaptive, collaborative and improvisational skill-set, able to respond in new ways to systemic and complex issues on the ground. It’s common to hear the expression ‘it’s all about relationships’ and it is clearly time to shift our focus to relationships; not relationships as ‘things’, but as co-created and dynamic relational processes in which we are embedded. In this way we can bring new qualities to our talking to each other about our various and shared visions of a better future.

Exploring new territories for evaluation - Provocative propositions - Sharp, Cathy (2018)

Practising change together – where nothing is clear, and everything keeps changing - Sharp, Cathy (Action Learning: Research and Practice, 2020)
This paper explores the thinking and practice of ‘action inquiry’ an embedded learning practice that can help navigate complexity when practising change together. The paper uses examples from social contexts where there are concerns about community wellbeing and health care. These are drawn from collaborative or collective leadership development programmes within public services that seek to bring new attention to the qualities of how people think, converse and interact, as part of their collective professional practice. This treats social action as a relational and dialogical practice, something that we do together as professionals by engaging in reflective inquiry and action. The paper suggests that action inquiry offers a prospect of rekindling the links between ‘action learning’ and collaborative leadership by developing a co-mission and a mutual commitment to a new type of learning partnership. Action inquiry can be wrapped around and enmeshed within initiatives and programmes that work with complexity, anywhere where effective social action will depend on the quality of relationships that can be developed. This research was funded by two separate Scottish Government commissions, where the author was a learning partner. The paper also draws on the further reflections of some of the practitioners most centrally involved.
Publisher: Routledge _eprint: https://doi.org/10.1080/14767333.2020.1712838

Glossary of Knowledge Management - Serrat, Olivier (Knowledge Solutions: Tools, Methods, and Approaches to Drive Organizational Performance, 2017)
The knowledge management discipline can be cryptic. These Knowledge Solutions define its most common concepts in simple terms.
Keywords: Definitions; Knowledge management; Taxonomy; Terminology

Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments - Serpe, Lauren; Ingram, Mason; Byom, Kate (New Directions for Evaluation, 2022)
This chapter examines good practices in implementing effective Monitoring, Evaluation, and Learning (MEL) systems within complex international development Democracy, Human Rights, and Governance (DRG) programs, which are characterized by challenges of non-linearity, limited evidence of theories of change, and contextual and politically contingent nature of outcomes. The chapter presents three cases of MEL systems in complex projects implemented by Pact across distinct and diverse operating contexts – Zimbabwe, Cambodia, and Somalia – to illustrate those projects’ MEL approaches that enabled continuous adaptation. The authors analyze the cases to respond to two questions: (1) What are the key elements of effective adaptive management-focused MEL systems in complex environments? (2) What is practical guidance for designing and enabling complexity-responsive and effective adaptive management-focused MEL systems? The case studies illustrate three key elements: (1) Information gathering that closely links context, research, and performance data; (2) Systems for reflection that offer scheduled learning moments of varying frequency and intensity, as well as multiple feedback mechanisms; and (3) Enabling structures that promote adaptive mindsets and attitudes within project teams.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/ev.20523

What We Do: Getting Beyond Statistics - Sense Guide (Sensemaker narrative monitoring, 2018)
Our approach Understanding daily life reality with micro-narratives Narratives and more specifically micro-narratives are a fundamental and ancient way by which humans interpret their experience and make decisions. SenseMaker® provides the ability to capture and understand those narratives. Through the web or app environment the software allows the capture of pictures, recordings and writing in various combinations to reflect how the respondents are making sense of the world. Reducing cognitive bias with self signification In a patented method, the respondent then interprets their own story into a series of abstract constructs (‘signifiers’) that feel more like a game than a survey, but allow profound meaning to emerge. This interpretation adds layers of meaning rather than simply interpreting the story and provides quantitative data to detect visual patterns among stories. The patterns are linked back to the original material enabling a deeper dive into individual stories. If the researcher first look for patterns in the metadata using statistical or visual tools, he or she is less likely to be biased by content and prematurely converge on an interpretation. Evidence based insights that enables action The output of SenseMaker® is statistical data backed up by explanatory narrative. This means that advocacy is an integral part of the system. Numbers on their own appear objective but are not persuasive; anecdotes on their own may be persuasive but are not objective. SenseMaker® puts the two together and provides a powerful means of persuasion. It also enables action. Instead of saying “How do we create a culture of X?” we say “How do we create more stories like this and fewer stories like that?” Then, as actions are initiated, we see the impact in real time.

Evaluation for equitable development results - Segone, M (UNICEF, 2011)
This document is made up of a range of Evaluation Working Papers (EWP) focused on evaluation for equitable development. Put together by evaluation specialists they present strategic evaluation findings, lessons learned and innovative approaches and methodologies. Part 1:Evaluation and equity Evaluation to accelerate progress towards equity, social justice and human rights 2 Human rights and gender equality in evaluation 13 When human rights is the starting point for evaluation 25 Strengthening Equity- focused evaluations through insights from feminist theory and approaches 39 Decolonizing evaluation in a developing world. Implications and cautions for Equity-focused evaluations 59 Part 2: Methodological implications for Equity-focused evaluations Methodological issues to design and implement equity-focused evaluations 86 Developmental evaluation for Equity-focused evaluations 102 Systems thinking and Equity-focused evaluations 115 Methodological challenges in using programme theory to evaluate pro-poor and equity-focused programmes by Patricia Rogers, Royal Melbourne Institute of Technology University and Richard Hummelbrunner, Independent consultant 142 Case Study and equity in Evaluationby Saville Kushner, University of the West of Englan 172 Values-Engaged Evaluationsby Jennifer Greene, University of Illinois at Urbana-Champaign 192 Part 3: Examples of Equity-focused evaluations Evaluating the contribution of UNDP to equity-focused public policies in Brazil and China 210 Using a human rights approach to evaluate ILO’s discrimination strategy 222 CONEVAL experience in evaluating interventions for Indigenous populations in Mexico 244 UNICEF supported evaluations with elements of equity-focused evaluations 258

Managing and Adapting a development program: Lessons from PRISMA - Seely, Kevin (PRISMA, 2019)
This case study is part of the AIP-Rural Learning Series. Funders and implementers of international development programs largely agree that adaptive management is industry best practice. Most development experts also broadly agree on what ‘adaptive management’ means. In this case study, we use a common definition of ‘adaptive management’, including the following features: Flexibility. Implementers create, modify and drop interventions when circumstances change or new information emerges, in order to tailor strategies to context and maximise impact. Purposeful experimentation. Implementers test different activities at the same time, monitoring them to learn what will achieve the desired impact. Since 2015, the number of publications calling for and praising adaptive management in development programs has grown fast. These publications give us an idea of the state of adaptive management in development programs. They reveal progress in some areas, such as tailoring interventions to local context and using evidence for decision-making. Yet they also reveal multiple, ongoing, real-world constraints to adaptive management. This case study explores how one development program, PRISMA, has avoided and overcome some of these constraints, whilst continuing to battle others. Four major constraints revealed in the adaptive management literature are discussed in this case study: Programs are designed in ways that make it hard to adapt interventions, target regions or sectors based on new learning or changing circumstances. Programs struggle to create an organisational culture that encourages learning and adapting. When staffing programs, recruiters prioritise sectoral expertise and length of experience over adaptive managerial competence. Program managers face pressures to spend their budgets predictably and before their program ends. Learning and testing take time and cost little, so managers feel pressure to deprioritise them. The first of these constraints is explored in the next section, ‘Design’, which looks at how the selection of target sectors and performance targets affects PRISMA implementers’ ability to manage adaptively. The third section, ‘Organisational Culture’, shares lessons on encouraging staff to test and improve interventions. Section 4, ‘Staffing’, looks at hiring adaptive managers, and freeing up their time to improve interventions. The final section summarises this case study’s key lessons. Throughout this paper, findings are based on 16 in-depth interviews with PRISMA’s junior, mid-level and senior staff, and its funders. To contextualise these findings, the authors reviewed the ‘adaptive management’ literature, and drew on their experience with development programs worldwide.

Adaptive Programming: The “Space of Possibility” - Seavey, Sara Mizuta (USAID Learning Lab, 2016)
Sara Mizuta Seavey, M.A., is a Senior Program Officer at FHI360 for the Mobile Solutions Technical Assistance and Research (mSTAR) project, where she works with USAID’s Digital Development Team to conceive, design, and test how real-time data systems can enable a more adaptive and participatory approach to development. She is passionate about systems thinking and participatory approaches to international development. What does space travel have to do with international development?

Conflict Sensitive Programme Management: A quick guide - SDC (SDC, 2006)

Conflict-sensitive programme management (CSPM) - SDC (2006)

Dispatch on Switzerland's International Cooperation 2017–2020: Key points in brief - SDC (Federal Department of Foreign Affairs FDFA, 2016)
The “Dispatch on Switzerland’s International Cooperation, 2017–2020”, is a report to the Swiss Parliament outlining the strategic priorities proposed by the Federal Council in this area. It includes framework credits for each of the five policy instruments used by Switzerland to implement its international cooperation strategy. These are implemented by the Swiss Agency for Development and Cooperation (SDC) of the Federal Department of Foreign Affairs (FDFA), the Human Security Division (HSD) of the FDFA’s Directorate of Political Affairs, and the State Secretariat for Economic Affairs (SECO) of the Federal Department of Economic Affairs, Education and Research (EAER).

Guidelines for the Monitoring System for Development-Related Changes (MERV) - SDC (SDC, 2013)

Peacebuilding and Statebuilding Strategy for SDC’s work in fragile and conflict contexts - SDC (Swiss Agency for Development and Cooperation SDC, 2015)

Swiss Cooperation Strategy Pakistan, 2017-2019 - SDC (2016)

Was bedeutet “Staying Engaged” im Kontext der aktuellen Krise in Nicaragua? Überlegungen und Strategien der ALAK (Internal memo) - SDC (SDC, 2018)
«Mitigation» (im Sinne von Notlinderung) und «Transformation» sind die zwei Schlagworte, an welchen sich die Neuausrichtung des Portfolios in Nicaragua über die nächsten Monate orientieren wird. Ziel ist es, dass die Schweiz ihr über die letzten Jahrzehnte akquiriertes politisches Kapital und ihre Expertise nutzt, um zu einer Linderung der Auswirkung der Krise für die Bevölkerung beizutragen und mithilft die Grundlagen für eine Transformation der politischen Kultur und eine langfristig angelegte Demokratisierung zu schaffen.

The 2015 State of Scrum Report: How the world is applying the most popular Agile approach to projects - Scrum Alliance (Scrum Alliance, 2015)

The struggle for organisational change: how the ActionAid Accountability, Learning and Planning System emerged - Scott-Villiers, Patta (Policy & Practice, 2002)
Change is driven not only by good ideas, but also by disagreement and frustration. This article takes the reader through a selective organisational history of the British NGO ActionAid from 1998 to 2001, looking at events and changes that had a bearing on the

Strategy Deployment and Spotify Rhythm - Scotl, Karl (AvailAgility, 2016)
Last month, Henrik Kniberg posted slides from a talk he gave at Agile Sverige on something called Spotify Rhythm - "Spotify’s current approach to getting aligned as a company". While looking through the material, it struck me that what he was describing was a form of Strategy Deployment. This interpretation is based purely on those slides - I haven't had a chance yet to explore this more deeply with Henrik or anyone else from Spotify. I hope I will do some day, but given that caveat, here's how I currently understand the approach in terms of the X-Matrix Model.

The Politics of Uncertainty : Challenges of Transformation - Scoones, Ian; Stirling, Andy; Stirling, Andy (Routledge, 2020)
Why is uncertainty so important to politics today? To explore the underlying reasons, issues and challenges, this book’s chapters address finance and banking,

What is Uncertainty and Why Does it Matter? - Scoones, Ian (STEPS centre, 2019)
Uncertainty defines our times. Whether it is in relation to climate change, disease outbreaks, financial volatility, natural disasters or political settlements, every media headline seems to assert that things are uncertain, and increasingly so. Uncertainty, where we do not know the probabilities of either likelihoods or outcomes, is different to risk, the implications of which are explored in this paper through five different ways of thinking about uncertainty, derived from highly diverse literatures encompassing societal, political, cultural, practice and individual perspectives. The paper continues by examining how these perspectives relate to four domains: finance and banking; critical infrastructures; disease outbreaks and climate change; natural hazards and disasters. Reflecting on these experiences, the paper argues that embracing uncertainty raises some fundamental challenges. It means questioning simple, linear perspectives on modernity and progress. It means rethinking expertise and including diverse knowledges in deliberations about the future. It means understanding how uncertainties emerge in social, political and economic contexts, and how uncertainties affect different people, depending on class, gender, race, age and other dimensions of social difference. And, if uncertainty is not reducible to probabilistic risk, it means a radically different approach to governance; one that rejects control-oriented, technocratic approaches in favour of more tentative, adaptive, hopeful and caring responses. The paper concludes by asking whether we can learn from those who live with and from uncertainty – including pastoralists in marginal settings – as part of a wider conversation about embracing uncertainties to meet the challenges of our turbulent world.

The Scrum Guide - Schwaber, Ken; Sutherland, Jeff (scrum.org, 2016)

Small is beautiful: economics as if people mattered - Schumacher, Ernst Friedrich (Blond & Briggs, 1973)

Lives Amid Violence: Transforming Development in the Wake of Conflict - Schomerus, Mareike (2022)
Violent conflict and its aftermath are pressing problems, particularly for international development initiatives. However, the results of development in conflict contexts have generally been disappointing and their preventative potential thus questionable. Available Open Access, Lives Amid Violence argues that this is because practitioners adhere to a mental model that emphasises linearity, certainty, and causality, assuming that violence is best addressed through work plans that deliver state-building, stabilisation and services. Based on ten years of multi-method research from, in, and on conflict-affected countries, this book challenges this approach.Drawing on a significant collaborative body of scholarship, this work puts forward original and generalizable conclusions about how lives amid violence persist, offering an invitation to abandon restricting mental models and to embrace creative ways of thinking and working. These include paying attention to the long-term effects of conflict on individual behaviour and decision-making, the social realities of economic life, the role service delivery plays in negotiations between citizens and states, and to creating meaningful relationships. Transformation also requires reflection and therefore the book concludes with constructive suggestions on how to practice these insights to better support those whose lives are shaped by violence.More details are available at www.transformingdevelopment.orgThe eBook editions of this book are available open access under a CC BY-NC-ND 3.0 licence on bloomsburycollections.com.

Making design core to the agile process: a look into how we built Salesforce's Lightning Experience - Schoen, Ian (Medium, 2016)
A look into how we built Salesforce’s Lightning Experience

How to Make Sense of Weak Signals - Schoemaker, Paul J. H.; Day, George S. (MIT Sloan Management Review, 2009)
Keywords: IMPORTANT

Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis - Schneider, Carsten Q.; Wagemann, Claudius (Cambridge Univ. Press, 2012)
"Qualitative Comparative Analysis (QCA) and other set-theoretic methods distinguish themselves from other approaches to the study of social phenomena by using sets and the search for set relations. In virtually all social science fields, statements about social phenomena can be framed in terms of set relations, and using set-theoretic methods to investigate these statements is therefore highly valuable. This book guides readers through the basic principles of set theory and then on to the applied practices of QCA. It provides a thorough understanding of basic and advanced issues in set-theoretic methods together with tricks of the trade, software handling and exercises. Most arguments are introduced using examples from existing research. The use of QCA is increasing rapidly and the application of set-theory is both fruitful and still widely misunderstood in current empirical comparative social research. This book provides an invaluable guide to these methods for researchers across the social sciences"–
Keywords: Comparative method; Mathematical models; Qualitative Methode; Set theory; Social science; Vergleichende Forschung

The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill? - Schmitt, Johannes (New Directions for Evaluation, 2020)
Despite increased discussions in the community and a common understanding about the virtue of mechanism-based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two-way classification of causal mechanisms along which the chapters to this issue are structured. The chapter continues by introducing the Causal Mechanism Claim and elaborates on how analyzing causal mechanisms is expected to increase policy relevance and causal capacity in evaluations. Drawing on this issue's rich corpus of firsthand practical experience, this introduction synthesizes key lessons that support or contradict the Causal Mechanism Claim. We find that both parts of the claim—increased policy relevance and strengthened causal capacity—are supported by the authors' experiences as bundled in this issue. However, we also identify challenges related to cross-cutting issues such as communication and practical applicability and point to the importance of method integration.

Independent Evaluation of SDC’s Results-Based Management System with a Focus on Poverty Reduction - Schmidt, Martin; Palenberg, Markus; Vähämäki, Janet (SDC, 2017)
The SDC's results-based management system ensures that the processes and instruments used for the design and implementation of programs and projects contribute to achieving the desired results (outputs, outcomes and impact). The independent evaluation examines the extent to which these processes and tools have fostered the results culture within the organization, and improved competencies for results-based management decisions, learning and communication. In addition to the findings, conclusions and recommendations, the evaluation report includes the management response of SDC’s Directorate.

Special Issue: Causal Mechanisms in Program Evaluation - Schmidt, Johannes (New Directions for Evaluation, 2020)
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/ev.20357

(Draft) Managing to Adapt - Analysing Adaptive Management for Planning, Monitoring, Evaluation, and Learning (draft) - Schlingheider, Annika; Pellfolk, Erica; Maneo, Gabriele; Desai, Harsh (Oxfam, 2017)
Adaptive management is at the heart of ‘doing development differently’ (Wild et al., 2016). Whether it is here to stay depends on how much it is mainstreamed into existing development programming by donors and implementers alike, especially in planning, monitoring, evaluation, and learning (PMEL) cycles. In this report, we find that mainstreaming adaptive management in PMEL involves three strategies: 1. planning for flexibility; 2. developing locally owned monitoring and evaluation (M&E); and 3. creating an enabling environment for learning. Adopting these strategies contributes to virtuous cycles of PMEL

ING’s agile transformation - Schlatmann, Bart (McKinsey Quarterly, 2017)
Two senior executives from the global bank describe their recent journey.

Qualitative comparative analysis: A valuable approach to add to the evaluator’s toolbox? Lessons from recent applications - Schatz, Florian; Welle, Katharina (IDS, 2016)

Rapid Results!: How 100-Day Projects Build the Capacity for Large-Scale Change - Schaffer, Robert H.; Ashkenas, Ron (Jossey-Bass, 2005)
Rapid Results! shows how to make large-scale changes succeed by using 100-day results-producing projects to develop this vital implementation capability. Written by Robert H. Schaffer, Ronald N. Ashkenas, and their associates—leaders in the field of change management—Rapid Results! describes an approach that has been field-tested by real organizations of every size and description to improve performance and speed the pace of change. Rapid results projects produce results quickly, introduce new work patterns, and enable participants to learn a variety of lessons about managing change. Step by step, the book describes how the use of rapid-cycle, or 100-day, projects will multiply your organization’s power to succeed at large-scale change. Schaffer and Ashkenas specifically outline the concept behind 100-day projects and show you how to Set up the architecture to implement rapid results projects Improve operational performance and also attain hard results in the soft areas of management Build rapid results into major organizational change such as reorganization, acquisition integration, and international development Use rapid results to drive leadership development and culture change

Affordances Explained - Scarantino, Andrea (Philosophy of Science, 2003)
I examine the central theoretical construct of ecological psychology, the concept of an affordance. In the first part of the paper, I illustrate the role affordances play in Gibson's theory of perception. In the second part, I argue that affordances are to be understood as dispositional properties, and explain what I take to be their characteristic background circumstances, triggering circumstances and manifestations. The main purpose of my analysis is to give affordances a theoretical identity enriched by Gibson's visionary insight, but independent of the most controversial claims of the Gibsonian movement.

Scaled Agile Framework – SAFe for Lean Software and System Engineering 4.5 - Scaled Agile (2017)

Life Stories From Children Working in Bangladesh’s Leather Sector and its Neighbourhoods: Told and Analysed by Children - Sayem, Mashrique; Sayed, Sayma; Maksud, A. K. M.; Reaz Hossain, Khandaker; Afroze, Jiniya; Burns, Danny; Raw, Anna; Hacker, Elizabeth (Institute of Development Studies, 2023)
CLARISSA (Child Labour: Action-Research-Innovation in South and South-Eastern Asia) has a participatory and child-centred approach that supports children to gather evidence, analyse it themselves and generate solutions to the problems they identify. The life story collection and collective analysis processes supported children engaged in the worst forms of child labour in Bangladesh to share and analyse their life stories. Over 400 life stories were collected from children who worked in the leather supply chain, or who lived and worked in leather sector neighbourhoods. Using causal mapping, 53 children who were engaged in or had experience of the worst forms of child labour collectively analysed the data. This resulted in children’s life stories becoming the evidence base for revealing macro‑level system dynamics that drive the worst forms of child labour. This paper is a record of the children’s analysis of the life stories and key themes they identified, which formed the basis of a series of seven child-led Participatory Action Research groups.
Accepted: 2023-11-07T09:14:57Z Publisher: Institute of Development Studies

Learning from Life Story Collection and Analysis with Children who Work in the Leather Sector in Bangladesh - Sayem, Mashrique; Paul, Sukanta; Apgar, Marina; Snijder, Mieke (2022)
CLARISSA (Child Labour: Action-Research-Innovation in South and South-eastern Asia) is a participatory evidence and innovation generating programme. We are generating evidence on the drivers of the worst forms of child labour (WFCL) and exploring how to address them through participatory Action Research (PAR) with children and other stakeholders in the leather supply chain in Dhaka, Bangladesh. Our main intervention modality is Systemic Action Research (SAR) (Burns, 2007), of which life story collection and analysis (LSC&A) is the first step in our participatory design that will inform child-led PAR groups which will become the engines of innovative responses to WFCL. The LSC&A methodology is a storytelling and story listening methodology and was chosen because of the universal power of stories to make sense of complex realities and seek new futures. People across the world like to tell their stories; they like to feel listened to and they are interested in how their story connects and compares to others. By collecting and analysing stories from hundreds of children in WFCL we can visualise the bigger system that each individual story is connected to. We hypothesize that through engagement in the process of telling, listening, collecting, and analysing life stories, children engaged in harmful and hazardous work will use their understanding of systems dynamics to move into creating their own solutions to the drivers of WFCL. In 2021 in Bangladesh, we collected 405 life stories from children living in Hazaribagh, Hemayetpur, Lalbagh, and Bhairab in Dhaka, with more than one hundred of these stories collected by children themselves. Following the story collection and transcription, children were supported by the CLARISSA implementation team to collectively analyse the stories through identifying critical ‘factors’ (events which have causes and consequences) and understanding how they causally relate to each other. The analysis of the 405 life stories resulted in the development of large system maps that illustrate all the causal dynamics that underpin lived experiences of WFCL. Based on the systemic analysis process the children identified themes of the PAR to be set up in their localities. Our experience with the LSC&A methodology is the first in the context of children in WFCL. The methodology has been used in one other project in Bangladesh to date. We therefore intentionally aimed to learn from the implementation process and to evaluate if and how the telling of, listening to, collecting and analysing of life stories is empowering and in turn whether it leads to increased ownership of the problems which motivates collective action (Burns, 2021). In this learning note we share our methodological learning and reflect on operational implications for designing and facilitating an LSC&A process with children which we hope will support adaptation and use of the methodology by others working in participatory programming with children.
Accepted: 2022-07-21T08:43:41Z Publisher: Institute of Development Studies

Introduction to SAVI's way of working - State Accountability and Voice Initiative (SAVI) - SAVI (DFID, 2015)
We are piloting a new approach to identifying and supporting our partners. This breaks with convention in many ways in order to improve impact. SAVI Approach Papers summarise key aspects of SAVI’s way of working. They explain what we do, and why – and link to relevant tools and frameworks. Our approach is summarized in...
Keywords: Practice

Nigeria Public Sector Accountability and Governance Programme - Business Case - SAVI (DFID, 2016)
In May 2016, SAVI transitioned into a successor programme – the ‘Engaged Citizens Pillar’ (ECP) of a wider DFID-funded governance reform programme ‘The Partnership to Engage, Reform and Learn’ (PERL). ECP is managed by the same service provider, Palladium, and the same core management team as SAVI, and many of the SAVI front line staff...

SAVI Approach Paper 1: Core Values - SAVI (London, 2015)
Governance reform is about government and citizens working together in more responsive, inclusive and accountable ways for the benefit of citizens. More responsive, inclusive and accountable attitudes and behaviour on the part of government and non-government stakeholders are the critical factors which lead to meaningful reform processes, and replicate and sustain reforms beyond the lifetime...

SAVI Approach Paper 10: Engaging State Governments - SAVI (DFID, 2015)
SAVI as a programme does not directly work with state governments – but we work in close conjunction with sister programmes who are supporting state governments on governance and sector reforms. SAVI supports non-government and SHoA partners to play their part in promoting more responsive, inclusive and accountable state governance delivering better services for citizens....

SAVI Approach Paper 11: Managing and Staffing an Adaptive Citizen Engagement Programme - SAVI (DFID, 2016)
SAVI, a DFID funded programme implemented by Palladium, is an adaptive programme putting learning and adaptation at the centre of all decision-making. In relation to management and staffing SAVI has established the following approaches to facilitate this: – An adaptive approach to programme management: Full time strategic technical leadership, that works closely with and complements...