Monitor, learn and adapt
Track and evaluate implementation and performance for continuous improvement
Description
Having implemented their strategy and activities for managing impact
The effect(s) of organisations' actions on people and the natural environment. A term used by the Platform to group enterprises, investors and financial institutions of all types. Source: Impact Management PlatformImpact
Organisation
Tracking practice
This involves the repeated measurement of an organisation’s practice indicators, to inform whether the implementation of its activities
Everything that organisations do, including operations, the procurement of inputs, the sale and provision of products and/or services, as well as any supporting activities The resources and relationships that organisations draw upon for their business activities, as well as the contextual elements that define their business activities. The direct result of organisations’ activities, including their products, services and any by-products.Activities
Input
Output
Tracking performance
This involves understanding an organisation’s performance in relation to an identified impact topic over time. The repeated measurement of the organisations’ outcomes
Usage #1 A change or event resulting from organisations’ activities and outputs, providing a causal link between the activities/outputs and their impact(s) on people and/or the natural environment Usage #2 The level of well-being experienced by people or condition of the natural environment that results from the actions of the organisation, as well as from external factorsOutcome
Example: A clothing manufacturer tracks the implementation of the minimum wages paid in its workforce over time. In doing so, it reviews whether change is positive or negative in direction (whether it has improved or worsened), and it places the level in context relative to a sustainability threshold, in this case the living wage. See Figure 1 for an illustration.
When it is not possible (because of a lack of data) or too soon to measure impacts, measuring a related outcome or even practice indicators (e.g. input, activity or output indicators) enables some tracking of progress. To this end, the causal linkage between practice and performance needs to be well established.
Evaluating practice and performance
In addition to tracking practice and performance over time, organisations need to evaluate whether its activities are effective in achieving its desired outcomes and impacts.
In some cases, the causal relationship between practice and performance is clear (e.g. the emission of greenhouse gases and climate change). In other cases this is less clear, and organisations need to assess whether the activities are leading to the desired outcomes and impacts. This is important to ensure that activities do actually deliver the desired outcomes.
In order to evaluate the effectiveness of their actions, organisations can conduct analyses that leverage counterfactual
The situation or condition which hypothetically may prevail for individuals, organisations, or groups were there no intervention. Measuring the counterfactual answers the question: what would have happened to people or the natural environment if they/it had not interacted with the organisation? Source: OECD Development Assistance CommitteeCounterfactual
Example: An enterprise that implements a diversity and inclusion training programme for its managers may consider the outcomes and impact of its activity by evaluating information on representation, experiences of opportunity and safety in the workforce. The enterprise can track changes in such outcomes and impacts across groups of employees, including among the employees whose managers did receive the training, and those employees whose managers did not (otherwise known as a “control group”). The data gathered against these two groups can show the degree of change, and therefore the effectiveness of the training.
For sustainability-focused organisations with sufficiently close distance to impact, collecting and understanding counterfactual data can also be a means of evaluating whether their organisation is causing a change that would otherwise not occur (versus the change that might have occurred anyway, in the absence of the organisation’s activities). This is known as assessing the organisation’s additionality.
For those sustainability-focused organisations with greater distance to impact (such as impact investors), assessing additionality can be more challenging. These organisations still can and should assess their investment contribution.
Indeed, for all sustainability-focused organisations, assessing their contribution to positive impacts is central to understanding whether they are delivering on their purpose and theory of change.
Example: A social enterprise focused on supporting and increasing the well-being of the elderly may consider its additionality by comparing the level of service provided to the targeted population to the likely level of availability in its absence.
An impact investor supporting the company, by contrast, would need to consider what portion of the increase in the well-being of elderly population is attributable to its investment (in other words, its contribution). This contribution can be put into context using the percentage of ownership by the investor. Further factors, such as investor engagement with company management (for instance, with a view to focusing on specific under-served areas or population sub-groups) also form a part of an investor’s contribution and should be considered in the assessment. See Figure 3 for an illustration.
Overall, evaluating impacts is more challenging for investors and financial institutions than for other enterprises, because of their distance to impact. As a result, these organisations often need to rely solely on tracking practice indicators (i.e. indicators that are linked to their activities and outputs).
Example: A bank that has identified pollution reduction as an impact objective (and is seeking to evaluate its performance) may find it difficult to measure financed pollution. However, it can monitor the evolution of its corporate portfolio; in particular, the portion of its portfolio composed of companies in “key negative” sectors (which it should aspire to phase out) and the portion composed of companies with a clear transition plan and/or in “key positive” sectors (which it should aspire to growing and making the norm).
Adapting practice
Having monitored and evaluated the implementation of their activities and their resulting impact performance, organisations should adapt their practice where necessary, and continue to develop and build on activities that are effective for reaching impact targets.
Resources
Guidance on impact measurement and assessment
Please see the Measure, assess and value action for resources on assessment.
Guidance on measuring and assessing contribution and additionality
Principles of Social Value
The Principles of Social Value guide organisations in considering social value in decision-making, aiming to optimise value for all stakeholders materially affected by their activities. The practice standards help organisations to implement each principle to a point where they are accountable for their activities.
This is a cross-cutting resource, meaning that it supports the internal impact management process as a whole, rather than one or a few of the Actions of Impact Management.
COMPASS: The Methodology for Comparing and Assessing Impact
The Methodology for Comparing and Assessing Impact provides an analytical framework to compare impact performance, with a specific focus on variance and the extent of the change required to enable meaningful contribution toward impact.
Use this resource for the following Actions of Impact Management:
- Monitor, learn and adapt: Determine to what extent an investment contributes meaningfully to social or environmental progress.
Sustainability Performance Classification (ABC of Enterprise Impact)
The ‘ABC’ of impact provides a way to connect these high-level intentions – which are what most enterprises and investors start with – to the more granular dimensions of impact and data categories, which help to measure and manage impact.
Use this resource to:
- Connect high-level intentions – which are what most enterprises and investors start with – to the more granular dimensions of impact and data categories, which help to measure and manage impact.
Multilateral Development Banks’ Harmonized Framework For Additionality In Private Sector Operations
The Multilateral Development Banks’ (MDB) Harmonized Framework For Additionality In Private Sector Operations standardises the assessment of “additionality” in private sector investments. Understanding additionality can increase access to finance for underserved markets, or enhance environmental and social standards by refering to the extent to which MDB finance contributes to outcomes.
Use this resource for the following Actions of Impact Management:
- Monitor, learn and adapt: Identify the types of evidence to demonstrate additionality.
Was this content useful?
If you would like to give us feedback on how we can improve this content, please complete our feedback form.
Your browser is currently blocking tracking. If you’d like to respond here, please either accept cookies or disable script blocking for this page and then reload. Alternatively, you can complete our feedback form.