-
""

Measuring the impact of your giving

26 February 2024

Please note: This article does not constitute advice. Barclays Private Bank does not endorse any of the companies or individuals referenced in this article.

Measuring impact is a key part of philanthropy. As well as helping to celebrate successes, evaluating progress may reveal places in which your and your recipients’ efforts are falling short of their desired outcomes.

Identifying these can allow you to shift your focus, adapt your approach and may ultimately improve your impact.

The topic of impact measurement is vast. Here, we briefly outline the key perspectives and steps you could take to evaluate progress, and share some good practice principles.

Three perspectives on impact

One of the key challenges is that ‘impact’ means different things to different people. There are also different aspects to impact in philanthropy – from societal, to organisational, to more personal. 

As a starting point, it is helpful to think of impact as the change that a philanthropist aspires to make through their giving. In essence, it is the difference that a contribution makes above and beyond any changes that would have otherwise occurred.

For example, these might include improved health or life chances for a group of people, or increased biodiversity. These are usually the kind of improvements philanthropists mean when using the term ‘impact’.

However, you could also view impact from three possible angles:

1. Through your recipients 

This involves assessing how your recipients define and measure their impact on society, and the extent to which they are applying and learning lessons. You can glean this information via formal and informal conversations, site visits, peer reviews and reports.

2. As a donor 

Taking this approach involves assessing whether, and how, your own contributions are making their intended impact. As a donor, this requires a different way of thinking, as you may be one step removed from the frontline of social change. Some donors see their role simply to respond to and support great charities and community organisations; others may consider impact more in terms of their contribution to a particular cause or issue. A Theory of Change (see below) can help to establish a framework for measurement.

3. Personal aspiration 

Another possibility is to consider whether your personal hopes and aspirations (for you and for your family) are being realised through your giving.

All three perspectives on impact are relevant, and exploring what matters most to you can be worthwhile. 

Some donors choose to measure impact themselves, but many seek expert support. There are external consultants and advisers who can help, and this could have the added benefit of reducing potential bias.

Key principles for measuring impact

Whether you’re evaluating your own progress or working with an external expert, following the eight practices below can be useful.

  1. Work alongside your grantees to identify what ‘meaningful progress’ is.
  2. Consider funding grantees to undertake meaningful measurement (often a gap in investment for charities).
  3. Only measure what is most relevant and use your insights to learn and adapt. 
  4. Be clear about the distinction between your/others’ contributions to positive change.
  5. Consider whether the change(s) may have occurred without your intervention.
  6. Recognise that societal impact and change takes time, and the process is rarely linear.
  7. Consider your personal hopes and aspirations – have you communicated these (as an individual, collective or family) and are they being met?
  8. Look at how others in your chosen field measure their impact and progress. What can you learn from this?

Attribution or contribution?

When measuring impact, we are looking for a causal link between our actions (or those of the organisations we support) and the ultimate change that happened as a result. In some cases, organisations can rigorously measure their attributed impact – for example, through randomised control trials, which is often seen as the ‘gold standard’ in measurement.

However, in the work of philanthropy and social change, success is often the result of collective action. 

So, what does this mean for measuring impact?

On the one hand, establishing the link between actions, outcome and impact can give us confidence that we are on the right path and that resources were put to good use. However, focusing too narrowly on trying to attribute impact to one actor brings its own set of problems. As multiple factors usually contribute to an outcome, it's often difficult to pinpoint which of these played the greatest role.

A more helpful concept may be ‘contribution’. Rather than owning the impact, the mindset shifts to being part of the winning team. If you have a clear sense of where you are trying to get to together, you can still measure whether you get there and your progress towards that goal. However, you can also keep a more open attitude about whether you (or the organisations you support) were the sole owners of those changes.

The Theory of Change 

Some philanthropists use a Theory of Change to map and visualise their giving. This approach clearly sets out the individual steps that you need to take to achieve your goals, in turn creating a logical model that shows how change could happen. A logic model can be particularly helpful if you wish to be accountable to others, build partnerships or seek funding for your work.

 A Theory of Change usually asks the following questions:

  • What change will you seek?
  • What is the need for the change?
  • Who will you target through your philanthropy and where?
  • How will you and others make the change happen?
  • When will you achieve this change?
  • What are your underlying assumptions?

If you would like to learn more about developing a Theory of Change and view some examples, there are numerous resources and guides available, including (but not limited to) those provided by think tank New Philanthropy Capital.

Quantitative or qualitative?

When measuring your impact, you will need to decide on the type of data or information to use for evaluating your progress.

One approach is to employ quantitative metrics, which rely on clear data that can easily be tracked and counted. Quantitative metrics often have a narrow focus and allow you to measure and report on results over a relatively short time frame. You (or your recipients) will need to consider carefully the relevant metrics for your goals.

However, measuring impact does not have to rely solely on quantifiable metrics. Indeed, some types of change can be difficult to quantify and are better presented as descriptive data. These are known as qualitative metrics. As an example, you can often best describe impact through stories and case studies of those whose lives have been improved through philanthropy.

Case study

Farah Jirdeh-Fonkenell: Key principles for measuring impact

In the case study below, Farah Jirdeh-Fonkenell, founder of the Pharo Foundation, discusses the approach her organisation takes to defining a strategy and measuring impact using a Theory of Change.

The Pharo Foundation has had many lives since I set it up in 2011. We began as a grant-giving organisation and then moved towards designing our own projects. Much of what we learned during those early years has led to where we are today.

Like all foundations, we have been on a journey. Early on, we experimented with an organic approach, in which projects were often initiated by suggestions from local officials who could appreciate their communities’ needs. 

My ‘joy and glory’

We now theme our work around three missions: empowering African youth through education, solving Africa’s water scarcity problem, and removing obstacles to African productivity and employment. My proudest achievement is our early childhood programme, which focuses on education centres. It is my joy and glory, and the most successful of our initiatives. 

Whatever we’re working on, we believe that measuring impact should not be an afterthought. Philanthropists need to build it into the early stages of their project design.

Four tips for measuring impact

Since our launch, we have used a process of trial and error to measure the impact of our projects and have now arrived at four key principles.

1) First, we agree a definition of impact and the process for measuring it. Impact is the difference between what happens after a programme is introduced, and what would have happened in its absence (the ‘counterfactual’). Impact evaluation is only meaningful if we have a comparison group. 

2) Our starting point needs to be the problem we intend to solve, not what activity we want to carry out. We also need clearly defined goals and measurable outcomes before we introduce ourselves to a community.

3) As philanthropists, we need a strong ‘Theory of Change’ to achieve the greatest possible impact. This approach begins with the outcome we would like to achieve. We then work backwards to identify all the steps required to accomplish our goals, and weigh the potential impact. 

A ‘Theory of Change’ also involves identifying the constraints that led to a problem’s development. For instance, limited school completion rates or low test scores can impact a young person’s achievements later in life.

4) Ideally, those implementing a programme should not be responsible for its design. This creates an incentive to request approval for a project, even if the potential benefits are marginal. 

By applying these principles from inception, we know that our projects will have the greatest likelihood of changing lives, while our human and financial resources are used as effectively as possible. For us, philanthropy is about giving with a results-oriented mindset.

Guide  to Giving

Guide to Giving

Our 12-chapter ‘Guide to Giving’ features inspirational case studies and­ key concepts to help you navigate the world of modern philanthropy.

Disclaimer

This communication is general in nature and provided for information/educational purposes only. It does not take into account any specific investment objectives, the financial situation or particular needs of any particular person. It is not intended for distribution, publication, or use in any jurisdiction where such distribution, publication, or use would be unlawful, nor is it aimed at any person or entity to whom it would be unlawful for them to access.

This communication has been prepared by Barclays Private Bank (Barclays) and references to Barclays includes any entity within the Barclays group of companies.

This communication:

(I) is not research nor a product of the Barclays Research department. Any views expressed in these materials may differ from those of the Barclays Research department. All opinions and estimates are given as of the date of the materials and are subject to change. Barclays is not obliged to inform recipients of these materials of any change to such opinions or estimates;

(ii) is not an offer, an invitation or a recommendation to enter into any product or service and does not constitute a solicitation to buy or sell securities, investment advice or a personal recommendation;

(iii) is confidential and no part may be reproduced, distributed or transmitted without the prior written permission of Barclays; and

(iv) has not been reviewed or approved by any regulatory authority.

Any past or simulated past performance including back-testing, modelling or scenario analysis, or future projections contained in this communication is no indication as to future performance. No representation is made as to the accuracy of the assumptions made in this communication, or completeness of, any modelling, scenario analysis or back-testing. The value of any investment may also fluctuate as a result of market changes.

Where information in this communication has been obtained from third party sources, we believe those sources to be reliable but we do not guarantee the information’s accuracy and you should note that it may be incomplete or condensed.

Neither Barclays nor any of its directors, officers, employees, representatives or agents, accepts any liability whatsoever for any direct, indirect or consequential losses (in contract, tort or otherwise) arising from the use of this communication or its contents or reliance on the information contained herein, except to the extent this would be prohibited by law or regulation.