Emma Roberts and Yu-Shan Chiu

Introduction

Here at TSIC we are committed to having more impact for our clients. Between us, we have delivered hundreds of evaluations and we’ve seen how the impact of evaluation can vary.  Some are truly inspiring, while others fall flat. 

This has prompted us to consider how we can ensure that every project we work on has as much impact as possible.  Building on what others have done in improving reporting, such as IVAR’s framing paper on open and trusting reporting, we are developing a new approach to reimagine evaluation reporting (more to come on that soon!). But in the meantime, we wanted to share two extremes of a debate we’ve been having internally.

This post is to be treated as a bit tongue-in-cheek – we don’t take either extreme end of this debate! But we thought it would be fun and thought-provoking to both “break up with evaluation reports” and “recommit our love” for evaluation reports. So in this blog post are 2 letters doing just that.

Get your tissues ready!

Breaking up with evaluation reports

Dear Evaluation Report,

I hope you’re sitting down, this may come as a shock. We’ve been together for so long and this is a painful letter to write. We’ve had some good times together and you’ve taught me a lot. But I’m afraid the time has come for us to part ways. Yes, I am breaking up with you after all this time. This relationship is no longer serving me and my people. In fact, I think our relationship is causing some tension and preventing me from growing. Let me explain why:

1. I just don’t feel the same way anymore. I don’t get inspired or influenced by you. Perhaps it is because you are so long? Perhaps it is because you don’t let me speak back to you? Perhaps it is because my attention span has reduced recently? I need something different from my relationship right now and you are not able to provide it.
2. When I show you at parties (or at work meetings), people glaze over. I don’t think you are having the impact you used to have. You are competing with social media, podcasts and data viz. I don’t want to be in a relationship with something that bores my friends.
3. You are quite similar to a lot of others – you just don’t stand out. You seem to follow the crowd. When we are together I keep looking over my shoulder to see if something more attractive comes along.
4. We no longer share the same values. I believe in equity and democratising the narrative of our work. You may not realise it, but your preferences for linear progress, expert narrative, and your claim to neutrality can diminish experiential knowledge.  You (albeit often unintentionally) reinforce power imbalances and a belief in productivity and deliverables that can undervalue the deeper and relational work that is more inclusive.
5. I used to think I could change you. Remember those times I tried to give you a make-over?  We experimented with colour, length and word choice. They were fun times. But deep down you are the same and you shouldn’t have to change to make me happy.

I’m sorry to break your heart, Evaluation Report. I will cherish the memories and I wish you well for your future.

Yours sincerely,

Evaluator

 

A love letter to evaluation reports

Dear Evaluation Report,

Roses are red, violets are blue, without Evaluation Reports, what would we do?!

In this fast-paced world of sound-bites, buzzwords and hashtags, I am ever more grateful for the structure and rigour that you bring.  After all these years together, I must declare my love for you is as strong as ever. Here’s why:

1. A good relationship is based on trust and consistency. Sweet report, you’ve always provided that comfort. There are no surprises with you. You are familiar, I know where I stand and what to expect.
2. When I present you in front of others, people respect us. You are considered logical, reliable and rigorous. You are cited and used as references. Together, we are able to influence many authorities and decision-makers.
3. You’ll be remembered in the future as a source of wisdom for others to learn from. While fleeting trends like Tweets and Instagram posts come and go, you stand as a timeless resource that future generations can draw upon.
4. You are detailed, measured and thorough. I love that you have taken the time to share your methods and your limitations. I love how you consider social and organisational contexts, reminding me that every impact has a backstory. Ahhhh….you see the big picture but can also give me the detail too.
5. You continue to adapt and change. I love that you have been prepared to try new things. Remember the time we did the make-over and we had that fun week away with the Graphic Designer. It was like a breath of fresh air and renewed my love for you.

Dearest Evaluation Report, please accept this love letter as a declaration of my love and commitment to you.  I will never cheat on you and remain loyal to you!

Yours lovingly,

Evaluator

So, where do you stand?

So now you’ve seen both our break-up letter and love letter for evaluation reports! Where do you stand? Here at TSIC we’d like to hear about your love affair with evaluation reports. Are you faithful? Ready to swipe left? What would be your reasons for a breakup or a vow renewal?

In the next blog in this series we will be sharing more about our new approach to impactful evaluation and how it contributes to our commitment to equitable evaluation.