Evaluating Storytelling: Where to Start?
Three ideas starting to evaluate your storytelling efforts.
Also co-authored by Kate Pazoles, Hattaway Communications.
The word “evaluation” can strike fear into the hearts of storytellers and communicators. On one hand, we all need to measure what works and what doesn’t. On the other hand, we communicators are often held responsible for unrealistic outcomes. And if we don’t ask the right questions or have access to the right information, we may be set up to fail.
So how can we, as communicators and storytellers, gain ownership of evaluation so that we can hold our teams and ourselves to ambitious but realistic goals? At our ComNet‘16 preconference session, “Road Map to Impact,” we discussed several lessons about communications evaluation drawn from our firm’s approach and client work.
Vanity metrics do not an evaluation strategy make.
This should come as no surprise, but many organizations still ask communicators to look at superficial statistics—social media engagement, web traffic and the like—to evaluate storytelling or broader communications efforts. While these numbers may show an uptick in Facebook likes or Twitter followers, most of the time we don’t know if they reflect progress toward your organization’s actual goals. You can set meaningful key performance indicators (or KPIs).
To track impact, we need to take several steps back and ask ourselves basic questions (these questions are all outlined on Storytelling for Good):
What is our goal for our story?
Who are our audiences for the story?
With each audience, do we want this story raise their awareness, change their attitudes, or motivate them to take a specific action?
Once we have our goal, audiences and communications objectives, we can begin to think about metrics for evaluation.
You can only measure what you can do
Huge outcomes and impact—changing the way people think about health, for example—are aspirational and inspiring. But as communicators, we can only measure what we, along with our grantees or allies, are actually *doing* with our storytelling efforts.
In our preconference session, we introduced three elements of effective communication: 1) message consistency and effectiveness, 2) strategic storytelling and content creation, and 3) outreach and audience engagement. Thinking about these elements alongside your communications objectives (awareness, attitudes, action) will help you decide what to measure in your storytelling efforts.
If you are hoping to start changing the conversation, for example, a first step is getting your team on the same page about how you talk about the issue. These questions can help with evaluating that task: How many people know what makes an effective story for your organization? How many staff/grantees have you engaged in storytelling trainings? How many people know how to tell stories about your issue?
Evaluation can be overwhelming. Start small, learn—and evolve
A common reaction to our workshop at ComNet was, “Wow, that’s a lot!” It is. But you can take it one step at a time, learn and evolve. Start by training your staff and some select grantees on how to create stories that reinforce your narrative, with a specific call to action.
You could also conduct a storytelling workshop with a few program staff and grantees, and measure how many stories made it into public communication, such as speeches, presentations, web copy and social media outreach after two months. If none have, regroup with the team and ask what they need: more help on story development, more training on the tools, etc. Through testing, you can evolve and find the right metrics for your organization.
As communicators and storytellers, we are all asked to measure our effectiveness—a reasonable and strategic undertaking. To do so, we have to ask the right questions, choose realistic metrics, and be willing to learn and evolve. We have to consider communications inputs and actions, as well as big picture outcomes.