Beyond the Numbers: Storytelling's Place in Holistic Evaluation

When most people think about evaluation, they think about numbers. Evaluators track performance indicators, compare benchmarks, and analyze changes over time. We measure outcomes, calculate percentages of improvement, and assess whether programs are meeting their goals. These metrics are important, but they rarely tell the whole story.

Complex programs, especially those in education, the arts, community development, and other human-centered fields, require a broader lens. Program outcomes are rarely straightforward. They unfold across multiple levels and often extend far beyond what can be captured through assessments, surveys, or Likert-scale data alone. To understand the full scope of a program's impact, evaluators must engage in ongoing conversation with project teams, stakeholders, and participants. A holistic evaluation requires more than measuring change. It requires understanding the experiences, relationships, and contexts that shape that change.

This is where storytelling becomes an important part of the evaluation process.

Storytelling as Evidence

Every participant enters a program with a unique set of experiences, goals, perspectives, strengths, and challenges. Those differences shape how individuals engage with a program and how they experience its benefits. At the same time, implementation is influenced by changing circumstances, organizational priorities, community needs, and countless other factors that cannot always be reduced to a number.

As evaluators, our responsibility is not only to determine whether a program worked, but also to understand how it worked, for whom it worked, and under what conditions. Quantitative data can tell us that change occurred. Stories help us understand why.

Consider a student who persists through a difficult semester because a success coach helped them navigate financial aid, connect with campus resources, and build confidence in their academic abilities. The student's persistence may appear in retention data, but the pathway that led to that outcome remains largely invisible without qualitative inquiry. Interviews, observations, focus groups, and participant reflections provide critical context for understanding how and why outcomes occur.

Stories do not simply add color to evaluation findings. They provide evidence about participant experiences, implementation processes, and program impacts that may otherwise go unnoticed. They help evaluators understand both individual experiences and broader patterns across a project.

At Shaffer Evaluation Group, we have increasingly incorporated storytelling into our work as we evaluate complex and multifaceted initiatives. One current national arts program, for example, defines success in ways that are highly individualized and difficult to quantify through traditional measures alone. To capture the full scope of the program's impact, we are drawing upon observations, interviews, participant testimony, images, and narrative accounts alongside more traditional data sources. Together, these methods help create a richer picture of outcomes that range from personal growth and artistic exploration to community engagement and nationwide network-building.

Humanizing Data

Storytelling also plays an important role in how evaluation findings are shared and used.

Program leaders, funders, and community stakeholders often rely on evaluation results to make important decisions. While charts, dashboards, and summary statistics are valuable tools, stories can make findings more accessible and meaningful.

A participant quote can bring a trend to life. A narrative describing implementation challenges can provide context for unexpected outcomes. Stories help stakeholders connect data to lived experiences and understand the significance behind the numbers.

This does not mean replacing evidence with anecdotes. Rather, it means recognizing that meaningful evidence can take many forms. When quantitative and qualitative findings are considered together, they provide a more complete understanding of a program's effectiveness and impact.

Program success is, in many ways, deeply human. Behind every outcome is a collection of experiences, relationships, decisions, and circumstances that influence how change occurs. By integrating storytelling into evaluation practice, evaluators can illuminate pathways of change, elevate participant voices, and capture impacts that might otherwise remain unseen. The result is an evaluation that not only measures outcomes but also helps tell the full story behind them.

If your institution is preparing to implement a nuanced, human-centered project and are looking for an evaluation partner to understand and capture complex impacts, please reach out to us at seg@shafferevaluation.com.