A Fresh Start to the School Year

 It’s hard to believe another school year is already upon us. The weeks leading up to the first day of school are full of energy including new calendars, refreshed schedules, updated routines, and that makes this moment an ideal time to think about how evaluation can be woven into the work you’re already doing. A little planning now can make data collection feel like a natural part of your processes rather than one more task competing for attention. 

Build Data Collection into your Calendars

One of the simplest ways to set yourself up for success is to add key data‑collection dates directly into master calendars and staff schedules. Early in the year, when calendars are being shared and finalized, it’s easy to build in reminders for the data you know you’ll need. If implementation data is required before reporting deadlines, add those dates now or send calendar invites to staff a few weeks ahead of time. This buffer gives you space to follow up and ensure everything is in place well before submissions are due. 

For ongoing data collection, such as implementation logs, resource checkout calendars, or feedback forms, schedule recurring reminders for yourself or your team so updates happen consistently. And if you rely on your institutional research or assessment office for annual data pulls, add that request to your calendar as well. Survey windows, site visits, and observation dates can all be planned in advance, reducing last‑minute scrambling later in the year. 

Reorient Staff to Data Procedures and Expectations

The start of school is also a perfect time to reintroduce staff to data‑collection procedures and expectations. Many school‑day staff aren’t immersed in the day‑to‑day world of grants, so a quick refresher on what data are needed, how they should be documented or shared, and why they matter can go a long way. This is also an opportunity to close the feedback loop by sharing examples of reports or summaries that use the data they helped collect. When staff see how their efforts support reporting and storytelling, it strengthens buy‑in and builds shared purpose. Reintroducing resource locations, implementation expectations, and available supports at the beginning of the year helps everyone start from the same foundation. 

The start of the school year is also a great time to connect with your evaluator to ensure your evaluation plan is aligned with your goals for the year. At Shaffer Evaluation Group, we can help you revisit your evaluation plan, make adjustments, and identify additional ways to analyze data that provide just‑in‑time insights to support implementation. This is also an ideal moment to discuss strategies for increasing response rates, strengthening data quality, and streamlining data‑collection processes so they fit naturally into your school‑year rhythm. 

With a little intentional planning, and the right evaluation support, data collection becomes a seamless part of your work, strengthening reporting, improving implementation, and helping you start the year with confidence. 

Beyond the Numbers: Storytelling's Place in Holistic Evaluation

When most people think about evaluation, they think about numbers. Evaluators track performance indicators, compare benchmarks, and analyze changes over time. We measure outcomes, calculate percentages of improvement, and assess whether programs are meeting their goals. These metrics are important, but they rarely tell the whole story.

Complex programs, especially those in education, the arts, community development, and other human-centered fields, require a broader lens. Program outcomes are rarely straightforward. They unfold across multiple levels and often extend far beyond what can be captured through assessments, surveys, or Likert-scale data alone. To understand the full scope of a program's impact, evaluators must engage in ongoing conversation with project teams, stakeholders, and participants. A holistic evaluation requires more than measuring change. It requires understanding the experiences, relationships, and contexts that shape that change.

This is where storytelling becomes an important part of the evaluation process.

Storytelling as Evidence

Every participant enters a program with a unique set of experiences, goals, perspectives, strengths, and challenges. Those differences shape how individuals engage with a program and how they experience its benefits. At the same time, implementation is influenced by changing circumstances, organizational priorities, community needs, and countless other factors that cannot always be reduced to a number.

As evaluators, our responsibility is not only to determine whether a program worked, but also to understand how it worked, for whom it worked, and under what conditions. Quantitative data can tell us that change occurred. Stories help us understand why.

Consider a student who persists through a difficult semester because a success coach helped them navigate financial aid, connect with campus resources, and build confidence in their academic abilities. The student's persistence may appear in retention data, but the pathway that led to that outcome remains largely invisible without qualitative inquiry. Interviews, observations, focus groups, and participant reflections provide critical context for understanding how and why outcomes occur.

Stories do not simply add color to evaluation findings. They provide evidence about participant experiences, implementation processes, and program impacts that may otherwise go unnoticed. They help evaluators understand both individual experiences and broader patterns across a project.

At Shaffer Evaluation Group, we have increasingly incorporated storytelling into our work as we evaluate complex and multifaceted initiatives. One current national arts program, for example, defines success in ways that are highly individualized and difficult to quantify through traditional measures alone. To capture the full scope of the program's impact, we are drawing upon observations, interviews, participant testimony, images, and narrative accounts alongside more traditional data sources. Together, these methods help create a richer picture of outcomes that range from personal growth and artistic exploration to community engagement and nationwide network-building.

Humanizing Data

Storytelling also plays an important role in how evaluation findings are shared and used.

Program leaders, funders, and community stakeholders often rely on evaluation results to make important decisions. While charts, dashboards, and summary statistics are valuable tools, stories can make findings more accessible and meaningful.

A participant quote can bring a trend to life. A narrative describing implementation challenges can provide context for unexpected outcomes. Stories help stakeholders connect data to lived experiences and understand the significance behind the numbers.

This does not mean replacing evidence with anecdotes. Rather, it means recognizing that meaningful evidence can take many forms. When quantitative and qualitative findings are considered together, they provide a more complete understanding of a program's effectiveness and impact.

Program success is, in many ways, deeply human. Behind every outcome is a collection of experiences, relationships, decisions, and circumstances that influence how change occurs. By integrating storytelling into evaluation practice, evaluators can illuminate pathways of change, elevate participant voices, and capture impacts that might otherwise remain unseen. The result is an evaluation that not only measures outcomes but also helps tell the full story behind them.

If your institution is preparing to implement a nuanced, human-centered project and are looking for an evaluation partner to understand and capture complex impacts, please reach out to us at seg@shafferevaluation.com.

Career Services: From Career Center to Career Pathways Infrastructure

In higher education, Career Services is often treated as a place students go when they are ready to write a resume, search for internships, or prepare for interviews. However, that model is too late, too optional, and too disconnected from how students actually make academic and career decisions. Students begin forming ideas about work, income, identity, and opportunity long before they reach graduation. If Career Services only appears at the end of that process, institutions miss one of the strongest opportunities to improve student persistence, completion, and employment outcomes.

In a recent study we conducted with a large community college serving an urban population, students described career decision-making as a complex process shaped by interests, academic strengths, prior work experience, family expectations, job availability, earning potential, and cultural background. Survey results reinforced this complexity: students rated their own strengths and academic abilities as highly influential, but they also placed strong weight on job availability and earning potential. In other words, students were not choosing programs in a vacuum. They were trying to make sense of who they were, what they could afford, what their families expected, and what the labor market might offer.

The same study also showed that career information reaches students through multiple channels. Students did not rely only on formal Career Services. They turned to faculty, advisors, college websites, family members, peers, and prior work experiences. Faculty were especially important because students often saw them as credible contacts: people who could explain what a job actually involved, what employers expected, what coursework mattered, and what pathways were realistic. If Career Services is confined to one office, it cannot fully support the way students actually navigate the career decision-making process.

A more promising model is to treat Career Services as institutional infrastructure. In this model, central career planning and advising services remain important, but they are not the only way career development happens. Instead, career planning should be embedded across the student journey through predictable touchpoints with Career Services, faculty and staff referrals, employment-based learning opportunities, and student support services. Students should encounter career development repeatedly, not only when they are preparing to leave.

This is where a Career Services journey model becomes useful. A journey model defines how students move from early exploration to informed decision-making, employer-connected learning, skill development, and employment or continued education. It asks: What should students understand in their first year? When should they connect their academic program planning to labor-market information? How and when will they encounter internships, work-based learning, or applied projects? Who helps them interpret employer expectations? How are career conversations documented and followed up? The point is not to add more disconnected services. The point is to make career development a routine part of academic progression.

The model also requires a broader view of who provides career guidance. Faculty, advisors, coaches, program staff, and student support personnel often serve as the first point of contact when students ask whether a program is worth the investment, whether a career is realistic, or what they can do with a credential. Institutions should not expect these staff to become career counselors, but they can equip them with career road maps, referral protocols, labor-market summaries, and clear guidance on when to connect students with Career Services. This turns informal advice into a more consistent institutional system.

The journal approach to Career Services is especially important for applied, technical, and workforce-oriented programs. Students in these pathways may need specialized advising that connects program requirements, credentials, labor-market information, employer expectations, work-based learning, and next-step employment or continued education. Traditional advising models can overemphasize transfer pathways and underemphasize immediate workforce goals. Specialized technical/workforce-oriented career advising protocols can close that gap by creating common intake, referral, advising, and follow-up procedures providing students with the Career Services they need for success.

Employer partnerships are another essential part of Career Services infrastructure. In a stronger model, employers are not engaged only at the point of hiring. They help students understand fields of work, clarify skill expectations, test career interests, build professional networks, and see how academic programs connect to real jobs. Employers can serve as mentors, classroom speakers, mock interviewers, project sponsors, internship and apprenticeship hosts, advisory committee members, curriculum informants, and partners in identifying emerging skills. They can also help faculty and Career Services staff interpret labor-market changes in practical terms: what entry-level roles look like, which credentials matter, what experiences strengthen employability, and how students can move from a first job to career advancement.

The larger lesson is that Career Services should not be viewed as a peripheral student support. It is a student success strategy, a workforce strategy, and an institutional capacity strategy. When Career Services is embedded across the student journey, students are more likely to see the purpose of their academic choices. When faculty and staff have tools to support career conversations, students receive more consistent guidance. When employers are engaged with faculty, staff, and students, more students gain access to sector expertise and applied learning and employment opportunities. When labor-market information is translated into advising, students can make better-informed decisions.