Skip to content
EP 776February 9, 2026

Bring Fun To Evaluation & Impact Data

Tony MartignettiKayla Meyers
Nonprofit Radio
Episode 776
0:00 / 0:00

About this episode

Kayla Meyers reveals the fun in what may sound dull, through braids, data galleries and data escape rooms. She distinguishes between outputs, outcomes and impact, and explains the disconnect between traditional evaluation and the impact measurement we need in today’s environment. She helps you recognize common evaluation challenges and sets you up to overcome them. Kayla is the founder of Bridgepoint Evaluation.

Here’s the transcript

Tony MartignettiHello and welcome to Tony Martignetti Nonprofit Radio, big nonprofit ideas for the other 95%. I'm your aptly named host, and I'm the podfather of your favorite hebdomadal podcast. Oh, I'm glad you're with us. I'd suffer the effects of aspergillosis if you inflamed me with the idea that you missed this week's show. Here's our associate producer Kate to give you the highlights.

Kate MartignettiHey Tony, here's what's up. Bring fun to evaluation and impact data. Kayla Meyers reveals the fun in what may sound dull. Through braids, data galleries, and data escape rooms. She distinguishes between outputs, outcomes, and impact, and explains the disconnect between traditional evaluation and the impact measurement we need in today's environment. She helps you recognize common evaluation challenges and sets you up to overcome them. Kayla is the founder of Bridgepoint Evaluation, On Tony's Take Two.

Tony MartignettiThey need your opinion.

Kate MartignettiHere is Bring Fun to Evaluation and Impact Data.

Tony MartignettiIt's my pleasure to welcome Kayla Meyers to Nonprofit Radio. Kayla is the founder of Bridgepoint Evaluation. Through training, coaching, and hands-on evaluation support, She guides organizations in designing practical, action-oriented evaluations. She's an adjunct professor teaching program evaluation and survey design. The company is at bridgepointevaluation.com, and you'll find Kayla on LinkedIn. Welcome to Nonprofit Radio, Kayla.

Kayla MeyersHi, Tony. Thank you so much for having me. It's so fun to be here.

Tony MartignettiUh, it is fun. Thank you. I'm glad you, I'm glad you're having fun already and we haven't even started. That's outstanding. All right. I love— thank you for bringing that. Thank you for bringing that energy. Okay. Evaluation, like impact measurement. These things get like nonprofits, I think, I fear get intimidated. Plus they sound boring, although essential. Help us help allay like fears of intimidation and boredom.

Kayla MeyersYeah, absolutely. So I think sometimes when folks think about evaluation, they think about auditing, they think about compliance, they think about proving their impact in a way that's going to be deemed enough. Whereas when we talk about evaluation over at Bridgepoint Evaluation, we focus on improving and learning and growing, and then also having a strong basis for making decisions confidently, for having shared understanding amongst your entire organization. And so really just trying to flip the script a little bit on why we do evaluation, acknowledging that demonstrating our impact is only one piece of why we go about evaluation and learning versus thinking about evaluation as an auditing and compliance mechanism.

Tony MartignettiOkay. And for decision-making, as you mentioned, so, you know, can we, can we humanize this process?

Kayla MeyersYeah, yeah, absolutely. I

Tony Martignettithink, I think that's doable, that's achievable.

Kayla MeyersAbsolutely. And I think sometimes when we think about evaluation, we think about numbers, we think about how many people accomplished what, and how do I make sure those numbers are as big as possible. I see all the times nonprofits saying we're going to reach 1,000 people, 1 million people, and what gets lost is that human moment. Exactly. And so I think grounding ourselves and getting back there is so important.

Tony MartignettiOkay. And we're going to talk about, you know, going from 1,000 to 1 million, you know, that's not going to happen in 6 months or even in a year, but you want to celebrate the steps reaching— we'll get to the, you know, the incremental nature that you should celebrate. I feel like we should distinguish near the beginning here between outcomes and impact. Can you, you know, make that clear for us?

Kayla MeyersYeah, absolutely. And so you can think about this, the easiest framework to think about this, in my opinion, is to think about the logic model, which I know I just said logic model and many people just like turned off their ears and were like, never mind.

Tony MartignettiNo, no, we're giving you a chance. No, no, not yet. That hasn't happened yet. Maybe at the 5-minute mark, but not, not the, not the 3:40 mark. No, we're— you're okay. All right. No, no.

Kayla MeyersSo just think about it instead of like an outcomes chain. Um, so we host this training to what? To, to achieve what outcome? Um, so you can think about outputs, which is how many people attended the training, but then what happened to those people in the training? What did those people do immediately after the training. Those are your short-term outcomes. Then you start building out that train, right? So people learned how to be financially healthy. They learned how to budget. And now the next outcomes on that train are things like they tried budgeting out. Once they tried budgeting out, they were able to better align their income with their expenditures. Once they got that, you know, kind of just working through that chain and really thinking about that overarching chain, what it results in. So we're talking about a financial health program. program, what it results in is the impact. The result there being that folks have the financial stability and the financial wellness to be able to have increased decision-making, increased resiliency, and increased ability for social movement, for financial movement within their lives. That's an impact. All the things that come before that are outcomes.

Tony MartignettiOkay, thank you. And outputs too. You added outputs too. Thank you. All right, cool, cool. So you believe there's a disconnect between traditional evaluation and the impact measurement that you want to be talking about, that you want, you want, you're encouraging folks to do, you encourage clients to do. So help us see how the old model is not so good. I don't know. Now, the old model is not new. The old model is not current. That's why it's old. Yeah. Share the, share the, the differences here, where we are versus where we used to be?

Kayla MeyersYeah, absolutely. And I think this is, you know, this is truly why Bridgepoint Evaluation exists. I have been an evaluation consultant for almost 15 years now, and much of my early career was spent on these really big 3-year, 5-year projects, huge budgets coming in from the federal government or research institutions. And then at the same time, I'd be working with nonprofits, medium-sized, large-sized, even some smaller, smaller size nonprofits who are being held to very similar standards as those, you know, large, huge consulting opportunities. And so what I, what I want to bring together is the, the two, uh, bridge across those words, right across those worlds. So that's Bridgepoint.

Tony MartignettiOh, look how fancy you are. Bridgepoint. Bridgepoint. You're bridging. Yeah, bridging those worlds. Oh, actually brilliant, brilliant Bridgepoint. Okay.

Kayla MeyersRight. And so, and so you're often seeing these large studies of demonstrating impact, proving impact. And instead, I want to work with organizations to reduce uncertainty and make better decisions with their data. So it's about improving your impact, not necessarily proving it, but improving it. And just generally kind of trying to take some of the tools from that impact measurement world and translate them into your in-house nonprofit of staff who wear 3 to 5 hats. Right. of perhaps folks doing impact measurement who maybe didn't have necessarily formal training on that, but they grew into that role and they're fantastic at that role. So how do we better support them even more?

Tony MartignettiLet's talk more about the decision-making that you mentioned earlier. You know, maybe, I don't know, maybe you have a story about how a nonprofit used data in decision-making. I won't put you on the spot if you don't, that's okay. You know, but, but help us see the value in, in clearer decisions?

Kayla MeyersYeah, absolutely. And so I think it can be— it can come from a few different reasons, but I do have one example in particular. Oh, cool. Working with a client, like many organizations, they had all in-person programming. COVID happened, they had all virtual programming, and now they're moving forward and they want to know the best direction. What is— how can they bring together all of those resources they just put into virtual programming, a high, high demand for their services, And their love for in-person programming. And so what we did was we used program evaluation to answer that exact question. What is working well about virtual programming? What's maybe not so working so well?

Tony MartignettiWhat was their work? What kind of programming were they doing?

Kayla MeyersYeah, they do financial coaching as well as— sorry, financial coaching and education, financial education coaching. And so, so they have kind of, you know, this, this whole course that they typically do in person. Then they shifted it all virtual. Now they're kind of in a blended approach and they're saying, well, if we continue virtual, we could rapidly expand geographically. And that's not just a self-serving thing, but folks all through the world could use financial education and coaching, especially when we're talking about closing the homeownership gap for people of color compared to white people. And so— Yeah. They brought me in, they brought in our team, and they said, how do we go about this? How do we, how do we kind of design an evaluation for this purpose? So we brought everything together. We looked at the quantitative, we looked at the organizational data, we looked at operational data, and then we also looked at things like test scores, surveys, things of that nature, attendance scores, and also brought in the qualitative. So trying to kind of get the how, what. Mm-hmm. output side of things with the why and so what qualitative side of things, bringing all this together to highlight where might virtual programming maybe have some shortfalls and how can you kind of close those gaps based on what your stakeholders are telling you? And where is there incredible opportunity for virtual programming? How can that, how can that be coupled perhaps with satellite offices or something like that, something of that nature to be able to expand your reach and really change the way that you're able to do your work?

Tony MartignettiIt sounds like a lot of that work was surveying.

Kayla MeyersIt was honestly what we, what we really leaned into was operational data, existing operational data, which this is gonna be something you hear me repeat. Let's use what you have. You probably have some great stuff. And then, and then focus groups and collaborative evaluation layered on top of it. So I worked with their entire staff to have consistent learning workshops. I think, again, trying to get Trying to get to that cultural change of evaluation isn't an audit. It's not a test. It is a learning opportunity. It's a cultural change and kind of coming together to look at the numbers and then match them with interviews and focus groups to add more context and depth.

Tony MartignettiFocus groups. So you facilitate focus groups? Is that facilitate, moderate? I don't know what it's called. What is

Kayla Meyersit? Facilitate. Yeah.

Tony MartignettiFacilitate focus groups. Yeah. Okay. How do you get people at ease? This is something I always wondered in a focus group. Now, so that was a program around financial literacy. How do you get people to open up about, you know, maybe where they started before working with this nonprofit? You know, that they were, I mean, they were essentially saying, I was financially illiterate because I'm in a financial literacy program. Right. How do you get people to open up, not just about that, but about, you know, not even talking about money? Like, people would rather talk about death or go to the dentist, I think, than talk about money. How do you get people to open up in that kind of, you know, in a group setting?

Kayla MeyersOh yeah, you are like nail on head there because it is so hard to even recruit people to come to that setting, let alone open up and communicate.

Tony MartignettiYeah, how do you even get them in the door? $50 gift cards or I don't know what, but

Kayla MeyersYes, exactly.

Tony MartignettiOh yeah.

Kayla MeyersYeah. So definitely compensating people for their time and expertise, sharing food, breaking bread. I mean, trying to understand like what are things that generally are going to provide comfort. And then I think really flipping the script a little bit, right? So talking to folks about we are navigating a broken system, an intentionally broken system. There's a system in place that seeks to hold this information back from you, that it tries to hold communities down, especially when it comes to financial wealth and power. And you are here as experts within your community, right? You are here as people with lived expertise, community expertise, network expertise, and that's what we're gonna talk about. So what we are actually gonna talk about in this focus group is how you as experts in the room see this program lifting up those around you. What are the ways in which you see it lifting people up, in which you see it Perhaps letting people fall through the cracks, which is something the organization really wants to reconcile with. How do we build some safety nets in there?

Tony MartignettiYeah.

Kayla MeyersAnd how can we get all that work together to kind of overcome this systemic effort? So really, you know, kind of deindividualizing every single component of it and saying, we're not here to necessarily talk about you, but you as an expert, right, in all of these different areas and how you can help us really have a reciprocal exchange of information about this.

Tony MartignettiThat's excellent. So, it's an appeal to community. You can help us help the community if you share, if you're honest. And plus, you mentioned that— I think most people do want to help the community, especially when they were helped by the program. Like, they want others— it's almost empowering. I can help this group help others if I help them.

Kayla MeyersYeah.

Tony MartignettiPlus, you mentioned meals. I happen to I'm writing a book. It's on planned giving fundraising, but I have something— I love shared meals. I mean, I do planned giving fundraising consulting, so I do a lot of individual donor and prospect meetings. I love over a meal. You said breaking bread, sharing a meal. I even created an acronym like MEAL, Meals Expertly Allow Learning.

Kayla MeyersOh, I love that.

Tony MartignettiI know. It's just something cute for the book. But, but it does, you know, the shared space, the share, you, you know, you, you like, you're at a communal table with the focus group, right? Before, I assume this is before or maybe even during their eating, people are literally sharing that physical space of the table and they're sharing the food.

Kayla MeyersYeah.

Tony MartignettiYeah.

Kayla MeyersAnd it, it

Tony Martignetticreates a metaphor for what you want them to do. You want them to share.

Kayla MeyersIt is, it's perfect. So there's all of the, those layers, right? And then there's just this really basic layer, Tony, which I'm sure you've seen where it lets people kind of crack their voice a little bit, right? So they get in the room and you're nervous and you're like, kind of, why am I here? But we're not going to talk about that first. We're going to talk about like, isn't— aren't these ribs amazing? Isn't this beautiful, incredible? And just start talking and just warm up our voices, warm up our relationship with one another. Much more smooth sailing than just getting in the room and saying, here's the consent language, let's go.

Tony MartignettiYeah, right. Were they beef ribs or pork ribs?

Kayla MeyersPork.

Tony MartignettiOkay. I live in North Carolina. It's got to be pork ribs.

Kayla MeyersOkay.

Tony MartignettiTexas, Texas, I think, is the— well, Midwest generally beef, more beef ribs. But, uh, yeah, pork ribs. Did you have pulled pork too, or just the ribs?

Kayla MeyersWe did all sorts of good meals. Um, we did, we did see some pulled pork, the corn. And that was the thing too, we revealed, we told folks the menu in advance, and then we had all these women making cornbread. And so then we're talking about cornbread recipes. I mean, it's just And I'll note here, the focus group's long. If you haven't caught on, the focus group's not a short endeavor. Yeah, yeah, we gotta show up, we gotta make our plates, we gotta talk, we gotta share this cornbread recipe, and then we're gonna get into it.

Tony MartignettiI love that. I love people came with the homemade cornbread. Outstanding. And then they're sharing the recipes. Oh no, I use canned corn. No, no, you gotta use fresh. No, canned corn is better. No. Okay. No, I love that. All right. Sorry. Sorry. Um, so All right, how do we overcome these challenges? I mean, how do we like sort of get nuts and bolts, you know, start to like, what should we be thinking about? Or, you know, if we, even if we don't have a, suppose we're not even a grant recipient, but we do want better data. We wanna, like you're saying, we have the data, but we need to coalesce our data so that it can help us. Maybe it's not even for a third party. Right. Maybe it is just for our own purposes. Uh, how, what do we need to like think about? I don't know, culturally, leadership-wise. You know, I like, I like steps, uh, if we can, and you know, not that you have to say 1, 2, 3, 4, 5, but you know, I like steps that people step, takeaways. I like takeaways that people can take action on or at least start thinking about.

Kayla MeyersAbsolutely. And I think about it as a framework, right? Because we try it out. It's just a general idea. Um, and I do a lot of this. So like I said, I do a lot of coaching, uh, which is more about one-on-one coaching as as fractional management. So if you just need someone to come in and kind of help your team, you know, navigate this real sea change in evaluation culture, we can come in and kind of manage that for you. And, you know, leave, leave you kind of with that learning system in place. And so what that tends to look like is we start off with an inventory of what you have, what's already going well, what do you already answer in terms of what data, data points you have, where you have interest, where you have staff interest, and really bringing people together in that identification. Mm-hmm. Because on one hand, yes, your team's, you know, filling out those spreadsheets. On the other hand, what you might not have a finger on the pulse of is that your country manager is always having lunch with their main volunteer and is kind of always doing a bit of a pulse check in terms of how things are going with them. That's data. Formalizing that is the challenge. So we start off with just this inventory. What do you already have in your pocket? Then we start to think about what are the strategic questions that are going to guide learning. So they might ask, you know, to what extent are we achieving our outcomes, with whom, for whom, under what circumstances? And they're gonna examine the process by which you do that, the appropriateness of that process, the relevance of that process. So we're just gonna put together those questions. We're gonna then put everything on a grid, right? So we're gonna take those questions, we're gonna put those across the top. We're gonna take all of your data sources, all of the work that you're doing, put that in rows, and identify where you have overlap, where we're answering those questions with the data. Mm-hmm. we're already collecting and examine it through the lens of breadth and depth. So breadth is participation counts. It's the number of people you reach, the number of activities you achieve.

Tony MartignettiYou were saying before, the outputs?

Kayla MeyersExactly. Breadth is going to tell you how far your work is going. And then depth. So then we're going to look for depth. How are we going to hear about stories of what that actually looks like on the ground, as well as perhaps case studies of how this one person like really went all in on the 4 programs we offer and changed her life in 9 months, like really changed her whole, her whole way of operating. Those are our depth stories. That is usually where we need to turn things up a little bit. So we go through this table, we look at this, those are all depth measures, these are breadth measures, and here's where we need to kind of add in some new tools or maybe just add in questions on the tools we already have. Get all of that in place. We talk about a reasonable implementation timeline, reasonable being key. If it's not reasonable, it will break and it will fall apart. But then the most important part that I think tends to get forgotten is when are we going to have our learning moments? When are we gonna come back together? Is it gonna be quarterly? Is it gonna be monthly dashboards and then quarterly conversations? But really kind of reorienting ourselves again How are we going to learn? When are we going to learn? In what ways are we going to learn? And that learning tends to look the same as that focus group I just talked about. We're gonna get together, we're gonna set aside enough time to have a meal, to talk, and to get out of our daily routines so that we can really come and think strategically about our work.

Tony MartignettiAnd what can we incrementally look for to celebrate little, little moments, whether, you know, it's a monthly dashboard or a monthly meet, quarterly meeting, whatever it is? Is, you know, like, what, what movement in our, in our, in this data formalizing process can we, can we see incrementally?

Kayla MeyersYeah. And one of my, one of my fractional management clients was such a great exemplar of this because within the first 2 months we got together, we identified their data systems, and we found key quick changes. One of those changes was we moved from one spreadsheet that wasn't linked to anything. It wasn't talking to anything else, right? They were having to work really hard on their data. We replaced it with a form that spoke directly to a dashboard. And so now their data is working for them. And within 3 months, we changed the way their team meetings were structured. So instead of each of their program managers coming together and trying to remember, oh, in the last month we held this training, I think there were 30 people there. Yeah, it felt like a success. People weren't that engaged. To doing these kind of report outs to instead opening up their team meeting and having their dashboard and having different program managers be like, whoa, you had 100 people come to that workshop? What on earth happened? And they were like, oh, right, I found this nurse who works in churches and she told everyone about our workshop and all of them came. And just having like these really amazing learning moments that changed when we stopped making people work so hard on their data and started making our data work so hard for them. Yeah.

Kate MartignettiIt's time for Tony's Take Two.

Tony MartignettiThank you, Kate. Someone needs your opinion. Uh, the— it's a, it's a former guest. She's been on a few times, uh, Karen Graham, very smart data scientist, tech person in the nonprofit community, and she is leading a donor management Software study. So she wants to get information about how you use your CRM, or even if you don't have a CRM, what you what you do in place of that. Just everything around your your donor management software. So I'm helping her to encourage you to participate in the study. NTEN is also involved. They're also. I think Karen's leading it, but NTEN is helping fund it. So, you know how closely we partner with NTEN. Amy Sample Ward, of course, being our tech contributor. She's the CEO of NTEN. And of course, I bring the podcast to NTEN's conference each year. This year we'll be going to Detroit in March. So helping Karen, helping NTEN. I would ask you to participate in the study. If you go to my LinkedIn this week, you will see, uh, just check the posts and I will have posted, uh, I have posted it about it this week. Uh, and the link to participate in the study will be, will be there. It'll be, uh, in my comment. So that's it. So I hope you can help out Karen, help out NTEN by participating in the In their donor management software study. I thank you very much. And that is Tony's Take Two. Kate, Kate, like my voice just cracked. Thank you. Like I'm 14.

Kate MartignettiI was gonna say something and now I forgot because now I just wanted to be— I want to make fun of you for your, your voice crack, but whatever I had, it was good.

Tony MartignettiI'm sure you were going to encourage listeners to participate in the study.

Kate MartignettiIn the study, yes. Please go participate in the study. Um, Kate, we've got beaucoup but loads more time. Here's the rest of Bring Fun to Evaluation and Impact Data with Kayla Meyers.

Tony MartignettiYou teach, um, program evaluation, survey design, Where is that you teach?

Kayla MeyersYeah, the Humphrey School of Public Affairs at the University of Minnesota.

Tony MartignettiOh, Hubert. They gotta be named for Hubert Humphrey, the senator from Minnesota who ran for president in, I don't know what election, presidential election. Hubert Humphrey, right?

Kayla MeyersYeah, you got it.

Tony MartignettiSo what's that like? Do students need a— well, let me ask you, jump all around. You got a lackluster host, I'm sorry. Do you have a background in I don't know, mathematics or data design, data analysis, data design, computer science, or you like Spanish, Spanish and music major? What?

Kayla MeyersSo this is, and this speaks to how I ended up in my career. I am a generalist with a generalist training. So I got a degree, an interdisciplinary degree in development. So economic development, community development, etc., where I took a different Every semester I was taking different classes in College of Health, College of Natural Resource Management, because I was like, well, I love all of this. I love the intersection of how all of these systems work together. And then got a mixed methods, had a mixed methods focus. So I was taking qualitative analysis classes alongside my statistics classes and policy analysis classes.

Tony MartignettiHmm.

Kayla MeyersAnd I am a graduate of the Humphrey School of Public Affairs. So I got to come back almost a decade later to then teach the exact classes that were the inspiration for my career.

Tony MartignettiThat's outstanding. Teaching the classes that were the inspiration for your career.

Kayla MeyersI love that.

Tony MartignettiAnd do you find a lot of interdisciplinary or like self-defined majors in your classes?

Kayla MeyersI think, you know, the biggest degree program at the Humphrey School is the Master's of Public Policy, which is inherently, you know, allows itself to really be customized quite nicely. But then we also do have students from, you know, the business school, from the education school, Well, kind of converging into this one space. We— I really teach the class because it's at the public affairs school with a lens to policy and a lens to public affairs work. So, you know, if you take an evaluation class at an education institution, they're really gonna focus on evaluation and education, or the public health school, it's really gonna focus on public health evaluation. But mine is really looking a little bit more both broadly and focused on public-facing programs. So how the programs that are intended to really help the public, how do we evaluate those and really measure that, especially because most of the time the public is interfacing with much more than just one program. They're interfacing with all sorts of different nonprofits.

Tony MartignettiDo you teach at all in person, or is it, or is it all virtual? It's

Kayla Meyersall in person, which is fantastic.

Tony MartignettiOh, that's excellent.

Kayla MeyersYeah.

Tony MartignettiSo now what is that like? Are you looking at a sea of laptops You know, the back of laptop screens. Is that how students in college take notes?

Kayla MeyersYou know, I—

Tony MartignettiLike when you look up, you see a bunch of like Apple and Dell and Lenovo logos and glowing eyeballs because their screens are lit up. Is that what you see or what?

Kayla MeyersI'll give them credit. Their laptops usually have some great funny stickers on them. So I do get that. The class is 3 hours long. And so we only do lecture for about 45 minutes and then we switch it up. We do a lot of applied learning, a lot of, a lot of group work, a lot of, you know, facilitated discussion. I'm trained in technology of participation and art of hosting, and I bring a lot of that into the classroom because I don't just want them to learn the concepts of evaluation. I want them to learn how to facilitate an evaluation. And so I will use a lot of times facilitation methods that I just want them to learn by having them go through it. So we host World Café conversations where they then get to learn, like, This is a World Café conversation. This is why you use it. This is when you use it. Great. Now we're going to use it to talk about how to apply this learning.

Tony MartignettiYou said you're trained in technology and participation. Is that—

Kayla MeyersTechnology of participation.

Tony MartignettiTechnology of participation. What—

Kayla Meyersyeah,

Tony Martignettiyou just— I think you just gave an example of it.

Kayla MeyersYeah.

Tony MartignettiWhat does that mean generally, the technology, the technology of participation?

Kayla MeyersYeah. And I— this was the— I think it was designed by a group. It's ICCA, International Culture— I'm gonna forget their acronym. It's basically putting together neuroscience and facilitation. So how do we overlay what neuroscience tells us about how people think and process information with how we help them navigate a conversation? One specific example that, and then your listeners can look this up and use it in their next conversation, is the O.R.I.D. framework. So the O.R.I.D. framework tells us—

Tony MartignettiO.R.I.D.?

Kayla MeyersYes, thank you. O-R-I-D. Observation, reflection, interpretation, decision-making.

Tony MartignettiOkay.

Kayla MeyersSo we're gonna start off when we bring a group together, perhaps we have a data dashboard, right? This is something I, I will often use whenever we're coming together over some data. We'll start off with just, what do you see? What stands out to you? Or do you have questions? What's surprising? What's not surprising? We don't have to ask all these questions, but these are all observational questions. Interpretation. What seems—

Tony MartignettiWait, what was the R? Wait, the O was observation. What was the R?

Kayla MeyersThank you.

Tony MartignettiSkipped the R. Yeah, you went from O to I. Okay. OI. So good. You can't redo the OI into OI. Okay. Reflection. What are we reflecting on?

Kayla MeyersReflecting what stands out to you, what feels critical, what feels desired, what feels undesired. Right? So we're just reflecting, like, how are we feeling? So what do we see? How do we feel about it? Interpret. What does it mean for us? Why? What feels of most importance? What feels of most importance for external communications? What feels of most importance for decision-making? Where do we need to dive deeper? So interpreting that information. So here's what I see. Here's how I'm feeling about it. Here's what I think I need to do about it. And then decision-making. So what's most important for us to carry forward in next steps? What next steps are we seeing here? Who needs to be involved in the next conversation? So So where do we go from here?

Tony MartignettiAll right, cool. Thank you. Taking a little digression into technology and— wait, technology. I just lost the word. Technology of participation. Oh, of participation. Technology of participation. Thank you. Well, so what about, you know, we can talk about some of the tools. I don't know, are there tools that folks can use or is everything I don't know, proprietary to Bridgepoint, or like, are there other tools that we, that we can offer, resources?

Kayla MeyersYeah, absolutely. And truly, I'm in this work because I want folks to take on evaluation. So— I

Tony Martignettican tell you're passionate about evaluation and program management, measurement. And no, it's moving, like you're moving. Your passion is I'm feeling it. What's the word I'm looking for? Palpable. Yes, it's palpable.

Kayla MeyersOur tagline is, we turn data into stories and so can you. That's the first phrase you'll see when you open up our website because that's what we believe. And so I often work with folks to think about a data braid. So when you bring everyone together, and sometimes when I like to bring a lot of tactical work into my conversations and show— so if we show up together in person, we might pull together some yarn and start actually braiding together pieces. But think about your data braid that your organization is pulling together. The strands are going to be qualitative. They're gonna be stories. They're gonna be those mission moments that really bring your team together, that they say, I was just talking to this one participant and gosh, I just, I was reenergized. I'm ready to go. They're going to be your quantitative measures. Maybe you have some pre-post survey or some pre-post test scores. Maybe you have some confidence measures. Those different quantitative measures, as well as your operational data. So you're looking at number of people coming to your trainings, number of trainings worked. These are all different strands within your data braid. And what you— first thing that you want to do is make sure that those strands are equal, right? So if you have a data braid and one strand is a string and another is a thick piece of yarn, how do we kind of change that up to make it a little bit more balanced, to make sure that We're properly pairing things like pre-post test scores with qualitative stories that help us understand why the change in test score is important. I often work in food systems. So working, you know, whether that be with the regional food supplier or aggregator, right? So thinking about those agricultural producers who bring together all these different products and provide them in a CSA or provide them to local schools. So I work on that side of things as well as the food shelf, food distribution, food bank side. And a lot of times what we hear is the number of grocery bags sent home with students on a Friday, right? So the idea here being that, that all of us can assume is that now this family has a meal for Saturday, which is really vital when we're talking about students and making sure families are fed, because those 5 days a week is so important for families. What we don't hear is why that is so important. And so when we start talking to participants and we hear them say, well, actually, I matched it with some of the food I already had in my cupboard. Mm-hmm. And we went to my mom's house and my kids were able to have time with their grandparents interacting. I was able to check on my parents and see how they're doing, and groceries were taken care of. I wouldn't have been able to feed all of these people had it not been for some of this supplemental food. And that resonates with people. People get that. That is why people want to do this work.

Tony MartignettiRight now it's grandchildren with their grandparents and there can be a bountiful meal.

Kayla MeyersYeah, right. And so that's the grade, right? Like, we just put these pieces together to really tell a holistic story of what your organization is doing and how it's, and how it's going about doing that. Because what we also heard in this is that she didn't necessarily have enough to feed all of— are they all her dependents, right? Is she, is she a caretaker for her, for her parents there? And so we can start digging into that too and saying like, hmm, I'm hearing this amazing thing, and maybe we can expand our definition of dependence in our next intake survey and hear from folks, like, is it more than just the people in your household that you're, that you're providing meals with? That way we can adjust the, the amount of food that we're sending home with you. All

Tony Martignettiright, Kayla, what else, what else can you share in the second part of your mission? That— and you can too.

Kayla MeyersYeah, so the braid is excellent.

Tony MartignettiThe braid is excellent. I love, I love the metaphor of the braid. Equal, you know, because if you have a ball and a strand, your braid is going to be, you know, fuck up. It's going to be messed up. It's not going to be weak. It's not going to be symmetric. So that's a terrific metaphor. What else for the and you can too part?

Kayla MeyersYeah, I think, you know, really thinking about how to bring your team together for collaborative learning. And so I kind of brought some of this up, but a lot of what we do is grounded in fun. Um, so I, I actually took a lot of trainings in youth-based evaluation, and so we're learning about theater exercises and play-based exercises. And my main takeaway was like, grown-ups love having fun. Why aren't we trying this out? Mm-hmm. Um, and so, and so some of the things that we do is we do data gallery walks where we, um, we bring everyone together and set it up almost as an art gallery of charts and quotes and, um, and different, you know, tables and just invite people to walk through it like a gallery, right? Where some folks are gonna be silent observers, they're gonna be reflecting. Other folks are gonna be having quiet conversations to help say like, what are you seeing here? I'm seeing this. What do you think? And then facilitating a large group conversation. So all to say, how are you learning? How are you collaboratively using the information to bring it to life, to tell the story of what's happening and help you learn the story of where to go next?

Tony MartignettiThe braid, the data gallery. You got one more? I love 3s. Is there one more that you could—

Kayla MeyersYeah.

Tony MartignettiOne more? Okay, great.

Kayla MeyersHere's another fun one, and I learned this from a colleague, a data escape room. This one is so fun if you just want to get people together to be silly. But take your data dashboard. So instead of that gallery where you put it all over the walls, put it on a dashboard. Break into teams. I recommend shaking people up, right? So if you have a programs team, like shake them up, mix them up.

Tony MartignettiYeah, get them mixed up. Right, right, right.

Kayla MeyersYeah. And now you're going to start a timer and you're gonna tell people, these are all clues that come together to tell a story, maybe 3 stories. You escape the data escape room when your team can cohesively tell a story. So you need to make sure there's no gaps. You need to make sure all these data points are kind of coming together. to help you understand the story that's, that's coming out here. And my students know this one because I do it in class and I, we always have a blast with it. But it really helps people examine their information, examine their program data, examine their organizational data, and put it together with different quotes, with different case studies, with different test scores, things of that nature, and be able to then say like, here's a comprehensive interpretation of what I'm seeing. Mm-hmm. And here's some things that are still a little bit of gaps for me. Like, here's, here's some things that I want to learn more so I can really test and prove this. And so we come back together and have a, have a large group discussion. And that's where a lot of the learning and revealing new insights comes out.

Tony MartignettiI love the data escape room.

Kayla MeyersIt's so fun.

Tony MartignettiYeah, that's, it does sound like fun. All right. All right. What about some, some challenges? Like, you know, obstacles we were likely— oh, you know what? Before we get to the obstacles, see, I told you, lackluster. This sounds like we— this is, this is, this is a, uh, an endeavor that is going to require, you know, leadership buy-in, right? I mean, you've got to get— because this is, this is going to take some time. Um, folks are going to come together, you know, even, even the quarterly meetings can be fun, it sounds like, but still it's taking time away. We need leadership buy-in for this initiative, right? Yeah.

Kayla MeyersYeah, we do.

Tony MartignettiOkay.

Kayla MeyersWe do. And I think just keeping in mind, we're already spending that time. We're already, we're already doing these things, right? So when we are having staff all fill out their own unique spreadsheets, and then we're having maybe a grants manager or someone take all of these spreadsheets and input them, like all this manual data entry, all of this, you know, kind of rote work that's going in, that's, it's time already spent. I'm saying like, let's take that that. Instead, make it into a system where you're not working so hard on your data, but your data is working much harder for you and, and revealing what it can do for you. So, you know, think back to that team meeting too, right, where we're starting off our team meeting, the first 20 minutes are folks trying to remember what on earth they did last week and think about things they can share with their colleagues. We're going to change that. We're going to instead make sure that our data is working harder. It's in a better spreadsheet, it's in a better dashboard, And we're going to have a much— our conversation is going to go much further.

Tony MartignettiI love systems. I mean, I think they're essential systems, processes, you know, that every— we have this, we have this cadence, but each time is not the first time we've done whatever it is we're talking about. So let's have a, let's have a process so that it, it just becomes easy, it becomes natural, becomes routine instead of it being an event every time.

Kayla MeyersRight, right. And that's, and that's, you know, something that we love to bring together, right, is like we are, we are the fun folks who are going to come and have a data escape room. And we're going to be able to convert your spreadsheets into Microsoft Forms that go through Power Automate and show up in this really nice Power BI dashboard. Like, we are, we are nerds who can dig into those different things and still share a great meal and have fun, uh, at the, at the annual meeting.

Tony MartignettiCan we have a glass of wine with the meeting, or—

Kayla MeyersAbsolutely. We're always in.

Tony MartignettiOkay, okay. And I love you, you're coming in like, we're, we're the fun, we're gonna have fun with People are like rolling their eyes. Yeah, I don't think so. But I'm sure within the first 10 minutes or so, you change minds. All right. So, I was starting to ask you about, you know, obstacles we might see in our data, our measurement and data analysis flow, our process. What, you know, what are some common things we might see and how do

Kayla MeyersYeah, I think one of the first challenges I often encounter—

Tony MartignettiJourney. That was the word I was like, journey, journey. I tell you, lackluster host. I told you this journey that we're on together. That's what I meant to say. Yeah. All right. Sorry.

Kayla MeyersYep. No, you're good. So the journey, so I think one of the biggest obstacles on that journey is folks are gonna struggle with how much do I leave behind and how much do I, do I kind of retroactively fix? So for example, when we're talking about a new way to enter in your data, right, that is going to give us a bit of a bump in the road in terms of, well, do we want to program all of our past data into this new dashboard, or are we just starting on day 1 and moving forward? That's a really important conversation to have to talk about the implications of either decision-making. But we can, we can think about the ways that we can utilize your community, your volunteers to help us with that backlog if we need to do that. Okay. And that shows up in a lot of different ways, right? It's kind of like if we refine and change our systems right now, how does that impact us in terms of having this longitudinal story, this longitudinal measure? It might, but at the end of the day, if you have a longitudinal story that doesn't really represent your work, doesn't go that deep, can't tell you that much, how valuable is it, right? So let's talk about setting up the framework for longitudinal work moving forward. Yeah. The other, the other challenge that's gonna come up is that you're gonna have funders who want different measures, and that is a pain point that a lot of organizations go through. So, you know, any funder or any development team will tell you that getting in those diverse types of funding is really key. The challenge is that when you bring in all these different funders, they might have all their own reporting requirements. And so how do you build out a system, an evaluation system in which you can meet all of those requirements while still being proactive about your learning, your strategy, your decision-making. That's where I think it can be really helpful to bring in, to bring in a team because it's a heavy load to lift at the front end. Once you have it figured out, you're good to go.

Tony MartignettiOkay. Only 2, only 2 obstacles to our journey?

Kayla MeyersThose are the 2 that pretty much always come up.

Tony MartignettiMost common. Okay.

Kayla MeyersYeah, those, those are the 2 that it's just, they're, they're just real challenges. They're just in the world. And, and I think, you know, staff, staff feelings and staff sentiments, kind of like you brought up when we started this, right? Like getting people to come to an evaluation workshop is like getting them to show up to algebra. Like no one wants to be there.

Tony MartignettiYeah.

Kayla MeyersI actually had a participant come up to me after a recent workshop and she said, I'm, I want you to know that they made me come here kicking and screaming. I brought out the entire book. I'm too busy, I'm sick, I'm this, and leadership said, please go. And now I actually have tangible tools, right? So once we get out of this, oh, can we do a crosstab here? Can we do a t-test there? People just gloss over it, right? They're like, oh my gosh, let's move that. That doesn't need to be something you have to worry yourself with is like, what is a t-test? What is she talking about? But instead saying, here's the results. Here's what this actually says. What we know is that the more times people come to our workshop, the better their savings account grows. That's what the main takeaway is, is what I'm trying to tell you. And kind of get yourself away from some of that jargon, some of that, you know, just that middle school math feeling of like, oh my gosh, why is there a letter in this math equation? I don't understand what's going on. And I say that as someone who did really struggle with, with some of, some of those math lessons. And so I understand where people are coming

Tony MartignettiThat's a great place to wrap because it's uplifting. You talk about t-tests. I took Statistics for Poets at Carnegie Mellon University. So, you know, that's— I recognize the phrase t-test. All right. Kayla, Professor Kayla Meyers. Outstanding. Thank you. Founder of Bridgepoint Evaluation. The company is at bridgepointevaluation.com. And Kayla is on LinkedIn. Kayla, thank you so much. Really.

Kayla MeyersThank you so much. This was fantastic.

Tony MartignettiI'm glad. I think it's fun. You make data fun.

Kayla MeyersI try.

Tony MartignettiYou're succeeding. Now, a lot of people are trying. You've, you've, you've succeeded.

Kate MartignettiNext week, grow your personal brand and your nonprofit. If you missed any part of this week's show,

Tony MartignettiI beseech you, find it at tonymartignetti.com.

Kate MartignettiOur creative producer is Claire Meyerhoff. I'm your associate producer, Kate Martignetti. The show's social media is by Susan Chavez. Marc Silverman is our web guy, and this music is by Scott Stein.

Tony MartignettiThank you for that affirmation, Scotty. Be with us next week. Next week for Nonprofit Radio, big nonprofit ideas for the other 95%. Go out and be great. Thank you.

Nonprofit Radio