tools, techniques, concepts related to Program Evaluation
This question intrigues me because of how much it implies about an organization’s culture and values around learning, failure and transparency. In my Program Evaluation classes at CSUEB’s Nonprofit Management Program, students engage in a mock debate about whether it’s better for nonprofits to do their own program evaluation or to bring in external evaluators … Read more
Last newsletter (July), I wrote about the plethora and uses of nonprofit organizational capacity assessment tools, such as the popular OCAT and CCAT. In researching such tools, I came across one that was new to me–Performance Practice (also called the Performance Imperative Organizational Self-Assessment or PIOSA). I liked its structure, transparency and the way its developers and … Read more
Sitting down to write this post, ideas were swirling around my head, colliding into each other. I had just read several recent reports and blog posts set aside in a “food for thought” email folder. There was Open Road Alliance’s startling—but not surprising—research finding that “Funder-created Obstacles” were the most common type of roadblock mission-driven … Read more
A couple weeks before the year-end holidays, I fell down and injured my knee and wrist. While not the first time I’ve had serious injuries, it was the first time an injury caused me serious mobility challenges. For over a week, I could barely walk and didn’t go out much. The experience was humbling. When … Read more
I recently took a 3-day facilitation skills training at Community At Work in San Francisco. If you aren’t familiar with CAW, you might wish to get better acquainted with this terrific, 31-year-old consulting, training and organization development think tank organization. Taught by masterful trainer/facilitator Sarah Fisk, a long-time senior consultant there, the Group Facilitation Skills: … Read more
Over the past few years, I’ve been called to examine the ways my cultural, racial and socio-economic background influences the work I do with nonprofit staff and boards, especially in program evaluation projects. I’d like to share a few insights I’ve gained from this exploration of what is now often called “white privilege”. My middle … Read more
Editor’s note: My colleague Deb Stephenson, an advisor to nonprofits on the design and implementation of information systems and a genius at diagnosing and solving technology problems, and I co-authored this post. With all the talk about nonprofits needing to prove their impact and stories about “big data”, pressure to keep up is prompting some … Read more
How do you answer questions about the difference you are making in the world? Do you and others in your nonprofit talk about program outcomes or program impact? In what ways do you describe the changes in your clients after they’ve been through your program? Do you compare their knowledge, attitudes or behavior after your … Read more
My firm has worked with a number of small nonprofit organizations that wanted help figuring out how to collect and analyze program outcomes data. They seek answers to such questions as: “Are our programs really working?” and “Are participants being helped in the ways we intend?” Most request help “creating a survey”, which, on the … Read more
I just finished teaching a 2-evening Program Evaluation course at California State University East Bay. This month, I engaged students in a quasi-debate fueled by a 2-part SSIR essay arguing that nonprofit service providers should NOT evaluate their own program outcomes. Because they lack social science research expertise and face conflicts of interest in reporting … Read more