Spring 2026 SOWK 460w Week 02 - Steps in Program Evaluation

title: Spring 2026 SOWK 460w Week 02 - Steps in Program Evaluation date: 2026-01-25 23:21:45 location: Heritage University tags:

presentation_video: > “” description: >

Program evaluation is an ethical obligation to us as social workers, but also beneficial to staff, agencies, and clients. During week two of this course, we will focus on the why of program evaluation and an overview of the evaluative process. We will also pick our learning teams for the program evaluation you will conduct this semester. The following is the agenda for the class session:

  • Why program evaluation as a process
  • The steps involved in program evaluation
  • Getting settled with the program evaluation assignment

Learning Objectives

  • Explain the purpose and importance of program evaluation in social work practice.
  • Describe the key steps involved in the program evaluation process and how they guide evaluation design and implementation.
  • Identify and evaluate characteristics of strong, evidence-informed program evaluations.
  • Apply ethical standards from the NASW Code of Ethics related to evaluation and research.
  • Generate initial ideas for program evaluation projects connected to their practicum settings.

SOWK 460w Week 02 Plan: What we will be covering today

Agenda

  • Why program evaluation as a process
  • The steps involved in program evaluation
  • Getting settled with the program evaluation assignment

Learning Objectives

  • Explain the purpose and importance of program evaluation in social work practice.
  • Describe the key steps involved in the program evaluation process and how they guide evaluation design and implementation.
  • Identify and evaluate characteristics of strong, evidence-informed program evaluations.
  • Apply ethical standards from the NASW Code of Ethics related to evaluation and research.
  • Generate initial ideas for program evaluation projects connected to their practicum settings.

General Questions About the Class

[Whole Class Activity] Open up for general questions about the class.

… We will talk more practically about the program evaluation later in class.

Single Subject Design

Single-Subject Designs are research methods used to determine whether an intervention was successful.

  • Often used with a single case or client.
  • Is a method used when the achievement of the goal is sufficiently important to be used as the primary outcome criterion. This focuses on the desired state and not the problem.
  • A / B data points
  • Prior to intervention and after intervention

Social Workers’ Ethical Responsibility to the Social Work Profession

5.02 Evaluation and Research has 17 specific points…

[Small Group Activity] Think, Pair, Share

  1. I want you to go to https://www.socialworkers.org/About/Ethics/Code-of-Ethics/Code-of-Ethics-English/Social-Workers-Ethical-Responsibilities-to-the-Social-Work-Profession
  2. Read through it
  3. Discuss the following questions with some people around you.

What stands out to you from this section? What are the ways that you imagine fulfilling this in your career?

[Whole Class Activity] Solicit ideas from the group.

Reference

National Association of Social Workers. (2021). NASW code of ethics. https://www.socialworkers.org/About/Ethics/Code-of-Ethics/Code-of-Ethics-English

Why Program Evaluation: What it can mean for us and our agencies

Program evaluation important task for social workers.

[Whole Class Activity] Why should we do program evaluation?

  • Ethical Obligation: Social workers have an ethical obligation to research
  • Improve skills: Improve skills and understanding of practice behaviors (consider PEER EBD)
  • Identify Needs: Evaluation can help to effectively identify the service needs of client populations (consider being effective, the most effective)
  • Improve Impact: Evaluation can improve the program’s potential impact
  • Clarify Program: Evaluation can make participants’ perspectives about the program more understood (sharing ideas, fleshing out what the program does and looks like)
  • Support Funding: It is essential to receive funding
  • Advocate for Program: It provides an avenue to share about the program and the work they are doing. This can help with program advocacy and development, increasing resources

Characteristics of Strong Evaluation: Some of the Things We Should Consider

I think it is helpful that Royse (2022) framed the rationale for engaging in program evaluation related to being able to process and understand research and use critical thinking skills. He provides several aspects we should consider in accepting if something is a strong evaluation (which also is what we should build into our own)

  • Enough people in the sample size
  • Objective data reported (facts, not some testimonials)
  • No unfounded claims
  • Evaluation of intervention across different types of clients
  • Use of a valid/reliable standardized instrument for pre/post-test
  • Sharing all data (both good and bad)
  • Reporting all limitations and challenges, along with the positive
  • Provide details connecting the claims with what happened in the intervention

Looking for Evidence: In Social Worker Interventions

Social work is a broad field with many potential interventions, and even some things that sound odd or weird (consider EMDR). The practices we engage in should be grounded in strong research and evidence-based practice.

I don’t think this means we can’t go to new places. Share the story of a supervisee who wants to do therapy and personal training.

[Small Group Activity] Working in groups of three or four, do the following:

Royse (2022) puts forth an activity using Holden and Barker (2018) and their article to consider the evidence. Examine the Holden and Barker (2018) article “Should Social Workers Be Engaged in These Practices?” Try to find one of the URLs still active to review the intervention or practice presented on the website. Then respond to the questions below.

  • What is the intervention, practice, or product that you examined
  • Explore for any objective evidence that you found to support the intervention?
  • Were any professional journal articles cited?
  • Was any comparison made to a comparison or control group with the same problem?
  • Estimate the benefit, in your opinion, that clients would receive from this intervention or product. Explain your response.

Reference

Holden, G., & Barker, K. (2018). Should social workers be engaged in these practices? Journal of Evidence-Informed Social Work, 15(1), 1-13. https://doi.org/10.1080/23761407.2017.1422075

Steps in a Program Evaluation: A Flow Chart

The following are the eight steps that we think about taking as a part of program evaluation.

(Kapp & Anderson, 2010)

Steps 1: Identify Evaluation Question

The first thing we must do is develop the question we are going to address in our evaluation. These questions guide all aspects of the process.

The project’s general focus is stated as a research question.

(Kapp & Anderson, 2010)

Step 2: Conceptualize Question

The second step we take is conceptualize the question.

When we have properly done this step, we will be able to say that…

  • The key concepts in the evaluation question are clarified
  • A clear conceptual framework is chosen after considering different approaches

(Kapp & Anderson, 2010)

Step 3: Operationalize Question

After we know what our question is asking and what it means, we need to define the terms and concepts in the question.

Specific concepts of the evaluation question are defined.

This means defining the terms within that question. For example, if the word family ‘who’ is meant by the term.

(Kapp & Anderson, 2010)

Step 4: Pick and Define Method

The fourth step is to pick and define the method being used.

You will notice that the authors use various mono-directional and bidirectional arrows. I have kept these in my rendition of the graphic. That is because there is a flow back and forth, and it is fluid.

Some of the methods for program evaluation we will be talking about during this course include:

  • Reviewing archival data
  • Group designs and methods
  • Qualitative designs and applications
  • Consumer satisfaction

(Kapp & Anderson, 2010)

Step 5: Select Sample

Then we select the sample

Evaluation participants/data collected.

We could talk about types of sampling (both probability and non-probability)

(Kapp & Anderson, 2010)

Step 6: Data Collection

Step six we gather the data we are going to collect

(Kapp & Anderson, 2010)

Step 7: Data Management & Analysis

Step seven is managing the data we have collected securely and our analysis of that data.

(Kapp & Anderson, 2010)

Step 8: Utilization of Information

The final step is that the agency needs to use the information. The authors even included an oversized box around this topic to designate this task’s importance.

The primary use of information is for service improvement.

(Kapp & Anderson, 2010)

All Steps of Program Evaluation

Reference

Kapp, S. A., & Anderson, G. R. (2010). Agency-based program evaluation: Lessons from practice. Sage Publications. https://doi.org/https://doi.org/10.4135/9781544364896

Practicums and Evaluation Ideas: Thinking About Research Projects

[Whole Class Activity] Restorative Justice style circle.

Review norms:

  • Respect the talking piece
  • Speak from the heart
  • Listen from the heart
  • Trust that you know what to say
  • Say just enough

Ask Questions:

  • Where is your practicum at? (Tell about agency and activities)
  • What are some of the things that you are doing and learning at your practicums?
  • What are ideas of potential program evaluations that you could imagine at your practicum placement

Reference

Clifford, A. (2013). Teaching restorative practices with classroom circles. http://restorativejustice.org/am-site/media/teaching-restorative-practices-with-classroom-circles.pdf

Developing a Learning Team

It takes different pieces

[Whole Class Activity]

  • What kind of qualities would we be looking for or consider to have an effective learning team
  • What is important for us all to do as a part of our team

[Whole Class Activity] Take time for people to go and find group mates.

Program Evaluation as an Assignment

  • Starting week 5 there are 10 Individual Weekly Journal Entries
  • Group Work Plan for the Program Evaluation: Includes evaluation design and data collection with tasks and deadlines assigned to group members
  • Agency Logic Model: The logic model looks at how a program is implemented through understanding the program’s resources, staff activities, program processes, and outcomes (often framed as immediate, intermediate, and long-range)
  • Executive Summary: Includes introduction, logic model, ethical framework, methods, data/findings, narrative/discussion, and references
  • Group Presentation: Inviting agency staff and university faculty

Discussion: Location and Date of Presentation

For Next Week (Week 03)

Next Week is Asynchronous What to do for week three…

Tasks:

  • CITI Research Ethics and Compliance Training
  • Forum Questions