Spring 2026 SOWK 460w Week 02 - Steps in Program Evaluation

Slide 1
Diagram with arrows labeled 1, 2, and 3, indicating a process. Text: 'Steps in Program Evaluation, Week 02,' and 'Spring 2026 SOWK 460w.' Mention of Jacob Campbell, Ph.D. at Heritage University.

Spring 2026 SOWK 460w Week 02 - Steps in Program Evaluation

title: Spring 2026 SOWK 460w Week 02 - Steps in Program Evaluation date: 2026-01-25 23:21:45 location: Heritage University tags:

presentation_video: > “” description: >

Program evaluation is an ethical obligation to us as social workers, but also beneficial to staff, agencies, and clients. During week two of this course, we will focus on the why of program evaluation and an overview of the evaluative process. We will also pick our learning teams for the program evaluation you will conduct this semester. The following is the agenda for the class session:

  • Why program evaluation as a process
  • The steps involved in program evaluation
  • Getting settled with the program evaluation assignment

Learning Objectives

  • Explain the purpose and importance of program evaluation in social work practice.
  • Describe the key steps involved in the program evaluation process and how they guide evaluation design and implementation.
  • Identify and evaluate characteristics of strong, evidence-informed program evaluations.
  • Apply ethical standards from the NASW Code of Ethics related to evaluation and research.
  • Generate initial ideas for program evaluation projects connected to their practicum settings.
Slide 2
Presentation slide titled 'SOWK 460w Week 02 Plan' with agenda and learning objectives related to program evaluation in social work. Includes objectives on purpose, steps, characteristics, ethics, and ideas for evaluation. Presenter: Jacob Campbell, Ph.D., at Heritage University. Spring 2026.

SOWK 460w Week 02 Plan: What we will be covering today

Agenda

  • Why program evaluation as a process
  • The steps involved in program evaluation
  • Getting settled with the program evaluation assignment

Learning Objectives

  • Explain the purpose and importance of program evaluation in social work practice.
  • Describe the key steps involved in the program evaluation process and how they guide evaluation design and implementation.
  • Identify and evaluate characteristics of strong, evidence-informed program evaluations.
  • Apply ethical standards from the NASW Code of Ethics related to evaluation and research.
  • Generate initial ideas for program evaluation projects connected to their practicum settings.
Slide 3
**Object:** Presentation slide **Action:** Displays course details **Context:** Describes a class at Heritage University, listing instructor contact info, class times, and land acknowledgment.**Text:** Left side: 'General Questions About the Class. We will talk more practically about the program evaluation later in class.'Right side: Details for 'Heritage University SOWK 460W (3 credits)'. Instructor: Dr. Jacob Campbell. Office hours, contact info, and class dates are provided. Includes Land Acknowledgement and Course Description.Bottom left: Jacob Campbell, Ph.D., LICSW at Heritage University, SOWK 460W Spring 2026.

General Questions About the Class

[Whole Class Activity] Open up for general questions about the class.

… We will talk more practically about the program evaluation later in class.

Slide 4
A line graph labeled 'A' and 'B' with points rising from Week 5 to Week 9. Text: 'Single Case Design... before, during, and after treatment... effectiveness of an intervention.'

Single Subject Design

Single-Subject Designs are research methods used to determine whether an intervention was successful.

  • Often used with a single case or client.
  • Is a method used when the achievement of the goal is sufficiently important to be used as the primary outcome criterion. This focuses on the desired state and not the problem.
  • A / B data points
  • Prior to intervention and after intervention
Slide 5
A presentation slide displays a QR code labeled 'Code of Ethics' on the right. On the left, text discusses social workers' ethical responsibilities and poses reflective questions. The background is beige.

Social Workers’ Ethical Responsibility to the Social Work Profession

5.02 Evaluation and Research has 17 specific points…

[Small Group Activity] Think, Pair, Share

  1. I want you to go to https://www.socialworkers.org/About/Ethics/Code-of-Ethics/Code-of-Ethics-English/Social-Workers-Ethical-Responsibilities-to-the-Social-Work-Profession
  2. Read through it
  3. Discuss the following questions with some people around you.

What stands out to you from this section? What are the ways that you imagine fulfilling this in your career?

[Whole Class Activity] Solicit ideas from the group.

Reference

National Association of Social Workers. (2021). NASW code of ethics. https://www.socialworkers.org/About/Ethics/Code-of-Ethics/Code-of-Ethics-English

Slide 6
Text slide outlines 'Why Program Evaluation,' listing benefits: ethical obligation, improve impact, support funding, identify needs, improve skills, clarify program, advocate for program. Author: Jacob Campbell, SOWK 460w Spring 2026.

Why Program Evaluation: What it can mean for us and our agencies

Program evaluation important task for social workers.

[Whole Class Activity] Why should we do program evaluation?

  • Ethical Obligation: Social workers have an ethical obligation to research
  • Improve skills: Improve skills and understanding of practice behaviors (consider PEER EBD)
  • Identify Needs: Evaluation can help to effectively identify the service needs of client populations (consider being effective, the most effective)
  • Improve Impact: Evaluation can improve the program’s potential impact
  • Clarify Program: Evaluation can make participants’ perspectives about the program more understood (sharing ideas, fleshing out what the program does and looks like)
  • Support Funding: It is essential to receive funding
  • Advocate for Program: It provides an avenue to share about the program and the work they are doing. This can help with program advocacy and development, increasing resources
Slide 7
Slide displaying guidelines for strong evaluation, listing considerations like sufficient sample size, objective data, legitimate claims, intervention evaluation, and data sharing. It highlights transparency in reporting limitations and connections between claims and interventions.

Characteristics of Strong Evaluation: Some of the Things We Should Consider

I think it is helpful that Royse (2022) framed the rationale for engaging in program evaluation related to being able to process and understand research and use critical thinking skills. He provides several aspects we should consider in accepting if something is a strong evaluation (which also is what we should build into our own)

  • Enough people in the sample size
  • Objective data reported (facts, not some testimonials)
  • No unfounded claims
  • Evaluation of intervention across different types of clients
  • Use of a valid/reliable standardized instrument for pre/post-test
  • Sharing all data (both good and bad)
  • Reporting all limitations and challenges, along with the positive
  • Provide details connecting the claims with what happened in the intervention
Slide 8
Object: Presentation slide Action: Explains finding evidence Context: Social worker interventions Text: - 'Looking for Evidence In Social Worker Interventions'- Questions about interventions, evidence, journal articles, and comparisons- References: 'Holden & Barker, 2018'- Instruction: Examine the article mentioned - Presented by: 'Jacob Campbell, Ph.D., LICSW at Heritage University, SOWK 460w Spring 2026'

Looking for Evidence: In Social Worker Interventions

Social work is a broad field with many potential interventions, and even some things that sound odd or weird (consider EMDR). The practices we engage in should be grounded in strong research and evidence-based practice.

I don’t think this means we can’t go to new places. Share the story of a supervisee who wants to do therapy and personal training.

[Small Group Activity] Working in groups of three or four, do the following:

Royse (2022) puts forth an activity using Holden and Barker (2018) and their article to consider the evidence. Examine the Holden and Barker (2018) article “Should Social Workers Be Engaged in These Practices?” Try to find one of the URLs still active to review the intervention or practice presented on the website. Then respond to the questions below.

  • What is the intervention, practice, or product that you examined
  • Explore for any objective evidence that you found to support the intervention?
  • Were any professional journal articles cited?
  • Was any comparison made to a comparison or control group with the same problem?
  • Estimate the benefit, in your opinion, that clients would receive from this intervention or product. Explain your response.

Reference

Holden, G., & Barker, K. (2018). Should social workers be engaged in these practices? Journal of Evidence-Informed Social Work, 15(1), 1-13. https://doi.org/10.1080/23761407.2017.1422075

Slide 9
Flowchart illustrating program evaluation steps, including identifying evaluation question, conceptualizing, operationalizing, selecting sample, data collection, management, and utilization. Titled 'Steps in a Program Evaluation' by Jacob Campbell, Ph.D.

Steps in a Program Evaluation: A Flow Chart

The following are the eight steps that we think about taking as a part of program evaluation.

(Kapp & Anderson, 2010)

Slide 10
The image is a flowchart illustrating steps in program evaluation. It includes stages like identifying evaluation questions, selecting samples, data collection, and analysis. Text includes course and author details: Jacob Campbell, Ph.D., LICSW at Heritage University, SOWK 460w Spring 2026.

Steps 1: Identify Evaluation Question

The first thing we must do is develop the question we are going to address in our evaluation. These questions guide all aspects of the process.

The project’s general focus is stated as a research question.

(Kapp & Anderson, 2010)

Slide 11
A flowchart diagram outlines steps in a program evaluation process. Key sections include 'Identify Evaluation Question' and 'Conceptualize Question.' Text: 'Steps in Program Evaluation' by Jacob Campbell, Ph.D., Heritage University.

Step 2: Conceptualize Question

The second step we take is conceptualize the question.

When we have properly done this step, we will be able to say that…

  • The key concepts in the evaluation question are clarified
  • A clear conceptual framework is chosen after considering different approaches

(Kapp & Anderson, 2010)

Slide 12
Flowchart illustrates program evaluation steps, detailing question identification, conceptualization, operationalization, method selection, sample selection, data collection, analysis, and information utilization. Labeled: 'Steps in a Program Evaluation,' 'Jacob Campbell, Ph.D., LICSW.'

Step 3: Operationalize Question

After we know what our question is asking and what it means, we need to define the terms and concepts in the question.

Specific concepts of the evaluation question are defined.

This means defining the terms within that question. For example, if the word family ‘who’ is meant by the term.

(Kapp & Anderson, 2010)

Slide 13
A flowchart illustrates program evaluation steps: identifying questions, conceptualization, operationalization, and defining methods, leading to data collection and analysis. Text includes: 'A Flow Chart Steps in a Program Evaluation,' 'Jacob Campbell, Ph.D., LICSW at Heritage University,' 'SOWK 460w Spring 2026,' and steps such as 'Identify Evaluation Question,' 'Pick and Define Method,' and 'Utilization of Information.'

Step 4: Pick and Define Method

The fourth step is to pick and define the method being used.

You will notice that the authors use various mono-directional and bidirectional arrows. I have kept these in my rendition of the graphic. That is because there is a flow back and forth, and it is fluid.

Some of the methods for program evaluation we will be talking about during this course include:

  • Reviewing archival data
  • Group designs and methods
  • Qualitative designs and applications
  • Consumer satisfaction

(Kapp & Anderson, 2010)

Slide 14
Flowchart illustrating steps in program evaluation, including 'Identify Evaluation Question,' 'Conceptualize Question,' 'Operationalize Question,' leading to 'Data Collection' and 'Data Management & Analysis.' Text includes course details, SOWK 460w Spring 2026, and creator's name, Jacob Campbell.

Step 5: Select Sample

Then we select the sample

Evaluation participants/data collected.

We could talk about types of sampling (both probability and non-probability)

(Kapp & Anderson, 2010)

Slide 15
A flowchart illustrates program evaluation steps with numbered processes: Identify Evaluation Question, Conceptualize and Operationalize Questions, Pick Method, Select Sample, Data Collection, Management, Analysis, and Utilization. Presented by Jacob Campbell, Ph.D., Heritage University.

Step 6: Data Collection

Step six we gather the data we are going to collect

(Kapp & Anderson, 2010)

Slide 16
The image shows a flow chart detailing steps in program evaluation. Key actions include identifying evaluation questions, conceptualizing, operationalizing, defining methods, selecting samples, collecting data, and managing data. Text includes: 'A Flow Chart Steps in a Program Evaluation' by Jacob Campbell, Ph.D., and 'SOWK 460w Spring 2026.'

Step 7: Data Management & Analysis

Step seven is managing the data we have collected securely and our analysis of that data.

(Kapp & Anderson, 2010)

Slide 17
Flowchart illustrates steps in program evaluation: Identify Evaluation Question, Conceptualize, Operationalize, Pick Method, Select Sample, Data Collection, Data Management, Utilization. Text: 'Steps in a Program Evaluation,' 'The use of information for service improvement is primary,' Jacob Campbell, Ph.D. at Heritage University, SOWK 460w Spring 2026.

Step 8: Utilization of Information

The final step is that the agency needs to use the information. The authors even included an oversized box around this topic to designate this task’s importance.

The primary use of information is for service improvement.

(Kapp & Anderson, 2010)

Slide 18
Flowchart outlines program evaluation steps: identifying evaluation question, conceptualizing and operationalizing it, selecting sample, defining method, collecting data, managing and analyzing data, utilizing information. Text includes: 'A Flow Chart Steps in a Program Evaluation,' 'Jacob Campbell, Ph.D., LICSW at Heritage University,' 'SOWK 460w Spring 2026.'

All Steps of Program Evaluation

Reference

Kapp, S. A., & Anderson, G. R. (2010). Agency-based program evaluation: Lessons from practice. Sage Publications. https://doi.org/https://doi.org/10.4135/9781544364896

Slide 19
The slide, titled 'Practicums and Evaluation Ideas,' features a circular graphic labeled 'Working in Circles' with advice on communication. Questions prompt reflection on practicum activities and evaluations. Credits note Jacob Campbell, Ph.D., LICSW at Heritage University, SOWK 460w Spring 2026.

Practicums and Evaluation Ideas: Thinking About Research Projects

[Whole Class Activity] Restorative Justice style circle.

Review norms:

  • Respect the talking piece
  • Speak from the heart
  • Listen from the heart
  • Trust that you know what to say
  • Say just enough

Ask Questions:

  • Where is your practicum at? (Tell about agency and activities)
  • What are some of the things that you are doing and learning at your practicums?
  • What are ideas of potential program evaluations that you could imagine at your practicum placement

Reference

Clifford, A. (2013). Teaching restorative practices with classroom circles. http://restorativejustice.org/am-site/media/teaching-restorative-practices-with-classroom-circles.pdf

Slide 20
A presentation slide titled 'Developing a Learning Team' features colorful LEGO pieces surrounding the text 'It Takes Different Parts and Pieces.' Discussion points include qualities for an effective learning team. Presented by Jacob Campbell, Ph.D., LICSW, at Heritage University, SOWK 460w Spring 2026.

Developing a Learning Team

It takes different pieces

[Whole Class Activity]

  • What kind of qualities would we be looking for or consider to have an effective learning team
  • What is important for us all to do as a part of our team

[Whole Class Activity] Take time for people to go and find group mates.

Slide 21
The slide outlines 'Program Evaluation as an Assignment,' detailing components such as '10 Individual Weekly Journal Entries,' 'Group Work Plan,' 'Agency Logic Model,' 'Executive Summary,' and 'Group Presentation,' authored by Jacob Campbell, Ph.D., at Heritage University for SOWK 460w Spring 2026.

Program Evaluation as an Assignment

  • Starting week 5 there are 10 Individual Weekly Journal Entries
  • Group Work Plan for the Program Evaluation: Includes evaluation design and data collection with tasks and deadlines assigned to group members
  • Agency Logic Model: The logic model looks at how a program is implemented through understanding the program’s resources, staff activities, program processes, and outcomes (often framed as immediate, intermediate, and long-range)
  • Executive Summary: Includes introduction, logic model, ethical framework, methods, data/findings, narrative/discussion, and references
  • Group Presentation: Inviting agency staff and university faculty

Discussion: Location and Date of Presentation

Slide 22
Presentation slide with text 'Next Week is Asynchronous' and instructions for 'CITI Research Ethics and Compliance Training' and 'Forum Questions.' Includes the names Jacob Campbell and Heritage University, SOWK 460w Spring 2026.

For Next Week (Week 03)

Next Week is Asynchronous What to do for week three…

Tasks:

  • CITI Research Ethics and Compliance Training
  • Forum Questions