Week 07 - Program Evaluation Design and Planning
A presentation at Heritage University @ CBC Week 07 in in Pasco, WA 99301, USA by Jacob Campbell
SOWK 460 Spring 2020 Planning: Class 07
Location: CBC Campus - SWL 208
Time: Mondays from 5:30-8:15
Week 07: 2/24/20
Topic and Content Area:
- Evaluation Design
- Planning
Reading Assignment: Kapp and Anderson chapters 8-9
Assignments Due:
- A-02 Reading Quiz 02/24/20
- A-04a: Weekly Journal 03 03/01/20
- A-04c: Group Work Plan 03/01/20
Other Important Information: N/A
Review: Logic Model Development
What success did you have? What barriers did you face?
If you were to do it again, what would you do differently? Why?
Review: Logic Model Development
What are the qualities and components of a good logic model?
Our Objectives
- We will use our logic models to identify information needs.
- We will identify the strengths and weaknesses of various program evaluation design models.
- We will utilize our logic models and our understanding of program evaluation design models to develop our evaluation plans.
Using Logic Models to Identify Key Information Needs
Using Logic Models to Identify Key Information Needs
Reviewing the logic model, ask yourself, “What information do we need to effectively evaluate the processes and outcomes of the program?”
Process: A process is the implementation of a key component of the program. In the Kellogg logic model, processes are described as activities and quantified as outputs.
Outcomes: Outcomes are results that occur that are directly linked to program processes.
Residential Treatment Program
[Whole Class Activity] Discuss this as an example logical model. Review how it would be created, the details within it, and how it helps in determining the evaluative process
Residential Treatment Program
Conceptualization for program and component and the indicators that we can track.
Residential Treatment Program
Adding to the conceptualization
Using Logic Models to Identify Key Information Needs
Reviewing your logic model, ask yourself…
“What information do you need to effectively evaluate the processes and outcomes of the program?”
Evaluation Design: How Data Will Be Collected
Brainstorm
[Whole Class Activity] How can we get the data we need for a program evaluation?
Sources of Information
- Questionnaires, surveys, checklists
- Interviews
- Observations
- Focus groups
- Existing data (systematically gathered data, case files, treatment documentation, etc.)
- Controlled experiments
Assigned Sources of Information
[Small Group Activity] Discuss
What are the advantages of getting data using this source? What are the disadvantages?
Residential Treatment Program
Addition of information sources
Identifying Data Sources
Review the program components and indicators you identified
“What is the best source of information for each indicator?”
Planning Your Evaluation
Planning Your Evaluation
- What program component(s) will you evaluate?
- What indicator will you use to measure each component?
- What will be your data source for each indicator?
- What does “success” look like? A. Comparison with pre-established target? (What is the pre-established target?) B. Positive change over time? (What are the time frames?)
- How will you collect the data?
- By when will you collect the data?
- Who will be responsible for collecting the data?
- How will you share the data?
Form
Discuss what to include…
This week is about understanding the logic model and being able to connect that to the program evaluation. The objectives are as follows:
- We will use our logic models to identify information needs.
- We will identify the strengths and weaknesses of various program evaluation design models.
- We will utilize our logic models and our understanding of program evaluation design models to develop our evaluation plans.
