Week 04 - Program Evaluation Process and Logic Models
A presentation at Heritage University @ CBC Week 04 in in Pasco, WA 99301, USA by Jacob Campbell
SOWK 460 Spring 2020 Planning: Class 04
Location: CBC Campus - SWL 208
Time: Mondays from 5:30-8:15
Week 04: 2/3/20
Topic and Content Area:
- Cultural Competency
- Logic Models
Reading Assignment: Kapp and Anderson chapters 4, 7
Assignments Due:
- A-02 Reading Quiz 02/03/20
- A-04a: Weekly Journal 01 02/09/20
- A-04b: Group Logic Model 02/09/20
Other Important Information: N/A
Agenda
- Overview of program evaluation process
- Logic models
Key Parts of Program Evaluation
There are number of parts that we must consider as we move into doing program evaluation.
- Engage stakeholder in the evaluation process
- Assess and address agency political factors
- Choose an evaluation design
- Data collection
- Reporting and using data
- Addressing culturally competent program evaluation
Steps in Program Evaluation
In preparing for a program evaluation, the following would be some of the steps to take.
- Identify evaluation question
- Conceptualize question
- Operationalize question
- Pick and define method
- Select sample
- Data collection
- Data management and analysis
- Utilization of information
Program Evaluation Check In
A program logic model is a picture of how an organization does its work — the theory and assumptions underlying the program. A program logic model links outcomes (both short- and long-term) with program activities/processes and the theoretical principles/assumptions of the program.
Logic Models - Purpose
A program logic model is a picture of how an organization does its work — the theory and assumptions underlying the program. A program logic model links outcomes (both short- and long-term) with program activities/processes and the theoretical principles/assumptions of the program.
Logic Models - Purpose
There are a number of reasons why it is useful to have a logic model for a program.
- Stakeholders are allowed to articulate their views about the program
- Stakeholders are allowed to hear and appreciate the views of other stakeholders
- Divergent views about the program are synthesized in a collaborative process.
- An integrated model is developed with stakeholder ownership
- The integrated model is scrutinized publicly for feasibility
- The model serves as a solid reference for program management decisions
- The model is used as an organizing tool for evaluation
- The model can be used as a promotional tool for the program
- The model can be employed to support program proposals for grant activities
Logic Models - Stakeholders
Engaging all of the stakeholders will get a more complete picture
- Clients
- Direct service staff
- Supervisory / management staff
- Executive staff
- Board of directors
- Funders
- Community partners
Logic Models - Potential Interview Questions
The following would be some potential interview questions to help develop a logic model.
- How is the program staffed and organized?
- What components are involved with the program other than staff?
- Can you describe the major activities of the program?
- What resources are devoted to these activities
- What are the main objectives of the program? What is the program trying to accomplish
- What accomplishments is the program likely to achieve in the next 2 and 3 years? What would you expect?
- How will these activities undertaken by the program accomplish the results?
- What kinds of information do you have on the program?
- How do you use this information?
- What kinds of information do you need to assess program performance?
- How would you use this information?
- What measures or indicators are relevant to the program?
- What problems face the program?
- What factors are likely to influence the program over the next 2 to 5 years?
Book Template for Logic Model
- Resources
- Staff activities
- Program processes
- Immediate outcomes
- Intermediate outcomes
- Long-range outcomes
Logic Model Example - PDC
Different type of logic model, but similar in many ways.
Logic Model Example - Basics
Resources/Inputs: The human, financial, organizational, and community resources a program has available to direct toward doing the work
Activities: What the program does with its resources (processes, tools, events, technology, actions)
Outputs: The direct product of program activities; described in terms of size and/or scope of services/products delivered or produced by the program
Outcomes: Specific changes in program participants’ behavior, knowledge, skills, level of functioning, etc.
Impact: Organizational, community, or systems-level changes expected as a result of the program
Developing a Logic Model Practice
Ask questions about the Children’s Day Program to work in small groups to create an example of a logic model
[Whole Class Activity] Be in the hot seat to ask questions
Make a Plan for Developing Your Logic Model
- Who are the stakeholders for you agency
- What would be some of your questions
- What would the categories look like
To help provide focus for your program evaluation projects we start off talking about program evaluations in general and then jump into logic models. The agenda is as follows:
- Overview of program evaluation process
- Logic models
for free. You
can too.
