Spring 2020 SOWK 460 Week 04 - Program Evaluation Process and Logic Models

A presentation at Heritage University in February 2020 by Jacob Campbell and is tagged with BASW Program, Heritage University, SOWK 460w

Location: CBC Campus - SWL 208 Time: Mondays from 5:30-8:15 Week 04: 2/3/20 Topic and Content Area: Cultural Competency Logic Models Reading Assignment: Kapp and Anderson chapters 4, 7 Assignments Due: A-02 Reading Quiz 02/03/20 A-04a: Weekly Journal 01 02/09/20 A-04b: Group Logic Model 02/09/20 Other Important Information: N/A

Overview of program evaluation process Logic models

There are number of parts that we must consider as we move into doing program evaluation. Engage stakeholder in the evaluation process Assess and address agency political factors Choose an evaluation design Data collection Reporting and using data Addressing culturally competent program evaluation

In preparing for a program evaluation, the following would be some of the steps to take. Identify evaluation question Conceptualize question Operationalize question Pick and define method Select sample Data collection Data management and analysis Utilization of information

A program logic model is a picture of how an organization does its work — the theory and assumptions underlying the program. A program logic model links outcomes (both short- and long-term) with program activities/processes and the theoretical principles/assumptions of the program.

There are a number of reasons why it is useful to have a logic model for a program. Stakeholders are allowed to articulate their views about the program Stakeholders are allowed to hear and appreciate the views of other stakeholders Divergent views about the program are synthesized in a collaborative process. An integrated model is developed with stakeholder ownership The integrated model is scrutinized publicly for feasibility The model serves as a solid reference for program management decisions The model is used as an organizing tool for evaluation The model can be used as a promotional tool for the program The model can be employed to support program proposals for grant activities

Engaging all of the stakeholders will get a more complete picture Clients Direct service staff Supervisory / management staff Executive staff Board of directors Funders Community partners

The following would be some potential interview questions to help develop a logic model. How is the program staffed and organized? What components are involved with the program other than staff? Can you describe the major activities of the program? What resources are devoted to these activities What are the main objectives of the program? What is the program trying to accomplish What accomplishments is the program likely to achieve in the next 2 and 3 years? What would you expect? How will these activities undertaken by the program accomplish the results? What kinds of information do you have on the program? How do you use this information? What kinds of information do you need to assess program performance? How would you use this information? What measures or indicators are relevant to the program? What problems face the program? What factors are likely to influence the program over the next 2 to 5 years?

Resources Staff activities Program processes Immediate outcomes Intermediate outcomes Long-range outcomes

Different type of logic model, but similar in many ways.

Resources/Inputs: The human, financial, organizational, and community resources a program has available to direct toward doing the work Activities: What the program does with its resources (processes, tools, events, technology, actions) Outputs: The direct product of program activities; described in terms of size and/or scope of services/products delivered or produced by the program Outcomes: Specific changes in program participants’ behavior, knowledge, skills, level of functioning, etc. Impact: Organizational, community, or systems-level changes expected as a result of the program

Ask questions about the Children’s Day Program to work in small groups to create an example of a logic model [Whole Class Activity] Be in the hot seat to ask questions

Who are the stakeholders for you agency What would be some of your questions What would the categories look like

Dr. Jacob Campbell

14 slides

Description

To help provide focus for your program evaluation projects we start off talking about program evaluations in general and then jump into logic models. The agenda is as follows:

Overview of program evaluation process
Logic models