Week 11 - Qualitative Design Methods for Program Evaluation

Program Evaluation Design Qualitative Designs and Applications Jacob Campbell, LICSW Heritage University Spring 2020 SOWK 460

Agenda • Plan for rest of the semester • Benefits of Qualitative Approach • Qualitative designs methods • Activity around focus group interviews • Planning time and follow up regarding program evaluation Jacob Campbell, LICSW Heritage University SOWK 460 - Spring 2020

Benefits of a Qualitative Approach “Qualitative designs embrace this ambiguity and attempt to include multiple sources to develop an improved understanding of the situation, question, service challenge, and so forth” –Kapp and Anderson (2010) p. 239 Jacob Campbell, LICSW Heritage University SOWK 460 - Spring 2020

Benefits of a Qualitative Approach Closely related to clinical practices (Kapp & Anderson, 2010)

Benefits of a Qualitative Approach Opportunity for Clients to tell their stories (Kapp & Anderson, 2010)

Qualitative Designs Open-Ended Interviews Observations Focus Group Interviews Field Notes

(Kapp & ) 0 1 0 2 , on s r e d n A Qualitative Designs Open-Ended Interviews Not focused on standardized instruments Follows a standardized set of questions Gives an opportunity share personal perspectives

Qualitative Designs Observations Insights not obtained through an interview Can learn more from observation vs interview Systematized by have a form or guiding questions (Kapp & Anderson, 2010)

Qualitative Designs Observations Example of ABC Data ABC Notes Date/Time/Duration Activity Student: Harold Grade: 9th Antecedent 10/11/13 9:35am 5 minutes 10/12/13 11:20 am 10 minutes Language Arts Behavior Consequence Individual task given Talks to Peers about off task topic Given Reminder by the teacher to work quietly Small Group math test Chatted with peers Asked to leave the class 10/12/13 1:30 pm 5 minutes PE Volleyball game team selection Refused to be on the team picked for Chose not to participate 10/15/13 9:35am 5 minutes Language Arts Individual task given Talking loudly about inappropriate topics Other students laughed Asked to leave class 10/17/13 1:20 pm 5 minutes PE Running the track Refused to run, walked with students not in his class on the field Encouraged to run but wouldn’t 10/18/13 9:35am 5 minutes Language Arts Essay assignment Went on laptop to not approved websites, showed other student Would not leave the website 10/21/13 11:20 am 5 minutes Math Individual work Algebraic Expressions Talked to peers about off topic conversation Started work but kept talking

Qualitative Designs Focus Group Interviews A group process the allows views of multiple people Structured to allow minority views and differences of opinions Investigate unanticipated discussion points (Kapp & Anderson, 2010)

Qualitative Designs Focus Group Interviews Paraphrase and restate comments frequently Seek other opinions (ask group for agreement). Attempt to engage all parties. Review positions of the entire group and verify that you have understanding Open floor for other areas of interest of the group Don’t be afraid to control discussion, and move on when somebody is not sharing the talking (Kapp & Anderson, 2010) Move discussion from heated argument bye naming the positions and moving on

Qualitative Designs Focus Group Interviews https://docs.google.com/document/d/ 1WDXv5LIZ73Qib8mXzue9n4uXlaFYnIpZ2rTwGB5Hwg/edit?usp=sharing (Kapp & Anderson, 2010)

Record critical events and information that comes up through processes (Kapp & Anderson, 2010) v i t a t i l a u Q s n g i s e eD (Kapp & Anderson, 2010)

How would we write up and share information created in our focus group interview?

Program Evaluation Break Out Groups