are we making a difference? · are we making a difference? real –life sarts evaluating changes in...

28
Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman This webinar is supported by grant number 2015-RA-AX-K014 awarded by the Office on Violence Against Women, U.S. Department of Justice. The opinions, findings, conclusions, and recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the Department of Justice, Office on Violence Against Women.

Upload: others

Post on 08-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Are We Making a Difference?Real –life SARTs evaluating changes in the system response

May 16, 2016

Jessica Jerney, Jude Foster, and Brenda Skogman

This webinar is supported by grant number 2015-RA-AX-K014 awarded by the Office on Violence Against Women, U.S. Department of Justice. The opinions, findings, conclusions, and recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the Department of Justice, Office on Violence Against Women.

Page 2: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Logistics

All phone lines are muted. To unmute your line, press 7. We will unmute all lines at the end of today’s session to hear from you.

You can submit questions via the chat bar at anytime during the webinar.

Please keep your line muted until you want to make a comment or ask a question (again7). To mute your line when you are done (6)

This webinar will be recorded and we’ll make the link available.

Page 3: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Welcome

Brenda SkogmanIsanti County SART CoordinatorIsanti County Victim/Witness

Jude FosterSouthern St. Louis County SART CoordinatorPAVSA Program Director

Jessica JerneyEvaluation and Research Coordinator Sexual Violence Justice Institute @ MNCASA

Leah LutzSVJI Program ManagerSexual Violence Justice Institute @ MNCASA

The Sexual Violence Justice Institute equips multidisciplinary teams and allied professionals with the concepts, tools, training, and resources needed to create a victim-centered response to sexual violence within their local communities.

Page 4: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Two Questions

Type your responses into the chat:

Where are you calling from?

Why do you think it is important to evaluate the work of your sexual assault response team (SART)?

Page 5: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

The Plan

Overview of the evaluation

Priorities for evaluation in a multi-disciplinary team

Steps of real-life evaluation Plan

Breaking it down for the team

Engaging your team in evaluation

Relevance: What’s the right question?

Capacity

Do

Methods

Using data to inform your team goals

Engaging victim/survivors in evaluation

Reflect

Apply

Resources for SART evaluation

Questions

Page 6: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

What is Evaluation?

Page 7: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Everyday Evaluation

PizzaCriteria includes:• Crust• Sauce• Cheese• Toppings

Page 8: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Everyday Evaluation:

Frozen Pizza

https://www.youtube.com/watch?v=sAnKvHxG0AQ

Page 9: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

What is Evaluation?

• Value judgements we make everyday

• Systematic approach

• Based on established criteria

• Opportunity to learn

• Informs decision-making

Page 10: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Different perspectives

Priorities for SART Evaluation

Page 11: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Creating a Collective

Understanding

Sharing Perspectives is essential for

• Better evaluation

• Better system response

Priorities for SART Evaluation

Page 12: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Steps to Evaluate

PLAN

DO

REFLECT

APPLY

“Learning is the process whereby knowledge is created through the transformation of experience.”

– David Kolb

Page 13: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

PLAN

“If you don’t know where you’re going, you’ll end up somewhere else.”

-Yogi Berra

Identify your QuestionsHelp your team formulate questions that will guide your evaluation. What do you want to know? What are you curious about? What does success look like?

Identify Sources of InformationWho or what can provide the information you are looking for? Are records accessible? Reliable?

Decide How you will Find OutWhat is the best way

(method) to gettingthe information you need?

Page 14: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Southern St. Louis County

Page 15: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Where should we start?What do you wonder about?

How to share with my team

Page 16: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Capacity

Page 17: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

DO

Collect Information

Based on the methodsyou chose, develop tools to collect information. Assign appropriate team members.

Organize Responses

Making sense of the data. (analyze)

What does the information say about the process? What picture does it paint? (interpret)

Review it Together

Make plans to share with the team. Consider what would be the best way to share the data and time constraints.

Page 18: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

MethodsHow have you collected information about your program or SART?

Page 19: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Methods

Interviews

Surveys

Focus groups, listening circles, informational group interviews

Data collection

Observations

Review documents

Use them together!

Page 20: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Isanti County

Page 21: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Gathering Existing Data

How soon following the sexual assault a report

was made to law enforcement?

Outcomes of Reported Cases

Sexual Assault Cases Reported to Law Enforcement 2010 2011 2012

Number of sexual assaults reported to law enforcement 104 108 97

Open 0 0 0

Cleared by arrest 44 42 40

Exceptionally cleared 12 2 0

Unfounded (false) 0 6 0

Unfounded (baseless) 0 4 0

Suspended / inactivated 0 0 0

Closed (no charges, no arrest) 48 54 57

Sexual Assault Cases Reported to Law Enforcement 2010 2011 2012

Referred to the County Attorney’s Office 76 68 62

Charged by prosecution 29 31 24

Case declined for charging by prosecution 42 29 31

Case pending for charging 0 1 5

Case dismissed (after charges filed – at victim’s request) 0 0 2

Case dismissed (for other reasons) 11 16 6

Case dismissed (continuance for dismissal in juvenile court) 0 4 1

Guilty plea as charged (criminal sexual conduct charge) 14 11 8

Guilty plea to a lesser sexual misconduct charge 15 16 14

Conflict of interest – transferred 2 2 1

Suspect drug or alcohol use at the time of the assault

Example from the field

Page 22: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Voices ofVictim/ Survivors

Example from the field:

Informational group interviews

Page 23: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

REFLECT

What did we learn?

How will we use it?

“Learning is the process whereby knowledge is created through the transformation of experience.”

– David Kolb

Page 24: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman
Page 25: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

APPLY

Build it into your work and planning

Do it again!

Page 26: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Resources

For more information or support on doing your own evaluation, contact Jessica Jerney at: [email protected] or (651) 288-7458.

Goff, E., Haas, S., and Pejsa, L. (2015). Sexual assault response teams, evaluation, and systems change: A resource for multidisciplinary team leadership. Saint Paul, MN: Sexual Violence Justice Institute, a project of the Minnesota Coalition Against Sexual Assault. Retrieved from www.mncasa.org

Page 27: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Resources

Page 28: Are we making a difference? · Are We Making a Difference? Real –life SARTs evaluating changes in the system response May 16, 2016 Jessica Jerney, Jude Foster, and Brenda Skogman

Questions&

Thank you

Brenda SkogmanIsanti County SART CoordinatorIsanti County Victim/[email protected]

Jude FosterSouthern St. Louis County SART CoordinatorPAVSA Program [email protected]

Jessica JerneyEvaluation and Research Coordinator Sexual Violence Justice Institute @ [email protected]

Leah LutzSVJI Program ManagerSexual Violence Justice Institute @ [email protected]