researching and selecting ebips workbook k-12 tools gt
TRANSCRIPT
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 1
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
O VER VI EW T h is R es e ar c h i ng an d S e l ec t in g E B I Ps Wo r kb oo k is de s ig ne d t o s up ple me n t the c on te n t o f t he R e s e ar c h ing a n d S el ec t in g E B IP s i nf o - b rie f . S pe ci f ica l ly , t he w o rk bo ok co n ta ins th re e s e p a ra te t ools to s u p po r t d iv is ion a n d s ch ool le a de rs i n V i r gin ia i n i de n ti fy i ng a n d c on du c tin g re s e a rc h in t o e v i de n ce - ba s e d i nte rv e nt ions a n d p ra ct i ce s ( EB I Ps ) tha t m a y p o te n ti a l ly a d d re s s the ne e ds a nd p r io ri t ie s d e te rmi ne d v ia t he com p re he ns iv e ne e ds a s s e s s me n t ( C NA ) p ro ce s s . T he s e to ols w il l a ls o i nf o rm s e le c t ion of re le v a n t E B IPs th a t b e s t ma t ch e s ta bl is he d ne e ds a n d tha t a re m os t fe a s i ble f or a g iv e n d iv is i on o r s cho ol to i mp le me nt . T he d i re c t io ns f or us in g e a ch tool a nd a co r re s pon di n g hy pe rl i nk a r e p re s e n te d be low .
TA B L E O F C O NTENTS
EBIP Evidence Review Worksheet – pa ge s 2 -4 ( a c c e s s ib l e h e re )
Di re c tio ns : Us e th is wo rk s he e t to e x a mi ne t he e v i de nce ba s e fo r e a ch o f the e v i de nce -b a s e d i nte rv e nt ions a n d p ra ct i ce s (E B IPs ) u n de r c ons ide ra t ion. I n e a ch r ow , a d dre s s t he p ro m pt o r q ue s ti on pr e s e n te d a s it re la te s t o e a c h e m pi r ica l s tu dy o f the E B I P . In s e e k i ng ou t t h is i nf o rma ti on , y ou ma y cons ul t r e s ou r ce s s u ch a s t he Wha t Wo r k s Cle a r in gh ous e (W W C) , Ev i de nce fo r ES S A , t he Na ti ona l C e n te r on In te ns iv e Int e rv e n tio ns , a n d ot he r da ta ba s e s t ha t r a te a n d /o r e v a l ua te EB I Ps o r wh ic h p rov i de a cce s s to the s pe c if ic s tu die s the ms e lv e s .
EBIP Hexagon Analysis Protocol – pa ge s 5 -9 ( ac c es si b l e h e r e )
Di re c tio ns : Us e t his p r o toc ol to gui de y ou r re s e a rch i nv e s t i ga t io ns a n d d e c is io n - ma k i n g a ro un d the s e le c tio n of s pe c i f ic e v i de n ce - ba s e d in te rv e n ti ons a n d p r a c ti ce s (E B IPs ) t ha t ma y a d d re s s o ne o r m o re ne e ds ide n tif ie d by y our div is io n ’s o r s ch ool ’s m os t re ce nt co mp re he ns iv e ne e ds a s s e s s me n t ( C NA ) . T he p r ot o col p re s e n ts gu id in g q ue s ti ons ba s e d the s ix f a c to rs be l ow t ha t s h oul d b e a d d re s s e d v ia re s e a rc h a n d c ons ide re d the du rin g EBI P s e le c tion p roce s s .
EBIP Discussion Guide – pa ge s 1 0-1 4 ( ac c e s s ib l e h e re )
Di re c tio ns : Us e t he p re s e n te d d is cus s i on q ue s ti ons — a n d the ir r e la te d p r o be s — to le a d c onv e rs a tio ns a mo ng d iv is ion a nd / o r s ch ool le a de rs a nd co l la bo ra t in g s ta k e ho lde rs re la t e d to p a s t , cu r re n t , a n d f utu re in te n de d a p pli ca ti on o f e v i de n ce - ba s e d in te rv e n tio ns a nd pra ct ice s ( E BI Ps ) . By e xp lo rin g the s e que s tio ns , d iv is i ons a nd s choo ls ca n de te rm ine the d e gre e to wh ich t he y ha v e a l re a dy i mp le me n t e d E B IPs a nd in fo r m p la nn in g f o r f utu re i mp le me n ta ti on o f ne w E B IPs .
1
2
3
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 2
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
Di re c tio ns : Us e t his wo rk s he e t t o e xa m ine the e v i de nce b a s e fo r e a c h o f the e v i de n ce - ba s e d i nte rv e nt io ns a n d pr a c ti ce s ( EB I Ps ) u nde r c ons i de ra ti on . In e a ch r ow, a dd re s s the pr om p t o r que s tio n p re s e n te d a s i t r e la te s to e a ch e m pi ri ca l s tu dy o f the EB I P. I n s e e k ing ou t t his in fo r ma tio n, y ou ma y co ns ul t re s ou r ce s s u ch a s t he Wh a t Wo rk s Cle a rin gh ous e (W W C) , Ev id e n ce fo r ES S A , the N a tio na l Ce n te r on In te ns ive I n te rv e n ti ons , a n d o the r da ta ba s e s tha t ra te a n d /o r e v a lua te EB I Ps o r w hi ch prov ide a c ce s s to the s pe c i f ic s tu die s the ms e lv e s .
# Q u e s t i o n / P r o m p t S t u d y 1 S t u d y 2 S t u d y 3
1 . L i s t t h e s o u r c e o f t h e e v i d e n c e r e v i e w ( e . g . , W W C ) o r t h e a u t h o r ( s ) a n d y e a r o f t h e s t u d y
R e c o r d r e s p o n s e h e r e .
R e c o r d r e s p o n s e h e r e .
R e c o r d r e s p o n s e h e r e .
2 a . W a s t h i s s t u d y a w e l l - d e s i g n e d a n d i m p l e m e n t e d r a n d o m i z e d c o n t r o l l e d t r i a l ( R C T ) , a s d e f i n e d b y E S S A ?
• I f a n s w e r i n g “ Y e s , ” p r o c e e d t o q u e s t i o n 2 b .
• I f a n s w e r i n g “ N o ” o r “ N o t e n o u g h i n f o r m a t i o n , ” p r o c e e d t o q u e s t i o n 3 a .
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
2 b . F o r t h i s R C T , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t f a v o r a b l e e f f e c t o f t h e E B I P o n r e l e v a n t o u t c o m e s ?
Y e s
N o
Y e s
N o
Y e s
N o
2 c . F o r t h i s R C T , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t a n d o v e r r i d i n g u n f a v o r a b l e e f f e c t o f t h e E B I P o n r e l e v a n t o u t c o m e s ?
Y e s
N o
Y e s
N o
Y e s
N o
2 d . D o e s t h i s R C T p r o v i d e s t r o n g e v i d e n c e t o s u p p o r t i m p l e m e n t a t i o n o f t h e E B I P ?
• I f y o u a n s w e r e d “ Y e s ” f o r 2 b a n d “ N o ” f o r 2 c , a n s w e r “ Y e s ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 6 .
• I f y o u a n s w e r e d “ N o ” f o r 2 b a n d “ Y e s ” f o r 2 c , a n s w e r “ N o ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 3 a .
Y e s
N o
Y e s
N o
Y e s
N o
3 a . W a s t h i s s t u d y a w e l l - d e s i g n e d a n d i m p l e m e n t e d q u a s i - e x p e r i m e n t a l d e s i g n ( Q E D ) , a s d e f i n e d b y E S S A ?
• I f a n s w e r i n g “ Y e s , ” p r o c e e d t o q u e s t i o n 3 b .
• I f a n s w e r i n g “ N o ” o r “ N o t e n o u g h i n f o r m a t i o n , ” p r o c e e d t o q u e s t i o n 4 a .
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
3 b . F o r t h i s Q E D , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t f a v o r a b l e i m p a c t o f t h e E B I P o n r e l e v a n t o u t c o m e s ?
Y e s
N o
Y e s
N o
Y e s
N o
E B I P E v i d e n c e R e v i e w Wo r k s h e e t
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 3
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
# Q u e s t i o n / P r o m p t S t u d y 1 S t u d y 2 S t u d y 3
3 c . F o r t h i s Q E D , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t a n d o v e r r i d i n g u n f a v o r a b l e i m p a c t o f t h e E B I P o n t h e r e l e v a n t o u t c o m e s ?
Y e s
N o
Y e s
N o
Y e s
N o
3 d . D o e s t h i s Q E D p r o v i d e m o d e r a t e e v i d e n c e t o s u p p o r t i m p l e m e n t a t i o n o f t h e E B I P ?
• I f y o u a n s w e r e d “ Y e s ” f o r 3 b a n d “ N o ” f o r 3 c , a n s w e r “ Y e s ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 6 .
• I f y o u a n s w e r e d “ N o ” f o r 3 b a n d “ Y e s ” f o r 3 c , a n s w e r “ N o ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 4 a .
Y e s
N o
Y e s
N o
Y e s
N o
4 a . W a s t h i s s t u d y a w e l l - d e s i g n e d a n d i m p l e m e n t e d c o r r e l a t i o n a l s t u d y , a s d e f i n e d b y E S S A ?
• I f a n s w e r i n g “ Y e s , ” p r o c e e d t o q u e s t i o n 4 b .
• I f a n s w e r i n g “ N o ” o r “ N o t e n o u g h i n f o r m a t i o n , ” p r o c e e d t o q u e s t i o n 5 .
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
4 b . F o r t h i s c o r r e l a t i o n a l s t u d y , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t f a v o r a b l e i m p a c t o f t h e E B I P o n t h e r e l e v a n t o u t c o m e ( s ) ?
Y e s
N o
Y e s
N o
Y e s
N o
4 c . F o r t h i s c o r r e l a t i o n a l s t u d y , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t a n d o v e r r i d i n g u n f a v o r a b l e i m p a c t o f t h e E B I P o n t h e r e l e v a n t o u t c o m e ( s ) ?
Y e s
N o
Y e s
N o
Y e s
N o
4 d . D o e s t h i s c o r r e l a t i o n a l s t u d y p r o v i d e p r o m i s i n g e v i d e n c e t o s u p p o r t i m p l e m e n t a t i o n o f t h e E B I P ?
• I f y o u a n s w e r e d “ Y e s ” f o r 4 b a n d “ N o ” f o r 4 c , a n s w e r “ Y e s ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 6 .
• I f y o u a n s w e r e d “ N o ” f o r 4 b a n d “ Y e s ” f o r 4 c , a n s w e r “ N o ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 5 .
Y e s
N o
Y e s
N o
Y e s
N o
5 . D o e s t h i s s t u d y d e m o n s t r a t e a r a t i o n a l e f o r u s i n g t h e E B I P ? I n o t h e r w o r d s , d o e s t h i s s t u d y s u g g e s t t h a t t h e E B I P i s l i k e l y t o i m p r o v e a r e l e v a n t o u t c o m e ?
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
Y e s
N o
N o t e n o u g h i n f o r m a t i o n
6 . E x a m i n i n g t h e i n f o r m a t i o n f o r q u e s t i o n s 2 d , 3 d , 4 d , a n d 5 , w h a t i s t h e h i g h e s t l e v e l o f e v i d e n c e p r o v i d e d b y e a c h s t u d y f o r t h e E B I P ?
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 4
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
# Q u e s t i o n / P r o m p t S t u d y 1 S t u d y 2 S t u d y 3
7 . I n e a c h s t u d y , w a s t h e E B I P i m p l e m e n t e d i n a s e t t i n g s i m i l a r t o y o u r d i v i s i o n o r s c h o o l ( e . g . , r u r a l , u r b a n , g r a d e s p a n ) ?
V e r y m u c h
S o m e w h a t
A l i t t l e
N o t a t a l l
V e r y m u c h
S o m e w h a t
A l i t t l e
N o t a t a l l
V e r y m u c h
S o m e w h a t
A l i t t l e
N o t a t a l l
8 . I n e a c h s t u d y , w a s t h e E B I P i m p l e m e n t e d w i t h p o p u l a t i o n s s i m i l a r t o y o u r d i v i s i o n o r s c h o o l ( e . g . , r a c i a l / e t h n i c d e m o g r a p h i c s , s p e c i a l i z e d p r o g r a m e n r o l l m e n t ) ?
V e r y m u c h
S o m e w h a t
A l i t t l e
N o t a t a l l
V e r y m u c h
S o m e w h a t
A l i t t l e
N o t a t a l l
V e r y m u c h
S o m e w h a t
A l i t t l e
N o t a t a l l
9 . L o o k i n g a c r o s s t h e i n f o r m a t i o n f o r q u e s t i o n 6 o n l y , w h i c h o f t h e f o l l o w i n g d e s i g n a t i o n s b e s t d e s c r i b e s t h e c u m u l a t i v e e v i d e n c e f o r t h i s E B I P ?
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
1 0 . L o o k i n g a c r o s s i n f o r m a t i o n f o r q u e s t i o n s 6 , 7 , a n d 8 , w h i c h o f t h e f o l l o w i n g d e s i g n a t i o n s b e s t d e s c r i b e s t h e c u m u l a t i v e e v i d e n c e f o r t h i s E B I P , s p e c i f i c a l l y f o r t h e s e t t i n g s a n d p o p u l a t i o n s t h a t a r e s i m i l a r t o y o u r d i v i s i o n o r s c h o o l ?
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
S t r o n g e v i d e n c e
M o d e r a t e e v i d e n c e
P r o m i s i n g e v i d e n c e
D e m o n s t r a t e s a r a t i o n a l e
E B I P E v i d e n c e R e v i e w W o r k s h e e t c o n t e n t s t a k e n v e r b a t i m , w i t h m i n o r a d a p t a t i o n s , f r o m : H a l e , S . , L . D u n n , N . F i l b y , J . R i c e , a n d L . V a n
H o u t e n . “ E v i d e n c e - B a s e d I m p r o v e m e n t : A G u i d e f o r S t a t e s t o S t r e n g t h e n T h e i r F r a m e w o r k s a n d S u p p o r t s A l i g n e d t o t h e E v i d e n c e R e q u i r e m e n t s o f E S S A . ” R e g i o n a l E d u c a t i o n a l L a b o r a t o r y W e s t , W e s t E d , 2 0 1 7 . p p . 6 1 - 7 3 h t t p s : / / w w w . w e s t e d . o r g / w p -c o n t e n t / u p l o a d s / 2 0 1 6 / 1 2 / E v i d e n c e - B a s e d - I m p r o v e m e n t - G u i d e - F I N A L - 1 2 2 1 1 6 . p d f
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 5
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
Di re c tio ns : U s e this p r o toc ol to g ui de y ou r re s e a r ch inv e s ti ga t io ns a nd d e c is io n - ma k i n g a ro un d t he s e le c tio n of s pe c i f ic e v i de n ce - ba s e d in te rv e n ti ons a n d p r a c ti ce s (E B IPs ) t ha t ma y a d d re s s one o r m o re ne e ds i de nt i f ie d by y ou r d iv is i on ’s o r s cho ol ’s mos t re ce n t co m pre he ns iv e ne e d s a s s e s s me n t ( C NA ) . T he p r o toc ol p re s e n ts g ui di ng q ue s tions b a s e d the s i x fa c to rs be low tha t s ho ul d b e a d d re s s e d v i a re s e a rc h a n d cons ide re d t he d ur in g EB IP s e le c tio n p ro ce s s .
- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- -
RELEVANCE B a s e d on ou r mos t re ce n t C NA , wha t a re the m os t p re s s i ng ne e ds fa ce d by o ur d iv is ion or s c hoo l? W ha t d a ta do we ha v e to s upp o r t t he e xis te n ce o f the s e ne e ds ?
R e c o r d r e s p o n s e h e r e .
E B I P H e x a g o n A n a l y s i s P r o t o c o l
F i t R e s o u r c e s
C a p a c i t y E v i d e n c e
R e l e v a n c e
R e p l i c a b i l i t y
R e l e v a n c e r e p r e s e n t s h o w w e l l t h e E B I P m e e t s t h e i d e n t i f i e d n e e d s o f t h e t a r g e t s t u d e n t p o p u l a t i o n .
R e s o u r c e s r e f e r s t o t h e a b i l i t y t o p r o v i d e a d e q u a t e t r a i n i n g , s t a f f i n g , t e c h n o l o g y , m a t e r i a l s , a n d f u n d i n g t o i m p l e m e n t a n E B I P w i t h f i d e l i t y .
F i t r e f e r s t o h o w w e l l t h e E B I P c o r r e s p o n d s w i t h t h e c l i m a t e a n d c u l t u r e o f t h e d i v i s i o n o r s c h o o l a n d t h e v a l u e s a n d p r i o r i t i e s o f i t s s t a k e h o l d e r s .
C a p a c i t y r e f e r s t o h o w l i k e l y i t i s t h a t a d i v i s i o n o r s c h o o l w i l l i m p l e m e n t t h e E B I P a s i n t e n d e d a n d s u s t a i n a n d i m p r o v e i m p l e m e n t a t i o n o v e r t i m e .
E v i d e n c e r e f e r s t o t h e s t r e n g t h o f r e s e a r c h f i n d i n g s i n d i c a t i n g t h e o u t c o m e s t h a t m i g h t b e e x p e c t e d i f t h e E B I P i s i m p l e m e n t e d w i t h f i d e l i t y .
R e p l i c a b i l i t y r e p r e s e n t s t h e d e g r e e w i t h w h i c h t h e E B I P c a n b e r e i t e r a t e d i n t h e c o n s i d e r i n g d i v i s i o n o r s c h o o l .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 6
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
B a s e d on ou r re v ie w of e xis ti ng EB I P da ta ba s e s (e . g . , Wha t Wo rk s C le a ri n ghous e ) a n d cons ul ta tio ns wi th o the r di v is i ons , s ch ools , a n d /o r e xpe r ts , wha t s t ra te gie s a n d s olu ti ons ma y he l p ou r div is io n or s c hoo l a d d re s s the a bov e ne e ds ? Th es e i te ms w i l l b e r ef er en ced a s “ EB I Ps u nde r con si der a tio n ” m ov ing f or w ar d in t h is p r o to col .
R e c o r d r e s p o n s e h e r e .
RESOURCES W ha t re s ou r ce s (e . g . , r e v e nue , ma te ri a ls , s ta ff ) w il l be re q uir e d t o imp le me n t the EB IPs u nde r c ons i de ra tio n wi th f i de l ity ?
R e c o r d r e s p o n s e h e r e .
Doe s ou r div is io n o r s c hoo l c ur re n tly ha v e t he re qui re d re s ou r ce s (e .g . , re v e n ue , ma te ria ls , s t a ff ) t o i mp le me nt t he E B IPs u nde r c ons i de ra ti on wi th f i de l i ty ? If no t , ca n we a c quir e t he m w it h i n a re a s o na ble t i me f ra me a n d w i tho ut s i gni f ica nt ly i mp a c tin g re s ou r ce a l loc a t ions to o t he r o ng oin g i nit ia tiv e s ?
R e c o r d r e s p o n s e h e r e .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 7
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
CAPACITY H ow e f fi cie n tly a n d e f fe c tiv e ly wi l l o ur d i v is ion or s c hoo l be a ble to tr a i n , s up po r t , a n d coa ch i mp le me nt in g s ta f f in t he e xe cut io n o f t he EB I Ps un de r cons id e ra tio n? W ha t re s ou r ce s , too ls , a n d t e c hni ca l a s s is ta nce e x is t t ha t ca n s u p po r t ou r e f fo r ts in th is a re a ?
R e c o r d r e s p o n s e h e r e .
H ow l ik e ly a re im ple me n ti n g s ta ff a nd o the r s ta k e hol de rs to b uy -i n to the EB I Ps u n de r c ons i de r a ti on ? W ha t is the pr o ba bil it y tha t the y w il l e ng a g e in a s us ta i ne d co mm i tme n t to i mp le me nti ng a n d i mpr ov i n g i mp le me nta ti on o f the E B IPs ?
R e c o r d r e s p o n s e h e r e .
REPLICABILITY U nde r wh a t co nd i tio ns ( e .g . , s c hool s e tt in g , im ple me n ta t io n t i me l ine ) ha v e t he EB I Ps und e r cons ide r a tio n b e e n i m ple me n te d p re v i ous ly ? T o w ha t de g re e do the con di t ions of o ur d iv is i on or s ch ool c o rre s po n d w it h t he s e c on dit io ns ?
R e c o r d r e s p o n s e h e r e .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 8
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
W ha t a re t he cha ra ct e ris ti cs (e . g . , r a ce , la n g ua ge s ta tus ) of the s t u de n ts a n d o the r s ta k e h ol de rs s u cce s s fu l ly ta r ge te d b y the EB IPs un de r co ns i de ra tion in t he pa s t? T o wha t d e g re e doe s t he i nte n de d t a r ge t po pu la tio n a t ou r div is ion o r s c ho o l co r re s pon d w it h t he s e c ha ra c te ris t i cs ?
R e c o r d r e s p o n s e h e r e .
EVIDENCE W ha t da ta a re a v a i la ble i nd ica t ing t ha t the EB I Ps un de r c ons i de ra tio n ha v e a hi gh p ro ba bil ity o f s u cce s s ? A re the me a s u re d e f fe c t s ize s o f the s e EB I Ps la r ge e noug h to ma k e t he i r im ple me n ta tio n w or t hwh ile ? A re t he re a ny da ta i nd ica t in g tha t the s e E B IPs ma y n ot be s u cce s s fu l?
R e c o r d r e s p o n s e h e r e .
W ha t da ta w il l ou r div is ion or s cho ol be a ble t o col le c t a n d mon it o r t o e ns u re f i de l i ty o f im ple me n ta t io n f o r the E BIPs un de r c ons ide ra t ion? Wha t da ta ca n ou r div is ion o r s ch ool co l le ct t o t ra ck pr o g re s s re la te d t o a n t ici pa t e d o r ta r ge t ou t come s ?
R e c o r d r e s p o n s e h e r e .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 9
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
FIT H ow we l l do the EB I Ps un de r cons i de ra ti on co r re s pon d w it h ou r div is ion ’s o r s c hoo l ’s la rg e r mis s i on a n d v is ion a nd o ur cu r re n t s tr a te g ic pr io r it ie s ?
R e c o r d r e s p o n s e h e r e .
H ow we ll do the E BI Ps un de r co ns i de ra ti on co r re s pon d w it h ou r d iv is ion ’s o r s c hoo l ’s c l im a te a nd cu lt u re a n d o u r s ta k e h ol de r ’s e xpe c ta tions fo r a n d b e l ie fs re ga r din g h i gh - q ua l i ty K -1 2 e d uca tio n?
R e c o r d r e s p o n s e h e r e .
E B I P H e x a g o n A n a l y s i s P r o t o c o l a d a p t e d f r o m : B l a s e , K . , L . K i s e r , a n d M . V a n D y k e . “ T h e H e x a g o n T o o l : E x p l o r i n g C o n t e x t . ” N a t i o n a l
I m p l e m e n t a t i o n R e s e a r c h N e t w o r k , U n i v e r s i t y o f N o r t h C a r o l i n a C h a p e l H i l l , 2 0 1 3 . p p . 2 - 4 . h t t p s : / / w w w . c d e . s t a t e . c o . u s / e a r l y / e a r l y / p y r a m i d m o d e l i m p l e m e n t a t i o n t o o l k i t - 9
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 10
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
Di re c tio ns : Us e t he pr e s e n te d dis cus s i on que s ti ons — a n d the i r re la te d p ro be s — t o le a d c onv e rs a tio ns a mon g div is i on a n d /o r s c hoo l le a d e rs a n d col la bo r a tin g s ta k e ho l de r s re la te d to pa s t , cu r re n t , a n d fut u re i nte n de d a p p lic a t ion o f e v i de nce - ba s e d in te r v e n ti ons a n d p ra ct ice s (E B IPs ) . By e x plo ri n g t he s e q ue s ti ons , d iv is ions a n d s ch ools c a n de te rmi ne the de gr e e to whi ch t he y ha v e a l re a dy i mp le me n t e d E B IPs a n d in fo r m p la n nin g for f u tu re imp le me n ta tio n o f ne w EB I Ps .
- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- - W ha t EB I Ps ha s ou r d iv is ion o r s ch ool us e d in t he p a s t to a dd r e s s o u r i d e n ti f ie d a r e a s o f ne e d a n d e s ta bl is he d s tr a te g ic pr io r it ie s ? W ha t we re t he re s ul ts o f us in g t he s e E B IPs ?
• P r ob e : A s k p a rt ic ipa n ts to na me the s pe c if ic E B IPs a n d t o a r tic ula t e t he s ho rt - a nd lon g - te r m g oa ls a s s o cia te d w it h t he m .
• P r ob e : A s k pa r ti ci pa nt s t o e x pla i n how the E BI P wa s i mp le me nte d . P ro mp t t he m to de s c r ibe h ow i mp le me nt in g s ta f f we r e tr a ine d a n d coa che d o n t he E B IP a n d how re s o ur ce s we r e a l loc a te d t o s u p po rt i mp le me nta ti on .
• P r ob e : A s k p a rt ic ipa n ts to s ha re da ta a n d /o r a r ti fa cts ind i ca tiv e o f r e s ul t s .
R e c o r d d i s c u s s i o n n o t e s h e r e .
E B I P D i s c u s s i o n G u i d e
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 11
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
W ha t E BI Ps is ou r div is ion o r s c hoo l co ns i de ri ng us in g to a d dre s s ou r i de n ti f ie d a re a s o f ne e d a n d e s ta bl is he d s t ra te g ic pr io r it ie s ? W hy do we b e l ie v e t he s e EB IPs wil l be e f fe ct iv e i n a c hie v i ng t he de s i re d r e s ul ts ?
• P r ob e : A s k p a rt ic ipa n ts t o de s c ri be how E B IPs un de r cons i de ra ti on d i f fe r f rom t hos e tr ie d i n the pa s t .
• P r ob e : A s k p a r ti ci pa n ts t o s um ma ri ze the e v i de nce a n d s up p or t in g re s e a rc h gu id in g the i r d e te r mi na ti on o f the EB I Ps ’ p ote nt ia l e f fe ct iv e ne s s .
• P r ob e : A s k p a r ti ci pa nt s t o e xp la i n how the E BI Ps un de r co ns i de r a tio n ha v e be e n imp le me n te d i n d iv is ions or s ch ool s im ila r to y ou r o wn (e . g. , s i ze , de mo g ra phi cs ) .
R e c o r d d i s c u s s i o n n o t e s h e r e .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 12
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
W ha t s te ps d oe s ou r div is io n o r s c hoo l a n ti ci pa te c om ple ti n g t o ini t i a te a n d s us ta in i mp le me n ta tio n f o r t he EB I Ps u nde r co ns i de ra ti on? H ow wi l l we e ns u re s u f fi cie n t re s o ur ce a l loc a t ions , s ta f f ca p a ci ty , a n d c om mun i ty b uy -i n ?
• P r ob e : A s k p a rt ic ipa n ts t o c ons i de r the role s o f div is ion o r s cho ol le a de rs a nd ot he r s ta k e h ol d e rs in t his p ro ce s s .
• P r ob e : A s k p a rt ic ipa n ts to b ra i ns t o rm po te nt ia l p ro fe s s i ona l de v e lo pme n t , t ra i nin g , a n d/ o r coa c hing s t ra te g ie s to s u p po r t im ple me n tin g s ta f f .
• P r ob e : A s k p a rt ic ipa n ts to re fle c t o n e x is tin g r e s ou r ce s to s up po r t im ple me n ta t io n o f the E B I Ps un de r c ons i de ra tio n a s co mpa re d t he le v e l o f re s ou r ce s re qu ir e d t o s us ta i n im ple me n ta ti on .
• P r ob e : A s k p a rt ic ipa n ts to s ha re p o te n tia l s t r a te g ie s to bu i l d com mu ni ty s u p po r t a n d b uy - in fo r t he E B IPs u n de r co ns i de ra t io n .
R e c o r d d i s c u s s i o n n o t e s h e r e .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 13
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
H ow d oe s o ur d iv is i on o r s c hoo l e xpe c t to m oni t or out c ome s re s u lt in g f ro m p o te n ti a l im ple me n ta t io n o f t he E B IPs un de r c ons id e ra tio n? H ow w il l we tr a ck pr og r e s s t owa r d g oa ls ?
• P rob e : As k p a rt ic ipa n ts to s ta te an ti ci pa te d o r de s i re d o ut co me s the y w oul d e xpe c t t o ob s e rv e as a r e s ul t o f i mp le me n tin g t he E B IPs u nde r cons i de ra ti on .
• P r ob e : A s k p a rt ic ipa n ts to re v ie w a n d e x pla i n p o te n tia l da ta , me t r ics , a n d k e y p e r f or ma n ce i nd ica t ors t ha t c oul d b e us e d t o s u p po r t p ro g re s s m oni to r in g .
R e c o r d d i s c u s s i o n n o t e s h e r e .
G t
© H a n o v e r R e s e a r c h , 2 0 2 1 14
RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )
K-12 Tools
W ha t a c t ions i s ou r div is ion or s c hoo l p re pa re d to ta k e s h oul d the E B IPs und e r co ns i de ra tio n no t ha v e t he i r i n te nd e d im pa cts a f te r s uf fi cie n t t i me a n d re s o urce s ha v e be e n de v o te d t o the i r i mp le me n ta tio n?
• P rob e : As k p a rt ic ipa n ts t o b rains t o rm a cco un ta bi l i ty pr o ce d u re s f o r e xa mini ng an d com mu nic at in g a bo ut re s u lt s .
• P r ob e : A s k p a rt ic ipa n ts to cons ide r a c ce pt a b le t i me li ne s fo r e v a lua t in g p r og r e s s t owa r d g oa ls a nd m a k in g de cis ions a b out w he the r to co n tinue a n E B IP ’s im ple me n ta t io n , ma k e c ha n ge s to t he EB I P , or t e rmi na te it s us a ge .
R e c o r d d i s c u s s i o n n o t e s h e r e .
E B I P D i s c u s s i o n G u i d e a d a p t e d f r o m : “ E v i d e n c e f o r S c h o o l I m p r o v e m e n t . ” T h e E d u c a t i o n T r u s t . p p . 1 - 3 . h t t p s : / / e d t r u s t . o r g / w p -
c o n t e n t / u p l o a d s / 2 0 1 4 / 0 9 / E S S A _ F a c t S h e e t _ _ E v i d e n c e - f o r - S c h o o l - I m p r o v e m e n t _ H y p e r l i n k s . p d f