cancer ’s approach to reviewer recognition · cancer ’s approach to reviewer recognition ... v....

29
Carissa A. Gilman Managing Editor, Cancer [email protected] CANCER ’S APPROACH TO REVIEWER RECOGNITION

Upload: lyminh

Post on 29-Jul-2018

223 views

Category:

Documents


0 download

TRANSCRIPT

  • Carissa A. Gilman

    Managing Editor, Cancer

    [email protected]

    CANCERS APPROACH TO REVIEWER RECOGNITION

  • International interdisciplinary journal of the American Cancer Society

    Published in partnership with Wiley

    Peer review performed via ScholarOne Manuscripts (Sch1)

    Editor-in-Chief and 22 disease site/discipline-specific Section Editors

    Received ~2,700 papers in 2016

    ~40% of submissions go to external peer review

    20% acceptance rate

    ~1,500 reviewers utilized annually

    ABOUT CANCER

    2

  • D R . WA LTER S TA D LER

    S EC T I O N ED I TO R , GEN I TO UR I N A R Y D I S EA S E

    C A N C ER

    THERE IS NO W AY A JOURNAL CAN EVER GIVE ENOUGH TO MAKE PEER

    REVIEW W ORTHWHILE

  • Reviewers believe reviewing is inadequately acknowledged and should carry more weight in institutions' evaluation processes

    Respondents value recognition over monetary rewards

    Most valued reward and recognition initiatives:

    o Feedback from journal (review quality, decision outcome, access to other reviewer comments)

    o Acknowledgement (in printed journal, on journal website, or personal note from editor)

    WILEY 2015 SURVEY

    4 Warne, V. (2016) Rewarding reviewers sense or sensibility? A Wiley study explained. Learned Publishing, 29: 4150. doi: 10.1002/leap.1002.

  • Annual listing of reviewers in the journal; special acknowledgment for top reviewers (by # of reviews completed)

    Thank you email upon review submission (signed by Section Editor)

    Thank you email upon decision (signed by Section Editor) including all reviewer comments to authors

    30% discount code on Wiley books (in thank you email)

    OUR PREVIOUS EFFORTS

    5

  • CME for reviewersreally need dedicated CME department; competing journals did not see enough uptake to make it seem worthwhile

    Tchotchkesno budget

    Recognition at annual meetingnot a membership society; no annual meeting

    IMPRACTICABLE IDEAS (FOR US)

    6

  • Academic recognition desired

    Needs to assist reviewers with tenure/promotion

    Building up peoples egos is surprisingly effective

    Language for inclusion on CVs, needs a name that sounds official

    SECTION EDITOR GUIDANCE

    7

  • Outstanding Reviewer Recognition Program

    o More stringent criteria for top reviewers; criteria stated in annual thank you to reviewers published in the journal

    o Personal thank you letters from Section Editors to reviewers

    o Letters of recognition to deans/chairs

    o Discount on OnlineOpen fees for top reviewers

    Publons

    NEW APPROACHES

    8

  • Had previously been those who reviewed 4 or more papers in a yearupped to 5 or more

    Wanted to add turnaround time and reviewer score to the criteria

    o Average review time of 14 days or less

    o Reviewer score snagscoring not mandatory in Sch1 (only 55% of reviewers who met other criteria had R-scores)

    CRITERIA FOR TOP REVIEWERS

    9

  • Informed that performance was in top 2%

    Told about OnlineOpen discount

    Sent template language and reviewer contact information to Section Editors and asked them to send personal emails

    Differing Section Editor engagement

    o + signed letters on letterhead

    o - asking me to send emails on their behalf

    PERSONAL THANK YOU LETTERS

    10

  • Sent 30 letters (emailed PDFs of letters on Cancer letterhead) to deans, chairs, and department heads

    Unexpectedly gratifying response

    LETTERS TO DEANS/CHAIRS

    11

  • Ryancongratulations, such an important service to do well. It is great to see this.

    Dr. Picus is a star and excels in so many areas.

    I am delighted to hear of this recognition for Yu Shyr. I'm not surprised, as he excels in so many ways and contributes so much to science. Still it is great for an important journal to recognize him in this way!

    Please pass on my thanks to Dr. Khuri for the recognition; this is a very nice process of the journal.

    Thank you very much for the time and effort you and your team put into making this possible. I am deeply appreciative.

    SAMPLING OF RESPONSES

    12

  • 13

  • Invited to participate by Wiley (offered to all publishing partners that use Sch1)

    Wiley has 773 integrated journals (publishes ~1,600)

    Cancer integration date: July 13, 2016

    Sch1 configuration changes:

    o Text to inform reviewers of Cancers involvement with Publons added to reviewer invitations and reviewer acceptance email templates

    o Opt-in question added to reviewer scoresheet

    o Email template added to send review/reviewer details to Publons upon completion of every review

    PUBLONS

    14

  • Improve review invitation acceptance rates

    Motivate reviewers to deliver better quality, more timely reviews

    Increase reviewer engagement/satisfaction

    WILEY GOALS

    15

  • WORKFLOW

    16

    Review invitation

    email w/ info on Publons

    Reviewer accepts

    invitation and is reminded

    about Publons

    Reviewer given option to opt-

    in when completing

    review scoresheet

    Review submitted; info about

    review automatically

    sent to Publons

    Thank you email w/ Publons details

    Reviewer receives email w/ instructions

    to claim review; review removed if no response 30

    days after 3rd email

    Article publishes; reviewer

    profile displayed publicly; 2

    weeks later, reviewer

    receives link to article

  • 17

  • Privacy settings

    o Open: Reviewer name associated with article

    o Blind: Reviewer name associated with journal

    o Blind: Reviewer name is associated with publisher

    o Hidden: Reviewer name is never shown on profile

    Default for Wiley: Blind (reviewer name associated with journal) and Unpublished (review content hidden)

    Disclaimer: You have a publisher level policy that applies to this journal preventing reviewers from displaying review content and preventing them from signing their reviews.

    CONFIDENTIALITY

    18

  • How many reviewers added how many reviews

    Total number of Cancer reviews on Publons

    Total number of Cancer reviewers on Publons

    Demographics of reviewers (e.g. country)

    Other journals they review for

    WEEKLY EMAIL UPDATES

    19

  • Reviewer engagement

    Top reviewers

    Suggested reviewers

    Demographics of reviewers (e.g. country, institution)

    Other journals they review for

    JOURNAL DASHBOARD

    20

  • 21

  • 22

  • 23

  • 24

  • Reviewers get credit for rejected manuscripts

    Information not displayed until article publishes somewhere

    Manuscript list on journal dashboard shows published manuscripts, including those your journal reviewed and rejected

    See where your rejected papers end up and the Altmetric scoreany regrets?

    REJECTED MANUSCRIPTS

    25

  • Opt-in rate45% (answered yes on scoresheet)

    Review invitation acceptance rate

    Average review time

    Review quality

    MEASURING SUCCESS

    26

  • COMPARISON OF PRE- AND POST-PUBLONS BEHAVIOR FOR REVIEWERS WHO OPTED IN

    27

    Before Opt In

    After Opt In

    Response % 92% 94%Agree % 68% 70%Completed % 96% 94%Avg Response Time (Days) 1.4 1.5Avg Review Time (Days) 11.3 10.2Avg Review Score 3.67 3.76

    Combined data

    Reviewer Person IDManuscript IDReviewer Full NameDate Reviewer InvitedDate Reviewer RespondedDate Score Sheet CompletedReviewer Invitation ResponseReview R-ScoreScore Sheet ResponseResponse time (Days)Review time (days)AgreedRespondedCompleted

    14455841CNCR-17-0382Armstrong, Andrew2/20/172/20/172/28/17Agreed via Email 4No0.374826388.03445602111

    14455841CNCR-16-2034Armstrong, Andrew9/28/169/28/1610/5/16Agreed via Email 4No0.648564816.86903935111

    14455841CNCR-16-1840Armstrong, Andrew9/6/169/11/16Declined via Email 5.46489583010

    14455841CNCR-16-2045Armstrong, Andrew10/4/1610/4/16Declined via Email 0.00758102010

    14455853CNCR-16-2560Bleyer, Archie11/30/1611/30/16Declined via Email 0.958125010

    14455854CNCR-16-0386Bloom, Allan3/7/163/8/16Unavailable via Email 1.42188657010

    14455858CNCR-16-0295Abrams, Julian2/16/162/17/16Declined via Email 1.52170138010

    14455858CNCR-16-0714Abrams, Julian4/22/164/22/16Unavailable via Email 0.41707175010

    14455860CNCR-15-2619Brewster, Abenaa12/21/1512/21/151/8/16Agreed via Email 40.5067361118.13747685111

    14455875CNCR-16-0902Chauvenet, Allen4/29/164/29/16No Response 0.10795139000

    14455880CNCR-16-0862Colevas, A. Dimitrios4/25/164/27/16Unavailable via Email 2.53965277010

    14455880CNCR-16-1091Colevas, A. Dimitrios8/23/168/30/16No Response 7.66465277000

    14455880CNCR-16-2374Colevas, A. Dimitrios11/14/1611/16/16Declined via Email 2.4428125010

    14455888CNCR-17-0397Degnim, Amy3/7/173/10/173/19/17Agreed via Email No3.799050928.62744213111

    14455894CNCR-16-1767Santin, Alessandro8/23/168/23/169/2/16Agreed via Email 4No0.251944449.80462963111

    14455894CNCR-16-0625Santin, Alessandro3/29/163/29/164/1/16Agreed via Email 0.668298613.04563657111

    14455896CNCR-16-0593Eisbruch, Avraham6/2/166/6/166/16/16Agreed via Email 4.2973032410.26828703111

    14455904CNCR-16-2560Ferrari, Andrea12/3/1612/4/16Declined via Email 1.14269675010

    14455912CNCR-16-0725Gajjar, Amar4/11/164/16/16Unavailable via Email 5.00783565010

    14455912CNCR-16-2129Gajjar, Amar10/7/1610/9/16Unavailable via Email 2.96853009010

    14455914CNCR-17-0326Garden, Adam2/8/172/10/172/20/17Agreed via Email 4No2.3641203710.29320601111

    14455928CNCR-16-2107Gronchi, Alessandro10/4/1610/6/1611/1/16Agreed via Email 4No2.1829050926.05138889111

    14455928CNCR-16-0983Gronchi, Alessandro5/12/165/12/16Unavailable via Email 0.72094907010

    14455934CNCR-16-0712Hessel, Amy Clark4/8/164/10/164/26/16Agreed via Email 2.3885648116.19130787111

    14455938CNCR-16-0609Hayes-Jordan, Andrea3/25/163/28/164/11/16Agreed via Email 43.5987731413.834375111

    14455947CNCR-16-2540Jemal, Ahmedin11/29/1611/29/1612/21/16Agreed via Email 3No0.4343981422.21615741111

    14455947CNCR-15-2589Jemal, Ahmedin12/14/1512/16/1512/23/15Agreed via Email 42.38396997.03486111111

    14455947CNCR-16-2115Jemal, Ahmedin10/6/1610/11/16Declined via Email 5.74673611010

    14455947CNCR-17-0322Jemal, Ahmedin3/30/173/30/17Declined 0.52819444010

    14455948CNCR-16-2008Jhingran, Anuja9/21/169/22/1610/10/16Agreed via Email 3No1.3832291618.58614584111

    14455948CNCR-16-1107Jhingran, Anuja7/19/167/19/16Agreed via Email 0.76535879110

    14455950CNCR-16-0904Kamat, Ashish4/28/164/28/164/28/16Agreed via Email 40.347905090.30866898111

    14455960CNCR-16-1176Kreimer, Aimee6/6/166/6/16Declined via Email 0.03582175010

    14455960CNCR-16-2344Kreimer, Aimee11/14/1611/14/16Declined via Email 0.51019675010

    14455969CNCR-16-1194Covens, Allan6/14/166/14/166/20/16Agreed via Email 40.24271995.7606713111

    14455975CNCR-16-1944Boyes, Allison9/13/169/14/1610/6/16Agreed via Email No1.3501157422.51289351111

    14455977CNCR-16-0883Aloia, Thomas4/26/164/28/165/12/16Agreed via Email 42.4332754613.89866898111

    14455977CNCR-16-2263Aloia, Thomas10/21/1610/26/16Declined via Email 5.3787037010

    14455980CNCR-17-0740Patel, Alpa3/25/173/27/17Declined 2.19170138010

    14456006CNCR-16-2115Vickers, Andrew10/6/1610/11/16Declined via Email 5.50760416010

    14456007CNCR-17-0748Ko, Andrew3/23/173/24/173/25/17Agreed via Email Yes1.848958330.69335648111

    14456008CNCR-16-2773Neugut, Alfred12/28/1612/30/16Declined via Email 2.32065972010

    14456015CNCR-16-0255Aparicio, Ana2/12/162/12/16Declined via Email 0.41502314010

    14456015CNCR-16-1184Aparicio, Ana6/7/166/7/16Declined via Email 0.79662037010

    14456015CNCR-16-2374Aparicio, Ana11/14/1611/14/16Declined via Email 0.57842592010

    14456015CNCR-17-0265Aparicio, Ana2/3/172/11/17No Response 8.42449074000

    14456017CNCR-16-0220Parikh-Patel, Arti2/8/162/17/16No Response 9.49017361000

    14456018CNCR-17-0275Ganti, Apar Kishor2/3/172/5/172/12/17Agreed via Email Yes2.958263886.63094908111

    14456018CNCR-16-1386Ganti, Apar Kishor7/5/167/5/167/18/16Agreed via Email 0.5063425913.04517361111

    14456018CNCR-16-0596Ganti, Apar Kishor3/25/163/27/164/12/16Agreed via Email 2.3769560116.3987963111

    14456018CNCR-15-2470Ganti, Apar Kishor1/25/162/2/16No Response 8.64680555000

    14456037CNCR-16-1157White, Arica6/24/166/27/16Declined via Email 3.41197916010

    14456037CNCR-16-1688White, Arica8/24/168/25/16Unavailable via Email 1.3914699010

    14456037CNCR-16-2117White, Arica10/6/1610/6/16Declined via Email 0.55677083010

    14456048CNCR-16-2041Shaha, Ashok9/27/169/27/16Unavailable via Email 0.47447916010

    14456056CNCR-16-1011Sood, Anil5/12/165/12/165/25/16Agreed via Email 30.2905555512.57885417111

    14456064CNCR-16-1631Tefferi, Ayalew8/8/168/8/168/8/16Agreed via Email 0.098148140.00947917111

    14456064CNCR-16-0274Tefferi, Ayalew2/16/162/16/16Unavailable via Email 0.85039351010

    14456067CNCR-17-0578Schroen, Anneke3/7/173/10/17Declined via Email 3.53402777010

    14456082CNCR-17-0365Zauber, Ann3/14/173/14/174/2/17Agreed via Email 4No0.6904398119.25743056111

    14456082CNCR-16-2605Zauber, Ann12/12/1612/15/16Agreed via Email 3.92895833110

    14456083CNCR-16-0713Zhu, Andrew4/21/164/24/165/12/16Agreed via Email 43.3904050918.33375111

    14456084CNCR-16-0520Zietman, Anthony3/16/163/16/16Declined via Email 0.77142361010

    14456095CNCR-16-1875Basen-Engquist, Karen9/7/169/7/169/29/16Agreed via Email No0.0123263822.30608797111

    14456112CNCR-16-1920Clary, Bryan9/13/169/20/16No Response 7.62366898000

    14456114CNCR-16-2129Conley, Barbara10/7/1610/7/1610/17/16Agreed via Email No0.651863429.92493056111

    14456114CNCR-16-0201Conley, Barbara2/8/162/8/16Declined via Email 0.55243055010

    14456114CNCR-17-0178Conley, Barbara1/25/171/25/17Declined via Email 0.66049768010

    14456115CNCR-16-1880Crane-Okada, Rebecca9/14/169/14/169/28/16Agreed via Email No0.4477314814.32135416111

    14456117CNCR-17-0428Dabaja, Bouthaina2/21/172/22/17Declined via Email 1.37414351010

    14456120CNCR-15-2535Davis, Brian12/13/1512/21/15No Response 8.63746527000

    14456129CNCR-16-2684Moy, Beverly12/14/1612/15/16Declined via Email 1.6358449010

    14456130CNCR-15-2711Ferrell, Betty12/30/1512/30/151/7/16Agreed via Email 0.415648148.22182871111

    14456133CNCR-16-0488Fuchs, Bryan3/24/163/24/164/8/16Agreed via Email 40.4181828715.03746527111

    14456133CNCR-16-0713Fuchs, Bryan5/4/165/6/16Declined via Email 2.58958333010

    14456139CNCR-16-1103Gustafsson, Bjorn6/15/166/19/16Declined via Email 4.23278935010

    14456155CNCR-17-0741Kushner, Brian4/7/174/7/174/10/17Agreed No0.220787033.24208334111

    14456163CNCR-16-0596Blumenschein, George3/25/164/6/16No Response 12.41879629000

    14456172CNCR-16-0593Murphy, Barbara6/2/166/9/16No Response 7.58783564000

    14456172CNCR-16-2029Murphy, Barbara10/6/1610/7/16Unavailable via Email 1.62800925010

    14456174CNCR-16-1188Polite, Blase6/10/166/12/167/5/16Agreed via Email 2.902719922.59945602111

    14456174CNCR-16-0027Polite, Blase1/8/161/11/162/6/16Agreed via Email 43.0637526.59971064111

    14456174CNCR-17-0914Polite, Blase4/17/174/20/17Declined 3.94967592010

    14456176CNCR-16-2477Bochner, Bernard11/28/1612/5/16No Response 7.58135416000

    14456181CNCR-16-1488Borghaei, Hossein7/21/167/22/168/9/16Agreed via Email 1.5574305518.39070602111

    14456197CNCR-16-0213Ruebner, Boris3/8/163/8/16No Response 0.66241898000

    14456197CNCR-16-0963Ruebner, Boris5/12/165/12/16No Response 0.5755324000

    14456205CNCR-16-2754Weigel, Brenda12/23/1612/30/161/14/17Agreed via Email 3No7.0264467515.53355325111

    14456212CNCR-16-0581Zebrack, Brad3/30/163/30/16Declined via Email 0.6805787010

    14456212CNCR-16-1466Zebrack, Brad7/20/167/20/16Declined via Email 0.80884259010

    14456212CNCR-16-1837Zebrack, Brad9/7/169/7/16Declined via Email 0.68215277010

    14456212CNCR-16-1932Zebrack, Brad9/27/169/29/16Declined via Email 2.27467592010

    14456212CNCR-16-2289Zebrack, Brad11/3/1611/4/16Declined via Email 1.30731481010

    14456212CNCR-16-2486Zebrack, Brad11/29/1611/29/16Unavailable via Email 0.16070601010

    14456219CNCR-16-2374Ambrosone, Christine11/18/1611/18/16Declined via Email 0.43927083010

    14456219CNCR-17-0564Ambrosone, Christine3/20/173/20/17Declined via Email 0.35315972010

    14456222CNCR-16-0323Chen, Chu2/24/162/29/16Unavailable via Email 4.45979167010

    14456224CNCR-17-0586Annunziata, Christina3/11/173/13/173/21/17Agreed via Email 4Yes2.408900468.30708333111

    14456224CNCR-16-1838Annunziata, Christina8/31/168/31/169/12/16Agreed via Email Yes0.0929166711.5995949111

    14456225CNCR-16-0416Antonescu, Cristina3/18/163/18/16Declined via Email 0.69768518010

    14456229CNCR-16-2059Cass, Ilana10/12/1610/14/1610/26/16Agreed via Email 4No2.5301157412.40283564111

    14456229CNCR-16-0783Cass, Ilana4/19/164/22/165/4/16Agreed via Email 42.5339236112.89254629111

    14456235CNCR-16-0110Baquet, Claudia1/21/161/22/16No Response 1.38547453000

    14456245CNCR-16-0454Bradley, Cathy3/7/163/8/163/23/16Agreed via Email 1.374282415.23931713111

    14456245CNCR-16-1389Bradley, Cathy7/8/167/10/16Agreed via Email 2.26827546110

    14456245CNCR-16-1702Bradley, Cathy8/16/168/16/16Unavailable via Email 0.4446875010

    14456272CNCR-16-1487Ferrone, Cristina7/26/167/28/16Unavailable via Email 2.71626157010

    14456272CNCR-16-2260Ferrone, Cristina10/25/1610/31/16No Response 6.42155092000

    14456272CNCR-16-2571Ferrone, Cristina12/7/1612/14/16No Response 7.59837963000

    14456274CNCR-17-0538Flowers, Christopher3/27/173/27/174/9/17Agreed No0.6118865713.17226852111

    14456274CNCR-16-0320Flowers, Christopher2/18/162/18/163/2/16Agreed via Email 0.2953356513.30649305111

    14456274CNCR-16-0764Flowers, Christopher4/19/164/22/16Declined via Email 3.22016204010

    14456288CNCR-16-2054Chang, Sam10/3/1610/4/1610/14/16Agreed via Email 4No1.430127319.91144676111

    14456309CNCR-17-0051Kollmannsberger, Christian1/12/171/12/172/1/17Agreed via Email No0.5813194420.16273148111

    14456318CNCR-16-1575Kane, Christopher8/5/168/7/169/10/16Agreed via Email 4Yes2.4167476833.73126157111

    14456321CNCR-16-1157Klabunde, Carrie6/17/166/24/16No Response 7.64181713000

    14456324CNCR-16-1951Landen, Charles9/19/169/19/1610/5/16Agreed via Email 4No0.0221296316.14216435111

    14456324CNCR-17-0582Landen, Charles3/8/173/9/17Agreed via Email 1.33425925110

    14456325CNCR-17-0609Langer, Corey3/20/17000

    14456327CNCR-16-0161Lao, Christopher2/1/162/1/162/14/16Agreed via Email 0.5511689813.33981481111

    14456337CNCR-16-1694Loprinzi, Charles9/16/169/16/169/23/16Agreed via Email Yes0.715995376.80934027111

    14456337CNCR-15-2405Loprinzi, Charles12/16/1512/16/1512/22/15Agreed via Email 0.250810185.97918982111

    14456337CNCR-16-0776Loprinzi, Charles4/25/164/26/16Declined via Email 1.3392824010

    14456338CNCR-15-2651Trimble, Cornelia12/22/1512/22/151/11/16Agreed via Email 0.5242592519.95515047111

    14456338CNCR-16-0877Trimble, Cornelia4/25/164/27/16Unavailable via Email 2.25393518010

    14456348CNCR-17-0749Moskowitz, Craig3/24/173/31/17Auto-Declined (no response) 7.01020833000

    14456349CNCR-16-0617Muller, Carolyn4/4/164/8/164/12/16Agreed via Email 44.544988424.18089121111

    14456349CNCR-16-1391Muller, Carolyn7/26/167/26/16Declined via Email 0.11767361010

    14456349CNCR-17-0248Muller, Carolyn2/9/172/22/17No Response 13.70377314000

    14456353CNCR-16-1286Coleman, Robert6/21/166/22/16Unavailable via Email 0.88086805010

    14456357CNCR-16-0121Cote, Michele1/21/161/23/162/2/16Agreed via Email 32.3643518510.03846065111

    14456357CNCR-17-0586Cote, Michele3/10/173/10/17Declined via Email 0.57724537010

    14456367CNCR-17-0491Powell, Charles2/28/172/28/173/15/17Agreed via Email Yes0.4011111114.95429398111

    14456371CNCR-16-0663Pui, Ching-Hon4/7/164/7/16Declined via Email 0.42792824010

    14456374CNCR-17-0208Crane, Christopher1/26/171/26/171/31/17Agreed via Email Yes0.401793984.99440972111

    14456374CNCR-16-1437Crane, Christopher7/11/167/11/167/20/16Agreed via Email 0.455590279.15756945111

    14456374CNCR-15-2631Crane, Christopher12/22/1512/22/1512/29/15Agreed via Email 0.50521997.11515047111

    14456375CNCR-17-0325Raut, Chandrajit2/7/172/7/172/10/17Agreed No0.767129632.77951388111

    14456375CNCR-16-2809Raut, Chandrajit1/3/171/3/171/4/17Agreed No0.342638881.26357639111

    14456375CNCR-16-1729Raut, Chandrajit8/18/168/18/168/18/16Agreed via Email Yes0.468171290.22883102111

    14456375CNCR-16-1589Raut, Chandrajit8/1/168/1/168/5/16Agreed via Email 0.901608793.60171296111

    14456375CNCR-16-0772Raut, Chandrajit4/13/164/13/164/13/16Agreed via Email 0.433877310.49658565111

    14456381CNCR-16-0734Saigal, Christopher4/12/164/14/165/3/16Agreed via Email 42.3923379619.44761574111

    14456381CNCR-16-0077Saigal, Christopher1/15/161/19/16No Response 4.57798611000

    14456381CNCR-16-0233Saigal, Christopher2/16/162/16/16Unavailable via Email 0.49355324010

    14456391CNCR-16-1544Snyderman, Carl7/27/167/27/168/8/16Agreed via Email 0.6527083311.67877315111

    14456395CNCR-16-2147Sternberg, Cora10/11/1610/14/16Declined via Email 3.17344907010

    14456398CNCR-16-0011Strange, Charlie1/20/161/20/16Declined via Email 0.86942129010

    14456408CNCR-16-2468Van Waes, Carter11/18/1611/23/1611/30/16Agreed via Email 4No5.648159726.9799537111

    14456410CNCR-16-1810Fernandez, Conrad9/19/169/20/169/25/16Agreed via Email 4Yes1.660694444.60677083111

    14456411CNCR-16-2484Willett, Christopher11/23/1611/23/1612/4/16Agreed via Email No0.667094910.73525463111

    14456411CNCR-16-1378Willett, Christopher7/18/167/18/167/22/16Agreed via Email 40.496041664.16503472111

    14456420CNCR-16-2089Adelstein, David10/18/1610/18/1610/22/16Agreed via Email 4No0.50253.99143518111

    14456420CNCR-16-1091Adelstein, David8/23/168/23/16Declined via Email 0.67642361010

    14456423CNCR-15-2365Dahlberg, Suzanne12/30/1512/30/15Declined via Email 0.53287037010

    14456423CNCR-16-1685Dahlberg, Suzanne8/24/168/24/16Declined via Email 0.46358796010

    14456426CNCR-15-2622Danhauer, Suzanne3/2/163/2/16Declined via Email 0.47469907010

    14456426CNCR-16-0657Danhauer, Suzanne4/25/164/26/16Declined via Email 1.04489583010

    14456430CNCR-16-1954Feldman, Darren9/16/169/19/16Unavailable via Email 3.50108796010

    14456430CNCR-17-0051Feldman, Darren1/12/171/15/17Declined via Email 3.53373842010

    14456451CNCR-16-1471Berry, Donna7/14/167/14/16Declined via Email 0.57913194010

    14456451CNCR-16-2622Berry, Donna12/12/1612/12/16Declined via Email 0.58616898010

    14456456CNCR-16-0595Bovbjerg, Dana3/29/163/29/164/19/16Agreed via Email 0.5854282421.11953703111

    14456464CNCR-16-0873Chhieng, David4/27/165/3/16No Response 6.34652777000

    14456472CNCR-16-2484Smith, David11/23/1611/23/16Declined via Email 0.73729166010

    14456476CNCR-16-2375Dershaw, D. David11/9/1611/16/16No Response 7.02986111000

    14456496CNCR-16-2215Freyer, David10/18/1610/18/1611/3/16Agreed via Email No0.6290046316.31317129111

    14456496CNCR-16-0975Freyer, David5/12/165/16/166/3/16Agreed via Email 4.0474421318.69611111111

    14456496CNCR-16-2560Freyer, David11/30/1612/3/16Unavailable via Email 3.91302083010

    14456497CNCR-16-0975Friedman, Debra5/12/165/12/16Unavailable via Email 0.94092592010

    14456499CNCR-16-0223Gaffney, David2/5/162/5/162/8/16Agreed via Email 30.142511572.63653935111

    14456499CNCR-16-1421Gaffney, David7/11/167/11/16Declined via Email 0.46387731010

    14456509CNCR-16-2678Green, Daniel12/15/1612/15/1612/22/16Agreed via Email Yes0.489004637.00876157111

    14456509CNCR-16-1915Green, Daniel9/12/169/14/169/19/16Agreed via Email No2.323946755.22265047111

    14456509CNCR-16-1578Green, Daniel7/28/167/28/167/29/16Agreed via Email 0.384363421.21274306111

    14456509CNCR-16-1121Green, Daniel5/26/165/26/165/27/16Agreed via Email 0.010879630.92650463111

    14456509CNCR-17-0779Green, Daniel4/3/174/3/17Declined 0.40134259010

    14456514CNCR-16-0358Hershman, Dawn3/2/163/11/16No Response 9.46549768000

    14456514CNCR-16-0845Hershman, Dawn4/20/164/27/16No Response 7.12592592000

    14456514CNCR-17-0065Hershman, Dawn1/12/171/14/17Declined via Email 2.83700231010

    14456514CNCR-17-0718Hershman, Dawn3/29/173/29/17Declined 0.38930555010

    14456517CNCR-16-0344Hoelzer, Dieter3/1/163/2/16Declined via Email 1.49789351010

    14456517CNCR-16-0988Hoelzer, Dieter5/18/165/19/16Declined via Email 1.31671296010

    14456518CNCR-16-0500Huntsman, David3/10/163/10/16Declined via Email 0.49173611010

    14456519CNCR-16-0021Diamond, Catherine1/19/161/19/162/9/16Agreed via Email 40.3630787120.7489699111

    14456522CNCR-17-0857Dispenzieri, Angela4/12/174/13/17Declined 1.69369213010

    14456531CNCR-16-0977Kirsch, David5/6/165/6/16Declined via Email 0.53363425010

    14456534CNCR-16-2263Kooby, David10/21/1610/23/16Declined via Email 2.67723379010

    14456543CNCR-16-0036Lieberman, David2/8/162/8/16Unavailable via Email 0.76732638010

    14456543CNCR-16-1134Lieberman, David6/1/166/1/16Unavailable via Email 0.49094907010

    14456543CNCR-16-1427Lieberman, David7/26/168/1/16Unavailable via Email 6.86055555010

    14456549CNCR-16-1123Michaelson, M. Dror6/1/166/7/166/7/16Agreed via Email 46.535115740.08704861111

    14456554CNCR-17-0168McDermott, David1/24/171/25/17Declined via Email 1.45105324010

    14456556CNCR-16-0894Euhus, David4/28/164/29/16Declined via Email 1.65266203010

    14456560CNCR-16-0223Miller, David2/5/162/8/16Agreed via Email 2.78746528110

    14456573CNCR-17-0465Dores, Graca2/27/172/28/173/11/17Agreed via Email 4No1.7632175910.7025111

    14456576CNCR-16-0488Owen, David3/24/163/24/164/6/16Agreed via Email 40.7717013812.98614584111

    14456576CNCR-16-0713Owen, David5/13/165/20/16No Response 7.54241898000

    14456582CNCR-16-1422Penson, David7/11/167/11/167/31/16Agreed via Email 40.4633101820.35788195111

    14456582CNCR-16-0664Penson, David3/31/164/2/16Declined via Email 2.40769675010

    14456582CNCR-16-2674Penson, David12/16/1612/16/16Declined via Email 0.00034722010

    14456594CNCR-17-0839Deininger, Michael4/6/17000

    14456598CNCR-16-0162Diefenbach, Michael3/28/164/6/16No Response 9.41931713000

    14456602CNCR-17-0428Dreyling, Martin3/2/173/3/17Declined via Email 1.09586805010

    14456606CNCR-17-0255Phillips, Robert2/7/172/8/17Unavailable via Email 1.41416666010

    14456617CNCR-17-0001Rosenthal, David1/4/171/5/171/24/17Agreed via Email No1.4181365719.44719907111

    14456629CNCR-16-1175Shin, Dong7/7/167/14/16No Response 7.53112268000

    14456629CNCR-16-2010Shin, Dong9/22/169/22/16Declined via Email 0.65692129010

    14456629CNCR-17-0634Shin, Dong3/11/173/16/17Declined via Email 5.87390046010

    14456634CNCR-17-0291Spiegel, David4/3/174/3/174/5/17Agreed 4Yes0.447083332.39954861111

    14456634CNCR-17-0362Spiegel, David2/18/172/18/173/11/17Agreed via Email Yes0.4914120321.18297454111

    14456634CNCR-16-1152Spiegel, David6/7/166/10/166/15/16Agreed via Email 3.097129635.39324074111

    14456638CNCR-15-2576Steensma, David12/16/1512/16/15Declined via Email 0.00269675010

    14456638CNCR-16-0988Steensma, David5/18/165/18/16Declined via Email 0.63670138010

    14456638CNCR-16-1327Steensma, David7/5/167/5/16Declined via Email 0.00373843010

    14456638CNCR-17-0601Steensma, David3/9/173/9/17Declined via Email 0.58226851010

    14456639CNCR-16-2067Araujo, Dejka10/18/1610/18/16Declined via Email 0.49976851010

    14456674CNCR-16-0075Bandres, Eva1/20/161/21/16Declined via Email 1.18966435010

    14456679CNCR-16-0344Bluhm, Elizabeth2/22/162/22/16Unavailable via Email 0.80684027010

    14456683CNCR-16-0134Bruera, Eduardo2/16/162/16/16Declined via Email 0.63761574010

    14456683CNCR-16-0776Bruera, Eduardo4/29/164/29/16Declined via Email 0.44094907010

    14456689CNCR-16-0977Cheng, Edward5/9/165/10/16Declined via Email 0.4868287010

    14456696CNCR-15-2648Choy, Edwin12/22/1512/23/15Declined via Email 1.46149305010

    14456709CNCR-17-0447Eggener, Scott2/25/172/25/172/26/17Agreed via Email 4Yes0.633287031.33395834111

    14456709CNCR-16-0064Eggener, Scott1/15/161/15/16Declined via Email 0.37160879010

    14456709CNCR-16-2559Eggener, Scott12/5/1612/6/16Declined via Email 1.32793981010

    14456715CNCR-16-2010Haura, Eric10/3/1610/4/16Declined via Email 0.86638889010

    14456719CNCR-17-0038Jabbour, Elias1/13/171/17/172/8/17Agreed via Email 3Yes4.5722916622.38118056111

    14456719CNCR-16-2373Jabbour, Elias11/7/1611/10/1611/28/16Agreed via Email 4Yes3.3065393518.12319445111

    14456719CNCR-16-1848Jabbour, Elias9/7/169/12/169/28/16Agreed via Email 4Yes5.3523032415.66435185111

    14456719CNCR-16-0742Jabbour, Elias4/11/164/12/165/1/16Agreed via Email 1.4268402719.09403936111

    14456719CNCR-16-0123Jabbour, Elias2/12/162/14/163/2/16Agreed via Email 2.8482407416.89736111111

    14456719CNCR-16-1284Jabbour, Elias8/1/168/8/16No Response 7.59792824000

    14456719CNCR-17-0867Jabbour, Elias4/18/174/20/17Agreed 2.08821759110

    14456720CNCR-17-0680Jonasch, Eric3/29/173/31/174/19/17Agreed 4Yes2.3940509219.60422454111

    14456723CNCR-17-0698Klein, Eric3/22/173/22/173/25/17Agreed via Email 4No0.878217592.57241898111

    14456723CNCR-16-2490Klein, Eric11/29/1611/29/1612/1/16Agreed via Email 4Yes0.666909721.97887731111

    14456738CNCR-16-2660Messing, Edward12/13/1612/16/1612/22/16Agreed via Email 4No3.505682875.94163194111

    14456738CNCR-16-0250Messing, Edward5/13/165/18/165/26/16Agreed via Email 45.379224538.04333334111

    14456740CNCR-16-2678Mullen, Elizabeth12/15/1612/17/161/4/17Agreed via Email 4No2.7087847218.28975694111

    14456741CNCR-16-1487Nakakura, Eric7/19/167/19/168/13/16Agreed via Email 40.5191782424.96380787111

    14456741CNCR-16-0602Nakakura, Eric4/11/164/13/165/2/16Agreed via Email 2.3198379619.39442129111

    14456741CNCR-16-2263Nakakura, Eric10/21/1610/22/16Agreed via Email 1.41831018110

    14456742CNCR-16-0269Engels, Eric2/16/162/16/162/26/16Agreed via Email 40.651886579.83876157111

    14456742CNCR-16-1477Engels, Eric8/1/168/8/16No Response 7.5965625000

    14456742CNCR-16-2146Engels, Eric10/31/1610/31/16Declined via Email 0.61128472010

    14456742CNCR-17-0434Engels, Eric3/1/173/3/17Declined via Email 2.22125010

    14456744CNCR-16-1227O'Reilly, Eileen6/10/166/10/166/18/16Agreed via Email