explaining semantic search: achieving warp speed · Публикация подобных...

25
DECEMBER 11, 2019 GEORGE WASHINGTON UNIVERSITY SPONSORED BY DECEMBER 11, 2019 GEORGE WASHINGTON UNIVERSITY SPONSORED BY Explaining Semantic Search: Achieving Warp Speed Eugene S. Reyes Federal Solutions Engineer 1

Upload: others

Post on 28-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BYDECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Explaining Semantic Search:Achieving Warp Speed

Eugene S. ReyesFederal Solutions Engineer

1

Page 2: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Who Am I?

2

15+ Years: Department of Defense and Intelligence Community

Multiple Applied Research & Development (R&D) Offices

Semantic Search emphasis10+ years of experience with Latent Semantic Indexing (LSI)

HLTCon 2018“Rapid Triage and Exploitation of Digital Media: Breaking the Warp Barrier”

Life-long Trekkie #LLAP

Page 3: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY 3

Illustration of a needle stack. From FritsAhlefeldt.com by Frits Ahlefeldt (2011, May 16). Retrieved from https://www.flickr.com/photos/hikingartist/5726834411.

Page 4: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Boolean/Keyword Search

4

Hammer

Page 5: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY 5

Page 6: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Boolean/Keyword Search

6

nuclear AND weapon

nuclear AND (weapon OR bomb)

“nuclear weapon” OR “nuclear bomb”

((nuclear OR thermonuclear) AND (weapon OR warhead OR bomb)) OR ((atom OR atomic OR fission OR fusion OR hydrogen) AND bomb) OR nuke OR a-bomb)

((nuclear OR thermonuclear) AND (weapon OR warhead OR bomb)) OR ((atom OR atomic OR fission OR fusion OR hydrogen) AND bomb) OR nuke OR a-bomb) NEAR (plutonium OR uranium)

Page 7: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY 7

Page 8: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY 8

Page 9: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Semantic SearchExtremely viable in Intelligence and Legal Discovery

Successes:1. Topic Exploration2. Detecting Coverage Gaps

9

Page 10: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Semantic SearchHow to trust output?

How to explain answer?

Math class:Show Your Work!!!

Star Trek VI:“...ionized gas” + “...gaseous anomalies…” → “Tailpipe”

HLT / NLP ...

10

Page 11: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BYDECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Basis Rosette

11

Page 12: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Basis Rosette

12

Language Identification+

Sentence Identification+

Entity Recognition+

Similar Terms+

Semantic Vectors / Similarity=

Page 13: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BYDECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Basis Semantic Studio

13

Page 14: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Similar Terms

14

Page 15: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Similar Terms

15

Page 16: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Similar Terms

16

Page 17: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Similar Terms

17

Page 18: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Mueller Report

18

As set forth in detail in this report, the Special Counsel’s investigation established thatRussia interfered in the 2016 presidential election principally through two operations.

Page 19: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Mueller Report

19

First, a Russian entity carried out a social media campaign that favored presidential candidate Donald J. Trump and disparaged presidential candidate Hillary Clinton.

Page 20: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Constitution & Trump-Ukraine Impeachment

20

Shall any man be above Justice? Above all shall that man be above it, who can commit the most extensive injustice?

Page 21: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Constitution & Trump-Ukraine Impeachment

21

Given the proximate threat of further presidential attempts to solicit foreign interference in our next election, we cannot wait to make a referral until our efforts to obtain additional testimony and documents wind their way through the courts.

Page 22: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Voice of America & RT

22

Page 23: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Voice of America & RTПубликация подобных отчётов — часть политической кампании по созданию в умах рядовых граждан убеждённости, что у России и Ирана действительно есть мощные группы специалистов, способных вмешаться в выборы или совершить другие противоправные действия не в интересах США

The publication of such reports is part of a political campaign to create in the minds of ordinary citizens the conviction that Russia and Iran really have powerful groups of specialists capable of interfering in elections or commit other illegal actions not in the interests of the United States.

23

Page 24: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BYDECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Questions?

24

Page 25: Explaining Semantic Search: Achieving Warp Speed · Публикация подобных отчётов — часть политической кампании по созданию

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Thank you!

25

Eugene S. ReyesFederal Solutions [email protected]