elastic stack overview · elastic stack overview the world’s most popular enterprise products for...

34
Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more

Upload: others

Post on 25-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Elastic Stack OverviewThe world’s most popular enterprise products for real-time search, logging, analytics, and more

Page 2: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Who?

2

$ curl http://localhost:9200/speaker/_doc/dpilato{ "nom" : "David Pilato", "jobs" : [ { "boite" : "SRA Europe (SSII)", "mission" : "bon à tout faire", "date" : "1995" }, { "boite" : "SFR", "mission" : "touche à tout", "date" : "1997" }, { "boite" : "e-Brands / Vivendi", "mission" : "chef de projets", "date": "2000" }, { "boite" : "DGDDI (douane)", "mission" : "mouton à 5 pattes", "date" : "2005" }, { "boite" : "IDEO Technologies", "mission" : "CTO", "date" : "2012" }, { "boite" : "elastic", "mission" : "développeur", "date" : "2013" } ], "passions" : [ "famille", "job", "deejay" ], "blog" : "http://david.pilato.fr/", "twitter" : [ "@dadoonet", "@elasticfr" ], "email" : "[email protected]"}

Page 3: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Store, Search, & Analyze

Visualize & Manage

Ingest

Elastic StackSOLUTIONS

Elastic Stack

Kibana

Elasticsearch

Beats Logstash

SaaS SELF-MANAGED

Elastic Cloud Elastic CloudEnterprise Standalone

APM

Page 4: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

4

ES-Hadoop

Deployment in the Enterprise

Data store Web APIs

Social Sensors

Kafka

Redis

Messaging Queue

Logstash

Workers (2+)

LDAP

Authentication

AD

Notification

SSO

Kibana

Custom UI

Elasticsearch Clients

Elasticsearch

Master (3)

Ingest (X)

Data – Hot (X)

Data – Warm (X)

Machine Learning (2+)

Coordinating (X)

Alerting (X)

HEARTBEAT

Beats

FILEBEAT

METRICBEAT

PACKETBEAT

WINGLOGBEAT

AUDITBEAT

Page 5: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

5 https://www.elastic.co/fr/subscriptions

Page 6: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Services at a Glance

6

Elastic Training

Certification Elastic Consulting

• Immersive learning experience

• Solution-based curriculum • Flexible ways-to-train

• Performance-based exam • Solve real-world tasks, in real-

time • Remote, secure testing

• Expert services focused on your business goals

• Phased-based packages • Product expertise

People Strategy Project Strategy

Page 7: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

IMMERSIVE LEARNING ENVIRONMENT

Lab-based exercises to help master new skills

SOLUTION-BASED CURRICULUM

Real-world examples and common use cases

EXPERIENCED INSTRUCTORS

Expertly trained and deeply rooted in everything Elastic

PERFORMANCE-BASED CERTIFICATION

Apply skills to real-world use cases, in real-time

Course offerings

Kibana Data and Ops Analyst: Jan 20-22

Elasticsearch Engineer I: Jan 21-22

Elasticsearch Engineer II: Jan 21-22

Who should attend?

Software Developers, Engineers, Data Architects, System Administrators, DevOps

What will I learn?

● How to manage deployments and develop solutions.

● Advanced cluster management techniques, best practices for capacity planning and scaling, and more.

Elastic Training Paris / France

En français

50% discount on the 2nd seat

Page 8: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Vouchers for free trainings

8

Training VoucherLogging Fundamentals LoggingMetrics Fundamentals MetricsAPM Fundamentals APMElastic Machine Learning for Cybersecurity MLCyberECE Fundamentals ECEFFundamentals of Securing Elasticsearch FSE

Elastic Training

https://training.elastic.co/elearning/

Please do not share those codes

Page 9: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

A typical search implementation…CREATE TABLE user( name VARCHAR(100), comments VARCHAR(1000));INSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

9

David

Page 10: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search on term

10

INSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name="David";Empty set (0,00 sec)

David

Page 11: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search like

11

INSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%David%";+--------------+----------------------+| name | comments |+--------------+----------------------+| David Pilato | Developer at elastic || David Gageot | Engineer at Google || David David | Who is that guy? |+--------------+----------------------+

David

Page 12: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search for termsINSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%David Pilato%";+--------------+----------------------+| name | comments |+--------------+----------------------+| David Pilato | Developer at elastic |+--------------+----------------------+

12

David Pilato

Page 13: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search with inverted termsINSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%Pilato David%";Empty set (0,00 sec)SELECT * FROM user WHERE name LIKE "%Pilato%David%";Empty set (0,00 sec)

13

Pilato David

Page 14: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search for terms

14

INSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%David%" AND name LIKE "%Pilato%";+--------------+----------------------+| name | comments |+--------------+----------------------+| David Pilato | Developer at elastic |+--------------+----------------------+

Pilato David

Page 15: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search in two fieldsINSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%David%" OR comments LIKE "%David%";+--------------+---------------------------------------------+| name | comments |+--------------+---------------------------------------------+| David Pilato | Developer at elastic || Malloum Laya | Worked with David at french customs service || David Gageot | Engineer at Google || David David | Who is that guy? |+--------------+---------------------------------------------+

15

David

Page 16: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue
Page 17: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search with typos

17

INSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%Dadid%";Empty set (0,00 sec)

Dadid

Page 18: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search with typos

18

INSERT INTO user VALUES ('David Pilato', 'Developer at elastic');INSERT INTO user VALUES ('Malloum Laya', 'Worked with David at french customs service');INSERT INTO user VALUES ('David Gageot', 'Engineer at Google');INSERT INTO user VALUES ('David David', 'Who is that guy?');

SELECT * FROM user WHERE name LIKE "%_adid%" OR name LIKE "%D_did%" OR name LIKE "%Da_id%" OR name LIKE "%Dad_d%" OR name LIKE "%Dadi_%";+--------------+----------------------+| name | comments |+--------------+----------------------+| David Pilato | Developer at elastic || David Gageot | Engineer at Google || David David | Who is that guy? |+--------------+----------------------+

Page 19: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue
Page 20: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

20

User Interface

Page 21: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Search engine?Moteur d'indexation de documents

Moteur de recherche dans les index

21

Page 22: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

22

Demo time!

Page 23: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Elastic Cloud on KubernetesThe official Operator (and more) for Elasticsearch and Kibana

Page 24: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Elasticsearch core security is now free

• TLS Encryption

• File-based and native authentication

• Role-based access control

Page 25: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

Elasticsearch SIEM solution available for free

New in 7.2

Page 26: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue
Page 27: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue
Page 28: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

28

Page 29: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

29

Page 30: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

30

Page 31: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue
Page 32: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

#ElasticStories

Page 33: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

IMMERSIVE LEARNING ENVIRONMENT

Lab-based exercises to help master new skills

SOLUTION-BASED CURRICULUM

Real-world examples and common use cases

EXPERIENCED INSTRUCTORS

Expertly trained and deeply rooted in everything Elastic

PERFORMANCE-BASED CERTIFICATION

Apply skills to real-world use cases, in real-time

Course offerings

Kibana Data and Ops Analyst: Jan 20-22

Elasticsearch Engineer I: Jan 21-22

Elasticsearch Engineer II: Jan 21-22

Who should attend?

Software Developers, Engineers, Data Architects, System Administrators, DevOps

What will I learn?

● How to manage deployments and develop solutions.

● Advanced cluster management techniques, best practices for capacity planning and scaling, and more.

Elastic Training Paris / France

En français

50% discount on the 2nd seat

Page 34: Elastic Stack Overview · Elastic Stack Overview The world’s most popular enterprise products for real-time search, logging, analytics, and more . ... Kafka Redis Messaging Queue

elasticfr

@elasticfr

discuss.elastic.co