many (big) data projects start in agile mode - home | ba4all in the cloud the... · many (big) data...

15
Hadoop in the cloud: the pragmatic start Joris Van den Borre, director, Tropos.io

Upload: dangduong

Post on 17-Mar-2018

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Hadoop in the cloud: the pragmatic start Joris Van den Borre, director, Tropos.io

Page 2: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Many (big) data projects start in Agile mode

Page 3: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Our key driver is growth

Page 4: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Cloud provides the building blocks

Page 5: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Gartner ranks AWS as a leader

* Covers all of our current and futurestorage & computing needs* Hadoop components as-a-service* High rate of innovation* Enterprise-ready with global presence

Page 6: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Store data

Process data

Hadoop is modular by nature

Source: www.Hortonworks.com

Page 7: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Split architecture for fast and high volume data

Page 8: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

S3 is a fast, scaleable storage service

Page 9: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

EMR is Hadoop-as-a-service

Page 10: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Extending architecture for real-time reporting

Page 11: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Optionally make a link with the DWH world

Page 12: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Configure & manage your cloud via web + api interfaces

Page 13: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Next step: iterate on your cluster design and/or go hybrid

Custom EC2 instances

(Hadoop distros)

(NoSQL db’s)

(notebooks)

(data manipulation/access)

Page 14: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data

Joris Van den Borre

Director, Tropos.io

http://www.tropos.io

@jvdborre

http://www.linkedin/in/jvdborre

Page 15: Many (big) data projects start in Agile mode - Home | ba4all in the Cloud the... · Many (big) data projects start in Agile mode. ... Split architecture for fast and high volume data