breaking the monolith - v3
TRANSCRIPT
Breaking the Monolith
WHOAMI
Cristobal ViedmaFounder & CEO @Monkimun
Former life: Head of Platform @Viki ($200M exit) Founder & CEO @Bluewalks
80% of the world can only read <6% of the Internet
W3techs 2015: http://w3techs.com/technologies/overview/content_language/allUnesco 2012: http://unesdoc.unesco.org/images/0018/001870/187016e.pdf
WHATISVIKI?
GLOBALTV
NOTADUMBTV
TITLEHERECROSSCULTURAL COMMUNICATION
CHALLENGES
WEBviki.com 56.com pptv.com youtube.com yahoo.com msn.com...
MOBILEAndroid iOS Blackberry Windows Phone Samsung Bada Kindle Fire...
SMARTTVs
Google TV, Samsung SmartTV, Roku...
HIGHLYDISTRIBUTED
Data: viki.com Oct'12
Top 5 Cities: Singapore,Santiago, LaVictoria, Jakarta, New York
EXPLOSIVEGROWTH
~22M users winter’12 (2500% growth). ~35M summer’13
DEMANDINGUSERSviewers start leaving if video doesn't play in 2 secs ...and every sec of additional delay ~6% more jumping ship!
Data: Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs. S. Shunmuga Krishnan, Ramesh K. Sitaraman, 2012
CHALLENGES
Large Ecosystem Highly DistributedExplosive GrowthDemanding Users
TITLEHERE
BREAKTHEMONOLITH
TITLEHERE
PLATFORMFOCUS
Scalability Availability
Performance
UNDERSTANDINGFacts:Read heavy (writes can wait) Everything fits in memory
Goal: 25ms uncached (10-100x better)
[SCALA|AVAILA]BILITY
Service Oriented Architecture Each vertical is a source of truth
Oceanus (Videos)
Activities (Behaviour)
Gaia (Users)
Aphrodite (Community)
…
ONEGATE
Hyperion (platform cluster)
Everything routed through api.viki.io
Oceanus (Videos)
Activities (Behaviour)
Gaia (Users)
Aphrodite (Community)
…
DISTRIBUTION
TH
HH
H
H
HH
H
PUB/SUBSYSTEMHyperion (platform cluster)
Oceanus (Videos)
Activities (Behaviour)
Gaia (Users)
Aphrodite (Community)
…
Message / Events Queue
… Message / Events Queue
Oceanus (Videos)
Activities (Behaviour)
Gaia (Users)
Aphrodite (Community)
Analytics
Hyperion(cluster)
viki.com
LogsSegmenting Tool
Subtitling tool
Baboon (CMS)
Hyperion(cluster)
Hyperion(cluster)
Devices (android, ios, etc)
Partners (Samsung, Youtube,
etc)
3rd Party Dev. (API)
Plat
form
Con
tent
Clie
nts
Know
ledge
EVENTDRIVENARCHITECTURE
CHALLENGES/FOCUS
Scalability Availability
Performance
Large Ecosystem Highly DistributedExplosive GrowthDemanding Users
PERFORMANCE
Generation Time Network time Render time
Hyperion Client
PERFORMANCE
Hyperion(cluster)
Nginx
APIProxy (GoLang)
Hyperion (Node.js)
Redis Redis Redis
GENERATIONOriginal (without latency) ~250ms
Everything in memory ~15-100ms
Sorting / VFind ~15ms
Paging ~9ms
Serializing ~5ms
UNCACHED
HORRORFUNFACTS
Alias - Redis 32bits VFIND - Redis forkJSON Concat in C
[email protected] https://angel.co/monkimun
Nothing new… Having fun & learning!
https://github.com/karlseguin/scaling-viki
80% of the world can only read <6% of the Internet
W3techs 2015: http://w3techs.com/technologies/overview/content_language/allUnesco 2012: http://unesdoc.unesco.org/images/0018/001870/187016e.pdf
Research shows 2-6 years is the best age to learn a language
Science 2005: http://www.sciencemag.org/content/310/5749/815
language learning is extremely bOOOring
and so is “gamifying” it…
A common language will accelerate growth and make the
world more united and equal
VISION
ADVISORS
Kent Liu Ex-GM Asia for EA Mobile Ex-Director JAMDAT mobile (IPO + $680M exit)
500 Startups Leading global venture capital seed fund
Razmig Hovaghimian Co-founder / CEO Viki Sr Executive Officer Rakuten Board Observer Rakuten
Gwynne Shotwell SpaceX President & COO
[email protected] https://angel.co/monkimun
[email protected]+1 415 528 99 71 +34 617 606 187
Psst, We are hiring!