microservices in a data science world
TRANSCRIPT
Title slide
Microservices in a Data
Science World@jhug | @NikosDimos
Microservices & Data Science | Jhug
Microservices & Data Science | Jhug
Monolith Microservice
Microservices & Data Science | Jhug
Definition of Microservices{Common Characteristics
1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design
http://martinfowler.com/articles/microservices.html
Microservices & Data Science | Jhug
Common characteristics
1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design
Microservices & Data Science | Jhug
Componentization via Services
Component
Independently upgradable
Independently replaceable
Library Service
Microservices & Data Science | Jhug
Common characteristics
1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design
Microservices & Data Science | Jhug
Organized around business capabilities
UI
SERVER
DATA SCIENCE
Microservices & Data Science | Jhug
Organized around business capabilities
Candidate Deduplication
Candidate Recommender
Shopping Cart
Microservices & Data Science | Jhug
Common characteristics
1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design
Microservices & Data Science | Jhug
Smart Endpoints Dumb Pipes
Microservices & Data Science | Jhug
Smart Endpoints Dumb Pipes
Microservices & Data Science | Jhug
Common characteristics
1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design
Microservices & Data Science | Jhug
Decentralization of Data Management
Microservices & Data Science | Jhug
Decentralization of Data Management
Microservices & Data Science | Jhug
Benefits Costs
+
+
+
-
-
-
Strong Module Boundaries
Independent Deployment
TechnologyDiversity
Distribution
Eventual Consistency
Operational Complexity
Microservices & Data Science | Jhug
Productivity
Complexity
Monolith
Microservice
Microservices & Data Science | Jhug
Workable journey to Microservices
Microservices & Data Science | Jhug
Workable Gen 1.0
Microservices & Data Science | Jhug
Workable Gen 1.5
Microservices & Data Science | Jhug
Workable Gen 2.0
Microservices & Data Science | Jhug
Workable Gen 2.0
Until we reached this...
Microservices & Data Science | Jhug
Workable Lessons LearnedThings to improve
● Rapid provisioning - Heroku● Basic Monitoring - Newrelic● Rapid Application Deployment - Heroku● Traceable Business Transactions - Kafka
● Devops Culture● Continuous Delivery ● Product-centered Teams
Title slideThanks.@workable | @NikosDimos