the future of apache cloudstack
TRANSCRIPT
![Page 1: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/1.jpg)
CloudStack Future
Sebas1en Goasguen VP Apache CloudStack
@sebgoa
![Page 2: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/2.jpg)
Background
• Citrix Senior Open Source Architect
• VP of Apache CloudStack
• PMC of Apache libcloud • ASF member • O’Reilly author of the CloudStack and Docker cookbooks
![Page 3: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/3.jpg)
Lots of users
![Page 4: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/4.jpg)
Strong Ecosystem
![Page 5: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/5.jpg)
2015 Community Plan
“House cleaning”
Engineering Roadmap
![Page 6: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/6.jpg)
Cleaning the house
h6p://s.apache.org/coS2
• Code and Infra • Ecosystem • Events / MarkeDng • DocumentaDon • Website
![Page 7: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/7.jpg)
Code -‐cleanup
• Remove AWSAPI ( ~1M LOC) • IP clearance for EC2stack and GCEstack now officially Apache CloudStack subprojects
• Sta1c analysis and focus on code quality but removal of dead code.
Future of CloudStack architecture in a Docker, Mesos, Kubernetes world
![Page 8: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/8.jpg)
Infrastructure -‐cleanup
• No more Review Board • All contribu1ons come as GitHub pull request • Increased 1me and priori1es on Travis • More and faster tes1ng • Simulator automa1cally packaged as Docker image
• New release management process
![Page 9: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/9.jpg)
Ecosystem
• CloudFoundry deployment • Cleanly publish all config management recipes • Get CloudStack Ansible module in core (e.g 2.0) • Expand Go client for be\er support in: – Terraform – Docker machine
• Define “stack” catalog to easily provision Hadoop, Storm, Spark clusters
![Page 10: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/10.jpg)
Events
• CloudStack Days – Aus1n – Sao Paulo – Tokyo, June 2 – Sea\le, August 20th
• CloudStack European Conference – Dublin October 8th – 9th
![Page 11: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/11.jpg)
Documenta1on
![Page 12: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/12.jpg)
Documenta1on
• New theme • Cleanup of old docs • Consolida1on of wiki pages • Re-‐think the doc structure • Be\er mul1-‐language support • All git based, mirrored on Github • Automa1cally built with Readthedocs.org
![Page 13: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/13.jpg)
Website
• Now moved to Git • Mirrored on GitHub and accep1ng pull requests
• Using middleman instead of apache CMS
Need an actual modern Design
![Page 14: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/14.jpg)
Engineering Roadmap Proposal
![Page 15: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/15.jpg)
On-‐Going Roadmap defini1on
h6p://s.apache.org/l6O
![Page 16: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/16.jpg)
Upgrade – e.g
• Database upgrade tools • Schema versioning • Agent upgrades • SystemVM upgrades • Rollback • Docs uprade
![Page 17: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/17.jpg)
Logging / Metrics – e.g
• Be\er error handling • Log processing • MDC system (logback) • Correla1on of resources in logs
![Page 18: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/18.jpg)
Storage –e.g
• Improve objet storage • Fix swig interface • Remove NFS dependency • Shared data disk • Snapshots on SAN • Migrate secondary storage
![Page 19: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/19.jpg)
Networking – e.g
• IPv6 • Network ACLs • Improve VR • API to VR • Extend VPC in physical nets • Reserved CIDR
![Page 20: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/20.jpg)
UI, API – e.g
• RBAC • 2 Factor auth • Annota1ons • SAML plugin • SSH key management in UI • Billing quota
![Page 21: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/21.jpg)
QA – e.g
• Be\er tests • Test environment • QA • Driver cer1fica1on • Crowdsource of QA • Performance
![Page 22: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/22.jpg)
Next
• These bug fixes and feature request will go to the community as a proposed roadmap
• Par1cipa1ng companies have already commi\ed to solving some of those items
![Page 23: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/23.jpg)
Architecture • Need for: – Be\er abstrac1ons between all layers – Contractualized guarantees between these layers
• To: – Coordinated access to resources with strong guarantees
– Opera1onal integrity – Higher feature velocity – Easily composable and configurable
![Page 24: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/24.jpg)
Architecture -‐e.g • Refactor management core • Refactor API server • Use embedded je\y • Use a YAML based config like cassandra and elas1csearch
• Persistence Layer – Remove DAO
There is a proposal for first steps to take
![Page 25: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/25.jpg)
Benefits • Simple configura1on and Upgrade • Even easier installa1on • Clean plugin framework • Decoupling of the code to help development • Pluggable implementa1ons (e.g database, network)
• Abstrac1on of compute (e.g containers, VMs) • Use of external resource allocators (e.g Mesos)
![Page 26: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/26.jpg)
A note on Docker
• Let’s package CloudStack as containers for easy deployment.
• CoreOS templates available for CloudStack
• Let’s not try to orchestrate containers
• Instead let’s embrace things like Kubernetes and maybe learn from it
![Page 27: The Future of Apache CloudStack](https://reader031.vdocuments.us/reader031/viewer/2022031923/58a1aaa81a28abd8728bf838/html5/thumbnails/27.jpg)
Thank you … Contribute, Share …
Sebas1en Goasguen
@sebgoa