what's new in kraken
TRANSCRIPT
What’s new in KrakenXSKYHaomai Wang
2016.12.09
Releases
• Hammerv0.94.x(LTS)– March '15• Infernalis v9.2.x– November'15• Jewelv10.2.x(LTS)– April'16• Krakenv11.2.x– December'16• Luminous v12.2.x(LTS)– April'17
RADOS -- BlueStore
• BlueStore =Block+NewStore• Key/value database(RocksDB)formetadata
• All datawritten directly to raw blockdevice(s)
• Inline compression(zlib,snappy,zstd)• ~2xfaster than FileStore
RADOS -- BlueStore
• Astable diskformat• Passing failureand stresstesting• Still flagged asexperimentfeature• Non-production and non-critical env
• Luminou• Remove experimentfeature• Full stable and readyfor broad usage
RADOS – Erasure Code Overwrite
• Experimentfeature• Diskformatand implementation arenotstable
• InitialRBDwithECOverwritetesting• Sequentialwriteperformancelooksgood!
• readssuffervs3xreplicationasexpected• smallrandomwritesalsosufferasexpected
RADOS – AsyncMessenger
• Newimplementationofnetworklayer• replacesagingSimpleMessenger• fixedsizethreadpool(vs2threadspersocket)• scalesbettertolargerclusters• morehealthyrelationshipwithtcmalloc• nowthedefault!
• Pluggablebackends• PosixStack – Linuxsockets,TCP(default,supported)
• Twoexperimentalbackends!
RADOS – AsyncMessenger
RADOS – AsyncMessenger Plugin
Ceph-MGR• ceph-monmonitordaemonscurrentlydoalot• morethantheyneedto(PGstatstosupportthingslike'df')• thislimitsclusterscalability
• ceph-mgr movesnon-criticalmetricsintoaseparatedaemon• thatismoreecient• thatcanstreamtographite,influxdb• thatcanefficientlyintegratewithexternalmodules(evenPython!)
• Goodhostfor• integrations,likeCalamariRESTAPIendpoint• comingfeatureslike'ceph top'or'rbd top’• high-levelmanagementfunctionsandpolicy
Ceph: QoS(DMClock)
• Setpolicyforboth• reserved/minimumIOPS• proportionalsharingofexcesscapacity• by• typeofIO(client,scrub,recovery)• pool• client(e.g.,VM)• BasedonmClock paperfromOSDI'10• IOscheduler• distributedenforcementwithcooperatingclients
RGW: Metadata Search
RGW: MISC
• Compression• SwiftstaticwebsiteAPI• S3 lifecycleAPI• CustomsearchfilterforLDAPauth• Python bindingforrgwfile
RBD: MISC
• Support erarsure codingpool• RBD Mirrorcansupportmetadatareplication• Rbd pythonapi supportsasync opeartions
CephFS: MISC
• Libcephfs enable properuid/gid control• Anew`pg_files`subcommandto`cephfs-data-scan`canidentifyfilesaffectedalostPG• Thefalse-positive"failingtorespondtocachepressure"warningshavebeenfixed• StandbyreplayMDSdaemonsnowconsumelessmemoryonworkloadsdoingdeletions• Scrubnowrepairsbacktrace,andpopulates`damagels` withdiscoverederrors.
Upgrade
• AllclustersmustfirstbeupgradedtoJewel10.2.zbeforeupgradingtoKraken11.2.z(or,eventually,Luminous12.2.z).
• NewMonwilluserocksdb asbackend
How To Help
微信公众号
了解XSKY 最新资讯,产品,信息,企业级解决方案,参加线上活动,请关注此公司官方微信公众号。
XSKY 微信公众号豪迈面向Ceph社区与开源爱好者,总结Ceph社区每周开发进展的最新资讯,更加偏重于研发与方向。
Ceph开发每周谈为企业级存储解决方案量身打造,结合福叔在数据存储与管理方面多年的经验,推荐业内以及企业级存储运维人员关注。
福叔讲存储
Thank you