what’s new in couchbase server 4 ne… · ©2015 couchbase inc. 4 disclaimer couchbase server 4.5...

What’sNewInCouchbaseServer4.5

ClarenceJMTauro,Ph.DSr.Instructor,Couchbase

©2015CouchbaseInc. 2

AbouttheSpeaker

▪  ClarenceJMTauro–[email protected]–  @javapsycheonTwiFer–  SeniorInstructor,Couchbase–  ~12YearsProfessionalTeachingandConsulLngExperience–  Ph.DinComputerSciencefromChristUniversity–  Hard-coreDoglover


BetaProgramforversion4.5

▪  Timeline–  1week(June17thorwhenweGAtheproduct)


Disclaimer

▪  CouchbaseServer4.5issLllunderdevelopmentinthebetaperiod.DetailspresentedheremaychangebasedoncustomerfeedbackandotherfactorsbytheLmethefinalversionoftheproductisreleased.


CouchbaseServer–theOperaEonalDBMSforweb,mobile,andIOTapplicaEons

CombinestheflexibilityofJSON,thepowerofSQL,andthescaleofNoSQL

DevelopwithAgility OperateatAnyScale

▪  FlexibleJSONdatamodel

▪  Dynamicschemasupport

▪  PowerfulquerylanguagethatextendsSQLtoJSON

▪  Sub-millisecondlatenciesatscale

▪  ElasLcscalingoncommodityservers

▪  Highavailability


TheJourneythusFar

FocusedonTechnicalInnovaLon

CouchbaseServer1.8

HighScaleKey/ValueDatabase

CouchbaseMobile1.0OfflineDataAvailabilityAuto-synchronizaLon

CouchbaseServer3.0

Mission-CriLcalScale&PerformanceSimplifiedAdministraLonImprovedHA/DR&Security

CouchbaseServer4.0SQL-likeQuerieswithNewSecondaryIndexing

MulL-DimensionalScalingArchitectureImprovedSecurity

CouchbaseServer2.0DocumentExtensions

NewXDCR

CouchbaseServer2.1EnhancedSecurity

HA/DR

CouchbaseServer2.2ImprovedXDCR

AdvancedStorageEngine


RecentAdvances–4.0

▪  CouchbaseServer4.0–  QueryandIndexing:

•  N1QLandNewGlobalSecondaryIndexing–  EnhancedClusterManagement

•  NewClusterZoneswithMulL-dimensionalScaling(MDS)–  EnhancedIntegraLons

•  NewODBC/JDBCDriverswithconnecLvitytoETLandBITools•  NewNaLve,SparkStreaming,SparkSQLandKaoaIntegraLon

–  EnhancedSecurity•  AudiLngandEnterpriseLDAPIntegraLon

–  EnhancedHighAvailability•  FasterXDCRandFilteringXDCR


RecentAdvances–4.1

▪  FasterQueries–  PreparedSQLExecuLonandCoveringIndexes

▪  DML–DataManipulaLonwithN1QL–  BulkDataOperaLonswithINSERT,UPDATEandDELETE


PreparedExecuEonandCoveringIndexes[Availablein4.1]

>3xfasterquerieswithpreparedexecuEonandcoveringindexes

QueryExecutionSteps

PreparedExecution

Ad-HocExecution

Parse CPUIntensiveSteps

Plan CPUIntensiveSteps

Scan

Fetch

Join

Filter

Aggregate

Sort

Offset

Limit

Project

NetworkIOIntensive NetworkIOIntensive

ExecuL

onTim

e


SimplifiedBatchDataUpdateswithN1QL[Availablein4.1]

▪  FullDMLSupportforSQLBasedUpdates–  SimplifiedDataMutaLonsinBulk

•  INSERTINSERT INTO bucket(key,value) VALUES(“doc_key”,{…});

•  UPDATEUPDATE bucket SET attribute = … WHERE type=“document type”;

–  Sample:CreateaCopyofaBucket

INSERT INTO new_bucket(key _k, value _v) SELECT meta().id _k, _v FROM original_bucket _v;

CouchbaseServerArchitectureOverview


Service-BasedArchitecture

QueryandIndexServicestobuildricherappsUnifiedProgrammingInterfaceandAdministraLon


Scale-uporScale-out

MulL-DimensionalScaling–IndependentScalingandWorkloadIsolaLon

What’sNewin4.5


Couchbase4.5-KeyFeatures

• Integratedqueryworkbenchwithauto-schemainference• ExtendedJOINsyntax• Integratedfull-textsearchqueries[preview]

EASIER,MOREEFFICIENTQUERYING

• EfficientRead/Writeofdatastructureswithsub-documentAPI

SIMPLER,MOREADVANCEDDATAACCESS

• FasterIndexingwithMemory-opEmizedindexes• ArrayindexingforfasterN1QLqueriesonarraysinJSON• ImprovedindexwriteperformancewithForestDB’scircularwrites

FASTER,MOREPOWERFULINDEXING

• Role-based-accesscontrolforadministrators&X.509cerLficatesforencryptedcommunicaLon• Queryprofilingandmonitoring• Fasterbackupandrestore

BETTER,MORECOMPREHENSIVEADMINISTRATION


SimplifiedDevelopment


QueryWorkbenchwithAutoCompleteforN1QL

NewIntegratedN1QLQueryWorkbenchTool(QWT)

N1QLEditorwithAuto-CompleLon&QueryHistory

DataWindowwithVisualTable,TreeandJSONOutput

BucketAnalyzerwithSmartSchemaInference


AutomaEcSchemaInferenceandAuto-CompleEon

▪  SmartSchemaInference:AutomaLcallyexaminessampleofdocumentsfrombucketsanddiscoversyourschema–  DocumentTypeDistribuLon–  ListofAFributes–  DataTypesforAFributes

BucketAnalyzerinWebConsole CBQCommandlineShell


Auto-CompletewithQueryEditor

▪  Auto-CompleLoninN1QLeditorprovides–  MatchingN1QLKeywords–  FieldNamesfromInferredSchema–  Addbackquotesfornameswithhyphen


ExtendedJOINs

▪  ExtendedJOINsforflexiblecrossdocumentoperaLons–  FasterJOINOperaLonswithONKEY…FORsyntax

SELECT * FROM `beer-sample` beer

JOIN `beer-sample` brewery ON KEYS beer.brewery_id

WHERE beer.type = "beer" AND brewery.type = "brewery" AND brewery.state =

"California";

JoinMeta(brewery).id=beer.brewery_id

IndexScan+Filtertype=“beer”

IndexScan+Filtertype=“brewery”

FilterBrewery.state=“California”

SELECT * FROM `beer-sample` brewery

JOIN `beer-sample` beer ON KEY beer.brewery_id FOR

brewery WHERE beer.type="beer" AND brewery.type="brewery" AND brewery.state="California";

Joinbeer.brewery_idin[Meta(brewery).id]

IndexScan+Filtertype=“beer”

IndexScan+FilterType=“brewery”

brewery.state=“California”

4.1

4.5


NewFlexibleJOINswithN1QL

7XfasterquerywithflexibleJOIN


Full-textSearchService[Preview]

Couchbase Query Couchbase Search Optimized for search queries Optimized for small queries

Many queries Each touches attribute data Search queries Each touches text within JSON

Oneplaeorm–Trulyintegratedsemi-structureddatamanagement



SearchtextdatainyourCouchbasedocuments▪  Powersearchboxesfordocumentcontents,websites,blogposts,Tweets,LckeLngandcatalogapps



▪  Benefits–  Fullycapablesearchservice,integratedinCouchbase–  ImmediatelyfamiliartousersofElasLcsearchandSolr–  CouchbaseadministraLonandmanagement

•  AutomaLcallyparLLoned,distributedandreplicated–  Noexternalsearchdependencies

•  Noneedtoprovisionhostsandinstallextraso|ware•  Avoiddatatransfersetupandsyncmanagement


ImprovedPerformanceandScale


EfficientSub-DocumentOperaEons

DocumentMutaEons:•  AtomicOperateon

individualfields•  IdenLcalsyntaxbehaviorto

regularbucketmethods(upsert,insert,get,replace)

•  SupportforJSONfragments.•  SupportforArrayswith

uniquenessguaranteesandordinalplacement(front/back)


FasterKeyBasedOperaEons!

10-14XFasterDocumentRead&UpdateOperaLon

95% Get Latency 95%SetLatency

95%Get&SetLatencyMeasured(Msecs)onsingleINTfieldupdatewithsub-documentvsfull-documentcall


Query:FindtheTop10MostAcLveUsersforMonthofAug

…

Q1AcLve@Jan2015

Q1:ExecuLonPlanonNnodes1.   ExecuteQ1onN1QLServicenode2.   ScanindexonIndexServicenode

12 …

Q1AcLve@Jan2015

Q1:ExecuLonPlanonNnodes1.   Scaier:ScaFerQ1toNnodes2.   Gather:GatherNresultsfromNnodes3.   Finalize:Re-AggregateQ1on1node

12 2 2 2 2

3

INDEXONCustomer_bucket(customer_name,total_logins.jan_2015)WHEREtype=“customer_profile”;

SELECTcustomer_name,total_logins.jan_2015FROMcustomer_bucketWHEREtype=“customer_profile”ORDERBYtotal_logins.jan_2015DESCLIMIT10;

GlobalIndexes(GSI) LocalIndexes(Views)


GlobalSecondaryIndexes

NewStorageOpEonsforGlobalSecondaryIndex1.  Memory-OpLmizedGlobalSecondaryIndexes(MOI)

•  OpEmizedforMemory:smallmemoryfootprint,opLmizedforlowestlatencyqueries•  FasterIndexing:freshindexesunderheavymutaLonswithlockfreeindex

maintenance•  PredictablelowlatencywithQueryandKeyBasedOperaEons,eveninpresenceof

largenumberofindexes

2.  StandardGlobalSecondaryIndexes

•  OpEmizedforStorage+Memory:efficientspilltodiskwithForestDBasthestorageengine

•  AdvancedIOPerformance:newcircularwritesthatminimizecompacLonoverheadofappendonlywrites


EfficientIOwithCircularWritesinStandardGSI

▪  ReducedDiskIORequirements–  Append-OnlyWriteswithfrequentfullcompacLon(Version4.1&Earlier)–  Circular-ReuseWriteswithreducedfullcompacLons(Newin4.5:)

•  Reusedorphanedblocksintheindexfile•  Reducetheneedforfrequentfull-compacLonsoftheindexfile

IndexMutaLon

Append-OnlyWriteCircularWrite

FileforGlobalSecondaryIndexes

IndexMutaLon

IndexMutaLon


ArrayIndexes--FasterSearchforNestedData

▪  EfficientlyIndexArraysCREATE INDEX … ON bucket(ARRAY i FOR i IN b END, a)

USING GSI;

▪  SampleQueries

SELECT * FROM default

WHERE ANY i IN b SATISFIES i<=1 END;

SELECT * FROM default X

UNNEST X.b Y

WHERE y<=1;

insertintodefault(key,value)values("1",

{"a":1,"b":[1,2],"c":{"ca":[1,2,3],"cb":4},"d":[

{"da":5,"db":6,“dc”:6.5},{"da":7,"db":8}],

"e":[{"ea":9,"eb":[10,11,12]},{"ea":13,"eb":[14,15,16]}],

"f":[[17,18],[19,20,21]]

});


HigherAvailability


EnterpriseBackupandRestore

>10xFasterBackups▪  BeFerDataProtecLonwithEnterpriseBackupRestore

–  Scaletolargerdatasets–  Fastbackupsandrestores–  BeFerConsistencyinbackupdata–  Resilienttofailures/TopologyChanges


SimplifiedSecurityCompliance


AdministraEveRoleBasedAccessControl

▪  AdministraLveRBACenablessegregaLonofadminduLes▪  AdministraLveuserscanbemappedtoout-of-the-boxroles▪  SeparaLonofsecurityadministraLonfromfulladministraLon▪  Rolespre-definedwithpermissionsforspecificresources

–  FullAdmin–  ClusterAdmin–  BucketAdmin–  ViewAdmin–  XDCRAdmin

FullAdmin

ClusterAdminBucketAdminViewAdminXDCRAdmin


EasyDevOps

©2014CouchbaseInc.

Achievingscale&availabilitywithCouchbase

©2014Couchbase,Inc. 37

▪  ScaleclusteronlinewithgrowingapplicaLonneeds,ondemand

▪  BuildalwaysavailableappswithreplicaLon&failover

▪  Removeprogrammingcomplexitybypushingshardingtothedatabase


Recap

• Integratedqueryworkbenchwithauto-schemainference• ExtendedJOINsyntax• Integratedfull-textsearchqueries[preview]

EASIER,MOREEFFICIENTQUERYING

• EfficientRead/Writeofdatastructureswithsub-documentAPI

SIMPLER,MOREADVANCEDDATAACCESS

• FasterIndexingwithMemory-opEmizedindexes• ArrayindexingforfasterN1QLqueriesonarraysinJSON• ImprovedindexwriteperformancewithForestDB’scircularwrites

FASTER,MOREPOWERFULINDEXING

• Role-based-accesscontrolforadministrators&X.509cerLficatesforencryptedcommunicaLon• Queryprofilingandmonitoring• Fasterbackupandrestore

BETTER,MORECOMPREHENSIVEADMINISTRATION


Thankyou!

QuesLons?

what’s new in couchbase server 4 ne… · ©2015 couchbase inc. 4 disclaimer couchbase server 4.5...

Documents