aem communities 6.1 - mongosv '15

Using Mongo with Adobe AEM CommunitiesKevin Nennig | Corporate Technical Instructor

SERVICES2

Adobe Media Optimizer

Adobe Social

Adobe Target

Adobe Audience Manager

Adobe Experience Manager

Adobe Campaign

Adobe Analytics

Adobe Primetime

Adobe Marketing Cloud Solution

SERVICES3

Adobe Media Optimizer

Adobe Social

Adobe Target

Adobe Audience Manager

Adobe Experience Manager

Adobe Campaign

Adobe Analytics

Adobe Primetime

Adobe Marketing Cloud Solution

AEM Modules

Using Mongo in AEM

AEMTarM

MongoMK MSRP

Persistence of entire database

User generated content only

Using Mongo in AEM

MongoMK

Persistence of entire database

AEMTarM

User generated content only

Why use Mongo for AEM Communities?

• Flexible JSON document model• Efficient searching with indexing• Built in replication for high availability• Scaleable• High concurrent writes• Reduces operational overhead

Lets have a social opinion!

• http://mongosv.kevinnennig.com

• AEM Community with Mongo common store (MSRP)

• “Mongo Opinions” is based upon Yahoo Answers

• Sign up and give your opinion to a few questions!

Communities 6.1

Publish farms are preferred

1http://mongosv.kevinnennig.com

Content Replication

AEM Publish Farm

AEM Author

Content Replication

AEM Publish Farm

AEM Author

• Recommended approach

• Performance• Scalability on read

access• Failover• What about UGC?

Communities 6.1

1Replicating UGC

isn’t good enough

AEM Replication of UGC (earlier versions of AEM)

AEMPublish

Comment, rating, forum post

2 Stored in repositoryand in Replication Outbox

3 Check and fetch Outbox content

4 Workflow-based moderation and spam check

AEMAuthor

Replication toall publish

Internal Network DMZ

AEM Replication of UGC (earlier versions of AEM)• Everything has to go

through author• UGC is not immediately

available everywhere• Slow

AEMPublish

Comment, rating, forum post

2 Stored in repositoryand in Replication Outbox

3 Check and fetch Outbox content

4 Workflow-based moderation and spam check

AEMAuthor

Replication toall publish

Internal Network DMZ

Communities 6.1

1Replicating UGC

isn’t good enough

2Need to be Fast and consistent

The Solution:Common Store for UGC

http://mongosv.kevinnennig.com

Implementing the Common Store

• Social Resource Provider (SRP)• An API that abstracts the storage

• Implemented three different ways• MongoMK JCR SRP (JSRP)• Adobe SRP (ASRP)• Mongo SRP (MSRP)

JSRP: JCR Social Resource Provider

19AEM Author

• Publish instances are clustered with MongoMK

• Default storage mechanism• Easy to setup UGC• UGC is only available on publish

instances• Publish Farm is not utilized

MongoMK

AEM Publish

ASRP: Adobe Social Resource Provider

TAR TAR TAR

AEM Publish Farm

Adobe Social Cloud

AEM Author

• Recommended for managed UGC

• No setup needed• Integrates with Adobe

Social Analytics Pipeline and Moderation

• Fast

MSRP: Mongo Social Resource Provider

TAR TAR TAR

AEM Author

AEM Publish Farm

• Recommended for on prem UGC

• Required to setup a mongo replset and solr cloud

• Fast and scaleable

What’s stored in the Common Store?

• Contextual• Comments• Reviews• Ratings• Votes/Likes

Adobe Social Cloud

MongoMK

• Standalone • Forums• Calendars• File Sharing• Activities

What isn’t stored in the Common Store?

• External user accounts• External groups

• Community websiteAdobe Social Cloud

MongoMK

What isn’t stored in the Common Store?

• External user accounts• External groups

• Community websiteAdobe Social Cloud

MongoMK

Replicated among publish instances but not author

Replicated from the author instance to publish farm

Comparing SRP

Adobe Social CloudMongoMK

Social Resource Provider

JSRP ASRP MSRP

Microkernel MongoMK TarMK TarMKSite Content Repository

Publish Server Publish Server Publish Server

UGC Repository Publish Server Adobe Social Cloud

MongoDB

When it should be used?

Default storage. Not recommended for production,

only development.

Customers using the ASC or who do

not want to support the

infrastructure

Requirements of data being on

prem or a company wants to

own the entire stack

Dispatcher

UGC is dynamic content.

Can it work with Dispatcher?

Dispatcher

AEM Publish Farm

AEM Author

Dispatcher

AEM Publish Farm

Dispatcher

GET PathWithComments.html

200 <html/>

GET /bin/service/userinfo.json

200 { “user” : “info” } User info

Performance increase using Mongo SRP

“Mixed transactions” test case: Based on customer data

Reverse Replication JSP components (deprecated in 6.0) CRX2 2 node active/passive cluster 5 transactions per second

Performance increase using Mongo SRP

“Mixed transactions” test case: Based on customer data

Reverse Replication JSP components (deprecated in 6.0) CRX2 2 node active/passive cluster 5 transactions per second

Mongo SRP SCF components MSRP 4 node farm Dispatcher 100 tps per instance

Setting up MSRP

AEM Author 27019

2701827017

AEM Publish Farm

AEM Author 27019

2701827017

Database: msrp-communities

Collection: collection1

AEM Publish Farm

Starting a replset Mongo

Start Mongo ServersmongoServer1$ mongod --bind_ip nennig-osx.local --logpath logs/mongo.log --dbpath db --replSet aem --port 27017

mongoServer2$ mongod --bind_ip nennig-osx.local --logpath logs/mongo.log --dbpath db --replSet aem --port 27018

mongoServer3$ mongod --bind_ip nennig-osx.local --logpath logs/mongo.log --dbpath db --replSet aem --port 27019

Create the Replica Set Connect to the mongodb you want to be Primary$ mongo nennig-osx.local:27017>

Initialize the Replica Set> rs.initiate()

{"info2" : "no configuration explicitly specified -- making one",

"me" : "nennig-osx.local:27017","info" : "Config now saved locally. Should come online in about a minute.",

"ok" : 1}aem:PRIMARY> rs.conf()

{"_id" : "aem",

"members" : [{

"_id" : 0,"host" : "nennig-osx.local:27017"

Initialize the Replica Set> rs.initiate()

{"info2" : "no configuration explicitly specified -- making one",

"me" : "nennig-osx.local:27017","info" : "Config now saved locally. Should come online in about a minute.",

"ok" : 1}aem:PRIMARY> rs.conf()

{"_id" : "aem",

"members" : [{

"_id" : 0,"host" : "nennig-osx.local:27017"

You can also use:rs.status()This will show the current status of each server including who’s PRIMARY/SECONDARY

Add membersaem:PRIMARY> rs.add(“nennig-osx.local:27018”){ "ok" : 1 }aem:PRIMARY> rs.add(“nennig-osx.local:27019”){ "ok" : 1 }

aem:PRIMARY> rs.conf(){

"_id" : "aem","version" : 3,"members" : [{"_id" : 0,"host" : "nennig-osx.local:27017"},{"_id" : 1,"host" : "nennig-osx.local:27018"},{"_id" : 2,"host" : "nennig-osx.local:27019"}]

Start the Solr Server

Download config files from the AEM server Start the Solr Server with the conf files on port 8983solrServer$ java –jar start.jar

Configure the Social Resource Provider on AEM

Q&AKevin Nennig

nennig@adobe.com

Slideshare: http://www.slideshare.net/KevinNennig/aem-communities-61-mongosv-15 Community Topologies: https://docs.adobe.com/docs/en/aem/6-1/deploy/communities/topologies.html MSRP: https://docs.adobe.com/docs/en/aem/6-1/administer/communities/srp/msrp.html

aem communities 6.1 - mongosv '15

Technology

aem hub 2014: aem 5.6.1 e-commerce integration

aem & apache slingŒauš... · sling models apache sling ....

aem & ecommerce integration

aem gems session saml authentication in aem

aem portfolio_apload

statistics aem holdings (aem sp) 52w high/low (sgd) buy

mongosv 2011 - replication

cop with aem

mongosv schema workshop

mongodb, hadoop and humongous data - mongosv 2012

aem manual

march atace session: unit testing with aem mocks · unit...

circuit 2015 - ui customization in aem 6.1

ask the aem community expert feb 2016 session: aem +...

adaptto() 2018 - upgrading an aem cluster using docker ·...

ph aem overview

aem lect11

aem evernote sync

aem and sling

aem tutorials