marklogic on awsmarklogic is an advanced aws partner. marklogic developer 8 and 9 and marklogic...

24
13 June 2019 © MARKLOGIC CORPORATION MarkLogic on AWS Wilfred Justin AWS – Principal Kiran Kamreddy Principal Product Manager Matt Sun Manager, Staff Engineer MarkLogic MarkLogic Amazon Web Services

Upload: others

Post on 21-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

13 June 2019© MARKLOGIC CORPORATION

MarkLogic on AWS

Wilfred JustinAWS – Principal

Kiran KamreddyPrincipal Product Manager

Matt SunManager, Staff Engineer

MarkLogic MarkLogicAmazon Web Services

Page 2: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

CORE SERVICES

Integrated Networking

Rules Engine

Device Shadows

Device SDKs

Device Gateway

Registry

Local Compute

Custom ModelTraining & Hosting

Conversational Chatbots

Virtual Desktops

App Streaming

Schema Conversion

Image & Scene Recognition

Sharing & Collaboration

Exabyte-ScaleData Migration

Text to Speech

Corporate EmailApplication Migration

Database Migration

Regions

Availability Zones

Points of Presence

Data Warehousing

Business Intelligence

Elasticsearch

Hadoop/Spark

Data Pipelines

Streaming Data Collection

ETLStreaming Data Analysis

Interactive SQL Queries

Queuing & Notifications

Workflow

Email

Transcoding

Deep Learning(Apache MXNet, TensorFlow, & others)

Server MigrationCommunications

MARKETPLACE

Business AppsBusiness Intelligence DevOps Tools Security Networking StorageDatabases

The picture can't be displayed.

API Gateway

Single Integrated Console

Identity

Sync

Mobile Analytics

Mobile App Testing

Targeted Push Notifications

One-click App Deployment

DevOps Resource Management

Application Lifecycle Management

Containers

Triggers

Resource Templates

Build & Test

Analyze & Debug

Identity Management

Key Management & Storage

Monitoring & Logs

Configuration Compliance

Web Application Firewall

Assessment& Reporting

Resource & Usage Auditing

Access Control

Account Grouping

DDOSProtection

TECHNICAL & BUSINESS SUPPORT

Support ProfessionalServices

Optimization Guidance

PartnerEcosystem

Training & Certification

Solutions Management

Account Management

Security & Billing Reports

Personalized Dashboard

Monitoring

Manage Resources

Data Integration

Integrated Identity & Access

Integrated Resource & Deployment Management

Integrated Devices& Edge Systems

Resource Templates

Configuration Tracking

Server Management

Service Catalogue

Search

MIGRATIONHYBRID ARCHITECTURE

ENTERPRISE APPS

MACHINE LEARNINGIoTMOBILE SERVICESDEV OPSANALYTICS

APP SERVICES

INFRASTRUCTURE SECURITY & COMPLIANCE MANAGEMENT TOOLS

ComputeVMs, Auto-scaling, Load Balancing, Containers, Virtual Private Servers, Batch Computing, Cloud Functions, Elastic GPUs, Edge Computing

StorageObject, Blocks, File, Archivals, Import/Export, Exabyte-scale data transfer

CDN

DatabasesRelational, NoSQL, Caching, Migration, PostgreSQL compatible

NetworkingVPC, DX, DNS

Facial Recognition & Analysis

Facial Search

Patching

Contact Center

The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed.The picture can't be displayed.

The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed. The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

The picture can't be displayed.

M O S T R O B U S T, F U L LY F E AT U R E D T E C H N O L O G Y I N F R A S T R U C T U R E

P L AT F O R M

Page 3: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Security is No.1 Priority at AWSComprehensive Security Capabilities to Support Virtually Any Workload

People & Procedures

Network Security

Physical Security

Platform Security

Page 4: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Cloud Security is a Shared Responsibility

Cross-service Controls

Service-specific Controls

Compliance of the Cloud

Compliance in the Cloud

Cloud Service Provider Controls

Optimized Network/OS/App Controls

https://aws.amazon.com/[email protected]

• Customers and Partners implement their own Application and Service controls

• Multiple customers with• FISMA ATOs• DIACAP ATOs• DoD P-ATO

• SAS-70 Type II• SOC 1 and 2• ISO 27001/ 2 Certification• Payment Card Industry (PCI)• Data Security Standard (DSS)• NIST Compliant Controls• DoD Compliant Controls• FedRAMP Compliant Controls • HIPAA and ITAR Compliant

Page 5: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

The Infrastructure platform for MarkLogic

Agility: Try more, fail fast, go big or start small, and process data at any scale

Scalability: Run jobs any time, without guessing capacity or limiting functionality

Get to Insights Faster: Focus on data science not the heavy undifferentiated lift of managing raw data

Broadest and Deepest Capabilities: Access 70+ managed Big Data services to address any workload

Low Cost: Pay only for the IT you use, when you use it

Data Migrations Made Easy: Move exabyte-scale data to the cloud quickly and cost-effectively

Page 6: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

AWS and MarkLogic

MarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential

Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward is to offer their platform as

a Service. MarkLogic’s Software-as-a-Service offerings the MarkLogic Query

Service and now the MarkLogic Data Hub Service – are available on AWS Marketplace.

We will continue to work together and innovate for the benefit of our enterprise customers.

.

Page 7: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Why MarkLogic in the cloud?

Page 8: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Motivations for Moving to Cloud Easier/faster to deploy

Scalability and Elasticity

Capacity on demand

Pay-as-you-go consumption model

Lower over TCO with less hardware and other capital expenses

Page 9: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Support for manual deployments

Pre-built AMIs (for single node deployments) and CloudFormation Templates (for clustering)

- Developer and BYOL options

- Templates on GitHub for Customization

All of the MarkLogic features

Leverage AWS Ecosystem for Lambdas, CloudWatch, API Gateway, etc.

MarkLogic in AWS

Page 10: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Faster, Better, More Secure on AWS

Faster and More SecureCloud Formation Templates for

existing/new VPCAWS KMS Native Support

Faster and BetterOne-click AMI on Marketplace,

Globally Available

Page 11: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

What’s New with MarkLogic on AWS

New reference architecture: public subnets + private subnets + NAT Gateway

New generation instance type: R5, R5a, R5d, R5ad, I3.metal, M5a, M5ad

Amazon Linux 2 base Image

GPU Enhanced AMI

EBS Volume encryption option and custom encryption key

S3 Support ELB Support Rolling Upgrades HA/DR

Tiered Storage Manageability Security Features

Page 12: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

As a Service

Automation

Scaling

High Availability

Manageability

Configuration

Deployment

Infrastructure sizing

Continuous Innovation in AWS

Page 13: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

MarkLogic Data Hub Service

Cloud ServiceData Hub

Data Hub automation Cost-effective in the cloud Reliability in the cloud

Fast data integration and curation Simplicity of a unified platform Data governance and security

Page 14: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Dev and testFaster to deploy and get started, lower costs

Hybrid cloudExtend your on-prem with cloud

Backup & ArchivesCost effectively secure and restore your data from ad hoc failures

Global availabilityServe applications locally across the global regions with global AWS backends

Disaster recoveryEnsure business continuity by fail-proofing critical systems

High burst workloadsHighly responsive apps with rapid elasticity requirements

MarkLogic Deployment Use Cases

Page 15: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

MarkLogic in AWS 9+ years of cloud success

Significant cloud customer and developer usage

Documentation and video resources to assist in your cloud strategyAWS

Page 16: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Successful AWS Migrations

45 racks, 4 clusters, 38 DBs, 1.2 billion documents, 1.4 PB storage, 57 TB RAM, 15k compute cores

iPlayer - 6 node cluster, 1 PB storage, 3 billion requests per year

SNL 40 App - 100 million views first 3 months, 50k requests per minute

3 AWS regions in US, EU, and Asia

2 6-node clusters, each r34x.large, 16 VCPUs each, 8TB

Page 17: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Deep Dive

Reference Architecture Live Demo Best Practice

Page 18: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Reference Architecture Quick start for production cluster example

Configurable cluster settings

New VPC / existing VPC

Multiple nodes / single nodes

Multiple zones / single zone

License: Developer / Pay-as-You-Go / BYOL

Highly customizable

Page 19: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward
Page 20: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward
Page 21: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Demo

Page 22: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

To deploy clusters, get started with MarkLogic CloudFormation templates

Customize templates based on business needs. Templates are open sourced on GitHub repository (cloud-enablement-aws)

Use MarkLogic published Marketplace AMIs for custom deployment

Use new generation of EC2 instance types

Using same templates to do Rolling Upgrades

Best Practices

Page 23: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Get Started

developer.marklogic.com/products/cloud/aws

Page 24: MarkLogic on AWSMarkLogic is an advanced AWS partner. MarkLogic Developer 8 and 9 and MarkLogic Essential Enterprise 8 and 9 are available in AWS Marketplace. The strategy going forward

Thank you