1 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Hortonworks Data Cloud for AWSField Awareness SessionNovember 4, 2016

2 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Introducing Hortonworks Data Cloud for AWS

Delivered and sold via AWS Marketplace Focuses on business agility, rather than

infinite configurability and cluster management

Addresses prescriptive, ephemeral use cases around Spark and Hive

Offers Pay-As-You-Go (PAYG) pricing “Optional Free Community Support”**

** Enterprise Support option coming soon

3 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Choose from Set of Prescriptive Cluster Types

4 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Product Architecture

cloudcontroller

(powered by Cloudbreak)

MasterNode

WorkerNode

WorkerNode

WorkerNode

MasterNode

WorkerNode

WorkerNode

WorkerNode

MasterNode

WorkerNode

WorkerNode

WorkerNode

Hortonworks Cloud - Product Architecture

HDP Cluster A

HDP Cluster B

HDP Cluster C

AMI-1 AMI-2 AMI-2 AMI-2 AMI-2

AMI-2 AMI-2 AMI-2 AMI-2

AMI-2 AMI-2 AMI-2 AMI-2

Docker

5 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Cluster Node Types

Master Node

Worker Node

- Ambari Server- Ambari Metrics Collector- HDP Master components (NameNode, ResourceManager,

HiveServer, etc)- Network Gateway

- Ambari Agent- Ambari Metrics Monitor- HDP Slave components (NodeManager, DataNode, etc)

2

6 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Hortonworks Data Cloud: Two AWS Marketplace Products

Name Description Components

Hortonworks Data Cloud – Controller Service

Initial Version: 1.8

Users run a single instance of this AMI in their AWS environment. It is the “cloud controller” for creating and managing HDP clusters.

- Operating System (Amazon Linux)- Cloudbreak- JDK (OpenJDK)- Database (PostgreSQL)- SmartSense

Hortonworks Data Cloud – HDP Services

Initial Version: 2.5

This AMI contains the Ambari + HDP software that becomes a cluster launched from the “cloud controller”.

- Operating System (Amazon Linux)- Ambari- HDP- JDK (OpenJDK)- Database (PostgreSQL)- SmartSense

• User must accept both product subscriptions in AWS Marketplace in order to create clusters

7 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Getting Started

Launch Cloud Controller

1Create

Cluster(s)

2Resize

Clone

Terminate

3

Subscribe to Products

0

8 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Launch Cloud Controller: Basic vs. Advanced

Basic Advanced

Cloud Controller Database Embedded PostgreSQL External Amazon RDS PostgreSQL

Cloud Controller VPC Creates New VPC + Subnet Uses Existing VPC + Subnet

Cluster VPC Options - Same VPC + New Subnet, or- Existing VPC + Subnet

- Same VPC + New Subnet, or- Existing VPC + Subnet

• Basic: Easiest approach, great for getting started but…• If you lose your controller instance, you lose your setup information.• No method to upgrade (to future releases).

• Advanced: For real deployments, stores controller setup information in external DB but…• Required more AWS knowledge to get started.

1

9 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Common Issues: First Time Access and SSL

This is not actually an issue…this is just the first time experience….– But user might be startled so this question might come up.

User needs to accept the SSL certificate when first accessing the cloud controller.

1

10 © Hortonworks Inc. 2011 – 2016. All Rights Reserved

Create Cluster: Hardware & Storage

Choose instance type for Master and Worker nodes Choose number of Worker node instances Advanced Option to customize storage per instance

2