training offering | dev-305 hortonworks … · training offering | dev-305 hortonworks ... this...

3

Click here to load reader

Upload: vukhuong

Post on 05-May-2018

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: TRAINING OFFERING | DEV-305 HORTONWORKS … · TRAINING OFFERING | DEV-305 HORTONWORKS ... This course provides a technical introduction to the fundamentals of Apache Storm ... Apache

TRAINING OFFERING | DEV-305 HORTONWORKS DATA PLATFORM (HDP®) DEVELOPER: APACHE STORM AND TRIDENT

2 DAYS

This course provides a technical introduction to the fundamentals of Apache Storm and Trident that includes the concepts, terminology, architecture, installation, operation, and management of Storm and Trident. Simple Storm and Trident code excerpts are provided throughout the course. The course also includes an introduction to, and code samples for, Apache Kafka. Apache Kafka is a messaging system that is commonly used in concert with Storm and Trident.

PREREQUISITES Students must have experience developing Java applications and using a Java IDE. Labs are completed using the Eclipse IDE and Gradle. Students should have a basic understanding of Hadoop.

TARGET AUDIENCE Hadoop developers who need to be able to design and build Storm and Kafka applications using Java and the Trident API.

FORMAT 50% Lecture/Discussion 50% Hands-0n Labs

AGENDA SUMMARY

Day 1: Real-Time Data Processing, Introduction to Storm Components, Installing and Configuring Storm Day 2: Storm Management, Kafka Programming, An Introduction to Trident

Page 2: TRAINING OFFERING | DEV-305 HORTONWORKS … · TRAINING OFFERING | DEV-305 HORTONWORKS ... This course provides a technical introduction to the fundamentals of Apache Storm ... Apache

About Hortonworks

Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact

For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405

© 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service

DAY 1 OBJECTIVES

• Identify Whether Storm Performs Batch or Real-Time Processing • Recognize Differences Between Batch and Real-Time Processing • List Reasons Why Companies Deploy Storm • Describe Storm Use Cases • Define the Terms Tuple, Stream, Topology, Spout, Bolt, Nimbus and Supervisor • Diagram the Relationship Between a Supervisor, Worker Process, Executor and a Task • Given the Java Code for a Topology, Diagram the Spout and Bolt Connections • Define the Purpose of a Stream Grouping • Perform a Storm Installation Using the Hortonworks Data Platform and Ambari • Given a List of Storm Configuration Sources, Order them By Precedence • Identify the Primary, Installation Specific Storm Configuration Files • Identify the URL Useful for Reading Storm Configuration Parameter Descriptions • List Differences Between Storm Local Mode and Distributed Mode • Identify Reasons to Use Storm Local Mode • Given a JAR File Name and the Package Name of a Topology, Build the Storm Command Necessary

to Submit the Topology to the Cluster • Given a Topology Code Example, Describe the Spout and Bolt Connections in the Topology • Identify the Purpose of the Muli-lang Protocol • Identify the Differences Between Reliable and Unreliable Operation • Diagram a Tuple Tree and Identify Its Branches • List Three Methods to Disable Reliable Operation

DAY 1 LABS

• Configuring a Storm Development Environment • Storm Word Count • Using Storm Multi-lang Support • Processing Log Files

Page 3: TRAINING OFFERING | DEV-305 HORTONWORKS … · TRAINING OFFERING | DEV-305 HORTONWORKS ... This course provides a technical introduction to the fundamentals of Apache Storm ... Apache

About Hortonworks

Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact

For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405

© 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service

DAY 2 OBJECTIVES

• List Tool Used to Manage and Monitor Storm • Display Online Help Using the Storm Command Line Client • Determine when it is Appropriate to Use the Storm List, Activate, Deactivate, Rebalance and Kill

Commands • Identify How to Open the Storm UI Console • Interpret the Metrics Displayed on the Storm UI Console • Recognize Use Cases for Kafka • Describe the Components of Kafka • Explain the Concept of a Topic Leader and Followers • Describe the Publication and Consumption of Kafka Messages • Define a New Kafka Topic • Configure and Instantiate a Kafka Spout for a Storm and Trident Topology • List Differences Between Storm and Trident • List Characteristics of a Trident Topology • List the Benefits of Batch Processing • Describe the Purpose and Operation of the Each Method • Describe the Purpose and Operation of a Trident Filter • Describe the Types of Aggregation Operations • List the Three Types of Trident States

DAY 2 LABS

• Integrating Kafka with Storm • Using Trident • Using Trident with Kafka

Revised 10/06/2017