cloudera manager meetup (july 11, 2013)
TRANSCRIPT
1
Cloudera Manager Meetup
July, 2013Palo Alto, CA
2
Agenda
©2013 Cloudera, Inc. All Rights Reserved.
Topic Time Speaker
Welcome/ Introduction 5 mins Bala Venkatrao
Overview of Cloudera Manager and demo of the latest release 30 mins Phil Zeyliger
Workflows - How CM makes it easier to manage the various Hadoop Operations (e.g High Availability setup, Rolling Upgrades, Decommissioning etc.)
30 mins Phil Langdale
API - How to extend and integrate CM into your existing infrastructure
30 mins BC
Q&A 30 mins All
©2013 Cloudera, Inc. All Rights Reserved.
Introduction
• Welcome!• Learn -> Use -> Feedback & Contribute!• Various ways to Contribute
• API wrappers, plug-in’s etc.• Charts libraries• Best Practices• “Parcels” for third-party libraries
3
Resources
• Cloudera Standard – FREE and provides the easiest option to get started with Hadoop• Includes several features for management, monitoring,
diagnosis and integration (API’s etc.)• Download from:
https://ccp.cloudera.com/display/SUPPORT/Downloads• Support available via [email protected] mailing lists
• Cloudera Quickstart VM’s• https://ccp.cloudera.com/display/SUPPORT/Cloudera+QuickStart+VM
• For Cloudera Enterprise – contact [email protected]
©2013 Cloudera, Inc. All Rights Reserved.4
Resources• Other valuable links
• CM community portal – Training, Docs, Videos, Blogs etc. http://www.cloudera.com/content/cloudera/en/developer-community/developer-admin-resources/cluster-management.html
• Cloudera Manager Blogs – http://blog.cloudera.com/blog/category/cloudera-manager/
• Cloudera GitHub - https://github.com/cloudera• Nagios plugins
• https://github.com/cloudera/cm_api/tree/master/nagios• https://github.com/harisekhon/nagios-plugins/blob/master/check_hadoop_cl
oudera_manager_metrics.pl• Charts scrapbook -
https://github.com/cloudera/cm_charting_scrapbook
©2013 Cloudera, Inc. All Rights Reserved.5
6
Agenda
©2013 Cloudera, Inc. All Rights Reserved.
Topic Time Speaker
Welcome/ Introduction 5 mins Bala Venkatrao
Overview of Cloudera Manager and demo of the latest release 30 mins Phil Zeyliger
Workflows - How CM makes it easier to manage the various Hadoop Operations (e.g High Availability setup, Rolling Upgrades, Decommissioning etc.)
30 mins Phil Langdale
API - How to extend and integrate CM into your existing infrastructure
30 mins BC
Q&A 30 mins All
©2011 Cloudera, Inc. All Rights Reserved.
7
What Cloudera Manager Does…
• Installation & Upgrade• Configuration• Process Supervision• Monitoring & Alerting• Diagnostics• Advanced Workflows• Auditing, Backup Tooling
©2013 Cloudera, Inc. All Rights Reserved.
8
©2013 Cloudera, Inc. All Rights Reserved.
9
Demo Time!
• Services, Hosts, Roles• Configuration• Health Checks• Custom Charting• Diagnostics
©2013 Cloudera, Inc. All Rights Reserved.
10
Why CM?
• Consistent, approachable model for diverse set of systems in CDH
• Benefit from Cloudera’s experience; make things “just work”
• Use fewer tools for the job• Get to work on your data problem already!
11
Agenda
©2013 Cloudera, Inc. All Rights Reserved.
Topic Time Speaker
Welcome/ Introduction 5 mins Bala Venkatrao
Overview of Cloudera Manager and demo of the latest release 30 mins Phil Zeyliger
Workflows - How CM makes it easier to manage the various Hadoop Operations (e.g High Availability setup, Rolling Upgrades, Decommissioning etc.)
30 mins Phil Langdale
API - How to extend and integrate CM into your existing infrastructure
30 mins BC
Q&A 30 mins All
12
Workflows
©2013 Cloudera, Inc. All Rights Reserved.
• Enabling HA for HDFS• Decommissioning a host• Expanding a cluster• Rolling Upgrade of CDH
13
Agenda
©2013 Cloudera, Inc. All Rights Reserved.
Topic Time Speaker
Welcome/ Introduction 5 mins Bala Venkatrao
Overview of Cloudera Manager and demo of the latest release 30 mins Phil Zeyliger
Workflows - How CM makes it easier to manage the various Hadoop Operations (e.g High Availability setup, Rolling Upgrades, Decommissioning etc.)
30 mins Phil Langdale
API - How to extend and integrate CM into your existing infrastructure
30 mins BC
Q&A 30 mins All
14
Topic 3
©2013 Cloudera, Inc. All Rights Reserved.
15
Appendix