apache ambari bof - configs - hadoop summit 2013

9
© Hortonworks Inc. 2013 Ambari Configuration API June 25, 2013 Page 1

Upload: hortonworks

Post on 28-May-2015

912 views

Category:

Technology


5 download

DESCRIPTION

Apache Ambari BOF Meet Up @ Hadoop Summit 2013 Configs http://www.meetup.com/Apache-Ambari-User-Group/events/119184782/

TRANSCRIPT

Page 1: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

AmbariConfiguration API

June 25, 2013

Page 1

Page 2: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Agenda• Purpose• Types• Cluster• Host Overrides• Host Component / Actual

Page 2

Page 3: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Purpose• Provide ability to set any config parameter• Values used to populate configuration files in

/etc/hadoop/conf (core-site, hdfs-site, etc)• Mechanism to set and view configurations• Insight into host configuration state

Page 3

Page 4: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Types• Two main types: global and site• Global Configuration

–Values required by shell or puppet scripts–Denoted using specially named global type

• Site-specific Configurations–Used by Hadoop components for fine-tuning a cluster–Named using standard Hadoop types (core-site, hdfs-site, mapred-site,

etc)

Page 4

Page 5: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Cluster - Definition• All configurations stored with clusterGET /api/v1/clusters/c1/configurations?type=global&tag=version1{ "type": "global", "tag": "version1", "properties": { "a": "b", "c": "d" }}

• Uniqueness defined by type/tag combinations• Type is matched to Hadoop configuration names, but is not restricted

• Tag can be any string

Page 5

Page 6: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Cluster – Desired• Only One Desired per typeGET /api/v1/clusters/c1{ "Clusters": { "cluster_id": 1, "desired_configs": { "global": { "tag": "version1", "user": "admin" }, ... } }}

• Auditing username and timestamp

Page 6

Page 7: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Host Overrides – Desired• Mechanism to set specific host-level overrides• Only One Desired per type, like ClusterGET /api/v1/clusters/c1/hosts/h1{ "Hosts": { "cluster_name": "c1", "host_name": "h1", "desired_configs": { "global": { "tag": "custom-mapred", "user": "admin" }, ... } }}

Page 7

Page 8: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Host Components – Actual• Discreet information, per Host Component • Structure similar to Cluster/Host desiredGET /api/v1/clusters/c1/hosts/h1/host_components/DATANODE{ "HostRoles" : { "cluster_name" : "c1", "component_name" : "DATANODE", "actual_configs" : { "core-site" : { "tag" : "version1" }, "global" : { "tag" : "version1” } } }}

Page 8

Page 9: Apache Ambari BOF - Configs - Hadoop Summit 2013

© Hortonworks Inc. 2013

Thank You

Page 9