hue: the hadoop ui - where we stand, hue meetup sf

23
HUE+MEETUP WHERE WE STAND Romain Rigaux + Abraham Elmahrek Cloudera - Feb 5, 2014

Upload: gethue

Post on 26-Jan-2015

120 views

Category:

Technology


5 download

DESCRIPTION

Learn about all the new features of Hue 3.5+ that is included in Cloudera CDH 5. Presented in San Francisco @ Cloudera by Romain Rigaux and Abe Elmahrek

TRANSCRIPT

Page 1: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

HUE+MEETUP !

WHERE WE STANDRomain Rigaux + Abraham ElmahrekCloudera - Feb 5, 2014

Page 2: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

FROM

HUE 2

Page 3: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

VIA

HUE 3 MOCKUP

Page 4: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

TO

HUE 3.5+

Page 5: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW APPS

PIGJO

B BROWSER

JOB DESIG

NER

OOZIE

HIVE IMPA

LA

METASTO

RE BROWSERSEARCH

HBASE BROWSER

SQOOP

ZOOKEEPERUSER ADMIN

DB QUERY

SPARK

HOME ...

GUI DESIG

N

FILE BROWSER

USER

USER WORKFL

OWS

USER

Page 6: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

GROWINGCOMMUNITY

0

125

250

375

500

Posts

Jul 12 Aug 12 Sep 12 Oct 12 Nov 12 Dec 12 Jan 13 Feb 13 Mar 13 Apr 13May 13 Jun 13 Jul 13 Aug 13 Sep 13 Oct 13 Nov 13

0

17,5

35

52,5

70

Topics

hue-­‐user@

Page 7: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW IN HUETOP 5

UI REDESIGN  SPARK !

DBQUERYIMPALA / HIVE ONE PAGE EDITOR !

DOC MODEL

Page 8: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW

HIVE / IMPALA

One  page  app

Page 9: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW

SPARK

Brand  new  app

Page 10: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW

OOZIE++

Dozens  of  improvements

Page 11: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW

PROXY APP

Put  anything  inside  Hue!

Page 12: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW

SEARCH

Graphical  facets  rock.

Page 13: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

NEW

MANY OTHERS

More  than  1300  improvements  and  new  features  since  Hue  2.2

HiveServer  and  Impala  with  Sentry  Impala  and  Hive  Editor  are  one  page  app:  Editor,  Progress,  Table  list  and  Results  are  on  the  same  page  Result  graphing  in  Hive  and  Impala  Editors.  Editor  and  Dashboard  for  Oozie  SLA,  crontab  and  credentials  Sqoop2  apps  supports  autocomplete  of  databases  and  tables  names/fields  HBase  Browser  Zookeeper  Browser  Integrate  external  Web  applications  in  any  language  with  the  proxy  app  Create  Hive  tables  and  load  quoted  CSV  data  Submit  any  Oozie  jobs  directly  from  HDFS  SSO  with  Hue:  new  SAML  backend  OpenId,  OAuth  (community  contributions)  Yarn  applications  and  security  LDAP  File  Browser  autocomplete  ….

Page 14: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

DEMO TIME

Page 15: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

FAST PACE

LAST MONTH

91  issues  created  and  90  resolved.  Core  team  +  Community

Page 16: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

THE CORETEAM PLAYERS

team.gethue.com

ABRAHAM ELMAHREK

ROMAIN RIGAUX

ENRICO BERTI

CHANG BEER

Page 17: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

TALKS

Meetups  and  events  in  NYC,  Paris,  LA,  Tokyo,  SF,  Stockholm,  Vienna,  San  Jose… Coming  up  in  Budapest,  London,  West  coast

AROUNDTHE WORLD

RETREATS

Nov  13  Koh  Chang,  Thailand  May  14  Curaçao,  Netherlands  Anclles

Page 18: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

GET HUE

Try  in  advance  the  latest  and  greatest  but  you’ll  have  to  configure  everything  on  your  own.

Get  to  play  with  Hue  and  various  Hadoop  components  in  5  minutes.  It’s  a  self  contained  CDH  environment  ready  to  use.

Newer  version  than  HDP,  close  to  the  original  2.5  minus  apps  like  HBase,  Impala,  Sqoop,  Search.

The  newest  addicon,  ships  Hue  3.0  through  the  GreenBuhon  products.  

Stable  and  highly  tested  releases  perfectly  integrated  with  the  Hadoop  ecosystem,  automagically  configured  by  Cloudera  Manager.

In  HDP  there’s  an  old  forked  version  of  Hue  2.3.

CLOUDERA’S CDH TARBALL CLOUDERA’S DEMO VM

HORTONWORKS* MAPR* HP CLOUD*

* YOUR MILEAGE MAY VARY.

BIGTOP EMBEDDED/DEMO IN IND. COMPANIES

Page 19: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

ROADMAP

CDH  5  with  Hue  3.5+  more  Sentry,  Search,  Spark,  doc  model  

Hue  3.6  Graph,  export,  Spark  Streaming,  inter-­‐app…

Come  talk  to  us  about  your  use  cases  and  what  you  would  like  to  see  next  in  Hue!

CDH  5b2  with  Hue  3.5+  bonus  SQL,  JobBrowser,  FileBrowser

FEBRUARY 2014 MARCH 2014 Q2 2014

AFTER

Page 20: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

MISSEDSOMETHING?

learn.gethue.com

Page 21: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

LINKS

WEBSITE

hhp://gethue.com

BLOG

hhp://blog.gethue.com

TWITTER

@gethue

USER GROUP

hue-­‐user@

Page 22: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

WHAT ARE YOUR USE CASES?

WHICH COMPONENTS DO YOU USE?

WHAT WOULD YOU LIKE TO SEE IN HUE?

INTERESTED IN CONTRIBUTING? WANNA SAY HELLO? DO YOU WANT A TAILOR

MADE TEAM RETREAT?

TEAM@ GETHUE.COM

Page 23: Hue: The Hadoop UI - Where we stand, Hue Meetup SF

THANKS.

www.gethue.com