help! my hadoop doesn't work!
DESCRIPTION
How to report a bug in apache hadoop -and when not toTRANSCRIPT
© Hortonworks Inc. 2014
Steve Loughran– Hortonworksstevel at apache.org@steveloughran
January 2014
Help! My Hadoop doesn't work!
© Hortonworks Inc. 2014Page 2
Reporting bugs inApacheTM HadoopTM
© Hortonworks Inc.
Terminology
JIRAAn issue (bug or feature request) in the JIRA database, referenced by its ID, i.e. HADOOP-8545
Feature Request
A proposal for adding something new to the codebase. Implicit promise to implement the feature.
Bug
A flaw in the Hadoop codebase which causes it to not behave as planned –in a well configured cluster.
Page 3
© Hortonworks Inc.
Is it a Bug? Probably Not
• Look at your own code• Look at the logs and any stack traces• Follow any URLs in the exception messages• Search for the exception messages• Commercial Big Data Stacks:use their tools, forums, support services
• Before filing: ask on [email protected]
Invalid issues will be closed:
http://wiki.apache.org/hadoop/InvalidJiraIssues
Page 4
© Hortonworks Inc.
Tools
• Hadoop Documentation, Javadocs, Wiki
• Books
• Network tools: ping, telnet, nslookup, ifconfig
• Browsers & search engines
• Stack traces
• kill -QUIT
• Hadoop source code
• Dev tool chain: svn, mvn, git, patch, JDK
Page 5
© Hortonworks Inc. 2014
Be able to start a Minecraft server before trying to bring up a Hadoop cluster
Page 6
© Hortonworks Inc.
Apache JIRA
https://issues.apache.org/jira
Page 7
© Hortonworks Inc. 2014
DEMO 1: Bad JIRAHADOOP-10226
Page 8
© Hortonworks Inc.
Don't
• File “critical” issue when it is just your server not working.• File the same issue repeatedly.• File issues against non ASF-releases• File bug reports against old releases• Include confidential information in emails or bug reports (including stack traces).
• Send “help!” emails to development lists or developers• Send those “help!” emails every 15 minutes
Page 9
© Hortonworks Inc. 2014
DEMO 2: Good JIRAHADOOP-10227
Page 10
© Hortonworks Inc.
Special Case: Security Bugs
Report security bugs to [email protected]
These get fixed before being announced
Kerberos not liking you is not a bug
Page 11
© Hortonworks Inc.
What happens to an issue?
• People who care about it will fix it when they have time.
• You are probably the person who cares the most.
• You may be the only person who can replicate it
• You are the best placed person to fix it.
• No fix will ship until a new major/minor Hadoop release.
• So come up with a workaround!
Page 12
© Hortonworks Inc.
Summary
• Apache JIRA is for reporting bugs in ASF code• Search for the problem on the web & in JIRA first.• Ask for help via user@hadoop or support channels• Replicate in most recent release• Create an informative JIRA
Then one of
1. Wait
2. Provide a fix with tests
Either way: a workaround is the only timely solution
Page 14
© Hortonworks Inc. 2014
How do I fix a bug?To follow…
Page 15