Hakuna MapData! » luigi

JobTracker slowness, guesstimation and a data-driven answer

| Posted in Monitoring, Troubleshooting |


JobTracker slowness issue

The problem

A couple of weeks ago, we got a JIRA ticket complaining about JobTracker being super slow (while it used to be super snappy most of the time). Obviously in such a situation, developers and analysts are a bit annoyed because it results in difficulties in submitting and tracking status of MapReduce jobs (however, the side effect is having a time for unplanned coffee break, what should not be so bad ;)) Anyway, we are also a bit ashamed and sad, because we aim for a perfect Hadoop cluster and no unplanned coffee breaks interruptions.