ApacheCon 2016 has ended
Back To Schedule
Thursday, May 12 • 9:00am - 9:50am
Flaky Tests and Bugs in Apache Softwares (e.g. Hadoop) - Akihiro Suda, NTT Corp.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Apache softwares are well tested.
Each of them has as many LOC of xUnit test codes as production codes, and the test codes are run frequently on Apache Buildbot.

However, unfortunately these xUnit tests tend to be "flaky". i.e. they can fail non-deterministically.
Even when tests are flaky on Buildbot, it is hard to debug for developers because failure cannot be reproduced by just running tests repeatedly.
So flaky tests can be a very troublesome threat for quality assuarance of Apache softwares.

In this presentation, Akihiro Suda will show the "flakiness" of several Apache softwares (e.g. Hadoop), and discuss why they are so flaky.

Additionally, he will also introduce his open-source debugging tool, named "Earthquake".
This tool can easily reproduce failures of flaky tests by increasing the non-deternimism of the thread scheduling for unmodified xUnit tests.

avatar for Akihiro Suda

Akihiro Suda

Software Engineer, NTT
Akihiro Suda is a software engineer at NTT Corporation, a Japan-based telecommunication company. He has been a core maintainer of Moby (former Docker Engine) since November 2016. He has been also a maintainer of several opensource container software such as Moby, BuildKit, containerd... Read More →

Thursday May 12, 2016 9:00am - 9:50am
Regency C

Attendees (7)