Toggle Menu

<-- Back to schedule

A Detailed Look at Erasure Codes in OpenStack Swift

Project: OpenStack Swift

OpenStack Swift has recently implemented erasure codes as a way to durably stored data. In this talk we'll start with a very brief overview of Swift and erasure codes and quickly move on to a detailed look at the implementation the erasure code feature. First we will cover the simple read/write data path. Then we'll move into some interesting challenges the community faced when implementing the feature, and how they were solved. We'll go over how Swift, an eventually-consistent (AP) system, does a multi-phase commit. We'll show where Swift uses two-dimensional time to handle failures and reach a steady-state. Swift's supports multiple external erasure code libraries, and we'll review the different ones available. There will be code. There will be performance graphs. There will be math. Come learn how we have implemented this feature in Swift and why it's such a big deal.

John Dickinson

John Dickinson is Project Technical Lead for OpenStack Swift. He was on the team that originally wrote Swift, and he's been part of the OpenStack project since it began. John's daily work involved writing code, doing code reviews, and managing the global Swift community. After working on Swift daily for six years, John's vision remains the same: that everyone, everywhere will use Swift every day, even if they don't realize it.


Geelong 2016

Our Emperor Penguin Sponsors

Geelong

About Geelong

Geelong is Victoria's second largest city, located on Corio Bay, and within a short drive from popular beach-front communities on the Bellarine Peninsula as well as being the gateway to the famous Great Ocean Road

More Info »

linux.conf.au

linux.conf.au

linux.conf.au is widely regarded by delegates as one of the best community run Linux conferences worldwide and is the largest Linux and Open Source Software conference in the Asia-Pacific.

Read More »

Sponsorship

Sponsorship

Our Sponsors help make linux.conf.au become the awesome conference everyone comes back to year after year. Come see who's on board this year, or find out how to get in contact with us

Sponsorship »