Show simple item record

dc.contributor.authorGog, Ionelen
dc.contributor.authorSchwarzkopf, Malteen
dc.contributor.authorGleave, Aen
dc.contributor.authorWatson, Roberten
dc.contributor.authorHand, Sen
dc.date.accessioned2017-05-19T11:12:30Z
dc.date.available2017-05-19T11:12:30Z
dc.date.issued2016-11-04en
dc.identifier.isbn978-1-931971-33-1en
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/264317
dc.description.abstractCentralized datacenter schedulers can make high-quality placement decisions when scheduling tasks in a cluster. Today, however, high-quality placements come at the cost of high latency at scale, which degrades response time for interactive tasks and reduces cluster utilization. This paper describes Firmament, a centralized scheduler that scales to over ten thousand machines at sub- second placement latency even though it continuously reschedules all tasks via a min-cost max-flow (MCMF) optimization. Firmament achieves low latency by using multiple MCMF algorithms, by solving the problem incrementally, and via problem-specific optimizations. Experiments with a Google workload trace from a 12,500-machine cluster show that Firmament improves placement latency by 20 x over Quincy [22], a prior centralized scheduler using the same MCMF optimiza- tion. Moreover, even though Firmament is centralized, it matches the placement latency of distributed schedulers for workloads of short tasks. Finally, Firmament exceeds the placement quality of four widely-used central- ized and distributed schedulers on a real-world cluster, and hence improves batch task response time by 6 x.
dc.description.sponsorshipThis work was supported by a Google European Doc- toral Fellowship, by NSF award CNS-1413920, and by the Defense Advanced Research Projects Agency (DARPA) and Air Force Research Laboratory (AFRL), under contract FA8750-11-C-0249.
dc.languageengen
dc.language.isoenen
dc.publisherUsenix
dc.titleFirmament: Fast, Centralized Cluster Scheduling at Scaleen
dc.typeConference Object
prism.endingPage115
prism.publicationDate2016en
prism.publicationNameSymposium on Operating Systems Design and Implementationen
prism.startingPage99
dc.identifier.doi10.17863/CAM.9784
dcterms.dateAccepted2016-06-30en
rioxxterms.versionAMen
rioxxterms.licenseref.urihttp://www.rioxx.net/licenses/all-rights-reserveden
rioxxterms.licenseref.startdate2016-11-04en
rioxxterms.typeConference Paper/Proceeding/Abstracten
dc.identifier.urlhttps://www.usenix.org/conference/osdi16/technical-sessions/presentation/gogen
pubs.conference-name12th USENIX Symposium on Operating Systems Design and Implementationen
pubs.conference-start-date2016-11-02en


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record