Re-architecting datacenter networks and stacks for low latency and high performance
SIGCOMM 2017 - Proceedings of the 2017 Conference of the ACM Special Interest Group on Data Communication
MetadataShow full item record
Handley, M., Raiciu, C., Agache, A., Voinescu, A., Moore, A., Antichi, G., & Wojcik, M. (2017). Re-architecting datacenter networks and stacks for low latency and high performance. SIGCOMM 2017 - Proceedings of the 2017 Conference of the ACM Special Interest Group on Data Communication, 29-42. https://doi.org/10.1145/3098822.3098825
© 2017 ACM. Modern datacenter networks provide very high capacity via redundant Clos topologies and low switch latency, but transport protocols rarely deliver matching performance. We present NDP, a novel datacenter transport architecture that achieves near-optimal completion times for short transfers and high flow throughput in a wide range of scenarios, including incast. NDP switch buffers are very shallow and when they fill the switches trim packets to headers and priority forward the headers. This gives receivers a full view of instantaneous demand from all senders, and is the basis for our novel, high-performance, multipath-aware transport protocol that can deal gracefully with massive incast events and prioritize traffic from different senders on RTT timescales. We implemented NDP in Linux hosts with DPDK, in a software switch, in a NetFPGA-based hardware switch, and in P4. We evaluate NDP's performance in our implementations and in large-scale simulations, simultaneously demonstrating support for very low-latency and high throughput.
This work was partly funded by the SSICLOPS H2020 project (644866).
European Commission Horizon 2020 (H2020) Industrial Leadership (IL) (644866)
External DOI: https://doi.org/10.1145/3098822.3098825
This record's URL: https://www.repository.cam.ac.uk/handle/1810/279206