Repository logo
 

Re-architecting datacenter networks and stacks for low latency and high performance

Accepted version
Peer-reviewed

Type

Conference Object

Change log

Authors

Handley, M 
Raiciu, C 
Agache, A 
Voinescu, A 
Moore, AW 

Abstract

© 2017 ACM. Modern datacenter networks provide very high capacity via redundant Clos topologies and low switch latency, but transport protocols rarely deliver matching performance. We present NDP, a novel datacenter transport architecture that achieves near-optimal completion times for short transfers and high flow throughput in a wide range of scenarios, including incast. NDP switch buffers are very shallow and when they fill the switches trim packets to headers and priority forward the headers. This gives receivers a full view of instantaneous demand from all senders, and is the basis for our novel, high-performance, multipath-aware transport protocol that can deal gracefully with massive incast events and prioritize traffic from different senders on RTT timescales. We implemented NDP in Linux hosts with DPDK, in a software switch, in a NetFPGA-based hardware switch, and in P4. We evaluate NDP's performance in our implementations and in large-scale simulations, simultaneously demonstrating support for very low-latency and high throughput.

Description

Keywords

Datacenters, Network Stacks, Transport Protocols

Journal Title

SIGCOMM 2017 - Proceedings of the 2017 Conference of the ACM Special Interest Group on Data Communication

Conference Name

SIGCOMM '17: ACM SIGCOMM 2017 Conference

Journal ISSN

Volume Title

Publisher

ACM
Sponsorship
European Commission Horizon 2020 (H2020) Industrial Leadership (IL) (644866)
This work was partly funded by the SSICLOPS H2020 project (644866).