Repository logo
 

An Event-Triggered Programmable Prefetcher for Irregular Workloads

Accepted version
Peer-reviewed

Type

Article

Change log

Authors

Abstract

jats:pMany modern workloads compute on large amounts of data, often with irregular memory accesses. Current architectures perform poorly for these workloads, as existing prefetching techniques cannot capture the memory access patterns; these applications end up heavily memory-bound as a result. Although a number of techniques exist to explicitly configure a prefetcher with traversal patterns, gaining significant speedups, they do not generalise beyond their target data structures. Instead, we propose an event-triggered programmable prefetcher combining the flexibility of a general-purpose computational unit with an event-based programming model, along with compiler techniques to automatically generate events from the original source code with annotations. This allows more complex fetching decisions to be made, without needing to stall when intermediate results are required. Using our programmable prefetching system, combined with small prefetch kernels extracted from applications, we achieve an average 3.0x speedup in simulation for a variety of graph, database and HPC workloads.</jats:p>

Description

Keywords

46 Information and Computing Sciences, 3301 Architecture, 33 Built Environment and Design

Journal Title

ACM SIGPLAN Notices

Conference Name

Journal ISSN

0362-1340
1558-1160

Volume Title

53

Publisher

Association for Computing Machinery (ACM)

Rights

All rights reserved
Sponsorship
Engineering and Physical Sciences Research Council (EP/K026399/1)
Engineering and Physical Sciences Research Council (EP/M506485/1)
EPSRC (1510365)