Repository logo
 

Online Event Processing: Achieving Consistency Where Distributed Transactions Have Failed

Accepted version
Peer-reviewed

Type

Article

Change log

Authors

Beresford, Alastair R  ORCID logo  https://orcid.org/0000-0003-0818-6535
Svingen, Boerge 

Abstract

Distributed transactions have failed as a mechanism for ensuring consistency across heterogeneous storage technologies in today's large-scale applications. Instead, we are witnessing the emergence of a programming model that relies on append-only event logs rather than transactions, and which we call OnLine Event Processing (OLEP) in contrast to OLTP. In this article we show that, although an event log is a very simple abstraction, applications that rely on such logs can efficiently provide strong consistency guarantees, such as atomicity and enforcing invariants, which are normally associated with ACID transactions. We provide case studies from real industrial data systems that have adopted the OLEP approach, demonstrating the practical advantages of building upon event logs.

Description

Keywords

4605 Data Management and Data Science, 4606 Distributed Computing and Systems Software, 46 Information and Computing Sciences

Journal Title

Communications of the ACM

Conference Name

Journal ISSN

1557-7317
1557-7317

Volume Title

62

Publisher

Association for Computing Machinery (ACM)
Sponsorship
The Boeing Company