High availability, elasticity, and strong consistency for massively parallel scans over relational data
Open access
Datum
2014-08Typ
- Journal Article
ETH Bibliographie
yes
Altmetrics
Abstract
An elastic and highly available data store is a key component of many cloud applications. Existing data stores with strong consistency guarantees are designed and optimized for small updates, key-value access, and (if supported) small range queries over a predefined key column. This raises performance and availability problems for applications which inherently require large updates, non-key access, and large range queries. This paper presents a solution to these problems: Crescando/RB; a distributed, scan-based, main memory, relational data store (single table) with robust performance and high availability. The system addresses a real, large-scale industry use case: the Amadeus travel management system. This paper focuses on the distribution layer of Crescando/RB, the problem and theory behind it, the rationale underlying key design decisions, and the novel multicast protocol and replication framework it is composed of. Highlighting the key features of the distribution layer, we present experimental results showing that even under permanent node failures and large-scale data repartitioning, Crescando/RB remains fully available and capable of sustaining a heavy query and update load. Mehr anzeigen
Persistenter Link
https://doi.org/10.3929/ethz-b-000075245Publikationsstatus
publishedExterne Links
Zeitschrift / Serie
The VLDB JournalBand
Seiten / Artikelnummer
Verlag
SpringerThema
Scan-only query processing; Dynamic partial replication; High availability; Atomic multicastOrganisationseinheit
03506 - Alonso, Gustavo / Alonso, Gustavo
03689 - Kossmann, Donald (ehemalig)
ETH Bibliographie
yes
Altmetrics