Show simple item record

dc.contributor.author
Willi, Roman A.
dc.contributor.supervisor
Barthels, Claude
dc.contributor.supervisor
Müller, Ingo
dc.contributor.supervisor
Alonso, Gustavo
dc.date.accessioned
2018-01-03T10:06:08Z
dc.date.available
2017-12-21T10:14:14Z
dc.date.available
2018-01-03T10:06:08Z
dc.date.issued
2017-12-21
dc.identifier.uri
http://hdl.handle.net/20.500.11850/223924
dc.identifier.doi
10.3929/ethz-b-000223924
dc.description.abstract
In this thesis, we present a novel, extensible RDMA database operator interface — where RDMA is not simply the acronym for Remote Direct Memory Accesses – in addition it also stands for Reusable, Distributed MAin-memory database operator interface. The interface is designed and implemented for distributed query pipelines scaling up algorithms to many thousand cores. It provides the usability of SQL, combined with the expressiveness and extensibility of Spark and will eventually achieve the performance of hand-tuned algorithms written in C++. We implement a distributed radix hash join algorithm and query 1 of the TPC-H Benchmark with the building blocks provided by the operator abstraction. While the former is intended to compare the performance to a hand-tuned, highly optimized implementation, the latter shows the expressiveness of the interface. Although the radix hash join implemented on top of the operator interface exhibits less performance, it has a similar sub-linear scaling behaviour. In the discussion section, we show the differences in the implementations and that the operator interface simply needs more fine-tuning to match similar performance or even surpass it.
en_US
dc.language.iso
en
en_US
dc.publisher
Systems Group, Department of Computer Science, ETH Zurich
en_US
dc.rights.uri
http://rightsstatements.org/page/InC-NC/1.0/
dc.subject
operator interface
en_US
dc.subject
extensible
en_US
dc.subject
reusable
en_US
dc.subject
RDMA
en_US
dc.subject
main-memory
en_US
dc.subject
main-memory database
en_US
dc.subject
micro-operator
en_US
dc.title
Design and Implementation of RDMA-based Database Operators
en_US
dc.type
Master Thesis
dc.rights.license
In Copyright - Non-Commercial Use Permitted
dc.date.published
2018-01-03
ethz.journal.volume
181
en_US
ethz.size
87 p.
en_US
ethz.publication.place
Zurich
en_US
ethz.publication.status
published
en_US
ethz.leitzahl
ETH Zürich::00002 - ETH Zürich::00012 - Lehre und Forschung::00007 - Departemente::02150 - Dep. Informatik / Dep. of Computer Science::02663 - Institut für Computing Platforms / Institute for Computing Platforms::03506 - Alonso, Gustavo / Alonso, Gustavo
en_US
ethz.date.deposited
2017-12-21T10:14:14Z
ethz.source
FORM
ethz.eth
yes
en_US
ethz.availability
Open access
en_US
ethz.rosetta.installDate
2018-01-03T10:06:12Z
ethz.rosetta.lastUpdated
2018-11-06T06:08:18Z
ethz.rosetta.exportRequired
true
ethz.rosetta.versionExported
true
ethz.COinS
ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.atitle=Design%20and%20Implementation%20of%20RDMA-based%20Database%20Operators&rft.date=2017-12-21&rft.volume=181&rft.au=Willi,%20Roman%20A.&rft.genre=unknown&rft.btitle=Design%20and%20Implementation%20of%20RDMA-based%20Database%20Operators
 Search via SFX

Files in this item

Thumbnail

Publication type

Show simple item record