Search
Abstract
Nowadays, the efficiency of storage systems is a bottleneck in many modern HPC clusters. High performance in the traditional approach – processing using files – is often difficult to obtain because of a model’s complexity and its read/write patterns. An alternative approach is to apply a key-value database, which usually has low latency and scales well. On the other hand, many key-value stores suffer from a limitation of memory capacity and vulnerability to serious failures, which is caused by processing in RAM. Moreover, some research suggests that scientific data models are not applicable to the storage structures of key-value databases. In this paper, the author proposes a resolution to the above-mentioned issues by replacing RAM with NVRAM. A practical example is based on Redis NoSQL. The article also contains three domain-specific APIs that show the idea behind transforming from an HPC data model to Redis structures as well as two micro-benchmarks results.
Citations
-
0
CrossRef
-
0
Web of Science
-
0
Scopus
Cite as
Full text
- Publication version
- Accepted or Published Version
- DOI:
- Digital Object Identifier (open in new tab) 10.7494/csci.2017.18.3.2077
- License
-
open in new tab
Keywords
Details
- Category:
- Articles
- Type:
- artykuły w czasopismach recenzowanych i innych wydawnictwach ciągłych
- Published in:
-
Computer Science
no. 18,
pages 1 - 14,
ISSN: 1508-2806 - Language:
- English
- Publication year:
- 2017
- Bibliographic description:
- Malinowski A.: Using Redis supported by NVRAM in HPC applications// Computer Science. -Vol. 18., nr. 3 (2017), s.1-14
- DOI:
- Digital Object Identifier (open in new tab) 10.7494/csci.2017.18.3.2077
- Verified by:
- Gdańsk University of Technology
seen 114 times