Three levels of fail-safe mode in MPI I/O NVRAM distributed cache - Publikacja - MOST Wiedzy

Wyszukiwarka

Three levels of fail-safe mode in MPI I/O NVRAM distributed cache

Abstrakt

The paper presents architecture and design of three versions for fail-safe data storage in a distributed cache using NVRAM in cluster nodes. In the first one, cache consistency is assured through additional buffering write requests. The second one is based on additional write log managers running on different nodes. The third one benefits from synchronization with a Parallel File System (PFS) for saving data into a new file which allows to keep file history at the cost of space. We have shown that the three level fail-safe mode incorporating these versions does introduce minimal overhead for a random walk microbenchmark application for a 1GB file and checkpoints created every 2000 iterations, computing powers of a graph with 10000 vertices and up to 20% overhead for parallel processing of images up to 1000 megapixels compared to the basic NVRAM cache without fail-safe modes. We also presented times for checkpoint creation and restoring for sizes up to 10GBs.

Cytowania

  • 1

    CrossRef

  • 1

    Web of Science

  • 1

    Scopus

Informacje szczegółowe

Kategoria:
Publikacja w czasopiśmie
Typ:
publikacja w in. zagranicznym czasopiśmie naukowym (tylko język obcy)
Opublikowano w:
Procedia Computer Science nr 136, strony 52 - 61,
ISSN: 1877-0509
Język:
angielski
Rok wydania:
2018
Opis bibliograficzny:
Malinowski A., Czarnul P.. Three levels of fail-safe mode in MPI I/O NVRAM distributed cache. Procedia Computer Science, 2018, Vol. 136, , s.52-61
DOI:
Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1016/j.procs.2018.08.237
Weryfikacja:
Politechnika Gdańska

wyświetlono 15 razy

Publikacje, które mogą cię zainteresować

Meta Tagi