Optimization of Data Assignment for Parallel Processing in a Hybrid Heterogeneous Environment Using Integer Linear Programming - Publikacja - MOST Wiedzy

Wyszukiwarka

Optimization of Data Assignment for Parallel Processing in a Hybrid Heterogeneous Environment Using Integer Linear Programming

Abstrakt

In the paper we investigate a practical approach to application of integer linear programming for optimization of data assignment to compute units in a multi-level heterogeneous environment with various compute devices, including CPUs, GPUs and Intel Xeon Phis. The model considers an application that processes a large number of data chunks in parallel on various compute units and takes into account computations, communication including bandwidths and latencies, partitioning, merging, initialization, overhead for computational kernel launch and cleanup. We show that theoretical results from our model are close to real results as differences do not exceed 5% for larger data sizes, with up to 16.7% for smaller data sizes. For an exemplary workload based on solving systems of equations of various sizes with various compute-to-communication ratios we demonstrate that using an integer linear programming solver (lp_solve) with timeouts allows to obtain significantly better total (solver+application) run times than runs without timeouts, also significantly better than arbitrary chosen ones. We show that OpenCL 1.2’s device fission allows to obtain better performance in heterogeneous CPU+GPU environments compared to the GPU-only and the default CPU+GPU configuration, where a whole device is assigned for computations leaving no resources for GPU management.

Cytowania

  • 3

    CrossRef

  • 0

    Web of Science

  • 5

    Scopus

Cytuj jako

Pełna treść

pobierz publikację
pobrano 41 razy
Wersja publikacji
Accepted albo Published Version
Licencja
Creative Commons: CC-BY-NC otwiera się w nowej karcie

Słowa kluczowe

Informacje szczegółowe

Kategoria:
Publikacja w czasopiśmie
Typ:
artykuły w czasopismach
Opublikowano w:
COMPUTER JOURNAL nr 65, strony 1412 - 1433,
ISSN: 0010-4620
Język:
angielski
Rok wydania:
2021
Opis bibliograficzny:
Boiński T., Czarnul P.: Optimization of Data Assignment for Parallel Processing in a Hybrid Heterogeneous Environment Using Integer Linear Programming// COMPUTER JOURNAL -Vol. 65,iss. 6 (2021), s.1412-1433
DOI:
Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1093/comjnl/bxaa187
Weryfikacja:
Politechnika Gdańska

wyświetlono 133 razy

Publikacje, które mogą cię zainteresować

Meta Tagi