Parallelization of large vector similarity computations in a hybrid CPU+GPU environment

Paweł Czarnul

doi:10.1007/s11227-017-2159-7

Parallelization of large vector similarity computations in a hybrid CPU+GPU environment

Abstract

The paper presents design, implementation and tuning of a hybrid parallel OpenMP+CUDA code for computation of similarity between pairs of a large number of multidimensional vectors. The problem has a wide range of applications, and consequently its optimization is of high importance, especially on currently widespread hybrid CPU+GPU systems targeted in the paper. The following are presented and tested for computation of all vector pairs: tuning of a GPU kernel with consideration of memory coalescing and using shared memory, minimization of GPU memory allocation costs, optimization of CPU–GPU communication in terms of size of data sent, overlapping CPU–GPU communication and kernel execution, concurrent kernel execution, determination of best sizes for data batches processed on CPUs and GPUs along with best GPU grid sizes. It is shown that all codes scale in hybrid environments with various relative performances of compute devices, even for a case when comparisons of various vector pairs take various amounts of time. Tests were performed on two high-performance hybrid systems with: 2 x Intel Xeon E5-2640 CPU + 2 x NVIDIA Tesla K20m and latest generation 2 x Intel Xeon CPU E5-2620 v4 + NVIDIA’s Pascal generation GTX 1070 cards. Results demonstrate expected improvements and beneficial optimizations important for users incorporating such types of computations into their parallel codes run on similar systems.

Citations

1 1

CrossRef
0

Web of Science
1 5

Scopus

Author (1)

Paweł Czarnul dr hab. inż.

Cite as

Full text

download paper

downloaded 1534 times

Publication version: Accepted or Published Version
License: open in new tab

Keywords

Details

Category:: Articles
Type:: artykuł w czasopiśmie wyróżnionym w JCR
Published in:: JOURNAL OF SUPERCOMPUTING no. 74, pages 768 - 786,
ISSN: 0920-8542
Language:: English
Publication year:: 2018
Bibliographic description:: Czarnul P.: Parallelization of large vector similarity computations in a hybrid CPU+GPU environment// JOURNAL OF SUPERCOMPUTING. -Vol. 74, nr. 2 (2018), s.768-786
DOI:: Digital Object Identifier (open in new tab) 10.1007/s11227-017-2159-7
Verified by:: Gdańsk University of Technology