Neural network training with limited precision and asymmetric exponent - Publikacja - MOST Wiedzy

Wyszukiwarka

Neural network training with limited precision and asymmetric exponent

Abstrakt

Along with an extremely increasing number of mobile devices, sensors and other smart utilities, an unprecedented growth of data can be observed in today’s world. In order to address multiple challenges facing the big data domain, machine learning techniques are often leveraged for data analysis, filtering and classification. Wide usage of artificial intelligence with large amounts of data creates growing demand not only for storage and operational memory, but also computational power. Increasing complexity and variety of neural network architectures are vivid examples of such trends in the modern data-driven industry. In response to this situation, focusing on less demanding operations for inference and training of neural networks became a popular approach among many researchers to overcome resources related issues. This work aims to investigate one of the paths associated with the mentioned efficiency problems and shows the impact of floating-point precision limitation on convolutional neural networks, including experiments on various exponent and mantissa sizes. Additionally, authors explore floating-point numbers utilization and optimization techniques in the scope of neural network training. Based on conducted research a novel method of asymmetric exponent utilization is presented achieving almost identical accuracy of 32-bit floating-point parameters while training a neural network with only 12-bit variables without additional rounding.

Cytowania

  • 1

    CrossRef

  • 1

    Web of Science

  • 1

    Scopus

Cytuj jako

Pełna treść

pełna treść publikacji nie jest dostępna w portalu

Słowa kluczowe

Informacje szczegółowe

Kategoria:
Publikacja w czasopiśmie
Typ:
artykuły w czasopismach
Opublikowano w:
Journal of Big Data nr 9,
ISSN:
Język:
angielski
Rok wydania:
2022
Opis bibliograficzny:
Blok M., Pietrołaj M.: Neural network training with limited precision and asymmetric exponent// Journal of Big Data -Vol. 9,iss. 1 (2022), s.63-
DOI:
Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1186/s40537-022-00606-2
Weryfikacja:
Politechnika Gdańska

wyświetlono 35 razy

Publikacje, które mogą cię zainteresować

Meta Tagi