Search results for: tokenization algorithm

• Investigation of Performance and Energy Consumption of Tokenization Algorithms on Multi-core CPUs Under Power Capping

  Publication

  • O. Diakun
  • J. Dobrosolski
  • P. Czarnul

  - Year 2024

  In this paper we investigate performance-energy optimization of tokenizer algorithm training using power capping. We focus on parallel, multi-threaded implementations of Byte Pair Encoding (BPE), Unigram, WordPiece, and WordLevel run on two systems with different multi-core CPUs: Intel Xeon 6130 and desktop Intel i7-13700K. We analyze execution times and energy consumption for various numbers of threads and various power caps and...

  Full text available to download

• Algorithms

  Journals

  ISSN: 1999-4893

• NUMERICAL ALGORITHMS

  Journals

  ISSN: 1017-1398 , eISSN: 1572-9265

• ACM Transactions on Algorithms

  Journals

  ISSN: 1549-6325 , eISSN: 1549-6333

• Algorithms for Molecular Biology

  Journals

  ISSN: 1748-7188

• RANDOM STRUCTURES & ALGORITHMS

  Journals

  ISSN: 1042-9832 , eISSN: 1098-2418

• Algorithmic Finance

  Journals

  ISSN: 2158-5571 , eISSN: 2157-6203

• Performance comparison of new modified gradient algorithm and Foy algorithm for iterative position calculation

  Publication

  • A. Czapiewska

  - Przegląd Telekomunikacyjny + Wiadomości Telekomunikacyjne - Year 2015

  In the paper a new position calculation algorithm is presented. It is proposed for indoor environments and is called modified gradient algorithm. This algorithm is compared with well-known Foy algorithm. The comparative analysis is based on real distance measurements conducted in indoor environment.

  Full text to download in external service

• Evolutional algorithm in stock control

  Publication

  • K. Jakowska-Suwalska
  • A. Sojda
  • M. Wolny

  - Year 2011

  Full text to download in external service

• Homology algorithm based on acyclic subspace

  Publication

  • M. Mrozek
  • P. Pilarczyk
  • N. Żelazna

  - COMPUTERS & MATHEMATICS WITH APPLICATIONS - Year 2008

  Full text to download in external service