Wyszukiwarka
A model, design, and implementation of an efficient multithreaded workflow execution engine with data streaming, caching, and storage constraints
Abstrakt
The paper proposes a model, design, and implementation of an efficient multithreaded engine for execution of distributed service-based workflows with data streaming defined on a per task basis. The implementation takes into account capacity constraints of the servers on which services are installed and the workflow data footprint if needed. Furthermore, it also considers storage space of the workflow execution engine and its cost. Caching service output data is implemented to speed up the execution of the workflow. Input data is partitioned into data packets, which are passed and processed by services previously selected for workflow tasks so that the aforementioned constraints are met. Performance impact of the proposed mechanisms is investigated for workflow structures common in acyclic directed graph workflow applications. It is shown for a real workflow with distributed processing of digital media content that the initial budget needs to be properly distributed between both the cost of services, but also the cost of intermediate storage to obtain good workflow execution times.
Cytowania
-
1 0
CrossRef
-
0
Web of Science
-
1 2
Scopus
Cytuj jako
Pełna treść
- Wersja publikacji
- Accepted albo Published Version
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1007/s11227-012-0837-z
- Licencja
-
otwiera się w nowej karcie
Słowa kluczowe
Informacje szczegółowe
- Kategoria:
- Publikacja w czasopiśmie
- Typ:
- artykuł w czasopiśmie wyróżnionym w JCR
- Opublikowano w:
-
JOURNAL OF SUPERCOMPUTING
nr 63,
wydanie 3,
strony 919 - 945,
ISSN: 0920-8542 - Język:
- angielski
- Rok wydania:
- 2013
- Opis bibliograficzny:
- Czarnul P.: A model, design, and implementation of an efficient multithreaded workflow execution engine with data streaming, caching, and storage constraints// JOURNAL OF SUPERCOMPUTING. -Vol. 63, iss. 3 (2013), s.919-945
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1007/s11227-012-0837-z
- Weryfikacja:
- Politechnika Gdańska
wyświetlono 113 razy