DEVELOPMENT OF THE ALGORITHM OF POLISH LANGUAGE FILM REVIEWS PREPROCESSING - Publication - Bridge of Knowledge

Search

DEVELOPMENT OF THE ALGORITHM OF POLISH LANGUAGE FILM REVIEWS PREPROCESSING

Abstract

The algorithm and the software for conducting the procedure of Preprocessing of the reviews of films in the Polish language were developed. This algorithm contains the following steps: Text Adaptation Procedure; Procedure of Tokenization; Procedure of Transforming Words into the Byte Format; Part-of-Speech Tagging; Stemming / Lemmatization Procedure; Presentation of Documents in the Vector Form (Vector Space Model) Procedure; Forming the Documents Models Database Procedure. The experiments of this algorithm conduction on the test sampling of reviews analysis was performed and the main conclusion was formulated.

Authors (2)

Cite as

Full text

download paper
downloaded 1152 times
Publication version
Accepted or Published Version
License
Copyright (Wydział Zarządzania w Ciechanowie (WSM w Warszawie))

Keywords

Details

Category:
Articles
Type:
artykuły w czasopismach recenzowanych i innych wydawnictwach ciągłych
Published in:
Rocznik Naukowy Wydzialu Zarzadzania w Ciechanowie pages 167 - 188,
ISSN: 1897-4716
Language:
English
Publication year:
2017
Bibliographic description:
Rizun N., Taranenko J.: DEVELOPMENT OF THE ALGORITHM OF POLISH LANGUAGE FILM REVIEWS PREPROCESSING// Rocznik Naukowy Wydzialu Zarzadzania w Ciechanowie. -., nr. 1-4 (XI) (2017), s.167-188
Bibliography: test
  1. The most frequently observed Dominant terms (from the sample) were defined, with their division into speech parts (Table 6): open in new tab
  2. Vanyushkin A. S., Grashchenkov L.A. (2016);
  3. Methods and algorithms extracted key- words. New information technologies for automated. № 19. open in new tab
  4. Rizun N., Kapłanski P. & Taranenko Y. (2016); open in new tab
  5. The Method of a Two-Level Text-Meaning Similarity Approximation of the Customers' Opinions. Czasopismo "Studia Ekonomic- zne -Zeszyty Naukowe". Uniwersytet Ekonomiczny w Katowicach. № 296, pp.64-85. open in new tab
  6. Rizun N., Kapłanski P. & Taranenko Y. (2016); open in new tab
  7. Development and Research of the Text Messages Semantic Clustering Methodology, The Third European Network Intelli- gence Conference (ENIC 2016). Proceedings. DOI: 10.1109/ENIC.2016.33. In book: 2016 Third European Network Intelligence Conference, Publisher: ENIC.2016.33, pp.180-187. open in new tab
  8. Kapłanski P., Rizun N., Taranenko Y. & Seganti A. (2016);
  9. Text-mining Similarity Approximation Operators for Opinion Mining in BI tools. Proceeding of the 11th Sci- entific Congerence "Internet in the Information Society-2016", Publisher: University of Dąbrowa Górnicza, Editors: Maciej Rostancki, Piotr Pikiewicz, Krystian Mączka, Paweł Buchwald, pp.121-141. open in new tab
  10. Feinerer, I., Hornik, K. & Meyer, D. (2008); Text mining infrastructure in: "R Journal of statistical software." 25(5). American Statistical Association. open in new tab
  11. Segalovich I. (2003);
  12. A fast-morphological algorithm with unknown word guessing induced by a dictionary for a web search engine. MLMTA-2003. open in new tab
  13. Koreniu T., Laurikkala Y, Järvelin K. & Juhola M. (2004); Stemming and Lemmatiza- tion in the Clustering of Finnish Text Documents. CIKM'04, November 8-13, Washing- ton, DC, USA. open in new tab
  14. Alkula, R. (2001) From plain character strings to meaningful words: Producing better full text databases for inflectional and compounding languages with morphological analysis software. "Information Retrieval" № 4, pp.195-208. open in new tab
  15. Weiss D. & Stempelator A. (2013); open in new tab
  16. Hybrid Stemmer for the Polish Language. open in new tab
  17. Lewandowska-Tomaszczyk B., James Melia P. (1997) PALC'97: Practical Applications in Language Corpora, pages 496-505, Łódź University Press. open in new tab
  18. Hajnicz, E. & Kupść, A. (2001); open in new tab
  19. Przegląd analizatorów morfologicznych dla języka pol- skiego. IPI PAN Research Report 937, Institute of Computer Science, Polish Academy of Sciences, Warsaw. open in new tab
  20. Vetulani, Z. & Obrębski, T. (1997); Morphological tagging of texts using the lemmatizer of the 'POLEX' electronic dictionary. In: Lewandowska-Tomaszczyk, B. & Melia P. J. (Eds.) Practical Applications in Language Corpora, Proceedings, University Press, pp. 496-505. open in new tab
  21. Obrębski, T. & Stolarski, M. (2006);
  22. UAM text tools -a flexible NLP architecture. In Proceedings of the Fifth International Conference on Language Resources and Evalu- ation, LREC 2006, pages 2259-2262, Genoa. ELRA open in new tab
  23. Miłkowski, M. (2010); open in new tab
  24. Developing an open-source, rule-based proofreading tool. Soft- ware: "Practice and Experience". 40(7): pp. 543-566. open in new tab
  25. Wolinski, M, Miłkowski, M., Ogrodniczuk, M., Przepiórkowski, A. & Szałkiewicz, L. (2010) PoliMorf: a (not so) new open morphological dictionary for Polish.
  26. Przepiórkowski A. & Wolinski, M. (2003); The unbearable lightness of tagging: A case study in morphosyntactic tagging of Polish. In Proceedings of the 4th International Workshop on Linguistically Interpreted Corpora. EACL 2003, pp. 109-116. open in new tab
  27. Radziszewski A. & Maziarz M. (2011); open in new tab
  28. Developing free morphological data for Polish, "Cognitive Studies / Etudes Cognitives" (lista ERIH), 11. open in new tab
  29. Rizun N., Taranenko Y. & Waloszek, W. (2017); open in new tab
  30. The Algorithm of Modelling and Analysis of Latent Semantic Relations: Linear Algebra vs. Probabilistic Topic Models. Knowledge Engineering and Semantic Web. Knowledge Engineering and Semantic Web, Publisher: Proceedings of the 8th International Conference (KESW 2017), pp.53- 68. DOI: 10.1007/978-3-319-69548-8 5. open in new tab
Verified by:
Gdańsk University of Technology

seen 97 times

Recommended for you

Meta Tags