Semantic URL Analytics to Support Efficient Annotation of Large Scale Web Archives

Tarcisio Souza; Elena Demidova; Thomas Risse; Helge Holzmann; Gerhard Gossen; Julian Szymański

doi:10.1007/978-3-319-27932-9_14

Semantic URL Analytics to Support Efficient Annotation of Large Scale Web Archives

Abstract

Long-term Web archives comprise Web documents gathered over longer time periods and can easily reach hundreds of terabytes in size. Semantic annotations such as named entities can facilitate intelligent access to the Web archive data. However, the annotation of the entire archive content on this scale is often infeasible. The most efficient way to access the documents within Web archives is provided through their URLs, which are typically stored in dedicated index files. The URLs of the archived Web documents can contain semantic information and can offer an efficient way to obtain initial semantic annotations for the archived documents. In this paper, we analyse the applicability of semantic analysis techniques such as named entity extraction to the URLs in a Web archive. We evaluate the precision of the named entity extraction from the URLs in the Popular German Web dataset and analyse the proportion of the archived URLs from 1,444 popular domains in the time interval from 2000 to 2012 to which these techniques are applicable. Our results demonstrate that named entity recognition can be successfully applied to a large number of URLs in our Web archive and provide a good starting point to efficiently annotate large scale collections of Web documents.

Citations

7

CrossRef
0

Web of Science
6

Scopus

Authors (6)

Tarcisio Souza
- L3S Research Center and Leibniz Universität Hannover .
Elena Demidova
- L3S Research Center and Leibniz Universität Hannover .
Thomas Risse
- L3S Research Center and Leibniz Universität Hannover .
Helge Holzmann
- L3S Research Center and Leibniz Universität Hannover .
Gerhard Gossen
- L3S Research Center and Leibniz Universität Hannover .
Julian Szymański dr hab. inż.

Cite as

Full text

full text is not available in portal

full content of the article see on external site open in new tab

Keywords

SEMANTIC ARCHIVES

Details

Category:: Conference activity
Type:: publikacja w wydawnictwie zbiorowym recenzowanym (także w materiałach konferencyjnych)
Title of issue:: W : Semantic Keyword-based Search on Structured Data Sources strony 153 - 166
Language:: English
Publication year:: 2015
Bibliographic description:: Souza T., Demidova E., Risse T., Holzmann H., Gossen G., Szymański J.: Semantic URL Analytics to Support Efficient Annotation of Large Scale Web Archives// W : Semantic Keyword-based Search on Structured Data Sources/ : , 2015, s.153-166
DOI:: Digital Object Identifier (open in new tab) 10.1007/978-3-319-27932-9_14
Verified by:: Gdańsk University of Technology