Elgold partial: News - Open Research Data - MOST Wiedzy

Wyszukiwarka

Elgold partial: News

Opis

The dataset contains 37 English texts scrapped from news websites. In each text, the named entities are marked. Each name entity is linked to the corresponding Wikipedia if possible. All entities were manually verified by at least three people, which makes the dataset a high-quality gold standard for the evaluation of named entity recognition and linking algorithms.

Each marked entity in the dataset is assigned to one of the following classes:
EVENT - Named hurricanes, battles, wars, sports events, etc.
FAC - Buildings, airports, highways, bridges, etc.
GPE - Countries, cities, states
LANGUAGE - Any named language
LAW - Named documents made into laws.
LOC - Non-GPE locations, mountain ranges, bodies of water
NORP - Nationalities or religious or political groups
ORG - Companies, agencies, institutions, etc.
PERSON - People, including fictional
PRODUCT - Objects, vehicles, foods, etc. (not services)
WORK_OF_ART - Titles of books, songs, etc.
DISEASE - Names of diseases
SUBSTANCE - Natural substances
SPECIE - Species names of animals, plants, viruses, etc.

The marked entities are embedded directly in the textual files using the following syntax:

{{mention content|entity class|Wikipedia target}}

The "mention content" is a fragment of the textual file that was marked, "entity class" is the named entity class, and "Wikipedia target" is the normalized name of the English Wikipedia page describing the entity. If the entity cannot be linked sensibly to any article the target is empty but the second pipe (|) is preserved. 

There is a guarantee that the double braces in the texts exist only as marked entity syntax. It allows to process the files using simple regular expression: {{[^{}]*}}

Ilustracja publikacji

The distribution of datast NER classes, split into separate categories. The first number shows the quantity of linked entities, the second all marked mentions.

Plik z danymi badawczymi

elgold-partial1.zip
46.2 kB, S3 ETag 10ddf246846813ce6bede60d6ba8dce8-1, pobrań: 49
Hash pliku liczony jest ze wzoru
hexmd5(md5(part1)+md5(part2)+...)-{parts_count} gdzie pojedyncza część pliku jest wielkości 512 MB

Przykładowy skrypt do wyliczenia:
https://github.com/antespi/s3md5
pobierz plik elgold-partial1.zip

Informacje szczegółowe o pliku

Licencja:
Creative Commons: by 4.0 otwiera się w nowej karcie
CC BY
Uznanie autorstwa

Informacje szczegółowe

Rok publikacji:
2024
Data zatwierdzenia:
2024-03-28
Data wytworzenia:
2024
Język danych badawczych:
angielski
Dyscypliny:
  • informatyka techniczna i telekomunikacja (Dziedzina nauk inżynieryjno-technicznych)
DOI:
Identyfikator DOI 10.34808/60c2-6n13 otwiera się w nowej karcie
Seria:
Weryfikacja:
Politechnika Gdańska

Słowa kluczowe

Powiązane zasoby

Cytuj jako

wyświetlono 101 razy