Elgold: gold standard, multi-genre dataset for named entity recognition and linking - Open Research Data - MOST Wiedzy

Twoje konto

zaloguj

Wyszukiwarka

Elgold: gold standard, multi-genre dataset for named entity recognition and linking

Opis

The dataset contains 276 multi-genre texts with marked named entities, which are linked to corresponding Wikipedia articles if available. Each entity was manually verified by at least three people, which makes the dataset a high-quality gold standard for the evaluation of named entity recognition and linking algorithms.

Each marked entity in the dataset is assigned to one of the following classes:
EVENT - Named hurricanes, battles, wars, sports events, etc.
FAC - Buildings, airports, highways, bridges, etc.
GPE - Countries, cities, states
LANGUAGE - Any named language
LAW - Named documents made into laws.
LOC - Non-GPE locations, mountain ranges, bodies of water
NORP - Nationalities or religious or political groups
ORG - Companies, agencies, institutions, etc.
PERSON - People, including fictional
PRODUCT - Objects, vehicles, foods, etc. (not services)
WORK_OF_ART - Titles of books, songs, etc.
DISEASE - Names of diseases
SUBSTANCE - Natural substances
SPECIE - Species names of animals, plants, viruses, etc.

The marked entities are embedded directly in the textual files using the following syntax:

{{mention content|entity class|Wikipedia target}}

The "mention content" is a fragment of the textual file that was marked, "entity class" is the named entity class, and "Wikipedia target" is the normalized name of the English Wikipedia page describing the entity. If the entity cannot be linked sensibly to any article the target is empty but the second pipe (|) is preserved. 

There is a guarantee that the double braces in the texts exist only as marked entity syntax. It allows to process the files using simple regular expression: {{[^{}]*}}

Plik z danymi badawczymi

data.zip
269.2 kB, S3 ETag f9c9f8ab8d9508445811d5692ec0859e-1, pobrań: 4
Hash pliku liczony jest ze wzoru
hexmd5(md5(part1)+md5(part2)+...)-{parts_count} gdzie pojedyncza część pliku jest wielkości 512 MB

Przykładowy skrypt do wyliczenia:
https://github.com/antespi/s3md5
pobierz plik data.zip

Informacje szczegółowe o pliku

Licencja:
Creative Commons: by 4.0 otwiera się w nowej karcie
CC BY
Uznanie autorstwa

Informacje szczegółowe

Rok publikacji:
2024
Data zatwierdzenia:
2024-01-22
Data wytworzenia:
2023
Język danych badawczych:
angielski
Dyscypliny:
  • informatyka techniczna i telekomunikacja (Dziedzina nauk inżynieryjno-technicznych)
DOI:
Identyfikator DOI 10.34808/9wvq-th71 otwiera się w nowej karcie
Weryfikacja:
Politechnika Gdańska

Słowa kluczowe

Powiązane zasoby

Cytuj jako

Autorzy

wyświetlono 83 razy