OntoValidate: OntoNotes 5.0 NER validation dataset - Open Research Data - Bridge of Knowledge

Your account

login

Search

OntoValidate: OntoNotes 5.0 NER validation dataset

wersja 1.2

Description

OntoValidate dataset consists of 603 randomly chosen raw texts
from the original OntoNote 5.0 dataset (3637 raw texts in total).

All raw texts are split into 13 subsets. Each subset was manually
annotated with named entities by at least 10 people. Each annotator followed 
the official annotation guidelines (OntoNotes Named Entity Guidelines VERSION 14.0)
that are distributed together with the OntoNotes 5.0 dataset. 

The OntoValidate dataset allows for a comparison of how different people
understand the named entity recognition task. On the other hand, it also gave us
some insights about the precision of annotation guidelines itself.

Format

Each directory of the OntoValidate dataset represents a separate annotator.
The first number in the directory name is the sequence number of the subset, the second is
the sequence number of the annotator. Each directory contains the JSON files that contain
the annotations in spaCy JSON format. 

All annotations were created using the NER Text Annotator tool (https://tecoholic.github.io/ner-annotator/).

Dataset file

data.zip
12.4 MB, S3 ETag 9923bb32afbb57014445662d1881072d-1, downloads: 35
The file hash is calculated from the formula
hexmd5(md5(part1)+md5(part2)+...)-{parts_count} where a single part of the file is 512 MB in size.

Example script for calculation:
https://github.com/antespi/s3md5
download file data.zip

File details

License:
Creative Commons: 0 1.0 open in new tab
CC 0
Public Domain Dedication

Details

Year of publication:
2024
Verification date:
2024-10-30
Dataset language:
English
Fields of science:
  • information and communication technology (Engineering and Technology)
DOI:
DOI ID 10.34808/htvn-p914 open in new tab
Verified by:
Gdańsk University of Technology

Keywords

Cite as

Authors

Version this document has several versions

DOI 10.34808/x2x8-xt69 represents the latest version of the data.

seen 62 times