OntoValidate: OntoNotes 5.0 NER validation dataset - Open Research Data - Bridge of Knowledge

Search

OntoValidate: OntoNotes 5.0 NER validation dataset

wersja 1.3

Description

OntoValidate dataset consists of 603 randomly chosen raw texts
from the original OntoNote 5.0 dataset (3637 raw texts in total).

All raw texts are split into 13 subsets. Each subset was manually
annotated with named entities by at least 10 people. Each annotator followed 
the official annotation guidelines (OntoNotes Named Entity Guidelines VERSION 14.0)
that are distributed together with the OntoNotes 5.0 dataset. 

The OntoValidate dataset allows for a comparison of how different people
understand the named entity recognition task. On the other hand, it also gave us
some insights about the precision of annotation guidelines itself.

Format

Each directory of the OntoValidate dataset represents a separate annotator.
The first number in the directory name is the sequence number of the subset, the second is
the sequence number of the annotator. Each directory contains the JSON files that contain
the annotations in spaCy JSON format. 

All annotations were created using the NER Text Annotator tool (https://tecoholic.github.io/ner-annotator/).

Dataset file

ontovalidate.zip
12.4 MB, S3 ETag a32338a6ab4f73d037dd304041fd3bd1-1, downloads: 16
The file hash is calculated from the formula
hexmd5(md5(part1)+md5(part2)+...)-{parts_count} where a single part of the file is 512 MB in size.

Example script for calculation:
https://github.com/antespi/s3md5
download file ontovalidate.zip

File details

License:
Creative Commons: 0 1.0 open in new tab
CC 0
Public Domain Dedication

Details

Year of publication:
2024
Verification date:
2024-11-29
Dataset language:
English
Fields of science:
  • information and communication technology (Engineering and Technology)
DOI:
DOI ID 10.34808/ahje-ch69 open in new tab
Verified by:
Gdańsk University of Technology

Keywords

Cite as

seen 45 times