Search
Description
OntoValidate dataset consists of 603 randomly chosen raw texts
from the original OntoNote 5.0 dataset (3637 raw texts in total).
All raw texts are split into 13 subsets. Each subset was manually
annotated with named entities by at least 10 people. Each annotator followed
the official annotation guidelines (OntoNotes Named Entity Guidelines VERSION 14.0)
that are distributed together with the OntoNotes 5.0 dataset.
The OntoValidate dataset allows for a comparison of how different people
understand the named entity recognition task. On the other hand, it also gave us
some insights about the precision of annotation guidelines itself.
Format
Each directory of the OntoValidate dataset represents a separate annotator.
The first number in the directory name is the sequence number of the subset, the second is
the sequence number of the annotator. Each directory contains the JSON files that contain
the annotations in spaCy JSON format.
All annotations were created using the NER Text Annotator tool (https://tecoholic.github.io/ner-annotator/).
Dataset file
hexmd5(md5(part1)+md5(part2)+...)-{parts_count} where a single part of the file is 512 MB in size.Example script for calculation:
https://github.com/antespi/s3md5
File details
- License:
-
open in new tab
CC 0Public Domain Dedication
Details
- Year of publication:
- 2024
- Verification date:
- 2024-09-30
- Dataset language:
- English
- Fields of science:
-
- information and communication technology (Engineering and Technology)
- DOI:
- DOI ID 10.34808/faag-5580 open in new tab
- Verified by:
- Gdańsk University of Technology
Keywords
Cite as
Authors
Version this document has several versions
-
version 1.2release date 2024-10-30
-
Current versionversion 1.1release date 2024-09-30
-
version 1.0release date 2024-08-29
seen 67 times