ie-datasets 0.0.8

Load fully-typed information extraction data in a single line.

Information Extraction Datasets

This package takes care of all of the tedium when loading various information extraction datasets, providing the data in fully validated and typed Pydantic objects.

Datasets

BioRED

Example

from ie_datasets import BioRED
BioRED.load_units(BioRED.Split.TRAIN)

ChemProt

Example

from ie_datasets import ChemProt
ChemProt.load_units(ChemProt.Split.TRAIN)

CrossRE

Example

from ie_datasets import CrossRE
CrossRE.load_units(CrossRE.Split.TRAIN, domain=CrossRE.Domain.AI)

CUAD

Example

from ie_datasets import CUAD
CUAD.load_units()

DEFT

Example

from ie_datasets import DEFT
DEFT.load_units(DEFT.Split.TRAIN, category=DEFT.Category.BIOLOGY)

NOTE: DEFT's data files contain an overwhelming number of errata. For now, we drop the errors instead of fixing them. This means that we are loading a subset of DEFT, not the full dataset.

DocRED

Example

from ie_datasets import DocRED
DocRED.load_schema()
DocRED.load_units(DocRED.Split.TRAIN_ANNOTATED)

NOTE: DocRED has been superseded by Re-DocRED

HyperRED

Example

from ie_datasets import HyperRED
HyperRED.load_units(HyperRED.Split.TRAIN)

KnowledgeNet

Example

from ie_datasets import KnowledgeNet
KnowledgeNet.load_units(KnowledgeNet.Split.TRAIN)

NOTE: The test split of KnowledgeNet is unlabelled.

Re-DocRED

Example

from ie_datasets import ReDocRED
ReDocRED.load_schema()
ReDocRED.load_units(ReDocRED.Split.TRAIN)

SciERC

Example

from ie_datasets import SciERC
SciERC.load_units(SciERC.Split.TRAIN)

SciREX

Example

from ie_datasets import SciREX
SciREX.load_units(SciREX.Split.TRAIN)

SoMeSci

Example

from ie_datasets import SoMeSci
SoMeSci.load_schema()
SoMeSci.load_units(SoMeSci.Split.TRAIN, group=SoMeSci.Group.CREATION_SENTENCES)

TPLinker/NYT

Example

from ie_datasets import TPLinkerNYT
TPLinkerNYT.load_schema()
TPLinkerNYT.load_units(TPLinkerNYT.Split.TRAIN)

TPLinker/WebNLG

Example

from ie_datasets import TPLinkerWebNLG
TPLinkerWebNLG.load_schema()
TPLinkerWebNLG.load_units(TPLinkerWebNLG.Split.TRAIN)

WikiEvents

Example

from ie_datasets import WikiEvents
WikiEvents.load_ontology()
WikiEvents.load_units(WikiEvents.Split.TRAIN)