Skip to main content

A toolkit for Relation Extraction and more...

Project description



Build Docs

A toolkit for Relation & Event eXtraction (REx) and more...

This project has not been finished yet, so be careful when using it, or wait until the first release comes out.

This project is suffering from the second-system effect. I would like to cut some features to make this going smoothly.

Accelerate seems to be a very sweet wrapper for multi-GPU, TPU training, we highly recommend you to use such frameworks, instead of adding hard codes on your own.

⚙️Installation

Make sure you have installed all the dependencies below.

  • Python>=3.6
    • torch>=1.2.0 : project is developed with torch==1.7.1, should be compatable with >=1.2.0 versions
    • numpy>=1.19.0
    • scikit-learn>=0.21.3
    • omegaconf>=2.0.6
    • loguru>=0.5.3
    • tqdm>=4.61.1
    • transformers>=4.8.2
$ git clone https://github.com/Spico197/REx.git
$ cd REx
$ pip install -e .

# or you can download and install from pypi, not recommend for now
$ pip install pytorch-rex -i https://pypi.org/simple

🚀QuickStart

Checkout the examples folder.

Name Model Dataset Task
SentRE-MCML PCNN IPRE Sentence-level Multi-class multi-label relation classification
BagRE PCNN+ONE NYT10 Bag-level relation classification (Multi-Instance Learning, MIL)
JointERE CasRel WebNLG Jointly entity relation extraction
  • To create new task for classification, try: rex new classification <task_name>
  • To create new task for tagging, try: rex new tagging <task_name>

✈️Abilities

Dataset

  • IPRE preprocess
  • NYT10

Tasks

  • Chinese sentence-level relation extraction
  • English bag-level relation extraction

Modules & Models

  • Piecewise CNN
  • PCNN + ONE
  • PCNN + ATT

✉️Update

  • v0.1.0: huge update with lots of new features, check the usage in examples/IPRE ~
  • v0.0.15: add safe_try to kill ugly statements in example main call
  • v0.0.14: update vocab embedding loading to be compatible with other embedding files
  • v0.0.13: update vocab, label_encoder, fix bugs in cnn reshaping and crf importing
  • v0.0.12: fix crf module import issue
  • v0.0.11: fix templates data resources
  • v0.0.10: update utils.config module, StaticEmbedding decoupling, remove eps in metrics, add templates generation entrypoints, add more tests (coverage stat for the whole repo, lots of codes are not test case covered)
  • v0.0.9: use argparse instead of click, move loguru logger into rex.utils.logging, add hierarchical config setting
  • v0.0.8: fix config loading, change default of makedirs and dump_configfile to be True
  • v0.0.7: fix recursive import bug
  • v0.0.6: integrate omega conf loading into the inner task, add load_*_data option to data managers
  • v0.0.5: update ffn
  • v0.0.4: return detailed classification information in mc_prf1, support nested dict tensor movement
  • v0.0.3: fix packaging bug in setup.py
  • v0.0.2: add black formatter and pytest testing
  • v0.0.1: change LabelEncoder.to_binary_labels into convert_to_multi_hot or convert_to_one_hot

🔑LICENCE

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytorch-rex-0.1.0.tar.gz (54.4 kB view details)

Uploaded Source

Built Distribution

pytorch_rex-0.1.0-py3-none-any.whl (77.4 kB view details)

Uploaded Python 3

File details

Details for the file pytorch-rex-0.1.0.tar.gz.

File metadata

  • Download URL: pytorch-rex-0.1.0.tar.gz
  • Upload date:
  • Size: 54.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.27.1 setuptools/52.0.0.post20210125 requests-toolbelt/0.9.1 tqdm/4.64.0 CPython/3.7.10

File hashes

Hashes for pytorch-rex-0.1.0.tar.gz
Algorithm Hash digest
SHA256 14bc7d43fcc0d76c0f137b186dc0e1d5b2ffd52d5ce6cf5a412a1e3b8f0dc9c1
MD5 9014ab431ec0e659126779ab98b6fc62
BLAKE2b-256 536d46b032c849e4cbdbab86d1bf9fd0f525db72948ba8e32c549acfb6837ac4

See more details on using hashes here.

File details

Details for the file pytorch_rex-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: pytorch_rex-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 77.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.27.1 setuptools/52.0.0.post20210125 requests-toolbelt/0.9.1 tqdm/4.64.0 CPython/3.7.10

File hashes

Hashes for pytorch_rex-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 4b85370edad8f3db55cb921a19d5c5abda47b8ced4cdbaeeacca81afc18e6201
MD5 1f62d12446bde4a5c96a8a1bfba94682
BLAKE2b-256 9f1e94318450c876a6fd11ae14363ab0b91bb812487744ae4fb13987858abb26

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page