Skip to main content

State of the art Lexical Substitution in Context

Project description

Install

 
pip3 install lexsub
Release: https://pypi.org/project/lexsub/
Version: 1.0.0.  

LexSub

The Lexical Substitution task involves selecting and ranking lexical paraphrases for a target word in a given sentential context. In the task, annotators and systems find an alternative substitute word or phrase for a target word in context. The task involves both finding the synonyms and disambiguating the context.

Example:

i/p : The wine was too strong to drink.
o/p : The wine was too powerful (0.93) / potent (0.91) / hot (0.5) / solid (0.3) / hard(0.3) to drink.

Powerful and potent are much better replacements as indicated by the score next to them as well. Whereas, all three are viable replacement candidates.
Now notice two important things that is interesting:

  • Not all synonyms fit in the context. (direct lexical substitutions won’t always work)
  • Not all words that fit in the context preserve the meaning of the sentence. (LM score doesn’t always correlate)

Datasets:

A. Lexical Substitution:

B. Word Sense Disambiguation:

References:

  1. SOTA-BERT
  2. Pre-BERT-SOTA,Melamud
  3. PIC- Katrin
  4. SemBERT, AAAI 2020
  5. LIBERT
  6. Morgifier LSTM, ICLR 2020

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lexsub-1.0.3.tar.gz (6.7 kB view details)

Uploaded Source

Built Distribution

lexsub-1.0.3-py3-none-any.whl (10.2 kB view details)

Uploaded Python 3

File details

Details for the file lexsub-1.0.3.tar.gz.

File metadata

  • Download URL: lexsub-1.0.3.tar.gz
  • Upload date:
  • Size: 6.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.37.0 CPython/3.7.4

File hashes

Hashes for lexsub-1.0.3.tar.gz
Algorithm Hash digest
SHA256 cbf1037bd68fd84ac0e6260446e4554dfd5470377680025bf97618b7dcf059e9
MD5 c9f03d82202f5c86e859c9e43c957c1b
BLAKE2b-256 7c2643d2ac519bb393d0316ea0f20c74f53bbcd96face3dc1ab344c9d0b13967

See more details on using hashes here.

File details

Details for the file lexsub-1.0.3-py3-none-any.whl.

File metadata

  • Download URL: lexsub-1.0.3-py3-none-any.whl
  • Upload date:
  • Size: 10.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.37.0 CPython/3.7.4

File hashes

Hashes for lexsub-1.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 975a5d9d9c09138755066f11e1455c2df3e4e26e93f4ef844221f46b65f4531c
MD5 d94bc126e4b75065bd05e43ab9b9f5ca
BLAKE2b-256 2e6bdae25d43d14847df5f9b8473a3df775819e92785dbed6fea43c919fb49bb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page