Skip to main content

Lightweight package for reading/writing pre-trained word embedding files

Project description

# pyemblib

A module for reading, writing, and using trained word embeddings.

## Installation

Install with pip!

`bash pip install pyemblib `

## Usage

This package currently supports word embeddings trained by the following packages:

### Reading

Both text-format and binary embedding files are supported.

The example below shows reading each format of embedding: `python ## import text embeddings text_embs = pyemblib.read('/tmp/text_embeddings.txt', mode=pyemblib.Mode.Text) ## import binary embeddings bin_embs = pyemblib.read('/tmp/bin_embeddings.bin', mode=pyemblib.Mode.Binary) `

Embeddings are read as a pyemblib.Embeddings object, which inherits from Python’s dictionary class; keys are words, and values are the embedding arrays.

To get the word vector for “python”, just use dictionary access: `python vec = embs['python'] print(vec) # [ 0.001 -0.237 ... ] `

### Writing

The same text and binary modes can be used for writing out embedding files as for reading.

`python embs = { 'a' : np.array([0.3 0.1 -0.2]), 'b' : np.array([-0.9, -0.2, -0.2]) } ## write as text pyemblib.write(embs, '/tmp/text_embeddings.txt', mode=pyemblib.Mode.Text) ## write as binary pyemblib.write(embs, '/tmp/bin_embeddings.bin', mode=pyemblib.Mode.Binary) `

## Feedback Please report any issues you encounter to the [Github Issues page](https://github.com/drgriffis/pyemblib/issues)!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyemblib-0.1.2.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

pyemblib-0.1.2-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file pyemblib-0.1.2.tar.gz.

File metadata

  • Download URL: pyemblib-0.1.2.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

File hashes

Hashes for pyemblib-0.1.2.tar.gz
Algorithm Hash digest
SHA256 06bc1065538c08ae6432d3899b4e2efa145c194e2a1f8b8cfbedc2c1981e31c0
MD5 0188d820a35ff8785298cf04d00d8516
BLAKE2b-256 bc851755939056815f578861fd507bd79162fcd677e257e29d76f274578b7068

See more details on using hashes here.

File details

Details for the file pyemblib-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: pyemblib-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 12.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

File hashes

Hashes for pyemblib-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5310389e0b8c9b2b779e9520d8f63ce4f85b6ce15dee8ff816068d583b685f8c
MD5 9bd8572fb3e636c9b8d6a0d01d1731c6
BLAKE2b-256 4125ea8557bddb839b2dd3541c98dff7c49bd46bed372b9ef542b2e3b8270a7c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page