Read and use many word embedding formats
Project description
🐍 snakefusion
Introduction
snakefusion
is a Python package for reading, writing, and using finalfusion,
fastText, floret, GloVe, and word2vec embeddings. This package is a thin
wrapper around the Rust finalfusion crate.
snakefusion
supports the same types of embeddings as finalfusion
:
- Vocabulary:
- No subwords
- Subwords
- Embedding matrix:
- Array
- Memory-mapped
- Quantized
- Format:
- fastText
- finalfusion
- floret
- GloVe
- word2vec
Building from source
Building snakefusion
from source requires a Rust toolchain that is installed
through rustup and setuptools-rust
:
$ pip install --upgrade setuptools-rust
You can then build and install snakefusion
in your environment:
$ pip install .
Documentation
Read the snakefusion documentation for a quickstart and API reference.
You use finalfrontier to train new embeddings, or download some pretrained embeddings.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Hashes for snakefusion-0.1.6-cp36-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b030808601cb11aa3226f797274065b6b5a3fa8486cb8715940169e32026f3e2 |
|
MD5 | 8ac89a50b59e9f9e2615852007478b02 |
|
BLAKE2b-256 | 41e271bd8f2fafe7e6efee62cd0065df084d9d6ad6f40bab7471ad18226e916a |
Hashes for snakefusion-0.1.6-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2173b14f38918c50b7cb6db52632f3ede066ab3e972b074ac56cc37df7591f73 |
|
MD5 | af181df41f641bebba13cba15f66df07 |
|
BLAKE2b-256 | fd629187cf9c85ab845e07e0394cc42313a5ed780b8a0e53abc9b6a040522933 |
Hashes for snakefusion-0.1.6-cp36-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77e7287f5b52309e93285116e2ebfb68f6b5b585846986b8aa05560fa474a539 |
|
MD5 | 7c3c2a11650c4c9d003a538df1e0be09 |
|
BLAKE2b-256 | d8ff526df7011a56420c2f39c251ef845732808eed9649aab276c87366166505 |