Installion
uv pip install fastertext
Usage
On a model such as glotlid you should expect around a 7x-10x speedup compared to regular fasttext.
! wget https://huggingface.co/cis-lmu/glotlid/resolve/main/model_v3.bin
from fastertext import load_model
model = load_model("model_v3.bin")
labels, probs = model.batch(["hello world", "bonjour le monde"], k=2)
id2label = model.get_labels()
print(id2label[int(labels[0, 0])], probs[0, 0])
Benchmark on longer Wikipedia documents
fastertext: 2.93s 34,114 texts/s
fasttext: 17.84s 5,604 texts/s
speedup: 6.1x
top-1 agreement: 100.0000%
Contributing
Need to support many linux builds through docker container to publish release wheels:
docker run --rm -v $(pwd):/io ghcr.io/pyo3/maturin build --release
uv publish target/wheels/*.whl
Citations
@misc{shippole2026fastertext,
author = {Shippole, Enrico},
title = {fastertext: embarrassingly parallel fasttext batch inference in rust},
year = {2026},
howpublished = {\url{https://github.com/teraflop-ai/fastertext}}
}
@article{joulin2016bag,
title={Bag of Tricks for Efficient Text Classification},
author={Joulin, Armand and Grave, Edouard and Bojanowski, Piotr and Mikolov, Tomas},
journal={arXiv preprint arXiv:1607.01759},
year={2016}
}
@article{bojanowski2016enriching,
title={Enriching Word Vectors with Subword Information},
author={Bojanowski, Piotr and Grave, Edouard and Joulin, Armand and Mikolov, Tomas},
journal={arXiv preprint arXiv:1607.04606},
year={2016}
}
@misc{messense_fasttext_rs,
author = {messense},
title = {fasttext-rs: fastText Rust binding},
howpublished = {\url{https://github.com/messense/fasttext-rs}}
}
@misc{wang_fasttext_parallel,
author = {Congyu Wang},
title = {fasttext-parallel: multithreaded batch processing for fasttext},
howpublished = {\url{https://github.com/Congyuwang/fasttext-parallel}}
}
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file fastertext-0.1.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.
File metadata
- Download URL: fastertext-0.1.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
- Upload date:
- Size: 353.4 kB
- Tags: CPython 3.9+, manylinux: glibc 2.17+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5f7517fc46052653ae7332ca6b1b39c48ba802233a146d756f1c0988eedc9253
|
|
| MD5 |
6750bc4669a47af20d2ddf9453d3ad4b
|
|
| BLAKE2b-256 |
2713cc6919fe867f769a4d2e3442742900066af5ad1652b546dc6996ccf814eb
|