helper package to make loading/unloading huggingface models quik-er
Project description
hugging-quik
A helper package to make loading/unloading huggingface models quik-er
This was originally part of pytorch-quik, but its requirements are large, and hugging-quik is a simple way to pull and use huggingface.co pretrained models and tokenizers.
hugging-quik does the following: - get_tokenizer: pull a tokenizer from the huggingface suite of models - save_tokenizer: save the tokenizer to disk - get_encodings: use the tokenizer to get text encodings - get_pretrained_model: pull a model from the huggingface suite - save_pretrained_model: save the model to disk
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hugging-quik-0.0.1.tar.gz
(6.5 kB
view hashes)
Built Distribution
Close
Hashes for hugging_quik-0.0.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 931f6fcb8ad36c78a1ed0b890c01a20d7a81876b25250afb9c6215ae104eed8c |
|
MD5 | 94d95cc13602b3422571efa6edd4a8d4 |
|
BLAKE2b-256 | 0ea3b82e326ca34a57c21141184f964ec15d0b3d8a4c559a869feed86ee54afd |