A package to count tokens in input text using OpenAI's tiktoken library.
Project description
gptwc: wc for GPT tokens
A simple utility for counting tokens. Uses tiktoken
Example Usage:
cat logs.txt | gptwc
gptwc < input.txt
Prints the number of tokens in the input stdin text, similar to how wc prints the number of words.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gptwc-1.0.0.tar.gz
(1.8 kB
view hashes)
Built Distribution
gptwc-1.0.0-py3-none-any.whl
(2.1 kB
view hashes)
