COders and DEcoders for jaX.
Project description
CoDeX
CoDeX contains learned data compression tools for JAX.
You can use this library to build your own ML models with end-to-end optimized data compression built in. It's useful to find storage-efficient representations of your data (images, features, examples, etc.) while only sacrificing a small fraction of model performance.
For a more in-depth introduction from a classical data compression perspective, consider our paper on nonlinear transform coding, or watch @jonycgn's talk on learned image compression. For an introduction to lossy data compression from a machine learning perspective, take a look at @yiboyang's review paper.
Documentation & getting help
Please post all questions or comments on Discussions. Only file Issues for actual bugs or feature requests. On Discussions, you may get a faster answer, and you help other people find the question or answer more easily later.
Installation
To install CoDeX via pip
, run the following command:
pip install jax-codex
To test that the installation works correctly, you can run the unit tests with:
python -m codex.all_tests
Once the command finishes, you should see a message 13 passed in 2.76s
or
similar in the last line.
Usage
We recommend importing the library from your Python code as follows:
import codex as cdx
Citation
If you use this library for research purposes, please cite:
@software{codex_github,
author = "Ballé, Johannes and Hwang, Sung Jin and Agustsson, Eirikur",
title = "{CoDeX}: Learned Data Compression in {JAX}",
url = "http://github.com/google/codex",
version = "0.0.1",
year = "2022",
}
In the above BibTeX entry, names are top contributors sorted by number of commits. Please adjust version number and year according to the version that was actually used.
Note that this is not an officially supported Google product.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file jax_codex-0.0.1-py3-none-any.whl
.
File metadata
- Download URL: jax_codex-0.0.1-py3-none-any.whl
- Upload date:
- Size: 19.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.10.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2805a311ff860537dfd240c28f337505045fc8e1622722a53ea156d4daa8bec2 |
|
MD5 | 75a072a9508a77b717b838ba5672b37e |
|
BLAKE2b-256 | acef202f912a255d2ad7ba73216fb56cc09ccc1c0dabc91f4fa6ce11d362eedd |