Skip to main content

COders and DEcoders for jaX.

Project description

CoDeX

CoDeX contains learned data compression tools for JAX.

You can use this library to build your own ML models with end-to-end optimized data compression built in. It's useful to find storage-efficient representations of your data (images, features, examples, etc.) while only sacrificing a small fraction of model performance.

For a more in-depth introduction from a classical data compression perspective, consider our paper on nonlinear transform coding, or watch @jonycgn's talk on learned image compression. For an introduction to lossy data compression from a machine learning perspective, take a look at @yiboyang's review paper.

Documentation & getting help

Please post all questions or comments on Discussions. Only file Issues for actual bugs or feature requests. On Discussions, you may get a faster answer, and you help other people find the question or answer more easily later.

Installation

To install CoDeX via pip, run the following command:

pip install jax-codex

To test that the installation works correctly, you can run the unit tests with:

python -m codex.all_tests

Once the command finishes, you should see a message 13 passed in 2.76s or similar in the last line.

Usage

We recommend importing the library from your Python code as follows:

import codex as cdx

Citation

If you use this library for research purposes, please cite:

@software{codex_github,
  author = "Ballé, Johannes and Hwang, Sung Jin and Agustsson, Eirikur",
  title = "{CoDeX}: Learned Data Compression in {JAX}",
  url = "http://github.com/google/codex",
  version = "0.0.1",
  year = "2022",
}

In the above BibTeX entry, names are top contributors sorted by number of commits. Please adjust version number and year according to the version that was actually used.

Note that this is not an officially supported Google product.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

jax_codex-0.0.1-py3-none-any.whl (19.4 kB view details)

Uploaded Python 3

File details

Details for the file jax_codex-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: jax_codex-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 19.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.7

File hashes

Hashes for jax_codex-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2805a311ff860537dfd240c28f337505045fc8e1622722a53ea156d4daa8bec2
MD5 75a072a9508a77b717b838ba5672b37e
BLAKE2b-256 acef202f912a255d2ad7ba73216fb56cc09ccc1c0dabc91f4fa6ce11d362eedd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page