Skip to main content

CI PyPI version Documentation Gitter Forum

CTranslate2

CTranslate2 is a C++ and Python library for efficient inference with Transformer models.

The project implements a custom runtime that applies many performance optimization techniques such as weights quantization, layers fusion, batch reordering, etc., to accelerate and reduce the memory usage of Transformer models on CPU and GPU.

The following model types are currently supported:

  • Encoder-decoder models: Transformer base/big, M2M-100, NLLB, BART, mBART, Pegasus, T5, UMT5, Whisper, T5Gemma, T5Gemma2, MADLAD-400
  • Decoder-only models: GPT-2, GPT-J, GPT-NeoX, OPT, BLOOM, MPT, Llama, Mistral, Gemma, CodeGen, GPTBigCode, Falcon, Qwen2
  • Encoder-only models: BERT, DistilBERT, XLM-RoBERTa

Compatible models should be first converted into an optimized model format. The library includes converters for multiple frameworks:

The project is production-oriented and comes with backward compatibility guarantees, but it also includes experimental features related to model compression and inference acceleration.

Key features

  • Fast and efficient execution on CPU and GPU
    The execution is significantly faster and requires less resources than general-purpose deep learning frameworks on supported models and tasks thanks to many advanced optimizations: layer fusion, padding removal, batch reordering, in-place operations, caching mechanism, etc.
  • Quantization and reduced precision
    The model serialization and computation support weights with reduced precision: 16-bit floating points (FP16), 16-bit brain floating points (BF16), 16-bit integers (INT16), 8-bit integers (INT8) and AWQ quantization (INT4).
  • Multiple CPU architectures support
    The project supports x86-64 and AArch64/ARM64 processors and integrates multiple backends that are optimized for these platforms: Intel MKL, oneDNN, OpenBLAS, Ruy, and Apple Accelerate.
  • Automatic CPU detection and code dispatch
    One binary can include multiple backends (e.g. Intel MKL and oneDNN) and instruction set architectures (e.g. AVX, AVX2) that are automatically selected at runtime based on the CPU information.
  • Parallel and asynchronous execution
    Multiple batches can be processed in parallel and asynchronously using multiple GPUs or CPU cores.
  • Dynamic memory usage
    The memory usage changes dynamically depending on the request size while still meeting performance requirements thanks to caching allocators on both CPU and GPU.
  • Lightweight on disk
    Quantization can make the models 4 times smaller on disk with minimal accuracy loss.
  • Simple integration
    The project has few dependencies and exposes simple APIs in Python and C++ to cover most integration needs.
  • Configurable and interactive decoding
    Advanced decoding features allow autocompleting a partial sequence and returning alternatives at a specific location in the sequence.
  • Support tensor parallelism for distributed inference
    Very large model can be split into multiple GPUs. Following this documentation to set up the required environment.

Some of these features are difficult to achieve with standard deep learning frameworks and are the motivation for this project.

Installation and usage

CTranslate2 can be installed with pip:

pip install ctranslate2

The Python module is used to convert models and can translate or generate text with few lines of code:

translator = ctranslate2.Translator(translation_model_path)
translator.translate_batch(tokens)

generator = ctranslate2.Generator(generation_model_path)
generator.generate_batch(start_tokens)

See the documentation for more information and examples.

If you have an AMD ROCm GPU, we provide specific Python wheels on the releases page.

Web Server

ctranslate2-web-server is a web server built on top of CTranslate2 that exposes an OpenAI-compatible REST API, making it easy to integrate CTranslate2 models into applications that already support the OpenAI API.

Benchmarks

We translate the En->De test set newstest2014 with multiple models:

  • OpenNMT-tf WMT14: a base Transformer trained with OpenNMT-tf on the WMT14 dataset (4.5M lines)
  • OpenNMT-py WMT14: a base Transformer trained with OpenNMT-py on the WMT14 dataset (4.5M lines)
  • OPUS-MT: a base Transformer trained with Marian on all OPUS data available on 2020-02-26 (81.9M lines)

The benchmark reports the number of target tokens generated per second (higher is better). The results are aggregated over multiple runs. See the benchmark scripts for more details and reproduce these numbers.

Please note that the results presented below are only valid for the configuration used during this benchmark: absolute and relative performance may change with different settings.

CPU

Tokens per second Max. memory BLEU
OpenNMT-tf WMT14 model
OpenNMT-tf 2.31.0 (with TensorFlow 2.11.0) 209.2 2653MB 26.93
OpenNMT-py WMT14 model
OpenNMT-py 3.0.4 (with PyTorch 1.13.1) 275.8 2012MB 26.77
- int8 323.3 1359MB 26.72
CTranslate2 3.6.0 658.8 849MB 26.77
- int16 733.0 672MB 26.82
- int8 860.2 529MB 26.78
- int8 + vmap 1126.2 598MB 26.64
OPUS-MT model
Transformers 4.26.1 (with PyTorch 1.13.1) 147.3 2332MB 27.90
Marian 1.11.0 344.5 7605MB 27.93
- int16 330.2 5901MB 27.65
- int8 355.8 4763MB 27.27
CTranslate2 3.6.0 525.0 721MB 27.92
- int16 596.1 660MB 27.53
- int8 696.1 516MB 27.65

Executed with 4 threads on a c5.2xlarge Amazon EC2 instance equipped with an Intel(R) Xeon(R) Platinum 8275CL CPU.

GPU

Tokens per second Max. GPU memory Max. CPU memory BLEU
OpenNMT-tf WMT14 model
OpenNMT-tf 2.31.0 (with TensorFlow 2.11.0) 1483.5 3031MB 3122MB 26.94
OpenNMT-py WMT14 model
OpenNMT-py 3.0.4 (with PyTorch 1.13.1) 1795.2 2973MB 3099MB 26.77
FasterTransformer 5.3 6979.0 2402MB 1131MB 26.77
- float16 8592.5 1360MB 1135MB 26.80
CTranslate2 3.6.0 6634.7 1261MB 953MB 26.77
- int8 8567.2 1005MB 807MB 26.85
- float16 10990.7 941MB 807MB 26.77
- int8 + float16 8725.4 813MB 800MB 26.83
OPUS-MT model
Transformers 4.26.1 (with PyTorch 1.13.1) 1022.9 4097MB 2109MB 27.90
Marian 1.11.0 3241.0 3381MB 2156MB 27.92
- float16 3962.4 3239MB 1976MB 27.94
CTranslate2 3.6.0 5876.4 1197MB 754MB 27.92
- int8 7521.9 1005MB 792MB 27.79
- float16 9296.7 909MB 814MB 27.90
- int8 + float16 8362.7 813MB 766MB 27.90

Executed with CUDA 11 on a g5.xlarge Amazon EC2 instance equipped with a NVIDIA A10G GPU (driver version: 510.47.03).

Contributing

CTranslate2 is a community-driven project. We welcome contributions of all kinds:

  • New Model Support: Help us implement more Transformer architectures.
  • Performance: Propose optimizations for CPU or GPU kernels.
  • Bug Reports: Open an issue if you find something not working as expected.
  • Documentation: Improve our guides or add new examples.

Check out our Contributing Guide to learn how to set up your development environment.

Additional resources

Metadata

Release files for ctranslate2 4.8.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for ctranslate2 4.8.3
File
ctranslate2-4.8.3-cp314-cp314t-win_amd64.whl CPython 3.14 CPython 3.14 free-threading Windows x86-64 Details
ctranslate2-4.8.3-cp314-cp314t-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp314-cp314t-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ ARM64, Linux glibc 2.27+ ARM64 Details
ctranslate2-4.8.3-cp314-cp314t-macosx_11_0_x86_64.whl CPython 3.14 CPython 3.14 free-threading macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp314-cp314t-macosx_11_0_arm64.whl CPython 3.14 CPython 3.14 free-threading macOS 11.0+ ARM64 Details
ctranslate2-4.8.3-cp314-cp314-win_amd64.whl CPython 3.14 CPython 3.14 Windows x86-64 Details
ctranslate2-4.8.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp314-cp314-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.14 CPython 3.14 Linux glibc 2.27+ ARM64, Linux glibc 2.28+ ARM64 Details
ctranslate2-4.8.3-cp314-cp314-macosx_11_0_x86_64.whl CPython 3.14 CPython 3.14 macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp314-cp314-macosx_11_0_arm64.whl CPython 3.14 CPython 3.14 macOS 11.0+ ARM64 Details
ctranslate2-4.8.3-cp313-cp313-win_amd64.whl CPython 3.13 CPython 3.13 Windows x86-64 Details
ctranslate2-4.8.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp313-cp313-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.13 CPython 3.13 Linux glibc 2.27+ ARM64, Linux glibc 2.28+ ARM64 Details
ctranslate2-4.8.3-cp313-cp313-macosx_11_0_x86_64.whl CPython 3.13 CPython 3.13 macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp313-cp313-macosx_11_0_arm64.whl CPython 3.13 CPython 3.13 macOS 11.0+ ARM64 Details
ctranslate2-4.8.3-cp312-cp312-win_amd64.whl CPython 3.12 CPython 3.12 Windows x86-64 Details
ctranslate2-4.8.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp312-cp312-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.12 CPython 3.12 Linux glibc 2.27+ ARM64, Linux glibc 2.28+ ARM64 Details
ctranslate2-4.8.3-cp312-cp312-macosx_11_0_x86_64.whl CPython 3.12 CPython 3.12 macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp312-cp312-macosx_11_0_arm64.whl CPython 3.12 CPython 3.12 macOS 11.0+ ARM64 Details
ctranslate2-4.8.3-cp311-cp311-win_amd64.whl CPython 3.11 CPython 3.11 Windows x86-64 Details
ctranslate2-4.8.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp311-cp311-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.11 CPython 3.11 Linux glibc 2.27+ ARM64, Linux glibc 2.28+ ARM64 Details
ctranslate2-4.8.3-cp311-cp311-macosx_11_0_x86_64.whl CPython 3.11 CPython 3.11 macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp311-cp311-macosx_11_0_arm64.whl CPython 3.11 CPython 3.11 macOS 11.0+ ARM64 Details
ctranslate2-4.8.3-cp310-cp310-win_amd64.whl CPython 3.10 CPython 3.10 Windows x86-64 Details
ctranslate2-4.8.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp310-cp310-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.10 CPython 3.10 Linux glibc 2.28+ ARM64, Linux glibc 2.27+ ARM64 Details
ctranslate2-4.8.3-cp310-cp310-macosx_11_0_x86_64.whl CPython 3.10 CPython 3.10 macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp310-cp310-macosx_11_0_arm64.whl CPython 3.10 CPython 3.10 macOS 11.0+ ARM64 Details
ctranslate2-4.8.3-cp39-cp39-win_amd64.whl CPython 3.9 CPython 3.9 Windows x86-64 Details
ctranslate2-4.8.3-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.9 CPython 3.9 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details
ctranslate2-4.8.3-cp39-cp39-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl CPython 3.9 CPython 3.9 Linux glibc 2.27+ ARM64, Linux glibc 2.28+ ARM64 Details
ctranslate2-4.8.3-cp39-cp39-macosx_11_0_x86_64.whl CPython 3.9 CPython 3.9 macOS 11.0+ x86-64 Details
ctranslate2-4.8.3-cp39-cp39-macosx_11_0_arm64.whl CPython 3.9 CPython 3.9 macOS 11.0+ ARM64 Details

Total release size: 631.1 MB

Release files / ctranslate2-4.8.3-cp314-cp314t-win_amd64.whl

Download URL ctranslate2-4.8.3-cp314-cp314t-win_amd64.whl
Size 19.5 MB
Tags CPython 3.14 CPython 3.14 free-threading Windows x86-64
SHA-256 checksum
How to use checksums
3e5f45b09cfd576d445de0f243e1f3419af96aaeda6b660074a884601cd8a66e
BLAKE2b-256 checksum
How to use checksums
3b6c2b4491e1b4578a1fb76f9c97054b3cb3471da9af5d40e7e301b4fb6dcf6b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314t-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp314-cp314t-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 40.4 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
604a163b486c7dcd1d6684dcd91675376168b6cb58d03a083474b24d42a80196
BLAKE2b-256 checksum
How to use checksums
2daf8edb114b4f8d9dcd64142f2c7e0f00e6224c942090cabc831c29d11ef077
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314t-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp314-cp314t-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.8 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
387da8d4c281d4e4284e398a96b89afc7c555fca270b7814de41a15a95306bf0
BLAKE2b-256 checksum
How to use checksums
217be520909e654cf1785cea29cc9f732317e08a50bacc70713fc7ac0ddf7ec4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314t-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp314-cp314t-macosx_11_0_x86_64.whl
Size 12.0 MB
Tags CPython 3.14 CPython 3.14 free-threading macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
30ec30fde852c236698890ff5c475ef32dcdaeed2f0cc92bbc23ef79199c274a
BLAKE2b-256 checksum
How to use checksums
77e4ff45605bf894250ec2e378fd5427a2ed5b5a702b4e41d63d92317f2e472f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314t-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp314-cp314t-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.14 CPython 3.14 free-threading macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
d3eb9dad7a3781edd0ea921473288d085a21284f0c6d00a3b01c479b36e30ae7
BLAKE2b-256 checksum
How to use checksums
bb88f7e1728f4de81926854eadb5a1ea3fadd650dcc19cb49682ac7a47ac92b1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314-win_amd64.whl

Download URL ctranslate2-4.8.3-cp314-cp314-win_amd64.whl
Size 19.5 MB
Tags CPython 3.14 Windows x86-64
SHA-256 checksum
How to use checksums
03b0ad8c6325f142341a7a7431b5ab693b51f43918be1c116b80ebb6e3c1f85e
BLAKE2b-256 checksum
How to use checksums
15997c3e8d0b8527acc4ed18ddc97f96d70928a672faba37d60cea1fe7bc831e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 40.2 MB
Tags CPython 3.14 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
7039b9b9f0520a891108b795c7bd960413cd54df9db319f9afc4c164d28336dc
BLAKE2b-256 checksum
How to use checksums
b297db80101f993f6febd1fbf91249cd900fc38af927cd90e04952400296ab45
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp314-cp314-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.6 MB
Tags CPython 3.14 Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
9f90e240ccb0b29d1296e435be2b73a915cf5770bf13b12d21d61470d9ce80c0
BLAKE2b-256 checksum
How to use checksums
eb4a735687d9bb5141e2a5ac6531482a4b1de2b06d7320c6f500590bb834b3bf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp314-cp314-macosx_11_0_x86_64.whl
Size 11.9 MB
Tags CPython 3.14 macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
69e62610ef4e6874c00fc2addf2218dd491652bd94cae42d4e8b326a497a3cd1
BLAKE2b-256 checksum
How to use checksums
dbcc080d5b3c68771b7bc068c63ce9343e34742470edaa507bce0274f1b4d768
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp314-cp314-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp314-cp314-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.14 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
851152c108e063db9c03620828f6ee0105f481f0360944207a12a3f361fc7e65
BLAKE2b-256 checksum
How to use checksums
85b11956d225ce13e27fed1bfa5d5f1637bbab3f7e954a0493c882bff3fa673e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp313-cp313-win_amd64.whl

Download URL ctranslate2-4.8.3-cp313-cp313-win_amd64.whl
Size 19.2 MB
Tags CPython 3.13 Windows x86-64
SHA-256 checksum
How to use checksums
c3c5d19b83df19f9f708ed16145fbc20b06827462f1a68c5286efc0ad41aa0c1
BLAKE2b-256 checksum
How to use checksums
1dd086d89881ffaa29ac54bb01a2da0b0680d39a9b737f5d0f799056ffc00bfe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 40.3 MB
Tags CPython 3.13 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
19deb5b17497bf588bb200f4114b1339f884929b3cba6644dc62a833acb0e623
BLAKE2b-256 checksum
How to use checksums
16f038111e687f35c4b85682738455989331ff9917c6e2818c2fa0c8cff8e293
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp313-cp313-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp313-cp313-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.6 MB
Tags CPython 3.13 Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
34f3ce8a4306a0d44d916fda7605fb71c6fa81411a147fb09ffe819ac4590f1b
BLAKE2b-256 checksum
How to use checksums
e0e206129fd90ce89a6c33551cb33e5a8310e662a4d709ba3a5d76322de8051f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp313-cp313-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp313-cp313-macosx_11_0_x86_64.whl
Size 11.9 MB
Tags CPython 3.13 macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
86daaf7f6b8b5527d7ea21205c5ab998d660a9f370451fd2861a00252d5b8115
BLAKE2b-256 checksum
How to use checksums
d2c4f09a8ddcfa53f5572b0af79266a8cb8687d46d175ead4fa923e8054295ac
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp313-cp313-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp313-cp313-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.13 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
a88f2782708edc20d03c3b811ecfec50ef12f9a92d7a6b5bd86edb1a4adb9cd7
BLAKE2b-256 checksum
How to use checksums
d2af6a3e6bd4b82aced0d39aa09fecae0a140980dc503f441a3a5cfefb3dd4f9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp312-cp312-win_amd64.whl

Download URL ctranslate2-4.8.3-cp312-cp312-win_amd64.whl
Size 19.2 MB
Tags CPython 3.12 Windows x86-64
SHA-256 checksum
How to use checksums
b5daf0758d522a422c76e53eb02ce9f42465a9aba938a86b27249fb5db2571b9
BLAKE2b-256 checksum
How to use checksums
dbf81aec2aaf0e8a09987085dd2e4a876619fee6026f20ed28a2c2efc6235bec
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 40.3 MB
Tags CPython 3.12 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
7e161eb031fcf2a5d81ce3a1cd8be4954c7df758d96cfaba57aeecc69a0c00ae
BLAKE2b-256 checksum
How to use checksums
b439438c9236c57443099763789ee009d6d43a65fb58283163fb0d6e6dadacd7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp312-cp312-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp312-cp312-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.6 MB
Tags CPython 3.12 Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
1b9ff80ed67ce7974cb0eafdf7ad79407678b5bea70db934c0d20aaa9db57964
BLAKE2b-256 checksum
How to use checksums
6899e08d28c28d45102c589fec3780a4410fe57d9e59a0839ad7f79dbc508cfb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp312-cp312-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp312-cp312-macosx_11_0_x86_64.whl
Size 11.9 MB
Tags CPython 3.12 macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
2bcbc6d49aca405dbb94f06437e8060107e52db9df0235c49a7aa9d99a3996e4
BLAKE2b-256 checksum
How to use checksums
4de0f82cd7926e74f812b1cb88b3616baa8cbdca3a8231ece516f773b61a373b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp312-cp312-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp312-cp312-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
116b7d90fbd704e990ba21f87b484dbdd3b1d9836fb7e642f4939237322bac83
BLAKE2b-256 checksum
How to use checksums
94b2a0908acaef272524e084b022775e0e5c5877e6216057246fb30b9957341f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp311-cp311-win_amd64.whl

Download URL ctranslate2-4.8.3-cp311-cp311-win_amd64.whl
Size 19.2 MB
Tags CPython 3.11 Windows x86-64
SHA-256 checksum
How to use checksums
6833b81fd7c86cb30c4a263033f4b60127f925120cc416ebeeb4c58ecba1f58b
BLAKE2b-256 checksum
How to use checksums
b90d217ea887dbc6feea8954620a020ba674cb5fd0bf17961a44a8b22602c8e4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 40.0 MB
Tags CPython 3.11 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
465622f9e81c823e50a8dfcbe27e6943e12d4f5eb638e169b4e6668db3e5ad2a
BLAKE2b-256 checksum
How to use checksums
b1f19e0423d83d4bc17f99cc84adefb676ae4afdd90556bb827b3af8b6917e88
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp311-cp311-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp311-cp311-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.4 MB
Tags CPython 3.11 Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
aeeb922d3e5ca30dc7d1fc62cd9d92683f03b65eaa5de4e891b9bc7654ab641f
BLAKE2b-256 checksum
How to use checksums
4e81a17348b33835f6d81ef84f7fa812c74819e62bde0c10af0c01e86e609da9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp311-cp311-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp311-cp311-macosx_11_0_x86_64.whl
Size 11.9 MB
Tags CPython 3.11 macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
b4e5ce85c87badf698be32aa04f053b7a20301a2965142ba724b0264c1d1c586
BLAKE2b-256 checksum
How to use checksums
babe3c5bf444bb2cb9213a6cdcc387ec19a2a0ac1c4683db4fac082036637cd9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp311-cp311-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp311-cp311-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
6d148423847df057662969866a434d5e1d58294b6cb08c6f9a7ca2613c301220
BLAKE2b-256 checksum
How to use checksums
d5a15bcd3046e4b46dca14019efbd46850347216a22541c28ffa163640cb3679
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp310-cp310-win_amd64.whl

Download URL ctranslate2-4.8.3-cp310-cp310-win_amd64.whl
Size 19.2 MB
Tags CPython 3.10 Windows x86-64
SHA-256 checksum
How to use checksums
3a6f8105815d81420ad7c24633a1355b682e6b5cdb3e422dc9c980655a76e94b
BLAKE2b-256 checksum
How to use checksums
1efc10b36bb4b6c06cbefc0cad5214362132c88594c03bdf4c4aafda261d4816
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 39.9 MB
Tags CPython 3.10 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
9b7c86002572d4f6fdd5909330fdc2e5dd2b2ceb978a95372c0926658c379962
BLAKE2b-256 checksum
How to use checksums
02be7104c6650d14815aeffc62f81acedffbb5278a9be3085d2b7433a137bcdf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp310-cp310-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp310-cp310-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.2 MB
Tags CPython 3.10 Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
7d7ca031cd994d303d30dea387c1a7cb9cace4ea58c84cec8ab9ba7cc2ca6c36
BLAKE2b-256 checksum
How to use checksums
aa6da89f4ac7859a346bc5554418f937c1930cc4b503a11f3c0b5ed3a345c1d1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp310-cp310-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp310-cp310-macosx_11_0_x86_64.whl
Size 11.9 MB
Tags CPython 3.10 macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
1730e334fa611703438fd97feea7e89ead333d10e8d9b5f38df4136e8c96b0f5
BLAKE2b-256 checksum
How to use checksums
73a1088c98b31396bdb37641cc4750c62463f0db2acba308fced5993a2fb885b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp310-cp310-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp310-cp310-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
b174efd7f9554b87b5a5125129c76a82736c2154d0e734ea2e55b3c58e75ba16
BLAKE2b-256 checksum
How to use checksums
af7607c2d83393f9071e66f7395ec333d0adea3c8b8e35be2ab4deaa87e4473d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp39-cp39-win_amd64.whl

Download URL ctranslate2-4.8.3-cp39-cp39-win_amd64.whl
Size 19.2 MB
Tags CPython 3.9 Windows x86-64
SHA-256 checksum
How to use checksums
cf4b55455cbd70177dec3a35a40bc864078c591e5bd8334ffaa58df7f5a9858c
BLAKE2b-256 checksum
How to use checksums
8ac5d79b007e56f67c06a62f9a19f19d9b9aa2398f2b7640b86b77bfa2e81a2d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL ctranslate2-4.8.3-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 39.9 MB
Tags CPython 3.9 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
49cd91bb2507861af827d40f37683662317c3a440a077434e93732f231e717ca
BLAKE2b-256 checksum
How to use checksums
fb705b798f7f1f3754e7bb751a2ec1d0c4fca5b2a6186252e7843290484ef6d2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp39-cp39-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl

Download URL ctranslate2-4.8.3-cp39-cp39-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Size 17.2 MB
Tags CPython 3.9 Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
57919198d914a3235a468e311699fd3b3dd51b44ee1ef9b4a2f691b92186ee3d
BLAKE2b-256 checksum
How to use checksums
c10320a9792a5600d6317a9fff7c33443c541ca4b80d2180065547513d3c2e02
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp39-cp39-macosx_11_0_x86_64.whl

Download URL ctranslate2-4.8.3-cp39-cp39-macosx_11_0_x86_64.whl
Size 11.9 MB
Tags CPython 3.9 macOS 11.0+ x86-64
SHA-256 checksum
How to use checksums
4184ceaa2145d6bb7e18d73a615804183323603d8c4ffddca5828fe6d5afde9b
BLAKE2b-256 checksum
How to use checksums
e915535eae972c13d85ca8235dcb2aecac17c4ce054b1ec4c20350da0487c975
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / ctranslate2-4.8.3-cp39-cp39-macosx_11_0_arm64.whl

Download URL ctranslate2-4.8.3-cp39-cp39-macosx_11_0_arm64.whl
Size 1.3 MB
Tags CPython 3.9 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
09abb685cbdae8ad896c12871837265bc6f08d58be6e1056ac39d95aba486ebd
BLAKE2b-256 checksum
How to use checksums
746485f0eda3350c3da4c7860b363b59e8f4d6e421bc9486196cbfcccef118f2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release history Release notifications | RSS feed

This release

4.8.3 This release

35 release files

4.8.2

35 release files

4.7.2

35 release files

4.5.0

20 release files

4.3.1

25 release files

4.2.1

25 release files

4.1.0

25 release files

4.0.0

25 release files

3.9.1

24 release files

3.9.0

24 release files

3.7.0

24 release files

3.6.0

24 release files

3.5.1

24 release files

3.5.0

24 release files

3.2.0

24 release files

3.1.0

24 release files

3.0.2

24 release files

3.0.1

24 release files

1.20.1

8 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page