Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Daft dataframes can load any data such as PDF documents, images, protobufs, csv, parquet and audio files into a table dataframe structure for easy querying

GitHub Actions tests PyPI latest tag Coverage slack community

Website • Docs • Installation • Daft Quickstart • Community and Support

Daft: High-Performance Data Engine for AI and Multimodal Workloads

Eventual-Inc/Daft | Trendshift

Daft is a high-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale.

  • Native multimodal processing: Process images, audio, video, and embeddings alongside structured data in a single framework

  • Built-in AI operations: Run LLM prompts, generate embeddings, and classify data at scale using OpenAI, Transformers, or custom models

  • Python-native, Rust-powered: Skip the JVM complexity with Python at its core and Rust under the hood for blazing performance

  • Seamless scaling: Start local, scale to distributed clusters on Ray, Kubernetes

  • Universal connectivity: Access data anywhere (S3, GCS, Iceberg, Delta Lake, Hugging Face, Unity Catalog)

  • Out-of-box reliability: Intelligent memory management and sensible defaults eliminate configuration headaches

Getting Started

Installation

Install Daft with pip install daft. Requires Python 3.10 or higher.

For more advanced installations (e.g. installing from source or with extra dependencies such as Ray and AWS utilities), please see our Installation Guide

Quickstart

Get started in minutes with our Quickstart - load a real-world e-commerce dataset, process product images, and run AI inference at scale.

More Resources

  • Examples - see Daft in action with use cases across text, images, audio, and more

  • User Guide - take a deep-dive into each topic within Daft

  • API Reference - API reference for public classes/functions of Daft

Benchmarks

AI Benchmarks

To see the full benchmarks, detailed setup, and logs, check out our benchmarking page.

Contributing

We ❤️ developers! To start contributing to Daft, please read CONTRIBUTING.md. This document describes the development lifecycle and toolchain for working on Daft. It also details how to add new functionality to the core engine and expose it through a Python API.

Here’s a list of good first issues to get yourself warmed up with Daft. Comment in the issue to pick it up, and feel free to ask any questions!

Telemetry

To help improve Daft, we collect non-identifiable data via Scarf (https://scarf.sh).

To disable this behavior, set the environment variable DO_NOT_TRACK=true.

The data that we collect is:

  1. Non-identifiable: No session IDs or user identifiers are collected

  2. Metadata-only: We do not collect any of our users’ proprietary code or data

  3. For development only: We do not buy or sell any user data

Please see our documentation for more details.

https://static.scarf.sh/a.png?x-pxid=31f8d5ba-7e09-4d75-8895-5252bbf06cf6

License

Daft has an Apache 2.0 license - please see the LICENSE file.

Metadata

Release files for daft 0.8.0rc1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for daft 0.8.0rc1
File Size Uploaded Provenance Actions
daft-0.8.0rc1.tar.gz 3.5 MB With provenance Details for daft-0.8.0rc1.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for daft 0.8.0rc1
File Actions
daft-0.8.0rc1-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for daft-0.8.0rc1-cp310-abi3-win_amd64.whl
daft-0.8.0rc1-cp310-abi3-manylinux_2_24_x86_64.whl CPython 3.10 abi3 Linux glibc 2.24+ x86-64 Details for daft-0.8.0rc1-cp310-abi3-manylinux_2_24_x86_64.whl
daft-0.8.0rc1-cp310-abi3-manylinux_2_24_aarch64.whl CPython 3.10 abi3 Linux glibc 2.24+ ARM64 Details for daft-0.8.0rc1-cp310-abi3-manylinux_2_24_aarch64.whl
daft-0.8.0rc1-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for daft-0.8.0rc1-cp310-abi3-macosx_11_0_arm64.whl
daft-0.8.0rc1-cp310-abi3-macosx_10_12_x86_64.whl CPython 3.10 abi3 macOS 10.12+ x86-64 Details for daft-0.8.0rc1-cp310-abi3-macosx_10_12_x86_64.whl

Total release size: 274.7 MB

Release files / daft-0.8.0rc1.tar.gz

Download URL daft-0.8.0rc1.tar.gz
Size 3.5 MB
Tags Source
SHA-256 checksum
How to use checksums
382b6d208c299538ae22f0fb5d07bfea11cb20ecde98ee7ff020e3a9ae71e994
BLAKE2b-256 checksum
How to use checksums
cf95c5a40f6fc0162355a51cfa43339a383aa3191e1d40289ae775c1928587cf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Release files / daft-0.8.0rc1-cp310-abi3-win_amd64.whl

Download URL daft-0.8.0rc1-cp310-abi3-win_amd64.whl
Size 55.5 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
37ba8ea9f8b55e974b3b086f4f5fcdb4da5e94d58896280221dd5ebcf28e6c23
BLAKE2b-256 checksum
How to use checksums
066de9d84d409bc8996a34a45006cd5e2390430b88a1328d6c1e52358ca561dc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Release files / daft-0.8.0rc1-cp310-abi3-manylinux_2_24_x86_64.whl

Download URL daft-0.8.0rc1-cp310-abi3-manylinux_2_24_x86_64.whl
Size 56.0 MB
Tags CPython 3.10 Linux glibc 2.24+ x86-64 abi3
SHA-256 checksum
How to use checksums
6e81ff8afb915184060e06dc7b139ac50110a6b4c4a9441f49527a4b2fb15108
BLAKE2b-256 checksum
How to use checksums
cccec76a91082a8b435cf867ecde7da01542ce5cac5f4b4df56f6f178e27ddd1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Release files / daft-0.8.0rc1-cp310-abi3-manylinux_2_24_aarch64.whl

Download URL daft-0.8.0rc1-cp310-abi3-manylinux_2_24_aarch64.whl
Size 54.0 MB
Tags CPython 3.10 Linux glibc 2.24+ ARM64 abi3
SHA-256 checksum
How to use checksums
c8265082418bf496919b85d1f9854bfd9536d1c35bebf4366234decffd3410a1
BLAKE2b-256 checksum
How to use checksums
4f20d50594aa93d487172dcb1d26c7851e207d0f41c3c451017c8a8e941402d5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Release files / daft-0.8.0rc1-cp310-abi3-macosx_11_0_arm64.whl

Download URL daft-0.8.0rc1-cp310-abi3-macosx_11_0_arm64.whl
Size 50.9 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
1b6670c911b2fc3e6e489f4246b7107ba870e032d3345980f09512d8d420e4ca
BLAKE2b-256 checksum
How to use checksums
ee02f4acd52ccdb5d6fbda0245ca08a58a6c64507bd8c952ce350d078b228e4c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Release files / daft-0.8.0rc1-cp310-abi3-macosx_10_12_x86_64.whl

Download URL daft-0.8.0rc1-cp310-abi3-macosx_10_12_x86_64.whl
Size 54.8 MB
Tags CPython 3.10 abi3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
bb48155810a3872a09edc9c98e22cfc3cf49e45bcc7acec6581bb8cfca0a3467
BLAKE2b-256 checksum
How to use checksums
32133d3b34998dc18989874feb0f3f8b08cb425669b6194d5e5a61c5ac4af871
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Security for daft 0.8.0rc1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 6 files in this release have been uploaded with provenance metadata.

Select from 6 files

Attestation for daft-0.8.0rc1.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page