Skip to main content

DatasetLens 🔍

Open-source dataset inspection and quality analysis toolkit for ML datasets.


Introduction

Inspect your datasets before training models!

DatasetLens helps you understand what is inside your datasets before they reach your training pipeline.

It can help identify:

  • File formats
  • Dataset composition
  • Supported and unsupported files
  • Broken or corrupt files
  • Duplicate files
  • Encoding and language information
  • Dataset-level statistics

The goal is simple: "Know your dataset before you train your model."


Project Status

🚧 Early Development

DatasetLens is actively evolving.

  • v0.1.0-alpha — Early development build (Deleted, due to crashes)
  • v0.2.0-alphs — Stable text-only build <----- Typo error must not die! 💀
  • v0.3.0-alpha — Image inspection added

Current development is focused on stability, inspection quality, and expanding supported modalities.

Star this repo for upcoming features or issue a request instead! 🐱


Quick List

Implemented

  • Text Inspector ✅
  • Image Inspector ✅

In Development

  • Duplicate Detection
  • Advanced Text Inspection
  • Advanced Image Inspection

Future Modalities

  • 3D Voxel
  • Point Clouds
  • TIFF
  • Audio
  • Video
  • Graph
  • NLP

Documentation

For deeper project information:


Metadata

Release files for datasetlens 0.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for datasetlens 0.3.0
File Size Uploaded Provenance
datasetlens-0.3.0.tar.gz 8.5 kB With provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for datasetlens 0.3.0
File Interpreter ABI Platform
datasetlens-0.3.0-py3-none-any.whl Python 3 none any Details

Total release size: 19.6 kB

Release files / datasetlens-0.3.0.tar.gz

Download URL datasetlens-0.3.0.tar.gz
Size 8.5 kB
Tags Source
SHA-256 checksum
How to use checksums
b6fd21c89941c391f9c2a800ddd4f5493c10858c11f4bce6c21060c0dcc8a043
BLAKE2b-256 checksum
How to use checksums
53335c162e06a946b2a8401b77dc034304c3c1bde997b294015cbaeb7d742843
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 26, 2026.

Transparency log

Release files / datasetlens-0.3.0-py3-none-any.whl

Download URL datasetlens-0.3.0-py3-none-any.whl
Size 11.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
624fa07df1141fce2a47b5a94a3982c942dcc081b12c4636a51e7327bd36c11a
BLAKE2b-256 checksum
How to use checksums
1ad5c1ee191314fb59867f48b9e44e37b6e2ed85f803c52a32816d1d091a7ae6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 26, 2026.

Transparency log

Security for datasetlens 0.3.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for datasetlens-0.3.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 26, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.3.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page