Overview
The SDMetrics library evaluates synthetic data by comparing it to the real data that you're trying to mimic. It includes a variety of metrics to capture different aspects of the data, for example quality and privacy. It also includes reports that you can run to generate insights, visualize data and share with your team.
The SDMetrics library is model-agnostic, meaning you can use any synthetic data. The library does not need to know how you created the data.
Install
Install SDMetrics using pip or conda. We recommend using a virtual environment to avoid conflicts with other software on your device.
pip install sdmetrics
conda install -c conda-forge sdmetrics
For more information about using SDMetrics, visit the SDMetrics Documentation.
Usage
Get started with SDMetrics Reports using some demo data,
from sdmetrics import load_demo
from sdmetrics.reports.single_table import QualityReport
real_data, synthetic_data, metadata = load_demo(modality='single_table')
my_report = QualityReport()
my_report.generate(real_data, synthetic_data, metadata)
Creating report: 100%|██████████| 4/4 [00:00<00:00, 5.22it/s]
Overall Quality Score: 82.84%
Properties:
Column Shapes: 82.78%
Column Pair Trends: 82.9%
Once you generate the report, you can drill down on the details and visualize the results.
my_report.get_visualization(property_name='Column Pair Trends')
Save the report and share it with your team.
my_report.save(filepath='demo_data_quality_report.pkl')
# load it at any point in the future
my_report = QualityReport.load(filepath='demo_data_quality_report.pkl')
Want more metrics? You can also manually apply any of the metrics in this library to your data.
# calculate whether the synthetic data respects the min/max bounds
# set by the real data
from sdmetrics.single_column import BoundaryAdherence
BoundaryAdherence.compute(real_data['start_date'], synthetic_data['start_date'])
0.8503937007874016
# calculate whether the synthetic data is new or whether it's an exact copy of the real data
from sdmetrics.single_table import NewRowSynthesis
NewRowSynthesis.compute(real_data, synthetic_data, metadata)
1.0
What's next?
To learn more about the reports and metrics, visit the SDMetrics Documentation.
The Synthetic Data Vault Project was first created at MIT's Data to AI Lab in 2016. After 4 years of research and traction with enterprise, we created DataCebo in 2020 with the goal of growing the project. Today, DataCebo is the proud developer of SDV, the largest ecosystem for synthetic data generation & evaluation. It is home to multiple libraries that support synthetic data, including:
- 🔄 Data discovery & transformation. Reverse the transforms to reproduce realistic data.
- 🧠 Multiple machine learning models -- ranging from Copulas to Deep Learning -- to create tabular, multi table and time series data.
- 📊 Measuring quality and privacy of synthetic data, and comparing different synthetic data generation models.
Get started using the SDV package -- a fully integrated solution and your one-stop shop for synthetic data. Or, use the standalone libraries for specific needs.
9 maintainers
Release files for sdmetrics 0.32.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sdmetrics-0.32.0.tar.gz | 173.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sdmetrics-0.32.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 433.2 kB
Release files / sdmetrics-0.32.0.tar.gz
| Download URL | sdmetrics-0.32.0.tar.gz |
|---|---|
| Size | 173.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a5ace74bf6659337d479de1ee7b0cec5834cab64ebbe5901d1724380169559ef
|
|
BLAKE2b-256 checksum How to use checksums |
6b9a78e6c3b06c31f246a77b3894276471744526e74f379c05c4fc3e7e319f68
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 25, 2026.
Transparency logRelease files / sdmetrics-0.32.0-py3-none-any.whl
| Download URL | sdmetrics-0.32.0-py3-none-any.whl |
|---|---|
| Size | 259.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d37547931ffa10bb6267f3b82340f9bcd1a3baceabfb5eb18de93053ed541638
|
|
BLAKE2b-256 checksum How to use checksums |
dd48e83cac4935cf7c84d07cc93a7dd869e7d6504f32feb84cf6859a53207e55
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 25, 2026.
Transparency log
