Skip to main content

Generate synthetic data that simulate a given dataset.

Project description

PyPi Shield Travis CI Shield

DataSynthesizer

DataSynthesizer generates synthetic data that simulates a given dataset.

It aims to facilitate the collaborations between data scientists and owners of sensitive data. It applies Differential Privacy techniques to achieve strong privacy guarantee.

For more details, please refer to DataSynthesizer: Privacy-Preserving Synthetic Datasets

Install DataSynthesizer

pip install DataSynthesizer

Usage

Assumptions for the Input Dataset

  1. The input dataset is a table in first normal form (1NF).
  2. When implementing differential privacy, DataSynthesizer injects noises into the statistics within active domain that are the values presented in the table.

Use Jupyter Notebooks

# install jupyter first
pip install jupyter

There are some demos in ./notebooks/

Use webUI

DataSynthesizer can be executed by a web-based UI.

# install django
pip install django

# go to the directory for webUI
cd DataSynthesizer/webUI/

# run the server
python manage.py runserver

Then open a browser and visit http://127.0.0.1:8000/synthesizer/

History

0.1.0 - 2020-06-11

  • First release on PyPI.

0.1.1 - 2020-07-05

Bugs Fixed

  • Numpy error when synthesising data with unique identifiers. - Issue #23 by @raids

0.1.2 - 2020-07-19

Bugs Fixed

  • infer_distribution() for string attributes fails to sort index of varying types. - Issue #24 by @raids

0.1.3 - 2020-09-13

Bugs Fixed

  • The dataframes are not appended into the full space in get_noisy_distribution_of_attributes(). - Issue #26 by @zjroth

0.1.4 - 2021-01-14

Bugs Fixed

  • Fix a bug in candidate key identification.

0.1.5 - 2021-03-11

What's New

  • Downgrade required Python from >=3.8 to >=3.7.

0.1.6 - 2021-03-11

What's New

  • Update example notebooks.

0.1.7 - 2021-03-31

Bugs Fixed

  • Fixed an error in Laplace noise parameter. - Issue #34 by @ganevgv

0.1.8 - 2021-04-09

Bugs Fixed

  • The randomness seeding is effective across the entire project now.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

DataSynthesizer-0.1.8.tar.gz (125.1 kB view hashes)

Uploaded Source

Built Distribution

DataSynthesizer-0.1.8-py2.py3-none-any.whl (23.9 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page