Skip to main content

YData SDK allows to use the *Data-Centric* tools from the YData ecosystem to accelerate AI development

Project description

YData SDK

YData Logo

pypi Pythonversion downloads


🎊 YData SDK for improved data quality everywhere!

ydata-sdk v0.1.0 is here! Create a YData account so you can start using today!


Documentation | More on YData

Overview

The YData SDK is an ecosystem of methods that allows users to, through a python interface, adopt a Data-Centric approach towards the AI development. The solution includes a set of integrated components for data ingestion, standardized data quality evaluation and data improvement, such as synthetic data generation, allowing an iterative improvement of the datasets used in high-impact business applications.

Synthetic data can be used as Machine Learning performance enhancer, to augment or mitigate the presence of bias in real data. Furthermore, it can be used as a Privacy Enhancing Technology, to enable data-sharing initiatives or even to fuel testing environments.

Under the YData SDK hood, you can find a set of algorithms and metrics based on statistics and deep learning based techniques, that will help you to accelerate your data preparation.

What you can expect:

YData SDK is composed by the following main modules:

  • Datasources

    • YData’s SDK includes several connectors for easy integration with existing data sources. It supports several storage types, like filesystems and RDBMS. Check the list of connectors.
    • SDK’s Datasources run on top of Dask, which allows it to deal with not only small workloads but also larger volumes of data.
  • Synthesizers

    • Simplified interface to train a generative model and learn in a data-driven manner the behavior, the patterns and original data distribution. Optimize your model for privacy or utility use-cases.
    • From a trained synthesizer, you can generate synthetic samples as needed and parametrise the number of records needed.
  • Synthetic data quality report Coming soon

    • An extensive synthetic data quality report that measures 3 dimensions: privacy, utility and fidelity of the generated data. The report can be downloaded in PDF format for ease of sharing and compliance purposes or as a JSON to enable the integration in data flows.
  • Profiling Coming soon

    • A set of metrics and algorithms summarizes datasets quality in three main dimensions: warnings, univariate analysis and a multivariate perspective.

Supported data formats

  • Tabular The RegularSynthesizer is perfect to synthesize high-dimensional data, that is time-independent with high quality results.
  • Time-Series The TimeSeriesSynthesizer is perfect to synthesize both regularly and not evenly spaced time-series, from smart-sensors to stock.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

ydata_sdk-0.11.0-py310-none-any.whl (118.1 kB view hashes)

Uploaded py310

ydata_sdk-0.11.0-py39-none-any.whl (117.2 kB view hashes)

Uploaded py39

ydata_sdk-0.11.0-py38-none-any.whl (117.4 kB view hashes)

Uploaded py38

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page