Skip to main content

AutoDC

Automated data-centric processing

This repository is the official Python implementation of position paper "AutoDC: Automated data-centric processing". The implementation will continue being updated in the coming months.

image

AutoDC is a framework to enable domain experts to automatically and systematically improve datasets without much coding requirement and manual process, the idea similar with AutoML (automated machine learning).

By using the AutoML system, such as Google Cloud AutoML, domain experts only need to bring in the input data, and AutoML takes care of the manual ML processes, then produces output predictions, along with user-defined evaluation metrics. With a similar idea, AutoDC is designed for domain experts to bring in a labeled dataset, such as annotated images, to the system; AutoDC takes care of the manual data improvement processes, and produces the improved dataset, by automatically correcting the incorrect labels (with user feedbacks), detecting edge cases, and augmenting edge cases.

Citation

Zac Yung-Chun Liu, Shoumik Roychowdhury, Scott Tarlow, Akash Nair, Shweta Badhe, and Tejas Shah. AutoDC: Automated data-centric processing, NeurIPS 2021: DCAI workshop, arXiv: 2111.12548.

Metadata

Release files for autodc 1.0.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for autodc 1.0.6
File Size Uploaded
autodc-1.0.6.tar.gz 8.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for autodc 1.0.6
File Interpreter ABI Platform
autodc-1.0.6-py3-none-any.whl Python 3 none any Details

Total release size: 19.2 kB

Release files / autodc-1.0.6.tar.gz

Download URL autodc-1.0.6.tar.gz
Size 8.7 kB
Tags Source
SHA-256 checksum
How to use checksums
dd1228276bcd8e8674f5c0ddf8da81a45c6c5646e71ce59cdbbe620b1b0c72dd
BLAKE2b-256 checksum
How to use checksums
ef118ad2dbf9c3c35cf4e6bbd0c012772b252152ae65f3558ed402a6ba1f33a1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.2

Release files / autodc-1.0.6-py3-none-any.whl

Download URL autodc-1.0.6-py3-none-any.whl
Size 10.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
402d7a23ff3b22e8765a3b2cee290d1e1ccc36a70427317aade646782e814273
BLAKE2b-256 checksum
How to use checksums
5dfe10445b7db4fea9ab9d8ca8ce2650455a9b4743dbb1a3cde03a61d8d3e186
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.2

Release history Release notifications | RSS feed

This release

1.0.6 This release

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page