Skip to main content

NoneChucks is a library for PyTorch that allows you to drop samples from your data and ensures that your Datasets and Transforms do not fail because of a few samples that are not parseable.

Project description

# nonechucks

  • [Introduction](#Introduction)

  • [Installation](#Installation)

  • [Usage](#Usage)

  • [Examples](#Examples) - [SafeDataset](#SafeDataset) - [SafeSampler](#SafeSampler)

  • [Contributing](#Contributing)

  • [Licensing](#Licensing)

<a name=”Introduction”/>

## Introduction The point of any data processing pipeline is to reduce the burden of doing messy and repetitive tasks for the programmer. PyTorch’s flexibly designed data processing module makes it a breeze to do common tasks like shuffling, batching, and iterating through datasets. However, both the dataset and sampler expect you to rid your dataset of any unwanted or corrputed samples before you feed it to them, as they provide no easy way to define what action to take in case an invalid sample is encountered. In fact, for many applications, this defeats the whole point of using a data processing module.

Nonechucks

<a name=”Installation” />

## Installation To install Nonechucks, simply use pip:

$ pip install nonechucks

<a name=”Usage”/>

## Usage

<a name=”Example”/>

## Examples

<a name=”SafeDataset” />

### SafeDataset

<a name=”SafeSampler” />

### SafeSampler

<a name=”Contributing”/>

## Contributing

We appreciate all contributions. If you are planning to contribute back bug-fixes, please do so without any further discussion. If you plan to contribute new features, utility functions or extensions, please first open an issue and discuss the feature with us.

<a name=”Licensing”/>

## Licensing

Nonechucks is [MIT licensed](https://github.com/msamogh/nonechucks/blob/master/LICENSE).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nonechucks-0.1.1.tar.gz (4.4 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page