No project description provided
Project description
Threaded File Loader
Multithreaded Python package for faster file loading in machine learning.
Installation
pip install ThreadedFileLoader
Usage:
ImageLoading
from ThreadedFileLoader.ThreadedFileLoader import *
instance = ThreadedImageLoader("path_to_/*.jpg")
instance.start_loading()
images = instance.loaded_objects
Loading Custom File Formats
Threaded FileLoader can load different file types.
This examples shows how the ThreadedTextLoader
class
overloads the ThreadedFileLoader
class to load text files.
from ThreadedFileLoader.ThreadedFileLoader import *
class ThreadedTextLoader(ThreadedFileLoader):
def object_loader(self, path):
with open(path) as afile:
data = afile.readlines()
return data
instance = ThreadedTextLoader("path_to_/*.txt")
instance.start_loading()
texts = instance.loaded_objects
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for ThreadedFileLoader-1.0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | cedd670f34674d3a16f027efb627dda2a91f7b053c778322ae6eaf78755c4427 |
|
MD5 | db04a506bc89d8993991c6b714ce298d |
|
BLAKE2b-256 | e0318ea1c2a2a2bc660c097ea0acaa59600a441ec6ae277d8a19a680c02ee76c |
Close
Hashes for ThreadedFileLoader-1.0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc6ee9ec5ad51c30f79786e1e8c3463dd5eaff36057c301f4ce89a1f28f5a17a |
|
MD5 | f90fcd00b3bcf8106340644dc0632fbe |
|
BLAKE2b-256 | 634141b2c3db10227f8e8156f953f40ecc41c97a8644939328b92d2a8a59a840 |