tqdm_batch
Batch processing using joblib including tqdm progress bars
Add batch processing to joblib, including tqdm progress bars.
Install
pip install tqdm_batch
Usage
Process a list of items using a function.
from tqdm_batch import batch_process
import random
import time
def batch_process_function(row, some_var):
time.sleep(0.01)
return row + random.randint(0, some_var)
N = 1_000
items = range(N)
result = batch_process(
items,
batch_process_function,
some_var=42,
n_workers=6,
sep_progress=True,
)
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tqdm_batch-0.1.0.tar.gz
(4.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tqdm_batch-0.1.0.tar.gz.
File metadata
- Download URL: tqdm_batch-0.1.0.tar.gz
- Upload date:
- Size: 4.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ee99acc7cf917944b8b480cc1db54ef25311dc4d29430f73579cc7b7c0d7e2e2
|
|
| MD5 |
b82bd7fea0b318f004ca539e0164508b
|
|
| BLAKE2b-256 |
1b0d13fa7ab620bad63ab667fd8f98e7a0c9fbb19fac4c0475625fb369bab7cd
|
File details
Details for the file tqdm_batch-0.1.0-py3-none-any.whl.
File metadata
- Download URL: tqdm_batch-0.1.0-py3-none-any.whl
- Upload date:
- Size: 5.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fd5afc95698c401eb9b395ce216e9b818ee195feba9b2c6059ae707cb62f2d59
|
|
| MD5 |
e805bf8d5f72466d8a05569e4aa7cd96
|
|
| BLAKE2b-256 |
a152483432667a397a9ca38b3cc7c711690206038d8b5705efeb8fde161c0e9d
|
