📜 notebooks and scripts for ai experiments and aws batch jobs.
Project description
📜 notebooks & scripts
📜 notebooks and scripts for ai experiments and aws batch jobs.
pip install notebooks-and-scripts
scripts
scripts are maintained as legacy and are replaced with @docker eval - <command>
.
also: sagesemseg
.
workflow
also home to workflow
, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.
> workflow help
workflow create \
pattern=a-bc-d|hourglass,~upload \
-|<job-name> \
<command-line>
. create a <pattern> workflow.
workflow monitor \
~download,~upload \
.|<job-name>
. monitor workflow.
workflow submit \
~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
.|<job-name>
. submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download
from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef
a-bc-d 🔗 |
hourglass 🔗 |
map-reduce 🔗 |
---|---|---|
To use on AWS SageMaker replace <plugin-name>
with nbs
and follow these instructions.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file notebooks_and_scripts-4.598.1.tar.gz
.
File metadata
- Download URL: notebooks_and_scripts-4.598.1.tar.gz
- Upload date:
- Size: 22.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.19
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 67325a9a50b0361fddd758547bd8c7a5c2592784d4329847dc15d68b8e3561a6 |
|
MD5 | 19c7debbea971a80a7c388900f5585a4 |
|
BLAKE2b-256 | 86c98664181ecb0f6af63d184d62d0b4768ebbaa17ed4362c5c9bdbce72fb942 |
File details
Details for the file notebooks_and_scripts-4.598.1-py3-none-any.whl
.
File metadata
- Download URL: notebooks_and_scripts-4.598.1-py3-none-any.whl
- Upload date:
- Size: 40.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.19
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d5ab8d9af85ede39ea3f1d20027461ba7549995908bc90732928b99d945b108f |
|
MD5 | bdd5d04e75fadac8806c65c2c6857ff3 |
|
BLAKE2b-256 | 6384fef5b3b967791c1b054d0930365b2c580ae548930afde0707aaeba21f8b2 |