Skip to main content

📜 notebooks and scripts for ai experiments and aws batch jobs.

Project description

📜 notebooks & scripts

📜 notebooks and scripts for ai experiments and aws batch jobs.

pip install notebooks-and-scripts

🔷 scripts 🔷 workflow 🔷


scripts

scripts are maintained as legacy and are replaced with @docker eval - <command>.

image image image image
paint-a-sentence mission-patch roofAI-train
https://medium.com/@arash-kamangir/a-cat-walking-under-apple-trees-style-by-stable-diffusion-ab60ece43e2a https://medium.com/@arash-kamangir/private-mission-patch-%EF%B8%8F-1-0c2eddd79762 https://arash-kamangir.medium.com/roofai-%EF%B8%8F-on-gpu-6-b02f8f67ed3f

also: sagesemseg.


workflow

also home to workflow, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.

 > workflow help
workflow create \
	pattern=a-bc-d|hourglass,~upload \
	-|<job-name> \
	<command-line>
 . create a <pattern> workflow.
workflow monitor \
	~download,~upload \
	.|<job-name>
 . monitor workflow.
workflow submit \
	~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
	.|<job-name>
 . submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download

from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef

a-bc-d 🔗 hourglass 🔗 map-reduce 🔗
image image image

PyPI version

To use on AWS SageMaker replace <plugin-name> with nbs and follow these instructions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

notebooks_and_scripts-4.598.1.tar.gz (22.6 kB view details)

Uploaded Source

Built Distribution

notebooks_and_scripts-4.598.1-py3-none-any.whl (40.8 kB view details)

Uploaded Python 3

File details

Details for the file notebooks_and_scripts-4.598.1.tar.gz.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.598.1.tar.gz
Algorithm Hash digest
SHA256 67325a9a50b0361fddd758547bd8c7a5c2592784d4329847dc15d68b8e3561a6
MD5 19c7debbea971a80a7c388900f5585a4
BLAKE2b-256 86c98664181ecb0f6af63d184d62d0b4768ebbaa17ed4362c5c9bdbce72fb942

See more details on using hashes here.

File details

Details for the file notebooks_and_scripts-4.598.1-py3-none-any.whl.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.598.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d5ab8d9af85ede39ea3f1d20027461ba7549995908bc90732928b99d945b108f
MD5 bdd5d04e75fadac8806c65c2c6857ff3
BLAKE2b-256 6384fef5b3b967791c1b054d0930365b2c580ae548930afde0707aaeba21f8b2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page