Skip to main content

📜 notebooks and scripts for ai experiments and aws batch jobs.

Project description

📜 notebooks & scripts

📜 notebooks and scripts for ai experiments and aws batch jobs.

pip install notebooks-and-scripts

🔷 scripts 🔷 workflow 🔷


scripts

scripts are maintained as legacy and are replaced with @docker eval - <command>.

image image image image
paint-a-sentence mission-patch roofAI-train
https://medium.com/@arash-kamangir/a-cat-walking-under-apple-trees-style-by-stable-diffusion-ab60ece43e2a https://medium.com/@arash-kamangir/private-mission-patch-%EF%B8%8F-1-0c2eddd79762 https://arash-kamangir.medium.com/roofai-%EF%B8%8F-on-gpu-6-b02f8f67ed3f

also: sagesemseg.


workflow

also home to workflow, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.

 > workflow help
workflow create \
	pattern=a-bc-d|hourglass,~upload \
	-|<job-name> \
	<command-line>
 . create a <pattern> workflow.
workflow monitor \
	~download,~upload \
	.|<job-name>
 . monitor workflow.
workflow submit \
	~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
	.|<job-name>
 . submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download

from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef

a-bc-d 🔗 hourglass 🔗 map-reduce 🔗
image image image

PyPI version

To use on AWS SageMaker replace <plugin-name> with nbs and follow these instructions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

notebooks_and_scripts-4.597.1.tar.gz (22.6 kB view details)

Uploaded Source

Built Distribution

notebooks_and_scripts-4.597.1-py3-none-any.whl (40.8 kB view details)

Uploaded Python 3

File details

Details for the file notebooks_and_scripts-4.597.1.tar.gz.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.597.1.tar.gz
Algorithm Hash digest
SHA256 517c4f5fafda1986226830bf9e36813aeed4abced97303e26063e589b0bf4135
MD5 3d1b6eb18e9952527facac5d8db479d0
BLAKE2b-256 5a421d9270aa253157e2a17b1f6b1d5ad73a333d1cfad994b7ee16c49477230c

See more details on using hashes here.

File details

Details for the file notebooks_and_scripts-4.597.1-py3-none-any.whl.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.597.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8ea0331c372c8de414190a5f3e8cb227644f21191df66b89c9d0150e662e67ca
MD5 6dfa2c642e1edc1458f540ab255c339e
BLAKE2b-256 ec9f5536a9f8b923f0d9069b5e614544a0d9d5f7823c104fcff8d212cb60067c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page