Skip to main content

📜 notebooks and scripts for ai experiments and aws batch jobs.

Project description

📜 notebooks & scripts

📜 notebooks and scripts for ai experiments and aws batch jobs.

pip install notebooks-and-scripts

🔷 scripts 🔷 workflow 🔷


scripts

scripts are maintained as legacy and are replaced with @docker eval - <command>.

image image image image
paint-a-sentence mission-patch roofAI-train
https://medium.com/@arash-kamangir/a-cat-walking-under-apple-trees-style-by-stable-diffusion-ab60ece43e2a https://medium.com/@arash-kamangir/private-mission-patch-%EF%B8%8F-1-0c2eddd79762 https://arash-kamangir.medium.com/roofai-%EF%B8%8F-on-gpu-6-b02f8f67ed3f

also: sagesemseg.


workflow

also home to workflow, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.

 > workflow help
workflow create \
	pattern=a-bc-d|hourglass,~upload \
	-|<job-name> \
	<command-line>
 . create a <pattern> workflow.
workflow monitor \
	~download,~upload \
	.|<job-name>
 . monitor workflow.
workflow submit \
	~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
	.|<job-name>
 . submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download

from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef

a-bc-d 🔗 hourglass 🔗 map-reduce 🔗
image image image

PyPI version

To use on AWS SageMaker replace <plugin-name> with nbs and follow these instructions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

notebooks_and_scripts-4.593.1.tar.gz (16.5 kB view details)

Uploaded Source

Built Distribution

notebooks_and_scripts-4.593.1-py3-none-any.whl (29.2 kB view details)

Uploaded Python 3

File details

Details for the file notebooks_and_scripts-4.593.1.tar.gz.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.593.1.tar.gz
Algorithm Hash digest
SHA256 503808a932d57bf47d9e96d00af456ce709d9de3ca7276cdeb62680d0519c080
MD5 4b777b7e0bdf552cf9e407df5e1fd539
BLAKE2b-256 57b40d69e2dc782610cd9102457d429721cd31d879f5792de94edd453c54fac8

See more details on using hashes here.

File details

Details for the file notebooks_and_scripts-4.593.1-py3-none-any.whl.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.593.1-py3-none-any.whl
Algorithm Hash digest
SHA256 44abb27350e95e9ab43e252f7b36b26f8cbec9d2133ae1f28a3ac4829317fa4f
MD5 eeba7682afa288cf7a22592fa5ccd93f
BLAKE2b-256 653fd2855d8a8ac4e8593458342f36ca0875540450241e19041b4f4410b59064

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page