Skip to main content

📜 notebooks and scripts for ai experiments and aws batch jobs.

Project description

📜 notebooks & [meta] scripts

notebooks and scripts for ai experiments and aws batch jobs.


image image image image
paint-a-sentence mission-patch roofAI-train
https://medium.com/@arash-kamangir/a-cat-walking-under-apple-trees-style-by-stable-diffusion-ab60ece43e2a https://medium.com/@arash-kamangir/private-mission-patch-%EF%B8%8F-1-0c2eddd79762 https://arash-kamangir.medium.com/roofai-%EF%B8%8F-on-gpu-6-b02f8f67ed3f

also: sagesemseg.


also home to workflow, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.

 > workflow help
workflow create \
	pattern=a-bc-d|hourglass,~upload \
	-|<job-name> \
	<command-line>
 . create a <pattern> workflow.
workflow monitor \
	~download,~upload \
	.|<job-name>
 . monitor workflow.
workflow submit \
	~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
	.|<job-name>
 . submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download

from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef

a-bc-d 🔗 hourglass 🔗 map-reduce 🔗
image image image

To use on AWS SageMaker replace <plugin-name> with nbs and follow these instructions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

notebooks_and_scripts-4.468.1.tar.gz (15.1 kB view hashes)

Uploaded Source

Built Distribution

notebooks_and_scripts-4.468.1-py3-none-any.whl (23.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page