Skip to main content

📜 notebooks and scripts for ai experiments and aws batch jobs.

Project description

📜 notebooks & scripts

📜 notebooks and scripts for ai experiments and aws batch jobs.

pip install notebooks-and-scripts

🔷 scripts 🔷 workflow 🔷


scripts

scripts are maintained as legacy and are replaced with @docker eval - <command>.

image image image image
paint-a-sentence mission-patch roofAI-train
https://medium.com/@arash-kamangir/a-cat-walking-under-apple-trees-style-by-stable-diffusion-ab60ece43e2a https://medium.com/@arash-kamangir/private-mission-patch-%EF%B8%8F-1-0c2eddd79762 https://arash-kamangir.medium.com/roofai-%EF%B8%8F-on-gpu-6-b02f8f67ed3f

also: sagesemseg.


workflow

also home to workflow, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.

 > workflow help
workflow create \
	pattern=a-bc-d|hourglass,~upload \
	-|<job-name> \
	<command-line>
 . create a <pattern> workflow.
workflow monitor \
	~download,~upload \
	.|<job-name>
 . monitor workflow.
workflow submit \
	~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
	.|<job-name>
 . submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download

from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef

a-bc-d 🔗 hourglass 🔗 map-reduce 🔗
image image image

PyPI version

To use on AWS SageMaker replace <plugin-name> with nbs and follow these instructions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

notebooks_and_scripts-4.595.1.tar.gz (16.5 kB view details)

Uploaded Source

Built Distribution

notebooks_and_scripts-4.595.1-py3-none-any.whl (29.2 kB view details)

Uploaded Python 3

File details

Details for the file notebooks_and_scripts-4.595.1.tar.gz.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.595.1.tar.gz
Algorithm Hash digest
SHA256 06c87ae7f824db67e4be773dbc3fab61b24076b9b05b40541701e7ae0477129f
MD5 463b27f2d44b34f20202dced903a2ce4
BLAKE2b-256 05151cd8fbaf2d2a1b167e76f6bd59d873757b33e6c91ff418b04174d5cad009

See more details on using hashes here.

File details

Details for the file notebooks_and_scripts-4.595.1-py3-none-any.whl.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.595.1-py3-none-any.whl
Algorithm Hash digest
SHA256 025cdd42e04006364a73c56dc0b1e0d0201c4912541be34c35cf62e852981663
MD5 4326c7987e68d75bbf598781faf83bb0
BLAKE2b-256 5e173fab55acfd681d02cb9a6d57c670c4c99b16fe5f939de39ab1ef90c594da

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page