Skip to main content

📜 notebooks and scripts for ai experiments and aws batch jobs.

Project description

📜 notebooks & scripts

📜 notebooks and scripts for ai experiments and aws batch jobs.

pip install notebooks-and-scripts

🔷 scripts 🔷 workflow 🔷


scripts

scripts are maintained as legacy and are replaced with @docker eval - <command>.

image image image image
paint-a-sentence mission-patch roofAI-train
https://medium.com/@arash-kamangir/a-cat-walking-under-apple-trees-style-by-stable-diffusion-ab60ece43e2a https://medium.com/@arash-kamangir/private-mission-patch-%EF%B8%8F-1-0c2eddd79762 https://arash-kamangir.medium.com/roofai-%EF%B8%8F-on-gpu-6-b02f8f67ed3f

also: sagesemseg.


workflow

also home to workflow, an abstraction to run mixed-type (cpu/gpu/...) DAGs of bash commands on aws batch.

 > workflow help
workflow create \
	pattern=a-bc-d|hourglass,~upload \
	-|<job-name> \
	<command-line>
 . create a <pattern> workflow.
workflow monitor \
	~download,~upload \
	.|<job-name>
 . monitor workflow.
workflow submit \
	~download,dryrun,to=aws_batch|generic|local|localflow,~upload \
	.|<job-name>
 . submit workflow.
@select - open
workflow create pattern=hourglass .
workflow submit to=aws_batch
@watch - @download

from https://arash-kamangir.medium.com/%EF%B8%8F-openai-experiments-54-e49117dc69ef

a-bc-d 🔗 hourglass 🔗 map-reduce 🔗
image image image

PyPI version

To use on AWS SageMaker replace <plugin-name> with nbs and follow these instructions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

notebooks_and_scripts-4.596.1.tar.gz (22.5 kB view details)

Uploaded Source

Built Distribution

notebooks_and_scripts-4.596.1-py3-none-any.whl (40.8 kB view details)

Uploaded Python 3

File details

Details for the file notebooks_and_scripts-4.596.1.tar.gz.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.596.1.tar.gz
Algorithm Hash digest
SHA256 a209588775f40522ec3e6eead3b5cbd01928d1c4e1dbc95b6002d8431acaf24b
MD5 901753a93cdd4d77e78d1c9f1b7837d0
BLAKE2b-256 2c413c8be70f527f109b901be9128968c2e3cdf928a54dd1de48c140ee2f92b0

See more details on using hashes here.

File details

Details for the file notebooks_and_scripts-4.596.1-py3-none-any.whl.

File metadata

File hashes

Hashes for notebooks_and_scripts-4.596.1-py3-none-any.whl
Algorithm Hash digest
SHA256 820ce9bdfef27a6e6cd969574a10046874e342fb64b05dd381864bf9804550bf
MD5 2d6a6c8afa99f5f36000bf6188e23f80
BLAKE2b-256 4a5b6c549500ba4a9ead1fa036bbc39448c41428c5f50f8aa8c72353379b5f64

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page