Skip to main content

LLM-wired bioinformatics pipeline orchestration over containerised tools

Project description

biocomposer

Graph-based orchestration of bioinformatics tools. Full documentation: https://mlberkeley.github.io/BioComposer-graph-based-orchestration-of-bioinformatics-tools-documentation/

Setup (both local and Modal)

pip install biocomposer
mkdir inputs              # put your FASTA/PDB/etc. files here
mkdir run                 # holds your pipeline script

Create a .env file in your working directory with the API key(s) you use (GEMINI_API_KEY, GOOGLE_API_KEY, ANTHROPIC_API_KEY, or OPENAI_API_KEY).

Create run/run_pipeline.py to define your pipeline.

Running locally

Prerequisites: Docker installed and running, bv installed (cargo install biov).

biocomp run run/run_pipeline.py --env .env

Outputs go to ./results/.

Running on Modal

pip install modal
modal setup
biocomp run --modal run/run_pipeline.py --env .env
modal volume get biocomp results/fasttree_output_1/stdout/fasttree_stdout.txt ./fasttree_stdout.txt

Flags

--env <path>      [both]  env file with API keys (default .env)
--clean           [both]  clear previous outputs first
--modal           [both]  run on Modal instead of locally
--gpu T4          [modal] GPU type (default A10G)
--memory 32768    [modal] sandbox memory in MB (default 8192)
--shell           [modal] drop into an interactive sandbox shell

Overriding a tool's command

By default a node runs the tool's entrypoint binary with its registry args. Override either when needed (slots like {input}/{output} map to the node's I/O):

# run a different exposed binary instead of the entrypoint
g.add_node("trimal", entrypoint_override="readal")

# replace the argument template
g.add_node("colabfold", args_override="--num-recycle 0 {fasta} {output_dir}")

# both together (common for non-entrypoint binaries)
g.add_node("trimal", entrypoint_override="readal",
           args_override="-in {alignment} -out {trimmed} -fasta")

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

biocomposer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (652.2 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

biocomposer-0.1.4-cp312-cp312-macosx_11_0_arm64.whl (518.2 kB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

biocomposer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (669.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

biocomposer-0.1.4-cp311-cp311-macosx_11_0_arm64.whl (520.5 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

biocomposer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (669.2 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

biocomposer-0.1.4-cp310-cp310-macosx_11_0_arm64.whl (524.2 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

File details

Details for the file biocomposer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for biocomposer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d24a5fc5024595805dfcc39be92607c4d8b6c4ab8b405a60f281f28e7493f1bc
MD5 b902d66c81be7a287a3f3be9b08e74a4
BLAKE2b-256 bc55b85d4ebf712be0dadc265aed916c93175da4066c87fff896801402e7bdb8

See more details on using hashes here.

Provenance

The following attestation bundles were made for biocomposer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: publish.yml on mlberkeley/BioComposer-graph-based-orchestration-of-bioinformatics-tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file biocomposer-0.1.4-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for biocomposer-0.1.4-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f6e9f1f8fc69beed8b8396ea5b66cb53a7a93e298b667939a820eb2a509a4bf4
MD5 1a0ec322e6ade99fafe93838e4a2e628
BLAKE2b-256 fe00714ee586ec29f851ff12a13fc3157bccc290331bece0f3bda95fb2cd5f6e

See more details on using hashes here.

Provenance

The following attestation bundles were made for biocomposer-0.1.4-cp312-cp312-macosx_11_0_arm64.whl:

Publisher: publish.yml on mlberkeley/BioComposer-graph-based-orchestration-of-bioinformatics-tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file biocomposer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for biocomposer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1109fbdab0be82d2f08b9b049ebed1254b1b7a5b45f10cc09c0079a2aca28c3c
MD5 1d5d842f01f06615c921d536a1ef698c
BLAKE2b-256 80f1ac2dfcc8e70761edd099a6647a52af8829c6b4f0bfd94aa875c832d7ac78

See more details on using hashes here.

Provenance

The following attestation bundles were made for biocomposer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: publish.yml on mlberkeley/BioComposer-graph-based-orchestration-of-bioinformatics-tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file biocomposer-0.1.4-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for biocomposer-0.1.4-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 642a5afa9ae011a47ef86406596c87d273af2df0a238cbaffabc766f6fe0aeb2
MD5 0521eb1a578846e37ee0f937d4962d64
BLAKE2b-256 90bdc12f3c8c2a5feb399e8f22c913995dc1c8f5d830debdcdabeac16172554c

See more details on using hashes here.

Provenance

The following attestation bundles were made for biocomposer-0.1.4-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: publish.yml on mlberkeley/BioComposer-graph-based-orchestration-of-bioinformatics-tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file biocomposer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for biocomposer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 5d000ad0c5c211b3bd65d7b4f2f27d34cdeea14ff1c8d8f621cc3889cae93a67
MD5 492fed87a820a374cb7ffc405de86cc4
BLAKE2b-256 14e489e17ef4d81eb7b4a9d9801ed88e442242c6705b46a62311366da93f2e72

See more details on using hashes here.

Provenance

The following attestation bundles were made for biocomposer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: publish.yml on mlberkeley/BioComposer-graph-based-orchestration-of-bioinformatics-tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file biocomposer-0.1.4-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for biocomposer-0.1.4-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 0295b0258be24d7b2b52c987e59eb929a65412dda1b6f4ee5ec23077ec2dc103
MD5 bd01b011e7c79768ea46f9e084a7b318
BLAKE2b-256 3c1410c7d828fec760babe8d93a75fe7f7342d3506f943e5cd08f8f03e4f8b6a

See more details on using hashes here.

Provenance

The following attestation bundles were made for biocomposer-0.1.4-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: publish.yml on mlberkeley/BioComposer-graph-based-orchestration-of-bioinformatics-tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page