Skip to main content

BioNeMo Large Language Model Components using NeMo and Megatron

Project description

bionemo-llm

The Bionemo Large Language Model (LLM) submodule contains common code used in submodules that train LLMs on biological datasets (currently bionemo-esm2 and bionemo-geneformer). This includes data masking and collate functions, the bio-BERT common architecture code, loss functions, and other NeMo / Megatron-LM compatibility functions. Sub-packages should only depend on bionemo-llm if they need access to NeMo and Megatron-LM.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bionemo_llm-2.4.2.tar.gz (59.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bionemo_llm-2.4.2-py3-none-any.whl (80.4 kB view details)

Uploaded Python 3

File details

Details for the file bionemo_llm-2.4.2.tar.gz.

File metadata

  • Download URL: bionemo_llm-2.4.2.tar.gz
  • Upload date:
  • Size: 59.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for bionemo_llm-2.4.2.tar.gz
Algorithm Hash digest
SHA256 8e29ebc59129bb30f3bce06077be0f3c602ff6f449f75134d8f188f5460723d1
MD5 cc1e261636879fc6d8dca7dc62310208
BLAKE2b-256 7e91d9b760a7cc35e2c8b9c879888a7c01daf51beaf57b4c7e452199a07d9eec

See more details on using hashes here.

Provenance

The following attestation bundles were made for bionemo_llm-2.4.2.tar.gz:

Publisher: bionemo-subpackage-ci.yml on NVIDIA/bionemo-framework

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file bionemo_llm-2.4.2-py3-none-any.whl.

File metadata

  • Download URL: bionemo_llm-2.4.2-py3-none-any.whl
  • Upload date:
  • Size: 80.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for bionemo_llm-2.4.2-py3-none-any.whl
Algorithm Hash digest
SHA256 a5eca30b38c7a6bb59793ea545572279d822636970ab1513e5b5f1b695026e95
MD5 5d13ca429fdc406f2eebc5e526b9e30e
BLAKE2b-256 885597475b38dcee925a23753b1d0fcdc3129d2962685e1a549079d8bb189a2d

See more details on using hashes here.

Provenance

The following attestation bundles were made for bionemo_llm-2.4.2-py3-none-any.whl:

Publisher: bionemo-subpackage-ci.yml on NVIDIA/bionemo-framework

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page