Skip to main content

Estimate costs and running times of complex LLM workflows/experiments/pipelines in advance before spending money, via simulations.

Project description

costly

Estimate costs and running times of complex LLM workflows/experiments/pipelines in advance before spending money, via simulations. Just put @costly() on the load-bearing function; make sure all functions that call it pass **kwargs to it and call your complex function with simulate=True and some cost_log: Costlog object. See examples.ipynb for more details.

Installation

pip install costly

Usage

See examples.ipynb for a full walkthrough.

Testing

poetry run pytest -s

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

costly-0.1.5.tar.gz (9.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

costly-0.1.5-py3-none-any.whl (11.3 kB view details)

Uploaded Python 3

File details

Details for the file costly-0.1.5.tar.gz.

File metadata

  • Download URL: costly-0.1.5.tar.gz
  • Upload date:
  • Size: 9.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.11.0 Windows/10

File hashes

Hashes for costly-0.1.5.tar.gz
Algorithm Hash digest
SHA256 d831917c84e424999a7ce99c9c34866a392150106747b892876ec1bf9c4e3af8
MD5 2440a1110fc92ea7f21a9f3717fe94d7
BLAKE2b-256 26d3ceb27ddb2b6747d5bad088f2859d08646c7e7ab57294e522eafff14e2a60

See more details on using hashes here.

File details

Details for the file costly-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: costly-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 11.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.11.0 Windows/10

File hashes

Hashes for costly-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 bb8bbd9dd0f12da951865b0570990f43c0fd78a51602c19af0067319cd68e04c
MD5 1abe64963a62f1320967f6256c17ffc6
BLAKE2b-256 0aca20b3f72605d2faee51381e69cae8da1494650e0544e111791c1345a0cba9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page