Skip to main content

ModelScout: Find the best LLM for your needs.

Project description

ModelScout

ModelScout is a command-line tool designed to help users pick the best LLM for their needs. Modelscout uses the same recommendation algorithm as Macros On Demand a more in-depth example of my SWE work. While ModelScout is simple it serves as a useful stop-gap in the quickly evolving field of LLMs. As the name suggests ModelScout is simply a scout and should serve as the beginning, not the end of your LLM search. Subjective metrics such as performance and the degree to which a model is supported are gathered from various sources and forums (ie. Benchmarks, Reddit, Google trends. etc) and are based largely on community sentiment so should be taken with a grain of salt. Further not the cost per million tokens for open source models are very rough estimates as well.


Features

  • Interactive filtering: Easily select filters step by step.
  • Customizable: Filter models by company, cost, performance, context length, and API/tool availability.
  • Lightweight & Easy to Use: Requires only Python and a CSV file.

Command-Line Arguments

Argument Description
file (Default: ./models.csv) Path to the CSV file
--scout Launch interactive mode for selecting filters (Recommended)
--top Number of recommended models to display (5 by default)
--license Ideal license (1 for open source, 0 for no preference)
--performance Ideal performance rating (1.0-10.0)
--cost Ideal cost per million tokens
--context_length Ideal context length
--Support Ideal API/tools availability (1.0-10.0)

CSV format

Model Name,Company,Context Length,Cost per Million Tokens,Performance,license,Support

--

Installation

Ensure you have Python installed, then install ModelScout using pip:

pip install git+https://github.com/yourusername/ModelScout.git

Alternatively, clone the repository manually:

git clone https://github.com/yourusername/ModelScout.git
cd ModelScout

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

modelscout-0.1.0.tar.gz (6.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

modelscout-0.1.0-py3-none-any.whl (6.4 kB view details)

Uploaded Python 3

File details

Details for the file modelscout-0.1.0.tar.gz.

File metadata

  • Download URL: modelscout-0.1.0.tar.gz
  • Upload date:
  • Size: 6.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.6

File hashes

Hashes for modelscout-0.1.0.tar.gz
Algorithm Hash digest
SHA256 f74b163d3d7be56a195f6e3bb17b3dcff6ff2c7b99de40b270b264cccb7a998f
MD5 57a2c3f78a6f5932b6f1613e6f8a7c8c
BLAKE2b-256 db4bde409300f9561cee99b28018c312759550fb50f680df59a02e5c71be877a

See more details on using hashes here.

File details

Details for the file modelscout-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: modelscout-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 6.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.6

File hashes

Hashes for modelscout-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 20c8f6b4535659beffc9f3fad592315ff30d5f04b9d302af50053cd36b2ef062
MD5 c1fd98eaec4e0d5a194489473aaf75d3
BLAKE2b-256 a64bde3361f80cc500a854c2b5689c572ffebae3c3f47146a3eb024bbf40b98b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page