inferless-cli 1.2.11

Inferless - Deploy Machine Learning Models in Minutes.

inferless-cli

Inferless - Deploy Machine Learning Models in Minutes.

See the website at https://inferless.com/ for documentation and more information about running code on Inferless.

Usage:

$ inferless [OPTIONS] COMMAND [ARGS]...

Options:

• -v, --version
• --help: Show this message and exit.

Commands:

• deploy: Deploy a model to Inferless
• export: Export the runtime configuration of...
• init: Initialize a new Inferless model
• log: Inferless models logs (view build logs or...
• login: Login to Inferless
• mode: Change mode
• model: Manage Inferless models (list , delete ,...
• remote-run: Remotely run code on inferless
• run: Run a model locally
• runtime: Manage Inferless runtimes (can be used to...
• secret: Manage Inferless secrets (list secrets)
• token: Manage Inferless tokens
• volume: Manage Inferless volumes (can be used to...
• workspace: Manage Inferless workspaces (can be used...

inferless deploy

Deploy a model to Inferless

Usage:

$ inferless deploy [OPTIONS]

Options:

• -c, --config TEXT: Inferless config file path to override from inferless.yaml [default: inferless.yaml]
• --help: Show this message and exit.

inferless export

Export the runtime configuration of another provider to Inferless runtime config

Usage:

$ inferless export [OPTIONS]

Options:

• -r, --runtime TEXT: The runtime configuration file of another provider [default: cog.yaml]
• -d, --destination TEXT: The destination file for the Inferless runtime configuration [default: inferless-runtime-config.yaml]
• -f, --from TEXT: The provider from which to export the runtime configuration [default: replicate]
• --help: Show this message and exit.

inferless init

Initialize a new Inferless model

Usage:

$ inferless init [OPTIONS]

Options:

• --help: Show this message and exit.

inferless log

Inferless models logs (view build logs or call logs)

Usage:

$ inferless log [OPTIONS] [MODEL_ID]

Arguments:

• [MODEL_ID]: Model id or model import id

Options:

• -i, --import-logs: Import logs
• -t, --type TEXT: Logs type [BUILD, CALL]] [default: BUILD]
• --help: Show this message and exit.

inferless login

Login to Inferless

Usage:

$ inferless login [OPTIONS]

Options:

• --help: Show this message and exit.

inferless mode

Change mode

Usage:

$ inferless mode [OPTIONS] MODE

Arguments:

• MODE: The mode to run the application in, either 'DEV' or 'PROD'. [required]

Options:

• --help: Show this message and exit.

inferless model

Manage Inferless models (list , delete , activate , deactivate , rebuild the models)

Usage:

$ inferless model [OPTIONS] COMMAND [ARGS]...

Options:

• --help: Show this message and exit.

Commands:

• activate: activate a model.
• deactivate: deactivate a model.
• delete: delete a model.
• info: Get model details.
• list: List all models.
• rebuild: rebuild a model.

inferless model activate

activate a model.

Usage:

$ inferless model activate [OPTIONS]

Options:

• --model-id TEXT: Model ID
• --help: Show this message and exit.

inferless model deactivate

deactivate a model.

Usage:

$ inferless model deactivate [OPTIONS]

Options:

• --model-id TEXT: Model ID
• --help: Show this message and exit.

inferless model delete

delete a model.

Usage:

$ inferless model delete [OPTIONS]

Options:

• --model-id TEXT: Model ID
• --help: Show this message and exit.

inferless model info

Get model details.

Usage:

$ inferless model info [OPTIONS]

Options:

• --model-id TEXT: Model ID
• --help: Show this message and exit.

inferless model list

List all models.

Usage:

$ inferless model list [OPTIONS]

Options:

• --help: Show this message and exit.

inferless model rebuild

rebuild a model. (If you have a inferless.yaml file in your current directory, you can use the --local or -l flag to redeploy the model locally.)

Usage:

$ inferless model rebuild [OPTIONS]

Options:

• --model-id TEXT: Model ID
• -l, --local: Local rebuild
• --help: Show this message and exit.

inferless remote-run

Remotely run code on inferless

Usage:

$ inferless remote-run [OPTIONS] [FILE_PATH]

Arguments:

• [FILE_PATH]: The path to the file to run on Inferless

Options:

• -c, --config TEXT: The path to the Inferless config file
• -e, --exclude TEXT: The path to the file to exclude from the run, use .gitignore format. If not provided, .gitignore will be used if present in the directory.
• --help: Show this message and exit.

inferless run

Run a model locally

Usage:

$ inferless run [OPTIONS]

Options:

• -r, --runtime TEXT: custom runtime config file path to override from inferless-runtime-config.yaml
• -t, --type TEXT: Type of runtime to run [inferless, replicate]
• -n, --name TEXT: Name of the model to deploy on inferless [default: inferless-model]
• -f, --env-file TEXT: Path to an env file containing environment variables (one per line in KEY=VALUE format)
• -e, --env TEXT: Environment variables to set for the runtime (e.g. 'KEY=VALUE'). If the env variable contains special chars please escape them.
• -u, --docker-base-url TEXT: Docker base url. Defaults to system default, feteched from env
• --help: Show this message and exit.

inferless runtime

Manage Inferless runtimes (can be used to list runtimes and upload new runtimes)

Usage:

$ inferless runtime [OPTIONS] COMMAND [ARGS]...

Options:

• --help: Show this message and exit.

Commands:

• generate: use to generate a new runtime from your...
• list: List all runtimes.
• patch: Patch a runtime.
• select: use to update the runtime in inferless...
• upload: Upload a runtime.
• version-list: use to list the runtime versions

inferless runtime generate

use to generate a new runtime from your local environment

Usage:

$ inferless runtime generate [OPTIONS]

Options:

• --help: Show this message and exit.

inferless runtime list

List all runtimes.

Usage:

$ inferless runtime list [OPTIONS]

Options:

• --help: Show this message and exit.

inferless runtime patch

Patch a runtime.

Usage:

$ inferless runtime patch [OPTIONS]

Options:

• -p, --path TEXT: Path to the runtime
• -i, --id TEXT: ID of the runtime
• --help: Show this message and exit.

inferless runtime select

use to update the runtime in inferless config file

Usage:

$ inferless runtime select [OPTIONS]

Options:

• -p, --path TEXT: Path to the inferless config file (inferless.yaml)
• -i, --id TEXT: runtime id
• --help: Show this message and exit.

inferless runtime upload

Upload a runtime.

Usage:

$ inferless runtime upload [OPTIONS]

Options:

• -p, --path TEXT: Path to the runtime
• -n, --name TEXT: Name of the runtime
• --help: Show this message and exit.

inferless runtime version-list

use to list the runtime versions

Usage:

$ inferless runtime version-list [OPTIONS]

Options:

• -i, --id TEXT: runtime id
• --help: Show this message and exit.

inferless secret

Manage Inferless secrets (list secrets)

Usage:

$ inferless secret [OPTIONS] COMMAND [ARGS]...

Options:

• --help: Show this message and exit.

Commands:

• list: List all secrets.

inferless secret list

List all secrets.

Usage:

$ inferless secret list [OPTIONS]

Options:

• --help: Show this message and exit.

inferless token

Manage Inferless tokens

Usage:

$ inferless token [OPTIONS] COMMAND [ARGS]...

Options:

• --help: Show this message and exit.

Commands:

• set: Set account credentials for connecting to...

inferless token set

Set account credentials for connecting to Inferless. If not provided with the command, you will be prompted to enter your credentials.

Usage:

$ inferless token set [OPTIONS]

Options:

• --token-key TEXT: Account CLI key [required]
• --token-secret TEXT: Account CLI secret [required]
• --help: Show this message and exit.

inferless volume

Manage Inferless volumes (can be used to list volumes and create new volumes)

Usage:

$ inferless volume [OPTIONS] COMMAND [ARGS]...

Options:

• --help: Show this message and exit.

Commands:

• cp: Add a file or directory to a volume.
• create: Create a new volume
• list: List all existing volumes
• ls: List files and directories within a volume
• rm: Specify the Inferless path to the file or...
• select: Select a volume for updates in the...

inferless volume cp

Add a file or directory to a volume.

Usage:

$ inferless volume cp [OPTIONS]

Options:

• -s, --source TEXT: Specify the source path (either a local directory/file path or an Inferless path)
• -d, --destination TEXT: Specify the destination path (either a local directory/file path or an Inferless path)
• -r, --recursive: Recursively copy the contents of a directory to the destination.
• --help: Show this message and exit.

inferless volume create

Create a new volume

Usage:

$ inferless volume create [OPTIONS]

Options:

• -n, --name TEXT: Assign a name to the new volume.
• --help: Show this message and exit.

inferless volume list

List all existing volumes

Usage:

$ inferless volume list [OPTIONS]

Options:

• --help: Show this message and exit.

inferless volume ls

List files and directories within a volume

Usage:

$ inferless volume ls [OPTIONS]

Options:

• -i, --id TEXT: Specify the ID of the volume to list.
• -p, --path TEXT: Define a specific directory path within the volume. Defaults to the root directory if not specified.
• -d, --directory: List only directories.
• -f, --files: List only files.
• -r, --recursive: Recursively list contents of directories.
• --help: Show this message and exit.

inferless volume rm

Specify the Inferless path to the file or directory you want to delete.

Usage:

$ inferless volume rm [OPTIONS]

Options:

• -p, --path TEXT: Infer Path to the file/dir your want to delete
• --help: Show this message and exit.

inferless volume select

Select a volume for updates in the Inferless configuration.

Usage:

$ inferless volume select [OPTIONS]

Options:

• -p, --path TEXT: Path to the Inferless configuration file (typically inferless.yaml)
• -i, --id TEXT: The ID of the volume to select.
• --help: Show this message and exit.

inferless workspace

Manage Inferless workspaces (can be used to switch between workspaces)

Usage:

$ inferless workspace [OPTIONS] COMMAND [ARGS]...

Options:

• --help: Show this message and exit.

Commands:

• use

inferless workspace use

Usage:

$ inferless workspace use [OPTIONS]

Options:

• --help: Show this message and exit.