Skip to main content

框架环境变量

环境变量 说明 默认值
TI_MODEL_DIR 模型路径 /data/model
TI_PREPROCESS_NUMS 预处理进程数 0
TI_INFERENCE_NUMS 推理进程数 1
TI_POSTPROCESS_NUMS 后处理进程数 0
TI_INFERENCE_MAX_BATCH_SIZE 推理Batch数 1

说明

  • 当TI_PREPROCESS_NUMS==0且TI_POSTPROCESS_NUMS==0时;

    model_service.py 文件中preprocess,postpress,predict 函数在一个进程中执行

  • 否则,model_service.py 文件中preprocess, postpress, predict 函数分别处于不同进程中执行,

    load 函数与predict 函数处于同一进程;

Metadata

Release files for ti-cloud-infer-framework 0.1.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for ti-cloud-infer-framework 0.1.6
File Interpreter ABI Platform
ti_cloud_infer_framework-0.1.6-py3-none-any.whl Python 3 none any Details

Release files / ti_cloud_infer_framework-0.1.6-py3-none-any.whl

Download URL ti_cloud_infer_framework-0.1.6-py3-none-any.whl
Size 8.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9bf087b192d60a441cb6c09e322521dab293d9fb597f8a9ee27440bd164cb0f2
BLAKE2b-256 checksum
How to use checksums
d89eef84fb7025e2309c238728194faeb8c2215d13d00a6a12f1913406496ed2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.8.16

Release history Release notifications | RSS feed

This release

0.1.6 This release

1 release file

0.1.5

1 release file

0.1.4

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page