Skip to main content

tfmx

Install

pip install tfmx --upgrade

Commands

Set GPU control state:

gpu_fan -cs a:1

Set GPU power limit:

# M-X GPU-0/1
gpu_pow -pm a:1 && gpu_pow -pl "0:160;1:200"

# M-A GPU-0/1
gpu_pow -pm a:1 && gpu_pow -pl "0,1:160"

Set GPU fan speed:

gpu_fan -cs a:1 && gpu_fan -fs a:100

Set GPU monitor with curve:

# gpu_mon -c "a:30-50/50-65/60-80/75-100;3,7:25-100" -s

Run tei compose and machine:

tei machine run --auto-start --perf-track --on-conflict replace

Run tei benchmark:

tei benchmark run -E "http://localhost:28800" -n 100000

Run qwn compose, machine, and benchmark:

export QWN_MACHINE_URL="http://$QWN_HOST:27800"

qwn compose up --gpu-configs "0"
qwn compose up --gpu-layout uniform-awq
qwn machine run --auto-start -b --on-conflict replace
qwn client chat "你好,请做个自我介绍"
qwn benchmark run -E "$QWN_MACHINE_URL" -n 100

Run qsr compose, machine, and benchmark:

export QSR_MACHINE_URL="http://$QSR_HOST:27900"

qsr compose up --gpu-configs "0"
qsr machine run --auto-start -b --on-conflict replace
qsr client transcribe ./sample.wav
qsr client chat --audio ./sample.wav "请转写为简体中文"
qsr benchmark run -E "$QSR_MACHINE_URL" -n 20 --audio ./sample.wav

Staged Run Scripts

For repeatable repo-local workflows, use the staged script directories:

bash runs/teis/01_deploy_default.sh
bash runs/teis/02_start_machine.sh
bash runs/teis/03_health_check.sh
bash runs/qwns/01_deploy_uniform.sh
bash runs/qwns/02_start_machine.sh
bash runs/qwns/03_health_check.sh
bash runs/qsrs/01_deploy_default.sh
bash runs/qsrs/02_start_machine.sh
bash runs/qsrs/03_health_check.sh
bash runs/recovery/restart_tei_qwn.sh
  • runs/teis/README.md: staged TEI deploy, health, benchmark, cleanup
  • runs/qwns/README.md: staged QWN deploy, health, benchmark, cleanup
  • runs/qsrs/README.md: staged QSR deploy, health, benchmark, cleanup
  • runs/recovery/README.md: joint TEI + QWN recovery and live validation

Metadata

Release files for tfmx 1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tfmx 1.3
File Size Uploaded Provenance Actions
tfmx-1.3.tar.gz 282.2 kB Without provenance Details for tfmx-1.3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for tfmx 1.3
File Interpreter ABI Platform Actions
tfmx-1.3-py3-none-any.whl Python 3 none any Details for tfmx-1.3-py3-none-any.whl

Total release size: 591.7 kB

Release files / tfmx-1.3.tar.gz

Download URL tfmx-1.3.tar.gz
Size 282.2 kB
Tags Source
SHA-256 checksum
How to use checksums
1f2e203d5d162bf474b4612ca1d9d1e262eceeab7c1cdcf2f59edacc988b02d6
BLAKE2b-256 checksum
How to use checksums
239ecf68ad81b48ec908526b1bd16275b86ab378daf4a1b0d657fe0bcc4d8982
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.9.25

Release files / tfmx-1.3-py3-none-any.whl

Download URL tfmx-1.3-py3-none-any.whl
Size 309.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
4323e9f8e89d79ffe0be6e01ddec0b6b049d5b62d6fc96835340bf0e8753f950
BLAKE2b-256 checksum
How to use checksums
98c47ed3604bcbd577da442c3b292d6d5c9ba06d9556b49022f1728d86471b30
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.9.25

Security for tfmx 1.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.3 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page