Skip to main content

System resource info, processor usage logging, RAM limit — standalone module from the SciTeX ecosystem

Project description

scitex-resource

PyPI Python Tests Install Test Coverage Docs License: AGPL v3

System resource info, processor usage logging, and RAM limiting helpers, extracted from the SciTeX ecosystem as a standalone package.

Install

pip install scitex-resource

API

import scitex_resource as r

# Flat hub-friendly metrics (cpu/mem/disk/gpu/load) — cross-platform via psutil
metrics = r.get_metrics()

# Canonical machine identity — every scitex-* package consumes this so they
# all agree on "what host am I". Resolves env > project config > user config
# > short hostname. See ~/.scitex/resource/config.yaml below.
name = r.get_machine_name()
cfg = r.get_machine_config()        # {"canonical_name", "aliases", "role", "hpc": {...}}

# Rich human-readable snapshot (system info, GPU, network, disk partitions)
specs = r.get_specs()

# CPU/RAM samples + continuous CSV logging
usage = r.get_processor_usages()
r.log_processor_usages("/tmp/usage.csv", limit_min=30, interval_s=1)

# Cap process RAM
r.limit_ram(0.5)

Machine identity config — ~/.scitex/resource/config.yaml

machine:
  canonical_name: mba                  # what every scitex-* package uses to refer to this host
  aliases:                              # optional; cross-package discovery / drift detection
    - Yusukes-MacBook-Air
    - Yusukes-MacBook-Air.local
  role: head                            # generic role tag (head, worker, hpc-login, ...)
  hpc:                                  # optional; HPC-only
    cluster: spartan
    login_only: true                    # don't surface login-node CPU as available
    partitions: [physical, sapphire]

Resolution cascade (highest precedence first):

  1. $SCITEX_RESOURCE_MACHINE
  2. <project>/.scitex/resource/config.yaml machine.canonical_name
  3. ~/.scitex/resource/config.yaml machine.canonical_name
  4. socket.gethostname().split(".", 1)[0]

This is the ecosystem convention — see scitex-python _skills/general/01_arch_06_local-state-directories.md for the full .scitex/<pkg-short>/ layout (config tracked, runtime/ ignored).

Status

Standalone fork of scitex.resource. Deps: pandas, psutil, PyYAML, matplotlib.

Decoupling notes:

  • scitex.str.readable_bytes / scitex.gen.fmt_size / scitex.str.printc → vendored as 3 small helpers in _compat.py.
  • scitex.io._load.load / scitex.io._save.save → use pandas.read_csv / to_csv directly for the CSV log files; defer to scitex.io only if a non-CSV path is requested (raises ImportError without scitex installed).
  • scitex.sh.sh → prefer scitex_sh if installed, fall back to plain subprocess.run (list-only).
  • scitex.session.start/close __main__ block → simplified to plain main().

The umbrella package's scitex.resource import path is preserved via a sys.modules-alias bridge. 65/65 tests pass.

License

AGPL-3.0-only (see LICENSE).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scitex_resource-0.3.0.tar.gz (36.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scitex_resource-0.3.0-py3-none-any.whl (36.4 kB view details)

Uploaded Python 3

File details

Details for the file scitex_resource-0.3.0.tar.gz.

File metadata

  • Download URL: scitex_resource-0.3.0.tar.gz
  • Upload date:
  • Size: 36.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for scitex_resource-0.3.0.tar.gz
Algorithm Hash digest
SHA256 f98cd414b3f9a6daa0be5a0e5dc06ff757ebc783e1ea68065c8d768189092d6b
MD5 e28f084e0609e75752a736a156349835
BLAKE2b-256 850942d8dcdd659c368390475463d526e4141c9bf53e3646685ab4c87d980463

See more details on using hashes here.

Provenance

The following attestation bundles were made for scitex_resource-0.3.0.tar.gz:

Publisher: publish-pypi.yml on ywatanabe1989/scitex-resource

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file scitex_resource-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: scitex_resource-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 36.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for scitex_resource-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 abc52c514f5f340ae85f4b1bc3ae80d778ef83d2b8301e09cb73a0551e087fae
MD5 e0a262461044be57f867ed1dab59b41c
BLAKE2b-256 3e1ed225a70bc106467e0b3e3a5e3db208a5a4613cb9bf3772a65bce9d2d4b07

See more details on using hashes here.

Provenance

The following attestation bundles were made for scitex_resource-0.3.0-py3-none-any.whl:

Publisher: publish-pypi.yml on ywatanabe1989/scitex-resource

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page