Log memory usage and auto choose device for machine learning model inference
Project description
soco-device
A package for logging, saving, and automatically choosing device during model inference stage.
Usage
-
install package
pip install soco-device
-
example usage
from soco_device.device_check import DeviceCheck
dc = DeviceCheck()
device_name = dc.get_device_by_model(model_name_or_path)
device = torch.device(device_name)
dc.log_start()
# inference model for one time here
dc.log_end()
dc.save(model_name_or_path)
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Close
Hashes for soco_device-0.0.3-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1af02d280e18e7dfd0d8bcf4171fae910e97f89a6d82cce7f9cdf9e68776edde |
|
| MD5 | 445472a6bf39307743b3e6c85227306e |
|
| BLAKE2b-256 | 86bf13c31b3e4627365bf3a8aec30bfd5dd257e22957a8a28af955ebe94d265d |
