No project description provided
Project description
sparrow-python
Install
pip install sparrow-python
# Or dev version
pip install sparrow-python[dev]
# Or
pip install -e .
# Or
pip install -e .[dev]
Usage
Multiprocessing SyncManager
Open server first:
$ spr start-server
The defualt port 50001
.
(Process1) productor:
from sparrow.multiprocess.client import Client
client = Client(port=50001)
client.update_dict({'a': 1, 'b': 2})
(Process2) consumer:
from sparrow.multiprocess.client import Client
client = Client(port=50001)
print(client.get_dict_data())
>> > {'a': 1, 'b': 2}
Common tools
- Kill process by port
$ spr kill {port}
- pack & unpack
support archive format: "zip", "tar", "gztar", "bztar", or "xztar".
$ spr pack pack_dir
$ spr unpack filename extract_dir
- Scaffold
$ spr create awosome-project
Some useful functions
sparrow.relp
Relative path, which is used to read or save files more easily.
sparrow.performance.MeasureTime
For measuring time (including gpu time)
sparrow.performance.get_process_memory
Get the memory size occupied by the process
sparrow.performance.get_virtual_memory
Get virtual machine memory information
sparrow.add_env_path
Add python environment variable (use relative file path)
Safe logger in multiprocessing
from sparrow.log import Logger
import numpy as np
logger = Logger(name='train-log', log_dir='./logs', )
logger.info("hello", "numpy:", np.arange(10))
logger2 = Logger.get_logger('train-log')
print(id(logger2) == id(logger))
>> > True
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sparrow_python-0.2.6.tar.gz
(851.2 kB
view hashes)
Built Distribution
sparrow_python-0.2.6-py3-none-any.whl
(887.6 kB
view hashes)
Close
Hashes for sparrow_python-0.2.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c9dfe9bc0fefb0b20d132bc0f27b5d46fd3917f20948262eabb059f3c9246793 |
|
MD5 | 67b900779a11838465390cbf5360e195 |
|
BLAKE2b-256 | ddb5dae7edf42250994038a6cd8ec0d2dc5df5e1df94713dbfad602bf3a3ca82 |