Python Common Function Tool Set.
Project description
sparrow_tool
Install
pip install sparrow-tool
# Or dev version
pip install sparrow-tool[dev]
# Or
pip install -e .
# Or
pip install -e .[dev]
Usage
Safe logger in multiprocessing
from sparrow.log import Logger
import numpy as np
logger = Logger(name='train-log', log_dir='./logs', )
logger.info("hello","numpy:",np.arange(10))
logger2 = Logger.get_logger('train-log')
print(id(logger2) == id(logger))
>>> True
Multiprocessing SyncManager
Open server first:
$ sparrow start-server
The defualt port 50001
.
(Process1) productor:
from sparrow.multiprocess.client import Client
client = Client(port=50001)
client.update_dict({'a': 1, 'b': 2})
(Process2) consumer:
from sparrow.multiprocess.client import Client
client = Client(port=50001)
print(client.get_dict_data())
>>> {'a': 1, 'b': 2}
Common tools
-
Kill process by port
$ sparrow kill {port}
-
pack & unpack
support archive format: "zip", "tar", "gztar", "bztar", or "xztar".sparrow pack pack_dir sparrow unpack filename extract_dir
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sparrow-tool-0.7.1.tar.gz
(4.7 MB
view hashes)
Built Distribution
Close
Hashes for sparrow_tool-0.7.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 586a396481508a0d1a47300e3eea181a8d39441e361714d5debc0ea56ed6b0e1 |
|
MD5 | 5c66c5b4b4efe93b161acc6133300424 |
|
BLAKE2b-256 | fa9c6e339e9e85f8bcd4724f4ee03dcf9779ad184188f1b85ce65453e45f53f5 |