Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Synchronizer

This is a synchronization library used to synchronize multiple processes in distributed systems.

Install

You can install this package with pip using the following command:

pip install multiprocess-synchronizer

Usage

from synchronizer import FileSystemSynchronizer
from multiprocessing import Process


def main(num_processes):
    fs_sync = FileSystemSynchronizer('test', rank, world_size)
    fs_sync.barrier()

if __name__ == "__main__":
    main()

FileSystemSynchronizer

FileSystemSynchronizer(shared_dir, rank, world_size)

Parameters:

  • shared_dir: A directory on a shared file system that can be accessed by all processes; this directory must be empty.
  • rank: Rank id of the current process.
  • world_size: Total number of processes.

shell

You can also use the synchronizer command:

synchronizer --shared_dir dir --rank 0 --num_processes 1

Metadata

Release files for multiprocess-synchronizer 0.0.2rc0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for multiprocess-synchronizer 0.0.2rc0
File Size Uploaded
multiprocess_synchronizer-0.0.2rc0.tar.gz 8.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for multiprocess-synchronizer 0.0.2rc0
File Interpreter ABI Platform
multiprocess_synchronizer-0.0.2rc0-py3-none-any.whl Python 3 none any Details

Total release size: 17.3 kB

Release files / multiprocess_synchronizer-0.0.2rc0.tar.gz

Download URL multiprocess_synchronizer-0.0.2rc0.tar.gz
Size 8.1 kB
Tags Source
SHA-256 checksum
How to use checksums
fb4fc527178700a8b3d91e8b3468b6ba781b5b0d70701e51569262123902ec0f
BLAKE2b-256 checksum
How to use checksums
77854d997ba0123f480c8694a813d4676446a45f417daea0870c2f2946334ad5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.9.20

Release files / multiprocess_synchronizer-0.0.2rc0-py3-none-any.whl

Download URL multiprocess_synchronizer-0.0.2rc0-py3-none-any.whl
Size 9.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8831c3158d4e370c5f5058e673d470e4e73031dc8d6d651f3f76d33f1af9d062
BLAKE2b-256 checksum
How to use checksums
c53eb0e45a607b2b5084b054ca923677d8336789d2f5ee29ef1297dc804b5154
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.9.20

Release history Release notifications | RSS feed

This release

0.0.2rc0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page