Skip to main content

A distributed unique ID generator inspired by Twitter's Snowflake

Project description

sonyflake

Sonyflake is a distributed unique ID generator inspired by Twitter’s Snowflake.

This project is a Python implementation inspired by the original sony/sonyflake project, written in Go.

Sonyflake focuses on lifetime and performance on many host/core environment. So it has a different bit assignment from Snowflake. By default, a Sonyflake ID is composed of:

  • 39 bits for time in units of 10 msec

  • 8 bits for a sequence number

  • 16 bits for a machine id

As a result, Sonyflake has the following advantages and disadvantages:

  • The lifetime (174 years) is longer than that of Snowflake (69 years)

  • It can work in more distributed machines (2^16) than Snowflake (2^10)

  • It can generate 2^8 IDs per 10 msec at most in a single instance (fewer than Snowflake)

However, if you want more generation rate in a single host, you can easily run multiple Sonyflake instances using threads or asyncio tasks.

In addition, you can adjust the lifetime and generation rate of Sonyflake by customizing the bit assignment and the time unit.

Installation

Python 3.11 or higher is required

Stable

# Linux/macOS
python -m pip install -U sonyflake

# Windows
py -3 -m pip install -U sonyflake

Development

# Linux/macOS
python -m pip install -U "sonyflake @ git+https://github.com/iyad-f/sonyflake"

# Windows
py -3 -m pip install -U "sonyflake @ git+https://github.com/iyad-f/sonyflake"

Usage

You can configure Sonyflake with the following options:

  • bits_sequence is the bit length of a sequence number. If bits_sequence is not provided, the default bit length is used, which is 8. If bits_sequence is 31 or more, an error is raised.

  • bits_machine_id is the bit length of a machine ID. If bits_machine_id is not provided, the default bit length is used, which is 16. If bits_machine_id is 31 or more, an error is raised.

  • time_unit is the time unit of Sonyflake. If time_unit is not provided, the default time unit is used, which is 10 msec. If time_unit is less than a millisecond, an error is raised.

  • start_time is the time since which the Sonyflake time is defined as the elapsed time. If start_time is not before the current time, an error is raised.

  • machine_id is the unique ID of a Sonyflake instance. If machine_id is not provided, the default machine_id is used, which is the lower 16 bits of the private IP address.

  • check_machine_id validates the uniqueness of a machine ID. If check_machine_id returns false, an error is raised. If check_machine_id is not provided, no validation is done.

The bit length of time is calculated by 63 - bits_sequence - bits_machine_id. If it is less than 32, an error is raised.

To obtain a new unique ID, use the next_id or next_id_async methods depending on whether you are in a synchronous or asynchronous environment.

Sync

import datetime

from sonyflake import Sonyflake

start_time = datetime.datetime(2025, 1, 1, 0, 0, 0, 0, datetime.UTC)
sf = Sonyflake(start_time=start_time)
next_id = sf.next_id()
print(next_id)

Async

import asyncio
import datetime

from sonyflake import Sonyflake


async def main() -> None:
    start_time = datetime.datetime(2025, 1, 1, 0, 0, 0, 0, datetime.UTC)
    sf = Sonyflake(start_time=start_time)
    next_id = await sf.next_id_async()
    print(next_id)

asyncio.run(main())

next_id or next_id_async can continue to generate IDs for about 174 years from start_time by default. But after the Sonyflake time is over the limit, next_id raises an error.

Examples

Examples can be found in the examples directory

Contact

Send a DM on discord at iyad8888.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sonyflake-2.0.1.tar.gz (14.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sonyflake-2.0.1-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file sonyflake-2.0.1.tar.gz.

File metadata

  • Download URL: sonyflake-2.0.1.tar.gz
  • Upload date:
  • Size: 14.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.8.15

File hashes

Hashes for sonyflake-2.0.1.tar.gz
Algorithm Hash digest
SHA256 45fd55eb1f25942c247252f5b3acac967ac00e1f8e2188a6c51262a64f499be3
MD5 b60ccec3a4f8123561ac3329c5d8b2bd
BLAKE2b-256 2bee667addc3dc8fabede0a96440b21bc25329e02fc11e4715f1924aec0d0513

See more details on using hashes here.

File details

Details for the file sonyflake-2.0.1-py3-none-any.whl.

File metadata

  • Download URL: sonyflake-2.0.1-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.8.15

File hashes

Hashes for sonyflake-2.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f9536b5a17ee439e44e286a93893da603dc818e47068865f6b8ae63536e0c1fa
MD5 f3c616cdeba4412d1def161fb5d088bc
BLAKE2b-256 afa1de1825160abe35ec35019b1ae8a7621a51c3b61885548cefb6afeacb1b19

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page