Skip to main content

A distributed unique ID generator inspired by Twitter's Snowflake

Project description

sonyflake

Sonyflake is a distributed unique ID generator inspired by Twitter’s Snowflake.

This project is a Python implementation inspired by the original sony/sonyflake project, written in Go.

Sonyflake focuses on lifetime and performance on many host/core environment. So it has a different bit assignment from Snowflake. By default, a Sonyflake ID is composed of:

  • 39 bits for time in units of 10 msec

  • 8 bits for a sequence number

  • 16 bits for a machine id

As a result, Sonyflake has the following advantages and disadvantages:

  • The lifetime (174 years) is longer than that of Snowflake (69 years)

  • It can work in more distributed machines (2^16) than Snowflake (2^10)

  • It can generate 2^8 IDs per 10 msec at most in a single instance (fewer than Snowflake)

However, if you want more generation rate in a single host, you can easily run multiple Sonyflake instances using threads or asyncio tasks.

In addition, you can adjust the lifetime and generation rate of Sonyflake by customizing the bit assignment and the time unit.

Installation

Python 3.11 or higher is required

Stable

# Linux/macOS
python -m pip install -U sonyflake

# Windows
py -3 -m pip install -U sonyflake

Development

# Linux/macOS
python -m pip install -U "sonyflake @ git+https://github.com/iyad-f/sonyflake"

# Windows
py -3 -m pip install -U "sonyflake @ git+https://github.com/iyad-f/sonyflake"

Usage

You can configure Sonyflake with the following options:

  • bits_sequence is the bit length of a sequence number. If bits_sequence is not provided, the default bit length is used, which is 8. If bits_sequence is 31 or more, an error is raised.

  • bits_machine_id is the bit length of a machine ID. If bits_machine_id is not provided, the default bit length is used, which is 16. If bits_machine_id is 31 or more, an error is raised.

  • time_unit is the time unit of Sonyflake. If time_unit is not provided, the default time unit is used, which is 10 msec. If time_unit is less than a millisecond, an error is raised.

  • start_time is the time since which the Sonyflake time is defined as the elapsed time. If start_time is not before the current time, an error is raised.

  • machine_id is the unique ID of a Sonyflake instance. If machine_id is not provided, the default machine_id is used, which is the lower 16 bits of the private IP address.

  • check_machine_id validates the uniqueness of a machine ID. If check_machine_id returns false, an error is raised. If check_machine_id is not provided, no validation is done.

The bit length of time is calculated by 63 - bits_sequence - bits_machine_id. If it is less than 32, an error is raised.

To obtain a new unique ID, use the next_id or next_id_async methods depending on whether you are in a synchronous or asynchronous environment.

Sync

import datetime

from sonyflake import Sonyflake

start_time = datetime.datetime(2025, 1, 1, 0, 0, 0, 0, datetime.UTC)
sf = Sonyflake(start_time=start_time)
next_id = sf.next_id()
print(next_id)

Async

import asyncio
import datetime

from sonyflake import Sonyflake


async def main() -> None:
    start_time = datetime.datetime(2025, 1, 1, 0, 0, 0, 0, datetime.UTC)
    sf = Sonyflake(start_time=start_time)
    next_id = await sf.next_id_async()
    print(next_id)

asyncio.run(main())

next_id or next_id_async can continue to generate IDs for about 174 years from start_time by default. But after the Sonyflake time is over the limit, next_id raises an error.

Examples

Examples can be found in the examples directory

Contact

Send a DM on discord at iyad8888.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sonyflake-2.0.2.tar.gz (14.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sonyflake-2.0.2-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file sonyflake-2.0.2.tar.gz.

File metadata

  • Download URL: sonyflake-2.0.2.tar.gz
  • Upload date:
  • Size: 14.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.8.17

File hashes

Hashes for sonyflake-2.0.2.tar.gz
Algorithm Hash digest
SHA256 43d210f0cad6180a6a2727eb7ad121a76dc478795e28b61ac2ed11f6f07c3fc7
MD5 339aad925409e0df4fc544495d9ee512
BLAKE2b-256 b2c9dff3f434db8ccb9cec0a9c4ca9443b1c791be4cd6be201feeba014a787d1

See more details on using hashes here.

File details

Details for the file sonyflake-2.0.2-py3-none-any.whl.

File metadata

  • Download URL: sonyflake-2.0.2-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.8.17

File hashes

Hashes for sonyflake-2.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 50a9865a416b25ac63645090aa21c1574ef18114525527874287d8203fb68c2d
MD5 d7ab4446904eac245555df58e9a1f39f
BLAKE2b-256 9fa22ae6d5e9ab4681710e4ee928ee7f8a31f99711e8eb18b972b41a39151d7d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page