Skip to main content

EasyFlake is a Python package for generating 64-bit IDs similar to Snowflake or Sonyflake.

Project description

EasyFlake

Test passing codecov PyPI PyPI - Python Version License

EasyFlake is a Python package for generating 64-bit IDs similar to Snowflake or Sonyflake. It provides a simple way to generate unique and sortable IDs that can be used as primary keys in databases, message queue messages, or other distributed systems.

Introduction

In a distributed system, it can be challenging to generate unique IDs for records that need to be stored or processed across multiple nodes. EasyFlake provides a way to generate IDs that are unique, sortable, and easy to work with.

Use Cases

Here are some examples of use cases for EasyFlake:

  • User account IDs: Generate unique IDs for user accounts that can be used across multiple servers or databases.
  • Transaction IDs: Generate IDs for financial transactions that need to be processed across multiple systems.
  • Order numbers: Generate unique order numbers that can be sorted by timestamp.

Installation

Install the latest version of EasyFlake using pip:

pip install easyflake

Usage

To use EasyFlake, simply create an instance of the EasyFlake class, passing in a unique node ID:

from easyflake import EasyFlake

ef = EasyFlake(node_id=1)
print(ef.get_id())

The get_id() method generates the next ID by the current timestamp. You can customize the number of bits used for the node ID and sequence ID parts, as well as the epoch timestamp and time scale.

ef = EasyFlake(node_id=0, node_id_bits=4, sequence_bits=6)
print(ef.get_id())

The components of the output ID are the sequence value, node ID, and timestamp, in order from the lower bits.

Arguments

  • node_id (int, NodeIdPool): A unique ID for the current node. This ID should be between 0 and (2 ^ node_id_bits) - 1.
  • node_id_bits (int): The maximum number of bits used to represent the node ID. This argument defaults to 8 / max node ID is 255.
  • sequence_bits (int): The maximum number of bits used to represent the sequence number. This argument defaults to 8 / max sequence number is 255.
  • epoch (float): A timestamp used as a reference when generating the timestamp section of the ID. This argument defaults to 1675859040 (2023-02-08T12:24:00Z).
  • time_scale (int): The number of decimal places used to represent the timestamp. This argument defaults to 3 (milliseconds).

API

NodeIDPool

This is a class that manages node IDs in a single-threaded or single-process environment. The default options provided are GrpcNodeIdPool and FileNodeIdPool. By inheriting from BaseNodeIdPool, you can also create your own custom node ID management.

easyflake.FileNodeIdPool

This is a file-based node ID management class. Care should be taken in distributed systems, as node IDs are managed by a single file.

Arguments
  • endpoint (str): The path to the file where node IDs are recorded.
  • bits (int): The maximum number of bits for node IDs.
easyflake.GrpcNodeIdPool

This is a gRPC-based node ID management class. You can start a gRPC server using easyflake-cli grpc.
However, it's important to note that the gRPC server can become a single point of failure in your system, so proper measures should be taken to ensure its availability.

Arguments
  • endpoint (str): The address of the gRPC server.
  • bits (int): The maximum number of bits for node IDs.

Command

easyflake-cli grpc

This command starts a gRPC server for managing node IDs.

Options
  • -p, --port: Specifies the port number of the gRPC server.
  • -d, --daemon: Starts the server in daemon mode (not supported on Windows).
  • --pid-file: Specifies the path to the PID file.

Contributing

See the contributing guide.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

easyflake-0.2.0.tar.gz (13.8 kB view details)

Uploaded Source

Built Distribution

easyflake-0.2.0-py3-none-any.whl (16.8 kB view details)

Uploaded Python 3

File details

Details for the file easyflake-0.2.0.tar.gz.

File metadata

  • Download URL: easyflake-0.2.0.tar.gz
  • Upload date:
  • Size: 13.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.8.16 Linux/5.15.0-1033-azure

File hashes

Hashes for easyflake-0.2.0.tar.gz
Algorithm Hash digest
SHA256 15b6e5b9506eeac05ee5fa568675aef388a6a8b256ee1dd2077cda03b969af39
MD5 a5bcb78439e0f798640662864eeffed8
BLAKE2b-256 405ca134fc87110b9382f42a5db576ecf95ff439368ff71b5344816fca20654d

See more details on using hashes here.

File details

Details for the file easyflake-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: easyflake-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 16.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.8.16 Linux/5.15.0-1033-azure

File hashes

Hashes for easyflake-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 bea33f5a6602c2663dc7ee8bd20aabb5ac640d371b5055dcd464a7869a6d5b78
MD5 911c51742e61499fb951fbcb271d200a
BLAKE2b-256 003f7fe1a8fdaf5fc4faf9edb478c9f759093059bd517d293b3c607d33b9662b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page