Skip to main content

A reusable parser for Lightning Network gossip messages format.

Project description

Ruff Code style: black Checked with mypy Uses: dataclasses Uses: typing

Commitizen friendly

โšก lnhistoryclient

A Python client library to parse and handle raw Lightning Network gossip messages from the gossip store. Centralized, reusable, and production-tested on real-world data. Perfect for microservices that consume Lightning Network data in raw_hex format. For details about the gossip messages see the Lightning Network specifications BOLT #7 This python package is part of the ln-history project


๐Ÿ“ฆ Features

  • ๐Ÿ” Parses raw gossip messages: ChannelAnnouncement, NodeAnnouncement, ChannelUpdate, and more
  • ๐Ÿงฑ Clean and extensible object model (e.g., ChannelAnnouncement, NodeAnnouncement, ChannelUpdate)
  • ๐Ÿงช Tested on real-world data
  • ๐Ÿงฐ Built with reusability in mind for microservice architectures

๐Ÿ› ๏ธ Installation

pip install lnhistoryclient

๐Ÿงฌ Usage

To parse a raw Lightning Network gossip message, first extract the message type, then use the type to select the appropriate parser. This ensures correctness and avoids interpreting invalid data. The library accepts both bytes and io.BytesIO objects as input for maximum flexibility.

from lnhistoryclient.parser.common import get_message_type
from lnhistoryclient.parser.parser_factory import get_parser_by_message_type


raw_hex = bytes.fromhex("0101...")  # Replace with actual raw hex (includes 2-byte type prefix)

msg_type = get_message_type_by_raw_hex(raw_hex)
if msg_type is not None:
    parser = get_parser_by_message_type(msg_type)
    result = parser(raw_hex[2:])  # Strip the type prefix if your parser expects it
    print(result)
else:
    print("Unknown or unsupported message type.")

For convenience (and if you're confident the input is valid), a shortcut is also available:

from lnhistoryclient.parser.parser_factory import get_parser_from_raw_hex

raw_hex = bytes.fromhex("0101...")  # Replace with actual raw hex

parser = get_parser_from_raw_hex(raw_hex)
if parser:
    result = parser(raw_hex[2:])
    print(result)
else:
    print("Could not determine parser.")

You can also directly use individual parsers if you know the message type:

from lnhistoryclient.parser.channel_announcement_parser import parse_channel_announcement

result = parse_channel_announcement(raw_hex)
print(result.channel_id, result.node1_id, result.node2_id)

๐ŸŽจ Model

The library provides python typing models for every gossip message. See in the project structure section below for details.

๐Ÿ“ Project Structure

lnhistoryclient
โ”œโ”€โ”€ LICENSE
โ”œโ”€โ”€ lnhistoryclient
โ”‚   โ”œโ”€โ”€ constants.py
โ”‚   โ”œโ”€โ”€ model
โ”‚   โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”‚   โ”œโ”€โ”€ Address.py
โ”‚   โ”‚   โ”œโ”€โ”€ AddressType.py
โ”‚   โ”‚   โ”œโ”€โ”€ cache
โ”‚   โ”‚   โ”‚   โ””โ”€โ”€ GossipCache.py
โ”‚   โ”‚   โ”œโ”€โ”€ ChannelAnnouncement.py
โ”‚   โ”‚   โ”œโ”€โ”€ ChannelUpdate.py
โ”‚   โ”‚   โ”œโ”€โ”€ core_lightning_internal
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ ChannelAmount.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ ChannelDying.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ DeleteChannel.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ GossipStoreEnded.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ PrivateChannelAnnouncement.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ PrivateChannelUpdate.py
โ”‚   โ”‚   โ”‚   โ””โ”€โ”€ types.py
โ”‚   โ”‚   โ”œโ”€โ”€ gossip_event_kafka
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”‚   โ”‚   โ””โ”€โ”€ GossipEvent.py
โ”‚   โ”‚   โ”œโ”€โ”€ gossip_event_zmq
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ ChannelAnnouncementEvent.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ ChannelUpdateEvent.py
โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ core_lightning_internal
โ”‚   โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ ChannelAmountEvent.py
โ”‚   โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ ChannelDyingEvent.py
โ”‚   โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ DeleteChannelEvent.py
โ”‚   โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ GossipStoreEndedEvent.py
โ”‚   โ”‚   โ”‚   โ”‚   โ”œโ”€โ”€ PrivateChannelAnnouncementEvent.py
โ”‚   โ”‚   โ”‚   โ”‚   โ””โ”€โ”€ PrivateChannelUpdateEvent.py
โ”‚   โ”‚   โ”‚   โ””โ”€โ”€ NodeAnnouncementEvent.py
โ”‚   โ”‚   โ”œโ”€โ”€ MessageMetadata.py
โ”‚   โ”‚   โ”œโ”€โ”€ NodeAnnouncement.py
โ”‚   โ”‚   โ””โ”€โ”€ types.py
โ”‚   โ””โ”€โ”€ parser
โ”‚       โ”œโ”€โ”€ __init__.py
โ”‚       โ”œโ”€โ”€ channel_announcement_parser.py
โ”‚       โ”œโ”€โ”€ channel_update_parser.py
โ”‚       โ”œโ”€โ”€ common.py
โ”‚       โ”œโ”€โ”€ core_lightning_internal
โ”‚       โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚       โ”‚   โ”œโ”€โ”€ channel_amount_parser.py
โ”‚       โ”‚   โ”œโ”€โ”€ channel_dying_parser.py
โ”‚       โ”‚   โ”œโ”€โ”€ delete_channel_parser.py
โ”‚       โ”‚   โ”œโ”€โ”€ gossip_store_ended_parser.py
โ”‚       โ”‚   โ”œโ”€โ”€ private_channel_announcement_parser.py
โ”‚       โ”‚   โ””โ”€โ”€ private_channel_update_parser.py
โ”‚       โ”œโ”€โ”€ node_announcement_parser.py
โ”‚       โ””โ”€โ”€ parser_factory.py
โ”œโ”€โ”€ pyproject.toml
โ”œโ”€โ”€ README.md
โ”œโ”€โ”€ requirements-dev.txt
โ””โ”€โ”€ tests

๐Ÿงช Testing

Unit tests coming soon.

๐Ÿง  Requirements

Python >=3.7, <4.0 Pure Python, no external dependencies

Code Style, Linting etc.

The code has been formatted using ruff, black and mypy

๐Ÿค Contributing

Pull requests, issues, and feature ideas are always welcome! Fork the repo Create a new branch Submit a PR with a clear description

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lnhistoryclient-3.2.0.tar.gz (21.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lnhistoryclient-3.2.0-py3-none-any.whl (28.3 kB view details)

Uploaded Python 3

File details

Details for the file lnhistoryclient-3.2.0.tar.gz.

File metadata

  • Download URL: lnhistoryclient-3.2.0.tar.gz
  • Upload date:
  • Size: 21.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for lnhistoryclient-3.2.0.tar.gz
Algorithm Hash digest
SHA256 b8aaf9517bda94643300864ee421d55e90ce274be092242e9599238de9a93c9f
MD5 6c4c785b5f63f32e3db002a1934186de
BLAKE2b-256 4731fb07bf601ad41180866045bc9c3c1c54fd853d9cf649401101d707054ac1

See more details on using hashes here.

Provenance

The following attestation bundles were made for lnhistoryclient-3.2.0.tar.gz:

Publisher: release.yml on ln-history/ln-history-python-client

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file lnhistoryclient-3.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for lnhistoryclient-3.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9a411a76f6836749e4c065bf331ff924dffd41e45fc5a45d3e1c7cdee7e2748a
MD5 6887f036b9dfd55966b44e6ce59d9697
BLAKE2b-256 4d76201257c9dbd07898c87b7dc8b6848fa7cc53344ea2c04170fa2514082ee4

See more details on using hashes here.

Provenance

The following attestation bundles were made for lnhistoryclient-3.2.0-py3-none-any.whl:

Publisher: release.yml on ln-history/ln-history-python-client

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page