Skip to main content

Asynchronous WHOIS client for Python using asyncio. Supports IPv6 and IP rotation.

Project description

async43

async43 is an asynchronous Python module for retrieving and parsing WHOIS data for a given domain.

This project is a fork of the excellent python-whois library by Richard Penman. It has been refactored to be fully asynchronous using asyncio and to add modern networking features.

Key Features

  • Fully Asynchronous: Built from the ground up with asyncio for high-performance, non-blocking network I/O.
  • IPv6 Support: Can query WHOIS servers over IPv6 and prioritizes it if available.
  • Outbound IP Rotation: Supports cycling through a list of available IPv6 addresses for outbound connections, useful for bypassing rate-limits.
  • Direct WHOIS Queries: Connects directly to the appropriate WHOIS server instead of relying on intermediate web services.
  • Structured Parsing: Uses structured text analysis with fuzzy label matching instead of regex patterns for more robust parsing across different WHOIS server formats.
  • Optional DNS Enrichment: Can enrich WHOIS results with DNS information (nameservers, SOA records, DNSSEC status) retrieved in parallel.
  • Parsed Data: Converts the raw WHOIS text into a structured Pydantic model.

Installation

Install from PyPI:

pip install async43

Or checkout the latest version from the repository:

git clone https://github.com/devl00p/async43.git
pip install -r requirements.txt

Example Usage

Basic Query

The whois function is a coroutine and must be awaited.

import asyncio
import async43

async def main():
    domain = 'example.com'
    w = await async43.whois(domain)
    
    print(w.dates.expires)
    # >>> datetime.datetime(2022, 8, 13, 4, 0, tzinfo=tzoffset('UTC', 0))
    
    print(w)
    # Whois(
    #   domain='example.com',
    #   dates=DomainDates(
    #     created='1995-08-14T04:00:00Z',
    #     expires='2022-08-13T04:00:00Z',
    #     ...
    #   ),
    #   ...
    # )

if __name__ == "__main__":
    asyncio.run(main())

WHOIS with DNS Enrichment

You can optionally enrich WHOIS data with DNS information retrieved in parallel:

import asyncio
import async43

async def main():
    # Enable DNS enrichment
    w = await async43.whois('cloudflare.com', enrich_dns=True)
    
    print(f"Domain: {w.domain}")
    print(f"DNSSEC (from WHOIS): {w.dnssec}")
    
    if w.dns_info:
        print(f"DNSSEC (from DNS): {w.dns_info.dnssec}")
        print(f"Nameservers: {w.dns_info.nameservers}")
        if w.dns_info.soa:
            print(f"SOA Serial: {w.dns_info.soa.serial}")

if __name__ == "__main__":
    asyncio.run(main())

Reusable Client for Multiple Queries

For applications performing multiple WHOIS lookups, use WhoisClient to avoid recreating network clients:

import asyncio
from async43 import WhoisClient

async def main():
    # Create a reusable client with DNS enrichment enabled
    client = WhoisClient(enrich_dns=True, timeout=15)
    
    # Perform multiple queries efficiently
    domains = ['cloudflare.com', 'google.com', 'example.org']
    
    for domain in domains:
        result = await client.whois(domain)
        print(f"{result.domain}: {result.dates.expires}")

if __name__ == "__main__":
    asyncio.run(main())

IPv6 Outbound IP Rotation

You can provide an iterator of IPv6 addresses to the WhoisClient to enable outbound IP rotation. This is useful for distributing your queries across multiple source addresses.

import asyncio
import itertools
from async43 import WhoisClient

async def main():
    # Your external function to get a list of available IPv6 addresses
    my_ipv6_addresses = ["2001:db8::1", "2001:db8::2", "2001:db8::3"]
    
    # Create a cycle iterator
    ipv6_cycler = itertools.cycle(my_ipv6_addresses)
    
    # Instantiate the client with the IP cycler and IPv6 preference
    client = WhoisClient(prefer_ipv6=True, ipv6_cycle=ipv6_cycler)
    
    # Each query will use the next IP in the cycle if the destination is IPv6
    result = await client.whois("example.com")
    print(result)

if __name__ == "__main__":
    asyncio.run(main())

Using Async Context Manager

import asyncio
from async43 import WhoisClient

async def main():
    async with WhoisClient(enrich_dns=True) as client:
        result1 = await client.whois("cloudflare.com")
        result2 = await client.whois("google.com")

if __name__ == "__main__":
    asyncio.run(main())

Using a Proxy

Set your environment SOCKS variable. Note that the underlying PySocks library is not asynchronous and will block.

export SOCKS="username:password@proxy_address:port"

Parsing Approach

Unlike the original python-whois which relied heavily on regular expressions, async43 uses a more robust approach:

  1. Structured Text Analysis: The raw WHOIS response is split into logical sections and key-value pairs
  2. Fuzzy Label Matching: Field labels are matched using fuzzy string matching, making the parser more resilient to variations in WHOIS server output formats
  3. Pydantic Models: Parsed data is returned as strongly-typed Pydantic models for better type safety and validation

This approach provides better accuracy and maintainability across different WHOIS server formats and TLDs.

Contributing

Pull requests are welcome!

If you want to improve parsing, the logic can be found in async43/parser.

Acknowledgements

This project is a fork of and builds upon the great work done by Richard Penman on python-whois.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

async43-0.1.1.tar.gz (31.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

async43-0.1.1-py3-none-any.whl (44.1 kB view details)

Uploaded Python 3

File details

Details for the file async43-0.1.1.tar.gz.

File metadata

  • Download URL: async43-0.1.1.tar.gz
  • Upload date:
  • Size: 31.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.11

File hashes

Hashes for async43-0.1.1.tar.gz
Algorithm Hash digest
SHA256 09da2824427a60d91b890647c951426e2f8931d13be8345bbd493841f1288592
MD5 63611b64e40582133c8b1f954552cb2d
BLAKE2b-256 aaa75ccd35f47ef76d98c92cdb78ac11bcf23daaac5cf00f8f11323ef82e24d6

See more details on using hashes here.

File details

Details for the file async43-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: async43-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 44.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.11

File hashes

Hashes for async43-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 048b9b6adfd22b56289d009417b3a4487b2709213b42f3026bb7e5323b5735b3
MD5 98fb5d34b760314748f80c4c088729ce
BLAKE2b-256 4dfcb02b68af5f02fc6f633c401536283cf84cfd6394ff2be261476d8a101edd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page