Skip to main content

A lightweight Ethereum JSON RPC library written in python

Project description

pythereum

(formerly eth_rpc)

A lightweight Ethereum RPC library for Python

Over four times faster than Web3.py, with more functionality!

Features include:

  • Ability to initiate remote procedure calls on a wide variety of ethereum functions
  • Websocket pooling for high performance calls
  • Support for RPC batching, allowing multiple calls to the same function at once
  • "eth_subscribe" functionality
  • Currency conversion, with support for esoteric denomination names (e.g. lovelace)
  • Private transaction and Bundle support for communication directly with block builders
  • Automatic nonce and gas management for transactions
  • Early-stage support for L2 chain specific functionality (Optimism P2P implemented for now)
  • Typed function outputs for intuitive library use

Implemented RPC methods

All methods listed in the Ethereum JSON RPC API specification are completed as of version 1.0.5, alongside methods for subscriptions, and support for calling custom function names with custom parameters.

Supported Builders

With the BuilderRPC class, pythereum supports submitting bundles and private transactions directly to block builders. Each builder class that can be passed into BuilderRPC instances automatically manages communication with the given builder.

The following builder classes are currently implemented:

  • Titan Builder
  • Rsync Builder
  • Builder0x69
  • Flashbots Builder
  • Loki Builder
  • Beaver Builder

Titan Builder and Flashbots now have support for mevboost bundles.

Getting started

Poetry

This project and its dependencies are managed by python poetry, which will automatically manage the versions of each library / python version upon which this project depends.

Install poetry with the instructions here.

Documentation

Brief documentation available on readthedocs.

More information and guides will be added to documentation over time.

Installation

Poetry Installation

The library currently requires python versions >=3.11.

If you want to include this library for use in another project via Poetry you must simply add the following to your pyproject.toml file under [tool.poetry.dependencies]

pythereum = {git = "https://github.com/gabedonnan/pythereum.git"}

or

pythereum = "^1.1.9"

If you would like to install the library via pypi instead of via this git repository. This git repository will always be the most up to date but the releases on pypi should be more thoroughly tested.

Pip / PyPi installation

The library is now available via pip!! (I had to change the whole project name to get it there)

It can be installed with the following command, or downloaded here:

python3 -m pip install pythereum

Example usage

Basic single function call

# Example simple function
import asyncio
from pythereum import EthRPC

TEST_URL = "ws://127.0.0.1:8545"

async def test_transaction_count():
  async with EthRPC(TEST_URL, pool_size=1) as erpc:
    # Gets the number of transactions sent from a given EOA address
    r = await erpc.get_transaction_count("0x5fC2E691E520bbd3499f409bb9602DBA94184672")
    print(r)

if __name__ == "__main__":
  asyncio.run(test_transaction_count())

Example subscription

# Example subscription
import asyncio
from pythereum import EthRPC, SubscriptionType

TEST_URL = "ws://127.0.0.1:8545"

async def test_subscription(subscription_type: SubscriptionType):
  """
  Creates a subscription to receive data about all new heads
  Prints each new subscription result as it is received
  """
  async with EthRPC(TEST_URL, pool_size=1) as erpc:
    async with erpc.subscribe(subscription_type) as sc:
      # The following will iterate as each item is gotten by sc.recv()
      async for item in sc.recv():
        # 'item' is formatted into the appropriate form for its subscription type
        # this is done by the sc.recv() automatically
        print(item)


if __name__ == "__main__":
  asyncio.run(test_subscription(SubscriptionType.new_heads))

Example batch call

# Example batch call
import asyncio
from pythereum import EthRPC

TEST_URL = "ws://127.0.0.1:8545"

async def test_batching():
  # Batch calls can be applied to any parameterised method
  # Each parameter must be passed in as a list 
  # With list length k where k is the batch size
  async with EthRPC(TEST_URL, pool_size=1) as erpc:
    r = await erpc.get_block_by_number(
      block_specifier=[
        i for i in range(40000, 40010)
      ],
      full_object=[
        True for _ in range(10)
      ]
    )
    print(r)


if __name__ == "__main__":
  asyncio.run(test_batching())

Example currency conversion

>>> from pythereum import EthDenomination, convert_eth
>>> convert_eth(1_000_000, convert_from=EthDenomination.wei, convert_to=EthDenomination.ether)
1e-12
>>> convert_eth(1_000, EthDenomination.babbage, EthDenomination.finney)
1e-09
>>> convert_eth(1e18, "wei", "eth")  # We can now use strings to represent denominations
1.0

Example builder submission

# Example builder submission
import asyncio
from eth_account import Account
from pythereum import BuilderRPC, TitanBuilder, HexStr, Transaction


async def test_builder_submission():
  # Create new arbitrary account wallet
  acct = Account.create()
  # Create an arbitrary EIP-1559 transaction
  # This transaction is an equivalence to a dictionary, 
  # it simply provides a convenient constructor
  tx = Transaction(
    from_address=acct.address,
    to_address="0x5fC2E691E520bbd3499f409bb9602DBA94184672",
    value=1,
    max_priority_fee_per_gas=1,
    max_fee_per_gas=1,
    gas=1,
    chain_id=1,
    nonce=0
  )

  # Sign your transaction with your account's key
  signed_tx = Account.sign_transaction(tx, acct.key).rawTransaction

  # BuilderRPC sends to TitanBuilder, private key used for creating a signed header
  async with BuilderRPC(TitanBuilder(), private_key=acct.key) as brpc:
    msg = await brpc.send_private_transaction(HexStr(signed_tx))
    print(msg)


if __name__ == "__main__":
  asyncio.run(test_builder_submission())

Example Gas and Nonce management

import asyncio
from eth_account import Account
from pythereum import GasManager, NonceManager, Transaction, EthRPC

TEST_URL = "ws://127.0.0.1:8545"

async def test_management():
  acct = Account.create()

  tx = Transaction(
    from_address=acct.address,
    to_address="0x5fC2E691E520bbd3499f409bb9602DBA94184672",
    value=1,
    chain_id=1
  )
  
  manager_rpc = EthRPC(TEST_URL, pool_size=2)
  await manager_rpc.start_pool()
  gm = GasManager(manager_rpc)
  
  async with gm.informed_manager() as im:
      im.fill_transaction(tx)
  async with NonceManager(manager_rpc) as nm:
      await nm.fill_transaction(tx)

  signed_tx = Account.sign_transaction(tx, acct.key).rawTransaction

  tx_result = await manager_rpc.send_raw_transaction(signed_tx)
  print(tx_result)
  
  # Wait some time for transaction to be executed so we can get its receipt
  await asyncio.sleep(3)
  tx_receipt = await manager_rpc.get_transaction_receipt(tx_result)

  # This means the next time gm.informed_manager() fills a tx, its price will update
  # An execution success will mean the maxPriorityFeePerGas value of tx will
  # be modified by im.success_multiplier, else it will be modified by im.fail_multiplier
  async with gm.informed_manager() as im:
    if tx_receipt is not None:
      if tx_receipt.status == 1:
        # Tell the gas manager that the transaction succeeded
        im.execution_success()
      else:
        # Tell the gas manager that the transaction failed
        im.execution_failure()
    # Fill the next transaction with updated values
    im.fill_transaction(tx)  
  
  print(tx)  
  
  await manager_rpc.close_pool()

if __name__ == "__main__":
    asyncio.run(test_management())

More examples available in the demo folder, including performance comparisons to Web3.py.

Testing your programs

Testing a program built with this library can be done with actual ethereum nodes, though they may rate limit you or cost eth to run. As such using testing programs such as Anvil from the Foundry suite of products allows for faster and more productive testing.

Install foundry

Instructions available at this link.

Run anvil

Anvil is a blockchain testing application included with foundry.

The following command will run an instance of anvil representing the blockchain's status at block number EXAMPLE_BLOCK_NUM via url EXAMPLE_RPC_URL.

anvil rpc-url EXAMPLE_RPC_URL@EXAMPLE_BLOCK_NUM

This is helpful for ensuring consistency in tests, or to simply have a simulated RPC client, run:

anvil

Acknowledgements

Special thanks to @totlsota as a more experienced blockchain developer than I, for giving me pointers when I needed them and generally assisting in the development of this project.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pythereum-1.1.10.tar.gz (31.8 kB view details)

Uploaded Source

Built Distribution

pythereum-1.1.10-py3-none-any.whl (35.6 kB view details)

Uploaded Python 3

File details

Details for the file pythereum-1.1.10.tar.gz.

File metadata

  • Download URL: pythereum-1.1.10.tar.gz
  • Upload date:
  • Size: 31.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.10.6 Linux/6.6.6-76060606-generic

File hashes

Hashes for pythereum-1.1.10.tar.gz
Algorithm Hash digest
SHA256 95abec4bd6900d096e3e20ce509d07eb1d652eff3d1dc130d745c4bb7823bfc0
MD5 6ad323364627ffa7c5b985798ca290d1
BLAKE2b-256 ca2c728faac3ab92d805de6a9b6fb24bfce0fecdfaebe51e7cd99a61239578fc

See more details on using hashes here.

File details

Details for the file pythereum-1.1.10-py3-none-any.whl.

File metadata

  • Download URL: pythereum-1.1.10-py3-none-any.whl
  • Upload date:
  • Size: 35.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.10.6 Linux/6.6.6-76060606-generic

File hashes

Hashes for pythereum-1.1.10-py3-none-any.whl
Algorithm Hash digest
SHA256 3f51f1d86a2355a5dd7a19222334525d211eafbb943551a8edd2831be6740729
MD5 b5f510dcf8fac56143ea0e7edbe9966c
BLAKE2b-256 119f8c68a44c600cf24cdf556f373a19d4a490cf74468b1b0fe34a7dc3cd4e33

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page