Skip to main content

ether_sql

A Python library to push ethereum blockchain data into an sql database.

ether_sql was built by Analyse Ether, with the goal of making Ethereum data easily available to everyone. This library can be used as a backbone for creating block explorers or performing data analysis.

It is written in Python 3.5+, uses web3.py for geting data using JSON-RPC calls and uses SqlAlchemy to connect to a postgressql database.

Buidl Status

This is currently in very alpha stage, and not recommended for production use until it has received sufficient testing. Currently supports Geth, Infura and Parity node, but transaction traces (eg. internal transactions) are currently available only with Parity node.

Build Status

Documentation available at: http://ether-sql.readthedocs.io

Installation guide

Please find the detailed installation guide here

Command line options

ether_sql has several built in cli commands to facilitate scraping data.

Syncing the data

To start the sync just type.

$ ether_sql scrape_block_range

This will start start pushing the data from an Infura node to the psql database.

Switching nodes

To switch nodes use the settings flag:

$ ether_sql --settings='PersonalParitySettings' scrape_block_range

Using multiple workers to sync data

To start 4 parallel workers use.

$ ether_sql --settings=YourSettings celery start -c4

The above command will start 4 workers using the settings YourSettings Then start the sync, which will automatically use the setting used to start workers. $ ether_sql scrape_block_range

Here is a demo of the process: https://www.youtube.com/watch?v=rnkfyAgGJwI&feature=youtu.be

Exporting as csv

To export the pushed data as a csv

$ ether_sql sql export_to_csv

To access other Command Line Interfaces (CLI) checkout the cli docs.

Metadata

Release files for ether-sql 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ether-sql 0.1.3
File Size Uploaded Provenance
ether_sql-0.1.3.tar.gz 269.4 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for ether-sql 0.1.3
File Interpreter ABI Platform
ether_sql-0.1.3-py3-none-any.whl Python 3 none any Details

Total release size: 553.5 kB

Release files / ether_sql-0.1.3.tar.gz

Download URL ether_sql-0.1.3.tar.gz
Size 269.4 kB
Tags Source
SHA-256 checksum
How to use checksums
71d72b19ee3361584d502d39b7288c315c49433aa70ec1b122a4e5f924940c41
BLAKE2b-256 checksum
How to use checksums
f6d0e7ef5c71dc906f315aacdd5068250d7f57c2f4d890711656c3d5b4c5766e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.3.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.6

Release files / ether_sql-0.1.3-py3-none-any.whl

Download URL ether_sql-0.1.3-py3-none-any.whl
Size 284.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
add33e53557c41bf76e11836d39ed6f2434f8165bb9640e0338d04451b78f745
BLAKE2b-256 checksum
How to use checksums
bc3cdaaf41d30e8273d3927358336db2695723ee1d088eae6cdc8654d30617a8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.3.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.6

Security for ether-sql 0.1.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.3 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page