Skip to main content

Ripple ledger extractor

Project description

https://travis-ci.org/tensorjack/grapple.svg?branch=master https://coveralls.io/repos/tensorjack/grapple/badge.png

Grapple extracts the ledger from rippled via websocket. It starts at the current ledger index, and walks backwards until it reaches the genesis ledger. The genesis ledger index is set by default to 152370, but is adjustable.

Grapple can collect data from a local or remote rippled instance. If you have a local rippled instance running that has downloaded all or most of the ledger, I strongly recommend doing local data collection. Fetching data from Ripple’s public websocket is very slow!

Also resamples the transaction time series to create “Open-Hi-Lo-Close” data, which can be useful for statistical tests, or simply for drawing charts.

Installation

The easiest way to install Grapple is using pip:

pip install grapple

Grapple is designed to integrate with PostgreSQL, using connection information in config.py. By default, it assumes that your database is located on localhost (127.0.0.1), and that your database’s name, password, username and are all “grapple”.

(While this is certainly not the most secure setup, it may be convenient for people who install Grapple via pip, and do not wish to edit its source code.)

Usage

Grapple can be used as a Python module:

from grapple import Grapple

grapple = Grapple()
grapple.download()

The Grapple constructor accepts the following keyword arguments:

socket_url (str):
rippled websocket URL (default=”ws://127.0.0.1:6006/”)
full (bool):
True if downloading the full ledger (starting from the current ledger and walking back to the genesis ledger). False if the download should stop at the last current ledger (i.e., the last time grapple was run). (default=True)
genesis (int):
Genesis block index. If full=True, this is where the download ends; otherwise, this value is ignored. (default=152370)
quiet (bool):
If True, suppress console output. (default=True)
resampling_frequencies (tuple):
Resampling frequencies, using pandas frequency codes. If None, then resampling is disabled. (default=(‘D’,) or daily)

It can also be run as a script:

python grapple.py [-flags]

Optional flags:

-w, --websocket [websocket url]:
    Specify the rippled websocket url. (default=ws://127.0.0.1:6006/)

-p, --public:
    Use Ripple Labs' public websocket, wss://s1.ripple.com:51233.

-f, --full:
    Download the full Ripple ledger.  Automatic on your first run.

-g, --genesis [ledger index]:
    Halting point for full downloads; ignored for partial downloads.

-q, --quiet:
    Suppress command line output.

Tests

Unit tests are in the test/ directory. Coverage is not wonderful at the moment, but slowly improving!

Note: tests that require a local rippled and/or Postgres database connection are disabled by default. See test/test_grapple.py for details.

Project details


Release history Release notifications

History Node

0.2.2

This version
History Node

0.2.1

History Node

0.2

History Node

0.1.2

History Node

0.1.1

History Node

0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
grapple-0.2.1.tar.gz (9.5 kB) Copy SHA256 hash SHA256 Source None Sep 2, 2014

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page