Skip to main content

Store raw and structured FollowTheMoney data from different datasets in a data lake

Project description

followthemoney-store

This library provides methods to store, fetch and list entities formatted as followthemoney data as datasets stored in a SQL backend.

Usage

Command-line usage

# Insert a bunch of FtM entities into a store:
$ cat ftm-entities.ijson | ftm store write -d my_dataset
# Re-create the entities in aggregated form:
$ ftm store iterate -d my_dataset | alephclient write-entities -f my_dataset

If you don't want to keep the balkhash dataset generated above, there's a shortcut that combines the write and iterate functions:

$ cat ftm-entities.ijson | ftm store aggregate | alephclient write-entities -f my_dataset

Python Library

from ftmstore import Dataset

dataset = Dataset("US-OFAC")
dataset.put(entity, fragment='1')

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

followthemoney-store-2.2.0.tar.gz (6.9 kB view hashes)

Uploaded Source

Built Distribution

followthemoney_store-2.2.0-py2.py3-none-any.whl (9.4 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page