Skip to main content

Data provider for Python - Query data from local DuckDB

Project description

nextpoly-data-provider

NextPoly data provider for Python, built with Rust and PyO3.

Features

  • Query Polymarket on-chain data (order filled events, FPMM transactions)
  • Query Polymarket off-chain data (markets, market tokens)
  • Query timeseries data for trading analysis
  • Time-travel queries with simulation_time parameter
  • Built on DuckDB for fast local queries
  • Python 3.11+ support with abi3 compatibility

Installation

pip install nextpoly-data-provider

uv

uv add nextpoly-data-provider
# or
uv pip install nextpoly-data-provider

Quick Start

from data_provider import DataProvider

# Create provider with default DB paths
provider = DataProvider()
# Optional: limit DuckDB memory per connection
# provider = DataProvider(memory_limit="4GB")
# Optional: set spill directory + threads per connection
# provider = DataProvider(temp_directory="/tmp/duckdb", threads=4)

# Query markets
markets = provider.off_chain.list_markets(limit=10)
for market in markets:
    print(f"{market.raw_data.get('question')}")

# Query on-chain events
orders = provider.on_chain.list_orders(limit=10)

# Query time series data
ts = provider.trading.get_timeseries(token_id="...")

Time Travel Queries

from datetime import datetime, timezone

# Query data as of a specific time
ts = int(datetime(2024, 1, 1, tzinfo=timezone.utc).timestamp())
provider = DataProvider(simulation_time=ts)

# Or set it later
provider.set_simulation_time(ts)

Development

Building from source

cd crates/data-provider
uv sync
uv run maturin develop

Running tests

# Install test dependencies
uv pip install pytest duckdb --python .venv/bin/python

# Run all tests
.venv/bin/python -m pytest tests/ -v

# Run specific test file
.venv/bin/python -m pytest tests/test_queries.py -v

Code quality

# Lint with ruff
ruff check tests/

# Type check with ty
uv tool run ty check tests/

Requirements

  • Python 3.11+
  • Local DuckDB database files

Type stubs

Type stubs live next to the package in crates/data-provider/data_provider/*.pyi.

To build the extension with maturin and verify stubs against runtime objects:

uv --version
cargo run -p xtask -- stub-check

stub-check uses uv run in crates/provider, creating .venv if needed and installing maturin, mypy, ruff, and ty automatically. Pass --debug to skip --release.

Publishing

maturin publish --release

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

nextpoly_data_provider-0.9.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.2 MB view details)

Uploaded CPython 3.11+manylinux: glibc 2.17+ x86-64

nextpoly_data_provider-0.9.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (10.2 MB view details)

Uploaded CPython 3.11+manylinux: glibc 2.17+ ARM64

nextpoly_data_provider-0.9.2-cp311-abi3-macosx_11_0_arm64.whl (10.9 MB view details)

Uploaded CPython 3.11+macOS 11.0+ ARM64

File details

Details for the file nextpoly_data_provider-0.9.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for nextpoly_data_provider-0.9.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 372b0e4ceb6d0d9cb0ef5bc087cd1c7f5865976b70540c64a8a17bbfcbe6423c
MD5 a9f8ee0e0ded933f5a0445478c141dbd
BLAKE2b-256 4c21f8003f1875302875915c68314ad9fc554e4df154433d5d672a7ffd82fc6d

See more details on using hashes here.

File details

Details for the file nextpoly_data_provider-0.9.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for nextpoly_data_provider-0.9.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 ad95a755e13de57ca8dea764df89753aa29601a5701e8e5042644679e4964d52
MD5 fc16ff1f75e4c4b76d65522d1140373c
BLAKE2b-256 db00be293621fd2819dc19fe6defec370d9e3494c3f1706a67c123aa6a42630a

See more details on using hashes here.

File details

Details for the file nextpoly_data_provider-0.9.2-cp311-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for nextpoly_data_provider-0.9.2-cp311-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f7ffe58a321109c7a64db1802b34a3bfffb6a2445f9a568aaabf639a5af6d6af
MD5 afb208a183ea4411cf02dd355be58f57
BLAKE2b-256 59389170d3c5064bbec8b564d91495726a48d2e4c83e448d4edd2b42b4344bf3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page