tt-data-store

Work with a shared market-data archive as if it were a local folder — backed by S3.

tt-data-store on PyPI · GitHub

New here? Start with the usage guide.

The idea

You have candle data (OHLCV) stored as Parquet files on S3. Multiple people or jobs need to read and write that data without stepping on each other.

MarketStore gives you a local working copy of the archive:

Open a folder → catalogue syncs from S3 (instruments + file list)
Call read() → downloads only the Parquet you need
Call write() + publish() → share your changes

You never manage S3 keys or checksums by hand.

Install

pip install "tt-data-store[s3]"

Python 3.11+. The [s3] extra installs boto3.

30-second example

from tt_data_store import Instrument, MarketStore

store = MarketStore(
    "./data",
    remote="s3://my-bucket/archive",
    region="us-east-1",
)

nifty = Instrument.index("NSE", "NIFTY")

# Read
df = store.read(nifty, start="2026-01-01", end="2026-01-31")

# Write
store.write(nifty, df, source="my-collector", register=True)
store.publish()

Documentation

Guide	What you'll learn
Usage guide	Concepts, setup, reading, writing, sync
API reference	Method signatures and types

When to use what

You want to…	Call
Check if remote moved ahead	`store.drift()`
Catch up with remote	`store.sync()` or `store.pull()`
Load candles	`store.read(instrument, start=..., end=...)`
Save candles locally	`store.write(instrument, candles, source=..., register=True)`
Share changes	`store.publish()`
See sync state	`store.status()`

Development

git clone https://github.com/Tiny-Trader/data-store.git
cd data-store
uv sync --extra dev --extra s3
uv run pytest

License

Apache-2.0 — see LICENSE.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tt_data_store-2.0.0.tar.gz (29.8 kB view details)

Uploaded Aug 27, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

tt_data_store-2.0.0-py3-none-any.whl (37.6 kB view details)

Uploaded Aug 27, 2026 Python 3

File details

Details for the file tt_data_store-2.0.0.tar.gz.

File metadata

Download URL: tt_data_store-2.0.0.tar.gz
Upload date: Aug 27, 2026
Size: 29.8 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for tt_data_store-2.0.0.tar.gz
Algorithm	Hash digest
SHA256	`5ebc85a97a2f8da859e93182c24051e6ff3dd8100361d0b72f17000314363c77`
MD5	`d0b43348fb1f58b12512566a5dd227bd`
BLAKE2b-256	`7439b870cf278a1545d851ca6f8cf7c9d6d7697fd8c2edc4015bdd5faec73862`

See more details on using hashes here.

Provenance

The following attestation bundles were made for tt_data_store-2.0.0.tar.gz:

Publisher: publish.yml on Tiny-Trader/data-store

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: tt_data_store-2.0.0.tar.gz
- Subject digest: 5ebc85a97a2f8da859e93182c24051e6ff3dd8100361d0b72f17000314363c77
- Sigstore transparency entry: 2618320855
- Sigstore integration time: Aug 27, 2026
Source repository:
- Permalink: Tiny-Trader/data-store@576be2a61e31cb93cd41e28d9dc26f2d6ce3ac7e
- Branch / Tag: refs/tags/v2.0.0
- Owner: https://github.com/Tiny-Trader
- Access: private
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: publish.yml@576be2a61e31cb93cd41e28d9dc26f2d6ce3ac7e
- Trigger Event: push