Skip to main content

Data7 streams CSV/Parquet datasets over HTTP from SQL queries.

Project description

Data7 ⚡ Open your data in minutes

Pronounced data·set (7 like sept in French).

GitHub Actions Workflow Status PyPI - Version

The idea 💡

TL;DR Data7 is a high performance web server that generates dynamic datasets (in CSV or Parquet formats) from existing databases and streams them over HTTP 🎉

A quick example

Let say you have a restaurant table in your PostgreSQL database, and you want to make this table an always-up-to-date dataset that can be easily used by the rest of the world.

All you have to do is to initialize your project:

data7 init

✍️ Edit configuration files:

# settings.yaml
production:
  host: "https://data7.wonderful-places.org"
  port: 80

# .secrets.yaml
production:
  DATABASE_URL: "postgresql+asyncpg://user:pass@server:port/wonderful-places"

# data7.yaml
production:
  datasets:
    - basename: restaurants
      query: "SELECT * FROM restaurant"

🏎️ Fire up the data7 server:

data7 run

💥 Your dataset is available at:

Documentation

The complete documentation of the project is avaiable at: https://jmaupetit.github.io/data7/

License

This work is released under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data7-0.8.0.tar.gz (9.9 kB view details)

Uploaded Source

Built Distribution

data7-0.8.0-py3-none-any.whl (11.0 kB view details)

Uploaded Python 3

File details

Details for the file data7-0.8.0.tar.gz.

File metadata

  • Download URL: data7-0.8.0.tar.gz
  • Upload date:
  • Size: 9.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for data7-0.8.0.tar.gz
Algorithm Hash digest
SHA256 24969e52b9c545c081f77ec78a5d72dafb54e70abc6b0ac2057211ffe685bde8
MD5 7654240a62763f66e0645e47a763d829
BLAKE2b-256 100b0d3c36a701629cffd4bb14a2e1f1619c38312e0ff995eaee9165fc743473

See more details on using hashes here.

File details

Details for the file data7-0.8.0-py3-none-any.whl.

File metadata

  • Download URL: data7-0.8.0-py3-none-any.whl
  • Upload date:
  • Size: 11.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for data7-0.8.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3c15029ef0e05e3b3de93c6f3d366163bda6708d588c4cf846fe8d9f4fac2ca5
MD5 e3b7240a708222092dee9e8643482517
BLAKE2b-256 e76243e53c7c151f0f7d48c9ced6fc99853de3544fafcff24d751066425ce7bb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page