Skip to main content

Adaptive read-only chunked SQL reader for large replicas

Project description

sql-chunker

Adaptive read-only chunked SQL reader. Drop-in for pd.read_sql.

from sql_chunker import ChunkedReader
_reader = ChunkedReader(get_pg_engine())
df = _reader.read_sql(sql)

Inside: read-only, statement_timeout=15s, adaptive chunk sizing (~8s/chunk), shrink-and-retry on timeout, safe direct fallback.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sql_chunker-1.0.0.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sql_chunker-1.0.0-py3-none-any.whl (9.4 kB view details)

Uploaded Python 3

File details

Details for the file sql_chunker-1.0.0.tar.gz.

File metadata

  • Download URL: sql_chunker-1.0.0.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for sql_chunker-1.0.0.tar.gz
Algorithm Hash digest
SHA256 5d7b1a80bbaaeffdb9dac3db141c9de24072cf8636624509404962967473d5e1
MD5 2f4b2956077a6c865aad405d03daa3a3
BLAKE2b-256 cb753e71545084444e9455e93751dedb8180616675dfdd34f8059a7e56bc4a09

See more details on using hashes here.

Provenance

The following attestation bundles were made for sql_chunker-1.0.0.tar.gz:

Publisher: publish.yml on makarsuperstar/sql-chunker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file sql_chunker-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: sql_chunker-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 9.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for sql_chunker-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8a4df7e06adc92e901a58601bed013c9773ab3a2713e21e80184f212d1b7827f
MD5 0f6992251d2a6c332672b434c6aae4ad
BLAKE2b-256 2581698ac6de15197479e4878a83bb6eca9efc9b31ff46eae28b5143b3747963

See more details on using hashes here.

Provenance

The following attestation bundles were made for sql_chunker-1.0.0-py3-none-any.whl:

Publisher: publish.yml on makarsuperstar/sql-chunker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page