Skip to main content

Adaptive read-only chunked SQL reader for large replicas

Project description

sql-chunker

Adaptive read-only chunked SQL reader. Drop-in for pd.read_sql.

from sql_chunker import ChunkedReader
_reader = ChunkedReader(get_pg_engine())
df = _reader.read_sql(sql)

Inside: read-only, statement_timeout=15s, adaptive chunk sizing (~8s/chunk), shrink-and-retry on timeout, safe direct fallback.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sql_chunker-1.1.1.tar.gz (10.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sql_chunker-1.1.1-py3-none-any.whl (11.1 kB view details)

Uploaded Python 3

File details

Details for the file sql_chunker-1.1.1.tar.gz.

File metadata

  • Download URL: sql_chunker-1.1.1.tar.gz
  • Upload date:
  • Size: 10.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for sql_chunker-1.1.1.tar.gz
Algorithm Hash digest
SHA256 eb6061371864651549cf0f3b57da88d1bef34e4e1255887616e94e75b4280efd
MD5 08711696b326ea39c5a40deb6166a2ed
BLAKE2b-256 2984f56c289e58d3963f89690ca27ef8b563d1fb6692444dd1309b646c6554c4

See more details on using hashes here.

Provenance

The following attestation bundles were made for sql_chunker-1.1.1.tar.gz:

Publisher: publish.yml on makarsuperstar/sql-chunker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file sql_chunker-1.1.1-py3-none-any.whl.

File metadata

  • Download URL: sql_chunker-1.1.1-py3-none-any.whl
  • Upload date:
  • Size: 11.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for sql_chunker-1.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fb1556a3e27c5dceafa7715bf4ba65e39d433367abc5f09cec5b50f97f1b2c13
MD5 17c5f42a5a73bd7182b801e66d22d031
BLAKE2b-256 a1a699a1f820a415912504930be428d3f45dcbdda2a3f2e32c22e5bd42aeab76

See more details on using hashes here.

Provenance

The following attestation bundles were made for sql_chunker-1.1.1-py3-none-any.whl:

Publisher: publish.yml on makarsuperstar/sql-chunker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page