CSV Streamer
I find myself doing a lot of the same thing recently... and that thing is streaming large csv files over the network in batches.
So I made a small python library using a few techniques that I know to stream csv files and yield them as batches of arrow tables for further processing/wrangling etc.
There's 4 paths and one entry point:
- stream_csv()
You can stream:
- Local CSVs
- Local CSVs in a zip file
- Remote CSVs
- Remove CSVs in a zip file
1 maintainer
Metadata
1 maintainer
Release files for csv-streamer 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| csv_streamer-0.1.0.tar.gz | 8.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| csv_streamer-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 17.6 kB
Release files / csv_streamer-0.1.0.tar.gz
| Download URL | csv_streamer-0.1.0.tar.gz |
|---|---|
| Size | 8.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
fef3a0aa4fea1f8529c6b8f0c8a115dc7d67436f9e2afcc735406131c5dfffed
|
|
BLAKE2b-256 checksum How to use checksums |
1490056236e7d87401526a353f3ad8b56d968ef6d112f73709883fe75aeeb9f9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.17 {"installer":{"name":"uv","version":"0.9.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / csv_streamer-0.1.0-py3-none-any.whl
| Download URL | csv_streamer-0.1.0-py3-none-any.whl |
|---|---|
| Size | 9.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b9478e54cfac14291010231b7cf7702d0a520c67f3acc75ff6c94a797f1cc9ac
|
|
BLAKE2b-256 checksum How to use checksums |
46f3d1e14a7ffcf4bb38c242fb530812a674508453362a9fd2add5aae443cd59
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.17 {"installer":{"name":"uv","version":"0.9.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
