Skip to main content

auto_sql

Build Status

==Work in progress==

auto_sql is very early in development, more features to come

Description

auto_sql is a memory aware csv to sqlite converter capable of converting multi-gigabyte tabular files to sqlite databases on low memory machines. auto_sql focuses on speed by enabling multi-processing on multi-core machines.

Installation

$pip install auto_sql

Usage Case

from auto_sql import AutoSql

tab_obj = AutoSql(file='file.csv',
                        db_name='database',
                        sep='\t',
                        out_dir=".")

if __name__ == "__main__":
    tab_obj.run()

Currently auto_sql only supports csv's with headers

Dependencies

  • Python 3.4, 3.5, or 3.6

  • pandas==0.21.1

  • psutil==5.4.7

Metadata

Release files for auto-sql 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for auto-sql 0.0.2
File Size Uploaded Provenance Actions
auto_sql-0.0.2.tar.gz 4.3 kB Without provenance Details for auto_sql-0.0.2.tar.gz

Release files / auto_sql-0.0.2.tar.gz

Download URL auto_sql-0.0.2.tar.gz
Size 4.3 kB
Tags Source
SHA-256 checksum
How to use checksums
5621b07eb49aa1ca92d883d57f59ede0f14b79f089489b4326b1ea7e7980bb6c
BLAKE2b-256 checksum
How to use checksums
fd1e82317566d4187c1ab52243b74b609b7b74ce71be59886c1515be6c21eff9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.5

Security for auto-sql 0.0.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.0.2 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page