LakeApi 2 SQL

This is a simple library that has currently there methods:

insert_http_arrow_stream_to_sql

Make a HTTP Request to an Endpoint from the Lake API and inserts the data via bulk insert into MS SQL Server. In Theory you could also get the data from some other HTTP Endpoint which returns an Arrow Stream and is authenticated using Basic Auth. It does not guarantee atomicity at sql server level, therefore you will usually want to use a global temp table as target.
insert_record_batch_to_sql

Same as above, but the input is a generic RecordBatchReader from pyarrow

It's meant to be used from Python, the Logic is written in Rust.

Features

You can specify Authentication=ActiveDirectoryMSI|ActiveDirectoryDefault|ActiveDirectoryInteractive in the connection string similar to .Net/ODBC SQL Driver. This requires the azure-identity package to be installed

Roadmap

There is still a lot todo:

Allow passing more flexible HTTP Authentication options
Add option to read from database and write to a flat file
Document
Test

Alternatives

This would not have been possible without the excellent arrow-odbc-py library. Use it whenever SQL Server is not the only possible target, or you need to read from a database or you just need something better ;)

Metadata

Release files for lakeapi2sql 0.9.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lakeapi2sql 0.9.1
File	Size	Uploaded	Provenance	Actions
lakeapi2sql-0.9.1.tar.gz	1.7 MB	May 3, 2024	Without provenance	Details for lakeapi2sql-0.9.1.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for lakeapi2sql 0.9.1
File	Interpreter	ABI	Platform	Actions Reset
lakeapi2sql-0.9.1-cp310-abi3-win_amd64.whl 2.4 MB May 3, 2024 Without provenance	CPython 3.10	abi3	Windows x86-64	Details for lakeapi2sql-0.9.1-cp310-abi3-win_amd64.whl
lakeapi2sql-0.9.1-cp310-abi3-win32.whl 2.2 MB May 3, 2024 Without provenance	CPython 3.10	abi3	Windows x86-32	Details for lakeapi2sql-0.9.1-cp310-abi3-win32.whl
lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 4.8 MB May 3, 2024 Without provenance	CPython 3.10	abi3	Linux glibc 2.17+ x86-64	Details for lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whl 4.9 MB May 3, 2024 Without provenance	CPython 3.10	abi3	Linux glibc 2.17+ x86-32	Details for lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whl
lakeapi2sql-0.9.1-cp310-abi3-macosx_11_0_arm64.whl 2.5 MB May 3, 2024 Without provenance	CPython 3.10	abi3	macOS 11.0+ ARM64	Details for lakeapi2sql-0.9.1-cp310-abi3-macosx_11_0_arm64.whl
lakeapi2sql-0.9.1-cp310-abi3-macosx_10_12_x86_64.whl 2.6 MB May 3, 2024 Without provenance	CPython 3.10	abi3	macOS 10.12+ x86-64	Details for lakeapi2sql-0.9.1-cp310-abi3-macosx_10_12_x86_64.whl

Total release size: 21.1 MB

Release files / lakeapi2sql-0.9.1.tar.gz

Download URL	lakeapi2sql-0.9.1.tar.gz
Size	1.7 MB
Tags	Source
SHA-256 checksum How to use checksums	`fbd41265fcfa604bac6bdff346174a0fba01b4eb93fb23434cc8aed353f95d87`
BLAKE2b-256 checksum How to use checksums	`5032f63110aa9f34abb33af4342c60cdcf6636f6a6c38cea10db5f21e417d96b`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Release files / lakeapi2sql-0.9.1-cp310-abi3-win_amd64.whl

Download URL	lakeapi2sql-0.9.1-cp310-abi3-win_amd64.whl
Size	2.4 MB
Tags	CPython 3.10 Windows x86-64 abi3
SHA-256 checksum How to use checksums	`3339f274724f65744f48ef3b9ac5a44a167b72c91081b486fe64e2355efe4743`
BLAKE2b-256 checksum How to use checksums	`447791a5b6f6e2eaf1f87541529447c0efd765f7f11af2e3fa9976c282b1dc76`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Release files / lakeapi2sql-0.9.1-cp310-abi3-win32.whl

Download URL	lakeapi2sql-0.9.1-cp310-abi3-win32.whl
Size	2.2 MB
Tags	CPython 3.10 Windows x86-32 abi3
SHA-256 checksum How to use checksums	`7fecb632f58070dc65bebbeec57026e7294aab6f0ca05556652291f006dd47a5`
BLAKE2b-256 checksum How to use checksums	`23326f73ea814d4e8eca4b558dc96073cf4b90b72fc082abdafa01d5b0e854ac`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Release files / lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL	lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size	4.8 MB
Tags	CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum How to use checksums	`33f7d30a36121f9a45e43b663fbae182a50420bbb7645fe13698bbca42bd302f`
BLAKE2b-256 checksum How to use checksums	`1ba9c57cd9f2acd581bc38b83cd94dc47d6ba2ee99ad7e37dfefb0f4d90213a9`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Release files / lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL	lakeapi2sql-0.9.1-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whl
Size	4.9 MB
Tags	CPython 3.10 Linux glibc 2.17+ x86-32 abi3
SHA-256 checksum How to use checksums	`3611767dc21ec0c32611b5cc0d51e01e712c103a79372037fb9330792c6f3301`
BLAKE2b-256 checksum How to use checksums	`0780da6918914cad949f4141821d1f4dceda017b179f92aa2cedef1affeb0f72`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Release files / lakeapi2sql-0.9.1-cp310-abi3-macosx_11_0_arm64.whl

Download URL	lakeapi2sql-0.9.1-cp310-abi3-macosx_11_0_arm64.whl
Size	2.5 MB
Tags	CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`41ba4f1486e3bfe8fa566ff1f11d3bf950dd86f63ac2d7ac220855c99bb69228`
BLAKE2b-256 checksum How to use checksums	`051ac22e1724a3444c805cca235ed4a29f391d7cb36b12d1eab7184deb3a7016`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Release files / lakeapi2sql-0.9.1-cp310-abi3-macosx_10_12_x86_64.whl

Download URL	lakeapi2sql-0.9.1-cp310-abi3-macosx_10_12_x86_64.whl
Size	2.6 MB
Tags	CPython 3.10 abi3 macOS 10.12+ x86-64
SHA-256 checksum How to use checksums	`bf6aef6346ab4190d71d737f892e92396d4229bb4059a2b9c61bf8bf48a1b655`
BLAKE2b-256 checksum How to use checksums	`536e90095e62c08b187f09cd33dad20068c946495c24fea0657fd9ffdf7651e1`
Upload date	May 3, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`maturin/1.5.1`

Security for lakeapi2sql 0.9.1

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.9.1 This release

May 3, 2024 7 release files No provenance

lakeapi2sql 0.9.1