Intake-Dremio

Dremio Plugin for Intake based on pyarrow Flight

User Installation

To install the intake-dremio plugin, execute the following command

conda install -c conda-forge intake-dremio

or:

pip install intake-dremio

When installing from the pyviz channel and conda-forge conda channels, you must ensure that libarrow-flight is also installed:

conda install -c pyviz -c conda-forge intake-dremio libarrow-flight

This is because conda-forge has split up pyarrow into individual packages as of pyarrow 16.

Example

An Intake catalog referencing a Dremio dataset consists of the uri pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr), e.g.:

sources:
  dremio_vds:
    driver: dremio 
    args:
        uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010  
        sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC

Release files for intake-dremio 0.2.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for intake-dremio 0.2.5
File	Size	Uploaded
intake_dremio-0.2.5.tar.gz	28.0 kB	Jun 13, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for intake-dremio 0.2.5
File	Interpreter	ABI	Platform	Reset
intake_dremio-0.2.5-py3-none-any.whl 9.5 kB Jun 13, 2024	Python 3	none	any	Details

Total release size: 37.6 kB

Release files / intake_dremio-0.2.5.tar.gz

Download URL	intake_dremio-0.2.5.tar.gz
Size	28.0 kB
Tags	Source
SHA-256 checksum How to use checksums	`02232073ca0df72e594a92edb1a5bf969e5f3f0d43feedf3e36f187507def98e`
BLAKE2b-256 checksum How to use checksums	`04dc64afb12bce125f33ab8ba728cbfa609e97d5bad0eced78b44b1716c15a3b`
Upload date	Jun 13, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.0.0 CPython/3.12.4`

Release files / intake_dremio-0.2.5-py3-none-any.whl

Download URL	intake_dremio-0.2.5-py3-none-any.whl
Size	9.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`c4b2677b184dcd4cf8c7b1c48a5f44ccc5a68f0a6921e375f5dbe4116214f6f4`
BLAKE2b-256 checksum How to use checksums	`ac4d051cb866b8caf24636c1d49844789ef58fbf1f3971185f1bfd274281223a`
Upload date	Jun 13, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.0.0 CPython/3.12.4`