Skip to main content

Python client for Dremio. See https://dremio.com

Project description

Dremio client

https://img.shields.io/pypi/v/dremio_client.svg https://img.shields.io/travis/rymurr/dremio_client.svg Documentation Status Updates Codacy Codecov

The un-official python client for Dremio’s REST API. This enables both administrators and data scientists to get the most out of Dremio in Python

Features

  • Cross platform support

  • All Pythons between 2.7 - 3.7 supported

  • Full support for Dremio’s REST API

  • Optional Support for Dremio’s ODBC or experimental Arrow Flight capabilities

  • Rich config file support via confuse yaml config library. Simple to create a client (config stored in a yaml file)

    from dremio_client import init
    client = init() # initialise connectivity to Dremio via config file
    catalog = client.data # fetch catalog
    vds = catalog.space.vds.get() # fetch a specific dataset
    df = vds.query() # query the first 1000 rows of the dataset and return as a DataFrame
    pds = catalog.source.pds.get() # fetch a physical dataset
    pds.metadata_refresh() # refresh metadata on that dataset
  • CLI interface for integration with scripts

    $ dremio_client query --sql 'select * from sys.options'
    {'results':results}
    $ dremio_client refresh-metadata --table 'my.vds.name'
    {'result':'ok'}
  • Catalog autocompletion in Jupyter Notebooks

https://raw.github.com/rymurr/dremio_client/master/docs/images/autocomplete.gif

Status

This is still alpha software and is relatively incomplete. Contributions in the form of Github Issues or Pull requests are welcome. See CONTRIBUTING

TODO

  • see issues

History

0.1.0 (2019-07-04)

  • First code, unreleased.

0.2.4 (2019-08-13)

  • Alpha quality release with partial implementation of features. First PyPI release.

0.3.0 (2019-08-14)

  • Beta quality release for GET based endpoints

0.5.0 (2019-10-30)

  • Most endpoint supported

  • flight support with tls & auth

  • minor bugfixes

0.6.3 (2020-01-29)

  • All endpoints supported

  • lots of bugfixes

  • utilities for building spaces/folders vds

  • removed recordclass library in favor of attrs

0.8.4 (2020-01-29)

  • history re-written

0.8.8 (2020-02-19)

  • minor bug fixes

0.8.9 (2020-02-19)

  • ensure use correct name for Spaces

0.8.11 (2020-03-09)

  • bug fixes when creating sources and folders

0.9.2 (2020-03-17)

  • add promote endpoint

  • update versions from pyup

0.10.1 (2020-03-19)

  • fix ssl verify flag in cli

0.11.1 (2020-04-09)

  • a number of bug fixes and improvements from the community

0.12.0 (2020-04-22)

  • add graph endpoint and cli flag

  • add more detailed exception handling

0.12.1 (2020-05-04)

  • few bug fixes and API extensions

0.13.0 (2020-05-21)

  • add version flag

  • upgrades and additions to some commands

0.13.1 (2020-05-21)

  • simplify delete cli command

0.13.2 (2020-05-22)

  • bugfixes

0.13.3 (2020-09-07)

  • fix wlm bug

  • bump dependencies

0.13.6 (2020-09-16)

  • add new apis

  • version bumps

0.14.0 (2021-04-01)

  • add new apis

  • version bumps

  • docs updates

  • fix to query to produce correct pandas data frame

  • fix to cli, dup args

0.15.1 (2021-08-26)

  • add new apis

  • version bumps

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dremio_client-0.15.1.tar.gz (3.5 MB view details)

Uploaded Source

Built Distribution

dremio_client-0.15.1-py2.py3-none-any.whl (53.2 kB view details)

Uploaded Python 2Python 3

File details

Details for the file dremio_client-0.15.1.tar.gz.

File metadata

  • Download URL: dremio_client-0.15.1.tar.gz
  • Upload date:
  • Size: 3.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.53.0 CPython/3.8.3

File hashes

Hashes for dremio_client-0.15.1.tar.gz
Algorithm Hash digest
SHA256 ff77bc63cb5e3ae50ff14df1834af45c4ac1613779aab8dd06b9392093f512a4
MD5 c33d075989b7aa56d45e00026ca8a16c
BLAKE2b-256 cc12a61355287f6a5af10bc6d72b35c3f8dbf74c7acb0b4b1f112167de7f75e2

See more details on using hashes here.

File details

Details for the file dremio_client-0.15.1-py2.py3-none-any.whl.

File metadata

  • Download URL: dremio_client-0.15.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 53.2 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.53.0 CPython/3.8.3

File hashes

Hashes for dremio_client-0.15.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 dbce9c7eb1cd1b5b73c74526314f8b247aab52531cf7664719eb6406c3385f90
MD5 2abf0fa7e7bb3717d1d3940384420b94
BLAKE2b-256 dd035eaf6594f94d49b0a99cb7a6f2c0265631814116c2314cfcdc94076879c8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page