Python client for Dremio. See https://dremio.com
Project description
Dremio client
The un-official python client for Dremio’s REST API. This enables both administrators and data scientists to get the most out of Dremio in Python
- Documentation: https://dremio-client.readthedocs.io.
- Github: https://github.com/rymurr/dremio_client
- PyPI: https://pypi.python.org/pypi/dremio_client
- Free software: Apache Software License 2.0
Features
Cross platform support
All Pythons between 2.7 - 3.7 supported
Full support for Dremio’s REST API
Optional Support for Dremio’s ODBC or experimental Arrow Flight capabilities
Rich config file support via confuse yaml config library. Simple to create a client (config stored in a yaml file)
from dremio_client import init client = init() # initialise connectivity to Dremio via config file catalog = client.data # fetch catalog vds = catalog.space.vds.get() # fetch a specific dataset df = vds.query() # query the first 1000 rows of the dataset and return as a DataFrame pds = catalog.source.pds.get() # fetch a physical dataset pds.metadata_refresh() # refresh metadata on that dataset
CLI interface for integration with scripts
$ dremio_client query --sql 'select * from sys.options' {'results':results} $ dremio_client refresh-metadata --table 'my.vds.name' {'result':'ok'}
Catalog autocompletion in Jupyter Notebooks
Status
This is still alpha software and is relatively incomplete. Contributions in the form of Github Issues or Pull requests are welcome. See CONTRIBUTING
TODO
- see issues
History
0.1.0 (2019-07-04)
- First code, unreleased.
0.2.4 (2019-08-13)
- Alpha quality release with partial implementation of features. First PyPI release.
0.3.0 (2019-08-14)
- Beta quality release for GET based endpoints
0.5.0 (2019-10-30)
- Most endpoint supported
- flight support with tls & auth
- minor bugfixes
0.6.3 (2020-01-29)
- All endpoints supported
- lots of bugfixes
- utilities for building spaces/folders vds
- removed recordclass library in favor of attrs
0.8.4 (2020-01-29)
- history re-written
0.8.8 (2020-02-19)
- minor bug fixes
0.8.9 (2020-02-19)
- ensure use correct name for Spaces
0.8.11 (2020-03-09)
- bug fixes when creating sources and folders
0.9.2 (2020-03-17)
- add promote endpoint
- update versions from pyup
0.10.1 (2020-03-19)
- fix ssl verify flag in cli
0.11.1 (2020-04-09)
- a number of bug fixes and improvements from the community
0.12.0 (2020-04-22)
- add graph endpoint and cli flag
- add more detailed exception handling
0.12.1 (2020-05-04)
- few bug fixes and API extensions
0.13.0 (2020-05-21)
- add version flag
- upgrades and additions to some commands
0.13.1 (2020-05-21)
- simplify delete cli command
0.13.2 (2020-05-22)
- bugfixes
0.13.3 (2020-09-07)
- fix wlm bug
- bump dependencies
0.13.6 (2020-09-16)
- add new apis
- version bumps
0.14.0 (2021-04-01)
- add new apis
- version bumps
- docs updates
- fix to query to produce correct pandas data frame
- fix to cli, dup args
0.15.1 (2021-08-26)
- add new apis
- version bumps
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for dremio_client-0.15.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbce9c7eb1cd1b5b73c74526314f8b247aab52531cf7664719eb6406c3385f90 |
|
MD5 | 2abf0fa7e7bb3717d1d3940384420b94 |
|
BLAKE2-256 | dd035eaf6594f94d49b0a99cb7a6f2c0265631814116c2314cfcdc94076879c8 |