Python script to download Hive command results from Qubole Data Service (QDS)
Project description
IQ-Get
======
A way to retrieve large Hive results from Qubole Data Service (QDS), made for clients of `Interactive Query <https://kb.mediamath.com/wiki/pages/viewpage.action?pageId=10651642>`_.
Installation
------------
The only way to install iq-get, currently, is to install from source.
* Download the source code: ``git clone git@github.com:MediaMath/iq-get.git``
* Run the following commands (installing the project may require root)
::
$ cd iq-get
$ python setup.py install
Usage
-----
This is a command-line utility and can be used as follows:
::
$ iq-get -h
| usage: iq-get [-h] [-o OUTPUT] [-d DELIMITER] Token Query_ID
|
| positional arguments:
| Token API token of the account from which this query ran
| Query_ID The ID of the query whose results you wish to download
|
| optional arguments:
| -h, --help show this help message and exit
| -o OUTPUT, --output OUTPUT
| The name of the file you wish to write to test
| -d DELIMITER, --delimiter DELIMITER
| Custom delimiter you would like to use
$ iq-get QDS_API_TOKEN 1234567 # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.csv
$ iq-get QDS_API_TOKEN 1234567 -o my_filename.csv # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/my_filename.csv
$ iq-get QDS_API_TOKEN 1234567 -d $'\t' # Will write a tab-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.tsv
======
A way to retrieve large Hive results from Qubole Data Service (QDS), made for clients of `Interactive Query <https://kb.mediamath.com/wiki/pages/viewpage.action?pageId=10651642>`_.
Installation
------------
The only way to install iq-get, currently, is to install from source.
* Download the source code: ``git clone git@github.com:MediaMath/iq-get.git``
* Run the following commands (installing the project may require root)
::
$ cd iq-get
$ python setup.py install
Usage
-----
This is a command-line utility and can be used as follows:
::
$ iq-get -h
| usage: iq-get [-h] [-o OUTPUT] [-d DELIMITER] Token Query_ID
|
| positional arguments:
| Token API token of the account from which this query ran
| Query_ID The ID of the query whose results you wish to download
|
| optional arguments:
| -h, --help show this help message and exit
| -o OUTPUT, --output OUTPUT
| The name of the file you wish to write to test
| -d DELIMITER, --delimiter DELIMITER
| Custom delimiter you would like to use
$ iq-get QDS_API_TOKEN 1234567 # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.csv
$ iq-get QDS_API_TOKEN 1234567 -o my_filename.csv # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/my_filename.csv
$ iq-get QDS_API_TOKEN 1234567 -d $'\t' # Will write a tab-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.tsv
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
iq-get-1.0.0.tar.gz
(3.1 kB
view hashes)
Built Distribution
Close
Hashes for iq_get-1.0.0-cp27-none-macosx_10_10_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 39d60875bf246fb7bcc594ba17663b03f0da16ea3b660ef1bf5ea757fc4add53 |
|
MD5 | d8ecfe61d998b84e5a6c476afe1048cf |
|
BLAKE2b-256 | 21b84b2435f62578bf6243c33bc962b373301e7773b82f1e392cac2f5c5df199 |