Python script to download Hive command results from Qubole Data Service (QDS)
Project description
IQ-Get
======
A way to retrieve large Hive results from Qubole Data Service (QDS), made for clients of `Interactive Query <https://kb.mediamath.com/wiki/pages/viewpage.action?pageId=10651642>`_.
Installation
------------
The only way to install iq-get, currently, is to install from source.
* Download the source code: ``git clone git@github.com:MediaMath/iq-get.git``
* Run the following commands (installing the project may require root)
::
$ cd iq-get
$ python setup.py install
Usage
-----
This is a command-line utility and can be used as follows:
::
$ iq-get -h
| usage: iq-get [-h] [-o OUTPUT] [-d DELIMITER] Token Query_ID
|
| positional arguments:
| Token API token of the account from which this query ran
| Query_ID The ID of the query whose results you wish to download
|
| optional arguments:
| -h, --help show this help message and exit
| -o OUTPUT, --output OUTPUT
| The name of the file you wish to write to test
| -d DELIMITER, --delimiter DELIMITER
| Custom delimiter you would like to use
$ iq-get QDS_API_TOKEN 1234567 # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.csv
$ iq-get QDS_API_TOKEN 1234567 -o my_filename.csv # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/my_filename.csv
$ iq-get QDS_API_TOKEN 1234567 -d $'\t' # Will write a tab-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.tsv
======
A way to retrieve large Hive results from Qubole Data Service (QDS), made for clients of `Interactive Query <https://kb.mediamath.com/wiki/pages/viewpage.action?pageId=10651642>`_.
Installation
------------
The only way to install iq-get, currently, is to install from source.
* Download the source code: ``git clone git@github.com:MediaMath/iq-get.git``
* Run the following commands (installing the project may require root)
::
$ cd iq-get
$ python setup.py install
Usage
-----
This is a command-line utility and can be used as follows:
::
$ iq-get -h
| usage: iq-get [-h] [-o OUTPUT] [-d DELIMITER] Token Query_ID
|
| positional arguments:
| Token API token of the account from which this query ran
| Query_ID The ID of the query whose results you wish to download
|
| optional arguments:
| -h, --help show this help message and exit
| -o OUTPUT, --output OUTPUT
| The name of the file you wish to write to test
| -d DELIMITER, --delimiter DELIMITER
| Custom delimiter you would like to use
$ iq-get QDS_API_TOKEN 1234567 # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.csv
$ iq-get QDS_API_TOKEN 1234567 -o my_filename.csv # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/my_filename.csv
$ iq-get QDS_API_TOKEN 1234567 -d $'\t' # Will write a tab-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.tsv
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
iq-get-1.0.0.tar.gz
(3.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file iq-get-1.0.0.tar.gz.
File metadata
- Download URL: iq-get-1.0.0.tar.gz
- Upload date:
- Size: 3.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1f697281add41fd2c5eebcd002dd3838b312234026a9728d36be11c61eeefd38
|
|
| MD5 |
be5ff12d0d90ba649fefa18cf0d342d0
|
|
| BLAKE2b-256 |
af101c1aeaa1ddbcc31a507897319945ec5801d10c44bfc3cd3f5fb2719782f4
|
File details
Details for the file iq_get-1.0.0-cp27-none-macosx_10_10_x86_64.whl.
File metadata
- Download URL: iq_get-1.0.0-cp27-none-macosx_10_10_x86_64.whl
- Upload date:
- Size: 3.7 kB
- Tags: CPython 2.7, macOS 10.10+ x86-64
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
39d60875bf246fb7bcc594ba17663b03f0da16ea3b660ef1bf5ea757fc4add53
|
|
| MD5 |
d8ecfe61d998b84e5a6c476afe1048cf
|
|
| BLAKE2b-256 |
21b84b2435f62578bf6243c33bc962b373301e7773b82f1e392cac2f5c5df199
|