Skip to main content

Python script to download Hive command results from Qubole Data Service (QDS)

Project description

IQ-Get
======
A way to retrieve large Hive results from Qubole Data Service (QDS), made for clients of `Interactive Query <https://kb.mediamath.com/wiki/pages/viewpage.action?pageId=10651642>`_.

Installation
------------
The only way to install iq-get, currently, is to install from source.

* Download the source code: ``git clone git@github.com:MediaMath/iq-get.git``
* Run the following commands (installing the project may require root)
::
$ cd iq-get
$ python setup.py install


Usage
-----
This is a command-line utility and can be used as follows:
::
$ iq-get -h
| usage: iq-get [-h] [-o OUTPUT] [-d DELIMITER] Token Query_ID
|
| positional arguments:
| Token API token of the account from which this query ran
| Query_ID The ID of the query whose results you wish to download
|
| optional arguments:
| -h, --help show this help message and exit
| -o OUTPUT, --output OUTPUT
| The name of the file you wish to write to test
| -d DELIMITER, --delimiter DELIMITER
| Custom delimiter you would like to use

$ iq-get QDS_API_TOKEN 1234567 # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.csv
$ iq-get QDS_API_TOKEN 1234567 -o my_filename.csv # Will write a comma-delimited file with results of query with ID 1234567 to ~/Desktop/my_filename.csv
$ iq-get QDS_API_TOKEN 1234567 -d $'\t' # Will write a tab-delimited file with results of query with ID 1234567 to ~/Desktop/full_result_1234567.tsv

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iq-get-1.0.0.tar.gz (3.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

iq_get-1.0.0-cp27-none-macosx_10_10_x86_64.whl (3.7 kB view details)

Uploaded CPython 2.7macOS 10.10+ x86-64

File details

Details for the file iq-get-1.0.0.tar.gz.

File metadata

  • Download URL: iq-get-1.0.0.tar.gz
  • Upload date:
  • Size: 3.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for iq-get-1.0.0.tar.gz
Algorithm Hash digest
SHA256 1f697281add41fd2c5eebcd002dd3838b312234026a9728d36be11c61eeefd38
MD5 be5ff12d0d90ba649fefa18cf0d342d0
BLAKE2b-256 af101c1aeaa1ddbcc31a507897319945ec5801d10c44bfc3cd3f5fb2719782f4

See more details on using hashes here.

File details

Details for the file iq_get-1.0.0-cp27-none-macosx_10_10_x86_64.whl.

File metadata

File hashes

Hashes for iq_get-1.0.0-cp27-none-macosx_10_10_x86_64.whl
Algorithm Hash digest
SHA256 39d60875bf246fb7bcc594ba17663b03f0da16ea3b660ef1bf5ea757fc4add53
MD5 d8ecfe61d998b84e5a6c476afe1048cf
BLAKE2b-256 21b84b2435f62578bf6243c33bc962b373301e7773b82f1e392cac2f5c5df199

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page