Skip to main content

Python Client for Google BigQuery

Project description

Python idiomatic client for Google BigQuery

pypi versions

Quick Start

$ pip install --upgrade google-cloud-bigquery

Authentication

With google-cloud-python we try to make authentication as painless as possible. Check out the Authentication section in our documentation to learn more. You may also find the authentication document shared by all the google-cloud-* libraries to be helpful.

Using the API

Querying massive datasets can be time consuming and expensive without the right hardware and infrastructure. Google BigQuery (BigQuery API docs) solves this problem by enabling super-fast, SQL-like queries against append-only tables, using the processing power of Google’s infrastructure.

Load data from CSV

import csv

from google.cloud import bigquery
from google.cloud.bigquery import SchemaField

client = bigquery.Client()

dataset = client.dataset('dataset_name')
dataset.create()  # API request

SCHEMA = [
    SchemaField('full_name', 'STRING', mode='required'),
    SchemaField('age', 'INTEGER', mode='required'),
]
table = dataset.table('table_name', SCHEMA)
table.create()

with open('csv_file', 'rb') as readable:
    table.upload_from_file(
        readable, source_format='CSV', skip_leading_rows=1)

Perform a synchronous query

# Perform a synchronous query.
QUERY = (
    'SELECT name FROM [bigquery-public-data:usa_names.usa_1910_2013] '
    'WHERE state = "TX"')
query = client.run_sync_query('%s LIMIT 100' % QUERY)
query.timeout_ms = TIMEOUT_MS
query.run()

for row in query.rows:
    print(row)

See the google-cloud-python API BigQuery documentation to learn how to connect to BigQuery using this Client Library.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

google-cloud-bigquery-0.26.0.tar.gz (92.9 kB view details)

Uploaded Source

Built Distribution

google_cloud_bigquery-0.26.0-py2.py3-none-any.whl (53.4 kB view details)

Uploaded Python 2Python 3

File details

Details for the file google-cloud-bigquery-0.26.0.tar.gz.

File metadata

File hashes

Hashes for google-cloud-bigquery-0.26.0.tar.gz
Algorithm Hash digest
SHA256 0103ce28b5124cdb915171d08a9439b9742bab15437c8cd37717894900aab4ef
MD5 73b873036bd9ecc84a95d155d3315041
BLAKE2b-256 cb5b3b7c76864281d7846f5b2e593b10656d2e63fd955987690ff209c661b013

See more details on using hashes here.

File details

Details for the file google_cloud_bigquery-0.26.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for google_cloud_bigquery-0.26.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8cea34bcdc7da81d085ed9b52568984094476b06856fddb0afda4846a2b9794a
MD5 0d6dcf3cf60ed5312d1c12e1b7c4f82c
BLAKE2b-256 400440480d01d4acb60761008c97a83197cd2f2043d9690e6bf99f8cd67b12e6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page