Skip to main content

Python Client for Google Cloud Dataproc API

alpha pypi versions

Google Cloud Dataproc API: Manages Hadoop-based clusters and jobs on Google Cloud Platform.

Quick Start

In order to use this library, you first need to go through the following steps:

  1. Select or create a Cloud Platform project.

  2. Enable billing for your project.

  3. Enable the Google Cloud Dataproc API.

  4. Setup Authentication.

Installation

Install this library in a virtualenv using pip. virtualenv is a tool to create isolated Python environments. The basic problem it addresses is one of dependencies and versions, and indirectly permissions.

With virtualenv, it’s possible to install this library without needing system install permissions, and without clashing with the installed system dependencies.

Supported Python Versions

Python >= 3.5

Deprecated Python Versions

Python == 2.7. Python 2.7 support will be removed on January 1, 2020.

Mac/Linux

pip install virtualenv
virtualenv <your-env>
source <your-env>/bin/activate
<your-env>/bin/pip install google-cloud-dataproc

Windows

pip install virtualenv
virtualenv <your-env>
<your-env>\Scripts\activate
<your-env>\Scripts\pip.exe install google-cloud-dataproc

Example Usage

from google.cloud import dataproc_v1

client = dataproc_v1.ClusterControllerClient()

project_id = ''
region = ''


# Iterate over all results
for element in client.list_clusters(project_id, region):
    # process element
    pass

# Or iterate over results one page at a time
for page in client.list_clusters(project_id, region).pages:
    for element in page:
        # process element
        pass

Next Steps

Metadata

Release files for google-cloud-dataproc 0.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for google-cloud-dataproc 0.7.0
File Size Uploaded
google-cloud-dataproc-0.7.0.tar.gz 237.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for google-cloud-dataproc 0.7.0
File Interpreter ABI Platform
google_cloud_dataproc-0.7.0-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 515.3 kB

Release files / google-cloud-dataproc-0.7.0.tar.gz

Download URL google-cloud-dataproc-0.7.0.tar.gz
Size 237.8 kB
Tags Source
SHA-256 checksum
How to use checksums
612f175466cb0dee45bc3e9157123ab59126e53f8baaa0bfa2095163ed52a279
BLAKE2b-256 checksum
How to use checksums
c0c0430b1f172622c3576923460830d3a84fb0fc2227b9d33b49ec04610a3331
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.0

Release files / google_cloud_dataproc-0.7.0-py2.py3-none-any.whl

Download URL google_cloud_dataproc-0.7.0-py2.py3-none-any.whl
Size 277.5 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
76ddc28fa12193d9ad7fa0f84c1ab50a1d4b68a725219e33312fd0090c0a977a
BLAKE2b-256 checksum
How to use checksums
58dcc42d191632d81d95ff82f539b12c9ebf26904b4ab3aa891b84953941e26f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.0

Release history Release notifications | RSS feed

5.29.0

2 release files

5.27.0

2 release files

5.26.0

2 release files

5.25.0

2 release files

5.24.0

2 release files

5.23.0

2 release files

5.22.0

2 release files

5.20.0

2 release files

5.18.1

2 release files

5.18.0

2 release files

5.17.1

2 release files

5.17.0

2 release files

5.16.0

2 release files

5.15.1

2 release files

5.15.0

2 release files

5.14.0

2 release files

5.13.0

2 release files

5.12.0

2 release files

5.10.2

2 release files

5.10.0

2 release files

5.9.3

2 release files

5.9.2

2 release files

5.9.1

2 release files

5.9.0

2 release files

5.8.0

2 release files

5.7.0

2 release files

5.6.0

2 release files

5.5.1

2 release files

5.5.0

2 release files

5.4.3

2 release files

5.4.2

2 release files

5.4.1

2 release files

5.4.0

2 release files

5.3.0

2 release files

5.2.0

2 release files

5.1.0

2 release files

5.0.3

2 release files

5.0.2

2 release files

5.0.1

2 release files

5.0.0

2 release files

4.0.3

2 release files

4.0.2

2 release files

4.0.1

2 release files

4.0.0

2 release files

3.3.2

2 release files

3.3.1

2 release files

3.3.0

2 release files

3.2.0

2 release files

3.1.1

2 release files

3.1.0

2 release files

3.0.0

2 release files

2.6.2

2 release files

2.6.1

2 release files

2.6.0

2 release files

2.5.0

2 release files

2.4.0

2 release files

2.3.1

2 release files

2.3.0

2 release files

2.2.0

2 release files

2.0.2

2 release files

2.0.1

2 release files

2.0.0

2 release files

1.1.3

2 release files

1.1.2

2 release files

1.1.1

2 release files

1.1.0

2 release files

1.0.1

2 release files

1.0.0

2 release files

0.8.2

2 release files

0.8.1

2 release files

0.8.0

2 release files

This release

0.7.0 This release

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.0

2 release files

0.4.0

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.0

2 release files

0.1.2

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page