Skip to main content

Download kernels from Kaggle.

Project description

kaggle-downloader

A wrapper around the Kaggle CLI to download multiple kernels at once.

Installation

  1. Grab the latest release of Python.
  2. Install this tool with pip install kaggle-downloader.
  3. Follow the steps from the Kaggle API documentation to create an API token. We never access this directly but let the official Kaggle API take care of authentication.

Usage

usage: kaggle-downloader [-h] {competition-refs,kernel-refs,kernels} ...

Download kernels from Kaggle.

positional arguments:
  {competition-refs,kernel-refs,kernels}
    competition-refs    Fetch competition references.
    kernel-refs         Fetch kernel references for a list of competition references.
    kernels             Fetch kernels for a list of kernel references.

optional arguments:
  -h, --help            show this help message and exit

Getting to the actual kernels takes three steps:

  1. Get a list of references to competitions:
    usage: kaggle-downloader competition-refs [-h] -o OUT
    
    optional arguments:
      -h, --help         show this help message and exit
      -o OUT, --out OUT  Output file.
    
  2. Get a list of references to kernels:
    usage: kaggle-downloader kernel-refs [-h] -c COMPETITIONS -e EXCLUDE -o OUT
    
    optional arguments:
      -h, --help            show this help message and exit
      -c COMPETITIONS, --competitions COMPETITIONS
                            File with list of competitions references.
      -e EXCLUDE, --exclude EXCLUDE
                            File with list of competitions references to exclude. Gets updated with competitions as they are processed.
      -o OUT, --out OUT     Output directory.
    
  3. Get kernels themselves:
    usage: kaggle-downloader kernels [-h] -k KERNELS -e EXCLUDE -o OUT
    
    optional arguments:
      -h, --help            show this help message and exit
      -k KERNELS, --kernels KERNELS
                            Directory with files containing a list of kernel references.
      -e EXCLUDE, --exclude EXCLUDE
                            File with list of kernel references to exclude. Gets updated with kernels as they are processed.
      -o OUT, --out OUT     Output directory.
    

Example usage

# Step 1:
kaggle-downloader competition-refs -o data/competition-refs.txt

# Step 2:
kaggle-downloader kernel-refs -c data/competition-refs.txt -e data/excluded-competition-refs.txt -o data/kernel-refs

# Step 3:
kaggle-downloader kernels -k data/kernel-refs -e data/excluded-kernel-refs.txt -o data/kernels

For developers

  1. Grab the latest release of Python.
  2. Install poetry.
  3. Run poetry install in the root of the repository.
  4. Set the Python interpreter in your IDE to the virtual environment that was created.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kaggle-downloader-1.0.2.tar.gz (5.5 kB view details)

Uploaded Source

Built Distribution

kaggle_downloader-1.0.2-py3-none-any.whl (6.1 kB view details)

Uploaded Python 3

File details

Details for the file kaggle-downloader-1.0.2.tar.gz.

File metadata

  • Download URL: kaggle-downloader-1.0.2.tar.gz
  • Upload date:
  • Size: 5.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.7 CPython/3.9.6 Windows/10

File hashes

Hashes for kaggle-downloader-1.0.2.tar.gz
Algorithm Hash digest
SHA256 4207947f5c9b4123071b124235b88dfb618e7cf16a85fa36793eee240f5f7b83
MD5 c1c6b457ee9d740a3c747814a28da2b5
BLAKE2b-256 c4dc75542c8cbccdbe4fccb4fced8e8c7288f3c102ec005bf4ca142f40db3fe8

See more details on using hashes here.

File details

Details for the file kaggle_downloader-1.0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for kaggle_downloader-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 cf0b38783af0092cc753ace61e533106ca782bf83fdc4c5efe27cd0856aa5538
MD5 18f2df667a36218677cfcbb2d8057fed
BLAKE2b-256 81070d3a9de96742eab66028f2c05d231c34e4b99cca7dc7c5ede85cd6ae57ab

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page