Skip to main content

scrapes spotify starting from an artist id, stores in sqlite

Project description

Spotiflite

Build Status Latest Version

Scrapes Spotify and dumps data to a sqlite3 database.

  • Uses requests to make queries, with pythonic user-agent
  • sleeps randomly between each HTTP call
  • is NOT in a hurry to get anywhere
  • has nice 80's cli interface

Install

$ pip install spotiflite

then go somewhere and setup a database:

$ spotiflite setup

you can also specify the db filename:

$ spotiflite --spotifydb=this/awesome/db setup

Usage

For example scrape Frank ෴ Zappa

$ spotiflite scrape 6ra4GIOgCZQZMOaUECftGN 
got 44 artist ids
extracted data for Tom Waits
saved data for Tom Waits
got 8 artist ids
extracted data for Elmer Snowden
saved data for Elmer Snowden
got 6 artist ids
extracted data for Wesley Willis
saved data for Wesley Willis
...

while its running you can get stats in another window

$ spotiflite stats 
rows: 9882
completed: 1395
jobs to do: 8487
DB size: 48.04 MB

Cli usage

Usage: spotiflite.py [OPTIONS] COMMAND [ARGS]...

Options:
  -db, --spotifydb TEXT  sqlite filename [default: spotify.db]
  --help                 Show this message and exit.

Commands:
  scrape    starts scraping from given artist id
  setup     creates tables
  stats     print out db stats
  teardown  deletes tables

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spotiflite-0.0.5.tar.gz (5.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

spotiflite-0.0.5-py3-none-any.whl (6.9 kB view details)

Uploaded Python 3

File details

Details for the file spotiflite-0.0.5.tar.gz.

File metadata

  • Download URL: spotiflite-0.0.5.tar.gz
  • Upload date:
  • Size: 5.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.7.5 Darwin/18.2.0

File hashes

Hashes for spotiflite-0.0.5.tar.gz
Algorithm Hash digest
SHA256 28db630066458b533a614cc81b8d4c7ee80f49e4fa48d95af322c1b1a739689d
MD5 64700e47e001384d53bf061fcfa90329
BLAKE2b-256 8080094e68e0d5b1a14eaa91816321b5fb253ce77d10353623406e059e49db1b

See more details on using hashes here.

File details

Details for the file spotiflite-0.0.5-py3-none-any.whl.

File metadata

  • Download URL: spotiflite-0.0.5-py3-none-any.whl
  • Upload date:
  • Size: 6.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.7.5 Darwin/18.2.0

File hashes

Hashes for spotiflite-0.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 1ebe743d830655bd5c23109d513c998ca79ecb304d065aa7b1370804d49f14dc
MD5 a033b66b02d6c990e73b33370834f581
BLAKE2b-256 ba09b4506ff31fb1b78cd3e6b9c179fd5016482197445c5cbc724f412a644d8a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page