Skip to main content

Scraper for www.zeitsprung.fm, a great history podcast.

Project description

zeitsprung.fm

zeitsprung

https://img.shields.io/pypi/v/zeitsprung.svg https://github.com/munterfi/zeitsprung/workflows/build/badge.svg Documentation Status Updates https://codecov.io/gh/munterfi/zeitsprung/branch/master/graph/badge.svg

Note: zeitsprung.fm has moved to geschichte.fm, therefore this project is no longer maintained.

This package provides a scraper for www.zeitsprung.fm, a great history podcast. To get the metadata of all episodes from the website, simply start the scraper:

from zeitsprung.scraping import Scraper
s = Scraper('path/to/folder/for/database')
s.run()

The scraper then downloads the all episode metadata and audio files. The metadata is written to the ‘meta’ table in the database. The audio files are converted to ‘.wav’ files and saved separately to a folder, while a link to the file is stored in the ‘audio’ table in the database.

To access the data, create a SQLiteEngine:

from zeitsprung.database import SQLiteEngine
db = SQLiteEngine('path/to/folder/for/database/zeitsprung.db')

Query the meta data from the database:

db.query_all_meta()

And the audio file paths and meta data:

db.query_all_audio()

Now have fun with analysing the episodes of zeitsprung!

Features

  • Scraper class to download the meta data and audio files of all episodes.
  • Database class to setup and access the SQLite database containing the meta data of the episodes.

To Do

  • Processing class to conduct speech recognition on the audio files and build an index for clustering the topics.
  • Visualize up to date statistics.

References

History

0.1.1 (2021-10-02)

  • Adjust URLs to GitHub account due to renaming @munterfinger to @munterfi.
  • Note: zeitsprung.fm has moved to geschichte.fm, therefore this project no longer is maintained.

0.1.0 (2020-09-22)

  • First release on PyPI.
  • Scraper class to download the meta data and audio files of all episodes.
  • Database class to setup and access the SQLite database containing the meta data of the episodes.
  • Documentation using readthedocs: https://zeitsprung.readthedocs.io/en/latest/
  • Github action for building and testing the package.
  • Coverage tests using codecov.io.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for zeitsprung, version 0.1.1
Filename, size File type Python version Upload date Hashes
Filename, size zeitsprung-0.1.1-py2.py3-none-any.whl (8.4 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size zeitsprung-0.1.1.tar.gz (57.2 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page