tap-feed 1.1.1

A Singer tap for RSS and Atom feeds built with the Meltano SDK for Singer Taps.

tap-feed

tap-feed is a Singer tap for various feeds and was built with the Meltano Tap SDK for Singer Taps. This tap can be used with RSS and Atom based feeds thanks to feedparser.

Installation

To install this tap, simply run the following command in your terminal:

pipx install tap-feed

Or if you don't want to use pipx:

pip3 install tap-feed

Configuration

Accepted Config Options

Property	Type	Required?	Description
feed_urls	String	Yes	A list of one or more feed paths
feed_fields	Array of Strings	Yes	A list of feed level data fields to capture
feed_entry_fields	Array of Strings	Yes	A list of entry level data fields to capture
feed_entry_replication_key	String	Yes	The field used to determine new records, typically 'published' or 'updated'
start_date	Date Time	No	The earliest record date to sync

A full list of supported settings and capabilities for this tap is available by running:

tap-feed --about

Example Config File

{
  "feed_urls": ["http://feeds.feedburner.com/PythonSoftwareFoundationNews", "https://talkpython.fm/episodes/rss"],
  "feed_fields": ["title", "subtitle"],
  "feed_entry_fields": ["id", "title", "link"],
  "feed_entry_replication_key": "published"
}

Usage

You can easily run tap-feed by itself or in a pipeline using Meltano.

Executing the Tap Directly

• First create a file containing the configuration in a json format, e.g., config.json
• Use the config file to create a catalog file and then invoke the tap

tap-feed --config config.json --discover > catalog.json
tap-feed --config config.json --catalog catalog.json