Skip to main content

Python package, scraping recipes from all over the internet

Project description

PyPi Travis Coveralls https://img.shields.io/github/license/hhursev/recipe-scrapers?:targethttps://github.com/hhursev/recipe-scrapers/blob/master/LICENSE:altLicense https://img.shields.io/github/stars/hhursev/recipe-scrapers?style=social:targethttps://github.com/hhursev/recipe-scrapers/:altGithub

A simple web scraping tool for recipe sites.

pip install recipe-scrapers

then:

from recipe_scrapers import scrape_me

# give the url as a string, it can be url from any site listed below
scraper = scrape_me('http://allrecipes.com/Recipe/Apple-Cake-Iv/Detail.aspx')

scraper.title()
scraper.total_time()
scraper.yields()
scraper.ingredients()
scraper.instructions()
scraper.image()
scraper.links()

Note: scraper.links() returns a dictionary object containing all of the <a> tag attributes. The attribute names are the dictionary keys.

Scrapers available for:

Contribute

Part of the reason I want this open sourced is because if a site makes a design change, the scraper for it should be modified.

If you spot a design change (or something else) that makes the scraper unable to work for a given site - please fire an issue asap.

If you are programmer PRs with fixes are warmly welcomed and acknowledged with a virtual beer.

If you want a scraper for a new site added

  • Open an Issue providing us the site name, as well as a recipe link from it.

  • If you are a developer and want to code the scraper on your own, this is a wonderful example of how to do it.

For Devs / Contribute

Assuming you have python3 installed, navigate to the directory where you want this project to live in and drop these lines

git clone git@github.com:hhursev/recipe-scrapers.git &&
cd recipe-scrapers &&
python3 -m venv .venv &&
source .venv/bin/activate &&
pip install -r requirements.txt &&
coverage run tests.py &&
coverage report

Spacial thanks to:

All the contributors that helped improving the package. You are awesome!

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

recipe_scrapers-5.0.0.tar.gz (14.9 kB view details)

Uploaded Source

Built Distribution

recipe_scrapers-5.0.0-py3-none-any.whl (70.2 kB view details)

Uploaded Python 3

File details

Details for the file recipe_scrapers-5.0.0.tar.gz.

File metadata

  • Download URL: recipe_scrapers-5.0.0.tar.gz
  • Upload date:
  • Size: 14.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/38.5.2 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/2.7.14

File hashes

Hashes for recipe_scrapers-5.0.0.tar.gz
Algorithm Hash digest
SHA256 326f6d701799e2e653fc45739d33fe741319532b78fa26fcf7fdca1af5ee0d8e
MD5 13efd4cb0a3a8e589a5ca90a167d3a72
BLAKE2b-256 ad347c3a70e372ee645aaed66f9a51344593b409c7f3c98a6e25b44048cee21c

See more details on using hashes here.

File details

Details for the file recipe_scrapers-5.0.0-py3-none-any.whl.

File metadata

  • Download URL: recipe_scrapers-5.0.0-py3-none-any.whl
  • Upload date:
  • Size: 70.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/38.5.2 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/2.7.14

File hashes

Hashes for recipe_scrapers-5.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ca673b07dbbade1379688d6cba23f3000132a1f990c91843bd11807611935f77
MD5 30ddeb573dd98f9cfc9bbd65535b9e0e
BLAKE2b-256 87b6987bc7156395b0c9c3ce55c0657df895eaff7ebb845ccfcc56cce82e9860

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page