A simple scraping library.
Project description
Purifier
A simple scraping library.
It allows you to easily create simple and concise scrapers, even when the input is quite messy.
Example usage
Extract titles and URLs of articles from Hacker News:
from purifier import request, html, xpath, maps, fields, one
scraper = (
request()
| html()
| xpath('//a[@class="titlelink"]')
| maps(
fields(
title=xpath("text()") | one(),
url=xpath("@href") | one(),
)
)
)
result = scraper.scrape("https://news.ycombinator.com")
result == [
{
"title": "Why Is the Web So Monotonous? Google",
"url": "https://reasonablypolymorphic.com/blog/monotonous-web/index.html",
},
{
"title": "Old jokes",
"url": "https://dynomight.net/old-jokes/",
},
...
]
Installation
pip install purifier
Docs
- Tutorial
- Available scrapers — API reference.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
purifier-0.2.16.tar.gz
(16.3 kB
view hashes)
Built Distribution
purifier-0.2.16-py3-none-any.whl
(16.2 kB
view hashes)
Close
Hashes for purifier-0.2.16-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 19ba1e1aab895ef964cd4f7905607edb5d2b6e28564161fc8ee7473bdfc28bee |
|
MD5 | f2e1c17d401de3c4a2d5076c6178feab |
|
BLAKE2b-256 | fcabfbed5979fe23d64873d2732b8df3b089ec5f4ba604fba88c0bb6eaf4b91b |