datahtml
datahtml is a library for crawling and extraction of data from html and xml content.
Datahtml lets you:
- Extract ld+json data from html
- Extract frequently used meta tags from html (those that are used for SEO and social media, between others)
- Extract Article data from a html, usually from Newspaper sites
- Parse RSS feeds from sites
- Crawl some specific social media sites like google and youtube
Under the hood datahtml uses libraries like BeautifoulSoup, Newspaper2k, feedparser between others, but datahtml takes an opinionated approach for crawling based on our expriencies doing so.
Quickstart
pip install datahtml
from datahtml import web, crawler
c = crawler.LocalCrawler()
w = web.download("https://www.infobae.com", crawler=c)
w.links()
License
datahtml is distributed under the terms of the MPL-2.0 license.
1 maintainer
Release files for datahtml 0.6.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| datahtml-0.6.0.tar.gz | 665.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| datahtml-0.6.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 745.0 kB
Release files / datahtml-0.6.0.tar.gz
| Download URL | datahtml-0.6.0.tar.gz |
|---|---|
| Size | 665.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
bba0f54648b8775da325cf8b8b6c0572983a79b3d4a049a1efec4b0f49fc0fbe
|
|
BLAKE2b-256 checksum How to use checksums |
39b2a9e8810db6368ddd66ff352e8e2949fb7e67c145afb35b4c08a5c7a39a90
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
python-httpx/0.23.0
|
Release files / datahtml-0.6.0-py3-none-any.whl
| Download URL | datahtml-0.6.0-py3-none-any.whl |
|---|---|
| Size | 79.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2de61dde0fc745e3a06afd6889f9ac53365a615f5073298c1095516bf74f8eb4
|
|
BLAKE2b-256 checksum How to use checksums |
4c2c056ec3bf258f682d9fa362d3598a2ed4b2f9308db9c60a81b780ade35712
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
python-httpx/0.23.0
|
