weweb 0.1.0

Dead-simple web data extraction. a = weweb(url), then a.images, a.links, a.text...

weweb 🕷️

Dead-simple web data extraction.
No boilerplate. Just point at a URL and pull what you need.

pip install weweb

---

Usage

from weweb import weweb

a = weweb("https://example.com")

a.images     # all images        → [{src, alt}, ...]
a.links      # all links         → [{url, text}, ...]
a.text       # all text blocks   → [{text}, ...]
a.headings   # h1–h6 headings    → [{level, text}, ...]
a.tables     # html tables       → [{col: value}, ...]
a.meta       # title, og tags    → [{title, description, ...}]
a.emails     # emails on page    → [{email}, ...]
a.phones     # phone numbers     → [{phone}, ...]

Export in one line

a.images.to_csv("images.csv")
a.links.to_json("links.json")
a.tables.to_db("data.db", table="products")

Custom selector

a.find("article h2")
a.find(".product-card", attrs=["class", "data-id"])

Chain exports

a.links.to_csv("links.csv").to_json("links.json")

---

License

MIT