xyz17711-web-scraper
Typed Python client for web-scraper, part of the 17711.xyz microservice fleet -- pay-per-call APIs settled in USDC via x402, listed on x402scan. See the Python family README for the full guide (payment configuration, LangChain integration, logging, error handling) -- this page only covers what's specific to this one package.
Install
pip install "xyz17711[web-scraper]"
Methods
| Method | Description |
|---|---|
extract_markdown |
URL to Markdown: read any web page and get its main article content as clean Markdown for agents ($0.003, x402) |
get_task_status |
Polls for the result of a task enqueued by a *_async tool |
scrape_url |
Scrape URL: fetch any web page through a proxy and get its status, content type and raw HTML ($0.002, x402) |
scrape_url_async |
[Deprecated - use web_scraper_scrape_url] Enqueues a web_scraper_scrape_url job and returns a task id immediately ($0.002, x402) |
Every method above has both a sync form and an async form (the a-prefixed sibling, e.g.
aextract_markdown next to extract_markdown), sharing one underlying client.
Quickstart
from xyz17711_web_scraper import Client
client = Client("https://api.17711.xyz/registry/web-scraper")
# see the Methods table above for every available call and its request/response model
LangChain
pip install "xyz17711-web-scraper[langchain]"
from xyz17711_web_scraper import Client
from xyz17711_web_scraper.langchain_tools import WebScraperToolkit
client = Client("https://api.17711.xyz/registry/web-scraper")
tools = WebScraperToolkit(client=client).get_tools()
License
MIT -- see the repository's own LICENSE.
1 maintainer
Metadata
1 maintainer
Release files for xyz17711-web-scraper 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| xyz17711_web_scraper-0.1.1.tar.gz | 6.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| xyz17711_web_scraper-0.1.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 12.6 kB
Release files / xyz17711_web_scraper-0.1.1.tar.gz
| Download URL | xyz17711_web_scraper-0.1.1.tar.gz |
|---|---|
| Size | 6.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
328091ce71866a19eddab5f73f0472a043ba7a27d4af52b83cf737dca5f9546e
|
|
BLAKE2b-256 checksum How to use checksums |
47862ca4b63135921bea1ec14fdb480f5fca96d0f676fa97e1ae80043b5cccea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.13
|
Release files / xyz17711_web_scraper-0.1.1-py3-none-any.whl
| Download URL | xyz17711_web_scraper-0.1.1-py3-none-any.whl |
|---|---|
| Size | 6.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
661a43f283b5bdd508115e63f913537ca470cb092f4b2269f84f6c242b81a2a9
|
|
BLAKE2b-256 checksum How to use checksums |
9577b84e3874667641ede3c9d4a17e4d32258165d680ce639d2ee24de7ac37de
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.13
|
