xyz17711-web-scraper
Typed Python client for web-scraper, part of the 17711.xyz microservice fleet -- pay-per-call APIs settled in USDC via x402, listed on x402scan. See the Python family README for the full guide (payment configuration, LangChain integration, logging, error handling) -- this page only covers what's specific to this one package.
Install
pip install "xyz17711[web-scraper]"
Methods
| Method | Description |
|---|---|
extract_markdown |
URL to Markdown: read any web page and get its main article content as clean Markdown for agents ($0.003, x402) |
get_task_status |
Polls for the result of a task enqueued by a *_async tool |
scrape_url |
Scrape URL: fetch any web page through a proxy and get its status, content type and raw HTML ($0.002, x402) |
scrape_url_async |
[Deprecated - use web_scraper_scrape_url] Enqueues a web_scraper_scrape_url job and returns a task id immediately ($0.002, x402) |
Every method above has both a sync form and an async form (the a-prefixed sibling, e.g.
aextract_markdown next to extract_markdown), sharing one underlying client.
Quickstart
from xyz17711_web_scraper import Client
client = Client() # talks to https://api.17711.xyz/registry/web-scraper by default
# see the Methods table above for every available call and its request/response model
Pass another base URL (self-hosted instance, test server) as the first argument:
Client("https://my-host.example/registry/web-scraper").
LangChain
pip install "xyz17711-web-scraper[langchain]"
from xyz17711_web_scraper import Client
from xyz17711_web_scraper.langchain_tools import WebScraperToolkit
client = Client()
tools = WebScraperToolkit(client=client).get_tools()
License
MIT -- see the repository's own LICENSE.
1 maintainer
Metadata
1 maintainer
Release files for xyz17711-web-scraper 0.1.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| xyz17711_web_scraper-0.1.2.tar.gz | 6.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| xyz17711_web_scraper-0.1.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 13.3 kB
Release files / xyz17711_web_scraper-0.1.2.tar.gz
| Download URL | xyz17711_web_scraper-0.1.2.tar.gz |
|---|---|
| Size | 6.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1edb249bf6ca5abf8abda74f568620678628fb0b3736fda53ce2eae84a24f0cd
|
|
BLAKE2b-256 checksum How to use checksums |
8ead19dbcf98550cad7b18664cee6bbda74a89e091374fc364260030d07b8083
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.13
|
Release files / xyz17711_web_scraper-0.1.2-py3-none-any.whl
| Download URL | xyz17711_web_scraper-0.1.2-py3-none-any.whl |
|---|---|
| Size | 6.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
926dff345b8302424736700582c9a83991384e8db7eac5a85507cc234c07b9e5
|
|
BLAKE2b-256 checksum How to use checksums |
71bb961b8e0a82bb7d2bd6b3342c109de690151ce6bcdc888a882bf45c95796d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.13
|
