Skip to main content

xyz17711-web-scraper

Publish PyPI Python versions License

Typed Python client for web-scraper, part of the 17711.xyz microservice fleet -- pay-per-call APIs settled in USDC via x402, listed on x402scan. See the Python family README for the full guide (payment configuration, LangChain integration, logging, error handling) -- this page only covers what's specific to this one package.

Install

pip install "xyz17711[web-scraper]"

Methods

Method Description
extract_markdown Fetches a URL and returns its main article content as clean Markdown ($0.007, x402)
get_task_status Polls for the result of a task enqueued by a *_async tool
scrape_url Fetches an arbitrary URL through a proxy sourced from proxy-pool, never directly ($0.005, x402)
scrape_url_async Enqueues a web_scraper_scrape_url job and returns a task id immediately ($0.005, x402)

Every method above has both a sync form and an async form (the a-prefixed sibling, e.g. aextract_markdown next to extract_markdown), sharing one underlying client.

Quickstart

from xyz17711_web_scraper import Client

client = Client("https://api.17711.xyz/registry/web-scraper")
# see the Methods table above for every available call and its request/response model

LangChain

pip install "xyz17711-web-scraper[langchain]"
from xyz17711_web_scraper import Client
from xyz17711_web_scraper.langchain_tools import WebScraperToolkit

client = Client("https://api.17711.xyz/registry/web-scraper")
tools = WebScraperToolkit(client=client).get_tools()

License

MIT -- see the repository's own LICENSE.

Metadata

Release files for xyz17711-web-scraper 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for xyz17711-web-scraper 0.1.0
File Size Uploaded
xyz17711_web_scraper-0.1.0.tar.gz 5.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for xyz17711-web-scraper 0.1.0
File Interpreter ABI Platform
xyz17711_web_scraper-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 11.8 kB

Release files / xyz17711_web_scraper-0.1.0.tar.gz

Download URL xyz17711_web_scraper-0.1.0.tar.gz
Size 5.6 kB
Tags Source
SHA-256 checksum
How to use checksums
f19e476a4881d36ab3b5138cb33257e3a20a73f965f7fc5bccc759284712eb6b
BLAKE2b-256 checksum
How to use checksums
55791c6223f464592cf84fec7483064636b8d400b39016dbc72286b552b0fc58
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.13

Release files / xyz17711_web_scraper-0.1.0-py3-none-any.whl

Download URL xyz17711_web_scraper-0.1.0-py3-none-any.whl
Size 6.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9838276618f8975f0f9ec0f2014f84213440b50008b79b8a433ceec70eca1ad8
BLAKE2b-256 checksum
How to use checksums
ec8d818e5c0c0057ccfe9208715c0d7708abd15e7938726e97dca1e4945d77f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.13

Release history Release notifications | RSS feed

0.1.2

2 release files

0.1.1

2 release files

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page