Fetch web pages as robot
Project description
fetchas
Fetch URLs as search engine robot ("fetch as")
Show content or headers of a given URL with the HTTP "User-Agent" header set to a search engine robot. Defaults to Googlebot.
Online help:
usage: fetchas [-h] [-r] [-I] [-a ROBOT_AGENT] url
Fetch URLs as search engine robot.
positional arguments:
url
optional arguments:
-h, --help show this help message and exit
-r, --follow-redirects
Follow redirects, if any occur
-I, --headers Show only response headers
-a ROBOT_AGENT, --robot-agent ROBOT_AGENT
ROBOT_AGENT should be one of the following values
(default: 'googlebot'): default, desktop, googlebot,
mobile, googlebot-mobile, googlebot2, bingbot,
bingbot-mobile, browser, iphone, pixel
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
fetchas-0.2.tar.gz
(3.0 kB
view hashes)
Built Distribution
fetchas-0.2-py3-none-any.whl
(3.7 kB
view hashes)