Use a random User-Agent provided by fake-useragent every request
Project description
scrapy-fake-useragent
Random User-Agent middleware based on fake-useragent. It picks up User-Agent strings based on usage statistics from a real world database.
Configuration
Turn off the built-in UserAgentMiddleware and add RandomUserAgentMiddleware:
DOWNLOADER_MIDDLEWARES = { 'scrapy.contrib.downloadermiddleware.useragent.UserAgentMiddleware': None, 'scrapy_fake_useragent.middleware.RandomUserAgentMiddleware': 400, }
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapy-fake-useragent-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 88e557917164a22a4b85db4554f9016fbe0c245bea3d7a57a4adcd6d992213c4 |
|
MD5 | 304005fd14a21856b48c3cf13b2a82a7 |
|
BLAKE2b-256 | 93ed5579d4e2cfffdc82503bd76b5b1ec60a73f85de612a85a8550eb6020cd20 |
Close
Hashes for scrapy_fake_useragent-0.0.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 697281fc0954fd29d7fc9e5ead74a6288d86e062db6fa419e980707d4da96eb5 |
|
MD5 | e35b567fa3532fa0eb1e2706754852ba |
|
BLAKE2b-256 | 98828158eed69fb3cca8bf5f960aa9156ae8b95b4af00e26d1deb7b8ff9e0964 |