A high-level Web Crawling and Web Scraping framework
Project description
boris-spider
一款高可用的python爬虫框架,支持分布式及批次采集
安装
From PyPi:
pip3 install boris-spider
From Git:
pip3 install git+https://github.com/Boris-code/boris-spider.git
快速上手
import spider
class DemoSpider(spider.SingleSpider):
def start_requests(self, *args, **kws):
yield spider.Request("https://www.baidu.com")
def parser(self, request, response):
print(response.text)
if __name__ == "__main__":
DemoSpider().start()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
boris-spider-0.0.2.tar.gz
(80.7 kB
view hashes)
Built Distribution
Close
Hashes for boris_spider-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0ac01b0e883c1cada4784676a05f849746aff5722e45b21666557c2c6d2bb15e |
|
MD5 | a0948c1eeb1a250a37374637a2d7bcb4 |
|
BLAKE2b-256 | 97f73d4530f7a28c98bfc12ebb3afde9a3d6069c274dbe61797e539ad2a13b95 |