A high-level Web Crawling and Web Scraping framework
Project description
boris-spider
一款高可用的python爬虫框架,支持分布式及批次采集
安装
From PyPi:
pip3 install boris-spider
From Git:
pip3 install git+https://github.com/Boris-code/boris-spider.git
快速上手
import spider
class DemoSpider(spider.SingleSpider):
def start_requests(self, *args, **kws):
yield spider.Request("https://www.baidu.com")
def parser(self, request, response):
print(response.text)
if __name__ == "__main__":
DemoSpider().start()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
boris-spider-0.0.3.tar.gz
(82.5 kB
view hashes)
Built Distribution
boris_spider-0.0.3-py3-none-any.whl
(100.2 kB
view hashes)
Close
Hashes for boris_spider-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e9906077cb67de2b252ac7010609482a02f2531725e77dee967aecee958fb6a7 |
|
MD5 | 85912f9825d89622a218ed35acc1a695 |
|
BLAKE2b-256 | 182790569332632f80791d5b093feed217adb0bea7af2cf246cfdd9e07ec3cce |