A high-level Web Crawling and Web Scraping framework
Project description
boris-spider
一款高可用的python爬虫框架,支持分布式及批次采集
安装
From pip:
pip3 install boris-spider
From Git:
pip3 install git+https://github.com/Boris-code/spider.git
快速上手
import spider
class DemoSpider(spider.SingleSpider):
def start_requests(self, *args, **kws):
yield spider.Request("https://www.baidu.com")
def parser(self, request, response):
print(response.text)
if __name__ == "__main__":
DemoSpider().start()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
boris-spider-0.0.1.tar.gz
(81.0 kB
view hashes)
Built Distribution
Close
Hashes for boris_spider-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 030264381affcb857862d201284fa93c8e06d2b56a5f89bc8cc40c8bae23289e |
|
MD5 | 12eb82b38444a9a5fb3451b24969f926 |
|
BLAKE2b-256 | ef854d6fe285655fcd3ecbfa68915f4dd761195ccf01b4ef5aac5ed73987d0bc |