A simple package for crawling bol.com
This is a really simple crawler that makes use of Scrapy to crawl bol.com.
Crawler instance has two functions you can use,
crawl_category. See an example below.
from bol_crawler.crawler import Crawler crawler = Crawler() # to crawl products products = crawler.crawl_products( [ 'https://www.bol.com/nl/p/lg-34gl750-b-ultragear-gaming-monitor/9200000115819731', ] ) # to crawl a category products = crawler.crawl_category( [ 'https://www.bol.com/nl/l/gaming-toetsenborden/N/18214/', 0 # the 0 value is how often you want to go to the next page. 0 is just crawling the first page ] )
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size bol_crawler-0.0.1-py3-none-any.whl (14.0 kB)||File type Wheel||Python version py3||Upload date||Hashes View|
|Filename, size bol-crawler-0.0.1.tar.gz (1.3 kB)||File type Source||Python version None||Upload date||Hashes View|
Hashes for bol_crawler-0.0.1-py3-none-any.whl