用于爬取JD和github的代码，数据存储于mongodb。.
Project description
scrapy crawl test -s JOBDIR=data -0 items.csv
watch -n 1 -d 'wc -l items.csv;du -h items.csv'
附数据 items.csv
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy_jingdong-1.2.1.tar.gz
(4.7 kB
view hashes)
Built Distribution
Close
Hashes for scrapy_jingdong-1.2.1-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ee760df7aead5859d98da93207af683403f73d69d29d804ca4ba6be20e16533e |
|
| MD5 | afdec8a25c7fe875a5f25e29b97edb86 |
|
| BLAKE2b-256 | 525a980847cfc269448a66f59db89781f7cda4d4dbdab7201db4f95c8e0249bc |
