A python crawler authored by Ken.
Project description
kcrawler
A python crawler authored by Ken.
1. 安装
pip install kcrawler
更新:
pip install --upgrade kcrawler
2. 使用
2.1 命令行
2.1.1 指定城市爬取安居客小区房价
kcrawler anjuke --city shenzhen --limit 50
数据保存在当前目录下,格式如下:
anjuke_shenzhen_community_price_20xx-xx-xx.csv
2.1.2 爬取掘金专栏阅读量
kcrawler juejin post --name ken --limit 100
kcrawler juejin post --name ken --limit 100 --url 'https://timeline-merger-ms.juejin.im/v1/get_entry_by_self?src=web&uid=5bd2b8b25188252a784d19d7&device_id=1567748420039&token=eyJhY2Nlc3NfdG9rZW4iOiJTTHVPcVRGQ1BseWdTZHF4IiwicmVmcmVzaF90b2tlbiI6ImJHZkJDVDlWQkZiQUNMdTYiLCJ0b2tlbl90eXBlIjoibWFjIiwiZXhwaXJlX2luIjoyNTkyMDAwfQ%3D%3D&targetUid=5bd2b8b25188252a784d19d7&type=post&limit=20&order=createdAt'
数据保存在当前目录下,name 参数指定的子目录下,如: ./ken
2.1.3 爬取掘金小册销售数据
kcrawler juejin book
数据保存在当前目录下,格式如下:
juejin_books_20xx-xx-xx.xls
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kcrawler-0.0.18.tar.gz
(7.9 kB
view hashes)
Built Distribution
kcrawler-0.0.18-py3-none-any.whl
(12.1 kB
view hashes)
Close
Hashes for kcrawler-0.0.18-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 900d5fadb25950cc701b5807c63c2b5b8a91abda7e693726e44a29162c559348 |
|
MD5 | 3e11881a20152bf633f65424e3bb73fb |
|
BLAKE2b-256 | dcab209002fd165c2f9efe12ea4e0ee041e6fd29fb6a062f132066106e1743c9 |