A Library to Convert Curl to Python Requests File
Project description
KKBA
Intruoduction
A low-code tool that generates python crawler code based on curl or url
Requirement
Python >= 3.6
Install
pip install kkba
Usage
Copy the curl command or url from the browser, without pasting, execute the command directly: kkba [options]
kkba [options]
# After the command execution, the crawler directory will be generated in the current directory (including the crawler articles and readme files).
Example
# 1. Copy curl or url
# 2. Excute commands
kkba -F
# use proxy,support 蜻蜓、快代理、阿布云, For detailed usage, you can view the source code
from kkba.proxy import Proxy
p = Proxy(crawlerType='requests', proxyType='xxx', username='xxx', password='xxx')
proxies = p.get_proxy()
Help Document
kkba -h
爬虫生成器
usage: kkba [options]
optional arguments:
-F, 推荐: 将粘贴板curl或者url,生成feapder异步爬虫代码,相当于scrapy的用法
-s 将粘贴板curl或者url,生成scrapy单文件项目
-f, 将粘贴板curl或者url,生成feapder同步爬虫代码,相当于requests的用法
-r, 将粘贴板curl或者url,生成requests爬虫代码
-h, --help 帮助文档
-v, --version 查看版本
Genrates feapder spider code
# install fepader
pip install feapder
# generates feapder spiders code
kkba -F
Generates scrapy single file code
# install scrapy
pip install scrapy
# generates scrapy single spiders code
kkba -F
Thanks
curl2pyreqs 令狐 向娜
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kkba-0.8.16.tar.gz
(15.8 kB
view hashes)
Built Distribution
kkba-0.8.16-py3-none-any.whl
(17.6 kB
view hashes)