Use c ++ multi-threaded http request library
Project description
fast_requests
介绍
这可能是最快的http请求库,暂支持get方法
要求
windows平台和python3.7.2
使用
下载fast_requetst_cpp.pyd
、fast_requests.py
、libcurl.dll
、zlibd1.dll
四个文件,在项目中导入fast_requests.py
api
#timeOut 单位为毫秒
get(urls, headers={}, nThread=5, isDebug=False, timeOut=3000, verifySsl=True)
sessionGet(urls, headers={}, nThread=5, isDebug=False, timeOut=3000, verifySsl=True)
#sessionGet和get的区别:sessionGet为每个线程持有一个session对象相当于requests的session,建议使用sessionGet速度更快
urls 请求的网址列表
headers 请求头
nThread 线程数(看自己设备配置,一般设20就差不多了)
isDebug 开启后会打印每个线程每个请求信息
timeOut 超时
verifySsl ssl验证
返回 Response 对象列表
Response 对象
Response.text 正文text文本
Response.status_code 状态码
Response.header
Response.content() 二进制数据
Response.Url url
Response.elapsed
Response.cookies
Response.error 暂且用不了
示例代码:
import fast_requests
urls = []
headers = {
"User-Agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.163 Safari/537.36"
}
for i in range(1, 200):
urls.append("https://baidu.com")
for i in fast_requests.get(urls, headers, 20):
print(i.text)
for i in fast_requests.sessionGet(urls, headers, 20):
print(i.text)
原理
c++ : cpr
python : pybind11
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
requests-cpp-0.1.0.tar.gz
(361.0 kB
view details)
Built Distribution
requests_cpp-0.1.0-py3-none-any.whl
(360.0 kB
view details)
File details
Details for the file requests-cpp-0.1.0.tar.gz
.
File metadata
- Download URL: requests-cpp-0.1.0.tar.gz
- Upload date:
- Size: 361.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 |
c03a190e5aad83e7ad412c45468a4e4ede6bcc29b1bd6b0bcad7a55853172ef9
|
|
MD5 |
9adbfd7515571b6c134cdb8fd6deaccd
|
|
BLAKE2b-256 |
a937d90f5ec540e15f4dbcbd897e23c517ed480e163052dcdc49463d36cde513
|
File details
Details for the file requests_cpp-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: requests_cpp-0.1.0-py3-none-any.whl
- Upload date:
- Size: 360.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 |
4ff9fb691863f78cf7209daec057502f601be21d1fad0f57684bf0b4c89e60b5
|
|
MD5 |
19280b0c91b19c9e0a89e8d48fba7f1f
|
|
BLAKE2b-256 |
82932720cb991207e99cc4f1952003d934218b703ecdf578fd0915ad8b9ea912
|