retail-bot-research
Project description
轻松跳过烦人的人机,实现高效采集数据
使用流程
- 安装模块
pip install walmartBot
- 导入模块
from walmartBot import WalMart
WalMart = WalMart()
res = WalMart.request('https://www.walmart.com/ip/Skytech-Archangel-Gaming-PC-Desktop-AMD-Ryzen-7-7700-NVIDIA-GeForce-RTX-5060-1TB-Gen4-NVMe-SSD-32GB-DDR5-RAM-Windows-11/17438712331?athAsset=eyJhdGhjcGlkIjoiMTc0Mzg3MTIzMzEiLCJhdGhzdGlkIjoiQ1MwMjAiLCJhdGhhbmNpZCI6Ikl0ZW1DYXJvdXNlbCIsImF0aHJrIjowLjB9&athena=true')
print(res.text)
- 代理配置与查看
WalMart = WalMart()
# 设置代理
WalMart.set_proxy('socks5h://127.0.0.1:7898/')
WalMart.set_proxy("socks5h://username:password@ip:port/")
# 禁用代理
WalMart.disable_proxy()
# 查看代理字符串
print(WalMart.current_proxy())
# 查看request使用的代理
print(WalMart.get_requests_proxy())
注意!!!
该风控可能由两种情况引起,一个是header检测,另一个是tls检测。 目前已解决header检测风控,测试后发现可以正常获取数据,如果多线程获取数据任然平凡出现风控,请联系我,我将添加tls指纹功能
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
walmartbot-0.0.2.tar.gz
(11.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file walmartbot-0.0.2.tar.gz.
File metadata
- Download URL: walmartbot-0.0.2.tar.gz
- Upload date:
- Size: 11.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
55eafc74724ab904b9a870beef5639e8f2b3700d9d93c47375a9bd606ac3d68c
|
|
| MD5 |
5f80c99f35b7644274bf85c660d2daee
|
|
| BLAKE2b-256 |
ee66ac168f33d890cfe9c4e84e9bc07079446a2b1fdb2c1c2e33208c6b8efe54
|
File details
Details for the file walmartbot-0.0.2-py3-none-any.whl.
File metadata
- Download URL: walmartbot-0.0.2-py3-none-any.whl
- Upload date:
- Size: 5.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8a46fad00682700ed6fb308e4279970208558829a0952ba81f46521047d2ade9
|
|
| MD5 |
e89db5b939f090521149cc7c4698f56d
|
|
| BLAKE2b-256 |
538824e80efc2323c4262c89b017e99702ac4759906f24f86f37f54ae4d8b428
|