A web crawler for QTE parts data
Project description
Install
pip install -r requirements.txt
Usage
Open a Debug Browser:
python main.py --task browser
Run Preparation Task:
python main.py --task prepare --year 2025
Run Detail Task:
python main.py --task detail --count 3
Package
python3.11 -m build
twine upload dist/*
# MacOS
/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome \ --remote-debugging-port=9222 --user-data-dir=/tmp/chrome-debug
# Windows
"C:\Program Files\Google\Chrome\Application\chrome.exe" --remote-debugging-port=9222 --user-data-dir="C:\tmp\chrome-debug"
地址栏输入 showmetheparts.com, 然后人工完成验证码
安装 qte-parts-crawler-cli
pip install qte-parts-crawler==0.1.2
qte-parts-crawler-cli
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
qte_parts_crawler-0.1.3.tar.gz
(11.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file qte_parts_crawler-0.1.3.tar.gz.
File metadata
- Download URL: qte_parts_crawler-0.1.3.tar.gz
- Upload date:
- Size: 11.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3316d23e69711c3e0eea9d9ef43c4182ee2b8cfd9ffc032c4c3957b06e747b5d
|
|
| MD5 |
747facb35012a44f59d3f3b6981f9695
|
|
| BLAKE2b-256 |
d84a946f0cb0a0d289175c36e7153bd10ea49449d947e1c67af028ede585e9cb
|
File details
Details for the file qte_parts_crawler-0.1.3-py3-none-any.whl.
File metadata
- Download URL: qte_parts_crawler-0.1.3-py3-none-any.whl
- Upload date:
- Size: 12.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
088a30f788e4c02e683225f58fd9c2b047058ebf47875ef18a7089925abc7a96
|
|
| MD5 |
7e4f919009494b4ea2ad4c653c3447d4
|
|
| BLAKE2b-256 |
44faddf744991a77f847ba4ac20effdc1747cd695c122868203b6162d8e25df8
|
