A Spider FrameWork
Project description
openget
A Spider FrameWork.
Installation
You can install openget by simply doing:
pip install openget
Usage
Very Important Thing This line must be the first line in code
from openget.spiders import *
About Environment Variable
~/.openget/.env < $(pwd)/.env
docker build
cd docekr
bash build.sh
TODO
- ftp download
- auto add task
- statis crawl speed
- browser support: zhipin.com tmall.com
- sqlite.db rename
- use cmd to create spider template
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
openget-0.1.9.tar.gz
(63.2 kB
view hashes)
Built Distributions
openget-0.1.9-py3.11.egg
(225.5 kB
view hashes)
openget-0.1.9-py3-none-any.whl
(72.2 kB
view hashes)