Crwy
简介
Crwy是一个轻量级的爬虫抓取框架,参考Scrapy框架结构开发而来。该框架提供了实用的爬虫模板,旨在帮助大家快速实现爬虫任务,高效开发。并为scrapy使用者提供通用轮子.。新增了gevent,使爬虫异步执行,速度更快。
运行环境
Python3
Works on Linux, Mac OSX
安装
快速安装
pip install crwy
or 前往下载: https://pypi.python.org/pypi/Crwy/
TODO
完善scrapy_plugs
完善selenium_api
兼容python3
Metadata
Release files for Crwy 1.7.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| Crwy-1.7.1.tar.gz | 27.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| Crwy-1.7.1-py3.6.egg | Legacy Egg format | - | - | Details |
Total release size: 126.8 kB
Release files / Crwy-1.7.1.tar.gz
| Download URL | Crwy-1.7.1.tar.gz |
|---|---|
| Size | 27.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c3af86fd3d84592f99f3c6c89b4e29af2d656dc0f238b75be2d1d6149f47924f
|
|
BLAKE2b-256 checksum How to use checksums |
ac5266cd57e721b892eafd195c734214a861e67534a0a137c30bc1cf926b26af
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/52.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.6.7
|
Release files / Crwy-1.7.1-py3.6.egg
| Download URL | Crwy-1.7.1-py3.6.egg |
|---|---|
| Size | 99.4 kB |
| Tags | Egg |
|
SHA-256 checksum How to use checksums |
31c330bd19c86864f9dbc57d4c2059a64034e9e5ece6b4dfb8d075c3a40aa6fd
|
|
BLAKE2b-256 checksum How to use checksums |
075d3488b33aac8b5379e3ca197b5c899a2d804eaadbebe02deb0fd09f5b657b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/52.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.6.7
|