Crwy

A Simple Web Crawling and Web Scraping framework

Project description

简介

Crwy是一个轻量级的爬虫抓取框架，参考Scrapy框架结构开发而来。该框架提供了实用的爬虫模板，旨在帮助大家快速实现爬虫任务，高效开发。并为scrapy使用者提供通用轮子^.。新增了gevent，使爬虫异步执行，速度更快。

运行环境

Python3
Works on Linux, Mac OSX

安装

快速安装

pip install crwy

or 前往下载: https://pypi.python.org/pypi/Crwy/

TODO

完善scrapy_plugs
完善selenium_api
兼容python3

Project details

Release history Release notifications | RSS feed

This version

1.7.1

Jan 25, 2021

1.7.0

Oct 27, 2020

1.6.0

Feb 4, 2020

1.5.7

Nov 9, 2020

1.5.6

Dec 11, 2019

1.5.5

Jul 25, 2019

1.5.4

Apr 4, 2019

1.5.3

Mar 26, 2019

1.5.2

Mar 25, 2019

1.5.1

Feb 18, 2019

1.5.0

Jan 11, 2019

1.4.0

Jan 6, 2019

1.3.2

Dec 24, 2018

1.3.1

Dec 18, 2018

1.3.0

Dec 6, 2018

1.2.0

Nov 8, 2018

1.1.4

Oct 24, 2018

1.1.3

Oct 19, 2018

1.1.2

Sep 20, 2018

1.1.1

Aug 26, 2018

1.1.0

Aug 24, 2018

1.0.9

Jul 1, 2018

1.0.8

May 10, 2018

1.0.7

Nov 14, 2017

1.0.6

Sep 22, 2017

1.0.5

Jun 13, 2017

1.0.3

Apr 4, 2017

1.0.2

Jan 9, 2017

1.0.1

Aug 24, 2016

1.0.0

Aug 18, 2016

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Crwy-1.7.1.tar.gz (27.5 kB view details)

Uploaded Jan 25, 2021 Source

Built Distribution

Crwy-1.7.1-py3.6.egg (99.4 kB view details)

Uploaded Jan 25, 2021 Source

File details

Details for the file Crwy-1.7.1.tar.gz.

File metadata

Download URL: Crwy-1.7.1.tar.gz
Upload date: Jan 25, 2021
Size: 27.5 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/52.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.6.7

File hashes

Hashes for Crwy-1.7.1.tar.gz
Algorithm	Hash digest
SHA256	`c3af86fd3d84592f99f3c6c89b4e29af2d656dc0f238b75be2d1d6149f47924f`
MD5	`a41b48a3e63c59d2bb7559bcb13faf55`
BLAKE2b-256	`ac5266cd57e721b892eafd195c734214a861e67534a0a137c30bc1cf926b26af`

See more details on using hashes here.

File details

Details for the file Crwy-1.7.1-py3.6.egg.

File metadata

Download URL: Crwy-1.7.1-py3.6.egg
Upload date: Jan 25, 2021
Size: 99.4 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/52.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.6.7

File hashes

Hashes for Crwy-1.7.1-py3.6.egg
Algorithm	Hash digest
SHA256	`31c330bd19c86864f9dbc57d4c2059a64034e9e5ece6b4dfb8d075c3a40aa6fd`
MD5	`f1ef8b605cb29c80d1f383cc8232122c`
BLAKE2b-256	`075d3488b33aac8b5379e3ca197b5c899a2d804eaadbebe02deb0fd09f5b657b`