A Simple Web Crawling and Web Scraping framework
Project description
# Crwy
[![PyPI Version](https://img.shields.io/pypi/v/Crwy.svg)](https://pypi.python.org/pypi/Crwy) [![Build Status](https://travis-ci.org/wuyue92tree/crwy.svg?branch=1.0.8)](https://travis-ci.org/wuyue92tree/crwy)
# 简介
Crwy是一个轻量级的爬虫抓取框架,参考Scrapy框架结构开发而来。该框架提供了实用的爬虫模板,旨在帮助大家快速实现爬虫任务,高效开发。新增了gevent,使爬虫异步执行,速度更快。
# 运行环境
Python2.7
Works on Linux, Mac OSX
# 依赖包
beautifulsoup4>=4.5.1
requests==2.12.0
configparser>=3.5.0
SQLAlchemy>=1.0.14
pyssdb>=0.1.2
redis>=2.10.5
gevent>=1.2.1
# 安装
快速安装 ` pip install crwy `
or 前往下载: https://pypi.python.org/pypi/Crwy/1.0.8/
# 使用手册
在这里: http://wuyue92tree.antio.top/opensource/crwy.html
# 友情链接
# 更新日志
http://wuyue92tree.antio.top/opensource/crwy.html#更新日志
# TODO
兼容python3
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.