Skip to main content

tool set for crawler project.

Project description

https://travis-ci.org/MacHu-GWU/crawlib-project.svg?branch=master https://codecov.io/gh/MacHu-GWU/crawlib-project/branch/master/graph/badge.svg https://img.shields.io/pypi/v/crawlib.svg https://img.shields.io/pypi/l/crawlib.svg https://img.shields.io/pypi/pyversions/crawlib.svg https://img.shields.io/badge/Star_Me_on_GitHub!--None.svg?style=social

Welcome to crawlib Documentation

crawlib is a crawler project building block to simplify:

  1. url encoding

  2. html parse

  3. error handling

  4. download html and file

Install

crawlib is released on PyPI, so all you need is:

$ pip install crawlib

To upgrade to latest version:

$ pip install --upgrade crawlib

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlib-0.0.11.tar.gz (323.0 kB view details)

Uploaded Source

Built Distribution

crawlib-0.0.11-py2-none-any.whl (367.2 kB view details)

Uploaded Python 2

File details

Details for the file crawlib-0.0.11.tar.gz.

File metadata

  • Download URL: crawlib-0.0.11.tar.gz
  • Upload date:
  • Size: 323.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for crawlib-0.0.11.tar.gz
Algorithm Hash digest
SHA256 a25c68f0091361d716c95308ed4c8b1e7d42895f94ea98f321e8119c49b1faa7
MD5 f21b1a36c9f0aca50a5449951a5a466b
BLAKE2b-256 3dceb253fd26aa46fbc1397bdc4797367d51455c5e1f9e5e95c86ae0b12a3166

See more details on using hashes here.

File details

Details for the file crawlib-0.0.11-py2-none-any.whl.

File metadata

File hashes

Hashes for crawlib-0.0.11-py2-none-any.whl
Algorithm Hash digest
SHA256 a886a71db99930564067c4bcd8080b33e1a7ac5e577a78833ba1d9f2a510de25
MD5 68a3854e9d56238465cf0ac7d2962619
BLAKE2b-256 2cc4f85b938109b2d639bc9e21c2fe231c05810b8dcc8f2b6e7d33cb59bf3d98

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page