Skip to main content

tool set for crawler project.

Project description

https://travis-ci.org/MacHu-GWU/crawlib-project.svg?branch=master https://codecov.io/gh/MacHu-GWU/crawlib-project/branch/master/graph/badge.svg https://img.shields.io/pypi/v/crawlib.svg https://img.shields.io/pypi/l/crawlib.svg https://img.shields.io/pypi/pyversions/crawlib.svg https://img.shields.io/badge/Star_Me_on_GitHub!--None.svg?style=social

Welcome to crawlib Documentation

crawlib is a crawler project building block to simplify:

  1. url encoding

  2. html parse

  3. error handling

  4. download html and file

Install

crawlib is released on PyPI, so all you need is:

$ pip install crawlib

To upgrade to latest version:

$ pip install --upgrade crawlib

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlib-0.0.8.tar.gz (321.1 kB view details)

Uploaded Source

Built Distribution

crawlib-0.0.8-py2-none-any.whl (363.1 kB view details)

Uploaded Python 2

File details

Details for the file crawlib-0.0.8.tar.gz.

File metadata

  • Download URL: crawlib-0.0.8.tar.gz
  • Upload date:
  • Size: 321.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for crawlib-0.0.8.tar.gz
Algorithm Hash digest
SHA256 ae1f335efaa30bfd813b54d0204d2cd6d76612e6e37f87c8771d6fd23d1561a1
MD5 c0c78bcea831063de072833f0eaf8d76
BLAKE2b-256 1c01ce78ad9376b6b0958188316b2b80d1683b145c6bace18ed833b5a4fd0080

See more details on using hashes here.

File details

Details for the file crawlib-0.0.8-py2-none-any.whl.

File metadata

File hashes

Hashes for crawlib-0.0.8-py2-none-any.whl
Algorithm Hash digest
SHA256 701bcfac448f44e2940b33829334a0a1e14a32dfcaba046d3bb1214101c33068
MD5 9282a5b1b28382b6f2fdc61779ebe9c9
BLAKE2b-256 1643ea5d77261c98f37894b405002c4946905e7b5bf44bc8a4adccd8527ee0d0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page