Skip to main content

tool set for crawler project.

Project description

https://travis-ci.org/MacHu-GWU/crawlib-project.svg?branch=master https://codecov.io/gh/MacHu-GWU/crawlib-project/branch/master/graph/badge.svg https://img.shields.io/pypi/v/crawlib.svg https://img.shields.io/pypi/l/crawlib.svg https://img.shields.io/pypi/pyversions/crawlib.svg https://img.shields.io/badge/Star_Me_on_GitHub!--None.svg?style=social

Welcome to crawlib Documentation

crawlib is a crawler project building block to simplify:

  1. url encoding

  2. html parse

  3. error handling

  4. download html and file

Install

crawlib is released on PyPI, so all you need is:

$ pip install crawlib

To upgrade to latest version:

$ pip install --upgrade crawlib

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlib-0.0.7.tar.gz (318.9 kB view details)

Uploaded Source

Built Distribution

crawlib-0.0.7-py2-none-any.whl (361.1 kB view details)

Uploaded Python 2

File details

Details for the file crawlib-0.0.7.tar.gz.

File metadata

  • Download URL: crawlib-0.0.7.tar.gz
  • Upload date:
  • Size: 318.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for crawlib-0.0.7.tar.gz
Algorithm Hash digest
SHA256 32d2398d4b06ba59c2020781b207ebfd2407c5dfb95190ebb996d770bd5e4cf0
MD5 41fd2c64a5788474b4701af3218115b2
BLAKE2b-256 b3138c441f9aa5885aef6c94da5a345a5130c7e7f19f6dc354bbb758aa7d9586

See more details on using hashes here.

File details

Details for the file crawlib-0.0.7-py2-none-any.whl.

File metadata

File hashes

Hashes for crawlib-0.0.7-py2-none-any.whl
Algorithm Hash digest
SHA256 70cbb70c7400ba684fd3c7e4450169b6288147dfec28309715c3a942468f468c
MD5 6a06887667c8c2498c08e05637f21c84
BLAKE2b-256 f3088706b114de9d250b7d3c45aa8d8adbc113418701d5db177b9d458c473aa6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page