crawlib

tool set for crawler project.

These details have not been verified by PyPI

Project links

Development Status
- 4 - Beta
Intended Audience
- Developers
License
- OSI Approved :: MIT License
Natural Language
- English
Operating System
Programming Language

Project description

https://travis-ci.org/MacHu-GWU/crawlib-project.svg?branch=master

https://codecov.io/gh/MacHu-GWU/crawlib-project/branch/master/graph/badge.svg

https://img.shields.io/pypi/v/crawlib.svg

https://img.shields.io/pypi/l/crawlib.svg

https://img.shields.io/pypi/pyversions/crawlib.svg

https://img.shields.io/badge/Star_Me_on_GitHub!--None.svg?style=social

Welcome to crawlib Documentation

Crawl library provides crawler project building block to simplify:

url encoding.
html parse.
error handling.
download html and file.
request cache.

Quick Links

Install

crawlib is released on PyPI, so all you need is:

$ pip install crawlib

To upgrade to latest version:

$ pip install --upgrade crawlib

Project details

These details have not been verified by PyPI

Project links

Development Status
- 4 - Beta
Intended Audience
- Developers
License
- OSI Approved :: MIT License
Natural Language
- English
Operating System
Programming Language

Release history Release notifications | RSS feed

0.1.1

Dec 31, 2019

0.1.0

Dec 27, 2019

0.0.27

Dec 30, 2018

0.0.26

Sep 9, 2018

0.0.25

Sep 6, 2018

0.0.24

Sep 5, 2018

0.0.23

Aug 22, 2018

0.0.22

Aug 19, 2018

0.0.21

Aug 18, 2018

0.0.20

Aug 15, 2018

0.0.19

Aug 15, 2018

0.0.18

Aug 14, 2018

0.0.17

Aug 12, 2018

0.0.16

Mar 22, 2018

0.0.15

Jan 22, 2018

0.0.14

Nov 24, 2017

This version

0.0.13

Nov 20, 2017

0.0.12

Nov 19, 2017

0.0.11

Nov 19, 2017

0.0.10

Nov 8, 2017

0.0.9

Nov 8, 2017

0.0.8

Oct 30, 2017

0.0.7

Oct 2, 2017

0.0.6

Apr 6, 2017

0.0.5

Feb 7, 2017

0.0.4

Feb 6, 2017

0.0.3

Feb 2, 2017

0.0.2

Sep 14, 2016

0.0.1

Aug 29, 2016

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlib-0.0.13.tar.gz (21.5 kB view details)

Uploaded Nov 20, 2017 Source

Built Distribution

crawlib-0.0.13-py2-none-any.whl (33.9 kB view details)

Uploaded Nov 20, 2017 Python 2

File details

Details for the file crawlib-0.0.13.tar.gz.

File metadata

Download URL: crawlib-0.0.13.tar.gz
Upload date: Nov 20, 2017
Size: 21.5 kB
Tags: Source
Uploaded using Trusted Publishing? No

File hashes

Hashes for crawlib-0.0.13.tar.gz
Algorithm	Hash digest
SHA256	`d995b368968d576e442393e1f0552288e0809b3f4335d44363f1ab7e89efe3e1`
MD5	`68eb149f80ebcda02ec84d707c8ffcd9`
BLAKE2b-256	`928968d113ce92b128fc4dcc4ee3ccb030e17f70a86fe192fb67636e9dacb387`

See more details on using hashes here.

File details

Details for the file crawlib-0.0.13-py2-none-any.whl.

File metadata

Download URL: crawlib-0.0.13-py2-none-any.whl
Upload date: Nov 20, 2017
Size: 33.9 kB
Tags: Python 2
Uploaded using Trusted Publishing? No

File hashes

Hashes for crawlib-0.0.13-py2-none-any.whl
Algorithm	Hash digest
SHA256	`064dd26161e326d6a15586ed50fd78898ec0b58518c6d792266ec29dcf6420a8`
MD5	`657644dcf338625345c0b940c1b8f20f`
BLAKE2b-256	`1de949d096accf11ab44ae8eaeee0c56a19ed7662c08cdc9cabff3600bde68e7`