nspider

A light multi-process web resources crawling framework

Project description

Overview

NSpider (NymphSpider) is a light multi-process web crawling and web scraping framework, used to crawl websites and extract resource files from their pages. It can be used for resources downloading and data collection.

Check the NSpider homepage at https://github.com/Nymphxyz/nspider for more information,

Requirements

Python 3.6+
Works on Linux(not sure), Windows, macOS(not sure)

Install

The quick way:

pip install nspider

Documentation

Check details at https://github.com/Nymphxyz/nspider

Project details

Release history Release notifications | RSS feed

This version

0.2.0

Feb 28, 2021

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nspider-0.2.0.tar.gz (17.5 kB view details)

Uploaded Feb 28, 2021 Source

Built Distribution

nspider-0.2.0-py3-none-any.whl (30.9 kB view details)

Uploaded Feb 28, 2021 Python 3

File details

Details for the file nspider-0.2.0.tar.gz.

File metadata

Download URL: nspider-0.2.0.tar.gz
Upload date: Feb 28, 2021
Size: 17.5 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.58.0 CPython/3.7.8

File hashes

Hashes for nspider-0.2.0.tar.gz
Algorithm	Hash digest
SHA256	`864d452036c973197d24a74ae0152654d8adef8a5e29c1c95c9955e66d60c7a6`
MD5	`5af6a782bdcb4d509f6ad00af346ba8b`
BLAKE2b-256	`ca52c30a31d8501c9edfa6ff75904980823d2a830a1dface3a71c568c29e1120`

See more details on using hashes here.

File details

Details for the file nspider-0.2.0-py3-none-any.whl.

File metadata

Download URL: nspider-0.2.0-py3-none-any.whl
Upload date: Feb 28, 2021
Size: 30.9 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.58.0 CPython/3.7.8

File hashes

Hashes for nspider-0.2.0-py3-none-any.whl
Algorithm	Hash digest
SHA256	`f61caa796fa88e9fbaed32ef1007c75a61cd3a7e58e46a222b8ae4f0f7a4480a`
MD5	`0175244690e540a0e03ddeab590e3b26`
BLAKE2b-256	`a6d26d140e7912fe5544300628984c1606e08ab4a8be4c91ec5f7e18c0c55fd3`