A simple utility for crawling text from 2ch
Project description
much
A simple utility for crawling text from 2ch
Usage
The command pull
requires two attributes - url of the web page to fetch and path to output file with json
or txt
extension depending on required output file format. For example:
python -m much pull https://2ch.hk/b/arch/2018-08-22/res/181770037.html assets/stories.txt
Installation
To install through pip:
pip install much
To install dependencies and create conda environment:
conda env create -f environment.yml
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
much-0.0.2.tar.gz
(7.8 kB
view details)
File details
Details for the file much-0.0.2.tar.gz
.
File metadata
- Download URL: much-0.0.2.tar.gz
- Upload date:
- Size: 7.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.9.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2cf8e7d5a2feead08ea85712ee7977801719f89b6091dfa9444f18d849385dcc |
|
MD5 | 293f26e7ee665ebb3f9cbd5e9efd29e2 |
|
BLAKE2b-256 | 118baa170061dd1445c9fcaeb540074356f7bc8c59f508e809a2c635fd8724a5 |