much
A simple utility for crawling text from 2ch
Usage
The command pull requires two attributes - url of the web page to fetch and path to output file with json or txt extension depending on required output file format. For example:
python -m much pull https://2ch.hk/b/arch/2018-08-22/res/181770037.html assets/stories.txt
To fetch archived threads on 17th page:
python -m much fetch 17
To list top 10 fetched threads by size (cumulative number of characters in messages longer than 100 symbols):
python -m much top 10
To star a thread (copy it to folder assets/starred with a given name):
python -m much star 263473351 discussion
Installation
To install through pip:
pip install much
To install dependencies and create conda environment:
conda env create -f environment.yml
Metadata
Release files for much 0.0.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| much-0.0.7.tar.gz | 10.3 kB | Without provenance | Details for much-0.0.7.tar.gz |
Release files / much-0.0.7.tar.gz
| Download URL | much-0.0.7.tar.gz |
|---|---|
| Size | 10.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b20fce3387addb839dfe205dc4ee0f4aa2a76329304715adb81a07bb5b0694d1
|
|
BLAKE2b-256 checksum How to use checksums |
ecbe4d365446d8d1f0564e141fa9aa4b5f595450a15b3a8860ffd6fa7bcf82e0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
Security for much 0.0.7
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.