Skip to main content

much

A simple utility for crawling text from 2ch

Usage

The command pull requires two attributes - url of the web page to fetch and path to output file with json or txt extension depending on required output file format. For example:

python -m much pull https://2ch.hk/b/arch/2018-08-22/res/181770037.html assets/stories.txt

To fetch archived threads on 17th page:

python -m much fetch 17

To list top 10 fetched threads by size (cumulative number of characters in messages longer than 100 symbols):

python -m much top 10

To star a thread (copy it to folder assets/starred with a given name):

python -m much star 263473351 discussion

Installation

To install through pip:

pip install much

To install dependencies and create conda environment:

conda env create -f environment.yml

Metadata

Release files for much 0.0.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for much 0.0.7
File Size Uploaded Provenance Actions
much-0.0.7.tar.gz 10.3 kB Without provenance Details for much-0.0.7.tar.gz

Release files / much-0.0.7.tar.gz

Download URL much-0.0.7.tar.gz
Size 10.3 kB
Tags Source
SHA-256 checksum
How to use checksums
b20fce3387addb839dfe205dc4ee0f4aa2a76329304715adb81a07bb5b0694d1
BLAKE2b-256 checksum
How to use checksums
ecbe4d365446d8d1f0564e141fa9aa4b5f595450a15b3a8860ffd6fa7bcf82e0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.11.5

Security for much 0.0.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page