Skip to main content

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Project description

Mush wikis scraper

Continous Integration Continous Delivery codecov PyPI version

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Usage

Install with python -m pip install --user mush-wikis-scraper

Then run python mush-wikis-scrap in your terminal. The package supports 3 formats: html, text and markdown with the --format option.

The result will be printed to the terminal. You can redirect it to a file with python mush-wikis-scrap > output.

Contributing

You need to have curl and uv installed on your system.

Then run the following command : curl -sSL https://raw.githubusercontent.com/cmnemoi/mush_wikis_scraper/main/clone-and-install | bash

Development

Run tests with make test.

License

The source code of this repository is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mush_wikis_scraper-0.9.0.tar.gz (14.1 MB view details)

Uploaded Source

Built Distribution

mush_wikis_scraper-0.9.0-py3-none-any.whl (13.6 kB view details)

Uploaded Python 3

File details

Details for the file mush_wikis_scraper-0.9.0.tar.gz.

File metadata

File hashes

Hashes for mush_wikis_scraper-0.9.0.tar.gz
Algorithm Hash digest
SHA256 25e36220f28988898b3ce33277cf9eb7185138874a1389de47b3842a78006206
MD5 f7c0c3fbf05debde3c25ada0492a6e19
BLAKE2b-256 226583423c695668672acfcb70eb32511d5f7bb526fb69fd84cba4430a079c91

See more details on using hashes here.

File details

Details for the file mush_wikis_scraper-0.9.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mush_wikis_scraper-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 71d6c7f3c7bb2fcf61cafb13f0bc1bfb2c88ae52a1dc49cd0ba05ca2c347bdb9
MD5 47e7e11bbdc9d30cf0dd5b5c95ea8df8
BLAKE2b-256 6b8ec369ac27c255e2417a8ab6c09618053e30c8c3d77352b2652c656f5b4602

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page