Skip to main content

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Project description

Mush wikis scraper

Continous Integration Continous Delivery codecov PyPI version

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Usage

Install with python -m pip install --user mush-wikis-scraper

Then run python mush-wikis-scrap in your terminal. The package supports 3 formats: html, text and markdown with the --format option.

The result will be printed to the terminal. You can redirect it to a file with python mush-wikis-scrap > output.

Contributing

You need to have curl and uv installed on your system.

Then run the following command : curl -sSL https://raw.githubusercontent.com/cmnemoi/mush_wikis_scraper/main/clone-and-install | bash

Development

Run tests with make test.

License

The source code of this repository is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mush_wikis_scraper-1.0.1.tar.gz (14.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mush_wikis_scraper-1.0.1-py3-none-any.whl (11.4 kB view details)

Uploaded Python 3

File details

Details for the file mush_wikis_scraper-1.0.1.tar.gz.

File metadata

  • Download URL: mush_wikis_scraper-1.0.1.tar.gz
  • Upload date:
  • Size: 14.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.5.1

File hashes

Hashes for mush_wikis_scraper-1.0.1.tar.gz
Algorithm Hash digest
SHA256 f5961831865929a54059e5afc2e2cd3128bbe3e4ca98e9d199a642394c6efe7f
MD5 1ce6a13da4a9cda2dd348370838272f3
BLAKE2b-256 39003cb29af5a5ef8737316e8bd03fd462f5525b850cace4335a1d116ae9ab16

See more details on using hashes here.

File details

Details for the file mush_wikis_scraper-1.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for mush_wikis_scraper-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8a5d5723fec32186f99ac477e360f038f4318cb8883d9745240c2047f841b03a
MD5 109e0bcf635daf96b7c49ced2a7bcc99
BLAKE2b-256 20bfc6d555d6102187948ff232928f577f077a4ec9026beff0c21b03718af9b5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page