Skip to main content

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Project description

Mush wikis scraper

Continous Integration Continous Delivery codecov PyPI version

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Usage

Install with python -m pip install --user mush-wikis-scraper

Then run python mush-wikis-scrap in your terminal. The package supports 3 formats: html, text and markdown with the --format option.

The result will be printed to the terminal. You can redirect it to a file with python mush-wikis-scrap > output.

Contributing

You need to have curl and uv installed on your system.

Then run the following command : curl -sSL https://raw.githubusercontent.com/cmnemoi/mush_wikis_scraper/main/clone-and-install | bash

Development

Run tests with make test.

License

The source code of this repository is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mush_wikis_scraper-1.0.0.tar.gz (14.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mush_wikis_scraper-1.0.0-py3-none-any.whl (11.4 kB view details)

Uploaded Python 3

File details

Details for the file mush_wikis_scraper-1.0.0.tar.gz.

File metadata

  • Download URL: mush_wikis_scraper-1.0.0.tar.gz
  • Upload date:
  • Size: 14.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.5.1

File hashes

Hashes for mush_wikis_scraper-1.0.0.tar.gz
Algorithm Hash digest
SHA256 77d271a9f702e4ae43da85217508e56573a7f9788714860305aea3154f61d11a
MD5 beb97fa260f4a72d618e7efe33b324bd
BLAKE2b-256 729476cb64e0df59765b3bb18c64f05db7604c87a90b9d35d31ce61308ce28c1

See more details on using hashes here.

File details

Details for the file mush_wikis_scraper-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mush_wikis_scraper-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2cfe3995c28d4f8834dc4e04816f14775674257342d7675a79529925b70d50fe
MD5 4f30fd5fa1e9d133c81eb97203fa775b
BLAKE2b-256 53c78d6f0ab2cc6d7c2cee43f79353bb6699fa4c15a0502e411a59a9f66bff75

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page