Skip to main content

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Project description

Mush wikis scraper

Continous Integration Continous Delivery codecov PyPI version

Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

Usage

Install with python -m pip install --user mush-wikis-scraper

Then run python mush-wikis-scrap in your terminal. The package supports 3 formats: html, text and markdown with the --format option.

The result will be printed to the terminal. You can redirect it to a file with python mush-wikis-scrap > output.

Contributing

You need to have curl and uv installed on your system.

Then run the following command : curl -sSL https://raw.githubusercontent.com/cmnemoi/mush_wikis_scraper/main/clone-and-install | bash

Development

Run tests with make test.

License

The source code of this repository is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mush_wikis_scraper-0.8.0.tar.gz (14.1 MB view details)

Uploaded Source

Built Distribution

mush_wikis_scraper-0.8.0-py3-none-any.whl (13.1 kB view details)

Uploaded Python 3

File details

Details for the file mush_wikis_scraper-0.8.0.tar.gz.

File metadata

File hashes

Hashes for mush_wikis_scraper-0.8.0.tar.gz
Algorithm Hash digest
SHA256 5cd7f0c4985824f23ddd32a730051adefc8ac8aadaf7239700f910eaeb250807
MD5 944adf4f9fa7f07da0660152363da46b
BLAKE2b-256 6fa7d1ae5ceb0dd58a0e3e701b150405b0002bb41ddd3d9f90509b4594030253

See more details on using hashes here.

File details

Details for the file mush_wikis_scraper-0.8.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mush_wikis_scraper-0.8.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7e35990b389c625910a964d1582606f3d26659d40dc6674a6eadc2315e9c7d8a
MD5 ad0ec632ee30bd59bdae33737c2cdd19
BLAKE2b-256 db6dc10f15c9106caaefaf82abfe268edb84e6c1673a2aeef14a77038d259a41

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page