Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/ and https://cmnemoi.github.io/archive_aide_aux_bolets/
Project description
Mush wikis scraper
Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/ and https://cmnemoi.github.io/archive_aide_aux_bolets/
Usage
Install with python -m pip install --user mush-wikis-scraper
Then run python mush-wikis-scrap
in your terminal. The package supports 3 formats: html
, text
and markdown
with the --format
option.
The result will be printed to the terminal. You can redirect it to a file with python mush-wikis-scrap > output
.
Contributing
You need to have curl
and uv
installed on your system.
Then run the following command : curl -sSL https://raw.githubusercontent.com/cmnemoi/mush_wikis_scraper/main/clone-and-install | bash
Development
Run tests with make test
.
License
The source code of this repository is licensed under the MIT License.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file mush_wikis_scraper-0.7.0.tar.gz
.
File metadata
- Download URL: mush_wikis_scraper-0.7.0.tar.gz
- Upload date:
- Size: 14.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.5.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 43722275ffe307a73fbd9e604f10bd60a36fe56a127b2abce8e7d16db82b240b |
|
MD5 | de2a57b1d403c9cb3e4b608e93d5fc24 |
|
BLAKE2b-256 | 084b7a5960133713cdef8e394cc3f70bdc1dee27857ad65d244b3ce2b09ac406 |
File details
Details for the file mush_wikis_scraper-0.7.0-py3-none-any.whl
.
File metadata
- Download URL: mush_wikis_scraper-0.7.0-py3-none-any.whl
- Upload date:
- Size: 12.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.5.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0b78e05aef7159ecc29ff41f3dabd843dfe7b3ae57939fc205588d87d1fd531c |
|
MD5 | 93959551f19b6bb7aa74cbd5f776334e |
|
BLAKE2b-256 | 33029ec190ebaa917487b3e741a28b26753535c7e5d0d486a0231a66ffb4a533 |