Scraper for http://mushpedia.com/ and http://twin.tithom.fr/mush/
Project description
Mush wikis scraper
Scraper for http://mushpedia.com/ and http://twin.tithom.fr/mush/
Usage
Install with python -m pip install --user mush-wikis-scraper
Then run python mush-wikis-scrap in your terminal. The package supports 3 formats: html, text and markdown with the --format option.
The result will be printed to the terminal. You can redirect it to a file with python mush-wikis-scrap > output.
Contributing
You need to have curl and uv installed on your system.
Then run the following command : curl -sSL https://raw.githubusercontent.com/cmnemoi/mushpedia_scraper/main/clone-and-install | bash
Development
Run tests with make test.
License
The source code of this repository is licensed under the MIT License.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file mush_wikis_scraper-0.5.0.tar.gz.
File metadata
- Download URL: mush_wikis_scraper-0.5.0.tar.gz
- Upload date:
- Size: 14.0 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.5.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f3c0796c50966e57b4da8dba7a6841c480ceff4aec585faf4593e221eda30442 |
|
| MD5 | 942add2c387892a4f5505c86bfcd3152 |
|
| BLAKE2b-256 | 2f9d80d34f989a1ebf182e085e0a77162104b0ddeec7932b5fdb880eaadc692a |
File details
Details for the file mush_wikis_scraper-0.5.0-py3-none-any.whl.
File metadata
- Download URL: mush_wikis_scraper-0.5.0-py3-none-any.whl
- Upload date:
- Size: 11.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.5.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 88526cb2bf754780417a44cbc1d312a587eadaf701f8d3ae9f6a75dfc95fb83a |
|
| MD5 | 4354763cc0e57788432862ed5d126b4f |
|
| BLAKE2b-256 | 5db019f3ad7cd5bb71c223d81836063eeed2273f7e32fcbb41c3a5c5cbf2a046 |
