Manga Wordlist Extractor
This script allows you to automatically scan through manga and generate a csv with all contained words.
It is intended to be used with the community deck feature of Bunpro, hence the csv format. Once the csv import feature will be published, I will adjust the format of the csv. If any other outputs are desired, let me know!
Installation
You need to have python installed (ideally Python 3.12).
Using pip
Install the package using
pip install manga-wordlist-extractor
Using the source code directly
Download this repository (using the "code -> download zip" option above the files list at the top). Open a command prompt in the downloaded folder after extracting.
Run this to install all dependencies:
pip install -r requirements.txt
You can now run the tool from the src/main/main.py file.
Usage
manga-wordlist-extractor [-h] [--parent] folder
Replace folder with the path containing the manga files. Make sure to surround it with quotation marks if there are spaces in the path!
If you enter a parent folder containing multiple volumes, add "--parent" before the folder path.
This will generate a vocab.csv file containing all words.
Notices
If you run into errors, look into the mokuro repository linked at the bottom. There might be some issues with python version compatibility.
Also important: This script is not perfect. The text recognition can make mistakes and some of the extracted vocab can be wrong. If this proves to be a big issue I will look for a different method to parse vocabulary from the text.
TODO
- Live Output from Mokuro (it can take very long)
- Separate outputs for each volume
- Added translations through dictionary lookup?
Acknowledgements
This is hardly my work, I just stringed together some amazing libraries:
- mokuro, to extract lines of text from manga - https://github.com/kha-white/mokuro
- mecab-python3, to tokenize japanese text and extract the dictionary forms - https://github.com/SamuraiT/mecab-python3
- unidic_lite, for data necessary for mecab to work - https://github.com/polm/unidic-lite
1 maintainer
Metadata
1 maintainer
Release files for manga-wordlist-extractor 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| manga_wordlist_extractor-0.2.1.tar.gz | 16.9 kB | Without provenance | Details for manga_wordlist_extractor-0.2.1.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| manga_wordlist_extractor-0.2.1-py3-none-any.whl | Python 3 | none | any | Details for manga_wordlist_extractor-0.2.1-py3-none-any.whl |
Total release size: 35.2 kB
Release files / manga_wordlist_extractor-0.2.1.tar.gz
| Download URL | manga_wordlist_extractor-0.2.1.tar.gz |
|---|---|
| Size | 16.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
109f86c7faff469941e3b0eff0b99a83dc60e0681d6ad852739b62f5ec7c63eb
|
|
BLAKE2b-256 checksum How to use checksums |
5a9fb0320ef2b8d9dabd7ea2797f5ad92953199db0bcfa31504d5a1fd9dc6a25
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.12.7
|
Release files / manga_wordlist_extractor-0.2.1-py3-none-any.whl
| Download URL | manga_wordlist_extractor-0.2.1-py3-none-any.whl |
|---|---|
| Size | 18.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ae4fca0ea99626c25dacee51e09dc47c9b28f897c82873f834e8a19a4ee023a7
|
|
BLAKE2b-256 checksum How to use checksums |
e5c91edff9db78d24c8ac4ce2481c9e35cbdc5fe0aae62aabce02d886adbe19d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.12.7
|
Security for manga-wordlist-extractor 0.2.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
