[NSFW] Useful tools for crawling study resources.
Project description
Jvav
Useful tools for crawling study resources. Supports Python library operations and command-line usage, with additional proxy options and cache support.
INSTALL
# python >= 3.9
pip install jvav -U
LIB
- DmmUtil
- JavDbUtil
- JavLibUtil
- JavBusUtil
- AvgleUtil
- MagnetUtil
- SukebeiUtil
- WikiUtil
- TransUtil
- RankUtil
# A sample for DmmUtil
import jvav
util = jvav.DmmUtil()
util.get_nice_avs_by_star_name('小倉由菜')
util.get_score_by_id('cawd-441')
util.get_all_top_stars()
CMD
usage: cmd.py [-h] [-v] [-av1 AV1] [-av2 AV2] [-av3 AV3] [-auth AUTH] [-nc] [-uc] [-sr SR] [-srn SRN] [-tg TG] [-pv1 PV1] [-pv2 PV2] [-rk1] [-rk2] [-p PROXY]
options:
-h, --help show this help message and exit
-v, --version Check version
-av1 AV1 Followed by a code, search this code on JavBus
-av2 AV2 Followed by a code, search this code on Sukebei
-av3 AV3 Followed by a code, search this code on JavDb
-auth AUTH Followed by a authentication code for JavBus, use it if you failed to search from Javbus, get the code from cookie key: bus_auth
-nc Filter out high-definition subtitles magnet links
-uc Filter out uncoded magnet links
-sr SR Followed by an actress name, get a list of high-rated codes based on the actress name
-srn SRN Followed by an actress name, get a list of the most recent codes based on the actress name
-tg TG Followed by a keyword, search for codes based on the keyword
-pv1 PV1 Followed by a code, get the corresponding preview video of the code on DMM
-pv2 PV2 Follow a code, get the corresponding preview video of the code on Avgle
-rk1 Get the top 25 ranking of DMM actresses
-rk2 Get the top 25 ranking of AVs
-p PROXY, --proxy PROXY
Followed by a proxy server address (by default reads the value of the environment variable http_proxy)
DEV
I use python-3.9.13 for development, please use python <= 3.9.
And it is recommended to use python virtual environment to avoid some unnecessary problems.
Here is my developing steps:
git clone https://github.com/akynazh/jvav.git
cd jvav
~/.pyenv/versions/3.9.13/bin/python -m venv .venv
source ./.venv/bin/activate
pip3 install -r requirements.txt
And then you can enjoy coding! Remember to write or run test cases in tests/test.py.
Please make sure the test is okay before submitting your code~
TODO
The following are some functions to be implemented, and I look forward to your contribution~
- support db.msin.jp
- support RankUtil in CMD (Thanks: @akynazh)
- cache the successful query results locally (Thanks: @akynazh)
- support javdb.com (Thanks: @Steven-Fake)
- support JavDbUtil in cmd (Thanks: @akynazh)
Thanks
Thanks to JetBrains for their support to this project!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file jvav-3.0.0.tar.gz.
File metadata
- Download URL: jvav-3.0.0.tar.gz
- Upload date:
- Size: 33.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0b58f1ac79f7e29f65c7bf2c3e2b7e8203643cec67b82c73f455a55cc4ae07c7
|
|
| MD5 |
8bddaedb1e03f90c1b9d1c7b8bd82992
|
|
| BLAKE2b-256 |
36373bc8eb26c23a28d4e142c7c24bfd6528686fed730fd69d16df0d4798b3f8
|
File details
Details for the file jvav-3.0.0-py3-none-any.whl.
File metadata
- Download URL: jvav-3.0.0-py3-none-any.whl
- Upload date:
- Size: 31.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f4a5d3629f67433fa0354ea30137a89a76b1035a4a1ac87589a5e02a8da0ae01
|
|
| MD5 |
2557f7f5af4586407726d8faaee85f8d
|
|
| BLAKE2b-256 |
0eb504899862cc18a66a7936c8472ea84db2232e6c0fdd8ee6b2d3f8f944721c
|