Skip to main content

[NSFW] Useful tools for crawling study resources.

Project description

Jvav

Useful tools for crawling study resources. Supports Python library operations and command-line usage, with additional proxy options and cache support.

INSTALL

# python >= 3.9
pip install jvav -U

LIB

  • DmmUtil
  • JavDbUtil
  • JavLibUtil
  • JavBusUtil
  • AvgleUtil
  • MagnetUtil
  • SukebeiUtil
  • WikiUtil
  • TransUtil
  • RankUtil
# A sample for DmmUtil
import jvav

util = jvav.DmmUtil()
util.get_nice_avs_by_star_name('小倉由菜')
util.get_score_by_id('cawd-441')
util.get_all_top_stars()

CMD

usage: cmd.py [-h] [-v] [-av1 AV1] [-av2 AV2] [-av3 AV3] [-auth AUTH] [-nc] [-uc] [-sr SR] [-srn SRN] [-tg TG] [-pv1 PV1] [-pv2 PV2] [-rk1] [-rk2] [-p PROXY]

options:
  -h, --help            show this help message and exit
  -v, --version         Check version
  -av1 AV1              Followed by a code, search this code on JavBus
  -av2 AV2              Followed by a code, search this code on Sukebei
  -av3 AV3              Followed by a code, search this code on JavDb
  -auth AUTH            Followed by a authentication code for JavBus, use it if you failed to search from Javbus, get the code from cookie key: bus_auth
  -nc                   Filter out high-definition subtitles magnet links
  -uc                   Filter out uncoded magnet links
  -sr SR                Followed by an actress name, get a list of high-rated codes based on the actress name
  -srn SRN              Followed by an actress name, get a list of the most recent codes based on the actress name
  -tg TG                Followed by a keyword, search for codes based on the keyword
  -pv1 PV1              Followed by a code, get the corresponding preview video of the code on DMM
  -pv2 PV2              Follow a code, get the corresponding preview video of the code on Avgle
  -rk1                  Get the top 25 ranking of DMM actresses
  -rk2                  Get the top 25 ranking of AVs
  -p PROXY, --proxy PROXY
                        Followed by a proxy server address (by default reads the value of the environment variable http_proxy)

DEV

I use python-3.9.13 for development, please use python <= 3.9.

And it is recommended to use python virtual environment to avoid some unnecessary problems.

Here is my developing steps:

git clone https://github.com/akynazh/jvav.git
cd jvav
~/.pyenv/versions/3.9.13/bin/python -m venv .venv
source ./.venv/bin/activate
pip3 install -r requirements.txt

And then you can enjoy coding! Remember to write or run test cases in tests/test.py. Please make sure the test is okay before submitting your code~

TODO

The following are some functions to be implemented, and I look forward to your contribution~

  • support db.msin.jp
  • support RankUtil in CMD (Thanks: @akynazh)
  • cache the successful query results locally (Thanks: @akynazh)
  • support javdb.com (Thanks: @Steven-Fake)
  • support JavDbUtil in cmd (Thanks: @akynazh)

Thanks

JetBrains Logo (Main) logo.

Thanks to JetBrains for their support to this project!

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jvav-3.0.0.tar.gz (33.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

jvav-3.0.0-py3-none-any.whl (31.5 kB view details)

Uploaded Python 3

File details

Details for the file jvav-3.0.0.tar.gz.

File metadata

  • Download URL: jvav-3.0.0.tar.gz
  • Upload date:
  • Size: 33.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for jvav-3.0.0.tar.gz
Algorithm Hash digest
SHA256 0b58f1ac79f7e29f65c7bf2c3e2b7e8203643cec67b82c73f455a55cc4ae07c7
MD5 8bddaedb1e03f90c1b9d1c7b8bd82992
BLAKE2b-256 36373bc8eb26c23a28d4e142c7c24bfd6528686fed730fd69d16df0d4798b3f8

See more details on using hashes here.

File details

Details for the file jvav-3.0.0-py3-none-any.whl.

File metadata

  • Download URL: jvav-3.0.0-py3-none-any.whl
  • Upload date:
  • Size: 31.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for jvav-3.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f4a5d3629f67433fa0354ea30137a89a76b1035a4a1ac87589a5e02a8da0ae01
MD5 2557f7f5af4586407726d8faaee85f8d
BLAKE2b-256 0eb504899862cc18a66a7936c8472ea84db2232e6c0fdd8ee6b2d3f8f944721c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page