Skip to main content
Help the Python Software Foundation raise $60,000 USD by December 31st!  Building the PSF Q4 Fundraiser

Scraper for YggTorrent

Project description

YggTorrentScraper

PyPI version Codacy Badge Maintainability Build Status codecov

Installation

pip install yggtorrentscraper

OR

clone this repository and

pip install -r requirements.txt

python setup.py install

Dependencies

Usage

Initialization

Actual cloudflare bypassers like https://github.com/VeNoMouS/cloudscraper seem to have some difficulties for now.

The easiest solution is to set « cf_clearance » cookie manually, you can find it in your browser.

import requests
from yggtorrentscraper import YggTorrentScraper

cookie = requests.cookies.create_cookie(
    name="cf_clearance",
    value="1b23f59d619777532aea667960d00269fc49517e-1589279876-0-150",
)
session = requests.session()

session.cookies.set_cookie(cookie)

scraper = YggTorrentScraper(session)

Selenium version

from yggtorrentscraper import YggTorrentScraperSelenium
from selenium import webdriver


options = webdriver.ChromeOptions()
options.add_argument("--log-level=3")
options.add_argument("--disable-blink-features")
options.add_argument("--disable-blink-features=AutomationControlled")
options.add_experimental_option("excludeSwitches", ["enable-logging"])

driver = webdriver.Chrome("D:\chromedriver.exe", options=options)

scraper = YggTorrentScraperSelenium(driver=driver)

#OR

scraper = YggTorrentScraperSelenium(driver_path="D:\chromedriver.exe")

Change TLD

YggTorrent TLD is change regularly, you can specify it at YggTorrentScraper construction with optionnal parameters yggtorrent_tld

from yggtorrentscraper import set_yggtorrent_tld

set_yggtorrent_tld("new_tld")

Session is requiered to download torrent

Login (optionnal)

I highly recommend you to not use your main account, YggTorrent ban bots

Requiered only for download torrent's file

if(scraper.login("myidentifiant", "mypassword")):
    print("Login success")
else:
    print("Login failed")

Search torrents

Return url's results torrent for specified search

torrents_url = scraper.search({name : "walking dead s08"})

"""

https://www2.yggtorrent.ch/torrent/filmvidâ–’o/sâ–’rie-tv/227730-the+walking+dead+s08+complete+vostfr+proper+720p+hdtv+x264-expm5
https://www2.yggtorrent.ch/torrent/filmvidâ–’o/sâ–’rie-tv/227752-the+walking+dead+s08+complete+vostfr+proper+hdtv+xvid-expm5
https://www2.yggtorrent.ch/torrent/filmvidâ–’o/sâ–’rie-tv/227763-the+walking+dead+s08+vostfr+web-dl+x264-ark01
https://www2.yggtorrent.ch/torrent/filmvidâ–’o/sâ–’rie-tv/227764-the+walking+dead+s08+vostfr+720p+amzn+web-dl+dd5+1+h264-ark01
https://www2.yggtorrent.ch/torrent/filmvidâ–’o/sâ–’rie-tv/227765-the+walking+dead+s08+vostfr+1080p+amzn+web-dl+ddp5+1+h264-ark01

...

"""

Search an torrents by uploader

Return url's results torrent for specified search

torrents_url = scraper.search({name : "walking dead s09", "uploader" : 'brandit'})

Search torrents with sorted results

Return url's results torrent for specified search

YggTorrent's sorting is bugged, in general the results are sorted but sometimes you can find some torrents at a wrong position

  • sort : name/publish_date/size/completed/seed/leech
  • order : asc/desc
torrents_url = scraper.search({"name": "blue oyster cult", "sort": "completed", "order": "desc"})

Search by category, subcategory and options_index

Complete categories tree is available in file categories.py

parameters = {
    "name": "walking dead",
    "category": "films_&_videos",
    "subcategory": "serie_tv",
    "options": {
        "langue": {"francais_(vff/truefrench)"},
        "episode": {"saison_complete"},
        "qualite": {"bluray_[full]"},
    },
}


research = scraper.search(parameters)

Most completed

Return url's of most completed (top 100) downloaded torrents

most_completed = scraper.most_completed()

"""

https://www2.yggtorrent.ch/torrent/filmvideo/serie-tv/440445-game-of-thrones-s08e02-multi-1080p-amzn-web-dl-dd5-1-x264-ark01
https://www2.yggtorrent.ch/torrent/application/windows/316475-microsoft-toolkit-v2-6-4-activateur-office-2016---2019-windows-10
https://www2.yggtorrent.ch/torrent/filmvideo/animation/431851-asterix-le-secret-de-la-potion-magique-2018-french-1080p-hdlight-x264-ac3-toxic
https://www2.yggtorrent.ch/torrent/application/windows/330032-windows-microsoft-office-2019-build-10730-20102-activation-francais
https://www2.yggtorrent.ch/torrent/filmvideo/serie-tv/436928-game-of-thrones-s08e01-multi-1080p-amzn-web-dl-dd5-1-h264-ark01

...

"""

Details

Get torrent's details

torrent = scraper.extract_details('https://www2.yggtorrent.ch/torrent/filmvideo/serie-tv/440445-game-of-thrones-s08e02-multi-1080p-amzn-web-dl-dd5-1-x264-ark01')

print(torrent)

"""

Name      : Game.of.Thrones.S08E02.MULTi.1080p.AMZN.WEB-DL.DD5.1.x264-ARK01
Url       : N/A (Not authentified)
Uploaded  : 2019-04-22 06:10:00
Size      : 1.40Go
Uploader  : Anonyme
Completed : 37157
Seeders   : 2254
Leechers  : 2

Files (1) :

Comments (15) :

"""

print(torrent.__str__(files=True, comments=True))

"""
Name      : Game.of.Thrones.S08E02.MULTi.1080p.AMZN.WEB-DL.DD5.1.x264-ARK01
Url       : N/A
Uploaded  : 2019-04-22 06:10:00
Size      : 1.40Go
Uploader  : Anonyme
Completed : 37157
Seeders   : 2254
Leechers  : 2

Files (1) :
size      :
file_name :Game.of.Thrones.S08E02.MULTi.1080p.AMZN.WEB-DL.DD5.1.x264-ARK01.mkv"}


Comments (15) :
Author : Beleg_5
Posted : 10 jours
Text   : Merci beaucoup.

Author : StephZher
Posted : 20 jours
Text   : Merci c'est cool !

...

"""

Download

Download torrent's file (.torrent), requiered to be logged

if(scraper.login("myidentifiant", "mypassword")):
    print("Login success")

    torrent = scraper.extract_details('https://www2.yggtorrent.ch/torrent/filmvideo/serie-tv/440445-game-of-thrones-s08e02-multi-1080p-amzn-web-dl-dd5-1-x264-ark01')

    scraper.download_from_torrent(torrent)

    """
    OR
    """

    scraper.download_from_torrent_url('https://www2.yggtorrent.ch/torrent/filmvideo/serie-tv/440445-game-of-thrones-s08e02-multi-1080p-amzn-web-dl-dd5-1-x264-ark01')
else:
    print("Login failed")

Logout (optionnal)

scraper.logout()

TODO

  • More tests, find non bugged search (especially for sort tests)

Test

Declare environment variables (requiered for login, download tests)

  • YGGTORRENT_IDENTIFIANT
  • YGGTORRENT_PASSWORD
pip install tox

tox

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for yggtorrentscraper, version 1.2.12
Filename, size File type Python version Upload date Hashes
Filename, size yggtorrentscraper-1.2.12.tar.gz (20.3 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page