zytools-fs 0.0.4

Personal Python utilities for FTP and video downloads

zytools-fs

Personal Python utilities for FTP and video downloads.

Install

pip install zytools-fs

FTP download

from zytools.utils.ftp import FTPDownloader

with FTPDownloader(host="127.0.0.1", user="user", password="password") as ftp:
    ftp.download("/remote/path", "./downloads")

Bilibili video download

from zytools.video import download_bili_video

download_bili_video(
    "https://www.bilibili.com/video/BVxxxx",
    output_dir="./downloads",
    filename="Bilibili_{BV}_{Date}_{Part}_{Duration}",
)

Filename template fields:

• {Title}: video title
• {BV}: BV id
• {Date}: publish date, YYYYMMDD
• {Page}: page number
• {Part}: page number
• {Duration}: duration in seconds
• {PartTitle}: page title

Task update

from zytools.utils import TaskUpdater, update_task

update_task(
    name="daily job",
    machine_id="machine-1",
    script_path="/path/to/script.py",
    server="http://127.0.0.1:8000",
)

task = TaskUpdater(
    name="daily job",
    machine_id="machine-1",
    script_path="/path/to/script.py",
)
task.update()

URL bloom filter

from zytools.utils import UrlFilter

url_filter = UrlFilter(capacity=100_000)

url = "https://example.com/video?id=1"

if url_filter.is_new(url):
    print("new url")
    url_filter.add(url)

url_filter.save()

MongoDB helper

Install the optional dependency:

pip install "zytools-fs[mongo]"

from zytools.utils import MongoHelper

with MongoHelper("mongodb://127.0.0.1:27017", "demo") as mongo:
    mongo.upsert_one(
        "users",
        {"_id": "user-1"},
        {"name": "Alice"},
    )