Skip to main content

local anime file database with deduplication and sorting

Project description

weltschmerz

Maintain a (local) database for anime files. Contains scripts to hash and sort anime files, as well as looking up files in AniDB utilizing the yumemi Python module.

This project is licensed under the terms of the MIT license. These third-party files are included:

  • pyselect.py: Copyright 2013 Matthew Behrens, under the terms of the MIT license.
  • sorttable.js: Copyright 2007 Stuart Langridge, under the terms of the X11/MIT license.

See also LICENSE.md

Requirements

  • Python 3 (>=3.6)
  • yumemi Python module (optional, for interacting with AniDB)
  • SQL database
    • PostgreSQL works, and is recommended
    • SQLite3 works, but does not support the numeric collation, edit anime.py: ep = Column(String(collation="numeric")) => ep = Column(String)

Configuration file

Copy weltschmerz.cfg.example to weltschmerz.cfg or $HOME/.config/weltschmerz/weltschmerz.cfg and adjust as necessary.

Import AniDB MyMist export

It is recommended to import your MyList first, as that will populate the Anime, Episode, and File tables.

  1. Request an xml-plain-full export of your MyList at AniDB - MyList Export
  2. Download export file
  3. Extract the export file:tar xf <mylist_export>.tgz
  4. Parse the export and populate the local database: ./parse_mylist_export.py --mylist-xml-files anime/a*.xml

Hash local files

weltschmerz files hash --folder /anime/by-id/00/00/01/ --folder /anime/by-id/00/00/02/

Add files to your AniDB MyList

Lookup the local files in AniDB and add them to your MyList, if they are present in AniDB. weltschmerz anidb lookup-files --folder /anime/by-id/00 --folder /anime/by-id/01 --debug --online --add-to-mylist --mylist-state 4

Deduplicate local files

Interactively deduplicate local files, as well as set the modified time of duplicate files to the oldest one. weltschmerz files remove-duplicates --preferred-directory-pattern /anime/by-id

Sort local files

Sort/Move files, this will put the files into folders according to their anime ids (padded to 6 digits) from AniDB. e.g. files for Seikai no Monshou (anime id 1) will be put in <target_basedir>/by-id/00/00/01.

weltschmerz files sort --source-basedir /anime/unsorted --target-basedir /anime

Create symlinks for local anime folders

To be able to look for local anime by name, create symlinks to point to the folders created by "Sort local files". This creates a by-name folder under the target basedir.

  1. Download anime titles dump (XML) from AniDB, see AniDB Wiki - API/Anime Titles for instructions.
  2. Decompress the title dump: gunzip anime-titles.xml.gz
  3. Run script to create the symlinks: ./animetitle.py anime-titles.xml /anime/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

weltschmerz-0.0.6.tar.gz (19.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

weltschmerz-0.0.6-py3-none-any.whl (23.0 kB view details)

Uploaded Python 3

File details

Details for the file weltschmerz-0.0.6.tar.gz.

File metadata

  • Download URL: weltschmerz-0.0.6.tar.gz
  • Upload date:
  • Size: 19.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3

File hashes

Hashes for weltschmerz-0.0.6.tar.gz
Algorithm Hash digest
SHA256 ebb3bfb7811097f9dcbd7ed9ec36ece3f8b1298aa9c432d2e0776682d7f1e751
MD5 6b5468734f451e8c0a03472cf8276e6a
BLAKE2b-256 71b2699fd43ec287bfaba4254c2209e5164dba454aff6a21b1a5b165d3a9bceb

See more details on using hashes here.

File details

Details for the file weltschmerz-0.0.6-py3-none-any.whl.

File metadata

  • Download URL: weltschmerz-0.0.6-py3-none-any.whl
  • Upload date:
  • Size: 23.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3

File hashes

Hashes for weltschmerz-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 ddf90822f7953788b546f91cf9d0651e1d1a0754516d8520b7b6cb2735e03edd
MD5 16fd453fe0e116d1ff5a81bfe027c804
BLAKE2b-256 737c6e01c10c69ca36d6967232500f2d86ca375c985985fa8c1dcfb20c30508c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page