Skip to main content

Cross-platform command-line AV1 / VP9 / HEVC / H264 / VVC encoding framework with per scene quality encoding

Project description


Av1an

A cross-platform framework to streamline encoding

alt text

Discord server

Easy, Fast, Efficient and Feature Rich

An easy way to start using VVC / AV1 / HEVC / H264 / VP9 / VP8 encoding. AOM, RAV1E, SVT-AV1, SVT-VP9, VPX, x265, x264, VTM(Experimental) are supported.

Example with default parameters:

av1an -i input

With your own parameters:

av1an -i input -enc aom -v "--cpu-used=3 --end-usage=q --cq-level=30 --threads=8" -w 10
--split_method aom_keyframes --target_quality 95 --vmaf_path "vmaf_v0.6.1.pkl" -min_q 20 -max_q 60
-ff "-vf scale=-1:1080" -a "-c:a libopus -ac 2 -b:a 192k" -s scenes.csv -log my_log -o output

Usage

-i   --input            Input file(s) (relative or absolute path)

-o   --output_file      Name/Path for output file (Default: (input file name)_(encoder).mkv)
                        Output file ending is always `.mkv`

-enc --encoder          Encoder to use
                        (`aom`,`rav1e`,`svt_av1`,`svt_vp9`,`vpx`,`x265`, `x264`,`vvc`)
                        Default: aom
                        Example: -enc rav1e

-v   --video_params     Encoder settings flags (If not set, will be used default parameters.)
                        Must be inside ' ' or " "

-p   --passes           Set number of passes for encoding
                        (Default: AOMENC: 2, rav1e: 1, SVT-AV1: 1, SVT-VP9: 1,
                        VPX: 2, x265: 1, x264: 1, VVC:1)

-w   --workers          Override number of workers.

-r   --resume           If encode was stopped/quit resumes encode with saving all progress
                        Resuming automatically skips scenedetection, audio encoding/copy,
                        spliting, so resuming only possible after actuall encoding is started.
                        temp folder must be presented for resume.

--no_check              Skip checking numbers of frames for source and encoded chunks.
                        Needed if framerate changes to avoid console spam.
                        By default any differences in frames of encoded files will be reported.

--keep                  Not deleting temprally folders after encode finished.

-q --quiet              Do not print tqdm to terminal.

-log --logging          Path to .log file(By default created in temp folder)

--temp                  Set path for temporally folders. Default: .temp

-cfg --config           Save/Read config file with encoder, encoder parameters,
                        FFmpeg and audio settings.

--mkvmerge              Use mkvmerge for concatenating instead of ffmpeg.
                        Use in case when concatenation fails.

-c  --config            Save config file with given name if doesn't exists.
                        Reads config file with that name.
                        Options provided to cli overwrite config values.
                        All options excepth in/out/vmaf/log/temp/config paths are saved.

--webm                  Outputs webm file.
                        Use only if you're sure source video and audio is compatible.

FFmpeg options

-a   --audio_params     FFmpeg audio settings (Default: copy audio from source to output)
                        Example: -a '-c:a libopus -b:a  64k'

-ff  --ffmpeg           FFmpeg options video options. Applied to each encoding segment individually.
                        (Warning: Cropping doesn't work with Target VMAF mode without
                        specifying it in --vmaf_filter)
                        Example:
                        --ff " -vf scale=320:240 "

-fmt --pix_format       Setting custom pixel/bit format for piping
                        (Default: 'yuv420p10le')
                        Based on encoder, options should be adjusted accordingly.

Segmenting

--split_method          Method used for generating splits.(Default: PySceneDetect)
                        Options: `pyscene`, `aom_keyframes`, `none`
                        `pyscene` - PyScenedetect, content based scenedetection
                        with threshold.
                        `aom_keyframes` - using stat file of 1 pass of aomenc encode
                        to get exact place where encoder will place new keyframes.
                        (Keep in mind that speed also depends on set aomenc parameters)
                        `ffmpeg` - Uses ffmpeg built in content based scene detection
                        with threshold. Slower and less precise than pyscene but requires
                        fewer dependencies.
                        `none` -  skips scenedetection. Useful for splitting by time

-cm  --chunk_method     Determine way in which chunks made for encoding.
                        By default selected best one avalable.
                        vs_ffms2 > vs_lsmash > hybrid
                        ['hybrid'(default), 'select', 'vs_ffms2'(Recomended To Install), 'vs_lsmash']

-tr  --threshold        PySceneDetect threshold for scene detection Default: 35

-s   --scenes           Path to file with scenes timestamps.
                        If file not exist, new will be generated in current folder
                        First run to generate stamps, all next reuse it.
                        Example: "-s scenes.csv"

-xs  --extra_split      Adding extra splits if frame distance beetween splits bigger than
                        given value. Pair with none for time based splitting or with any
                        other splitting method to break up massive scenes.
                        Example: 1000 frames video with single scene,
                        -xs 200 will add splits at 200,400,600,800.

Target Quality

--target_quality        Quality value to target.
                        VMAF used as substructure for algorithms.
                        Supported for all encoders(Exception:VVC).
                        Best works in range 85-97.
                        When using this mode specify full encoding options.
                        Encoding options must include quantizer based mode,
                        and some quantizer option provided. (This value got replaced)
                        `--crf`,`--cq-level`,`--quantizer` etc

--target_quality_method Type of algorithm for use.
                        Options: per_shot, per_frame.
                        Per frame avalable only for SVT-AV1.

--min_q, --max_q        Min,Max Q values limits
                        If not set by user, default for encoder range will be used.

--vmaf                  Calculate vmaf after encode is done and make a plot.

--vmaf_plots            Make plots for target quality search decisions
                        (Exception: early skips)
                        Saved in temp folder

--vmaf_path             Custom path to libvmaf models.
                        example: --vmaf_path "vmaf_v0.6.1.pkl"
                        Recomended to place both files in encoding folder
                        (`vmaf_v0.6.1.pkl` and `vmaf_v0.6.1.pkl.model`)
                        (Required if vmaf calculation doesn't work by default)

--vmaf_res              Resolution scaling for vmaf calculation,
                        vmaf_v0.6.1.pkl is 1920x1080 (by default),
                        vmaf_4k_v0.6.1.pkl is 3840x2160 (don't forget about vmaf_path)

--probes                Number of probes for interpolation.
                        1 and 2 probes have special cases to try to work with few data points.
                        Optimal is 4-6 probes. Default: 4

--vmaf_filter           Filter used for vmaf calculation. Passed format is filter_complex.
                        So if crop filter used ` -ff " -vf crop=200:1000:0:0 "`
                        `--vmaf_filter` must be : ` --vmaf_filter "crop=200:1000:0:0"`

--probing_rate             Setting rate for vmaf probes (Every N frame used in probe, Default: 4)

--n_threads             Limit number of threads that used for vmaf calculation
                        Example: --n_threads 12
                        (Required if VMAF calculation gives error on high core counts)

Main Features

Spliting video by scenes for parallel encoding because AV1 encoders are currently not good at multithreading, encoding is limited to single or couple of threads at the same time.

  • PySceneDetect used for spliting video by scenes and running multiple encoders.
  • Fastest way to encode AV1 without losing quality, as fast as many CPU cores you have :).
  • Target Quality mode. Targeting end result reference visual quality. VMAF used as substructure
  • Resuming encoding without loss of encoded progress.
  • Simple and clean console look.
  • Automatic detection of the number of workers the host can handle.
  • Building encoding queue with bigger files first, minimizing waiting for the last scene to encode.
  • Both video and audio transcoding with FFmpeg.
  • Logging of progress of all encoders.

Install

Support developer

Bitcoin - 1gU9aQ2qqoQPuvop2jqC68JKZh5cyCivG

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Av1an-minimal-5.5.4.tar.gz (45.0 kB view details)

Uploaded Source

Built Distribution

Av1an_minimal-5.5.4-py3-none-any.whl (72.8 kB view details)

Uploaded Python 3

File details

Details for the file Av1an-minimal-5.5.4.tar.gz.

File metadata

  • Download URL: Av1an-minimal-5.5.4.tar.gz
  • Upload date:
  • Size: 45.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.54.0 CPython/3.9.1

File hashes

Hashes for Av1an-minimal-5.5.4.tar.gz
Algorithm Hash digest
SHA256 2c64793dab71a3e6244702377e7b44c1e454c3eb9517160dfac763cc5f909283
MD5 c41ad30cc8058ec8229ab362f31d21f2
BLAKE2b-256 567bf955fafe127a74acb9fdf1d6d957726820566171f97fc9a7ef02e1cc6c51

See more details on using hashes here.

File details

Details for the file Av1an_minimal-5.5.4-py3-none-any.whl.

File metadata

  • Download URL: Av1an_minimal-5.5.4-py3-none-any.whl
  • Upload date:
  • Size: 72.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.54.0 CPython/3.9.1

File hashes

Hashes for Av1an_minimal-5.5.4-py3-none-any.whl
Algorithm Hash digest
SHA256 4e087cdf34b9986361fb349e57941134648192ee703e5a6e68ca8473cb40f1b4
MD5 9a3556dade4e166beff7452dbbe16b86
BLAKE2b-256 e1f6441f4318e55bde659797c9c49661786b6096a83b384f198c9a802f69ce87

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page