Skip to main content

Image animation given a driving video sequence and a source image.

Project description

Deep Animator

Image animation given a driving video sequence and a source image.

Deep Animator is an implementation of First Order Motion Model for Image Animation by Aliaksandr Siarohin, Stéphane Lathuilière, Sergey Tulyakov, Elisa Ricci and Nicu Sebe.

The source code can be found here. This library is a simple transformation of the original code into a shell script for quick experimentation. This is also an educational effort for the writer.

Install

Run pip install deep-animator to install the library in your environment.

How to use

First you need to download the weights of the model here. Then just run the following command.

deep_animate <path_to_the_source_image> <path_to_the_driving_video> <path_to_yaml_conf> <path_to_model_weights>

  • Example of source image here
  • Example of driving video here

An example YAML file is given below:

model_params:
  common_params:
    num_kp: 10
    num_channels: 3
    estimate_jacobian: True
  kp_detector_params:
     temperature: 0.1
     block_expansion: 32
     max_features: 1024
     scale_factor: 0.25
     num_blocks: 5
  generator_params:
    block_expansion: 64
    max_features: 512
    num_down_blocks: 2
    num_bottleneck_blocks: 6
    estimate_occlusion_map: True
    dense_motion_params:
      block_expansion: 64
      max_features: 1024
      num_blocks: 5
      scale_factor: 0.25
  discriminator_params:
    scales: [1]
    block_expansion: 32
    max_features: 512
    num_blocks: 4
    sn: True

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

deep_animator-0.1.1.tar.gz (20.8 kB view details)

Uploaded Source

Built Distribution

deep_animator-0.1.1-py3-none-any.whl (22.2 kB view details)

Uploaded Python 3

File details

Details for the file deep_animator-0.1.1.tar.gz.

File metadata

  • Download URL: deep_animator-0.1.1.tar.gz
  • Upload date:
  • Size: 20.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3.post20200330 requests-toolbelt/0.9.1 tqdm/4.44.1 CPython/3.7.7

File hashes

Hashes for deep_animator-0.1.1.tar.gz
Algorithm Hash digest
SHA256 dcefb5644d8a57b23d385409cc5c9deb157795c397f3bb4367f9ac4901889854
MD5 1cbfd4c656a2cffb3721ead4fe3b32c9
BLAKE2b-256 d05c07178131401427b2228a2b5a968ef0bc3447c2e9b5dbda39856ff9a31407

See more details on using hashes here.

File details

Details for the file deep_animator-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: deep_animator-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 22.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3.post20200330 requests-toolbelt/0.9.1 tqdm/4.44.1 CPython/3.7.7

File hashes

Hashes for deep_animator-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 62703ba9c74755ef6d29baa4ef222836187f755ea3938e5090c1382bfc6d0e30
MD5 e32dc424fed7452fc37f6e2c83814af9
BLAKE2b-256 04835d1d442429d5b4f02d58516f28c716a1aa8b42a9f017a929713529da02fa

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page