text2video 0.0.4

Utils for text2video generation models

Official text2video package

This is the official github repo of pypi package text2video (https://pypi.org/project/text2video/). This repo is intended to provide common interface to help develop text2video related Vision-Language Models and related deployed APIs. There are also many brilliant AI apps released such as Runway AI, Pika AI, Kling AI, etc. Right now it has just started from scratch and you are very welcome to contact us if you would like to commit to this repo and facilitate the community.

Install

pip install text2video

An example of Calling arxiv.org to Fetch Latest "Text To Video" Related Papers

Usage

import text2video as t2v

input_dict = {"text": "Text to Video"}

res = t2v.api(input_dict, model=None, api_name="ArxivPaperAPI", start=0, max_results = 3)
paper_list = json.loads(res["text"])
print ("###### Text to Image Recent Paper List:")
for (i, paper_json) in enumerate(paper_list):
    print ("### PAPER %d" % (i+1))
    print (paper_json)

Common Interface of Text to Video Application

class YourText2VideoAPI(BaseAPI):
    """docstring for ClassName"""
    def __init__(self, configs):
        super(YourText2VideoAPI, self).__init__(configs)
        self.name = "xxxxx"

    def api(self, input_dict, model, kwargs):
        """
            Args:
                input_dict: dict, multi-modal input text, image, audio and video
                model: huggingface model of tf or pytoch
                kwargs: key-value args
            Return:
                res_dict: dict, multi-modal text text, image, audio and video
        """
        res_dict={}
        try:
            input_text = input_dict["text"]   # str
            input_image = input_dict["image"] # image path
            input_audio = input_dict["audio"] # audio path
            input_video = input_dict["video"] # video path

            res_dict["text"] = None
            res_dict["image"] = None
            res_dict["audio"] = None
            res_dict["video"] = None
        except Exception as e:
            print (e)
        return res_dict

Awesome Text to Video Papers and Projects

2024 Text to Video Paper

PAPER	URL
HARIVO: Harnessing Text-to-Image Models for Video Generation	https://arxiv.org/pdf/2410.07763
MMHead: Towards Fine-grained Multi-modal 3D Facial Animation	https://arxiv.org/abs/2410.07757
T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design	https://arxiv.org/abs/2410.05677
MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion	https://arxiv.org/abs/2410.07659

AI Services Reviews and Ratings

Chatbot

OpenAI o1 Reviews
ChatGPT User Reviews
Gemini User Reviews
Perplexity User Reviews
Claude User Reviews
Qwen AI Reviews
Doubao Reviews
ChatGPT Strawberry
Zhipu AI Reviews

AI Image Generation

Midjourney User Reviews
Stable Diffusion User Reviews
Runway User Reviews
GPT-5 Forecast
Flux AI Reviews
Canva User Reviews

AI Video Generation

Luma AI
Pika AI Reviews
Runway AI Reviews
Kling AI Reviews
Dreamina AI Reviews

AI Education

Coursera Reviews
Udacity Reviews
Grammarly Reviews

Robotics

Tesla Cybercab Robotaxi
Tesla Optimus
Figure AI
Unitree Robotics Reviews
Waymo User Reviews
ANYbotics Reviews
Boston Dynamics

AI Tools

DeepNLP AI Tools

AI Widgets

Apple Glasses
Meta Glasses
Apple AR VR Headset
Google Glass
Meta VR Headset
Google AR VR Headsets

Social

Character AI

Self-Driving

BYD Seal
Tesla Model 3
BMW i4
Baidu Apollo Reviews
Hyundai IONIQ 6

Related Blogs

1. Introduction to multimodal generative models
   
2. Generative AI Search Engine Optimization
   
3. AI Image Generator User Reviews
   
4. AI Video Generator User Reviews
   
5. AI Chatbot & Assistant Reviews
   
6. Best AI Tools User Reviews