ruDALL-E generate images from texts in Russian language
Project description
ruDALL-E
Generate images from texts
pip install rudalle==0.0.1rc8
🤗 HF Models:
Minimal Example:
generation by ruDALLE:
from rudalle.pipelines import generate_images, show, super_resolution, cherry_pick_by_clip
from rudalle import get_rudalle_model, get_tokenizer, get_vae, get_realesrgan, get_ruclip
from rudalle.utils import seed_everything
# prepare models
device = 'cuda'
dalle = get_rudalle_model('Malevich', pretrained=True, fp16=True, device=device)
realesrgan = get_realesrgan('x4', device=device)
tokenizer = get_tokenizer()
vae = get_vae().to(device)
ruclip, ruclip_processor = get_ruclip('ruclip-vit-base-patch32-v5')
ruclip = ruclip.to(device)
text = 'изображение радуги на фоне ночного города'
seed_everything(42)
pil_images = []
scores = []
for top_k, top_p, images_num in [
(2048, 0.995, 3),
(1536, 0.99, 3),
(1024, 0.99, 3),
(1024, 0.98, 3),
(512, 0.97, 3),
(384, 0.96, 3),
(256, 0.95, 3),
(128, 0.95, 3),
]:
_pil_images, _scores = generate_images(text, tokenizer, dalle, vae, top_k=top_k, images_num=images_num, top_p=top_p)
pil_images += _pil_images
scores += _scores
show(pil_images, 6)
auto cherry-pick by ruCLIP:
top_images, clip_scores = cherry_pick_by_clip(pil_images, text, ruclip, ruclip_processor, device=device, count=6)
show(top_images, 3)
super resolution:
sr_images = super_resolution(top_images, realesrgan)
show(sr_images, 3)
text, seed = 'красивая тян из аниме', 6955
Image Prompt
see jupyters/ruDALLE-image-prompts-A100.ipynb
text, seed = 'Храм Василия Блаженного', 42
skyes = [red_sky, sunny_sky, cloudy_sky, night_sky]
🚀 Contributors 🚀
- @bes shared great idea and realization with IDWT for decoding images with higher quality 512x512! 😈💪 thanks a lot for your advices
- @neverix thanks a lot for contributing for speed up of inference
- @Igor Pavlov trained model and prepared code with super-resolution
- @oriBetelgeuse thanks a lot for easy API of generation using image prompt
- @Alex Wortega created first FREE version colab notebook with fine-tuning ruDALL-E Malevich (XL) on sneakers domain 💪
- @Anton Lozhkov Integrated to Huggingface Spaces with Gradio, see here
Social Media
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
rudalle-0.0.1rc8.tar.gz
(33.2 kB
view hashes)
Built Distribution
rudalle-0.0.1rc8-py3-none-any.whl
(37.9 kB
view hashes)
Close
Hashes for rudalle-0.0.1rc8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 69b97f2255b8ec0002b3174e9f01acb64d1d713307d98adafe1a6ab34d6f3b83 |
|
MD5 | c7f53b4e55e08160b98082878b8cdb83 |
|
BLAKE2b-256 | 8c5aa3eaf48f6268780d3097dd90f310b8ce28d80f8aebdfb8bda52fd70b42f0 |