Skip to main content

Scraperly 🎬

Logo

PyPI version Python versions License GitHub stars GitHub issues Downloads

Transform your text into captivating AI-narrated videos with matching visuals! 🚀

Scraperly is your all-in-one Python toolkit for creating engaging AI-powered videos. It seamlessly combines web scraping, AI content processing, and video generation to turn your text into professional-looking videos with minimal effort.

📚 Table of Contents

✨ Features

  • 🎥 One-Click Video Creation: Transform text into professional videos
  • 🤖 Multiple AI Providers: Choose from OpenAI, Anthropic, Hyperbolic, or Ollama
  • 🖼️ Smart Image Scraping: Automatic image sourcing from Lexica.art
  • 🗣️ Natural Narration: High-quality text-to-speech conversion
  • Fast Processing: Efficient content segmentation and processing
  • 🎨 Customizable Output: Control image count and video parameters

🚀 Quick Start

from scraperly import scraperly
import os

# Create your first AI video in just 3 lines!
result = scraperly(
    content="Your story or content here",
    provider_name="openai",
    api_key=os.getenv("OPENAI_API_KEY"),
    model="gpt-4"
)

⚙️ Installation

📦 Using pip (Recommended)

# Basic installation
pip install scraperly

# With AI provider support
pip install "scraperly[ai]"

# Set up your API keys (recommended)
export OPENAI_API_KEY="your-openai-api-key"
export ANTHROPIC_API_KEY="your-anthropic-api-key"

🔧 From Source

# Clone and install
git clone https://github.com/adelelawady/scraperly.git
cd scraperly
pip install -e ".[ai]"

🎯 Use Cases

1. Story Visualization

from scraperly import scraperly
import os

# Turn a story into an engaging video
story = """
The ancient castle stood silently against the twilight sky,
its weathered stones holding centuries of secrets...
"""

result = scraperly(
    content=story,
    provider_name="anthropic",
    api_key=os.getenv("ANTHROPIC_API_KEY"),
    model="claude-3-sonnet",
    max_images_per_segment=3
)

2. Educational Content

from scraperly import scraperly
import os

# Create educational videos
lesson = """
The Solar System consists of eight planets orbiting around the Sun.
Each planet has unique characteristics...
"""

result = scraperly(
    content=lesson,
    provider_name="openai",
    api_key=os.getenv("OPENAI_API_KEY"),
    model="gpt-4-turbo",
    max_images_per_segment=2,
    output_video_path="solar_system.mp4"
)

🤖 AI Providers

Provider Default Model Available Models Features
OpenAI gpt-4 All OpenAI chat models (e.g., gpt-4, gpt-3.5-turbo, gpt-4-turbo, etc.) Best for creative content
Anthropic claude-3-sonnet All Claude models (e.g., claude-3-opus, claude-3-sonnet, claude-3-haiku, etc.) Excellent analysis
Hyperbolic deepseek-v3 All Deepseek models (e.g., deepseek-v3, deepseek-v2, etc.) Fast processing
Ollama llama2 All Ollama models (e.g., llama2, mistral, codellama, etc.) Local execution

🔧 Troubleshooting

🚫 Chrome Driver Issues
  • ✅ Update Chrome to latest version
  • ✅ Verify matching chromedriver version
  • ✅ Check system PATH configuration
❌ AI Provider Errors
  • ✅ Verify API key validity
  • ✅ Check provider status
  • ✅ Confirm model availability
⚠️ Video Processing Issues
  • ✅ Install/update FFmpeg
  • ✅ Check disk space
  • ✅ Verify file permissions

🤝 Contributing

We love your input! To contribute:

  1. 🍴 Fork the repo
  2. 🌿 Create your branch (git checkout -b feature/AmazingFeature)
  3. 💾 Commit changes (git commit -m 'Add AmazingFeature')
  4. 📤 Push to branch (git push origin feature/AmazingFeature)
  5. 🎁 Open a Pull Request

📝 License

Released under MIT License. See LICENSE for details.

👤 Author

Created with 💖 by adelelawady


Made with ❤️ for the AI community

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scraperly-2.0.1.tar.gz (16.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scraperly-2.0.1-py3-none-any.whl (14.5 kB view details)

Uploaded Python 3

File details

Details for the file scraperly-2.0.1.tar.gz.

File metadata

  • Download URL: scraperly-2.0.1.tar.gz
  • Upload date:
  • Size: 16.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.0

File hashes

Hashes for scraperly-2.0.1.tar.gz
Algorithm Hash digest
SHA256 069979a764cc072be72bc47c0f349f2d9c2fe614b3078732cd80fdff93084d1b
MD5 ebc09d89fd8982d9869802b209604f9e
BLAKE2b-256 6c9ea1a36eca5caa137af467d737e1dc48f17dac27aa45fe9009637d119dbb1e

See more details on using hashes here.

File details

Details for the file scraperly-2.0.1-py3-none-any.whl.

File metadata

  • Download URL: scraperly-2.0.1-py3-none-any.whl
  • Upload date:
  • Size: 14.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.0

File hashes

Hashes for scraperly-2.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 40c10850e77b1be9fee839bbed7cdcffadce0c92016d60b8304603e53e81a486
MD5 dddbb45af9fcbbbc65fd73e781372b9b
BLAKE2b-256 4d14c3aa4940edaf114404a326cf755b3e58fb51b20ad70bbc5a76b39ea260fb

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

2.0.1 This release

2 files

2.0.0

2 files

1.0.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page