ga-scrap 1.0.0

A powerful Playwright-based scraper helper with hot reload

🕷️ GA-Scrap

The Ultimate Web Scraping Library
Playwright-powered • Developer-friendly • Production-ready

---

✨ What Makes GA-Scrap Special?

🎯 Simple & Powerful from ga_scrap import SyncGAScrap with SyncGAScrap() as scraper: scraper.goto("https://example.com") title = scraper.get_text("h1") scraper.screenshot("page.png")

🏖️ Error-Resilient Development # Sandbox mode - errors don't crash! with SyncGAScrap(sandbox_mode=True) as scraper: scraper.click("#might-not-exist") # Logs error, continues scraper.screenshot("still_works.png") # Still works!

---

🚀 Quick Start

Installation

git clone https://github.com/GrandpaAcademy/GA-Scrap.git
cd GA-Scrap
pip install -r requirements.txt
playwright install

Your First Scraper

from ga_scrap import SyncGAScrap

with SyncGAScrap() as scraper:
    scraper.goto("https://quotes.toscrape.com")
    quotes = scraper.get_all_text(".quote .text")
    print(f"Found {len(quotes)} quotes!")

That's it! No async/await, no complex setup - just simple Python code.

📚 Learn More

Comprehensive documentation and examples:

📖 Full Documentation • 🚀 Real-World Examples • 🔧 API Reference

---

🎯 Core Features

Feature	Description	Status
🔄 Dual Interface	Both sync and async APIs	✅
🏖️ Sandbox Mode	Error-resilient development	✅
🎭 Full Playwright	Complete A-Z feature access	✅
📱 Device Emulation	Mobile, tablet, desktop	✅
🌐 Network Control	Request/response interception	✅
📸 Media Capture	Screenshots, PDFs, videos	✅
🔧 Developer Tools	Hot reload, debugging	✅
🎨 Beautiful CLI	Colorful command interface	✅

---

📚 Complete Web Documentation

🌐 Visit Our Interactive Documentation Site 🌐

Beautiful • Interactive • Complete

🎯 Choose Your Learning Path

👶 Beginner New to web scraping? 📖 Getting Started 🎯 Basic Examples 🔧 Installation Guide

🧪 Developer Building scrapers? 🏖️ Sandbox Mode 🔄 Sync Interface ⚡ Hot Reload

🚀 Advanced Need full control? 🎭 Playwright API 🔧 Architecture 🤝 Contributing

---

🎨 Interface Options

🔄 Synchronous (Recommended)

Perfect for beginners and most use cases

from ga_scrap import SyncGAScrap

with SyncGAScrap() as scraper:
    scraper.goto("https://example.com")
    data = scraper.get_text(".content")
    scraper.screenshot("result.png")

⚡ Asynchronous

For advanced users and high-performance scenarios

import asyncio
from ga_scrap import GAScrap

async def scrape():
    async with GAScrap() as scraper:
        await scraper.goto("https://example.com")
        data = await scraper.get_text(".content")
        await scraper.screenshot("result.png")

asyncio.run(scrape())

---

🏖️ Sandbox Mode

The game-changer for development!

# Traditional scraping - one error stops everything
scraper.click("#button")  # ❌ Element not found → CRASH!

# GA-Scrap sandbox mode - errors are handled gracefully
with SyncGAScrap(sandbox_mode=True) as scraper:
    scraper.click("#button")  # ❌ Error logged, execution continues
    scraper.screenshot("debug.png")  # ✅ Still works perfectly!

Benefits:

• 🛡️ Never crashes - Browser stays active during errors
• 📝 Detailed logging - Know exactly what went wrong
• 🔄 Instant recovery - Fix and continue immediately
• 🧪 Perfect for testing - Try different approaches safely

---

🎭 Complete Playwright Access

Every Playwright feature from A-Z is available:

# High-level GA-Scrap methods
scraper.goto("https://example.com")
scraper.screenshot("page.png")

# Direct Playwright access when needed
page = scraper.get_playwright_page()
await page.evaluate("document.body.style.background = 'red'")

# Safe method execution with sandbox protection
result = scraper.execute_playwright_method('page', 'title')

🔤 View A-Z Feature List

• Accessibility testing
• Browser management
• Cookies & context
• Downloads handling
• Evaluate JavaScript
• Form interactions
• Geolocation control
• Hover & interactions
• Injection (CSS/JS)
• JavaScript execution
• Keyboard simulation
• Locators & selectors
• Mouse operations
• Network monitoring
• Offline mode
• PDF generation
• Query selectors
• Recording (video/HAR)
• Screenshots
• Touch simulation
• Upload files
• Viewport control
• Waiting strategies
• XPath selectors
• Yielding control
• Zone/timezone settings

---

🛠️ CLI Tools

# Quick scraping
ga-scrap quick "https://example.com" "h1"

# Create new project
ga-scrap new my-scraper

# Development with hot reload
ga-scrap dev

# Run with auto-restart
ga-scrap run script.py

---

🎯 Examples

📰 News Scraper

with SyncGAScrap() as scraper:
    scraper.goto("https://news.ycombinator.com")
    
    titles = scraper.get_all_text(".titleline > a")
    scores = scraper.get_all_text(".score")
    
    for title, score in zip(titles, scores):
        print(f"{score}: {title}")

🛒 E-commerce Scraper

with SyncGAScrap(sandbox_mode=True) as scraper:
    scraper.goto("https://example-shop.com")
    
    # Handle potential popups gracefully
    scraper.click(".popup-close")  # Won't crash if not found
    
    products = scraper.get_all_text(".product-name")
    prices = scraper.get_all_text(".product-price")
    
    for product, price in zip(products, prices):
        print(f"{product}: {price}")

📱 Mobile Scraping

with SyncGAScrap(device="iPhone 12") as scraper:
    scraper.goto("https://mobile-site.com")
    scraper.simulate_touch(100, 200)
    scraper.screenshot("mobile-view.png")

---

🤝 Contributing

We love contributions! Check out our Contributing Guide to get started.

---

📄 License

MIT License - see LICENSE for details.

---

Made with ❤️ by Grandpa Academy

⭐ Star us on GitHub • 📖 Read the Docs • 🚀 See Examples • 🐛 Report Issues