Skip to main content

A tool to crawl Overleaf templates and store data in Supabase

Project description

Supabase Overleaf Template Crawler

This project crawls LaTeX templates from Overleaf and stores them in a local Supabase instance.

Setup

  1. Install dependencies:
pip install -r requirements.txt
  1. Ensure your local Supabase instance is running.
  2. Run the crawler:
python src/main.py

Project Structure

  • src/: Contains the source code
  • main.py: Main entry point
  • crawler_general.py: Crawls general template information
  • crawler_detail.py: Crawls detailed template information
  • db_handler.py: Handles database operations
  • config/: Contains configuration files
  • data/: (Optional) For storing any local data

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

supabase_overleaf-0.1.0.tar.gz (7.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

supabase_overleaf-0.1.0-py3-none-any.whl (7.8 kB view details)

Uploaded Python 3

File details

Details for the file supabase_overleaf-0.1.0.tar.gz.

File metadata

  • Download URL: supabase_overleaf-0.1.0.tar.gz
  • Upload date:
  • Size: 7.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.0

File hashes

Hashes for supabase_overleaf-0.1.0.tar.gz
Algorithm Hash digest
SHA256 19780e32c8895ca3002255c3564a7b75cefe5c86f200274036650543edb03196
MD5 678eda3a75ad9f9e73d97dba8f30d548
BLAKE2b-256 c04c5b4f98462c0cacfd280f5e396bd829268fa3ab8fb46e852397c9a57ac5b0

See more details on using hashes here.

File details

Details for the file supabase_overleaf-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for supabase_overleaf-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0de0f714124bc584f497b36b9c7a105c3fb3142366930225c73e3f6a8ff17d1d
MD5 5fb05700687d93738514a242d0a82d5b
BLAKE2b-256 d9d5ce62bc6dd95b6bfa9d83d572753b77aedb999ac1f90cbb77cd3fbfd7009d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page