email-archiver 0.1.0

Email-to-EML Secure Archiver

Email-to-EML Secure Archiver (EESA)

A Python-based command-line utility to programmatically retrieve emails from Gmail and Microsoft 365 and save them as RFC822-compliant .eml files.

✨ Features

• 🔐 Secure OAuth2 Authentication - Browser-based authentication with 2FA support
• 📧 Multi-Provider Support - Gmail and Microsoft 365 (Outlook)
• 🔍 Advanced Filtering - Date-based, incremental sync, custom queries
• 🪝 Webhook Integration - Automatically send downloaded emails to webhook endpoints
• 💾 Incremental Checkpointing - Resume interrupted downloads
• 📦 Modern Package Management - UV/UVX support for easy installation and execution

🚀 Quick Start

Installation

cd email-archiver
uv sync

Basic Usage

# Download emails from Gmail since a specific date
uv run main.py --provider gmail --since 2024-12-01

# Incremental sync (resume from last checkpoint)
uv run main.py --provider gmail --incremental

# With webhook integration
uv run main.py --provider gmail --since 2024-12-23 \
  --webhook-url https://your-webhook.com/endpoint \
  --webhook-secret "Bearer your-token"

📖 Documentation

• Quick Start Guide - Get up and running in 5 minutes
• Complete Documentation - Full setup and configuration guide
• API Reference - Command-line arguments and Python API
• Examples - 21 practical examples and use cases

🎯 Common Use Cases

Daily Email Backup

uv run main.py --provider gmail --incremental

Archive Specific Emails

# Emails with attachments
uv run main.py --provider gmail --query "has:attachment" --since 2024-01-01

# From specific sender
uv run main.py --provider gmail --query "from:[e-mail]"

Webhook Integration

# Send emails to processing endpoint
uv run main.py --provider gmail --incremental \
  --webhook-url https://api.example.com/emails \
  --webhook-secret "Bearer sk_live_abc123"

⚙️ Configuration

Gmail Setup

1. Create a project in Google Cloud Console
2. Enable Gmail API
3. Create OAuth 2.0 credentials (Desktop App)
4. Save credentials as config/client_secret.json

Microsoft 365 Setup

1. Register app in Azure Portal
2. Add Mail.Read permission
3. Update config/settings.yaml with your Client ID

See Quick Start Guide for detailed instructions.

🪝 Webhook Integration

EESA can automatically POST downloaded .eml files to a webhook endpoint:

Via CLI:

uv run main.py --provider gmail --since 2024-12-01 \
  --webhook-url https://webhook.site/your-id \
  --webhook-secret "Bearer token"

Via Configuration:

# config/settings.yaml
webhook:
  url: "https://your-webhook.com/endpoint"
  enabled: true
  headers:
    Authorization: "Bearer your-token"

📋 Command-Line Arguments

Argument	Description
--provider {gmail,m365}	Email provider (required)
--since YYYY-MM-DD	Download emails since date
--incremental	Resume from last checkpoint
--query STRING	Custom search query
--webhook-url URL	Webhook endpoint URL
--webhook-secret SECRET	Authorization header for webhook

See API Reference for complete documentation.

🔧 Requirements

• Python 3.9+
• UV package manager (recommended) or pip
• Gmail API credentials (for Gmail)
• Azure AD app registration (for M365)

📁 Project Structure

email-archiver/
├── main.py                 # CLI entry point
├── core/                   # Core modules
│   ├── gmail_handler.py    # Gmail API integration
│   ├── graph_handler.py    # Microsoft Graph API integration
│   └── utils.py            # Utility functions
├── config/
│   ├── settings.yaml       # Configuration file
│   ├── checkpoint.json     # Incremental sync state
│   └── client_secret.json  # OAuth credentials (git-ignored)
├── auth/                   # OAuth tokens (git-ignored)
├── downloads/              # Downloaded .eml files
├── docs/                   # Documentation
└── pyproject.toml          # UV/Python project config

🔒 Security

• OAuth2 Only - No password storage
• Read-Only Scopes - gmail.readonly and Mail.Read
• Token Protection - Tokens stored with restricted permissions (chmod 600)
• HTTPS Webhooks - Always use HTTPS for webhook endpoints

🤝 Contributing

This project follows the specification in docs/SPECIFICATION.md.

📄 License

See LICENSE file for details.

🆘 Support

For issues or questions:

1. Check the documentation
2. Review examples
3. Check logs in sync.log

🎓 Examples

Automation with Cron

# Daily backup at 2 AM
0 2 * * * cd /path/to/email-archiver && uv run main.py --provider gmail --incremental

Python Integration

import subprocess

subprocess.run([
    "uv", "run", "main.py",
    "--provider", "gmail",
    "--since", "2024-12-01"
], cwd="/path/to/email-archiver")

See EXAMPLES.md for 21 more examples!

---

Built with ❤️ for secure email archiving