Skip to main content

Automatically fetch and install Python dependencies from a remote server.

Project description

🚀 Requirement Loader

Python Version PyPI Version License GitHub Issues

Automatically fetch and install Python dependencies from remote sources for enhanced security and deployment flexibility.

When working on production servers, there's always a risk that zero-day vulnerabilities may be discovered in packages listed in your requirements.txt file. With Requirement Loader, you can update your requirements file hosted online (e.g., on GitHub) or local, and it will automatically download and install the updated dependencies. The system can either restart your application immediately or defer updates until the next scheduled restart.

✨ Key Features

  • 🔄 Automatic Updates: Continuously monitor and install dependency updates from remote sources
  • 🌐 Multiple Sources: Support for GitHub, HTTPS/HTTP URLs, and local files
  • 🔒 Security Focused: Quickly patch zero-day vulnerabilities by updating remote requirements
  • Auto Restart: Automatically restart applications after dependency updates
  • 🔇 Silent Mode: Install packages without verbose output for clean logs
  • ⚙️ Configurable: Customize update intervals, restart behavior, and more
  • 🐍 Python 3.11+: Modern Python support with type hints

🚀 Quick Start

Installation

pip install requirement-loader

Basic Usage

from requirement_loader import RequirementLoader

# Automatically manage dependencies from GitHub
loader = RequirementLoader(
    requirement_url="https://github.com/yourusername/yourproject/blob/main/requirements.txt",
    update_at_startup=True,
    auto_reload=True,
    sleep_time=300  # Check every 5 minutes
)

# Your application code here
print("Application running with automatic dependency management!")

Advanced Configuration

from requirement_loader import RequirementLoader

# Production setup with custom configuration
loader = RequirementLoader(
    requirement_url="https://your-server.com/secure/requirements.txt",
    update_at_startup=True,      # Install dependencies on startup
    silent_mode=True,            # Quiet installation(s)
    sleep_time=600,              # Check every 10 minutes
    auto_reload=True             # Auto-restart on updates
)

📖 Documentation

For comprehensive documentation, examples, and best practices, visit our Wiki:

  • Installation Guide - Detailed installation instructions and setup
  • Usage Guide - Complete usage examples and configuration options
  • Home - Overview and getting started

🛡️ Use Cases

Production Security

Quickly patch zero-day vulnerabilities by updating your remote requirements file. No need to redeploy - just update the file and let Requirement Loader handle the rest.

# Update requirements.txt on GitHub when a vulnerability is discovered
# Requirement Loader will automatically detect and install the fix
loader = RequirementLoader("https://github.com/company/configs/blob/main/prod-requirements.txt")

Centralized Dependency Management

Manage dependencies across multiple deployments from a single source.

# All your services can use the same requirements source
loader = RequirementLoader("https://internal-repo.company.com/shared-requirements.txt")

Automated Deployments

Ensure all instances have the latest approved dependencies without manual intervention.

# Staging environment with frequent updates
loader = RequirementLoader(
    requirement_url="https://github.com/company/project/blob/staging/requirements.txt",
    sleep_time=60  # Check every minute
)

Manual Updates

For scenarios where you need full control over when updates occur, disable automatic updates and trigger them manually:

from requirement_loader import RequirementLoader

# Disable automatic updates for manual control
loader = RequirementLoader(
    requirement_url="https://github.com/company/project/blob/main/requirements.txt",
    update_at_startup=False,  # Don't update on startup
    auto_reload=False         # Disable background updates
)

# Manually trigger updates when needed
loader.update(reload=True)   # Update and restart application
loader.update(reload=False)  # Update without restarting

Note: The manual_update=True parameter is only available when auto_reload=False. This prevents conflicts between automatic and manual update processes.

🔧 Supported URL Types

Type Example Description
GitHub https://github.com/user/repo/blob/main/requirements.txt Automatically converts to raw URL
Raw GitHub https://raw.githubusercontent.com/user/repo/main/requirements.txt Direct raw file access
HTTPS https://example.com/requirements.txt Any HTTPS URL
HTTP http://internal-server.com/requirements.txt HTTP URLs (use with caution)
Local File file:///path/to/requirements.txt Local file system

⚙️ Configuration Options

Constructor Parameters

Parameter Type Default Description
requirement_url str "requirements.txt" URL or path to requirements file
update_at_startup bool True Download and install requirements on initialization
silent_mode bool True Install packages without verbose output
sleep_time int 5 Seconds between update checks
auto_reload bool True Enable automatic update checking and restart

Manual Update Method

loader.update(reload=True, manual_update=True)
Parameter Type Default Description
reload bool False Whether to restart the application after update
manual_update bool True Must be True for manual calls (internal parameter)

Important: manual_update=True can only be used when auto_reload=False to prevent conflicts.

🚨 Error Handling

Requirement Loader includes comprehensive error handling for manual updates:

from requirement_loader import RequirementLoader, ArgumentConflict, RestrictedArgumentError

try:
    # This will work - auto_reload disabled for manual control
    loader = RequirementLoader(
        requirement_url="https://github.com/user/repo/blob/main/requirements.txt",
        auto_reload=False  # Disable automatic updates
    )
    
    # Manual update - this works
    loader.update(reload=True, manual_update=True)
    
except ArgumentConflict as e:
    print(f"Configuration conflict: {e}")
    # This happens when trying manual updates with auto_reload=True
    
except RestrictedArgumentError as e:
    print(f"Invalid argument: {e}")
    # This happens when manual_update=False is used incorrectly
    
except Exception as e:
    print(f"Unexpected error: {e}")

# Example of what causes ArgumentConflict:
try:
    loader_auto = RequirementLoader(auto_reload=True)
    loader_auto.update(manual_update=True)  # This will raise ArgumentConflict
except ArgumentConflict as e:
    print("Can't manually update when auto_reload is enabled!")

## 🐳 Docker Example

```dockerfile
FROM python:3.11-slim

# Install requirement-loader
RUN pip install requirement-loader

# Copy your application
COPY . /app
WORKDIR /app

# Your app will automatically manage its dependencies
CMD ["python", "app.py"]

🔒 Security Considerations

  • Use HTTPS URLs for secure transmission
  • Verify source authenticity - only use trusted requirement sources
  • Monitor remote files for unauthorized changes
  • Test updates in staging before production
  • Implement access controls on your requirements repositories

🧪 Testing

Run the included tests:

# Clone the repository
git clone https://github.com/Ivole32/requirement-loader.git
cd requirement-loader

# Install development dependencies
pip install -e .

# Run tests
python -m pytest tests/

🤝 Contributing

We welcome contributions! Here's how you can help:

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Commit your changes (git commit -m 'Add amazing feature')
  4. Push to the branch (git push origin feature/amazing-feature)
  5. Open a Pull Request

Development Setup

# Clone your fork
git clone https://github.com/yourusername/requirement-loader.git
cd requirement-loader

# Create virtual environment
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install in development mode
pip install -e .

# Install development dependencies
pip install pytest black flake8

📋 Requirements

  • Python 3.11+
  • requests >= 2.25.0

📝 Changelog

v0.0.4 (Current)

  • Initial stable release
  • Support for GitHub, HTTPS, HTTP, and local file URLs
  • Automatic application restart functionality
  • Configurable update intervals
  • Silent and verbose installation modes

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🆘 Support

🙏 Acknowledgments

  • Thanks to all contributors who help make this project better
  • Inspired by the need for better dependency management in production environments
  • Built with ❤️ for the Python community

⭐ Star this repository if you find it useful!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

requirement_loader-0.0.4.tar.gz (6.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

requirement_loader-0.0.4-py3-none-any.whl (6.5 kB view details)

Uploaded Python 3

File details

Details for the file requirement_loader-0.0.4.tar.gz.

File metadata

  • Download URL: requirement_loader-0.0.4.tar.gz
  • Upload date:
  • Size: 6.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.0

File hashes

Hashes for requirement_loader-0.0.4.tar.gz
Algorithm Hash digest
SHA256 e3f64e2375607247efbb1d200b165d91a8ade44e480b0564702607ce240e7abb
MD5 be91d02edf187403a39a6017bb3c6eb6
BLAKE2b-256 1384028fc8c2c40dac9aab2e57b07d79fa649cf15e864e9a21526328cce19671

See more details on using hashes here.

File details

Details for the file requirement_loader-0.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for requirement_loader-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 bbcf909a22f6de18028ad584e9b379c21df6cd667b5d544e09efbad37222861b
MD5 38c94b2a2593870d1c93758e602cabbd
BLAKE2b-256 61d1139c3a6bc2f37fe72bcd6ae8c61127bed581303a3dad4304ba6a25c2565f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page