Skip to main content

Advanced Data Processing and Analytics Framework

Project description

ADPA Framework

PyPI version Python License Documentation Status CI/CD codecov Code style: black Security: bandit Imports: isort Downloads

Overview

ADPA (Advanced Data Processing and Analytics) is a comprehensive framework for data processing, analytics, and machine learning tasks. It provides a robust foundation for building scalable, secure, and maintainable data applications.

🚀 Quick Start

pip install adpa
from adpa.text2sql import Text2SQLConverter

# Initialize the converter
converter = Text2SQLConverter()

# Convert natural language to SQL
query = "Find all users who joined after 2024"
sql = converter.convert(query)
print(sql)

📚 Read the Quick Start Guide

✨ Features

Core Components

  • Text2SQL Engine: Convert natural language to SQL with schema validation
  • Agent System: Autonomous agents for complex data processing tasks
  • LLM Integration: Support for multiple LLM providers (OpenAI, Anthropic, Azure)
  • Database Operations: Unified interface for database interactions
  • Security Layer: Built-in security features and input validation

Advanced Features

  • Monitoring: Real-time performance and resource monitoring
  • Caching: Intelligent caching system for improved performance
  • Scaling: Horizontal scaling capabilities for large workloads
  • API Integration: Ready-to-use API interfaces
  • UI Components: Modern web interface components

🛠️ Installation

Basic Installation

pip install adpa

With Optional Dependencies

# With all features
pip install "adpa[all]"

# With specific features
pip install "adpa[llm,monitoring]"

📖 Documentation

🌟 Examples

Text to SQL Conversion

from adpa.text2sql import Text2SQLConverter
from adpa.database import DatabaseManager

# Initialize components
converter = Text2SQLConverter()
db = DatabaseManager()

# Convert and execute query
query = "Show me sales trends for last month"
sql = converter.convert(query)
results = db.execute(sql)

Agent System Usage

from adpa.agents import AgentSystem
from adpa.agents.types import Task

# Initialize agent system
agent_system = AgentSystem()

# Create and execute task
task = Task(
    description="Analyze user behavior patterns",
    data={"timeframe": "last_week"}
)
result = agent_system.execute_task(task)

Monitoring Integration

from adpa.monitoring import Monitor

# Initialize monitoring
monitor = Monitor()

# Track operations
with monitor.track("data_processing"):
    # Your code here
    pass

# Get metrics
metrics = monitor.get_metrics()

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

Development Setup

# Clone repository
git clone https://github.com/achimdehnert/adpa.git
cd adpa

# Install development dependencies
pip install poetry
poetry install --with dev,test,docs

# Run tests
poetry run pytest
poetry run robot -d results tests/robot/tests/

📊 Project Status

  • Latest Release: v1.5.0
  • Python Versions: 3.11, 3.12
  • Development Status: Beta
  • License: MIT

🔗 Links

📝 License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

adpa-0.1.6.tar.gz (45.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

adpa-0.1.6-py3-none-any.whl (165.1 kB view details)

Uploaded Python 3

File details

Details for the file adpa-0.1.6.tar.gz.

File metadata

  • Download URL: adpa-0.1.6.tar.gz
  • Upload date:
  • Size: 45.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.9

File hashes

Hashes for adpa-0.1.6.tar.gz
Algorithm Hash digest
SHA256 fd1e665550610ab95caa903651c02091916922d406b4736ef513642639b35009
MD5 d7f1689817435c9bd5db6f6ba4ec458f
BLAKE2b-256 5d73509fe4693b11fdd99f76a1817e18b1a4c605543bcf7f30d651e10f51797b

See more details on using hashes here.

File details

Details for the file adpa-0.1.6-py3-none-any.whl.

File metadata

  • Download URL: adpa-0.1.6-py3-none-any.whl
  • Upload date:
  • Size: 165.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.9

File hashes

Hashes for adpa-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 6203b0b28fe591b591e39af06450382daf5457b3674409cf6cb0dd9a91f61093
MD5 d6d3308d0817346166cb1d1f06f24b49
BLAKE2b-256 3d1972e59ab57c339c2b1b6026d747e5337537c5a46500cdad94059a3f84356f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page