Skip to main content

Advanced Data Processing and Analytics Framework

Project description

ADPA Framework

PyPI version Python License Documentation Status CI/CD codecov Code style: black Security: bandit Imports: isort Downloads

Overview

ADPA (Advanced Data Processing and Analytics) is a comprehensive framework for data processing, analytics, and machine learning tasks. It provides a robust foundation for building scalable, secure, and maintainable data applications.

🚀 Quick Start

pip install adpa
from adpa.text2sql import Text2SQLConverter

# Initialize the converter
converter = Text2SQLConverter()

# Convert natural language to SQL
query = "Find all users who joined after 2024"
sql = converter.convert(query)
print(sql)

📚 Read the Quick Start Guide

✨ Features

Core Components

  • Text2SQL Engine: Convert natural language to SQL with schema validation
  • Agent System: Autonomous agents for complex data processing tasks
  • LLM Integration: Support for multiple LLM providers (OpenAI, Anthropic, Azure)
  • Database Operations: Unified interface for database interactions
  • Security Layer: Built-in security features and input validation

Advanced Features

  • Monitoring: Real-time performance and resource monitoring
  • Caching: Intelligent caching system for improved performance
  • Scaling: Horizontal scaling capabilities for large workloads
  • API Integration: Ready-to-use API interfaces
  • UI Components: Modern web interface components

🛠️ Installation

Basic Installation

pip install adpa

With Optional Dependencies

# With all features
pip install "adpa[all]"

# With specific features
pip install "adpa[llm,monitoring]"

📖 Documentation

🌟 Examples

Text to SQL Conversion

from adpa.text2sql import Text2SQLConverter
from adpa.database import DatabaseManager

# Initialize components
converter = Text2SQLConverter()
db = DatabaseManager()

# Convert and execute query
query = "Show me sales trends for last month"
sql = converter.convert(query)
results = db.execute(sql)

Agent System Usage

from adpa.agents import AgentSystem
from adpa.agents.types import Task

# Initialize agent system
agent_system = AgentSystem()

# Create and execute task
task = Task(
    description="Analyze user behavior patterns",
    data={"timeframe": "last_week"}
)
result = agent_system.execute_task(task)

Monitoring Integration

from adpa.monitoring import Monitor

# Initialize monitoring
monitor = Monitor()

# Track operations
with monitor.track("data_processing"):
    # Your code here
    pass

# Get metrics
metrics = monitor.get_metrics()

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

Development Setup

# Clone repository
git clone https://github.com/achimdehnert/adpa.git
cd adpa

# Install development dependencies
pip install poetry
poetry install --with dev,test,docs

# Run tests
poetry run pytest
poetry run robot -d results tests/robot/tests/

📊 Project Status

  • Latest Release: v1.5.0
  • Python Versions: 3.11, 3.12
  • Development Status: Beta
  • License: MIT

🔗 Links

📝 License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

adpa-0.1.5.tar.gz (126.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

adpa-0.1.5-py3-none-any.whl (183.4 kB view details)

Uploaded Python 3

File details

Details for the file adpa-0.1.5.tar.gz.

File metadata

  • Download URL: adpa-0.1.5.tar.gz
  • Upload date:
  • Size: 126.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.9

File hashes

Hashes for adpa-0.1.5.tar.gz
Algorithm Hash digest
SHA256 3d2158064d9c983a93f87142ba2cee68f1260fcd1fd98d2df3cf2390b7eaf01a
MD5 f763aef9d33b152d86c3c3d0211dc4bf
BLAKE2b-256 57fc9857575d4fee2f3afa1f00a62c252649307d602f80ea03e457069c273dca

See more details on using hashes here.

File details

Details for the file adpa-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: adpa-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 183.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.9

File hashes

Hashes for adpa-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 b6fef0a97b34964dca07b793d4c5f9ad5b91533dd384b21291b61d6f1012e010
MD5 29e6c36175a67475a177b38bda5105c3
BLAKE2b-256 22bd1b2d58a71f8951589a483d197a972e497f29a7bfbe72ccc33810079eb5cf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page