MCP-Agentic-Data-Engineering
conda create -p venv python==3.11 -y
conda activate venv/
docker compose up
- stdio : used for terminal based application
- sse: used for non terminal based application like fastapi, flask etc
For stdio protocol (MCP-Server)
python mcp_server/stdio/mcp_server.py
For stdio protocol (MCP-Client)
python mcp_client/stdio/mcp_client.py
For sse protocol (MCP-Server)
python mcp_server/sse/mcp_server.py
For sse protocol (MCP-Client)
uvicorn mcp_client.sse.mcp_client:app --reload --port 3030
Following Functionalities this Agentic DE can perform
1. Upload & Ingest Data
Prompt Example: Upload CSVs to MySQL
Upload all CSVs from the `data` folder into MySQL. Use filenames as table names.
Prompt Example: Upload JSON to MongoDB
Upload `customers.json` from the `data` folder to the `test_data` collection in the `coke` database.
2. Modify & Update Data
Prompt Example: Update MySQL Tables
Set `is_active = 0` for users where `age > 60` in the `users` table.
Prompt Example: Update MongoDB Documents
Update all documents in the MongoDB database "coke" inside the "coke_collection1" collection where the customer_id is 101. Set the name field to "Manmeet".
3. Manage S3-Like Object Stores
Prompt Example: Create S3 Buckets (MinIO)
Create a new S3 bucket for staging reports and log the creation in Jira.
Prompt Example: Move Files Across Buckets
Move all data from `raw-bucket/sales/` to `processed-bucket/sales-clean/`.
4. Automate Workflows with Airflow
Prompt Example: Schedule Python Code as Airflow DAG
Run this every day at 8 AM:
import pandas as pd
df = pd.read_csv("s3://raw-bucket/sales.csv")
df.to_csv("s3://processed-bucket/cleaned_sales.csv")
5. Ticketing & Task Logging
Prompt Example: Auto-Create Jira Tickets
Raise a Jira ticket for uploading sales data and verifying transformation completeness.
Enjoy Coding!
Metadata
Release files for agentic-de 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| agentic-de-0.1.0.tar.gz | 2.6 kB | Without provenance | Details for agentic-de-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| agentic_de-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for agentic_de-0.1.0-py3-none-any.whl |
Total release size: 5.9 kB
Release files / agentic-de-0.1.0.tar.gz
| Download URL | agentic-de-0.1.0.tar.gz |
|---|---|
| Size | 2.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
df32cb48543031ea4e2a12524310e0dd09300a28a276bc7a3f3f61c0a54de559
|
|
BLAKE2b-256 checksum How to use checksums |
7b799b3fbd6fbcf0c5f834ce0bb8b2f70030a77d4ce9d87225ef883354ab0080
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.0
|
Release files / agentic_de-0.1.0-py3-none-any.whl
| Download URL | agentic_de-0.1.0-py3-none-any.whl |
|---|---|
| Size | 3.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
04c780e9236cee9d7da91baa788ae32d796c825805c5cbd58d32151e2108599d
|
|
BLAKE2b-256 checksum How to use checksums |
e206181232ba819a8972361aa0e42adb0c98bb95473a511e5762524de3f0108b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.0
|
Security for agentic-de 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.