Skip to main content

isA_Data

Cloud Data Analytics & Processing Center

🎯 Purpose

独立的数据分析云服务,处理数据处理、分析、可视化等任务。 从 isA_MCP/tools/services/data_analytics_service 迁移而来,提供 API 服务。

🏗️ Architecture

isA_Data/
├── app/
│   ├── main.py                    # FastAPI 主服务
│   ├── config.py                  # 配置管理
│   └── api/
│       ├── analytics.py           # 数据分析端点
│       ├── processing.py          # 数据处理端点
│       └── visualization.py       # 数据可视化端点
│
├── services/
│   ├── analytics/                 # [迁移自 isA_MCP]
│   │   ├── pandas_ops.py          # Pandas 操作
│   │   ├── statistical.py         # 统计分析
│   │   └── ml_analysis.py         # ML 分析
│   │
│   ├── processing/
│   │   ├── etl.py                 # ETL 处理
│   │   ├── cleaning.py            # 数据清洗
│   │   └── transformation.py      # 数据转换
│   │
│   └── storage/
│       ├── database.py            # 数据库操作
│       └── cache.py               # 缓存管理
│
├── core/
│   ├── logging.py
│   └── clients/
│       └── model_client.py        # ISA Model 客户端
│
├── deployment/
│   ├── docker/
│   │   └── Dockerfile
│   └── kubernetes/
│       └── deployment.yaml
│
├── tests/
│   └── test_analytics.py
│
├── requirements.txt
└── README.md

📡 API Endpoints

Data Analytics

POST /api/v1/data/analyze
POST /api/v1/data/statistics
POST /api/v1/data/ml/predict

Data Processing

POST /api/v1/data/clean
POST /api/v1/data/transform
POST /api/v1/data/aggregate

Data Visualization

POST /api/v1/data/visualize/chart
POST /api/v1/data/visualize/dashboard

📦 Install (PyPI)

isa-data is published to PyPI — install it as an SDK to consume the canonical data-product contracts and the lifted data-product DevEx engines:

pip install "isa-data>=1.0.1"

Use >=1.0.1: 1.0.0 eagerly imported intelligent_query_service → deltalake (not a dependency), so the lightweight dataphin engines failed to import; #457 made that import lazy.

Data-product DevEx kit (consumed by towers, e.g. sn_commercial_tower)

The SDK ships the tower-agnostic engines a tower delegates to (see docs/data-products/tower-onboarding.md and ADR-0006):

from isa_data.contracts.data_products import build_artifact_inventory, ArtifactSurfaceSpec
from isa_data.services.data_fabric_service.federation.dataphin.scaffolding import scaffold
from isa_data.services.data_fabric_service.federation.dataphin.handoff import generate_handoff
from isa_data.services.data_fabric_service.federation.dataphin.deploy import build_plan_from_contract
from isa_data.services.product_spec.deploy_contract import load_ct_contract

Privileged Data Product stages use the canonical secret-free authorization contract and group lifecycle client documented in docs/data-products/access-authorization.md:

from isa_data.contracts.data_products import compile_access_intent
from isa_data.services.data_product_authorization import DataProductAuthorizationClient

These import without the heavy data-infra stack (deltalake/duckdb) — that is pulled only if you use IntelligentQueryService.

🚀 Usage

As Standalone Service

# Start server (FastAPI app)
uvicorn isa_data.main:app --host 0.0.0.0 --port 8084

# Or with Docker
docker-compose up

Called from isA_MCP

# isA_MCP 中通过 API 调用
from tools.services.data_analytics_service import ISA_Data_Client

client = ISA_Data_Client(base_url="http://localhost:8001")
result = await client.analyze_data(
    data=df,
    analysis_type="descriptive"
)

💡 Benefits

  1. 专注: 专门处理数据相关任务
  2. 性能: 可以部署在大内存机器上处理大数据
  3. 隔离: 数据处理故障不影响 MCP 主服务
  4. 可复用: 多个服务都可以调用数据分析能力
  5. 扩展: 未来可以添加更多数据源和分析能力

🔄 Migration Status

  • Phase 1: 基础架构搭建
  • Phase 2: 迁移 data_analytics 模块
  • Phase 3: FastAPI 端点实现
  • Phase 4: 数据库集成
  • Phase 5: isA_MCP 集成测试
  • Phase 6: 生产部署

🔗 Related Projects

  • isA_MCP: MCP 工具层(API 调用端)
  • isA_OS: Web & OS 操作云服务
  • isA_Model: 模型服务

Release files for isa-data 1.6.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for isa-data 1.6.0
File Size Uploaded
isa_data-1.6.0.tar.gz 20.2 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for isa-data 1.6.0
File Interpreter ABI Platform
isa_data-1.6.0-py3-none-any.whl Python 3 none any Details

Total release size: 40.9 MB

Release files / isa_data-1.6.0.tar.gz

Download URL isa_data-1.6.0.tar.gz
Size 20.2 MB
Tags Source
SHA-256 checksum
How to use checksums
317978d333921db4dc862e1dbf87f2c0fba13ce28e591d307492cd30ae1b25c3
BLAKE2b-256 checksum
How to use checksums
5092fdcd9f5e1d8b939cbc02b74bf2e16446c6df9700c4b70dda65dd67d34cc7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release files / isa_data-1.6.0-py3-none-any.whl

Download URL isa_data-1.6.0-py3-none-any.whl
Size 20.7 MB
Tags Python 3
SHA-256 checksum
How to use checksums
5a1fa2c1d69a463561aa5a10efd36dbd284271a8dc9c77238109c499bf9e2afa
BLAKE2b-256 checksum
How to use checksums
7d81aeca98de098fddc8fe5239bc11d6b8e9f018e88f5283db61431d3303080c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release history Release notifications | RSS feed

1.6.21

2 release files

1.6.20

2 release files

1.6.19

2 release files

1.6.18

2 release files

1.6.17

2 release files

1.6.16

2 release files

1.6.15

2 release files

1.6.14

2 release files

1.6.13

2 release files

1.6.12

2 release files

1.6.11

2 release files

1.6.10

2 release files

1.6.9

2 release files

1.6.8

2 release files

1.6.7

2 release files

1.6.6

2 release files

1.6.5

2 release files

1.6.4

2 release files

1.6.3

2 release files

1.6.2

2 release files

1.6.1

2 release files

This release

1.6.0 This release

2 release files

1.5.0

2 release files

1.4.0

2 release files

1.3.0

2 release files

1.2.5

2 release files

1.2.4

2 release files

1.2.3

2 release files

1.2.0

2 release files

1.0.7

2 release files

1.0.6

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page