Skip to main content

PEP 249-compliant Python connector for CData Connect AI — live SQL access to 350+ enterprise data sources

Project description

ConnectAI Python Connector

CData Connect AI is a managed data layer providing live, governed access to 350+ enterprise data sources — Salesforce, SAP, Snowflake, Dynamics, and more. This PEP 249-compliant Python connector enables querying and writing via standard SQL through the Connect AI REST API. No ETL, no stale exports — just real-time data directly in your pipeline. Passthrough authentication inherits existing enterprise permissions.

A Python DB-API 2.0 (PEP 249) compliant connector for CData Connect AI. Query any data source connected through Connect AI using the standard Python database interface.

Installation

pip install cdata-connect-ai

For pandas integration:

pip install "cdata-connect-ai[full]"

Quick Start

import cdata_connect_ai

conn = cdata_connect_ai.connect(
    base_url="https://cloud.cdata.com/api/",
    username="you@example.com",
    password="<your_personal_access_token>",
)

cursor = conn.cursor()
cursor.execute("SELECT * FROM [Salesforce1].[Salesforce].[Account]")
rows = cursor.fetchall()
for row in rows:
    print(row)

conn.close()

Configuration File

Use a PyHOCON config file to keep credentials out of code:

# config.conf
cdata_api_db {
  base_url = "https://cloud.cdata.com/api/"
  username = "you@example.com"
  password = "<your_personal_access_token>"
}
conn = cdata_connect_ai.connect(config_path="config.conf")

Parameterized Queries

cursor.execute(
    "SELECT * FROM [DB].[public].[users] WHERE city = %(city)s LIMIT %(limit)s",
    {"city": "New York", "limit": 10},
)

Batch Operations

cursor.executemany(
    "INSERT INTO [DB].[public].[cities] (city, id) VALUES (@city, @id)",
    [
		{"@city": {"dataType": 5, "value": "New York"}, "@id": {"dataType": 8, "value": 1}},
		{"@city": {"dataType": 5, "value": "London"},   "@id": {"dataType": 8, "value": 2}},
    ],
)

Stored Procedures

cursor.callproc("[DB].[public].[my_procedure]", ("arg1", "arg2"))
rows = cursor.fetchall()

Connection Options

Parameter Description Default
base_url Connect AI API base URL https://cloud.cdata.com/api
username Authentication username
password Personal access token
config_path Path to PyHOCON config file
workspace Connect AI workspace name
timeout HTTP request timeout (seconds) 90
max_retries Retries on transient 5xx errors 3
retry_delay Base delay between retries (seconds) 1.0

DB-API 2.0 Compliance

Attribute Value
apilevel "2.0"
threadsafety 1
paramstyle "pyformat"

Supported methods: connect(), cursor(), execute(), executemany(), callproc(), fetchone(), fetchmany(), fetchall(), close(), commit(), rollback()

Exception Hierarchy

cdata_connect_ai.Error
├── InterfaceError
└── DatabaseError
    ├── DataError
    ├── OperationalError
    ├── IntegrityError
    ├── InternalError
    ├── ProgrammingError
    └── NotSupportedError

Requirements

  • Python >= 3.10
  • requests >= 2.28.0
  • ijson >= 3.1.0
  • pyhocon >= 0.3.60

Running Tests

Tests are split into unit (no server) and integration (mock server auto-starts).

pip install -e ".[dev]"

# Unit tests only — fast, no server needed
pytest tests/unit/ -v

# Integration tests — mock server auto-starts on localhost
pytest tests/integration/ -v

# All tests
pytest tests/ -v

# Run against a live Connect AI endpoint
CDATA_BASE_URL=https://cloud.cdata.com/api \
CDATA_USERNAME=you@example.com \
CDATA_PASSWORD=<pat> \
SKIP_LIVE_TESTS=0 \
pytest tests/integration/ -v

See tests/README.md for test organization details.

Test Environment Variables

Variable Description Default
CDATA_BASE_URL API endpoint http://localhost:8080/api
CDATA_USERNAME Auth username test@example.com
CDATA_PASSWORD Auth password / PAT any_token
MOCK_PORT Mock server port 8080
MOCK_SERVER_DIR Path to mock server ../connect-ai-mock
SKIP_LIVE_TESTS Skip live API tests 1

Building from Source

Install the build tool:

pip install build

Build both the wheel and source distribution from the connector/ directory:

cd connector
python -m build

Artifacts are written to connector/dist/:

dist/
├── cdata_connect_ai-1.0.0-py3-none-any.whl   # Wheel (preferred for install)
└── cdata_connect_ai-1.0.0.tar.gz             # Source distribution

Install the locally built wheel:

pip install dist/cdata_connect_ai-1.0.0-py3-none-any.whl

Publishing to PyPI

pip install twine

# Verify the package metadata before uploading
twine check dist/*

# Upload to PyPI
twine upload dist/*

Store your PyPI credentials in ~/.pypirc or pass them as environment variables:

# ~/.pypirc
[pypi]
username = __token__
password = pypi-<your-api-token>

For the full automated release flow (staging via Azure Artifacts → smoke test → PyPI), see RELEASING.md.

Demo Client

A demo script at the repo root (client_demo.py) exercises the connector end-to-end against the mock server. It covers:

  • SELECT with fetchall, fetchone, and fetchmany
  • cursor.description (column metadata)
  • Parameterized queries (pyformat)
  • Batch INSERT via executemany and SELECT to verify
  • DELETE and confirm empty result
  • Stored procedure via callproc
  • Error handling (OperationalError on bad host)

Step 1 — Start the mock server (in one terminal):

cd connect-ai-mock
pip install -r requirements.txt
python run.py
# Server ready at http://localhost:8080

Step 2 — Install the connector and run the demo (in another terminal):

# Install from PyPI
pip install cdata-connect-ai

# OR install the locally built wheel
pip install connector/dist/cdata_connect_ai-1.0.0-py3-none-any.whl

# Run
python client_demo.py

Expected output covers all 9 demo sections and ends with All done.

License

MIT — see LICENSE

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cdata_connect_ai-1.1.0.tar.gz (67.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cdata_connect_ai-1.1.0-py3-none-any.whl (17.4 kB view details)

Uploaded Python 3

File details

Details for the file cdata_connect_ai-1.1.0.tar.gz.

File metadata

  • Download URL: cdata_connect_ai-1.1.0.tar.gz
  • Upload date:
  • Size: 67.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for cdata_connect_ai-1.1.0.tar.gz
Algorithm Hash digest
SHA256 1cac6c0c351c6a18ebce11f811392b5be14b5f6e66162f62b4fcd569ae07ae01
MD5 85930936a6e0c78ef69284789220f977
BLAKE2b-256 e27ea4607df8b0d2631b8cdf65d9b3a16ec6da983026aa56b302ce5e2a730063

See more details on using hashes here.

File details

Details for the file cdata_connect_ai-1.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for cdata_connect_ai-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a85a7c5519eda127254e1ee2831b34a859ac4d7028e14aa26085540ba737b2b0
MD5 3d89e7c09ae80a973e2dc47c84ac2444
BLAKE2b-256 1b80eb72aaaf90a8a031d4d30895e2c56de0d6b859c9296099736c45b8ce93b2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page