Skip to main content

- ReadME updated.

Project description

🚗 Analytics Ingest Client

A lightweight Python library to batch and send automotive telemetry — like signals, DTCs, GPS, and network stats — to a GraphQL backend.


🔧 Features

  • Python 3.11+ support
  • Clean, single-class interface: IcsAnalytics
  • In-memory caching for resolved IDs
  • Smart batching (by time, count, or signal limit)
  • Async-safe request queuing (1 request at a time)
  • Minimal dependencies
  • Easy to integrate and test
  • Supports Signals, DTCs, GPS, and Network Stats ingestion

📦 Installation

pip install analytics-ingest

🚀 Quick Usage

from analytics_ingest import IcsAnalytics

client = IcsAnalytics(
    device_id=123,
    vehicle_id=456,
    fleet_id=789,
    org_id=1011,
    graphql_endpoint="https://your-backend/graphql",
    batch_size=100,
    batch_interval_seconds=10,
    max_signal_count=100
)

# Add a signal
client.add_signal({
    'name': 'VehicleIdentificationNumber',
    'unit': '',
    'messageName': 'BusQuery_IDDecoding_F190_VSSAL', 
    'networkName': 'Cluster_6_TestTool',
    'ecuName': '',
    'arbId': '',
    'fileId': '1234',
    'paramType': 'TEXT',
    'signalType': 'DID',
    'messageDate': '2025-07-15T01:40:00.000000',
    'paramId': 'F190',
    'data': [{
        'value': 0.04,
        'time': '1970-01-07T18:28:54Z',
        'svalue':''
    }, # more data objects
    ]
})

# Add DTCs
client.add_dtc({
    'messageName': 'DTC Message99B049',
    'name': 'DTC Message99B049',
    'networkName': 'Cluster_6_TestTool',
    'ecuName': 'VCU_Android_GAS',
    'ecuId': '14DA80F1',
    'messageDate': '2025-07-15T01:42:20.385429',
    'fileId': '1234',
    'data': [{
        'dtcId': 'B19B0-49',
        'description': 'Head-Up Display - Internal Electronic Failure',
        'status': '2F',
        'time': '2025-07-15T01:42:15.979524'
    }, # more data objects. 
    ]
})

# Add GPS
client.add_gps({
    "time": "2025-07-28T12:34:56.789Z",
    "latitude": 37.7749,
    "longitude": -122.4194,
    "accuracy": 10.5,
    "altitude": 120.3,
    "speed": 45.2,
    "bearing": 75.0,
    "available": {
        "accuracy": True,
        "altitude": True,
        "bearing": False,
        "speed": True,
        "time": True
    }
})

# Add Network Stats
client.add_network_stats({
    "name": "CAN1",
    "vehicleId": 456,
    "uploadId": 1,
    "totalMessages": 1000,
    "matchedMessages": 950,
    "unmatchedMessages": 50,
    "errorMessages": 0,
    "longMessageParts": 0,
    "rate": 500.0
})

client.add_network_stats({
    'name': 'jacobs',
    'vehicleId': 9539366,
    'uploadId': 4255,
    'totalMessages': 222,
    'matchedMessages': 139,
    'unmatchedMessages': 0,
    'errorMessages': 27,
    'longMessageParts': 21,
    'maxTime': '2025-08-01T11:06:53.947Z',
    'minTime': '2025-08-01T11:06:53.947Z',
    'rate': 59.44
})

# Flush remaining data before exit
client.flush()
client.close()

⚙️ Config Options

Set through constructor or environment variables.

Param Description Default
device_id Device ID (required)
vehicle_id Vehicle ID (required)
fleet_id Fleet ID (required)
org_id Org ID (required)
graphql_endpoint GraphQL endpoint
batch_size Max items per batch 100
batch_interval_seconds Time-based flush interval 10
max_signal_count Max signals before flush 100

🛠️ Error Handling & Logging

  • Raises exceptions for bad input or backend failures
  • Use logging instead of print in production
  • Automatically retries failed batches on next interval

🧪 Testing

Run all tests:

PYTHONPATH=src python3 -m unittest discover -s tests -v

Build and publish:

rm -rf dist/
python3 -m build
python -m twine upload dist/*

💡 Improvements & Roadmap

  • Full async API support
  • Runtime config updates
  • More usage examples
  • Metrics & monitoring hooks
  • Linting/type-checking in CI

🤝 Contributing

We welcome PRs and issues! Please follow PEP8 and include tests with any changes.

One-Time Setup

pip install pre-commit
pre-commit install

🏁 Dev Quick Start

git clone http://lustra.intrepidcs.corp/ics/wivi/ipa-py-library.git
cd analytics-ingest

# Setup virtual environment
python3.11 -m venv venv3.11
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install dependencies
# Uses pyproject.toml – no requirements.txt
pip install -e .[dev]

Test ingestion logic:

PYTHONPATH=src python3 test_auto_flush_by_signal_count.py

📄 License

MIT License Readme.txt 4 KB

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

analytics_ingest-0.1.72.tar.gz (20.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

analytics_ingest-0.1.72-py3-none-any.whl (23.6 kB view details)

Uploaded Python 3

File details

Details for the file analytics_ingest-0.1.72.tar.gz.

File metadata

  • Download URL: analytics_ingest-0.1.72.tar.gz
  • Upload date:
  • Size: 20.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for analytics_ingest-0.1.72.tar.gz
Algorithm Hash digest
SHA256 e83ce211bfbb7e17aaa1add686b5a42d1ccc3d0de1e32767461e4d46c2236c42
MD5 8c9e9ebc7e64950542c05fe260f9d165
BLAKE2b-256 2de6d5445f76ef626b2e0a95033c256d47900cc1d89525b2dce0df1f5cc37da5

See more details on using hashes here.

File details

Details for the file analytics_ingest-0.1.72-py3-none-any.whl.

File metadata

File hashes

Hashes for analytics_ingest-0.1.72-py3-none-any.whl
Algorithm Hash digest
SHA256 c1c05db1abdcb375efbfa5f809696ad69e3801cb9388bb6806b7a1cd7c74225d
MD5 257d8e4aeb0571e3e86045d7dcf96c30
BLAKE2b-256 74a5e2bafbc979f0af0454366b2e52dfa0ce312463b1f6e92a6900a5c3973d3c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page