Skip to main content

edgemodelkit: A Python library for seamless sensor data acquisition and logging.

Project description

EdgeModelKit: Sensor Data Acquisition and Logging Library

EdgeModelKit is a Python library developed by EdgeNeuron, designed to simplify sensor data acquisition, logging, and real-time processing for IoT devices. It works seamlessly with the DataLogger script from the EdgeNeuron Arduino library, making it ideal for edge computing and machine learning applications.


Features

  • Serial Communication: Supports data acquisition over serial ports with robust error handling.
  • Flexible Data Fetching: Retrieve sensor data as Python lists or NumPy arrays.
  • Customizable Logging: Log sensor data into CSV files with optional timestamps and counters.
  • Class-Based Organization: Log data with class labels to prepare datasets for machine learning tasks.
  • Error Handling: Gracefully handles data decoding errors and missing keys in sensor data packets.

Usage Prerequisites

This library is designed to work in conjunction with the DataLogger script available in the EdgeNeuron Arduino library. The DataLogger script configures your Arduino-based IoT device to send structured JSON sensor data over a serial connection.

Before using EdgeModelKit, ensure:

  1. Your Arduino device is programmed with the DataLogger script from the EdgeNeuron Arduino library.
  2. The device is connected to your system via a serial interface.

Installation

Install EdgeModelKit using pip:

pip install edgemodelkit

Quick Start

1. Initialize the DataFetcher

from edgemodelkit import DataFetcher

# Initialize the DataFetcher with the desired serial port and baud rate
fetcher = DataFetcher(serial_port="COM3", baud_rate=9600)

2. Fetch Sensor Data

# Fetch data as a Python list
sensor_data = fetcher.fetch_data(return_as_numpy=False)
print("Sensor Data:", sensor_data)

# Fetch data as a NumPy array
sensor_data_numpy = fetcher.fetch_data(return_as_numpy=True)
print("Sensor Data (NumPy):", sensor_data_numpy)

3. Log Sensor Data

# Log 10 samples to a CSV file with timestamp and count columns
fetcher.log_sensor_data(class_label="ClassA", num_samples=10, add_timestamp=True, add_count=True)

CSV Logging Details

The CSV file is generated automatically based on the sensor name (e.g., TemperatureSensor_data_log.csv) and contains the following:

  • Timestamp: (Optional) Records the time when the data was logged.
  • Sample Count: (Optional) A sequential counter for each data sample.
  • Data Columns: Each element in the sensor data array is stored in separate columns (e.g., data_value_1, data_value_2, ...).

The data is saved under a folder named Dataset, with subfolders organized by class_label (if specified).


Real-Time Data Processing Example

from edgemodelkit import DataFetcher

fetcher = DataFetcher(serial_port="COM3", baud_rate=9600)

try:
    while True:
        # Fetch data as NumPy array
        sensor_data = fetcher.fetch_data(return_as_numpy=True)
        print("Received Data:", sensor_data)

        # Perform custom processing (e.g., feed to a TensorFlow model)
        # prediction = model.predict(sensor_data)
        # print("Prediction:", prediction)
finally:
    fetcher.close_connection()

Using ModelPlayGround

1. Initialize the ModelPlayGround

from edgemodelkit import ModelPlayGround

# Initialize the ModelPlayGround with the path to your .keras model
playground = ModelPlayGround(model_path="path_to_your_model.keras")

2. View Model Summary

# Display the model architecture
playground.model_summary()

3. View Model Statistics

# View model size and number of parameters
playground.model_stats()

4. Convert Model to TensorFlow Lite

# Convert the model to TFLite format with default quantization
playground.model_converter(quantization_type="default")

# Convert the model to TFLite format with float16 quantization
playground.model_converter(quantization_type="float16")

# Convert the model to TFLite format with int8 quantization
playground.model_converter(quantization_type="int8")

5. Test TFLite Model on Live Data

from edgemodelkit import DataFetcher

# Initialize a DataFetcher
fetcher = DataFetcher(serial_port="COM3", baud_rate=9600)

# Perform live testing of the TFLite model
prediction = playground.edge_testing(tflite_model_path="path_to_tflite_model.tflite", data_fetcher=fetcher)
print("Model Prediction:", prediction)

Disclaimer

Currently, the ModelPlayGround class supports only .keras models for conversion and testing. Support for other model formats may be added in future updates.


Contributing

We welcome contributions to EdgeModelKit! Feel free to submit bug reports, feature requests, or pull requests on our GitHub repository.


License

EdgeModelKit is licensed under the MIT License. See the LICENSE file for details.


Support

For support and inquiries, contact us at support@edgeneuronai.com or visit our GitHub repository.


About EdgeNeuron

EdgeNeuron is a pioneer in edge computing solutions, enabling developers to build intelligent IoT applications with state-of-the-art tools and libraries. Learn more at edgeneuronai.com.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

edgemodelkit-1.0.1.tar.gz (6.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

edgemodelkit-1.0.1-py3-none-any.whl (6.7 kB view details)

Uploaded Python 3

File details

Details for the file edgemodelkit-1.0.1.tar.gz.

File metadata

  • Download URL: edgemodelkit-1.0.1.tar.gz
  • Upload date:
  • Size: 6.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for edgemodelkit-1.0.1.tar.gz
Algorithm Hash digest
SHA256 2821a0470083419a6020fb127e72f181b1da6ff5d2ffce95d3f88be0b2c3cad5
MD5 a8893070a77cc1ebddd70fbfbfec1ad0
BLAKE2b-256 f20637a0ca08e21940cb834fdd2bd69b3e84ee1d9a7a7c60304246aa5fd485e9

See more details on using hashes here.

File details

Details for the file edgemodelkit-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: edgemodelkit-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 6.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for edgemodelkit-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8171174c1e46120a47946eeb173e7d1012fcf1db17fa877449ffce70b327689f
MD5 465d81133970eed51cd8d379e6e1bece
BLAKE2b-256 0d7a52f787aa269ab87f4989fc37fc6ddd664106d6f327551eaad07c6876d925

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page