Skip to main content

n23 - data acquisition and processing framework

Project description

N23 is data acquisition and processing framework, optimized for Internet of Things and edge computing.

The framework is designed for programmers who want to implement applications on top of it.

Features

  • scheduler to asynchronously obtain data from sockets, sensors, devices and other data sources

  • flexible and efficient storage of data in a timeseries database

  • build applications using Python or Lisp (Hylang) API

  • configure applications using Lisp (Hylang) syntax; use macros for templating

  • based on Python asynchronous coroutines minimizing resource use and avoiding cost of context switching of threads

Scheduler

The scheduler performs parallel data reads, both event-driven and on regular basis. When reading data on regular basis, the time drift is minimized, for example data read every second shall produce sixty data points within one minute.

Storage

N23 framework provides default storage mechanism using PostgreSQL RDBMS with TimescaleDB extension. It supports multiple data types, compression, and chunking. This allows to use efficiently the available storage.

PostgreSQL without TimescaleDB extension can be used for small databases.

The TimescaleDB based storage is optional and any other system can be used. A system with very good asyncio support is recommended.

Analytics

The data can be analyzed and visualized with any popular tool supporting connection to the PostgreSQL RDBMS. For example, querying PostgreSQL database is possible with Python and R languages.

Demo Applications

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

n23-0.9.1.tar.gz (41.0 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page