Skip to main content

n23 - data acquisition and processing framework

Project description

N23 is data acquisition and processing framework, optimized for Internet of Things and edge computing.

The framework is designed for programmers who want to implement applications on top of it.

Features

  • scheduler to asynchronously obtain data from sockets, sensors, devices and other data sources

  • flexible and efficient storage of data in a timeseries database

  • build applications using Python or Lisp (Hylang) API

  • configure applications using Lisp (Hylang) syntax; use macros for templating

  • based on Python asynchronous coroutines minimizing resource use and avoiding cost of context switching of threads

Scheduler

The scheduler performs parallel data reads, both event-driven and on regular basis. When reading data on regular basis, the time drift is minimized, for example data read every second shall produce sixty data points within one minute.

Storage

N23 framework provides default storage mechanism using PostgreSQL RDBMS with TimescaleDB extension. It supports multiple data types, compression, and chunking. This allows to use efficiently the available storage.

PostgreSQL without TimescaleDB extension can be used for small databases.

The TimescaleDB based storage is optional and any other system can be used. A system with very good asyncio support is recommended.

Analytics

The data can be analyzed and visualized with any popular tool supporting connection to the PostgreSQL RDBMS. For example, querying PostgreSQL database is possible with Python and R languages.

Demo Applications

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

n23-0.9.1.tar.gz (41.0 kB view details)

Uploaded Source

File details

Details for the file n23-0.9.1.tar.gz.

File metadata

  • Download URL: n23-0.9.1.tar.gz
  • Upload date:
  • Size: 41.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.1.dev0+g94f810c.d20240510 CPython/3.12.5

File hashes

Hashes for n23-0.9.1.tar.gz
Algorithm Hash digest
SHA256 f7c23eef079321cd6a71535edfb1c4d787fff7ea3f5fb94df5c8ca56f31a23e0
MD5 af67422f518ba29ba14524f58c36e198
BLAKE2b-256 226254dbb5bb7e1f06d0fda7b4fae697929251d528518f46b5ac24bfb6513d99

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page