pynndb2 2.2.8

Database library for Python based on LMDB storage engine

PYNNDB2 - Python Native Nosql DataBase library

This is version 2 of the Python NoSQL database library, for more complete documentation please visit https://pynndb.madpenguin.uk or browse around the source code in this repository.

Please note that this library should be backwards compatible with V1 with regards to databases but NOT the API. The API has been reworked so you will need to modify any existing applications in order to use V2. The changes are more semantic than structural and upgrading should not be too onerous. Also, there are new features in V2 which are not available in V1, so once you've started using a database with the V2 library, it's probably best not to move backwards, although if you've not used compression or full function indexes, moving back should be ok.

PyNNDB is a NoSQL Database library implemented in Python utilising the LMDB key-value storage store for back-end functionality. Although there might be an immediate perception that this idea might result in something that is a little "slow", it consists of a python layer backed by a powerful engine written in 'C', much like other popular Python database solutions and as a result generally compares favourably.

The idea of database logic coded in Python came about after many years of using both SQL and NoSQL databases with Python to write Cloud based microservices and coming across issued that were difficult to address with current main-stream solutions. Notably, it became apparent that the performance bottleneck in these applications ended up being in the Python layer between the application and the back-end database, a layer often added as a compatibility options to allow Python applications to access the database. This raised the question, "what if we pick a faster back-end, and make this Python layer a first-class component rather than an after-thought?"

Features

• NoSQL database library written in Python using the LMDB C-extension as a base KV store
• Primary ObjectId() based indexes for all objects
• Mutiple secondary indexes based on Python functions, supporting unique and duplicates
• Transparent compression / decompression (currently zStd and Snappy)
• Powerful and flexible search routines
• Designed to work in a multi-processor environment / multiprocessing IPC
• Inherits the features of LMDB including ACID transaction processing

Notes

• IF you are upgrading from 2.0 to 2.1 please be aware that the format of ObjectId has changed, so if your code relies on the ordering of ObjectId and you work with persistent data, you will probably want to rewrite your data with the new ObjectId for consistency.

About the code

Version 2 is coded for Python 3.7+ and makes use of Python3's new "typing" module with a view to self-documentation. All of the API documentation (and many of the examples) are documented automatically 100% from source code using the documentation routes contained within this repository, for example;

If you have problems or spot any bugs, please feel free to log an issue on the Bug Tracker or alternatively connect on Keybase