Pandas DataFrame Service (DFS).
Project description
Pandas DataFrame Service (DFS)
Features
* Simple, ~100 lines multi-threaded file cache implementation
* Key-value store for Panda DataFrames with basic index querying
* Fixed budget memory consumption w/ LRU eviction
* Supports updates on files and dataframes
* Simple TCP client/server interface w/ client-side connection pooling
Limitations
1. Currently does not support replication, though the file system can be (e.g. NAS)
Usage
Install
$ pip3 install dataframe-service
Start server
$ dfs_server
Serving on 0.0.0.0 port 8000 with max memory 1073741824 at root directory <current dir>
Run DFS REPL
$ rlwrap dfs_repl
Welcome to DFS REPL
author: Brian Guarraci
repo : https://github.com/briangu/dfs
crtl-c to quit
?> stats
{
"memory": {
"used": "0",
"free": "1073741824",
"max": "1073741824"
}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataframe-service-0.1.13.tar.gz
(10.4 kB
view hashes)
Built Distribution
Close
Hashes for dataframe_service-0.1.13-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fa20e37e510de6dfb67aa3b5e909c2c6560baf96a218c89990415fa88bc8ac4f |
|
MD5 | ea02114444446608b8d3abce6dc7e654 |
|
BLAKE2b-256 | 9b94c3b3bc0108894d1479a59f9d11cbaf95c50a92a86db35de65f0528708a9b |