Pandas DataFrame Service (DFS).
Project description
Pandas DataFrame Service (DFS)
Features
* Simple, ~100 lines multi-threaded file cache implementation
* Key-value store for Panda DataFrames with basic index querying
* Fixed budget memory consumption w/ LRU eviction
* Supports updates on files and dataframes
* Simple TCP client/server interface w/ client-side connection pooling
Limitations
1. Currently does not support replication, though the file system can be (e.g. NAS)
Usage
Install
$ pip3 install dataframe-service
Start server
$ dfs_server
Serving on 0.0.0.0 port 8000 with max memory 1073741824 at root directory <current dir>
Run DFS REPL
$ rlwrap dfs_repl
Welcome to DFS REPL
author: Brian Guarraci
repo : https://github.com/briangu/dfs
crtl-c to quit
?> stats
{
"memory": {
"used": "0",
"free": "1073741824",
"max": "1073741824"
}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataframe-service-0.1.13.tar.gz
(10.4 kB
view details)
Built Distribution
File details
Details for the file dataframe-service-0.1.13.tar.gz
.
File metadata
- Download URL: dataframe-service-0.1.13.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7afd755b79403ae1e6142d764cc6f9d766eef8d9be7520b2f15c9cc870037da9 |
|
MD5 | 4969a39516656206b151ea04249a0e58 |
|
BLAKE2b-256 | f92d43dea88ff37b34acbe74943c2d4c9236df97b5da34d8ba8530cf56fb3a17 |
File details
Details for the file dataframe_service-0.1.13-py3-none-any.whl
.
File metadata
- Download URL: dataframe_service-0.1.13-py3-none-any.whl
- Upload date:
- Size: 12.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | fa20e37e510de6dfb67aa3b5e909c2c6560baf96a218c89990415fa88bc8ac4f |
|
MD5 | ea02114444446608b8d3abce6dc7e654 |
|
BLAKE2b-256 | 9b94c3b3bc0108894d1479a59f9d11cbaf95c50a92a86db35de65f0528708a9b |