Skip to main content

Pandas DataFrame Service (DFS).

Project description

Pandas DataFrame Service (DFS)

Features

* Simple, ~100 lines multi-threaded file cache implementation
* Key-value store for Panda DataFrames with basic index querying
* Fixed budget memory consumption w/ LRU eviction
* Supports updates on files and dataframes
* Simple TCP client/server interface w/ client-side connection pooling

Limitations

1. Currently does not support replication, though the file system can be (e.g. NAS)

Usage

Install

$ pip3 install dataframe-service 

Start server

$ dfs_server
Serving on 0.0.0.0 port 8000 with max memory 1073741824 at root directory <current dir>

Run DFS REPL

$ rlwrap dfs_repl
Welcome to DFS REPL
author: Brian Guarraci
repo  : https://github.com/briangu/dfs
crtl-c to quit

?> stats
{
  "memory": {
    "used": "0",
    "free": "1073741824",
    "max": "1073741824"
  }
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataframe-service-0.1.13.tar.gz (10.4 kB view hashes)

Uploaded Source

Built Distribution

dataframe_service-0.1.13-py3-none-any.whl (12.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page