Skip to main content

Pandas DataFrame Service (DFS).

Project description

Pandas DataFrame Service (DFS)

Features

* Simple, ~100 lines multi-threaded file cache implementation
* Key-value store for Panda DataFrames with basic index querying
* Fixed budget memory consumption w/ LRU eviction
* Supports updates on files and dataframes
* Simple TCP client/server interface w/ client-side connection pooling

Limitations

1. Currently does not support replication, though the file system can be (e.g. NAS)

Usage

Install

$ pip3 install dataframe-service 

Start server

$ dfs_server
Serving on 0.0.0.0 port 8000 with max memory 1073741824 at root directory <current dir>

Run DFS REPL

$ rlwrap dfs_repl
Welcome to DFS REPL
author: Brian Guarraci
repo  : https://github.com/briangu/dfs
crtl-c to quit

?> stats
{
  "memory": {
    "used": "0",
    "free": "1073741824",
    "max": "1073741824"
  }
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataframe-service-0.1.13.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

dataframe_service-0.1.13-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file dataframe-service-0.1.13.tar.gz.

File metadata

  • Download URL: dataframe-service-0.1.13.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for dataframe-service-0.1.13.tar.gz
Algorithm Hash digest
SHA256 7afd755b79403ae1e6142d764cc6f9d766eef8d9be7520b2f15c9cc870037da9
MD5 4969a39516656206b151ea04249a0e58
BLAKE2b-256 f92d43dea88ff37b34acbe74943c2d4c9236df97b5da34d8ba8530cf56fb3a17

See more details on using hashes here.

File details

Details for the file dataframe_service-0.1.13-py3-none-any.whl.

File metadata

File hashes

Hashes for dataframe_service-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 fa20e37e510de6dfb67aa3b5e909c2c6560baf96a218c89990415fa88bc8ac4f
MD5 ea02114444446608b8d3abce6dc7e654
BLAKE2b-256 9b94c3b3bc0108894d1479a59f9d11cbaf95c50a92a86db35de65f0528708a9b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page