Skip to main content

Pandas DataFrame Service (DFS)

Features

* Simple, ~100 lines multi-threaded file cache implementation
* Key-value store for Panda DataFrames with basic index querying
* Fixed budget memory consumption w/ LRU eviction
* Supports updates on files and dataframes
* Simple TCP client/server interface w/ client-side connection pooling

Limitations

1. Currently does not support replication, though the file system can be (e.g. NAS)

Usage

Install

$ pip3 install dataframe-service 

Start server

$ dfs_server
Serving on 0.0.0.0 port 8000 with max memory 1073741824 at root directory <current dir>

Run DFS REPL

$ rlwrap dfs_repl
Welcome to DFS REPL
author: Brian Guarraci
repo  : https://github.com/briangu/dfs
crtl-c to quit

?> stats
{
  "memory": {
    "used": "0",
    "free": "1073741824",
    "max": "1073741824"
  }
}

Metadata

Release files for dataframe-service 0.1.13

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dataframe-service 0.1.13
File Size Uploaded
dataframe-service-0.1.13.tar.gz 10.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dataframe-service 0.1.13
File Interpreter ABI Platform
dataframe_service-0.1.13-py3-none-any.whl Python 3 none any Details

Total release size: 23.0 kB

Release files / dataframe-service-0.1.13.tar.gz

Download URL dataframe-service-0.1.13.tar.gz
Size 10.4 kB
Tags Source
SHA-256 checksum
How to use checksums
7afd755b79403ae1e6142d764cc6f9d766eef8d9be7520b2f15c9cc870037da9
BLAKE2b-256 checksum
How to use checksums
f92d43dea88ff37b34acbe74943c2d4c9236df97b5da34d8ba8530cf56fb3a17
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.10.9

Release files / dataframe_service-0.1.13-py3-none-any.whl

Download URL dataframe_service-0.1.13-py3-none-any.whl
Size 12.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fa20e37e510de6dfb67aa3b5e909c2c6560baf96a218c89990415fa88bc8ac4f
BLAKE2b-256 checksum
How to use checksums
9b94c3b3bc0108894d1479a59f9d11cbaf95c50a92a86db35de65f0528708a9b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.10.9

Release history Release notifications | RSS feed

This release

0.1.13 This release

2 release files

0.1.12

2 release files

0.1.11

2 release files

0.1.10

2 release files

0.1.9

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page