Skip to main content

PyDFS

Distributed File System written in Python.

Installation

pip install dfspy

Usage

PyDFS is Centralized Distributed File System, which means there is a master and slave nodes. The current implementation assumes that the system has only one master node and many slave nodes.

PyDFS supports command line interface (CLI) to interact with it. There are 2 groups of the commands (like Docker Management Commands):

  • pydfs init - to initialize, manage and sync nodes
  • pydfs dfs - to interact with DFS itself (put/get data to/from it)

Let's take a closer look at these commands.

init commands

With pydfs init command you can initialize master and slave nodes - it's pretty simple:

  • pydfs init master
  • pydfs init slave --master_ip [IP]

dfs commands

  • pydfs dfs put --path [PATH] --master_ip [IP]
  • pydfs dfs get --path [PATH] --master_ip [IP]

other commands

  • pydfs --version
  • pydfs --info

Docker

You can also use docker-compose to run multi-container application with:

  • 1 master node
  • 2 slave nodes
  • 2 user nodes
docker-compose up --build

Requirements

Python >= 3.7

Citation

If you use PyDFS in a scientific publication, we would appreciate references to the following BibTex entry:

@misc{silkwayai2022pydfs,
    author       = {Dani El-Ayyass and Artem Fomin},
    title        = {Distributed File System written in Python},
    howpublished = {\url{https://github.com/silkway-ai/pydfs}},
    year         = {2022}
}

Metadata

Release files for dfspy 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dfspy 0.1.0
File Size Uploaded Provenance Actions
dfspy-0.1.0.tar.gz 6.8 kB Without provenance Details for dfspy-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for dfspy 0.1.0
File Interpreter ABI Platform Actions
dfspy-0.1.0-py3-none-any.whl Python 3 none any Details for dfspy-0.1.0-py3-none-any.whl

Total release size: 20.5 kB

Release files / dfspy-0.1.0.tar.gz

Download URL dfspy-0.1.0.tar.gz
Size 6.8 kB
Tags Source
SHA-256 checksum
How to use checksums
2fd238cf5c5d4e5d7504f53f355659c19df3323e632dcbe4a226952b76792498
BLAKE2b-256 checksum
How to use checksums
7b5a6352f6b18c764b4e8f13232170bab68c81ec811ae6c52163ca43255780de
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.5

Release files / dfspy-0.1.0-py3-none-any.whl

Download URL dfspy-0.1.0-py3-none-any.whl
Size 13.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
07e5b3523caecb8210d22e13d72b81b75eb9a6a42e6c0023fff7a2a16faad6c3
BLAKE2b-256 checksum
How to use checksums
e33954685a2c2bf24b3ae7c2154d221d56ca890623399675f35fb1458674fdfb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.5

Security for dfspy 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page