PyDFS
Distributed File System written in Python.
Installation
pip install dfspy
Usage
PyDFS is Centralized Distributed File System, which means there is a master and slave nodes. The current implementation assumes that the system has only one master node and many slave nodes.
PyDFS supports command line interface (CLI) to interact with it. There are 2 groups of the commands (like Docker Management Commands):
pydfs init- to initialize, manage and sync nodespydfs dfs- to interact with DFS itself (put/get data to/from it)
Let's take a closer look at these commands.
init commands
With pydfs init command you can initialize master and slave nodes - it's pretty simple:
pydfs init masterpydfs init slave --master_ip [IP]
dfs commands
pydfs dfs put --path [PATH] --master_ip [IP]pydfs dfs get --path [PATH] --master_ip [IP]
other commands
pydfs --versionpydfs --info
Docker
You can also use docker-compose to run multi-container application with:
- 1 master node
- 2 slave nodes
- 2 user nodes
docker-compose up --build
Requirements
Python >= 3.7
Citation
If you use PyDFS in a scientific publication, we would appreciate references to the following BibTex entry:
@misc{silkwayai2022pydfs,
author = {Dani El-Ayyass and Artem Fomin},
title = {Distributed File System written in Python},
howpublished = {\url{https://github.com/silkway-ai/pydfs}},
year = {2022}
}
Metadata
Release files for dfspy 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| dfspy-0.1.0.tar.gz | 6.8 kB | Without provenance | Details for dfspy-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| dfspy-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for dfspy-0.1.0-py3-none-any.whl |
Total release size: 20.5 kB
Release files / dfspy-0.1.0.tar.gz
| Download URL | dfspy-0.1.0.tar.gz |
|---|---|
| Size | 6.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2fd238cf5c5d4e5d7504f53f355659c19df3323e632dcbe4a226952b76792498
|
|
BLAKE2b-256 checksum How to use checksums |
7b5a6352f6b18c764b4e8f13232170bab68c81ec811ae6c52163ca43255780de
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.7.5
|
Release files / dfspy-0.1.0-py3-none-any.whl
| Download URL | dfspy-0.1.0-py3-none-any.whl |
|---|---|
| Size | 13.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
07e5b3523caecb8210d22e13d72b81b75eb9a6a42e6c0023fff7a2a16faad6c3
|
|
BLAKE2b-256 checksum How to use checksums |
e33954685a2c2bf24b3ae7c2154d221d56ca890623399675f35fb1458674fdfb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.7.5
|
Security for dfspy 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.