Skip to main content

Online File Transfer Optimization

Project description

Falcon: Online File Transfers Optimization

The application can only correctly function on Linux-based operating systems due to several Linux-based functional dependencies.

Installation

You can install the falcon-datamover package from PyPI:

pip install falcon-datamover

or

python3 -m pip install falcon-datamover

The Falcon package is supported on Python 3.6 and above.

Usage

Falcon is a command line application. please run help to find required arguments

$ falcon --help
usage: falcon [-h] [--host HOST] [--port PORT] [--data_dir DATA_DIR] [--method METHOD] [--max_cc MAX_CC] [--direct DIRECT] [--checksum CHECKSUM] agent

positional arguments:
agent                Please choose agent type: sender or receiver

optional arguments:
-h, --help           show this help message and exit
--host HOST          Receiver host address; default: 127.0.0.1
--port PORT          Receiver port number; default: 50021
--data_dir DATA_DIR  data directory of sender or receiver
--method METHOD      choose one of them : gradient, probe
--max_cc MAX_CC      maximum concurrency
--direct DIRECT      enable direct I/O
--checksum CHECKSUM  enable checksum verification

for example: on the receiver node:

$ falcon receiver --host 10.10.1.2 --port 5000 --data_dir /data/dest/

similarly, on the sender node:

$ falcon sender --host 10.10.1.2 --port 5000 --data_dir /data/src/ --method probe

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

falcon-datamover-1.0.8.tar.gz (12.2 kB view hashes)

Uploaded Source

Built Distribution

falcon_datamover-1.0.8-py3-none-any.whl (12.5 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page