Skip to main content

GFAL2-compatible CLI tools based on fsspec (HTTP/HTTPS and XRootD)

Project description

gfal-cli

A Python reimplementation of the gfal2-util command-line tools, built on fsspec. Supports local files, HTTP/HTTPS, and XRootD (root://).

Installation

From PyPI

pip install gfal-cli

From Native Repository (Recommended for Updates)

Enable the repository to receive automatic updates via dnf update or apt upgrade.

YUM (AlmaLinux / RHEL)

sudo curl -sL -o /etc/yum.repos.d/gfal-cli.repo https://lobis.github.io/gfal-cli/rpm/gfal-cli.repo
sudo dnf install -y python3-gfal-cli

APT (Ubuntu / Debian)

Add the repository:

echo "deb [trusted=yes] https://lobis.github.io/gfal-cli/deb/ stable main" | sudo tee /etc/apt/sources.list.d/gfal-cli.list
sudo apt-get update
sudo apt-get install -y python3-gfal-cli

After installation the following commands are available on your PATH:

Command Description
gfal-ls List directory contents
gfal-cp / gfal-copy Copy files
gfal-rm Remove files or directories
gfal-mkdir Create directories
gfal-stat Display file status
gfal-cat Print file contents to stdout
gfal-save Write stdin to a remote file
gfal-rename Rename / move a file
gfal-chmod Change file permissions
gfal-sum Compute file checksums
gfal-xattr Get or set extended attributes

Quick start

All commands accept any URL that fsspec understands. Local paths must be given as file:// URIs.

# Stat a local file
gfal-stat file:///tmp/test.txt

# List a remote HTTP directory
gfal-ls https://example.com/data/

# Copy a file from XRootD to local
gfal-cp root://eosuser.cern.ch//eos/user/j/jdoe/file.root file:///tmp/file.root

# Copy with checksum verification
gfal-cp -K ADLER32 root://server//path/src.dat file:///tmp/dst.dat

# Recursive copy
gfal-cp -r root://server//path/srcdir/ file:///tmp/dstdir/

# Remove a directory tree
gfal-rm -r file:///tmp/old_dir/

# Compute a checksum
gfal-sum file:///tmp/file.root ADLER32

Command reference

gfal-ls

gfal-ls [OPTIONS] URI [URI ...]
Option Description
-l Long listing (permissions, size, date)
-a / --all Show hidden files (names starting with .)
-d / --directory List the entry itself, not its contents
-H / --human-readable Human-readable sizes with -l (e.g. 1.2M)
-r / --reverse Reverse sort order
--time-style Timestamp format: locale (default), iso, long-iso, full-iso
--full-time Equivalent to --time-style=full-iso
--color Colorise output: auto (default), always, never
gfal-ls -lH root://server//eos/data/
gfal-ls -la file:///tmp/mydir/
gfal-ls -l --time-style=full-iso https://example.com/files/

gfal-cp / gfal-copy

gfal-cp [OPTIONS] SRC [SRC ...] DST
Option Description
-f / --force Overwrite destination if it exists
-r / -R / --recursive Copy directories recursively
-p / --parent Create parent directories at destination as needed
-K ALG / --checksum ALG Verify checksum after copy (ADLER32, MD5, SHA256, …)
--checksum-mode both (default), source, target
--dry-run Show what would be copied without copying
--from-file FILE Read source URIs from a file (one per line)
--abort-on-failure Stop after the first failed transfer
--transfer-timeout N Per-file timeout in seconds (0 = no timeout)
--tpc Attempt third-party copy, fall back to streaming
--tpc-only Require third-party copy (fail if unsupported)
# Simple copy
gfal-cp file:///tmp/src.txt https://server/dst.txt

# Force overwrite with ADLER32 verification
gfal-cp -f -K ADLER32 root://server//path/file.root file:///tmp/file.root

# Recursive copy, create parents
gfal-cp -r -p root://server//eos/srcdir/ file:///tmp/dstdir/

# Third-party copy between two XRootD servers
gfal-cp --tpc root://src-server//path/file root://dst-server//path/file

gfal-rm

gfal-rm [OPTIONS] URI [URI ...]
Option Description
-r / -R / --recursive Remove directories and their contents
--dry-run Show what would be deleted without deleting
--from-file FILE Read URIs to delete from a file
--just-delete Skip the stat check and delete directly
gfal-rm file:///tmp/old.txt
gfal-rm -r root://server//eos/old_dir/
gfal-rm --dry-run root://server//eos/dir/     # preview only

gfal-stat

gfal-stat URI [URI ...]

Prints POSIX-style stat information (size, permissions, timestamps):

  File: 'root://server//eos/data/file.root'
  Size: 1048576        regular file
Access: (0644/-rw-r--r--)      Uid: 1000   Gid: 1000
Access: 2025-06-01 12:34:56.000000
Modify: 2025-06-01 12:34:56.000000
Change: 2025-06-01 12:34:56.000000

gfal-mkdir

gfal-mkdir [OPTIONS] URI [URI ...]
Option Description
-p / --parents Create intermediate parent directories; no error if already exists
-m MODE Permissions in octal (default: 755)
gfal-mkdir root://server//eos/user/j/jdoe/newdir
gfal-mkdir -p root://server//eos/user/j/jdoe/a/b/c

gfal-sum

gfal-sum URI ALGORITHM

Supported algorithms: ADLER32, CRC32, CRC32C, MD5, SHA1, SHA256, SHA512.

gfal-sum file:///tmp/file.root ADLER32
# file:///tmp/file.root 0a1b2c3d

gfal-cat

gfal-cat URI [URI ...]

Prints file contents to stdout. Multiple files are concatenated.

gfal-save

gfal-save URI

Reads from stdin and writes to the given URI.

echo "hello" | gfal-save root://server//eos/user/j/jdoe/hello.txt

gfal-rename

gfal-rename SOURCE DESTINATION

gfal-chmod

gfal-chmod MODE URI [URI ...]

MODE is an octal permission string, e.g. 0644 or 755.

Common options

Every command accepts these global flags:

Option Description
-v / --verbose Enable verbose output
-t N / --timeout N Global timeout in seconds
-E CERT / --cert CERT Path to client certificate (PEM)
--key KEY Path to client key (PEM)
--no-verify Disable TLS certificate verification
--log-file FILE Write log output to a file

Authentication

X.509 proxy (XRootD / HTTPS): If X509_USER_PROXY is set or a proxy exists at /tmp/x509up_u<uid>, it is used automatically. Override with -E/--key.

HTTPS client certificates: Pass --cert and --key for mutual TLS authentication.

Development

git clone https://github.com/lobis/gfal-cli.git
cd gfal-cli

python -m venv .venv
source .venv/bin/activate

pip install -e ".[dev]"
pytest tests/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gfal_cli-0.1.25.tar.gz (99.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gfal_cli-0.1.25-py3-none-any.whl (43.0 kB view details)

Uploaded Python 3

File details

Details for the file gfal_cli-0.1.25.tar.gz.

File metadata

  • Download URL: gfal_cli-0.1.25.tar.gz
  • Upload date:
  • Size: 99.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for gfal_cli-0.1.25.tar.gz
Algorithm Hash digest
SHA256 30a3f023142f39646efcfeb51303e2f84aece0fc5906473ad07745b7ec2dbd2e
MD5 8689052dce5515d106da2358ce2ab32e
BLAKE2b-256 27c7f1a28a6933019133693ea49d4be2c63e6305f1eb7afe7337a55a5b5a92e9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gfal_cli-0.1.25.tar.gz:

Publisher: publish.yml on lobis/gfal-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gfal_cli-0.1.25-py3-none-any.whl.

File metadata

  • Download URL: gfal_cli-0.1.25-py3-none-any.whl
  • Upload date:
  • Size: 43.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for gfal_cli-0.1.25-py3-none-any.whl
Algorithm Hash digest
SHA256 2e30d4c6220d8c3b73b2d732af5b1f55bf24a510bb4bbefdbb88bdbcf729e583
MD5 1b5f4a6a4d942d36f80a2af3509bd616
BLAKE2b-256 247a2feb8050ad0bf7200d82fc3dafd9dcf5fbbe86aeeef962c9dd8a8b836a9c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gfal_cli-0.1.25-py3-none-any.whl:

Publisher: publish.yml on lobis/gfal-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page