Skip to main content

GFAL2-compatible CLI tools based on fsspec (HTTP/HTTPS and XRootD)

Project description

gfal-cli

A Python reimplementation of the gfal2-util command-line tools, built on fsspec. Supports local files, HTTP/HTTPS, and XRootD (root://).

Installation

From PyPI

pip install gfal-cli

From Native Repository (Recommended for Updates)

Enable the repository to receive automatic updates via dnf update or apt upgrade.

YUM (AlmaLinux / RHEL)

sudo curl -sL -o /etc/yum.repos.d/gfal-cli.repo https://lobis.github.io/gfal-cli/rpm/gfal-cli.repo
sudo dnf install -y python3-gfal-cli

APT (Ubuntu / Debian)

Add the repository:

echo "deb [trusted=yes] https://lobis.github.io/gfal-cli/repo/deb/ stable main" | sudo tee /etc/apt/sources.list.d/gfal-cli.list
sudo apt-get update
sudo apt-get install -y python3-gfal-cli

After installation the following commands are available on your PATH:

Command Description
gfal-ls List directory contents
gfal-cp / gfal-copy Copy files
gfal-rm Remove files or directories
gfal-mkdir Create directories
gfal-stat Display file status
gfal-cat Print file contents to stdout
gfal-save Write stdin to a remote file
gfal-rename Rename / move a file
gfal-chmod Change file permissions
gfal-sum Compute file checksums
gfal-xattr Get or set extended attributes

Quick start

All commands accept any URL that fsspec understands. Local paths must be given as file:// URIs.

# Stat a local file
gfal-stat file:///tmp/test.txt

# List a remote HTTP directory
gfal-ls https://example.com/data/

# Copy a file from XRootD to local
gfal-cp root://eosuser.cern.ch//eos/user/j/jdoe/file.root file:///tmp/file.root

# Copy with checksum verification
gfal-cp -K ADLER32 root://server//path/src.dat file:///tmp/dst.dat

# Recursive copy
gfal-cp -r root://server//path/srcdir/ file:///tmp/dstdir/

# Remove a directory tree
gfal-rm -r file:///tmp/old_dir/

# Compute a checksum
gfal-sum file:///tmp/file.root ADLER32

Command reference

gfal-ls

gfal-ls [OPTIONS] URI [URI ...]
Option Description
-l Long listing (permissions, size, date)
-a / --all Show hidden files (names starting with .)
-d / --directory List the entry itself, not its contents
-H / --human-readable Human-readable sizes with -l (e.g. 1.2M)
-r / --reverse Reverse sort order
--time-style Timestamp format: locale (default), iso, long-iso, full-iso
--full-time Equivalent to --time-style=full-iso
--color Colorise output: auto (default), always, never
gfal-ls -lH root://server//eos/data/
gfal-ls -la file:///tmp/mydir/
gfal-ls -l --time-style=full-iso https://example.com/files/

gfal-cp / gfal-copy

gfal-cp [OPTIONS] SRC [SRC ...] DST
Option Description
-f / --force Overwrite destination if it exists
-r / -R / --recursive Copy directories recursively
-p / --parent Create parent directories at destination as needed
-K ALG / --checksum ALG Verify checksum after copy (ADLER32, MD5, SHA256, …)
--checksum-mode both (default), source, target
--dry-run Show what would be copied without copying
--from-file FILE Read source URIs from a file (one per line)
--abort-on-failure Stop after the first failed transfer
--transfer-timeout N Per-file timeout in seconds (0 = no timeout)
--tpc Attempt third-party copy, fall back to streaming
--tpc-only Require third-party copy (fail if unsupported)
# Simple copy
gfal-cp file:///tmp/src.txt https://server/dst.txt

# Force overwrite with ADLER32 verification
gfal-cp -f -K ADLER32 root://server//path/file.root file:///tmp/file.root

# Recursive copy, create parents
gfal-cp -r -p root://server//eos/srcdir/ file:///tmp/dstdir/

# Third-party copy between two XRootD servers
gfal-cp --tpc root://src-server//path/file root://dst-server//path/file

gfal-rm

gfal-rm [OPTIONS] URI [URI ...]
Option Description
-r / -R / --recursive Remove directories and their contents
--dry-run Show what would be deleted without deleting
--from-file FILE Read URIs to delete from a file
--just-delete Skip the stat check and delete directly
gfal-rm file:///tmp/old.txt
gfal-rm -r root://server//eos/old_dir/
gfal-rm --dry-run root://server//eos/dir/     # preview only

gfal-stat

gfal-stat URI [URI ...]

Prints POSIX-style stat information (size, permissions, timestamps):

  File: 'root://server//eos/data/file.root'
  Size: 1048576        regular file
Access: (0644/-rw-r--r--)      Uid: 1000   Gid: 1000
Access: 2025-06-01 12:34:56.000000
Modify: 2025-06-01 12:34:56.000000
Change: 2025-06-01 12:34:56.000000

gfal-mkdir

gfal-mkdir [OPTIONS] URI [URI ...]
Option Description
-p / --parents Create intermediate parent directories; no error if already exists
-m MODE Permissions in octal (default: 755)
gfal-mkdir root://server//eos/user/j/jdoe/newdir
gfal-mkdir -p root://server//eos/user/j/jdoe/a/b/c

gfal-sum

gfal-sum URI ALGORITHM

Supported algorithms: ADLER32, CRC32, CRC32C, MD5, SHA1, SHA256, SHA512.

gfal-sum file:///tmp/file.root ADLER32
# file:///tmp/file.root 0a1b2c3d

gfal-cat

gfal-cat URI [URI ...]

Prints file contents to stdout. Multiple files are concatenated.

gfal-save

gfal-save URI

Reads from stdin and writes to the given URI.

echo "hello" | gfal-save root://server//eos/user/j/jdoe/hello.txt

gfal-rename

gfal-rename SOURCE DESTINATION

gfal-chmod

gfal-chmod MODE URI [URI ...]

MODE is an octal permission string, e.g. 0644 or 755.

Common options

Every command accepts these global flags:

Option Description
-v / --verbose Enable verbose output
-t N / --timeout N Global timeout in seconds
-E CERT / --cert CERT Path to client certificate (PEM)
--key KEY Path to client key (PEM)
--no-verify Disable TLS certificate verification
--log-file FILE Write log output to a file

Authentication

X.509 proxy (XRootD / HTTPS): If X509_USER_PROXY is set or a proxy exists at /tmp/x509up_u<uid>, it is used automatically. Override with -E/--key.

HTTPS client certificates: Pass --cert and --key for mutual TLS authentication.

Development

git clone https://github.com/lobis/gfal-cli.git
cd gfal-cli

python -m venv .venv
source .venv/bin/activate

pip install -e ".[dev]"
pytest tests/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gfal_cli-0.1.24.tar.gz (99.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gfal_cli-0.1.24-py3-none-any.whl (43.0 kB view details)

Uploaded Python 3

File details

Details for the file gfal_cli-0.1.24.tar.gz.

File metadata

  • Download URL: gfal_cli-0.1.24.tar.gz
  • Upload date:
  • Size: 99.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for gfal_cli-0.1.24.tar.gz
Algorithm Hash digest
SHA256 7774cc11499aa289d447629b8054026d042e66cc35082e5e6b6a694c124985cf
MD5 a00d75eec50024a0f2e3d58b14505e8f
BLAKE2b-256 f3b77fbf476adef157df1d62c6911ddf88905c42cf0bec90721f4c550b06c4da

See more details on using hashes here.

Provenance

The following attestation bundles were made for gfal_cli-0.1.24.tar.gz:

Publisher: publish.yml on lobis/gfal-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gfal_cli-0.1.24-py3-none-any.whl.

File metadata

  • Download URL: gfal_cli-0.1.24-py3-none-any.whl
  • Upload date:
  • Size: 43.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for gfal_cli-0.1.24-py3-none-any.whl
Algorithm Hash digest
SHA256 9c2d3dda773bbea186b687c98a0b1b32e1e98549bc974f3412000dc3eea97ddf
MD5 cb95039630460fa25e85ee438c004f24
BLAKE2b-256 25d9d47f5c490700cc6edac5a5e5e3f165513ed5edf70d8bd5d3d1ecd3270ce7

See more details on using hashes here.

Provenance

The following attestation bundles were made for gfal_cli-0.1.24-py3-none-any.whl:

Publisher: publish.yml on lobis/gfal-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page