Skip to main content

GFAL2-compatible CLI tools based on fsspec (HTTP/HTTPS and XRootD)

Project description

gfal-cli

A Python reimplementation of the gfal2-util command-line tools, built on fsspec. Supports local files, HTTP/HTTPS, and XRootD (root://).

Installation

From PyPI

pip install gfal-cli

From Native Repository (Recommended for Updates)

Enable the repository to receive automatic updates via dnf update or apt upgrade.

YUM (AlmaLinux / RHEL)

sudo curl -sL -o /etc/yum.repos.d/gfal-cli.repo https://lobis.github.io/gfal-cli/rpm/gfal-cli.repo
sudo dnf install -y python3-gfal-cli

APT (Ubuntu / Debian)

Add the repository:

echo "deb [trusted=yes] https://lobis.github.io/gfal-cli/repo/deb/ stable main" | sudo tee /etc/apt/sources.list.d/gfal-cli.list
sudo apt-get update
sudo apt-get install -y python3-gfal-cli

After installation the following commands are available on your PATH:

Command Description
gfal-ls List directory contents
gfal-cp / gfal-copy Copy files
gfal-rm Remove files or directories
gfal-mkdir Create directories
gfal-stat Display file status
gfal-cat Print file contents to stdout
gfal-save Write stdin to a remote file
gfal-rename Rename / move a file
gfal-chmod Change file permissions
gfal-sum Compute file checksums
gfal-xattr Get or set extended attributes

Quick start

All commands accept any URL that fsspec understands. Local paths must be given as file:// URIs.

# Stat a local file
gfal-stat file:///tmp/test.txt

# List a remote HTTP directory
gfal-ls https://example.com/data/

# Copy a file from XRootD to local
gfal-cp root://eosuser.cern.ch//eos/user/j/jdoe/file.root file:///tmp/file.root

# Copy with checksum verification
gfal-cp -K ADLER32 root://server//path/src.dat file:///tmp/dst.dat

# Recursive copy
gfal-cp -r root://server//path/srcdir/ file:///tmp/dstdir/

# Remove a directory tree
gfal-rm -r file:///tmp/old_dir/

# Compute a checksum
gfal-sum file:///tmp/file.root ADLER32

Command reference

gfal-ls

gfal-ls [OPTIONS] URI [URI ...]
Option Description
-l Long listing (permissions, size, date)
-a / --all Show hidden files (names starting with .)
-d / --directory List the entry itself, not its contents
-H / --human-readable Human-readable sizes with -l (e.g. 1.2M)
-r / --reverse Reverse sort order
--time-style Timestamp format: locale (default), iso, long-iso, full-iso
--full-time Equivalent to --time-style=full-iso
--color Colorise output: auto (default), always, never
gfal-ls -lH root://server//eos/data/
gfal-ls -la file:///tmp/mydir/
gfal-ls -l --time-style=full-iso https://example.com/files/

gfal-cp / gfal-copy

gfal-cp [OPTIONS] SRC [SRC ...] DST
Option Description
-f / --force Overwrite destination if it exists
-r / -R / --recursive Copy directories recursively
-p / --parent Create parent directories at destination as needed
-K ALG / --checksum ALG Verify checksum after copy (ADLER32, MD5, SHA256, …)
--checksum-mode both (default), source, target
--dry-run Show what would be copied without copying
--from-file FILE Read source URIs from a file (one per line)
--abort-on-failure Stop after the first failed transfer
--transfer-timeout N Per-file timeout in seconds (0 = no timeout)
--tpc Attempt third-party copy, fall back to streaming
--tpc-only Require third-party copy (fail if unsupported)
# Simple copy
gfal-cp file:///tmp/src.txt https://server/dst.txt

# Force overwrite with ADLER32 verification
gfal-cp -f -K ADLER32 root://server//path/file.root file:///tmp/file.root

# Recursive copy, create parents
gfal-cp -r -p root://server//eos/srcdir/ file:///tmp/dstdir/

# Third-party copy between two XRootD servers
gfal-cp --tpc root://src-server//path/file root://dst-server//path/file

gfal-rm

gfal-rm [OPTIONS] URI [URI ...]
Option Description
-r / -R / --recursive Remove directories and their contents
--dry-run Show what would be deleted without deleting
--from-file FILE Read URIs to delete from a file
--just-delete Skip the stat check and delete directly
gfal-rm file:///tmp/old.txt
gfal-rm -r root://server//eos/old_dir/
gfal-rm --dry-run root://server//eos/dir/     # preview only

gfal-stat

gfal-stat URI [URI ...]

Prints POSIX-style stat information (size, permissions, timestamps):

  File: 'root://server//eos/data/file.root'
  Size: 1048576        regular file
Access: (0644/-rw-r--r--)      Uid: 1000   Gid: 1000
Access: 2025-06-01 12:34:56.000000
Modify: 2025-06-01 12:34:56.000000
Change: 2025-06-01 12:34:56.000000

gfal-mkdir

gfal-mkdir [OPTIONS] URI [URI ...]
Option Description
-p / --parents Create intermediate parent directories; no error if already exists
-m MODE Permissions in octal (default: 755)
gfal-mkdir root://server//eos/user/j/jdoe/newdir
gfal-mkdir -p root://server//eos/user/j/jdoe/a/b/c

gfal-sum

gfal-sum URI ALGORITHM

Supported algorithms: ADLER32, CRC32, CRC32C, MD5, SHA1, SHA256, SHA512.

gfal-sum file:///tmp/file.root ADLER32
# file:///tmp/file.root 0a1b2c3d

gfal-cat

gfal-cat URI [URI ...]

Prints file contents to stdout. Multiple files are concatenated.

gfal-save

gfal-save URI

Reads from stdin and writes to the given URI.

echo "hello" | gfal-save root://server//eos/user/j/jdoe/hello.txt

gfal-rename

gfal-rename SOURCE DESTINATION

gfal-chmod

gfal-chmod MODE URI [URI ...]

MODE is an octal permission string, e.g. 0644 or 755.

Common options

Every command accepts these global flags:

Option Description
-v / --verbose Enable verbose output
-t N / --timeout N Global timeout in seconds
-E CERT / --cert CERT Path to client certificate (PEM)
--key KEY Path to client key (PEM)
--no-verify Disable TLS certificate verification
--log-file FILE Write log output to a file

Authentication

X.509 proxy (XRootD / HTTPS): If X509_USER_PROXY is set or a proxy exists at /tmp/x509up_u<uid>, it is used automatically. Override with -E/--key.

HTTPS client certificates: Pass --cert and --key for mutual TLS authentication.

Development

git clone https://github.com/lobis/gfal-cli.git
cd gfal-cli

python -m venv .venv
source .venv/bin/activate

pip install -e ".[dev]"
pytest tests/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gfal_cli-0.1.23.tar.gz (99.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gfal_cli-0.1.23-py3-none-any.whl (43.0 kB view details)

Uploaded Python 3

File details

Details for the file gfal_cli-0.1.23.tar.gz.

File metadata

  • Download URL: gfal_cli-0.1.23.tar.gz
  • Upload date:
  • Size: 99.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for gfal_cli-0.1.23.tar.gz
Algorithm Hash digest
SHA256 f1ec6698e5507f9ad11bdff804020f30071cbf3d087d1e084122d74d46107a7d
MD5 65f7c7df50451dd1f9560b67fd00c337
BLAKE2b-256 1310d0c725357b1eeba0d5a1ec4b71aed379f17fc7810d2b6dde4b3446525b0f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gfal_cli-0.1.23.tar.gz:

Publisher: publish.yml on lobis/gfal-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gfal_cli-0.1.23-py3-none-any.whl.

File metadata

  • Download URL: gfal_cli-0.1.23-py3-none-any.whl
  • Upload date:
  • Size: 43.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for gfal_cli-0.1.23-py3-none-any.whl
Algorithm Hash digest
SHA256 da35a7822d65048eb29affa229de65fd436f351675b75b8c786ab56ddfe4a1c2
MD5 52e817710ef0100512536682d9d3cefa
BLAKE2b-256 d6ec1b7680b7558588c36c1847e33cfb23262f99953b213e2fa47221b9299fbc

See more details on using hashes here.

Provenance

The following attestation bundles were made for gfal_cli-0.1.23-py3-none-any.whl:

Publisher: publish.yml on lobis/gfal-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page