f2r

Command line tool to create RPMs out of aliBuild output.

Prerequisites

  • aliBuild 1.16.0 or higher (writes .meta.json in the install directories)
  • Optional: To enable S3 support you need to create a config file under ~/.s3cfg, see CERN IT instructions
  • gem + fpm: yum install rubygems -y ; gem install fpm

Installation

To just install the tool: python3 -m pip install f2r

OR

Use flp-release-server role from system-configuration to fully provision a build server.

Quickstart

Build packages using aliBuild, eg:

aliBuild build O2Suite --defaults o2-dataflow --always-prefer-system

Then create RPMs providing the package and version as found under sw/<architecture>/:

f2r generate --package O2Suite --version latest-o2-dataflow

Validate created RPMs (this requires sudo):

f2r validate

Create YUM repo:

f2r repo

and sync it to S3:

f2r sync

CLI options

Simple run f2r -h to see all available options

Developers documentation

Software lifecycle

  • Make changes and merge MR when lint and tests pass
  • Bump version in pyproject.toml
  • Push a git tag matching the version: the release CI job builds the sdist and wheel with python3 -m build and uploads them to PyPI
  • Update build server using pip

Simple description of the logic

Creates tree of dependencies by recursively iterating over "alidist" recipes. It disables certain packages based on selected "defaults". It retrieves versioning information from the .meta.json file that aliBuild writes in each install directory (sw/<architecture>/<package>/<version>/.meta.json), which lists the direct runtime and build dependencies resolved for that build.

It is capable of generating "devel" RPMs. In such case, in addition to runtime dependencies, it also packs build dependencies, with the versions recorded in .meta.json.

A dependency listed in the recipe but not recorded in .meta.json was not built by aliBuild and is treated as a system dependency. Definitions in (devel|runtime).slc*.yaml translate system dependencies into a list of RPM packages.

Then, it uses fpm tool to generate RPMs.

When the requested top-level package is O2Suite, it additionally generates the dependency-free o2-flp-suite-buildinfo RPM, which ships /etc/o2.d/FLP_suite_alidist_revision with the full alidist commit SHA the suite was built from (taken from .meta.json, falling back to the alidist checkout HEAD). The RPM version is the commit's committer date (YYYYMMDDHHMM, UTC) and its release starts with the short SHA, so newer alidist revisions are dnf-visible upgrades and regeneration from the same revision is idempotent.

Development setup

cd flp-to-rpm
python3 -m venv env
source env/bin/activate
python3 -m pip install -e '.[dev]'

The editable install exposes the f2r command and picks up code changes without reinstalling.

Lint and unit tests

Run from the repository root:

ruff check .
ruff format --check .
python3 -m unittest discover tests

# Run a single test:
python3 -m unittest tests.testPackage.TestPackage.test_deps_with_versions

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (3.2.0)

Owner

PyPI data
Data sourced directly from PyPI's database.

Credits

Author: Barthelemy von Haller

License expression

GPL-3.0-only
View SPDX License List

Requires

Python >=3.9

Provides Extra

dev

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

f2r-3.1.0.tar.gz (30.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

f2r-3.1.0-py3-none-any.whl (34.5 kB view details)

Uploaded Python 3

File details

Details for the file f2r-3.1.0.tar.gz.

File metadata

  • Download URL: f2r-3.1.0.tar.gz
  • Upload date:
  • Size: 30.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.14

File hashes

Hashes for f2r-3.1.0.tar.gz
Algorithm Hash digest
SHA256 92b51165ba3513b08841a888b93f5d17f9fb498f13dcbecfb8f5595cab3025d1
MD5 9a085ab97d8d1e426b243e337c2291a2
BLAKE2b-256 fb899b53cc0f2560b12f142a5fca99cc3c6da0f27f9e7e121c5bdf3cc6d12f2c

See more details on using hashes here.

File details

Details for the file f2r-3.1.0-py3-none-any.whl.

File metadata

  • Download URL: f2r-3.1.0-py3-none-any.whl
  • Upload date:
  • Size: 34.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.14

File hashes

Hashes for f2r-3.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 52d0c825297a4e504977a4441e6dab64d744c27ba10ff5027a0ce61ab9fe655f
MD5 297793c0416f3490b52da4eb70e54a24
BLAKE2b-256 1cf2266e6f650459c4e410cf023d35a4f16eb98e680090913205a5f095b77af5

See more details on using hashes here.

Release history Release notifications | RSS feed

3.2.0

2 files

This release

3.1.0 This release

2 files

3.0.3

2 files

3.0.2

2 files

3.0.1

2 files

3.0.0

2 files

2.13.0

2 files

2.12.0

2 files

2.11.0

2 files

2.10.0

2 files

2.9.0

2 files

2.8.3

2 files

2.8.2

2 files

2.8.1

2 files

2.8.0

2 files

2.7.0

1 file

2.6.6

1 file

2.6.5

1 file

2.6.4

1 file

2.6.3

2 files

2.6.2

2 files

2.6.1

2 files

2.6.0

1 file

2.5.1

2 files

2.5.0

2 files

2.4.14

2 files

2.4.13

1 file

2.4.12

2 files

2.4.11

2 files

2.4.9

1 file

2.4.8

2 files

2.4.7

2 files

2.4.6

2 files

2.4.5

2 files

2.4.4

2 files

2.4.3

2 files

2.4.2

2 files

2.4.1

2 files

2.4.0

2 files

2.3.1

2 files

2.3.0

2 files

2.2.1

2 files

2.2.0

2 files

2.1.0

2 files

2.0.1

2 files

2.0.0

2 files

Pre-release

2.0.0rc1

2 files

1.6.0

2 files

1.5.3

2 files

1.5.2

2 files

1.5.1

2 files

1.5.0

2 files

1.4.2

2 files

1.4.0

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.1.0

2 files

1.0.7

2 files

1.0.6

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page