Skip to main content

Changelogs for installable pending updates, or available/uninstalled packages

Project description

Changelog tool for Zypper

Both YUM & DNF can provide changelogs for pending package updates, or as-yet uninstalled packages. Zypper, the package manager favoured by openSUSE, lacks these capabilities currently.

This tool is a standalone work-around that uses zypper local cache files, specifically each repo's /var/cache/zypp/raw/(REPOSITORY-ALIAS)/repodata/*primary.xml.[gz|zst], to discover the latest version of each package that is available within each repository.

An RPM python interface is then used to interrogate the header of that latest-per-repo version. This facilitates having to only download the header of each rpm from the remote repositories, for each package queried.

The default is to consider only installable pending package updates. Analysing a large repository for all available packages is still somewhat extreme, and rarely required.

History

This endeavour represents a heavily modified version of zypper-changelog-plugin by Zoltán Balogh of SUSE.

These references differ in packaging details/config but share the LGPL-2.1-only licensed zypper-changelog file. The single Python source file differs by a pending GitHub PR fix; already in the OBS zypper-changelog-plugin-0.6.tar.gz. This file is renamed to zypper-changelog-lib.py with the original preserved within Git to help with Aims 6.

Aims

This fork's aims are to:

  1. Add library capability, enabling its use in other Python projects,
  2. Add common, non-optional constrains/optimisations not found in the original work. E.g. retrieving changelogs only for the latest version of each package in each repo.
  3. Lightly re-work the CLI options available; with the aim of simplifying its use.
  4. Add repo authentication capability such as for some SLES repos, via password-store initially. Required outside that already provided by zypper by virtue of our partial (http 206) requests.
  5. Reduce RAM requirements by further optimisations. The original, and still to a large extent this fork, struggle with larger repos on systems with < 4 GB RAM.
  6. Ultimately, contribute back to the original project if these goals align.

Use within Python projects

The current maintainer of this fork has a time-sensitive specific use for the modified code as presented. But as per Aims 6 above, it is hoped that over time all improvements can be shared with the above-referenced project.

PyPI page: zypper-changelog-lib

pip install zypper-changelog-lib

Your virtual environment, as per the included Poetry .venv config, needs to include:

Logging namespace starts with zypper_changelog_lib The returned dictionary has a package name index with list values containing changelog line elements. The first changelog line element is the package's version-release string.

from zypper_changelog_lib import get_zypper_changelog

zyppchange = get_zypper_changelog(repo_list=["Rockstor-Testing"], pkg_list=["rockstor"])
if zyppchange is None:
    return None
changelog_list: list = zyppchange.get("rockstor", [])
if changelog_list:  # First element is available package version pertaining to the changelog.
    new_version = changelog_list.pop(0)
    return new_version, changelog_list

OS package dependencies

Names based on openSUSE packages.

  • Python311 - A suspected minimum.
  • Python311-rpm - to interface with the OS's RPM version.
  • python311-requests - used for the partial (HTTP 206) rpm header retrievals.
  • password-store - repo authentication, via the Python keyring-pass module.
  • zstd - decompression tool used for the zypper cache files.
  • zypper - Obviously.

CLI use

The initial focus here is on enabling library functionality, but the following should work for testing purposes using the included Poetry config.

Poetry .venv preparation

From the source root:

poetry install

Note that zypper refresh ensures its cache files are up to date with repository content.

Default

List the changelogs for all installable updates

zypper refresh
poetry run zyppchangelog

Not all pending updates have accompanying changelog entries, in this case only the package name header will be output; e.g. Package: libvpl2 in the following example. Similarly, companion packages can sometimes share a changelog. The following is an example output containing both of the above.

Package: iproute2
* Wed Mar 19 2025 mkubecek@suse.cz
- avoid spurious cgroup warning (bsc#1234383):
  - ss-Tone-down-cgroup-path-resolution.patch

Package: iproute2-bash-completion
* Wed Mar 19 2025 mkubecek@suse.cz
- avoid spurious cgroup warning (bsc#1234383):
  - ss-Tone-down-cgroup-path-resolution.patch

Package: libvpl2

Repository Authentication

Required repository credentials are assumed to be held by password-store, by Jason A. Donenfeld of wireguard fame. But any keyring compatible back-end should work, if properly configured. The keyring-pass library provides the keyring interface to pass/password-store.

Keyring-pass, by default, has a prefix of "python-keyring". The following uses the CLI pass command from the password-store OS rpm package. A single set of credentials for the repo alias "Rockstor-Stable" have been added.

pass

Password Store
└── python-keyring
    └── zypper-changelog-lib
        └── Rockstor-Stable
            └── 43c30530-50e2-49a2-8a0f-f9b0ceae0402

The above credentials could have been added/updated via CLI:

pass add python-keyring/zypper-changelog-lib/Rockstor-Stable/43c30530-50e2-49a2-8a0f-f9b0ceae0402
# repo-pass-typed-in

Where 43c30530-50e2-49a2-8a0f-f9b0ceae0402 is the repository username counterpart.

Credentials can be removed via CLI:

pass delete python-keyring/zypper-changelog-lib/<repo-alias>/<auth-username>

Password retrieval via CLI:

pass python-keyring/zypper-changelog-lib/Rockstor-Stable/43c30530-50e2-49a2-8a0f-f9b0ceae0402
test-password

Password retrieval via Python:

poetry shell
python
>>> import keyring
>>> import keyring_pass
>>> repo_auth = keyring.get_credential("zypper-changelog-lib/Rockstor-Testing", None)
>>> print(repo_auth)
None
>>> repo_auth = keyring.get_credential("zypper-changelog-lib/Rockstor-Stable", None)
>>> print(type(repo_auth))
<class 'keyring.credentials.SimpleCredential'>
>>> print(repo_auth.username)
43c30530-50e2-49a2-8a0f-f9b0ceae0402
>>> print(repo_auth.password)
test-password

Note: If credentials exist for a repository (by alias) that does not require authentication, they will be retrieved, but not used: as the server will make no request for them.

Debug

An example containing both package and repository filtering with all debug logging redirected to a file:

zypper refresh
poetry run zyppchangelog -p zstd,acl,deltarpm -r openSUSE:update-slowroll -d 2> output-file.txt

Note: debug logs can be several MBs.

Known limitations

Internally, the OS provided zstd package is used to uncompress .gz or .zst zypper cache files. On Leap 15.6 and newer this is fine, but on Leap 15.5 (EOL) the following is indicated via debug output:

zstd: /var/cache/zypp/raw/...-primary.xml.gz: gzip file cannot be uncompressed (zstd compiled without HAVE_ZLIB) -- ignored

'Plaindir' type repositories are ignored as they have no associated/cached metadata. Similarly, repositories added without the 'refresh' option, or pending a zypper refresh, will also have no cached metadata. And as such will also be ignored.

There is still a large memory requirement: see Aims 5. Predominantly as we unzstd the zypper cache file (20/200 MB compressed/uncompressed) to /tmp (typically ramdisk), and subsequently use a non-stream approach to its parsing; resulting in two concurrent memory loads. It is proposed that the later be addressed via a stream-based approach to the XML parsing. Which would leave the former as a more manageable memory burden - given speed is also a concern here.

There exists a potential bug in the cache file parsing where no version-release is extracted for some packages. It is as-yet unknown if this is actually a parsing based bug, or if the info is just not available. When no version/release is found, the latest package per repo selection is indeterminate. However, retrieved rpm header rarely has no Ver/Rel information, and this is used when Ver/Rel is None from cache parsing. It has also been observed that cache file parsing can yield only Ver and no Rel! For repositories that have only a single version of each package, this is not an issue. But for package-specific repositories that have many versions of the same package, this could be important. Debug logging will indicate if a substitution was required.

There is as-yet no convenience Class interface. This would be a nice-to-have to ease exposing to clients more setting such as time-outs etc.

Two versions of the same package (by name) from different repositories are indeterminate. This limitation is predominantly down to the current output format of DICT for library use, and JSON as an optional output format. We currently index by package name alone: resulting in non-optimal overwrite potential.

Options and parameters

From:

poetry run zyppchangelog --help
usage: zyppchangelog [-h] [-p PACKAGES] [-r REPOS] [-of OUTF] [-d] [-t] [-re] [-AA]

Changelogs for installable pending updates, or available/uninstalled packages (requires options).

Note: '--all-available' alone is extreme: it retrieves rpm headers for
the latest version (per repo) of all available packages - taking no account of
what packages are installed. '--all-available' still heeds the filters
of '--packages' & '--repos' if specified, but the changelogs presented are
full default length: not a difference to any incidentally installed packages.

options:
  -h, --help            show this help message and exit
  -p PACKAGES, --packages PACKAGES
                        Comma separated list (no spaces) of package names to consider.
                        Default is all installed packages.
  -r REPOS, --repos REPOS
                        Comma separated list (no spaces) of repository aliases to consider.
                        Default is all enabled repositories.
  -of OUTF, --output-format OUTF
                        Options: 'json' - formatted single print.
                        Default is line-by-line prints.
  -d, --debug           Enable debug mode.
  -t, --titles-only     List only the changelog titles.
  -re, --regex          Enable regular expression in package names.
  -AA, --all-available  Changelogs for all available packages (latest versions only): USE WITH CAUTION.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

zypper_changelog_lib-0.7.9.tar.gz (46.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

zypper_changelog_lib-0.7.9-py3-none-any.whl (46.9 kB view details)

Uploaded Python 3

File details

Details for the file zypper_changelog_lib-0.7.9.tar.gz.

File metadata

  • Download URL: zypper_changelog_lib-0.7.9.tar.gz
  • Upload date:
  • Size: 46.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.11.11 Linux/6.4.0-150600.23.47-default

File hashes

Hashes for zypper_changelog_lib-0.7.9.tar.gz
Algorithm Hash digest
SHA256 f1a601a7607c190241d741db0c21ec9857b937c92786068c333c352aacd53535
MD5 16d435cc980936f88e5be1594443a1d6
BLAKE2b-256 a622210dfc499b1e154a1ad30cc504900bb112554b24446f8be350f65bfffde5

See more details on using hashes here.

File details

Details for the file zypper_changelog_lib-0.7.9-py3-none-any.whl.

File metadata

  • Download URL: zypper_changelog_lib-0.7.9-py3-none-any.whl
  • Upload date:
  • Size: 46.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.11.11 Linux/6.4.0-150600.23.47-default

File hashes

Hashes for zypper_changelog_lib-0.7.9-py3-none-any.whl
Algorithm Hash digest
SHA256 f5784eb1e93bdb9a663e9d4156f0564474c32f39b44719e0fcee591877719bce
MD5 2c81f80730a2d0d357265a090251e97d
BLAKE2b-256 d8c1f701ee820e93b36d0e580e941d52e6118515500f7c8490d03b94e959d986

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page