gh_release_tools 0.1.5

Tools for data wrangling in github releases

Release Tools

Note: These tools are being used for my personal projects and are not meant for general public use.

This project provides a set of tools to manage publishing a large number of files using GitHub releases, particularly to overcome the 1000 file limit per release by creating supplementary releases. This assumes that gh (the GitHub CLI) is installed and configured on your system, as it is used to interact with GitHub releases.

Features

• Generate file lists: Create a CSV file containing a list of all files in a GitHub release.
• Upload files to a release: Upload files from a local directory to a GitHub release, with an option to overwrite existing files.

Installation

This project is packaged using Hatch. To install the tools, you can run the following command:

pip install .

This will install the gh_release_tools package and make the following command-line tools available:

• generate-lists
• upload-to-release

Usage

It is recommended to run the tools using uvx to avoid dependency conflicts with other installed packages.

uvx

uvx --from gh_release_tools generate-lists --release <tag> --extension <extension>
uvx --from gh_release_tools upload-to-release --release <tag> --folder <folder> --extension <extension> [--overwrite] [--create-extra-releases]

generate-lists

This tool generates a CSV file named listing_files.csv containing a list of assets from a specified GitHub release and its associated -extra releases. The CSV file includes the file name, size, and download URL for each asset. The generated CSV is then uploaded to the base release, overwriting any existing listing_files.csv.

Usage:

generate-lists --release <tag> --extension <ext1> [--extension <ext2> ...]

Arguments:

• --release, -r: The base name of the GitHub release (e.g., v1.0.0).
• --extension, -e: The file extension of the assets to include in the list (e.g., .zip). This argument can be specified multiple times for different extensions.

Example:

generate-lists --release v1.0.0 --extension .zip --extension .txt

This command will generate a listing_files.csv file with a list of all .zip and .txt files from the v1.0.0 release and any releases named v1.0.0-extra<number>.

upload-to-release

This tool uploads files from a local folder to a GitHub release. It can be configured to skip files that already exist in the release or to overwrite them. It can also create new supplementary releases if the target release is full.

Usage:

upload-to-release --release <tag> --folder <folder> --extension <ext1> [--extension <ext2> ...] [--overwrite] [--create-extra-releases]

Arguments:

• --release, -r: The git tag of the release to upload to.
• --folder, -d: The local folder containing the files to upload.
• --extension, -e: The file extension of the files to upload (e.g., .zip). This argument can be specified multiple times.
• --overwrite: (Optional) Overwrite existing assets in the release.
• --create-extra-releases, -x: (Optional) Create supplementary releases if the main release is full.

Example:

upload-to-release --release v1.0.0 --folder /path/to/files --extension .zip

This command will upload all .zip files from the /path/to/files directory to the v1.0.0 release. If a file with the same name already exists in the release, it will be skipped. To overwrite existing files, use the following command:

upload-to-release --release v1.0.0 --folder /path/to/files --extension .zip --overwrite