Skip to main content

artifact-hub

main workflow

Manage artifacts using object storage. Manage all kinds of artifacts E.g. models, json files, sqlite dbs and track their versions and history using any object store as a backend. This project facilitates self-hosted hub without a lot of management overhead.

Currently supported object stores include:

  • S3

Installation

pip install artifact-hub

Usage

  1. Create a sample file sample.txt

    This is a sample file 
    with multiline content
    
  2. Initialize the hub instance for a specific object/project

    from artifact_hub import s3_hub
    
    hub = s3_hub("bucket", "folder", "object_id")
    hub.push("sample.txt", "first push", "description of first push")
    

Limitations

  1. Concurrent push and pulls from multiple parties at the same time can not be handled. because of the linear nature of the history the last push will overwrite the previous one.
    Actor A and B tries to push concurrently
    Actor A and B pull latest version 10
    Actor A complete push version 11 early
    Actor B completes push version 11 late and overwrite Actor A's push. This may happen when Actor B is pushing a much larger change than A's
    

Release files for artifact-hub 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for artifact-hub 0.0.3
File Size Uploaded
artifact_hub-0.0.3.tar.gz 9.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for artifact-hub 0.0.3
File Interpreter ABI Platform
artifact_hub-0.0.3-py3-none-any.whl Python 3 none any Details

Total release size: 16.6 kB

Release files / artifact_hub-0.0.3.tar.gz

Download URL artifact_hub-0.0.3.tar.gz
Size 9.4 kB
Tags Source
SHA-256 checksum
How to use checksums
cac3b2379868b2beaac5866da78aebcb61ebf79b12f4febde75c4fd03db1996e
BLAKE2b-256 checksum
How to use checksums
6701bb8efae1b17c5154752e62e270a653e39e1389510c53eee7a0c855480d17
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.6

Release files / artifact_hub-0.0.3-py3-none-any.whl

Download URL artifact_hub-0.0.3-py3-none-any.whl
Size 7.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
588de5d056bc45a169bae3962273841e76d65536901cf392e445c984d4a918f2
BLAKE2b-256 checksum
How to use checksums
e600879febf98101149fdf770f98722f033350b5ead3a6d8b7e689208f0292a7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.6

Release history Release notifications | RSS feed

This release

0.0.3 This release

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page