articat: data artifact catalog
Project description
articat
Minimal metadata catalog to store and retrieve metadata about data artifacts.
High level features:
- set of predefined metadata models
- flexible metadata (arbitrary key-values)
- no long running services (low maintenance)
- IO/data format agnostic
- immutable metadata
Example:
To publish a file system Artifact:
from articat.fs_artifact import FSArtifact
from pathlib import Path
from datetime import date
with FSArtifact.partitioned(id="foo", partition=date.today()) as fsa:
tmp_file = fsa.joinpath("answer.txt")
Path(tmp_file).write_text("42")
fsa.metadata.description = "Answer to the Ultimate Question of Life, the Universe, and Everything"
To retrieve metadata about the Artifact above:
from articat.fs_artifact import FSArtifact
from datetime import date
FSArtifact.partitioned(id="foo", partition=date.today()).fetch()
Artifact flavours
Currently available Artifact flavours:
- File System Artifact: FSArtifact
- BigQuery Artifact: BQArtifact
- Notebook Artifact: NotebookArtifact
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
articat-0.1.1a1.tar.gz
(36.1 kB
view hashes)
Built Distribution
articat-0.1.1a1-py3-none-any.whl
(42.2 kB
view hashes)
Close
Hashes for articat-0.1.1a1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9ebc453b9489100836549876e374636fc7ad16a38eb3e0bd1ceb25798cc3f31 |
|
MD5 | 6d1e681430ba81b704fe34718e9dbcdb |
|
BLAKE2b-256 | 5f9a65c2c4d4c2e597e00c13d7316e84acf9b8249fbe59556d845ca6ca2b499a |