Dagster Toolbox
A set of tools to ease Dagster usage
Requirements
- Python 3.10+
- Dagster 1.6.13 / 0.22.13
Installation
pip install dagster-toolbox
Usage
New object storage resource
Declare resource
from dagster_toolbox.resources import ObjectStorage
class Analytics(ObjectStorage):
bucket = "analytics"
@resource
def analytics_objects(init_context):
return Analytics()
RESOURCE_DEFS = {
"analytics_objects": analytics_objects,
}
Use resource
@asset
def export_files(context):
partition_key = context.asset_partition_key_for_output()
file_path = f"analytics/data/{partition_key}"
file_resource = context.resource.analytics_objects.read(file_path)
...
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dagster_toolbox-0.0.23.tar.gz
(15.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dagster_toolbox-0.0.23.tar.gz.
File metadata
- Download URL: dagster_toolbox-0.0.23.tar.gz
- Upload date:
- Size: 15.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/5.1.1 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
65b6491f327e0c619704eb47d6b532cc9d48c3297b78403a02ba5353e9f65c5c
|
|
| MD5 |
e622101ec292246744f742b276d94bd7
|
|
| BLAKE2b-256 |
34f1e638a05150a9ee50a3f94b523fa9f7b47ddb9611503b12d9cfc6ba4cecb9
|
File details
Details for the file dagster_toolbox-0.0.23-py3-none-any.whl.
File metadata
- Download URL: dagster_toolbox-0.0.23-py3-none-any.whl
- Upload date:
- Size: 29.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/5.1.1 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e4ad6494c44e822f2934e91a219481b54f90ec5395d3e353ec54436087fec6c5
|
|
| MD5 |
23ec724de0a72702bd2374463959521b
|
|
| BLAKE2b-256 |
edf8f9c7c85a45f5368dae4db215e24c110e402e5d59c9c8adada206d94b1698
|
