Skip to main content

Dagster Toolbox

A set of tools to ease Dagster usage

Requirements

  • Python 3.10+
  • Dagster 1.6.13 / 0.22.13

Installation

pip install dagster-toolbox

Usage

New object storage resource

Declare resource

from dagster_toolbox.resources import ObjectStorage


class Analytics(ObjectStorage):
    bucket = "analytics"
    

@resource
def analytics_objects(init_context):
    return Analytics()


RESOURCE_DEFS = {
    "analytics_objects": analytics_objects,
}

Use resource

@asset
def export_files(context):
    partition_key = context.asset_partition_key_for_output()
    file_path = f"analytics/data/{partition_key}"
    
    file_resource = context.resource.analytics_objects.read(file_path)    
    ...

Metadata

Release files for dagster-toolbox 0.0.23

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-toolbox 0.0.23
File Size Uploaded
dagster_toolbox-0.0.23.tar.gz 15.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-toolbox 0.0.23
File Interpreter ABI Platform
dagster_toolbox-0.0.23-py3-none-any.whl Python 3 none any Details

Total release size: 44.7 kB

Release files / dagster_toolbox-0.0.23.tar.gz

Download URL dagster_toolbox-0.0.23.tar.gz
Size 15.7 kB
Tags Source
SHA-256 checksum
How to use checksums
65b6491f327e0c619704eb47d6b532cc9d48c3297b78403a02ba5353e9f65c5c
BLAKE2b-256 checksum
How to use checksums
34f1e638a05150a9ee50a3f94b523fa9f7b47ddb9611503b12d9cfc6ba4cecb9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.5

Release files / dagster_toolbox-0.0.23-py3-none-any.whl

Download URL dagster_toolbox-0.0.23-py3-none-any.whl
Size 29.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e4ad6494c44e822f2934e91a219481b54f90ec5395d3e353ec54436087fec6c5
BLAKE2b-256 checksum
How to use checksums
edf8f9c7c85a45f5368dae4db215e24c110e402e5d59c9c8adada206d94b1698
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.5

Release history Release notifications | RSS feed

This release

0.0.23 This release

2 release files

0.0.20

2 release files

0.0.18

2 release files

0.0.17

2 release files

0.0.16

2 release files

0.0.15

2 release files

0.0.14

2 release files

0.0.13

2 release files

0.0.12

2 release files

0.0.11

2 release files

0.0.10

2 release files

0.0.9

2 release files

0.0.8

2 release files

0.0.7

2 release files

0.0.6

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

2 release files

0.0.1

2 release files

0.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page