Polars Unity Catalog IO Managers for Dagster
Project description
Dagster Unity Catalog Polars
A IO Manager to read Unity Catalog Tables in Dagster orchestrated pipelines.
Instantiating the IO Manager
To instantiate the IO Manager you need to pass a non-cached token generating function as a Callable[..., str] such that the load functions generate and refresh the thoken as needed. Is set to every 1000 queries by default, this should suffice most of the time.
You also need to pass the server hostname to your databricks workspace and the SQL Warehouse endpoint to which you'll be connecting to.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dagster_unity_catalog_polars-0.2.4.tar.gz.
File metadata
- Download URL: dagster_unity_catalog_polars-0.2.4.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
639731f15eccb3bcc886f493953c02d6e779e0625d08f743d96c012968e5213e
|
|
| MD5 |
73bdf8934738260cb95d0cadc656130f
|
|
| BLAKE2b-256 |
c12f4880b2ed948bbeb00b0b464d0a579a7490ef29d2c1be291fd1e308066740
|
File details
Details for the file dagster_unity_catalog_polars-0.2.4-py3-none-any.whl.
File metadata
- Download URL: dagster_unity_catalog_polars-0.2.4-py3-none-any.whl
- Upload date:
- Size: 13.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2ae51adbbf8d2fac9c14e9364accaf90ad09b54602c683153ca6f8aea27883b7
|
|
| MD5 |
ebfbc8b53ad9581a0cc59dd12227459c
|
|
| BLAKE2b-256 |
dd5684edb79f8bc8a2f4d6536cfeec7f4dccfc467c47945a7b1a73a0b4f1d312
|
